2024-09-13T14:51:58.662 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T14:51:58.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T14:51:58.781 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707 branch: wip-rishabh-testing-20240910.095512-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} email: null first_in_suite: false job_id: '7903707' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - client session with non-allowable root sha1: 50bbe7f395997dcd871813949c49addbbf630361 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 kclient: syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T14:51:58.781 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T14:51:58.782 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T14:51:58.782 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T14:51:58.784 INFO:teuthology.task.internal:Checking packages... 2024-09-13T14:51:58.809 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T14:51:58.810 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T14:51:58.810 INFO:teuthology.packaging:ref: None 2024-09-13T14:51:58.810 INFO:teuthology.packaging:tag: None 2024-09-13T14:51:58.810 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T14:51:58.810 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T14:51:58.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T14:51:58.963 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850-g50bbe7f3-1focal 2024-09-13T14:51:58.965 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T14:51:58.972 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T14:51:58.972 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T14:51:58.997 INFO:teuthology.task.internal:Saving configuration 2024-09-13T14:51:59.015 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T14:51:59.029 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T14:51:59.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 14:46:07.466174', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T14:51:59.093 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 14:46:07.468125', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T14:51:59.093 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T14:51:59.102 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T14:51:59.102 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T14:51:59.103 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T14:51:59.181 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f438a787be0>, signals=[15]) 2024-09-13T14:51:59.182 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T14:51:59.190 INFO:teuthology.task.internal:Opening connections... 2024-09-13T14:51:59.190 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T14:51:59.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:51:59.300 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T14:51:59.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:51:59.400 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T14:51:59.409 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-13T14:51:59.416 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-13T14:51:59.417 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-13T14:51:59.465 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-09-13T14:51:59.465 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T14:51:59.465 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-09-13T14:51:59.465 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="20.04" 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=focal 2024-09-13T14:51:59.466 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=focal 2024-09-13T14:51:59.467 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-13T14:51:59.496 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-13T14:51:59.503 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-13T14:51:59.503 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-13T14:51:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2024-09-13T14:51:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T14:51:59.552 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="20.04" 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T14:51:59.553 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=focal 2024-09-13T14:51:59.554 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=focal 2024-09-13T14:51:59.554 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-13T14:51:59.587 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T14:51:59.597 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T14:51:59.612 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T14:51:59.612 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-13T14:51:59.616 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-13T14:51:59.622 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T14:51:59.633 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T14:51:59.633 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-13T14:51:59.665 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-13T14:51:59.686 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T14:51:59.757 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T14:51:59.774 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T14:51:59.775 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T14:51:59.775 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T14:51:59.775 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T14:51:59.776 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T14:51:59.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T14:51:59.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T14:51:59.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T14:51:59.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T14:51:59.977 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:51:59.977 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T14:51:59.977 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-13T14:51:59.984 INFO:teuthology.orchestra.run.smithi181.stdout:5.4.0-124-generic 2024-09-13T14:51:59.984 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:51:59.984 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T14:51:59.985 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-13T14:51:59.985 DEBUG:teuthology.orchestra.run.smithi181:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T14:52:00.002 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:52:00.002 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T14:52:00.003 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-13T14:52:00.009 INFO:teuthology.orchestra.run.smithi050.stdout:5.4.0-124-generic 2024-09-13T14:52:00.010 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:52:00.010 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T14:52:00.010 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-13T14:52:00.010 DEBUG:teuthology.orchestra.run.smithi050:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T14:52:00.045 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T14:52:00.073 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T14:52:00.182 INFO:teuthology.orchestra.run.smithi181.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T14:52:00.184 DEBUG:teuthology.orchestra.run.smithi181:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T14:52:00.206 INFO:teuthology.orchestra.run.smithi050.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T14:52:00.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T14:52:00.216 DEBUG:teuthology.orchestra.run.smithi181:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T14:52:00.233 DEBUG:teuthology.orchestra.run.smithi181:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T14:52:00.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T14:52:00.251 DEBUG:teuthology.orchestra.run.smithi050:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T14:52:30.684 INFO:teuthology.orchestra.run.smithi181.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T14:52:30.684 INFO:teuthology.orchestra.run.smithi181.stderr: * [new branch] main -> origin/main 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T14:52:30.748 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T14:52:30.749 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T14:52:30.749 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T14:52:30.749 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T14:52:30.749 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T14:52:30.749 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T14:52:30.749 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T14:52:30.750 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T14:52:30.750 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T14:52:30.750 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T14:52:30.750 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T14:52:30.750 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T14:52:30.751 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T14:52:30.751 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T14:52:30.751 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T14:52:30.751 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T14:52:30.751 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T14:52:30.755 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T14:52:30.756 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T14:52:30.756 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T14:52:30.756 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T14:52:30.756 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T14:52:30.756 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T14:52:30.756 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T14:52:30.757 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T14:52:30.757 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T14:52:30.758 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T14:52:30.758 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T14:52:30.758 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T14:52:30.758 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T14:52:30.758 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T14:52:30.758 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T14:52:30.759 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T14:52:30.760 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T14:52:30.760 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T14:52:30.760 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T14:52:30.760 INFO:teuthology.orchestra.run.smithi181.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T14:52:35.299 INFO:teuthology.orchestra.run.smithi181.stderr:Updating files: 44% (1582/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2084/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2440/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2908/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T14:52:35.304 INFO:teuthology.orchestra.run.smithi181.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T14:52:35.322 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T14:52:35.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:52:35.476 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:52:35.477 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T14:52:35.479 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi181.front.sepia.ceph.com to complete... 2024-09-13T14:52:36.146 INFO:teuthology.orchestra.run.smithi050.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T14:52:36.146 INFO:teuthology.orchestra.run.smithi050.stderr: * [new branch] main -> origin/main 2024-09-13T14:52:36.214 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T14:52:36.215 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T14:52:36.215 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T14:52:36.215 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T14:52:36.215 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T14:52:36.215 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T14:52:36.215 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T14:52:36.217 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T14:52:36.218 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T14:52:36.222 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T14:52:36.223 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T14:52:36.224 INFO:teuthology.orchestra.run.smithi050.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T14:52:36.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13 14:52:36 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T14:52:36.481 INFO:teuthology.orchestra.run.smithi181.stderr:FINISHED --2024-09-13 14:52:36-- 2024-09-13T14:52:36.481 INFO:teuthology.orchestra.run.smithi181.stderr:Total wall clock time: 1.0s 2024-09-13T14:52:36.481 INFO:teuthology.orchestra.run.smithi181.stderr:Downloaded: 1 files, 43M in 0.9s (50.8 MB/s) 2024-09-13T14:52:36.484 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T14:52:36.484 DEBUG:teuthology.orchestra.run.smithi181:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T14:52:36.747 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T14:52:38.488 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T14:52:38.493 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T14:52:38.626 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T14:52:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:Updating files: 29% (1032/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2061/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2895/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T14:52:41.030 INFO:teuthology.orchestra.run.smithi050.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T14:52:41.050 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T14:52:41.051 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:52:41.199 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:52:41.200 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T14:52:41.202 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2024-09-13T14:52:41.939 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T14:52:42.065 INFO:teuthology.orchestra.run.smithi181.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:52:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13 14:52:41 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T14:52:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2024-09-13 14:52:41-- 2024-09-13T14:52:42.188 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 1.0s 2024-09-13T14:52:42.188 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 43M in 0.8s (51.9 MB/s) 2024-09-13T14:52:42.190 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T14:52:42.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T14:52:42.495 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T14:52:44.220 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T14:52:44.225 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T14:52:44.365 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T14:52:47.848 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T14:52:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:09.637 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub' 2024-09-13T14:53:09.652 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T14:53:09.681 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-09-13T14:53:09.988 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:10.012 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:10.374 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T14:53:10.387 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T14:53:12.394 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-09-13T14:53:12.577 DEBUG:teuthology.orchestra.run.smithi181:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T14:53:12.587 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T14:53:12.587 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T14:53:12.587 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:12.610 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:12.611 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T14:53:12.639 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T14:53:12.640 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T14:53:12.641 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T14:53:12.642 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T14:53:12.656 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T14:53:12.656 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T14:53:12.657 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T14:53:12.657 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T14:53:12.659 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T14:53:12.659 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T14:53:12.659 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T14:53:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T14:53:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T14:53:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T14:53:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T14:53:12.660 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T14:53:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T14:53:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T14:53:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T14:53:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T14:53:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T14:53:12.661 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T14:53:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T14:53:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T14:53:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T14:53:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T14:53:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T14:53:12.662 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T14:53:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T14:53:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T14:53:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T14:53:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T14:53:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T14:53:12.663 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T14:53:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T14:53:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T14:53:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T14:53:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T14:53:12.664 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T14:53:12.665 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T14:53:12.665 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T14:53:12.665 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T14:53:12.665 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T14:53:12.665 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T14:53:12.665 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T14:53:12.666 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T14:53:12.666 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T14:53:12.666 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T14:53:12.666 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T14:53:12.666 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T14:53:12.667 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T14:53:12.667 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T14:53:12.667 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T14:53:12.667 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T14:53:12.667 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T14:53:12.667 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T14:53:12.668 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T14:53:12.668 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T14:53:12.668 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T14:53:12.668 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T14:53:12.668 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T14:53:12.668 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T14:53:12.669 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T14:53:12.669 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T14:53:12.669 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T14:53:12.669 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T14:53:12.669 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T14:53:12.669 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T14:53:12.670 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T14:53:12.670 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T14:53:12.670 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T14:53:12.670 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T14:53:12.670 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T14:53:12.671 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T14:53:12.671 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T14:53:12.671 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T14:53:12.671 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T14:53:12.671 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T14:53:12.671 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T14:53:12.672 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T14:53:12.672 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T14:53:12.672 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T14:53:12.672 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T14:53:12.672 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T14:53:12.673 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T14:53:12.673 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T14:53:12.673 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T14:53:12.673 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T14:53:12.673 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T14:53:12.674 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T14:53:12.675 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T14:53:12.675 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T14:53:12.675 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T14:53:12.675 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T14:53:12.675 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T14:53:12.676 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T14:53:12.676 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T14:53:12.676 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T14:53:12.676 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T14:53:12.676 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T14:53:12.676 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T14:53:12.677 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T14:53:12.677 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T14:53:12.677 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T14:53:12.677 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T14:53:12.677 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T14:53:12.678 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T14:53:12.678 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T14:53:12.678 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T14:53:12.678 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T14:53:12.678 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T14:53:12.678 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T14:53:12.679 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T14:53:12.679 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T14:53:12.679 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T14:53:12.679 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T14:53:12.679 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T14:53:12.679 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T14:53:12.680 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T14:53:12.680 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T14:53:12.680 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T14:53:12.680 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T14:53:12.680 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T14:53:12.681 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T14:53:12.681 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T14:53:12.681 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T14:53:12.681 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T14:53:12.681 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T14:53:12.681 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T14:53:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T14:53:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T14:53:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T14:53:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T14:53:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T14:53:12.682 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T14:53:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T14:53:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T14:53:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T14:53:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T14:53:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T14:53:12.683 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T14:53:12.684 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T14:53:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T14:53:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T14:53:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T14:53:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T14:53:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T14:53:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T14:53:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T14:53:12.751 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T14:53:12.751 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T14:53:12.752 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T14:53:12.753 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T14:53:12.754 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T14:53:12.755 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T14:53:12.756 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T14:53:12.757 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T14:53:12.758 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T14:53:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T14:53:12.760 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T14:53:12.761 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T14:53:12.762 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T14:53:12.763 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T14:53:12.764 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T14:53:12.765 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T14:53:12.766 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T14:53:12.767 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T14:53:12.768 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T14:53:12.769 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T14:53:12.770 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T14:53:12.771 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T14:53:12.772 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T14:53:12.773 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T14:53:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T14:53:12.775 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T14:53:12.776 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T14:53:12.777 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T14:53:12.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T14:53:12.779 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T14:53:12.780 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T14:53:12.781 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T14:53:12.782 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T14:53:12.783 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T14:53:12.784 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T14:53:12.785 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T14:53:12.786 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T14:53:12.787 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T14:53:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T14:53:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T14:53:12.790 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T14:53:12.791 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T14:53:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T14:53:12.793 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T14:53:12.794 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T14:53:12.795 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T14:53:12.796 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T14:53:12.797 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T14:53:12.798 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T14:53:12.799 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T14:53:12.800 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T14:53:12.801 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T14:53:12.802 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T14:53:12.803 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T14:53:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T14:53:12.805 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T14:53:12.806 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T14:53:12.807 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T14:53:12.808 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T14:53:12.809 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T14:53:12.810 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T14:53:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T14:53:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T14:53:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T14:53:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T14:53:12.870 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T14:53:12.871 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T14:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T14:53:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T14:53:12.874 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T14:53:12.875 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T14:53:12.876 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T14:53:12.877 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T14:53:12.878 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T14:53:12.879 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T14:53:12.880 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T14:53:12.881 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T14:53:12.882 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T14:53:12.883 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T14:53:12.884 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T14:53:12.885 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T14:53:12.886 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T14:53:12.887 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T14:53:12.888 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T14:53:12.889 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T14:53:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T14:53:12.891 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T14:53:12.892 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T14:53:12.893 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T14:53:12.894 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T14:53:12.895 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T14:53:12.896 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T14:53:12.897 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T14:53:12.898 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T14:53:12.899 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T14:53:12.900 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T14:53:12.901 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T14:53:12.902 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T14:53:12.903 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T14:53:12.904 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T14:53:12.905 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T14:53:12.906 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T14:53:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T14:53:12.908 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T14:53:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T14:53:12.910 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T14:53:12.911 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T14:53:12.912 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T14:53:12.913 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T14:53:12.914 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T14:53:12.915 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T14:53:12.916 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T14:53:12.917 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T14:53:12.918 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T14:53:12.919 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T14:53:12.920 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T14:53:12.921 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T14:53:12.922 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T14:53:12.923 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T14:53:12.924 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T14:53:12.925 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T14:53:12.926 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T14:53:12.927 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T14:53:12.928 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T14:53:12.929 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T14:53:12.930 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T14:53:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T14:53:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T14:53:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T14:53:12.969 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T14:53:12.970 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T14:53:12.971 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T14:53:12.972 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T14:53:12.973 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T14:53:12.974 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T14:53:12.975 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T14:53:12.976 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T14:53:12.977 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T14:53:12.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T14:53:12.979 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T14:53:12.980 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T14:53:12.981 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T14:53:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T14:53:12.983 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T14:53:12.984 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T14:53:12.985 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T14:53:12.986 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T14:53:12.987 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T14:53:12.988 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T14:53:12.989 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T14:53:12.990 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T14:53:12.991 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T14:53:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T14:53:12.993 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T14:53:12.994 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T14:53:12.995 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T14:53:12.996 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T14:53:12.997 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T14:53:12.998 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T14:53:12.999 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T14:53:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T14:53:13.001 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T14:53:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T14:53:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T14:53:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T14:53:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T14:53:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T14:53:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T14:53:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T14:53:13.004 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T14:53:13.005 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T14:53:13.006 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T14:53:13.007 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T14:53:13.008 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T14:53:13.009 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T14:53:13.010 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T14:53:13.011 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T14:53:13.012 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T14:53:13.013 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T14:53:13.014 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T14:53:13.015 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T14:53:13.016 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T14:53:13.016 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T14:53:13.016 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T14:53:13.016 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T14:53:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T14:53:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T14:53:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T14:53:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T14:53:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T14:53:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T14:53:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T14:53:13.021 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T14:53:13.021 INFO:teuthology.orchestra.run.smithi181.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:53:13.021 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T14:53:13.021 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T14:53:13.031 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:13.032 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:13.032 DEBUG:teuthology.orchestra.run.smithi181:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T14:53:13.041 INFO:teuthology.orchestra.run.smithi181.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T14:53:13.041 INFO:teuthology.orchestra.run.smithi181.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T14:53:13.041 INFO:teuthology.orchestra.run.smithi181.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T14:53:13.041 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T14:53:13.042 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:13.042 DEBUG:teuthology.orchestra.run.smithi181:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T14:53:13.044 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi181.front.sepia.ceph.com to complete... 2024-09-13T14:53:13.719 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub' 2024-09-13T14:53:13.726 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T14:53:13.738 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-09-13T14:53:13.996 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:14.394 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T14:53:14.406 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T14:53:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-09-13T14:53:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-09-13T14:53:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T14:53:16.655 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-13T14:53:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T14:53:17.510 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T14:53:19.510 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-13T14:53:19.703 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T14:53:19.712 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T14:53:19.712 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T14:53:19.712 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:19.734 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:19.734 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T14:53:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T14:53:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T14:53:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T14:53:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T14:53:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T14:53:19.764 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T14:53:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T14:53:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T14:53:19.767 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T14:53:19.767 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T14:53:19.779 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T14:53:19.780 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T14:53:19.781 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T14:53:19.782 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T14:53:19.783 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T14:53:19.784 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T14:53:19.785 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T14:53:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T14:53:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T14:53:19.788 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T14:53:19.789 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T14:53:19.790 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T14:53:19.842 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T14:53:19.842 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T14:53:19.842 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T14:53:19.842 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T14:53:19.843 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T14:53:19.844 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T14:53:19.845 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T14:53:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T14:53:19.847 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T14:53:19.848 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T14:53:19.849 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T14:53:19.850 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T14:53:19.851 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T14:53:19.852 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T14:53:19.853 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T14:53:19.854 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T14:53:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T14:53:19.856 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T14:53:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T14:53:19.858 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T14:53:19.859 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T14:53:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T14:53:19.861 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T14:53:19.862 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T14:53:19.863 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T14:53:19.864 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T14:53:19.865 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T14:53:19.866 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T14:53:19.867 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T14:53:19.868 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T14:53:19.869 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T14:53:19.870 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T14:53:19.870 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T14:53:19.870 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T14:53:19.870 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T14:53:19.870 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T14:53:19.870 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T14:53:19.871 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T14:53:19.872 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T14:53:19.873 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T14:53:19.874 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T14:53:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T14:53:19.876 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T14:53:19.877 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T14:53:19.878 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T14:53:19.879 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T14:53:19.880 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T14:53:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T14:53:19.882 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T14:53:19.883 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T14:53:19.884 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T14:53:19.885 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T14:53:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T14:53:19.887 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T14:53:19.888 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T14:53:19.889 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T14:53:19.890 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T14:53:19.891 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T14:53:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T14:53:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T14:53:19.894 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T14:53:19.895 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T14:53:19.896 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T14:53:19.896 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T14:53:19.896 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T14:53:19.928 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T14:53:19.929 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T14:53:19.930 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T14:53:19.931 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T14:53:19.932 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T14:53:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T14:53:19.934 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T14:53:19.935 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T14:53:19.936 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T14:53:19.937 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T14:53:19.938 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T14:53:19.939 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T14:53:19.940 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T14:53:19.941 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T14:53:19.942 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T14:53:19.943 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T14:53:19.944 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T14:53:19.945 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T14:53:19.946 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T14:53:19.947 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T14:53:19.948 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T14:53:19.949 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T14:53:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T14:53:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T14:53:19.952 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T14:53:19.953 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T14:53:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T14:53:19.955 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T14:53:19.956 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T14:53:19.957 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T14:53:19.958 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T14:53:19.959 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T14:53:19.960 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T14:53:19.961 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T14:53:19.962 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T14:53:19.963 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T14:53:19.963 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T14:53:19.963 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T14:53:19.963 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T14:53:19.963 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T14:53:19.964 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T14:53:19.964 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T14:53:19.965 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T14:53:19.966 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T14:53:19.999 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T14:53:20.000 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T14:53:20.001 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T14:53:20.002 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T14:53:20.003 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T14:53:20.004 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T14:53:20.005 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T14:53:20.006 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T14:53:20.007 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T14:53:20.008 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T14:53:20.009 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T14:53:20.010 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T14:53:20.011 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T14:53:20.012 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T14:53:20.012 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T14:53:20.015 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T14:53:20.015 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T14:53:20.015 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T14:53:20.015 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T14:53:20.016 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T14:53:20.017 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T14:53:20.018 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T14:53:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T14:53:20.020 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T14:53:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T14:53:20.022 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T14:53:20.023 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T14:53:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T14:53:20.025 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T14:53:20.026 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T14:53:20.027 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T14:53:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T14:53:20.029 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T14:53:20.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T14:53:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T14:53:20.032 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T14:53:20.033 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T14:53:20.034 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T14:53:20.035 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T14:53:20.036 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T14:53:20.037 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T14:53:20.038 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T14:53:20.039 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T14:53:20.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T14:53:20.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T14:53:20.040 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T14:53:20.054 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T14:53:20.054 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T14:53:20.055 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T14:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T14:53:20.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T14:53:20.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T14:53:20.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T14:53:20.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T14:53:20.057 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T14:53:20.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T14:53:20.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T14:53:20.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T14:53:20.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T14:53:20.058 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T14:53:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T14:53:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T14:53:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T14:53:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T14:53:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T14:53:20.059 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T14:53:20.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T14:53:20.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T14:53:20.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T14:53:20.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T14:53:20.060 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T14:53:20.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T14:53:20.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T14:53:20.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T14:53:20.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T14:53:20.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T14:53:20.061 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T14:53:20.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T14:53:20.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T14:53:20.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T14:53:20.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T14:53:20.062 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T14:53:20.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T14:53:20.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T14:53:20.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T14:53:20.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T14:53:20.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T14:53:20.063 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T14:53:20.064 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T14:53:20.064 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T14:53:20.064 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T14:53:20.064 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T14:53:20.064 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T14:53:20.064 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T14:53:20.065 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T14:53:20.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T14:53:20.065 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T14:53:20.065 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T14:53:20.065 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T14:53:20.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T14:53:20.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T14:53:20.066 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T14:53:20.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T14:53:20.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T14:53:20.066 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T14:53:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T14:53:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T14:53:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T14:53:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T14:53:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T14:53:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T14:53:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T14:53:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T14:53:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T14:53:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T14:53:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T14:53:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T14:53:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T14:53:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T14:53:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T14:53:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T14:53:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T14:53:20.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T14:53:20.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T14:53:20.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T14:53:20.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T14:53:20.070 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T14:53:20.070 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T14:53:20.071 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T14:53:20.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T14:53:20.071 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T14:53:20.071 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T14:53:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T14:53:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T14:53:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T14:53:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T14:53:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T14:53:20.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T14:53:20.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T14:53:20.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T14:53:20.073 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T14:53:20.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T14:53:20.073 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T14:53:20.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T14:53:20.074 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T14:53:20.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T14:53:20.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T14:53:20.074 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T14:53:20.074 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T14:53:20.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T14:53:20.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T14:53:20.075 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T14:53:20.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T14:53:20.075 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T14:53:20.076 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T14:53:20.077 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T14:53:20.078 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T14:53:20.079 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T14:53:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T14:53:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T14:53:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T14:53:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T14:53:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T14:53:20.107 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T14:53:20.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T14:53:20.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T14:53:20.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T14:53:20.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T14:53:20.107 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T14:53:20.108 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T14:53:20.109 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T14:53:20.110 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T14:53:20.111 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T14:53:20.112 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T14:53:20.113 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T14:53:20.114 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T14:53:20.115 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T14:53:20.116 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T14:53:20.117 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T14:53:20.118 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T14:53:20.119 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T14:53:20.120 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T14:53:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T14:53:20.122 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T14:53:20.123 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T14:53:20.124 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T14:53:20.125 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T14:53:20.126 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T14:53:20.127 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T14:53:20.128 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T14:53:20.129 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T14:53:20.130 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T14:53:20.131 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T14:53:20.132 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T14:53:20.133 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T14:53:20.134 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T14:53:20.135 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T14:53:20.136 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T14:53:20.137 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T14:53:20.138 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T14:53:20.138 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T14:53:20.138 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T14:53:20.138 INFO:teuthology.orchestra.run.smithi050.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:53:20.138 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T14:53:20.138 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T14:53:20.142 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:20.143 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:20.143 DEBUG:teuthology.orchestra.run.smithi050:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T14:53:20.159 INFO:teuthology.orchestra.run.smithi050.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T14:53:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T14:53:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T14:53:20.159 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T14:53:20.160 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:20.160 DEBUG:teuthology.orchestra.run.smithi050:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T14:53:20.162 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi050.front.sepia.ceph.com to complete... 2024-09-13T14:53:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-09-13T14:53:20.816 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T14:53:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-13T14:53:21.143 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:21.155 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:53:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T14:53:21.556 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T14:53:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-13T14:53:46.570 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T14:53:46.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T14:53:46.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:53:53.625 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T14:53:53.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-13T14:53:53.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:54:05.121 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-13T14:54:12.033 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-09-13T14:54:14.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T14:54:14.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:54:17.217 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-13T14:54:21.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-13T14:54:21.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:54:29.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T14:54:29.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:55:00.934 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-13T14:55:01.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T14:55:01.681 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T14:55:01.681 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-13T14:55:01.738 INFO:teuthology.orchestra.run.smithi181.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:55:01.738 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:55:01.738 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T14:55:01.738 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T14:55:02.739 DEBUG:teuthology.parallel:result is None 2024-09-13T14:55:21.048 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T14:55:33.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-13T14:55:33.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:55:33.322 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-13T14:55:34.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-13T14:55:34.074 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T14:55:34.074 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-13T14:55:34.133 INFO:teuthology.orchestra.run.smithi050.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:55:34.136 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:55:34.136 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T14:55:34.136 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T14:55:35.139 DEBUG:teuthology.parallel:result is None 2024-09-13T14:55:35.139 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T14:55:35.147 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T14:55:35.147 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T14:55:35.153 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T14:55:35.169 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T14:55:35.187 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T14:55:35.239 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T14:55:35.239 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T14:55:35.245 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T14:55:35.279 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T14:55:35.285 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T14:55:35.285 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T14:55:35.321 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T14:55:35.429 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:55:35.442 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:55:35.461 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:55:35.489 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:55:35.493 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T14:55:35.500 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T14:55:35.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T14:55:35.504 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T14:55:35.538 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T14:55:35.687 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T14:55:35.687 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T14:55:35.693 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T14:55:35.713 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T14:55:35.769 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T14:55:35.830 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T14:55:35.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T14:55:35.908 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T14:55:35.928 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T14:55:35.987 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T14:55:35.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T14:55:36.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-13T14:55:36.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-13T14:55:36.254 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T14:55:36.262 INFO:teuthology.task.internal:Starting timer... 2024-09-13T14:55:36.262 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T14:55:36.347 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T14:55:36.396 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-09-13T14:55:36.396 DEBUG:teuthology.task.selinux:Excluding smithi181: OS 'ubuntu' does not support SELinux 2024-09-13T14:55:36.396 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T14:55:36.396 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T14:55:36.396 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T14:55:36.396 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T14:55:36.420 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T14:55:36.433 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T14:55:36.434 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T15:02:53.176 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-09-13T15:02:53.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-13T15:02:53.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:02:53.290 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-13T15:02:53.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-13T15:02:53.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T15:02:53.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:02:53.634 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-13T15:02:53.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T15:02:53.847 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T15:02:53.861 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T15:02:53.861 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:02:53.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:02:53.867 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:02:53.867 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:02:53.940 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T15:02:53.940 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Command line: ntpd -gq 2024-09-13T15:02:53.942 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: proto: precision = 0.044 usec (-24) 2024-09-13T15:02:53.942 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T15:02:53.942 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T15:02:53.942 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T15:02:53.943 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listen normally on 4 lo [::1]:123 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%4]:123 2024-09-13T15:02:53.944 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:02:53 ntpd[13500]: Listening on routing socket on fd #22 for interface updates 2024-09-13T15:02:53.958 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T15:02:53.958 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Command line: ntpd -gq 2024-09-13T15:02:53.959 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: proto: precision = 0.041 usec (-24) 2024-09-13T15:02:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T15:02:53.960 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T15:02:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T15:02:53.961 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T15:02:53.961 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T15:02:53.962 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T15:02:53.962 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T15:02:53.962 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listen normally on 3 enp3s0f1 172.21.15.181:123 2024-09-13T15:02:53.962 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listen normally on 4 lo [::1]:123 2024-09-13T15:02:53.962 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b9d%5]:123 2024-09-13T15:02:53.962 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:02:53 ntpd[13636]: Listening on routing socket on fd #22 for interface updates 2024-09-13T15:02:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:54 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:54.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:54 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:54 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:54 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:54 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:54.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:54 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:54.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:54 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:54.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:54 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:54.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:54 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:54.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:54 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:54.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:54 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:54.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:54 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:55.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:55.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:55.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:55.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:55.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:55.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:55.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:55.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:55 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:56 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:56 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:56 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:56.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:56 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:56 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:56.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:56 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:56.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:56.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:56.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:56.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:56.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:56.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:56 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:57.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:57.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:57.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:57.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:57 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:57.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:57 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:57.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:57 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:57.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:57 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:57.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:57 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:57.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:57 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:57.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:57 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:58 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:58 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:58 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:58 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:58 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:58.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:58 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:58.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:58.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:58 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:02:59 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:02:59.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:59 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:59.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:59 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:59.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:59 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:02:59.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:59 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:02:59.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:59 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:02:59.959 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:02:59 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:03:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:03:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:03:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:03:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:03:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:03:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:03:00.942 INFO:teuthology.orchestra.run.smithi050.stdout:13 Sep 15:03:00 ntpd[13500]: ntpd: time slew -0.000678 s 2024-09-13T15:03:00.942 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.000678s 2024-09-13T15:03:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T15:03:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:13 Sep 15:03:00 ntpd[13500]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:03:00.961 INFO:teuthology.orchestra.run.smithi181.stdout:13 Sep 15:03:00 ntpd[13636]: ntpd: time slew +0.000804 s 2024-09-13T15:03:00.961 INFO:teuthology.orchestra.run.smithi181.stdout:ntpd: time slew +0.000804s 2024-09-13T15:03:00.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T15:03:00.961 INFO:teuthology.orchestra.run.smithi181.stderr:13 Sep 15:03:00 ntpd[13636]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T15:03:01.078 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:03:01.078 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-13T15:03:01.078 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.079 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.079 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.079 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.110 INFO:teuthology.orchestra.run.smithi181.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:03:01.110 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================== 2024-09-13T15:03:01.110 INFO:teuthology.orchestra.run.smithi181.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.110 INFO:teuthology.orchestra.run.smithi181.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.111 INFO:teuthology.orchestra.run.smithi181.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.111 INFO:teuthology.orchestra.run.smithi181.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T15:03:01.113 INFO:teuthology.run_tasks:Running task install... 2024-09-13T15:03:01.122 DEBUG:teuthology.task.install:project ceph 2024-09-13T15:03:01.122 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T15:03:01.122 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T15:03:01.122 INFO:teuthology.task.install:Using flavor: default 2024-09-13T15:03:01.128 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T15:03:01.128 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T15:03:01.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-09-13T15:03:01.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-key list | grep Ceph 2024-09-13T15:03:01.355 INFO:teuthology.orchestra.run.smithi181.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T15:03:01.364 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T15:03:01.490 INFO:teuthology.orchestra.run.smithi181.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T15:03:01.490 INFO:teuthology.orchestra.run.smithi181.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T15:03:01.492 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T15:03:01.492 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T15:03:01.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:03:01.509 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T15:03:01.509 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T15:03:01.511 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T15:03:01.511 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T15:03:01.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:03:01.647 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default/ 2024-09-13T15:03:01.648 INFO:teuthology.task.install.deb:Package version is 18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:03:01.668 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default/ 2024-09-13T15:03:01.668 INFO:teuthology.task.install.deb:Package version is 18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:03:01.916 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:03:01.916 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T15:03:01.949 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:03:01.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T15:03:01.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-09-13T15:03:01.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-13T15:03:02.225 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T15:03:02.324 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T15:03:02.402 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T15:03:02.402 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T15:03:02.406 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T15:03:02.441 INFO:teuthology.orchestra.run.smithi181.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal InRelease 2024-09-13T15:03:02.455 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T15:03:02.488 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T15:03:02.491 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal InRelease 2024-09-13T15:03:02.513 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T15:03:02.537 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T15:03:02.560 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T15:03:02.587 INFO:teuthology.orchestra.run.smithi181.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T15:03:02.632 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T15:03:02.656 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T15:03:02.703 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main i386 Packages [3,435 B] 2024-09-13T15:03:02.756 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main i386 Packages [3,435 B] 2024-09-13T15:03:02.806 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T15:03:03.579 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 28.7 kB in 1s (22.4 kB/s) 2024-09-13T15:03:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.7 kB in 1s (19.1 kB/s) 2024-09-13T15:03:04.873 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-09-13T15:03:04.909 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-850-g50bbe7f3-1focal cephadm=18.2.4-850-g50bbe7f3-1focal ceph-mds=18.2.4-850-g50bbe7f3-1focal ceph-mgr=18.2.4-850-g50bbe7f3-1focal ceph-common=18.2.4-850-g50bbe7f3-1focal ceph-fuse=18.2.4-850-g50bbe7f3-1focal ceph-test=18.2.4-850-g50bbe7f3-1focal ceph-volume=18.2.4-850-g50bbe7f3-1focal radosgw=18.2.4-850-g50bbe7f3-1focal python3-rados=18.2.4-850-g50bbe7f3-1focal python3-rgw=18.2.4-850-g50bbe7f3-1focal python3-cephfs=18.2.4-850-g50bbe7f3-1focal python3-rbd=18.2.4-850-g50bbe7f3-1focal libcephfs2=18.2.4-850-g50bbe7f3-1focal libcephfs-dev=18.2.4-850-g50bbe7f3-1focal librados2=18.2.4-850-g50bbe7f3-1focal librbd1=18.2.4-850-g50bbe7f3-1focal rbd-fuse=18.2.4-850-g50bbe7f3-1focal python3-cephfs=18.2.4-850-g50bbe7f3-1focal cephfs-shell=18.2.4-850-g50bbe7f3-1focal cephfs-top=18.2.4-850-g50bbe7f3-1focal cephfs-mirror=18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:03:05.024 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-09-13T15:03:05.177 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-13T15:03:05.217 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-09-13T15:03:05.218 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-09-13T15:03:05.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-850-g50bbe7f3-1focal cephadm=18.2.4-850-g50bbe7f3-1focal ceph-mds=18.2.4-850-g50bbe7f3-1focal ceph-mgr=18.2.4-850-g50bbe7f3-1focal ceph-common=18.2.4-850-g50bbe7f3-1focal ceph-fuse=18.2.4-850-g50bbe7f3-1focal ceph-test=18.2.4-850-g50bbe7f3-1focal ceph-volume=18.2.4-850-g50bbe7f3-1focal radosgw=18.2.4-850-g50bbe7f3-1focal python3-rados=18.2.4-850-g50bbe7f3-1focal python3-rgw=18.2.4-850-g50bbe7f3-1focal python3-cephfs=18.2.4-850-g50bbe7f3-1focal python3-rbd=18.2.4-850-g50bbe7f3-1focal libcephfs2=18.2.4-850-g50bbe7f3-1focal libcephfs-dev=18.2.4-850-g50bbe7f3-1focal librados2=18.2.4-850-g50bbe7f3-1focal librbd1=18.2.4-850-g50bbe7f3-1focal rbd-fuse=18.2.4-850-g50bbe7f3-1focal python3-cephfs=18.2.4-850-g50bbe7f3-1focal cephfs-shell=18.2.4-850-g50bbe7f3-1focal cephfs-top=18.2.4-850-g50bbe7f3-1focal cephfs-mirror=18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:03:05.341 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-13T15:03:05.416 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:03:05.417 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T15:03:05.417 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:03:05.418 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-09-13T15:03:05.418 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T15:03:05.419 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T15:03:05.420 INFO:teuthology.orchestra.run.smithi181.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T15:03:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T15:03:05.422 INFO:teuthology.orchestra.run.smithi181.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T15:03:05.422 INFO:teuthology.orchestra.run.smithi181.stdout:Recommended packages: 2024-09-13T15:03:05.422 INFO:teuthology.orchestra.run.smithi181.stdout: btrfs-tools 2024-09-13T15:03:05.540 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-13T15:03:05.540 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T15:03:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T15:03:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T15:03:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T15:03:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T15:03:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T15:03:05.635 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages will be upgraded: 2024-09-13T15:03:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 librbd1 2024-09-13T15:03:05.720 INFO:teuthology.orchestra.run.smithi181.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T15:03:05.720 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 199 MB of archives. 2024-09-13T15:03:05.720 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T15:03:05.720 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T15:03:05.740 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T15:03:05.745 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:03:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T15:03:05.746 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:03:05.746 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-13T15:03:05.746 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T15:03:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T15:03:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T15:03:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T15:03:05.747 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T15:03:05.748 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T15:03:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T15:03:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T15:03:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T15:03:05.748 INFO:teuthology.orchestra.run.smithi050.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T15:03:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T15:03:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T15:03:05.750 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-13T15:03:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T15:03:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T15:03:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T15:03:05.750 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-13T15:03:05.751 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-09-13T15:03:05.773 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T15:03:05.804 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T15:03:05.806 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T15:03:05.811 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-850-g50bbe7f3-1focal [3,450 kB] 2024-09-13T15:03:05.824 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T15:03:05.868 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T15:03:05.871 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T15:03:05.879 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T15:03:05.881 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T15:03:05.882 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T15:03:05.883 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T15:03:05.883 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T15:03:05.887 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T15:03:05.887 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T15:03:05.889 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T15:03:05.903 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T15:03:05.904 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T15:03:05.904 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T15:03:05.905 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T15:03:05.905 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T15:03:05.906 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T15:03:05.920 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T15:03:05.921 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T15:03:05.922 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T15:03:05.923 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T15:03:05.937 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T15:03:05.941 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T15:03:05.941 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T15:03:05.942 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T15:03:05.942 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T15:03:05.943 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T15:03:05.954 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T15:03:05.955 INFO:teuthology.orchestra.run.smithi181.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T15:03:05.957 INFO:teuthology.orchestra.run.smithi181.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T15:03:05.957 INFO:teuthology.orchestra.run.smithi181.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T15:03:05.971 INFO:teuthology.orchestra.run.smithi181.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T15:03:05.972 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T15:03:05.973 INFO:teuthology.orchestra.run.smithi181.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T15:03:05.974 INFO:teuthology.orchestra.run.smithi181.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T15:03:05.974 INFO:teuthology.orchestra.run.smithi181.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T15:03:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T15:03:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T15:03:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T15:03:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T15:03:05.975 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T15:03:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T15:03:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T15:03:05.976 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-09-13T15:03:05.976 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 librbd1 2024-09-13T15:03:05.976 INFO:teuthology.orchestra.run.smithi181.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T15:03:05.977 INFO:teuthology.orchestra.run.smithi181.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T15:03:05.988 INFO:teuthology.orchestra.run.smithi181.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T15:03:05.989 INFO:teuthology.orchestra.run.smithi181.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T15:03:05.989 INFO:teuthology.orchestra.run.smithi181.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-850-g50bbe7f3-1focal [4,041 kB] 2024-09-13T15:03:05.991 INFO:teuthology.orchestra.run.smithi181.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T15:03:05.991 INFO:teuthology.orchestra.run.smithi181.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T15:03:06.005 INFO:teuthology.orchestra.run.smithi181.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T15:03:06.006 INFO:teuthology.orchestra.run.smithi181.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T15:03:06.008 INFO:teuthology.orchestra.run.smithi181.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T15:03:06.008 INFO:teuthology.orchestra.run.smithi181.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T15:03:06.009 INFO:teuthology.orchestra.run.smithi181.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T15:03:06.051 INFO:teuthology.orchestra.run.smithi181.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-850-g50bbe7f3-1focal [747 kB] 2024-09-13T15:03:06.058 INFO:teuthology.orchestra.run.smithi181.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-850-g50bbe7f3-1focal [386 kB] 2024-09-13T15:03:06.066 INFO:teuthology.orchestra.run.smithi181.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-850-g50bbe7f3-1focal [31.9 kB] 2024-09-13T15:03:06.067 INFO:teuthology.orchestra.run.smithi181.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-850-g50bbe7f3-1focal [201 kB] 2024-09-13T15:03:06.070 INFO:teuthology.orchestra.run.smithi181.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-850-g50bbe7f3-1focal [62.5 kB] 2024-09-13T15:03:06.071 INFO:teuthology.orchestra.run.smithi181.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-850-g50bbe7f3-1focal [367 kB] 2024-09-13T15:03:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T15:03:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 199 MB of archives. 2024-09-13T15:03:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T15:03:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T15:03:06.076 INFO:teuthology.orchestra.run.smithi181.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-850-g50bbe7f3-1focal [6,627 kB] 2024-09-13T15:03:06.094 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T15:03:06.099 INFO:teuthology.orchestra.run.smithi181.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T15:03:06.103 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T15:03:06.118 INFO:teuthology.orchestra.run.smithi181.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T15:03:06.119 INFO:teuthology.orchestra.run.smithi181.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T15:03:06.131 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T15:03:06.133 INFO:teuthology.orchestra.run.smithi181.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T15:03:06.133 INFO:teuthology.orchestra.run.smithi181.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T15:03:06.133 INFO:teuthology.orchestra.run.smithi181.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T15:03:06.134 INFO:teuthology.orchestra.run.smithi181.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T15:03:06.134 INFO:teuthology.orchestra.run.smithi181.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T15:03:06.135 INFO:teuthology.orchestra.run.smithi181.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T15:03:06.136 INFO:teuthology.orchestra.run.smithi181.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T15:03:06.137 INFO:teuthology.orchestra.run.smithi181.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T15:03:06.152 INFO:teuthology.orchestra.run.smithi181.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T15:03:06.153 INFO:teuthology.orchestra.run.smithi181.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T15:03:06.158 INFO:teuthology.orchestra.run.smithi181.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T15:03:06.160 INFO:teuthology.orchestra.run.smithi181.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T15:03:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T15:03:06.163 INFO:teuthology.orchestra.run.smithi181.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T15:03:06.165 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T15:03:06.170 INFO:teuthology.orchestra.run.smithi181.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T15:03:06.174 INFO:teuthology.orchestra.run.smithi181.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T15:03:06.179 INFO:teuthology.orchestra.run.smithi181.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T15:03:06.180 INFO:teuthology.orchestra.run.smithi181.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T15:03:06.180 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T15:03:06.188 INFO:teuthology.orchestra.run.smithi181.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-850-g50bbe7f3-1focal [113 kB] 2024-09-13T15:03:06.189 INFO:teuthology.orchestra.run.smithi181.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-850-g50bbe7f3-1focal [479 kB] 2024-09-13T15:03:06.194 INFO:teuthology.orchestra.run.smithi181.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-850-g50bbe7f3-1focal [25.2 MB] 2024-09-13T15:03:06.199 INFO:teuthology.orchestra.run.smithi181.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T15:03:06.202 INFO:teuthology.orchestra.run.smithi181.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T15:03:06.204 INFO:teuthology.orchestra.run.smithi181.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T15:03:06.231 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-850-g50bbe7f3-1focal [3,450 kB] 2024-09-13T15:03:06.232 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T15:03:06.234 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T15:03:06.243 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T15:03:06.245 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T15:03:06.246 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T15:03:06.247 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T15:03:06.248 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T15:03:06.249 INFO:teuthology.orchestra.run.smithi181.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T15:03:06.250 INFO:teuthology.orchestra.run.smithi181.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T15:03:06.250 INFO:teuthology.orchestra.run.smithi181.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T15:03:06.251 INFO:teuthology.orchestra.run.smithi181.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T15:03:06.252 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T15:03:06.252 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T15:03:06.254 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T15:03:06.264 INFO:teuthology.orchestra.run.smithi181.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T15:03:06.265 INFO:teuthology.orchestra.run.smithi181.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T15:03:06.266 INFO:teuthology.orchestra.run.smithi181.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T15:03:06.266 INFO:teuthology.orchestra.run.smithi181.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T15:03:06.267 INFO:teuthology.orchestra.run.smithi181.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T15:03:06.270 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T15:03:06.270 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T15:03:06.273 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T15:03:06.275 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T15:03:06.276 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T15:03:06.277 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T15:03:06.287 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T15:03:06.288 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T15:03:06.290 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T15:03:06.292 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T15:03:06.305 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T15:03:06.312 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T15:03:06.312 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T15:03:06.313 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T15:03:06.314 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T15:03:06.316 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T15:03:06.322 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T15:03:06.323 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T15:03:06.326 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T15:03:06.327 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T15:03:06.345 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T15:03:06.348 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T15:03:06.350 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T15:03:06.351 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T15:03:06.352 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T15:03:06.355 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T15:03:06.362 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T15:03:06.363 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T15:03:06.365 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T15:03:06.365 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T15:03:06.380 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T15:03:06.386 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T15:03:06.389 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T15:03:06.390 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T15:03:06.391 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T15:03:06.491 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T15:03:06.511 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T15:03:06.513 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T15:03:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T15:03:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T15:03:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T15:03:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T15:03:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T15:03:06.530 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T15:03:06.530 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T15:03:06.531 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T15:03:06.547 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T15:03:06.548 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T15:03:06.553 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T15:03:06.556 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T15:03:06.559 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T15:03:06.569 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T15:03:06.575 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T15:03:06.580 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T15:03:06.580 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T15:03:06.598 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T15:03:06.601 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T15:03:06.603 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T15:03:06.630 INFO:teuthology.orchestra.run.smithi181.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-850-g50bbe7f3-1focal [9,614 kB] 2024-09-13T15:03:06.648 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T15:03:06.649 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T15:03:06.649 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T15:03:06.650 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T15:03:06.663 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T15:03:06.664 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T15:03:06.665 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T15:03:06.666 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T15:03:06.666 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T15:03:06.787 INFO:teuthology.orchestra.run.smithi181.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-850-g50bbe7f3-1focal [238 kB] 2024-09-13T15:03:06.790 INFO:teuthology.orchestra.run.smithi181.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-850-g50bbe7f3-1focal [148 kB] 2024-09-13T15:03:06.791 INFO:teuthology.orchestra.run.smithi181.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-850-g50bbe7f3-1focal [1,575 kB] 2024-09-13T15:03:06.817 INFO:teuthology.orchestra.run.smithi181.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-850-g50bbe7f3-1focal [6,639 kB] 2024-09-13T15:03:06.937 INFO:teuthology.orchestra.run.smithi181.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-850-g50bbe7f3-1focal [24.5 MB] 2024-09-13T15:03:07.368 INFO:teuthology.orchestra.run.smithi181.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-850-g50bbe7f3-1focal [13.7 kB] 2024-09-13T15:03:07.369 INFO:teuthology.orchestra.run.smithi181.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-850-g50bbe7f3-1focal [856 kB] 2024-09-13T15:03:07.377 INFO:teuthology.orchestra.run.smithi181.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-850-g50bbe7f3-1focal [2,296 kB] 2024-09-13T15:03:07.416 INFO:teuthology.orchestra.run.smithi181.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-850-g50bbe7f3-1focal [239 kB] 2024-09-13T15:03:07.418 INFO:teuthology.orchestra.run.smithi181.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-850-g50bbe7f3-1focal [143 kB] 2024-09-13T15:03:07.421 INFO:teuthology.orchestra.run.smithi181.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-850-g50bbe7f3-1focal [7,015 kB] 2024-09-13T15:03:07.486 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-850-g50bbe7f3-1focal [4,041 kB] 2024-09-13T15:03:07.551 INFO:teuthology.orchestra.run.smithi181.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-850-g50bbe7f3-1focal [7,873 kB] 2024-09-13T15:03:07.689 INFO:teuthology.orchestra.run.smithi181.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-850-g50bbe7f3-1focal [13.9 kB] 2024-09-13T15:03:07.689 INFO:teuthology.orchestra.run.smithi181.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-850-g50bbe7f3-1focal [46.9 MB] 2024-09-13T15:03:08.115 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-850-g50bbe7f3-1focal [747 kB] 2024-09-13T15:03:08.211 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-850-g50bbe7f3-1focal [386 kB] 2024-09-13T15:03:08.223 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-850-g50bbe7f3-1focal [31.9 kB] 2024-09-13T15:03:08.223 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-850-g50bbe7f3-1focal [201 kB] 2024-09-13T15:03:08.271 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-850-g50bbe7f3-1focal [62.5 kB] 2024-09-13T15:03:08.273 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-850-g50bbe7f3-1focal [367 kB] 2024-09-13T15:03:08.325 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-850-g50bbe7f3-1focal [6,627 kB] 2024-09-13T15:03:08.601 INFO:teuthology.orchestra.run.smithi181.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-850-g50bbe7f3-1focal [120 kB] 2024-09-13T15:03:08.602 INFO:teuthology.orchestra.run.smithi181.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-850-g50bbe7f3-1focal [270 kB] 2024-09-13T15:03:08.605 INFO:teuthology.orchestra.run.smithi181.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-850-g50bbe7f3-1focal [33.0 kB] 2024-09-13T15:03:08.605 INFO:teuthology.orchestra.run.smithi181.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-850-g50bbe7f3-1focal [22.8 kB] 2024-09-13T15:03:08.606 INFO:teuthology.orchestra.run.smithi181.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-850-g50bbe7f3-1focal [37.4 kB] 2024-09-13T15:03:08.606 INFO:teuthology.orchestra.run.smithi181.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-850-g50bbe7f3-1focal [13.5 MB] 2024-09-13T15:03:08.858 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-850-g50bbe7f3-1focal [113 kB] 2024-09-13T15:03:08.874 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-850-g50bbe7f3-1focal [479 kB] 2024-09-13T15:03:08.876 INFO:teuthology.orchestra.run.smithi181.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-850-g50bbe7f3-1focal [107 kB] 2024-09-13T15:03:08.883 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-850-g50bbe7f3-1focal [25.2 MB] 2024-09-13T15:03:09.329 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-850-g50bbe7f3-1focal [9,614 kB] 2024-09-13T15:03:09.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-850-g50bbe7f3-1focal [238 kB] 2024-09-13T15:03:09.483 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-850-g50bbe7f3-1focal [148 kB] 2024-09-13T15:03:09.486 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-850-g50bbe7f3-1focal [1,575 kB] 2024-09-13T15:03:09.509 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-850-g50bbe7f3-1focal [6,639 kB] 2024-09-13T15:03:09.620 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-850-g50bbe7f3-1focal [24.5 MB] 2024-09-13T15:03:09.811 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 199 MB in 3s (61.7 MB/s) 2024-09-13T15:03:09.989 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T15:03:10.028 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-850-g50bbe7f3-1focal [13.7 kB] 2024-09-13T15:03:10.029 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-850-g50bbe7f3-1focal [856 kB] 2024-09-13T15:03:10.037 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-850-g50bbe7f3-1focal [2,296 kB] 2024-09-13T15:03:10.056 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T15:03:10.060 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T15:03:10.076 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-850-g50bbe7f3-1focal [239 kB] 2024-09-13T15:03:10.080 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-850-g50bbe7f3-1focal [143 kB] 2024-09-13T15:03:10.082 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-850-g50bbe7f3-1focal [7,015 kB] 2024-09-13T15:03:10.134 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T15:03:10.196 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-850-g50bbe7f3-1focal [7,873 kB] 2024-09-13T15:03:10.325 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-850-g50bbe7f3-1focal [13.9 kB] 2024-09-13T15:03:10.326 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-850-g50bbe7f3-1focal [46.9 MB] 2024-09-13T15:03:10.454 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T15:03:10.473 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T15:03:10.545 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T15:03:10.882 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T15:03:10.903 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T15:03:10.982 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T15:03:11.108 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-850-g50bbe7f3-1focal [120 kB] 2024-09-13T15:03:11.109 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-850-g50bbe7f3-1focal [270 kB] 2024-09-13T15:03:11.112 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-850-g50bbe7f3-1focal [33.0 kB] 2024-09-13T15:03:11.112 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-850-g50bbe7f3-1focal [22.8 kB] 2024-09-13T15:03:11.113 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-850-g50bbe7f3-1focal [37.4 kB] 2024-09-13T15:03:11.113 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-850-g50bbe7f3-1focal [13.5 MB] 2024-09-13T15:03:11.325 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-850-g50bbe7f3-1focal [107 kB] 2024-09-13T15:03:11.385 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T15:03:11.404 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T15:03:11.485 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T15:03:11.855 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T15:03:11.875 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T15:03:11.905 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T15:03:12.241 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T15:03:12.260 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T15:03:12.277 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 199 MB in 5s (37.3 MB/s) 2024-09-13T15:03:12.299 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T15:03:12.456 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T15:03:12.527 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T15:03:12.530 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T15:03:12.577 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T15:03:12.853 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T15:03:12.873 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T15:03:12.931 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:03:12.938 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T15:03:12.961 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T15:03:13.013 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T15:03:13.391 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T15:03:13.409 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T15:03:13.449 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T15:03:13.456 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T15:03:13.473 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T15:03:13.506 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:03:13.852 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T15:03:13.871 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T15:03:13.926 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T15:03:13.945 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T15:03:13.952 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T15:03:13.984 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:03:14.356 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T15:03:14.373 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T15:03:14.414 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T15:03:14.429 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T15:03:14.448 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T15:03:14.487 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T15:03:14.800 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T15:03:14.820 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T15:03:14.891 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T15:03:14.916 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../010-librbd1_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:15.040 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librbd1 (18.2.4-850-g50bbe7f3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T15:03:15.429 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T15:03:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T15:03:15.505 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:03:15.740 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../011-librados2_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:15.861 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librados2 (18.2.4-850-g50bbe7f3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T15:03:16.040 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T15:03:16.053 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T15:03:16.098 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:03:16.526 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T15:03:16.548 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T15:03:16.592 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:03:16.640 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T15:03:16.660 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:16.698 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcephfs2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:17.012 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T15:03:17.032 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T15:03:17.070 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T15:03:17.093 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rados. 2024-09-13T15:03:17.111 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../013-python3-rados_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:17.151 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rados (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:17.495 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T15:03:17.501 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-librbd1_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:17.514 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:17.545 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-ceph-argparse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:17.649 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (18.2.4-850-g50bbe7f3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T15:03:17.840 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T15:03:17.860 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:17.897 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cephfs (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:18.284 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T15:03:18.302 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:18.342 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:18.444 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-librados2_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:18.569 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (18.2.4-850-g50bbe7f3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T15:03:18.745 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T15:03:18.764 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T15:03:18.803 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T15:03:19.114 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T15:03:19.127 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:19.173 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rbd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:19.332 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T15:03:19.350 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:19.390 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:19.575 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T15:03:19.588 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T15:03:19.633 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T15:03:19.768 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-09-13T15:03:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-rados_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:19.825 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:20.028 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T15:03:20.045 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T15:03:20.111 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T15:03:20.229 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T15:03:20.245 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:20.286 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:20.606 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T15:03:20.626 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:20.681 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T15:03:20.704 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T15:03:20.748 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T15:03:20.939 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:21.159 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librgw2. 2024-09-13T15:03:21.179 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../022-librgw2_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:21.209 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librgw2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:21.392 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T15:03:21.411 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:21.450 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:21.862 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T15:03:21.878 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T15:03:21.920 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T15:03:22.178 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T15:03:22.190 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:22.219 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:22.239 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T15:03:22.254 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:22.306 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:22.614 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liboath0. 2024-09-13T15:03:22.633 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T15:03:22.672 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T15:03:22.692 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T15:03:22.713 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T15:03:22.783 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T15:03:23.051 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T15:03:23.069 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:23.117 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libradosstriper1 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:23.195 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T15:03:23.210 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T15:03:23.253 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T15:03:23.637 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-common. 2024-09-13T15:03:23.647 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T15:03:23.657 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../026-ceph-common_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:23.658 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T15:03:23.695 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:23.706 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T15:03:24.109 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-09-13T15:03:24.126 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-librgw2_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:24.168 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:25.103 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T15:03:25.118 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:25.194 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:25.597 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0. 2024-09-13T15:03:25.612 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T15:03:25.655 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T15:03:26.016 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T15:03:26.037 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:26.074 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:26.268 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-base. 2024-09-13T15:03:26.285 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../027-ceph-base_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:26.348 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-base (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:26.595 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-09-13T15:03:26.614 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-ceph-common_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:26.652 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:27.605 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T15:03:27.618 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T15:03:27.663 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T15:03:28.072 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T15:03:28.089 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T15:03:28.130 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T15:03:28.493 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T15:03:28.515 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T15:03:28.559 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T15:03:28.921 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T15:03:28.941 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T15:03:28.978 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T15:03:29.307 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-09-13T15:03:29.320 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-ceph-base_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:29.332 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-mako. 2024-09-13T15:03:29.349 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T15:03:29.378 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:29.389 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T15:03:29.785 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T15:03:29.805 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T15:03:29.866 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T15:03:30.204 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T15:03:30.224 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T15:03:30.295 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T15:03:30.656 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webob. 2024-09-13T15:03:30.677 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T15:03:30.754 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T15:03:30.768 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T15:03:30.811 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T15:03:30.957 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T15:03:31.215 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T15:03:31.227 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T15:03:31.265 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T15:03:31.302 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T15:03:31.321 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T15:03:31.360 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T15:03:31.635 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T15:03:31.648 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T15:03:31.693 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T15:03:31.698 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T15:03:31.717 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T15:03:31.756 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T15:03:32.063 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T15:03:32.078 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T15:03:32.120 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T15:03:32.195 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T15:03:32.212 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T15:03:32.260 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T15:03:32.441 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-09-13T15:03:32.455 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T15:03:32.490 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T15:03:32.640 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T15:03:32.658 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T15:03:32.697 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T15:03:32.915 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T15:03:32.923 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T15:03:32.970 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T15:03:33.050 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-paste. 2024-09-13T15:03:33.073 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T15:03:33.116 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T15:03:33.317 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T15:03:33.330 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T15:03:33.375 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T15:03:33.486 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T15:03:33.505 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T15:03:33.544 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T15:03:33.720 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-09-13T15:03:33.732 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T15:03:33.769 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T15:03:33.889 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T15:03:33.909 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T15:03:33.947 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T15:03:34.163 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T15:03:34.176 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T15:03:34.221 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T15:03:34.301 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T15:03:34.320 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T15:03:34.359 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T15:03:34.574 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T15:03:34.587 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T15:03:34.632 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T15:03:34.730 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T15:03:34.749 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T15:03:34.788 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T15:03:35.010 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T15:03:35.024 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T15:03:35.075 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T15:03:35.193 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T15:03:35.214 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T15:03:35.251 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T15:03:35.447 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T15:03:35.459 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T15:03:35.496 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T15:03:35.613 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T15:03:35.634 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:35.670 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:35.833 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-09-13T15:03:35.847 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T15:03:35.891 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T15:03:36.851 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T15:03:36.870 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:36.901 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:36.986 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T15:03:36.995 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T15:03:37.078 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T15:03:37.287 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T15:03:37.305 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T15:03:37.345 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T15:03:37.414 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T15:03:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T15:03:37.503 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T15:03:37.707 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T15:03:37.724 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T15:03:37.764 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T15:03:37.889 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T15:03:37.899 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T15:03:37.942 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T15:03:38.168 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T15:03:38.187 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T15:03:38.251 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T15:03:38.312 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T15:03:38.323 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T15:03:38.361 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T15:03:38.663 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T15:03:38.682 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:38.721 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:38.824 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T15:03:38.837 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T15:03:38.882 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T15:03:39.227 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T15:03:39.241 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:39.283 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T15:03:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:39.301 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:39.341 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mon (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:39.749 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T15:03:39.765 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:39.831 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:40.210 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T15:03:40.221 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T15:03:40.267 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T15:03:40.361 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T15:03:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:40.419 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-osd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:40.638 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T15:03:40.673 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T15:03:40.695 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T15:03:41.134 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T15:03:41.149 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T15:03:41.192 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T15:03:41.595 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T15:03:41.609 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:41.653 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:42.232 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T15:03:42.245 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:42.289 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:42.474 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph. 2024-09-13T15:03:42.495 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../054-ceph_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:42.540 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:42.851 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T15:03:42.864 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:42.926 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T15:03:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:43.429 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T15:03:43.448 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:43.487 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mds (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:44.057 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package cephadm. 2024-09-13T15:03:44.078 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../057-cephadm_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:44.123 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:44.477 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T15:03:44.496 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T15:03:44.534 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T15:03:44.955 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T15:03:44.973 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T15:03:45.046 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T15:03:45.440 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T15:03:45.453 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:45.498 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:45.504 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-09-13T15:03:45.523 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-ceph_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:45.562 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:45.885 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T15:03:45.905 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T15:03:45.932 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T15:03:45.943 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T15:03:45.945 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:45.989 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:46.313 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-attr. 2024-09-13T15:03:46.333 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T15:03:46.371 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T15:03:46.459 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T15:03:46.474 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:46.559 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:46.749 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T15:03:46.769 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T15:03:46.807 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T15:03:47.162 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-09-13T15:03:47.177 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-py. 2024-09-13T15:03:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-cephadm_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:03:47.195 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T15:03:47.220 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:47.235 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T15:03:47.590 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T15:03:47.604 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T15:03:47.605 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T15:03:47.624 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T15:03:47.647 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T15:03:47.663 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T15:03:48.008 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T15:03:48.026 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T15:03:48.051 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T15:03:48.065 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T15:03:48.065 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T15:03:48.128 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T15:03:48.411 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T15:03:48.432 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T15:03:48.476 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T15:03:48.503 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T15:03:48.517 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:48.561 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:48.914 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T15:03:48.932 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T15:03:48.957 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T15:03:48.972 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T15:03:48.973 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T15:03:49.015 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T15:03:49.267 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T15:03:49.288 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T15:03:49.333 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T15:03:49.401 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-attr. 2024-09-13T15:03:49.417 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T15:03:49.459 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T15:03:49.627 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T15:03:49.645 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T15:03:49.685 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T15:03:49.837 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T15:03:49.852 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T15:03:49.895 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T15:03:50.047 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-routes. 2024-09-13T15:03:50.060 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T15:03:50.105 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T15:03:50.273 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-09-13T15:03:50.282 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T15:03:50.322 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T15:03:50.517 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T15:03:50.537 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:50.575 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:50.728 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T15:03:50.742 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T15:03:50.829 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T15:03:51.213 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T15:03:51.228 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T15:03:51.270 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T15:03:51.632 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T15:03:51.646 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T15:03:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T15:03:52.023 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T15:03:52.041 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T15:03:52.102 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T15:03:52.105 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T15:03:52.122 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T15:03:52.369 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T15:03:52.433 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T15:03:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T15:03:52.526 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T15:03:52.689 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T15:03:52.707 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T15:03:52.746 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T15:03:52.915 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T15:03:52.936 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T15:03:52.980 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T15:03:53.082 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T15:03:53.097 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T15:03:53.140 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T15:03:53.468 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-09-13T15:03:53.484 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T15:03:53.526 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T15:03:53.891 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T15:03:53.905 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:53.974 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:54.398 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T15:03:54.412 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T15:03:54.456 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T15:03:55.060 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T15:03:55.081 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T15:03:55.126 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T15:03:55.421 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T15:03:55.430 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T15:03:55.471 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T15:03:55.530 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T15:03:55.549 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T15:03:55.588 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T15:03:55.807 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T15:03:55.821 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T15:03:55.865 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T15:03:56.210 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T15:03:56.224 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T15:03:56.292 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T15:03:56.359 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T15:03:56.378 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:56.417 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:57.653 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T15:03:57.673 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T15:03:57.711 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T15:03:57.756 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T15:03:57.773 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T15:03:57.813 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T15:03:58.177 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T15:03:58.200 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T15:03:58.243 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T15:03:58.401 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T15:03:58.416 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T15:03:58.459 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T15:03:58.640 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T15:03:58.657 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T15:03:58.698 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T15:03:58.879 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T15:03:58.894 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T15:03:58.937 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T15:03:59.060 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T15:03:59.078 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T15:03:59.117 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T15:03:59.480 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T15:03:59.497 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T15:03:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T15:03:59.690 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T15:03:59.706 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:03:59.747 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:03:59.924 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T15:03:59.943 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T15:04:00.016 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T15:04:00.360 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T15:04:00.379 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T15:04:00.452 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T15:04:00.837 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T15:04:00.857 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T15:04:00.905 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T15:04:01.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T15:04:01.024 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T15:04:01.083 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T15:04:01.284 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T15:04:01.302 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T15:04:01.342 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T15:04:01.522 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T15:04:01.540 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T15:04:01.580 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T15:04:01.732 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T15:04:01.749 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T15:04:01.789 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T15:04:01.951 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T15:04:01.970 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T15:04:02.009 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T15:04:02.388 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T15:04:02.399 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T15:04:02.454 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T15:04:02.577 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T15:04:02.592 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:02.669 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:02.840 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T15:04:02.851 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T15:04:02.882 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T15:04:03.075 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T15:04:03.089 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T15:04:03.134 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T15:04:03.269 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T15:04:03.285 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T15:04:03.356 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T15:04:03.545 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T15:04:03.564 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:04:03.603 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:03.694 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T15:04:03.704 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T15:04:03.760 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T15:04:03.940 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package jq. 2024-09-13T15:04:03.959 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:04:03.997 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T15:04:04.173 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T15:04:04.214 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T15:04:04.319 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package socat. 2024-09-13T15:04:04.338 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T15:04:04.377 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T15:04:04.596 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T15:04:04.613 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T15:04:04.653 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T15:04:04.739 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T15:04:04.758 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T15:04:04.797 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T15:04:05.024 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T15:04:05.042 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T15:04:05.082 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T15:04:05.185 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-test. 2024-09-13T15:04:05.204 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../096-ceph-test_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:05.243 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-test (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:05.798 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T15:04:05.815 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:05.856 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:06.234 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T15:04:06.274 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T15:04:06.292 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T15:04:06.695 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T15:04:06.711 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:04:06.745 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-09-13T15:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:07.426 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-09-13T15:04:07.445 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T15:04:07.483 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T15:04:07.863 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T15:04:07.881 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T15:04:07.912 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T15:04:08.351 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-09-13T15:04:08.369 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-ceph-test_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:08.408 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:09.172 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T15:04:09.191 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:09.238 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-volume (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:09.701 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T15:04:09.718 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:09.758 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking cephfs-mirror (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:10.112 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T15:04:10.129 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T15:04:10.169 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T15:04:10.481 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T15:04:10.504 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:10.547 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking cephfs-shell (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:10.841 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T15:04:10.855 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:10.899 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking cephfs-top (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:11.202 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T15:04:11.222 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T15:04:11.260 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:11.773 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T15:04:11.793 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:11.830 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcephfs-dev (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:12.259 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T15:04:12.278 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T15:04:12.374 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T15:04:12.421 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T15:04:12.439 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:12.512 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:12.739 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T15:04:12.759 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T15:04:12.804 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T15:04:12.975 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T15:04:12.991 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:13.033 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-mirror (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:13.258 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T15:04:13.278 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T15:04:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:13.428 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T15:04:13.446 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T15:04:13.486 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T15:04:13.806 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T15:04:13.823 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:13.864 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-shell (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:14.192 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T15:04:14.211 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-850-g50bbe7f3-1focal_all.deb ... 2024-09-13T15:04:14.249 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-top (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:14.552 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T15:04:14.572 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T15:04:14.618 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:15.165 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T15:04:15.185 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:15.255 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:15.378 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T15:04:15.401 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T15:04:15.443 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T15:04:15.700 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T15:04:15.712 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T15:04:15.780 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T15:04:15.830 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T15:04:15.850 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T15:04:15.887 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T15:04:16.164 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T15:04:16.181 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T15:04:16.230 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T15:04:16.249 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T15:04:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T15:04:16.307 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T15:04:16.675 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T15:04:16.693 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T15:04:16.720 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T15:04:16.724 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:16.738 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T15:04:16.776 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T15:04:17.305 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T15:04:17.326 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T15:04:17.371 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T15:04:17.759 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T15:04:17.779 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T15:04:18.228 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T15:04:18.247 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T15:04:18.285 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T15:04:18.639 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T15:04:18.659 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T15:04:18.696 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T15:04:18.904 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T15:04:18.927 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T15:04:18.971 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T15:04:19.066 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T15:04:19.091 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T15:04:19.132 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T15:04:19.383 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T15:04:19.401 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T15:04:19.441 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T15:04:19.802 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T15:04:19.821 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T15:04:19.860 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T15:04:19.903 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package radosgw. 2024-09-13T15:04:19.922 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../116-radosgw_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:19.961 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking radosgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:20.272 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T15:04:20.293 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T15:04:20.338 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T15:04:20.897 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T15:04:20.942 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T15:04:21.329 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T15:04:21.331 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T15:04:21.349 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T15:04:21.352 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:21.386 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T15:04:21.397 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking rbd-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:21.782 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T15:04:21.782 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T15:04:21.801 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T15:04:21.839 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T15:04:22.168 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T15:04:22.218 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T15:04:22.237 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T15:04:22.275 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T15:04:22.294 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T15:04:22.445 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T15:04:22.596 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T15:04:22.616 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T15:04:22.653 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T15:04:22.663 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:23.326 INFO:teuthology.orchestra.run.smithi181.stdout:Adding system user cephadm....done 2024-09-13T15:04:23.511 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:23.654 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T15:04:23.916 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-09-13T15:04:23.936 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-radosgw_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:23.973 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:24.089 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T15:04:24.423 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:24.583 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T15:04:24.709 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T15:04:25.102 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T15:04:25.378 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T15:04:25.397 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-850-g50bbe7f3-1focal_amd64.deb ... 2024-09-13T15:04:25.435 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:25.596 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T15:04:25.845 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T15:04:25.972 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T15:04:26.224 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T15:04:26.315 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T15:04:26.374 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T15:04:26.493 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T15:04:26.658 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T15:04:26.711 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:27.001 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T15:04:27.381 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-09-13T15:04:27.394 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-ceph-argparse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:27.567 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:27.693 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T15:04:27.895 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T15:04:28.021 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T15:04:28.120 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T15:04:28.364 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T15:04:28.480 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T15:04:28.605 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T15:04:28.714 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T15:04:28.756 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T15:04:29.074 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T15:04:29.167 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T15:04:29.200 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T15:04:29.660 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T15:04:29.660 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T15:04:30.019 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T15:04:30.020 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T15:04:30.370 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T15:04:30.379 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T15:04:30.714 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T15:04:30.788 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T15:04:31.065 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T15:04:31.147 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T15:04:31.425 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:31.565 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T15:04:31.809 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T15:04:31.908 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T15:04:31.936 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T15:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T15:04:32.300 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T15:04:32.460 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T15:04:32.654 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T15:04:32.803 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T15:04:33.014 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T15:04:33.140 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T15:04:33.312 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T15:04:33.608 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T15:04:33.789 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T15:04:34.009 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T15:04:34.165 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T15:04:34.360 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T15:04:34.600 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T15:04:34.845 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T15:04:35.051 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T15:04:35.177 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:35.229 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T15:04:35.570 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T15:04:35.713 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T15:04:36.031 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T15:04:36.164 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T15:04:36.315 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T15:04:36.416 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T15:04:36.441 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T15:04:36.542 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T15:04:36.668 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T15:04:36.809 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T15:04:37.044 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T15:04:37.202 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:04:37.328 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T15:04:37.479 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T15:04:37.562 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T15:04:37.906 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T15:04:37.955 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T15:04:38.299 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T15:04:38.415 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T15:04:38.658 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T15:04:38.809 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T15:04:38.875 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T15:04:39.001 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:39.152 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T15:04:39.494 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:04:39.536 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T15:04:39.637 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T15:04:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T15:04:40.063 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T15:04:40.189 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T15:04:40.349 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T15:04:40.351 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T15:04:40.698 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T15:04:40.708 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T15:04:40.849 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T15:04:41.118 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:04:41.244 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T15:04:41.258 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T15:04:41.370 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T15:04:41.677 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T15:04:41.819 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T15:04:41.822 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T15:04:41.945 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T15:04:42.207 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T15:04:42.388 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T15:04:42.591 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T15:04:42.717 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T15:04:42.772 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T15:04:43.077 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T15:04:43.436 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T15:04:43.812 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T15:04:44.222 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T15:04:44.573 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T15:04:44.586 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:44.701 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T15:04:44.704 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T15:04:45.111 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T15:04:45.156 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T15:04:45.523 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T15:04:45.554 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T15:04:45.746 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T15:04:45.872 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T15:04:45.874 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:04:46.001 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T15:04:46.282 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T15:04:46.402 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T15:04:46.675 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T15:04:46.795 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T15:04:47.263 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T15:04:47.656 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T15:04:48.555 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:48.681 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T15:04:48.895 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T15:04:49.021 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T15:04:49.164 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:49.174 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T15:04:49.290 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T15:04:49.559 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T15:04:49.666 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T15:04:49.792 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T15:04:49.927 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T15:04:50.053 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T15:04:50.151 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T15:04:50.470 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T15:04:50.494 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T15:04:50.879 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T15:04:50.881 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T15:04:51.314 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librados2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:51.357 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T15:04:51.534 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T15:04:51.693 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librgw2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:51.808 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T15:04:51.819 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:51.945 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcephfs2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:52.121 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T15:04:52.481 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libradosstriper1 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:52.607 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T15:04:52.976 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librbd1 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:53.102 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:53.122 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T15:04:53.228 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:53.248 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T15:04:53.400 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T15:04:53.533 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T15:04:53.542 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T15:04:53.542 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T15:04:53.910 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T15:04:54.035 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T15:04:54.380 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcephfs-dev (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:54.539 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rados (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:54.665 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up cephfs-top (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:54.670 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T15:04:54.799 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T15:04:55.079 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T15:04:55.606 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T15:04:55.936 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rbd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.058 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.062 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up rbd-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.230 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.336 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T15:04:56.356 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cephfs (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.462 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.482 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up cephfs-shell (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.613 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.650 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.739 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:56.888 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T15:04:57.273 INFO:teuthology.orchestra.run.smithi181.stdout:Adding group ceph....done 2024-09-13T15:04:57.283 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T15:04:57.768 INFO:teuthology.orchestra.run.smithi181.stdout:Adding system user ceph....done 2024-09-13T15:04:57.786 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:57.912 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:57.980 INFO:teuthology.orchestra.run.smithi181.stdout:Setting system user ceph properties....done 2024-09-13T15:04:58.017 INFO:teuthology.orchestra.run.smithi181.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T15:04:58.071 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:58.224 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T15:04:58.339 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T15:04:58.339 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T15:04:58.760 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T15:04:59.315 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:59.441 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:59.600 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-top (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:59.668 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up cephfs-mirror (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:04:59.726 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T15:04:59.930 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:04:59.931 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:05:00.764 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-test (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:00.887 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up radosgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:00.905 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:01.031 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:01.191 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:01.317 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:01.451 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-shell (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:01.582 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:05:01.583 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:05:01.594 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:02.226 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-09-13T15:05:02.372 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-base (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:02.680 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-09-13T15:05:02.901 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-09-13T15:05:02.909 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T15:05:02.939 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T15:05:03.161 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T15:05:03.706 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T15:05:03.833 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mds (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:04.108 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T15:05:04.108 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T15:05:04.679 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-mirror (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:04.952 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:05:04.952 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:05:05.219 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T15:05:05.219 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T15:05:05.780 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:05.956 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:06.061 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-osd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:06.663 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:05:06.664 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:05:06.849 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T15:05:06.849 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T15:05:07.541 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:07.662 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:07.788 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:07.964 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mon (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:08.044 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T15:05:08.230 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T15:05:08.230 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T15:05:08.936 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:09.085 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:09.236 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:09.236 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T15:05:09.236 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T15:05:09.361 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:09.521 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-volume (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:09.973 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T15:05:10.103 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:10.133 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T15:05:10.394 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T15:05:10.394 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T15:05:10.584 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T15:05:11.247 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:12.079 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T15:05:12.079 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T15:05:12.923 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:13.049 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:13.225 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:13.492 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T15:05:13.492 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T15:05:14.377 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:14.527 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:14.712 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:14.863 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (18.2.4-850-g50bbe7f3-1focal) ... 2024-09-13T15:05:15.325 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T15:05:15.471 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T15:05:15.510 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T15:05:15.978 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T15:05:16.239 INFO:teuthology.orchestra.run.smithi181.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:05:16.246 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T15:05:16.373 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-09-13T15:05:16.596 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-09-13T15:05:16.596 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-09-13T15:05:16.805 INFO:teuthology.orchestra.run.smithi181.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T15:05:16.805 INFO:teuthology.orchestra.run.smithi181.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T15:05:16.805 INFO:teuthology.orchestra.run.smithi181.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T15:05:16.805 INFO:teuthology.orchestra.run.smithi181.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T15:05:16.805 INFO:teuthology.orchestra.run.smithi181.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T15:05:16.806 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:05:16.806 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T15:05:16.806 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:05:16.807 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-09-13T15:05:16.807 INFO:teuthology.orchestra.run.smithi181.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T15:05:16.807 INFO:teuthology.orchestra.run.smithi181.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T15:05:16.807 INFO:teuthology.orchestra.run.smithi181.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T15:05:16.807 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T15:05:16.808 INFO:teuthology.orchestra.run.smithi181.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T15:05:16.809 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-09-13T15:05:16.809 INFO:teuthology.orchestra.run.smithi181.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T15:05:16.809 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T15:05:16.809 INFO:teuthology.orchestra.run.smithi181.stdout: libengine-pkcs11-openssl 2024-09-13T15:05:16.917 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-09-13T15:05:16.918 INFO:teuthology.orchestra.run.smithi181.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T15:05:16.918 INFO:teuthology.orchestra.run.smithi181.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T15:05:16.919 INFO:teuthology.orchestra.run.smithi181.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T15:05:16.919 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T15:05:16.919 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T15:05:16.919 INFO:teuthology.orchestra.run.smithi181.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T15:05:16.920 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages will be upgraded: 2024-09-13T15:05:16.921 INFO:teuthology.orchestra.run.smithi181.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T15:05:17.009 INFO:teuthology.orchestra.run.smithi181.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T15:05:17.010 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 25.4 MB of archives. 2024-09-13T15:05:17.010 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T15:05:17.010 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T15:05:17.142 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T15:05:17.143 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T15:05:17.145 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T15:05:17.153 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T15:05:17.155 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T15:05:17.169 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T15:05:17.170 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T15:05:17.171 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T15:05:17.173 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T15:05:17.173 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T15:05:17.175 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T15:05:17.176 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T15:05:17.178 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T15:05:17.178 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T15:05:17.193 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T15:05:17.194 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T15:05:17.204 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T15:05:17.208 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T15:05:17.215 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T15:05:17.216 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T15:05:17.232 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T15:05:17.232 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T15:05:17.242 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T15:05:17.254 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T15:05:17.272 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T15:05:17.275 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T15:05:17.276 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T15:05:17.276 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T15:05:17.277 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T15:05:17.287 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T15:05:17.289 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T15:05:17.418 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T15:05:17.418 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T15:05:17.418 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T15:05:17.419 INFO:teuthology.orchestra.run.smithi181.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T15:05:17.419 INFO:teuthology.orchestra.run.smithi181.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T15:05:17.972 INFO:teuthology.orchestra.run.smithi181.stdout:Preconfiguring packages ... 2024-09-13T15:05:18.190 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 25.4 MB in 0s (51.8 MB/s) 2024-09-13T15:05:18.513 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119132 files and directories currently installed.) 2024-09-13T15:05:18.516 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T15:05:18.727 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T15:05:20.655 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T15:05:21.164 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T15:05:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:05:21.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T15:05:22.079 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-13T15:05:22.304 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-13T15:05:22.305 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-13T15:05:22.547 INFO:teuthology.orchestra.run.smithi050.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T15:05:22.547 INFO:teuthology.orchestra.run.smithi050.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T15:05:22.547 INFO:teuthology.orchestra.run.smithi050.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T15:05:22.547 INFO:teuthology.orchestra.run.smithi050.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T15:05:22.547 INFO:teuthology.orchestra.run.smithi050.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T15:05:22.547 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:05:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T15:05:22.548 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:05:22.548 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-13T15:05:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T15:05:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T15:05:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T15:05:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T15:05:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T15:05:22.551 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-13T15:05:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T15:05:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T15:05:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: libengine-pkcs11-openssl 2024-09-13T15:05:22.652 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119132 files and directories currently installed.) 2024-09-13T15:05:22.655 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T15:05:22.662 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-13T15:05:22.663 INFO:teuthology.orchestra.run.smithi050.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T15:05:22.663 INFO:teuthology.orchestra.run.smithi050.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T15:05:22.664 INFO:teuthology.orchestra.run.smithi050.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T15:05:22.664 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T15:05:22.664 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T15:05:22.664 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T15:05:22.665 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-09-13T15:05:22.666 INFO:teuthology.orchestra.run.smithi050.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T15:05:22.789 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T15:05:22.862 INFO:teuthology.orchestra.run.smithi050.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T15:05:22.862 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 25.4 MB of archives. 2024-09-13T15:05:22.862 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T15:05:22.862 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T15:05:23.235 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T15:05:23.428 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T15:05:23.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T15:05:23.483 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T15:05:23.484 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T15:05:23.497 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T15:05:23.499 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T15:05:23.597 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T15:05:23.599 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T15:05:23.607 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T15:05:23.611 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T15:05:23.612 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T15:05:23.644 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T15:05:23.645 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T15:05:23.648 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T15:05:23.649 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T15:05:23.726 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T15:05:23.726 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T15:05:23.738 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T15:05:23.740 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T15:05:23.754 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T15:05:23.755 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T15:05:23.807 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T15:05:23.807 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T15:05:23.825 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T15:05:23.831 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T15:05:23.860 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T15:05:23.919 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T15:05:23.927 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T15:05:23.928 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T15:05:23.929 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T15:05:23.931 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T15:05:23.953 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T15:05:23.971 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T15:05:24.357 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T15:05:24.357 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T15:05:24.357 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T15:05:24.358 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T15:05:24.358 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T15:05:24.384 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119132 files and directories currently installed.) 2024-09-13T15:05:24.387 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T15:05:24.520 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T15:05:24.947 INFO:teuthology.orchestra.run.smithi050.stdout:Preconfiguring packages ... 2024-09-13T15:05:25.086 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T15:05:25.217 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T15:05:25.330 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 25.4 MB in 2s (15.1 MB/s) 2024-09-13T15:05:25.687 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119132 files and directories currently installed.) 2024-09-13T15:05:25.690 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T15:05:25.742 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T15:05:25.866 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T15:05:25.905 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T15:05:26.467 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T15:05:26.486 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T15:05:26.525 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T15:05:26.945 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package dump. 2024-09-13T15:05:26.968 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T15:05:27.011 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T15:05:27.341 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package indent. 2024-09-13T15:05:27.361 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:27.406 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T15:05:27.502 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T15:05:27.785 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T15:05:27.809 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T15:05:27.851 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T15:05:28.238 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T15:05:28.258 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T15:05:28.296 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T15:05:28.624 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T15:05:28.646 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T15:05:28.690 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:05:29.060 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T15:05:29.079 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:29.118 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:05:29.548 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T15:05:29.567 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:29.621 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119132 files and directories currently installed.) 2024-09-13T15:05:29.625 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T15:05:29.630 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:05:29.782 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T15:05:29.984 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T15:05:30.003 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:30.058 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:05:30.445 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T15:05:30.478 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T15:05:30.496 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T15:05:30.536 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T15:05:30.656 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T15:05:30.931 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T15:05:30.951 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T15:05:30.989 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T15:05:31.040 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T15:05:31.391 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T15:05:31.406 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:31.458 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:31.528 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119132 files and directories currently installed.) 2024-09-13T15:05:31.531 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T15:05:31.664 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T15:05:31.870 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T15:05:31.890 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:31.936 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:05:32.222 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T15:05:32.314 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T15:05:32.337 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:32.361 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T15:05:32.380 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:05:32.674 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T15:05:32.696 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T15:05:32.741 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T15:05:32.943 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T15:05:33.074 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T15:05:33.304 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T15:05:33.323 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T15:05:33.394 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T15:05:33.678 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T15:05:33.697 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T15:05:33.736 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T15:05:33.830 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package modemmanager. 2024-09-13T15:05:33.847 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:33.909 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:05:34.139 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package dump. 2024-09-13T15:05:34.158 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T15:05:34.197 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T15:05:34.551 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package indent. 2024-09-13T15:05:34.576 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:34.617 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T15:05:34.954 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T15:05:34.977 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T15:05:34.987 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T15:05:35.001 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T15:05:35.020 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T15:05:35.112 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T15:05:35.509 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T15:05:35.530 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T15:05:35.567 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T15:05:35.600 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package network-manager. 2024-09-13T15:05:35.619 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T15:05:35.707 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T15:05:35.878 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T15:05:35.902 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T15:05:35.944 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:05:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T15:05:36.369 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:36.431 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:05:36.523 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ppp. 2024-09-13T15:05:36.545 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T15:05:36.734 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T15:05:36.753 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:36.808 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:05:37.021 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T15:05:37.195 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T15:05:37.214 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:37.253 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:05:37.445 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T15:05:37.467 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T15:05:37.512 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T15:05:37.664 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T15:05:37.685 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T15:05:37.722 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T15:05:37.923 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T15:05:37.943 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T15:05:38.016 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T15:05:38.126 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T15:05:38.146 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T15:05:38.184 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T15:05:38.368 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T15:05:38.442 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T15:05:38.451 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T15:05:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T15:05:38.599 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:38.636 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:38.797 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T15:05:38.818 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:38.888 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:39.039 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T15:05:39.061 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:39.125 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:05:39.527 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T15:05:39.534 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T15:05:39.547 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T15:05:39.554 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:39.592 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:05:39.625 INFO:teuthology.orchestra.run.smithi181.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T15:05:39.654 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T15:05:39.853 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T15:05:39.875 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T15:05:39.944 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T15:05:40.208 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T15:05:40.228 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:40.273 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:40.523 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T15:05:40.542 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T15:05:40.581 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T15:05:41.026 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package modemmanager. 2024-09-13T15:05:41.045 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:05:41.131 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:05:41.798 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T15:05:41.815 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T15:05:41.844 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql. 2024-09-13T15:05:41.863 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T15:05:41.873 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T15:05:41.902 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T15:05:42.163 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T15:05:42.186 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T15:05:42.254 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T15:05:42.487 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager. 2024-09-13T15:05:42.503 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T15:05:42.532 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T15:05:42.553 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T15:05:42.593 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T15:05:42.598 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T15:05:42.900 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T15:05:42.919 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T15:05:42.958 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T15:05:43.378 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T15:05:43.399 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T15:05:43.419 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ppp. 2024-09-13T15:05:43.431 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T15:05:43.540 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T15:05:43.873 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T15:05:43.918 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T15:05:44.084 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T15:05:44.291 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T15:05:44.306 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T15:05:44.348 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T15:05:44.444 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:44.569 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T15:05:44.729 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T15:05:44.794 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T15:05:44.812 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T15:05:44.889 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T15:05:44.889 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T15:05:45.247 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T15:05:45.262 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T15:05:45.322 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T15:05:45.345 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:05:45.345 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:05:45.677 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T15:05:45.693 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:45.768 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:46.241 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:46.440 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T15:05:46.458 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T15:05:46.561 INFO:teuthology.orchestra.run.smithi050.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T15:05:46.592 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T15:05:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T15:05:47.163 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T15:05:47.211 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:48.184 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T15:05:48.305 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T15:05:48.451 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T15:05:48.582 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T15:05:48.916 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql. 2024-09-13T15:05:48.935 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T15:05:48.973 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T15:05:49.276 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T15:05:49.294 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T15:05:49.336 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T15:05:49.647 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T15:05:49.663 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T15:05:49.705 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T15:05:49.887 INFO:teuthology.orchestra.run.smithi181.stdout:Adding user postgres to group ssl-cert 2024-09-13T15:05:50.007 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T15:05:50.024 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T15:05:50.065 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T15:05:50.519 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T15:05:50.536 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T15:05:50.601 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T15:05:50.760 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:50.760 INFO:teuthology.orchestra.run.smithi181.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T15:05:50.988 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T15:05:51.224 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T15:05:51.228 INFO:teuthology.orchestra.run.smithi181.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T15:05:51.228 INFO:teuthology.orchestra.run.smithi181.stdout:Removing obsolete dictionary files: 2024-09-13T15:05:51.617 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:51.743 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T15:05:51.786 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T15:05:51.915 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T15:05:52.046 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T15:05:52.510 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:05:52.510 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:05:53.209 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T15:05:53.335 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T15:05:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:53.486 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T15:05:53.612 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T15:05:54.857 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T15:05:55.292 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T15:05:55.402 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T15:05:55.469 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:05:55.509 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T15:05:55.620 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T15:05:55.746 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T15:05:55.871 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T15:05:56.106 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T15:05:56.232 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:05:56.563 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T15:05:56.688 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T15:05:56.727 INFO:teuthology.orchestra.run.smithi181.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T15:05:56.751 INFO:teuthology.orchestra.run.smithi181.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:This user must also own the server process. 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:The default text search configuration will be set to "english". 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:Data page checksums are disabled. 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:56.828 INFO:teuthology.orchestra.run.smithi181.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T15:05:56.829 INFO:teuthology.orchestra.run.smithi181.stdout:creating subdirectories ... ok 2024-09-13T15:05:56.829 INFO:teuthology.orchestra.run.smithi181.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T15:05:56.839 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T15:05:56.864 INFO:teuthology.orchestra.run.smithi181.stdout:selecting default max_connections ... 100 2024-09-13T15:05:56.909 INFO:teuthology.orchestra.run.smithi181.stdout:selecting default shared_buffers ... 128MB 2024-09-13T15:05:56.931 INFO:teuthology.orchestra.run.smithi181.stdout:selecting default time zone ... Etc/UTC 2024-09-13T15:05:56.932 INFO:teuthology.orchestra.run.smithi181.stdout:creating configuration files ... ok 2024-09-13T15:05:57.108 INFO:teuthology.orchestra.run.smithi181.stdout:running bootstrap script ... ok 2024-09-13T15:05:57.709 INFO:teuthology.orchestra.run.smithi181.stdout:performing post-bootstrap initialization ... ok 2024-09-13T15:05:58.166 INFO:teuthology.orchestra.run.smithi050.stdout:Adding user postgres to group ssl-cert 2024-09-13T15:05:58.289 INFO:teuthology.orchestra.run.smithi181.stdout:syncing data to disk ... ok 2024-09-13T15:05:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:58.290 INFO:teuthology.orchestra.run.smithi181.stdout:Success. You can now start the database server using: 2024-09-13T15:05:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: pg_ctlcluster 12 main start 2024-09-13T15:05:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:05:58.521 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:05:58.522 INFO:teuthology.orchestra.run.smithi050.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T15:05:58.841 INFO:teuthology.orchestra.run.smithi181.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T15:05:58.841 INFO:teuthology.orchestra.run.smithi181.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T15:05:59.010 INFO:teuthology.orchestra.run.smithi050.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T15:05:59.010 INFO:teuthology.orchestra.run.smithi050.stdout:Removing obsolete dictionary files: 2024-09-13T15:05:59.036 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T15:05:59.555 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T15:06:01.011 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T15:06:01.142 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T15:06:01.268 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T15:06:01.435 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T15:06:02.656 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:06:02.714 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T15:06:02.816 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:06:02.942 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T15:06:03.152 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:06:03.157 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T15:06:03.265 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T15:06:03.277 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T15:06:03.368 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:06:03.403 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T15:06:03.494 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T15:06:03.628 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T15:06:03.779 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T15:06:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T15:06:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout:which means they are currently configured by ifupdown: 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout:- enp3s0f1 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T15:06:04.600 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:04.646 INFO:teuthology.orchestra.run.smithi050.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T15:06:04.681 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:This user must also own the server process. 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:The default text search configuration will be set to "english". 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:Data page checksums are disabled. 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T15:06:04.748 INFO:teuthology.orchestra.run.smithi050.stdout:creating subdirectories ... ok 2024-09-13T15:06:04.749 INFO:teuthology.orchestra.run.smithi050.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T15:06:04.785 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default max_connections ... 100 2024-09-13T15:06:04.827 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T15:06:04.834 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default shared_buffers ... 128MB 2024-09-13T15:06:04.856 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default time zone ... Etc/UTC 2024-09-13T15:06:04.857 INFO:teuthology.orchestra.run.smithi050.stdout:creating configuration files ... ok 2024-09-13T15:06:05.045 INFO:teuthology.orchestra.run.smithi050.stdout:running bootstrap script ... ok 2024-09-13T15:06:05.381 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T15:06:05.698 INFO:teuthology.orchestra.run.smithi050.stdout:performing post-bootstrap initialization ... ok 2024-09-13T15:06:06.229 INFO:teuthology.orchestra.run.smithi050.stdout:syncing data to disk ... ok 2024-09-13T15:06:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:06.229 INFO:teuthology.orchestra.run.smithi050.stdout:Success. You can now start the database server using: 2024-09-13T15:06:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: pg_ctlcluster 12 main start 2024-09-13T15:06:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:06.278 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T15:06:06.789 INFO:teuthology.orchestra.run.smithi050.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T15:06:06.789 INFO:teuthology.orchestra.run.smithi050.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T15:06:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T15:06:07.294 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:06:07.432 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T15:06:07.600 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:06:07.752 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T15:06:07.877 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T15:06:08.003 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:06:08.154 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:06:08.280 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:06:08.596 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:06:08.596 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:06:09.577 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T15:06:09.694 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T15:06:09.837 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T15:06:09.997 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T15:06:10.498 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T15:06:10.773 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:06:10.890 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:06:11.016 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T15:06:11.226 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:06:11.360 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T15:06:11.520 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout:which means they are currently configured by ifupdown: 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout:- ens1f0 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T15:06:12.732 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:12.967 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T15:06:13.504 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T15:06:14.484 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T15:06:15.439 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T15:06:15.573 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T15:06:15.767 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T15:06:15.901 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T15:06:16.044 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T15:06:16.187 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:06:16.504 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T15:06:16.630 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T15:06:16.957 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:06:16.958 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:06:17.982 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T15:06:18.126 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T15:06:18.260 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T15:06:18.445 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T15:06:18.930 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T15:06:23.561 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T15:06:23.668 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T15:06:24.901 INFO:teuthology.orchestra.run.smithi181.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:06:24.911 DEBUG:teuthology.parallel:result is None 2024-09-13T15:06:32.009 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T15:06:32.117 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T15:06:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:06:33.359 DEBUG:teuthology.parallel:result is None 2024-09-13T15:06:33.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:06:33.506 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-09-13T15:06:33.549 INFO:teuthology.orchestra.run.smithi050.stdout:18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:06:33.550 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:06:33.550 INFO:teuthology.task.install:The correct ceph version 18.2.4-850-g50bbe7f3-1focal is installed. 2024-09-13T15:06:33.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:06:33.694 DEBUG:teuthology.orchestra.run.smithi181:> dpkg-query -W -f '${Version}' ceph 2024-09-13T15:06:33.729 INFO:teuthology.orchestra.run.smithi181.stdout:18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:06:33.730 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850-g50bbe7f3-1focal 2024-09-13T15:06:33.730 INFO:teuthology.task.install:The correct ceph version 18.2.4-850-g50bbe7f3-1focal is installed. 2024-09-13T15:06:33.732 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T15:06:33.732 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:33.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:06:33.768 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:33.768 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:06:33.809 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T15:06:33.809 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:33.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:06:33.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:06:33.916 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:33.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:06:33.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:06:34.026 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T15:06:34.027 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:34.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:06:34.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:06:34.140 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:34.141 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:06:34.171 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:06:34.247 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T15:06:34.247 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:34.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:06:34.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:06:34.353 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:34.353 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:06:34.387 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:06:34.464 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T15:06:34.543 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T15:06:34.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-09-13T15:06:34.550 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-09-13T15:06:34.583 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T15:06:34.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T15:06:34.627 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T15:06:34.658 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T15:06:34.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T15:06:34.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T15:06:34.755 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T15:06:34.755 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T15:06:34.756 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T15:06:34.756 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:34.756 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T15:06:34.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T15:06:34.932 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:34.932 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T15:06:34.951 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T15:06:35.075 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T15:06:35.075 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T15:06:35.076 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707', 'branch': 'wip-rishabh-testing-20240910.095512-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap}', 'email': None, 'first_in_suite': False, 'job_id': '7903707', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.095512-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.095512-reef', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1152, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'sleep_before_teardown': 0, 'subset': '984/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.095512-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:36:41', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T15:06:35.076 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T15:06:35.082 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T15:06:35.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T15:06:35.140 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T15:06:35.178 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:35.178 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:06:35.234 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:06:35.235 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-13T15:06:35.295 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 494 Links: 1 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-13 15:01:06.955971814 +0000 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-13 15:01:06.487982606 +0000 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-13 15:01:06.487982606 +0000 2024-09-13T15:06:35.296 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-13T15:06:35.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:06:35.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-13T15:06:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-13T15:06:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000312257 s, 1.6 MB/s 2024-09-13T15:06:35.368 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:06:35.436 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 503 Links: 1 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-13 15:01:07.643955948 +0000 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-13 15:01:07.315963513 +0000 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-13 15:01:07.315963513 +0000 2024-09-13T15:06:35.497 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-13T15:06:35.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:06:35.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-13T15:06:35.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-13T15:06:35.569 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000564338 s, 907 kB/s 2024-09-13T15:06:35.571 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:06:35.639 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 506 Links: 1 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-13 15:01:08.343939806 +0000 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-13 15:01:08.011947462 +0000 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-13 15:01:08.011947462 +0000 2024-09-13T15:06:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-13T15:06:35.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:06:35.778 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-13T15:06:35.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-13T15:06:35.779 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000611414 s, 837 kB/s 2024-09-13T15:06:35.782 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:06:35.855 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 514 Links: 1 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-13 15:01:08.683931965 +0000 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-13 15:01:08.679932058 +0000 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-13 15:01:08.679932058 +0000 2024-09-13T15:06:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-13T15:06:35.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:06:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-13T15:06:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-13T15:06:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000565275 s, 906 kB/s 2024-09-13T15:06:35.994 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:06:36.060 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:36.061 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:36.061 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:06:36.078 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:06:36.078 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 496 Links: 1 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 15:01:02.411125165 +0000 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 15:01:02.079132821 +0000 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 15:01:02.079132821 +0000 2024-09-13T15:06:36.137 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-09-13T15:06:36.137 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:06:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T15:06:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T15:06:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000672349 s, 762 kB/s 2024-09-13T15:06:36.211 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:06:36.274 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 503 Links: 1 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 15:01:03.079109761 +0000 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 15:01:02.755117231 +0000 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 15:01:02.755117231 +0000 2024-09-13T15:06:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-09-13T15:06:36.331 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:06:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T15:06:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T15:06:36.401 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000644998 s, 794 kB/s 2024-09-13T15:06:36.403 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:06:36.468 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-13T15:06:36.528 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 508 Links: 1 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 15:01:03.719095001 +0000 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 15:01:03.391102566 +0000 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 15:01:03.391102566 +0000 2024-09-13T15:06:36.529 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-09-13T15:06:36.529 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:06:36.601 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T15:06:36.601 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T15:06:36.601 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000551706 s, 928 kB/s 2024-09-13T15:06:36.603 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:06:36.666 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 6h/6d Inode: 514 Links: 1 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 15:01:04.335080797 +0000 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 15:01:04.031087807 +0000 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 15:01:04.031087807 +0000 2024-09-13T15:06:36.719 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-09-13T15:06:36.720 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:06:36.791 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T15:06:36.791 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T15:06:36.792 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000698226 s, 733 kB/s 2024-09-13T15:06:36.793 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:06:36.857 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:36.858 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T15:06:36.858 INFO:tasks.ceph:Generating config... 2024-09-13T15:06:36.859 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T15:06:36.859 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T15:06:36.859 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T15:06:36.859 INFO:tasks.ceph:[client] pid file = 2024-09-13T15:06:36.859 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T15:06:36.859 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T15:06:36.859 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T15:06:36.859 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T15:06:36.859 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T15:06:36.859 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T15:06:36.859 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T15:06:36.860 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T15:06:36.861 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T15:06:36.862 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T15:06:36.862 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T15:06:36.862 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T15:06:36.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T15:06:36.931 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T15:06:36.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T15:06:37.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:06:37.072 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.181'), ('mon.c', '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]')] 2024-09-13T15:06:37.073 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T15:06:37.074 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:37.074 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T15:06:37.130 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.181 --addv c '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:37.245 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:37.245 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:06:37.245 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2024-09-13T15:06:37.245 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2024-09-13T15:06:37.245 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:06:37.245 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2024-09-13T15:06:37.244879+0000 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-13T15:06:37.244879+0000 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 16 (pacific) 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] mon.c 2024-09-13T15:06:37.246 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T15:06:37.249 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T15:06:37.265 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 73923987-4656-4194-a4fe-9d4ec875d2d3... 2024-09-13T15:06:37.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:06:37.310 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-13T15:06:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:06:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:06:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-13T15:06:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-13T15:06:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-13T15:06:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-13T15:06:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:06:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:06:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-09-13T15:06:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-13T15:06:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-13T15:06:37.412 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-09-13T15:06:37.412 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-09-13T15:06:37.412 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:06:37.412 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-09-13T15:06:37.413 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-09-13T15:06:37.414 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on skipped message = False 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-09-13T15:06:37.415 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.416 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-09-13T15:06:37.417 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:06:37.418 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T15:06:37.419 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:06:37.420 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on pool no app = False 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:06:37.421 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = "" 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-09-13T15:06:37.422 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-13T15:06:37.423 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-13T15:06:37.433 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T15:06:37.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T15:06:37.522 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T15:06:37.522 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:37.522 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T15:06:37.536 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:37.537 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T15:06:37.594 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:06:37.594 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:37.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T15:06:37.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:06:37.694 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:06:37.694 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:37.757 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:06:37.757 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:37.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T15:06:37.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:06:37.822 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:06:37.822 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:37.880 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T15:06:37.880 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T15:06:37.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T15:06:37.983 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T15:06:37.991 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T15:06:38.087 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T15:06:38.110 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T15:06:38.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T15:06:38.205 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T15:06:38.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T15:06:38.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T15:06:38.382 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T15:06:38.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T15:06:38.422 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T15:06:38.525 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T15:06:38.532 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T15:06:38.565 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T15:06:38.702 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T15:06:38.709 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T15:06:38.736 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T15:06:38.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T15:06:38.816 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T15:06:38.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T15:06:38.919 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T15:06:38.945 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T15:06:39.015 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T15:06:39.046 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T15:06:39.114 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T15:06:39.142 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T15:06:39.142 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T15:06:39.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T15:06:39.176 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:39.176 INFO:tasks.ceph:role: osd.0 2024-09-13T15:06:39.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:06:39.177 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:39.285 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:39.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-13T15:06:39.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T15:06:39.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T15:06:39.397 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:39.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:39.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T15:06:39.474 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:39.475 INFO:tasks.ceph:role: osd.1 2024-09-13T15:06:39.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:06:39.475 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:39.586 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:39.587 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:39.587 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:39.587 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:39.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-13T15:06:39.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T15:06:39.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T15:06:39.702 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:39.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:39.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T15:06:39.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:39.779 INFO:tasks.ceph:role: osd.2 2024-09-13T15:06:39.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:06:39.780 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T15:06:39.896 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:39.896 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:39.896 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:39.896 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2024-09-13T15:06:39.897 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:39.897 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:39.897 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:39.897 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:39.897 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:39.897 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:39.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-13T15:06:39.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T15:06:39.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T15:06:40.005 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:40.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:40.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T15:06:40.085 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:40.085 INFO:tasks.ceph:role: osd.3 2024-09-13T15:06:40.085 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:06:40.085 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T15:06:40.196 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:40.196 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:40.196 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:40.196 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2024-09-13T15:06:40.196 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:40.196 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:40.197 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:40.197 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:40.197 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:40.197 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:40.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-13T15:06:40.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T15:06:40.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T15:06:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:40.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:40.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:40.475+0000 7f643e315880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T15:06:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:40.479+0000 7f643e315880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T15:06:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:40.479+0000 7f643e315880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:06:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:40.479+0000 7f643e315880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:06:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:40.479+0000 7f643e315880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:06:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:40.479+0000 7f643e315880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T15:06:43.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T15:06:43.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:43.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:43.703+0000 7ffab0ce2880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T15:06:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:43.703+0000 7ffab0ce2880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T15:06:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:43.703+0000 7ffab0ce2880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:06:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:43.703+0000 7ffab0ce2880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:06:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:43.703+0000 7ffab0ce2880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:06:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:43.707+0000 7ffab0ce2880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T15:06:46.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T15:06:46.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:46.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:46.963+0000 7fc2dd782880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T15:06:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:46.963+0000 7fc2dd782880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T15:06:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:46.963+0000 7fc2dd782880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:06:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:46.963+0000 7fc2dd782880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:06:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:46.963+0000 7fc2dd782880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:06:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:46.963+0000 7fc2dd782880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T15:06:50.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T15:06:50.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:50.211+0000 7ffa967ab880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T15:06:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:50.211+0000 7ffa967ab880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T15:06:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:50.211+0000 7ffa967ab880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T15:06:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:50.211+0000 7ffa967ab880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T15:06:50.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:50.211+0000 7ffa967ab880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T15:06:50.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:06:50.215+0000 7ffa967ab880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T15:06:53.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T15:06:53.341 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T15:06:53.375 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:53.375 INFO:tasks.ceph:role: osd.4 2024-09-13T15:06:53.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:06:53.375 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T15:06:53.986 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:53.987 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:53.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T15:06:53.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T15:06:54.122 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T15:06:54.140 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:54.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:54.142 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T15:06:54.219 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:54.219 INFO:tasks.ceph:role: osd.5 2024-09-13T15:06:54.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:06:54.220 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T15:06:54.744 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:54.745 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:54.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T15:06:54.749 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T15:06:54.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T15:06:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:54.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:54.839 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T15:06:54.914 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:54.915 INFO:tasks.ceph:role: osd.6 2024-09-13T15:06:54.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:06:54.915 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T15:06:55.501 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:55.502 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:55.507 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T15:06:55.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T15:06:55.623 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T15:06:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:55.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:55.645 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T15:06:55.721 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:06:55.721 INFO:tasks.ceph:role: osd.7 2024-09-13T15:06:55.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:06:55.722 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T15:06:56.299 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:06:56.300 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:06:56.306 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T15:06:56.307 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T15:06:56.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T15:06:56.424 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:06:56.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:06:56.426 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:56.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:56.587+0000 7fdc6bae0880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T15:06:56.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:56.591+0000 7fdc6bae0880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T15:06:56.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:56.591+0000 7fdc6bae0880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T15:06:56.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:56.591+0000 7fdc6bae0880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T15:06:56.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:56.591+0000 7fdc6bae0880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T15:06:56.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:56.599+0000 7fdc6bae0880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T15:06:59.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T15:06:59.735 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:06:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:59.847+0000 7f0f6e707880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T15:06:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:59.851+0000 7f0f6e707880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T15:06:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:59.851+0000 7f0f6e707880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T15:06:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:59.851+0000 7f0f6e707880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T15:06:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:59.851+0000 7f0f6e707880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T15:06:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:06:59.851+0000 7f0f6e707880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T15:07:02.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T15:07:03.004 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:07:03.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:03.115+0000 7fd063c60880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T15:07:03.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:03.115+0000 7fd063c60880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T15:07:03.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:03.115+0000 7fd063c60880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T15:07:03.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:03.115+0000 7fd063c60880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T15:07:03.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:03.115+0000 7fd063c60880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T15:07:03.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:03.119+0000 7fd063c60880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T15:07:05.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:05.084 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:06.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T15:07:06.260 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:07:06.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:06.375+0000 7fc1036e0880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T15:07:06.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:06.375+0000 7fc1036e0880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T15:07:06.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:06.375+0000 7fc1036e0880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T15:07:06.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:06.375+0000 7fc1036e0880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T15:07:06.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:06.375+0000 7fc1036e0880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T15:07:06.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:06.379+0000 7fc1036e0880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T15:07:09.476 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T15:07:09.509 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T15:07:09.509 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T15:07:09.543 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T15:07:09.622 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T15:07:09.697 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T15:07:09.773 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T15:07:09.848 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T15:07:09.925 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:09.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T15:07:10.002 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.002 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T15:07:10.035 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.036 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T15:07:10.111 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.111 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T15:07:10.186 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.186 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T15:07:10.259 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.259 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T15:07:10.335 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.335 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T15:07:10.408 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.408 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T15:07:10.486 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:10.487 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T15:07:10.504 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:10.504 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T15:07:10.562 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.562 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T15:07:10.579 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:10.579 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T15:07:10.641 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T15:07:10.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T15:07:10.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T15:07:10.689 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w== 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w== 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw== 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw== 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-09-13T15:07:10.690 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw== 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g== 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg== 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg== 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ== 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ== 2024-09-13T15:07:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg== 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw== 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA== 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g== 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg== 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw== 2024-09-13T15:07:10.692 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-09-13T15:07:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A== 2024-09-13T15:07:10.693 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2024-09-13T15:07:10.693 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g== 2024-09-13T15:07:10.711 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-09-13T15:07:10.711 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w== 2024-09-13T15:07:10.711 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-09-13T15:07:10.711 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg== 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-09-13T15:07:10.712 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg== 2024-09-13T15:07:10.713 INFO:teuthology.orchestra.run.smithi181.stdout:[client.2] 2024-09-13T15:07:10.714 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw== 2024-09-13T15:07:10.714 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-09-13T15:07:10.714 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A== 2024-09-13T15:07:10.714 INFO:teuthology.orchestra.run.smithi181.stdout:[client.3] 2024-09-13T15:07:10.714 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g== 2024-09-13T15:07:10.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:07:10.743 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:07:10.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:10.845 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:10.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:10.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:11.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.029 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.116 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:07:11.381 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:07:11.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:11.467 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:11.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:11.553 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:07:11.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.640 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.724 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.815 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:07:11.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:11.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.080 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.169 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.260 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:07:12.341 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T15:07:12.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T15:07:12.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:07:12.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T15:07:12.557 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T15:07:12.592 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:07:12.731 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T15:07:12.763 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T15:07:12.840 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:07:12.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T15:07:13.023 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:07:13.028 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:07:13.081 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T15:07:13.082 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T15:07:13.082 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T15:07:13.087 INFO:tasks.ceph.mon.a:Started 2024-09-13T15:07:13.087 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T15:07:13.088 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T15:07:13.129 INFO:tasks.ceph.mon.b:Started 2024-09-13T15:07:13.129 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T15:07:13.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T15:07:13.135 INFO:tasks.ceph.mon.c:Started 2024-09-13T15:07:13.135 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T15:07:13.135 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T15:07:13.135 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T15:07:13.141 INFO:tasks.ceph.mgr.y:Started 2024-09-13T15:07:13.141 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T15:07:13.141 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T15:07:13.146 INFO:tasks.ceph.mgr.x:Started 2024-09-13T15:07:13.146 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T15:07:13.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T15:07:13.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.306+0000 7fc926600700 1 Processor -- start 2024-09-13T15:07:13.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.306+0000 7fc926600700 1 -- start start 2024-09-13T15:07:13.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc926600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 0x7fc920071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc926600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 0x7fc920161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc926600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc920161740 con 0x7fc92006ed70 2024-09-13T15:07:13.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc926600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9201607b0 con 0x7fc92015a770 2024-09-13T15:07:13.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc926600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200b4120 con 0x7fc9200b39b0 2024-09-13T15:07:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc92006ed70 0x7fc92015d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59944/0 (socket says 172.21.15.50:59944) 2024-09-13T15:07:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91fe00700 1 -- 172.21.15.50:0/2139195902 learned_addr learned my addr 172.21.15.50:0/2139195902 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 0x7fc920161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91f400700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 0x7fc920071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91ea00700 1 -- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 msgr2=0x7fc920161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91ea00700 1 -- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 msgr2=0x7fc920161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 0x7fc920161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 0x7fc920161200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:07:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91f400700 1 -- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 msgr2=0x7fc920071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:07:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91f400700 1 -- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 msgr2=0x7fc920071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:07:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91f400700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 0x7fc920071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:07:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.310+0000 7fc91f400700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 0x7fc920071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:07:13.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936680897 0 0) 0x7fc918001110 con 0x7fc92006ed70 2024-09-13T15:07:13.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9040035d0 con 0x7fc92006ed70 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919254762 0 0) 0x7fc9040035d0 con 0x7fc92006ed70 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 msgr2=0x7fc920161200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.181:3300/0 conn(0x7fc9200b39b0 0x7fc920161200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 msgr2=0x7fc920071350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 --2- 172.21.15.50:0/2139195902 >> v2:172.21.15.50:3300/0 conn(0x7fc92015a770 0x7fc920071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200b4400 con 0x7fc92006ed70 2024-09-13T15:07:13.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fc918001800 con 0x7fc92006ed70 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 >> v1:172.21.15.50:6789/0 conn(0x7fc92006ed70 legacy=0x7fc92015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc904003a20 0x7fc904003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc904004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc904005230 0x7fc90400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201607b0 con 0x7fc904005230 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200b4120 con 0x7fc904004870 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90400c1e0 con 0x7fc904003a20 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc904004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.466+0000 7fc91fe00700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc904005230 0x7fc90400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91f400700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc904003a20 0x7fc904003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91ea00700 1 -- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc904003a20 msgr2=0x7fc904003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:13.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc904003a20 0x7fc904003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91ea00700 1 -- 172.21.15.50:0/2139195902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc904005230 msgr2=0x7fc90400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc904005230 0x7fc90400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91ea00700 1 -- 172.21.15.50:0/2139195902 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040035d0 con 0x7fc904004870 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91fe00700 1 -- 172.21.15.50:0/2139195902 reap_dead start 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91f400700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc904003a20 0x7fc904003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc904004cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc9040058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3136ecf357f8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00c070 con 0x7fc904004870 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c013630 con 0x7fc904004870 2024-09-13T15:07:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc91e000700 1 -- 172.21.15.50:0/2139195902 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0139e0 con 0x7fc904004870 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 -- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 msgr2=0x7fc904004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc904004cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc9040058a0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 -- 172.21.15.50:0/2139195902 shutdown_connections 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 --2- 172.21.15.50:0/2139195902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc904004cf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 -- 172.21.15.50:0/2139195902 >> 172.21.15.50:0/2139195902 conn(0x7fc9200b1e10 msgr2=0x7fc92006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 -- 172.21.15.50:0/2139195902 shutdown_connections 2024-09-13T15:07:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.470+0000 7fc926600700 1 -- 172.21.15.50:0/2139195902 wait complete. 2024-09-13T15:07:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 Processor -- start 2024-09-13T15:07:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 -- start start 2024-09-13T15:07:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc9201f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9200ce0d0 0x7fc9201f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ce550 0x7fc9201f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201f3400 con 0x7fc9200ce0d0 2024-09-13T15:07:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200cc4a0 con 0x7fc904004870 2024-09-13T15:07:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.474+0000 7fc926600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200cc740 con 0x7fc9200ce550 2024-09-13T15:07:13.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ce550 0x7fc9201f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ce550 0x7fc9201f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:46800/0 (socket says 172.21.15.50:46800) 2024-09-13T15:07:13.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91fe00700 1 -- 172.21.15.50:0/2701092225 learned_addr learned my addr 172.21.15.50:0/2701092225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:13.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9200ce0d0 0x7fc9201f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91f400700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc9201f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 -- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ce550 msgr2=0x7fc9201f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ce550 0x7fc9201f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 -- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 msgr2=0x7fc9201f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc9201f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 -- 172.21.15.50:0/2701092225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200cca20 con 0x7fc9200ce0d0 2024-09-13T15:07:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc91ea00700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9200ce0d0 0x7fc9201f5a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc90c018000 tx=0x7fc90c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c014cc0 con 0x7fc9200ce0d0 2024-09-13T15:07:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c014e20 con 0x7fc9200ce0d0 2024-09-13T15:07:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c003900 con 0x7fc9200ce0d0 2024-09-13T15:07:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9200ccd00 con 0x7fc9200ce0d0 2024-09-13T15:07:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9200cd2c0 con 0x7fc9200ce0d0 2024-09-13T15:07:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc90c027440 con 0x7fc9200ce0d0 2024-09-13T15:07:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.478+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc90c003d60 con 0x7fc9200ce0d0 2024-09-13T15:07:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.482+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920161200 con 0x7fc9200ce0d0 2024-09-13T15:07:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.486+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc90c017020 con 0x7fc9200ce0d0 2024-09-13T15:07:13.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.566+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc92006e800 con 0x7fc9200ce0d0 2024-09-13T15:07:13.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc917400700 1 -- 172.21.15.50:0/2701092225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc90c00f040 con 0x7fc9200ce0d0 2024-09-13T15:07:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9200ce0d0 msgr2=0x7fc9201f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9200ce0d0 0x7fc9201f5a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc90c018000 tx=0x7fc90c0047e0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 shutdown_connections 2024-09-13T15:07:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9200ce550 0x7fc9201f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9200ce0d0 0x7fc9201f5a30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 --2- 172.21.15.50:0/2701092225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc904004870 0x7fc9201f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.570+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 >> 172.21.15.50:0/2701092225 conn(0x7fc9200b1e10 msgr2=0x7fc920072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:13.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.574+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 shutdown_connections 2024-09-13T15:07:13.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:13.574+0000 7fc926600700 1 -- 172.21.15.50:0/2701092225 wait complete. 2024-09-13T15:07:13.580 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-09-13T15:07:13.601 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T15:07:13.601 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T15:07:13.601 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:13.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T15:07:13.636 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:13.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T15:07:13.710 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:13.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T15:07:13.711 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:13.703+0000 7f0f96f372c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:07:13.722 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:13.714+0000 7fdcf340c2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:07:13.752 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:13.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T15:07:13.826 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:13.826 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T15:07:13.857 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:13.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T15:07:13.929 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:13.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T15:07:14.002 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:07:14.003 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T15:07:14.076 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 94e9df0e-591f-44b5-9dca-6aee13c5c6f2 0 2024-09-13T15:07:14.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.283+0000 7f7a6e800700 1 Processor -- start 2024-09-13T15:07:14.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.283+0000 7f7a6e800700 1 -- start start 2024-09-13T15:07:14.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a680b3dd0 0x7f7a68072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b41b0 0x7f7a6806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6806e290 con 0x7f7a68162170 2024-09-13T15:07:14.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a680729a0 con 0x7f7a680b3dd0 2024-09-13T15:07:14.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68161480 con 0x7f7a680b41b0 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a680b3dd0 0x7f7a68072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a680b3dd0 0x7f7a68072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58424/0 (socket says 172.21.15.181:58424) 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 -- 172.21.15.181:0/3584452920 learned_addr learned my addr 172.21.15.181:0/3584452920 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6ca00700 1 --2- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b41b0 0x7f7a6806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 -- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b41b0 msgr2=0x7f7a6806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 --2- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b41b0 0x7f7a6806dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 -- 172.21.15.181:0/3584452920 >> v1:172.21.15.50:6789/0 conn(0x7f7a68162170 legacy=0x7f7a680cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 -- 172.21.15.181:0/3584452920 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680726c0 con 0x7f7a680b3dd0 2024-09-13T15:07:14.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6d400700 1 --2- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b3dd0 0x7f7a68072020 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009910 tx=0x7f7a5c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95ef22b3b5e4895f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:14.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a67e00700 1 -- 172.21.15.181:0/3584452920 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011830 con 0x7f7a680b3dd0 2024-09-13T15:07:14.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a67e00700 1 -- 172.21.15.181:0/3584452920 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c011990 con 0x7f7a680b3dd0 2024-09-13T15:07:14.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a67e00700 1 -- 172.21.15.181:0/3584452920 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011d40 con 0x7f7a680b3dd0 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b3dd0 msgr2=0x7f7a68072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 --2- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b3dd0 0x7f7a68072020 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009910 tx=0x7f7a5c009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- 172.21.15.181:0/3584452920 shutdown_connections 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 --2- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b41b0 0x7f7a6806dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 --2- 172.21.15.181:0/3584452920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b3dd0 0x7f7a68072020 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- 172.21.15.181:0/3584452920 >> 172.21.15.181:0/3584452920 conn(0x7f7a6806a780 msgr2=0x7f7a6806ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- 172.21.15.181:0/3584452920 shutdown_connections 2024-09-13T15:07:14.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.287+0000 7f7a6e800700 1 -- 172.21.15.181:0/3584452920 wait complete. 2024-09-13T15:07:14.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 Processor -- start 2024-09-13T15:07:14.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 -- start start 2024-09-13T15:07:14.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 0x7f7a6809af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b41b0 0x7f7a681f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a68162170 0x7f7a680b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a681f7c90 con 0x7f7a68162170 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6809c890 con 0x7f7a680b41b0 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6e800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68099ee0 con 0x7f7a680b3dd0 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 0x7f7a6809af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6ca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b41b0 0x7f7a681f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 0x7f7a6809af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51236/0 (socket says 172.21.15.181:51236) 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 -- 172.21.15.181:0/473070044 learned_addr learned my addr 172.21.15.181:0/473070044 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6de00700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a68162170 0x7f7a680b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 -- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b41b0 msgr2=0x7f7a681f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b41b0 0x7f7a681f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 -- 172.21.15.181:0/473070044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a68162170 msgr2=0x7f7a680b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a68162170 0x7f7a680b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 -- 172.21.15.181:0/473070044 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c009570 con 0x7f7a680b3dd0 2024-09-13T15:07:14.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.291+0000 7f7a6d400700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 0x7f7a6809af60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a68073680 tx=0x7f7a5c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c004510 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c01e070 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c003900 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6809a1c0 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6809a780 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7a5c02d450 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7a5c003d60 con 0x7f7a680b3dd0 2024-09-13T15:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.295+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a68072020 con 0x7f7a680b3dd0 2024-09-13T15:07:14.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.299+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7a5c020070 con 0x7f7a680b3dd0 2024-09-13T15:07:14.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.379+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "94e9df0e-591f-44b5-9dca-6aee13c5c6f2", "id": 0} v 0) v1 -- 0x7f7a680cea80 con 0x7f7a680b3dd0 2024-09-13T15:07:14.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a65600700 1 -- 172.21.15.181:0/473070044 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94e9df0e-591f-44b5-9dca-6aee13c5c6f2", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a5c015020 con 0x7f7a680b3dd0 2024-09-13T15:07:14.393 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-09-13T15:07:14.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 msgr2=0x7f7a6809af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 0x7f7a6809af60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a68073680 tx=0x7f7a5c004770 comp rx=0 tx=0).stop 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 shutdown_connections 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a68162170 0x7f7a680b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a680b41b0 0x7f7a681f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 --2- 172.21.15.181:0/473070044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a680b3dd0 0x7f7a6809af60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 >> 172.21.15.181:0/473070044 conn(0x7f7a6806a780 msgr2=0x7f7a68160820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 shutdown_connections 2024-09-13T15:07:14.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.387+0000 7f7a6e800700 1 -- 172.21.15.181:0/473070044 wait complete. 2024-09-13T15:07:14.417 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 0cb89c50-8f83-4dfd-a217-ff23506326c5 1 2024-09-13T15:07:14.548 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:14.542+0000 7fdcf340c2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:07:14.571 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:14.563+0000 7f0f96f372c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:07:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.579+0000 7fbdf9a00700 1 Processor -- start 2024-09-13T15:07:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.579+0000 7fbdf9a00700 1 -- start start 2024-09-13T15:07:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf9a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbdf40cf510 0x7fbdf40cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf9a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf4150390 con 0x7fbdf415c500 2024-09-13T15:07:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf9a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf406d2c0 con 0x7fbdf4073660 2024-09-13T15:07:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf9a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf415c8e0 con 0x7fbdf40cf510 2024-09-13T15:07:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf9000700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbdf4073660 0x7fbdf4163c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50940/0 (socket says 172.21.15.181:50940) 2024-09-13T15:07:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf9000700 1 -- 172.21.15.181:0/2518440465 learned_addr learned my addr 172.21.15.181:0/2518440465 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T15:07:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf3400700 1 --2- 172.21.15.181:0/2518440465 >> v2:172.21.15.50:3300/0 conn(0x7fbdf40cf510 0x7fbdf40cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612826769 0 0) 0x7fbdf406d2c0 con 0x7fbdf4073660 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd80057e0 con 0x7fbdf4073660 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001144345 0 0) 0x7fbdf4150390 con 0x7fbdf415c500 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf406d2c0 con 0x7fbdf415c500 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf3400700 1 -- 172.21.15.181:0/2518440465 >> v1:172.21.15.181:6789/0 conn(0x7fbdf4073660 legacy=0x7fbdf4163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf3400700 1 -- 172.21.15.181:0/2518440465 >> v1:172.21.15.50:6789/0 conn(0x7fbdf415c500 legacy=0x7fbdf4070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf3400700 1 -- 172.21.15.181:0/2518440465 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf406c460 con 0x7fbdf40cf510 2024-09-13T15:07:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.583+0000 7fbdf3400700 1 --2- 172.21.15.181:0/2518440465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf40cf510 0x7fbdf40cf980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009880 tx=0x7fbde0009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa56d054c9ec9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0011830 con 0x7fbdf40cf510 2024-09-13T15:07:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0011990 con 0x7fbdf40cf510 2024-09-13T15:07:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf2a00700 1 -- 172.21.15.181:0/2518440465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0011d20 con 0x7fbdf40cf510 2024-09-13T15:07:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2518440465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf40cf510 msgr2=0x7fbdf40cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 --2- 172.21.15.181:0/2518440465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf40cf510 0x7fbdf40cf980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009880 tx=0x7fbde0009b90 comp rx=0 tx=0).stop 2024-09-13T15:07:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2518440465 shutdown_connections 2024-09-13T15:07:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 --2- 172.21.15.181:0/2518440465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf40cf510 0x7fbdf40cf980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2518440465 >> 172.21.15.181:0/2518440465 conn(0x7fbdf406a780 msgr2=0x7fbdf406ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2518440465 shutdown_connections 2024-09-13T15:07:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.587+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2518440465 wait complete. 2024-09-13T15:07:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 Processor -- start 2024-09-13T15:07:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 -- start start 2024-09-13T15:07:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdf4073660 0x7fbdf41f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 0x7fbdf4158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf415c500 0x7fbdf4144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4151b10 con 0x7fbdf415c500 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40b2c10 con 0x7fbdf4073660 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4099a20 con 0x7fbdf40cf510 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 0x7fbdf4158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 0x7fbdf4158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51248/0 (socket says 172.21.15.181:51248) 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf3400700 1 -- 172.21.15.181:0/2715770614 learned_addr learned my addr 172.21.15.181:0/2715770614 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf3e00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdf4073660 0x7fbdf41f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.591+0000 7fbdf9000700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf415c500 0x7fbdf4144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3e00700 1 -- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 msgr2=0x7fbdf4158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3e00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 0x7fbdf4158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3e00700 1 -- 172.21.15.181:0/2715770614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf415c500 msgr2=0x7fbdf4144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3e00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf415c500 0x7fbdf4144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3e00700 1 -- 172.21.15.181:0/2715770614 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00094b0 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3400700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 0x7fbdf4158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf3e00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdf4073660 0x7fbdf41f69b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c430 tx=0x7fbde400c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40052d0 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf4151270 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400ce90 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40036a0 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf4151830 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbde4003b00 con 0x7fbdf4073660 2024-09-13T15:07:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fbde401c440 con 0x7fbdf4073660 2024-09-13T15:07:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.595+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf40b2970 con 0x7fbdf4073660 2024-09-13T15:07:14.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.603+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbdf40b2970 con 0x7fbdf4073660 2024-09-13T15:07:14.638 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:14.630+0000 7fdcf340c2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:07:14.660 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:14.651+0000 7f0f96f372c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:07:14.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.683+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0cb89c50-8f83-4dfd-a217-ff23506326c5", "id": 1} v 0) v1 -- 0x7fbdf40b2d50 con 0x7fbdf4073660 2024-09-13T15:07:14.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdebe00700 1 -- 172.21.15.181:0/2715770614 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cb89c50-8f83-4dfd-a217-ff23506326c5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbdf40b2d50 con 0x7fbdf4073660 2024-09-13T15:07:14.697 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdf4073660 msgr2=0x7fbdf41f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdf4073660 0x7fbdf41f69b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c430 tx=0x7fbde400c740 comp rx=0 tx=0).stop 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 shutdown_connections 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdf415c500 0x7fbdf4144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbdf40cf510 0x7fbdf4158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 --2- 172.21.15.181:0/2715770614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdf4073660 0x7fbdf41f69b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 >> 172.21.15.181:0/2715770614 conn(0x7fbdf406a780 msgr2=0x7fbdf40aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:14.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 shutdown_connections 2024-09-13T15:07:14.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.691+0000 7fbdf9a00700 1 -- 172.21.15.181:0/2715770614 wait complete. 2024-09-13T15:07:14.720 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new c07fbfc7-cafd-4308-94d8-adb1fb8d1435 2 2024-09-13T15:07:14.853 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:14.846+0000 7fdcf340c2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:07:14.876 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:14.871+0000 7f0f96f372c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:07:14.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7db1200700 1 Processor -- start 2024-09-13T15:07:14.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7db1200700 1 -- start start 2024-09-13T15:07:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7db1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac06d620 0x7f7dac06c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7db1200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0b1980 con 0x7f7dac06cea0 2024-09-13T15:07:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7db1200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0b2500 con 0x7f7dac143b70 2024-09-13T15:07:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7db1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac06d2f0 con 0x7f7dac06d620 2024-09-13T15:07:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7dab400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7dac143b70 0x7f7dac0cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50944/0 (socket says 172.21.15.181:50944) 2024-09-13T15:07:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7dab400700 1 -- 172.21.15.181:0/3912216767 learned_addr learned my addr 172.21.15.181:0/3912216767 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T15:07:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.879+0000 7f7daaa00700 1 --2- 172.21.15.181:0/3912216767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac06d620 0x7f7dac06c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464019387 0 0) 0x7f7dac0b2500 con 0x7f7dac143b70 2024-09-13T15:07:14.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d900035d0 con 0x7f7dac143b70 2024-09-13T15:07:14.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919018225 0 0) 0x7f7dac0b1980 con 0x7f7dac06cea0 2024-09-13T15:07:14.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dac0b2500 con 0x7f7dac06cea0 2024-09-13T15:07:14.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457442725 0 0) 0x7f7d900035d0 con 0x7f7dac143b70 2024-09-13T15:07:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daaa00700 1 -- 172.21.15.181:0/3912216767 >> v1:172.21.15.181:6789/0 conn(0x7f7dac143b70 legacy=0x7f7dac0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daaa00700 1 -- 172.21.15.181:0/3912216767 >> v1:172.21.15.50:6789/0 conn(0x7f7dac06cea0 legacy=0x7f7dac0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daaa00700 1 -- 172.21.15.181:0/3912216767 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0b1bd0 con 0x7f7dac06d620 2024-09-13T15:07:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daaa00700 1 --2- 172.21.15.181:0/3912216767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac06d620 0x7f7dac06c960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009800 tx=0x7f7d98009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5395510391ccf5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c001670 con 0x7f7dac06d620 2024-09-13T15:07:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d98004030 con 0x7f7dac06d620 2024-09-13T15:07:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7daa000700 1 -- 172.21.15.181:0/3912216767 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980043c0 con 0x7f7dac06d620 2024-09-13T15:07:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 -- 172.21.15.181:0/3912216767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac06d620 msgr2=0x7f7dac06c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 --2- 172.21.15.181:0/3912216767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac06d620 0x7f7dac06c960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009800 tx=0x7f7d98009b10 comp rx=0 tx=0).stop 2024-09-13T15:07:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 -- 172.21.15.181:0/3912216767 shutdown_connections 2024-09-13T15:07:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 --2- 172.21.15.181:0/3912216767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac06d620 0x7f7dac06c960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 -- 172.21.15.181:0/3912216767 >> 172.21.15.181:0/3912216767 conn(0x7f7dac06a390 msgr2=0x7f7dac06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:14.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 -- 172.21.15.181:0/3912216767 shutdown_connections 2024-09-13T15:07:14.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.883+0000 7f7db1200700 1 -- 172.21.15.181:0/3912216767 wait complete. 2024-09-13T15:07:14.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.887+0000 7f7db1200700 1 Processor -- start 2024-09-13T15:07:14.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.887+0000 7f7db1200700 1 -- start start 2024-09-13T15:07:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.887+0000 7f7db1200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dac06cea0 0x7f7dac15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.887+0000 7f7db1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac06d620 0x7f7dac13c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.887+0000 7f7db1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 0x7f7dac071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7db1200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac15d690 con 0x7f7dac06d620 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7db1200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac13d8e0 con 0x7f7dac06cea0 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7db1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac13dbc0 con 0x7f7dac143b70 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 0x7f7dac071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dab400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dac06cea0 0x7f7dac15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 0x7f7dac071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51264/0 (socket says 172.21.15.181:51264) 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 -- 172.21.15.181:0/2988795605 learned_addr learned my addr 172.21.15.181:0/2988795605 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7daaa00700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac06d620 0x7f7dac13c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 -- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dac06cea0 msgr2=0x7f7dac15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dac06cea0 0x7f7dac15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 -- 172.21.15.181:0/2988795605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac06d620 msgr2=0x7f7dac13c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac06d620 0x7f7dac13c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 -- 172.21.15.181:0/2988795605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980094b0 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7dabe00700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 0x7f7dac071060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7da400cc20 tx=0x7f7da400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4003c20 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4003d80 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac13dea0 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400aae0 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac140f10 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7da40050d0 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7da40057a0 con 0x7f7dac143b70 2024-09-13T15:07:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.891+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac140d70 con 0x7f7dac143b70 2024-09-13T15:07:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.895+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7dac140d70 con 0x7f7dac143b70 2024-09-13T15:07:14.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.975+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c07fbfc7-cafd-4308-94d8-adb1fb8d1435", "id": 2} v 0) v1 -- 0x7f7dac06c960 con 0x7f7dac143b70 2024-09-13T15:07:14.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.987+0000 7f7da3400700 1 -- 172.21.15.181:0/2988795605 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c07fbfc7-cafd-4308-94d8-adb1fb8d1435", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7da4005380 con 0x7f7dac143b70 2024-09-13T15:07:14.994 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-09-13T15:07:14.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 msgr2=0x7f7dac071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:14.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 0x7f7dac071060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7da400cc20 tx=0x7f7da400cf30 comp rx=0 tx=0).stop 2024-09-13T15:07:14.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 shutdown_connections 2024-09-13T15:07:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7dac143b70 0x7f7dac071060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac06d620 0x7f7dac13c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 --2- 172.21.15.181:0/2988795605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7dac06cea0 0x7f7dac15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 >> 172.21.15.181:0/2988795605 conn(0x7f7dac06a390 msgr2=0x7f7dac0cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 shutdown_connections 2024-09-13T15:07:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:14.991+0000 7f7db1200700 1 -- 172.21.15.181:0/2988795605 wait complete. 2024-09-13T15:07:15.015 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new bd5a1c36-553d-4756-9d99-91cdc9e89421 3 2024-09-13T15:07:15.141 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:15.134+0000 7fdcf340c2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:07:15.177 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:15.171+0000 7f0f96f372c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:07:15.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.175+0000 7f9171200700 1 Processor -- start 2024-09-13T15:07:15.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 -- start start 2024-09-13T15:07:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c143b60 0x7f916c0d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f916c0cf3b0 0x7f916c0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f916c15e720 0x7f916c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c15f710 con 0x7f916c0cf3b0 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c0d19e0 con 0x7f916c15e720 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9171200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0d0780 con 0x7f916c143b60 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f916a800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f916c15e720 0x7f916c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c143b60 0x7f916c0d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f916a800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f916c15e720 0x7f916c15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58478/0 (socket says 172.21.15.181:58478) 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f916a800700 1 -- 172.21.15.181:0/1030215260 learned_addr learned my addr 172.21.15.181:0/1030215260 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:15.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169400700 1 --2- 172.21.15.181:0/1030215260 >> v2:172.21.15.50:3300/0 conn(0x7f916c0cf3b0 0x7f916c0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 -- 172.21.15.181:0/1030215260 >> v2:172.21.15.181:3300/0 conn(0x7f916c15e720 msgr2=0x7f916c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 --2- 172.21.15.181:0/1030215260 >> v2:172.21.15.181:3300/0 conn(0x7f916c15e720 0x7f916c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 -- 172.21.15.181:0/1030215260 >> v2:172.21.15.50:3300/0 conn(0x7f916c0cf3b0 msgr2=0x7f916c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 --2- 172.21.15.181:0/1030215260 >> v2:172.21.15.50:3300/0 conn(0x7f916c0cf3b0 0x7f916c0cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 -- 172.21.15.181:0/1030215260 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c0cfd30 con 0x7f916c143b60 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9169e00700 1 --2- 172.21.15.181:0/1030215260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c143b60 0x7f916c0d14a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f916c0b07a0 tx=0x7f915c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794efd467c720e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:15.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9168a00700 1 -- 172.21.15.181:0/1030215260 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c011830 con 0x7f916c143b60 2024-09-13T15:07:15.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.179+0000 7f9168a00700 1 -- 172.21.15.181:0/1030215260 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c011990 con 0x7f916c143b60 2024-09-13T15:07:15.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9168a00700 1 -- 172.21.15.181:0/1030215260 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c011d20 con 0x7f916c143b60 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 -- 172.21.15.181:0/1030215260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c143b60 msgr2=0x7f916c0d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 --2- 172.21.15.181:0/1030215260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c143b60 0x7f916c0d14a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f916c0b07a0 tx=0x7f915c009b30 comp rx=0 tx=0).stop 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 -- 172.21.15.181:0/1030215260 shutdown_connections 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 --2- 172.21.15.181:0/1030215260 >> v2:172.21.15.181:3300/0 conn(0x7f916c15e720 0x7f916c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 --2- 172.21.15.181:0/1030215260 >> v2:172.21.15.50:3300/0 conn(0x7f916c0cf3b0 0x7f916c0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 --2- 172.21.15.181:0/1030215260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c143b60 0x7f916c0d14a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 -- 172.21.15.181:0/1030215260 >> 172.21.15.181:0/1030215260 conn(0x7f916c06e660 msgr2=0x7f916c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 -- 172.21.15.181:0/1030215260 shutdown_connections 2024-09-13T15:07:15.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.183+0000 7f9171200700 1 -- 172.21.15.181:0/1030215260 wait complete. 2024-09-13T15:07:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 Processor -- start 2024-09-13T15:07:15.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 -- start start 2024-09-13T15:07:15.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c0cf3b0 0x7f916c13f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c143b60 0x7f916c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 0x7f916c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14d190 con 0x7f916c0cf3b0 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14d750 con 0x7f916c143b60 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9171200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14fca0 con 0x7f916c15e720 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f916a800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 0x7f916c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c143b60 0x7f916c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f916a800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 0x7f916c0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51288/0 (socket says 172.21.15.181:51288) 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f916a800700 1 -- 172.21.15.181:0/1746883924 learned_addr learned my addr 172.21.15.181:0/1746883924 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c0cf3b0 0x7f916c13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 -- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 msgr2=0x7f916c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 0x7f916c0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 -- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c143b60 msgr2=0x7f916c14f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c143b60 0x7f916c14f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 -- 172.21.15.181:0/1746883924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0094b0 con 0x7f916c0cf3b0 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169400700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c143b60 0x7f916c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f916a800700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 0x7f916c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.187+0000 7f9169e00700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c0cf3b0 0x7f916c13f540 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f915c016000 tx=0x7f915c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c004510 con 0x7f916c0cf3b0 2024-09-13T15:07:15.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c01e070 con 0x7f916c0cf3b0 2024-09-13T15:07:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c003900 con 0x7f916c0cf3b0 2024-09-13T15:07:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c14ff80 con 0x7f916c0cf3b0 2024-09-13T15:07:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c13fa80 con 0x7f916c0cf3b0 2024-09-13T15:07:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f915c02d450 con 0x7f916c0cf3b0 2024-09-13T15:07:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f915c003d60 con 0x7f916c0cf3b0 2024-09-13T15:07:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.191+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c1501c0 con 0x7f916c0cf3b0 2024-09-13T15:07:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.199+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f915c020070 con 0x7f916c0cf3b0 2024-09-13T15:07:15.222 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:15.214+0000 7fdcf340c2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:07:15.261 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:15.255+0000 7f0f96f372c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:07:15.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.279+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bd5a1c36-553d-4756-9d99-91cdc9e89421", "id": 3} v 0) v1 -- 0x7f916c0cf7f0 con 0x7f916c0cf3b0 2024-09-13T15:07:15.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.283+0000 7f9162000700 1 -- 172.21.15.181:0/1746883924 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd5a1c36-553d-4756-9d99-91cdc9e89421", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f915c015020 con 0x7f916c0cf3b0 2024-09-13T15:07:15.291 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-09-13T15:07:15.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c0cf3b0 msgr2=0x7f916c13f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c0cf3b0 0x7f916c13f540 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f915c016000 tx=0x7f915c004770 comp rx=0 tx=0).stop 2024-09-13T15:07:15.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 shutdown_connections 2024-09-13T15:07:15.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c15e720 0x7f916c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c143b60 0x7f916c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 --2- 172.21.15.181:0/1746883924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c0cf3b0 0x7f916c13f540 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 >> 172.21.15.181:0/1746883924 conn(0x7f916c06e660 msgr2=0x7f916c06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:15.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 shutdown_connections 2024-09-13T15:07:15.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.287+0000 7f9171200700 1 -- 172.21.15.181:0/1746883924 wait complete. 2024-09-13T15:07:15.312 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new c182ec57-da4b-4749-af30-c787603621c2 4 2024-09-13T15:07:15.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 Processor -- start 2024-09-13T15:07:15.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 -- start start 2024-09-13T15:07:15.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f09e00cf5c0 0x7f09e006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e013f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e00b2e10 con 0x7f09e015d350 2024-09-13T15:07:15.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e013fdd0 con 0x7f09e00cf5c0 2024-09-13T15:07:15.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e7000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e006b4a0 con 0x7f09e006a390 2024-09-13T15:07:15.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f09e00cf5c0 0x7f09e006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f09e00cf5c0 0x7f09e006b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58498/0 (socket says 172.21.15.181:58498) 2024-09-13T15:07:15.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e013f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51298/0 (socket says 172.21.15.181:51298) 2024-09-13T15:07:15.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5c00700 1 -- 172.21.15.181:0/3766651925 learned_addr learned my addr 172.21.15.181:0/3766651925 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:15.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5200700 1 -- 172.21.15.181:0/3766651925 >> v2:172.21.15.181:3300/0 conn(0x7f09e00cf5c0 msgr2=0x7f09e006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:15.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5200700 1 --2- 172.21.15.181:0/3766651925 >> v2:172.21.15.181:3300/0 conn(0x7f09e00cf5c0 0x7f09e006b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5200700 1 -- 172.21.15.181:0/3766651925 >> v1:172.21.15.50:6789/0 conn(0x7f09e015d350 legacy=0x7f09e00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.459+0000 7f09e5200700 1 -- 172.21.15.181:0/3766651925 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e006a890 con 0x7f09e006a390 2024-09-13T15:07:15.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e5200700 1 --2- 172.21.15.181:0/3766651925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e013f890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009850 tx=0x7f09cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f8c858287091de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:15.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09dfe00700 1 -- 172.21.15.181:0/3766651925 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc011830 con 0x7f09e006a390 2024-09-13T15:07:15.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09dfe00700 1 -- 172.21.15.181:0/3766651925 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc011990 con 0x7f09e006a390 2024-09-13T15:07:15.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09dfe00700 1 -- 172.21.15.181:0/3766651925 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc011d40 con 0x7f09e006a390 2024-09-13T15:07:15.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 -- 172.21.15.181:0/3766651925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 msgr2=0x7f09e013f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 --2- 172.21.15.181:0/3766651925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e013f890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009850 tx=0x7f09cc009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:15.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 -- 172.21.15.181:0/3766651925 shutdown_connections 2024-09-13T15:07:15.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 --2- 172.21.15.181:0/3766651925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e013f890 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 --2- 172.21.15.181:0/3766651925 >> v2:172.21.15.181:3300/0 conn(0x7f09e00cf5c0 0x7f09e006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 -- 172.21.15.181:0/3766651925 >> 172.21.15.181:0/3766651925 conn(0x7f09e0070d10 msgr2=0x7f09e00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:15.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 -- 172.21.15.181:0/3766651925 shutdown_connections 2024-09-13T15:07:15.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 -- 172.21.15.181:0/3766651925 wait complete. 2024-09-13T15:07:15.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 Processor -- start 2024-09-13T15:07:15.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.463+0000 7f09e7000700 1 -- start start 2024-09-13T15:07:15.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e00cf5c0 0x7f09e0139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09e015d350 0x7f09e0139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e013a070 con 0x7f09e00cf5c0 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e01f3310 con 0x7f09e015d350 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e015bfc0 con 0x7f09e006a390 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51306/0 (socket says 172.21.15.181:51306) 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 -- 172.21.15.181:0/636690207 learned_addr learned my addr 172.21.15.181:0/636690207 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:15.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e6600700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09e015d350 0x7f09e0139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5200700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e00cf5c0 0x7f09e0139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 -- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09e015d350 msgr2=0x7f09e0139760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09e015d350 0x7f09e0139760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 -- 172.21.15.181:0/636690207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e00cf5c0 msgr2=0x7f09e0139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e00cf5c0 0x7f09e0139220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 -- 172.21.15.181:0/636690207 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0094b0 con 0x7f09e006a390 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e6600700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09e015d350 0x7f09e0139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e5c00700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e015ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e930 tx=0x7f09d400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40096c0 con 0x7f09e006a390 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400c850 con 0x7f09e006a390 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e01f2a00 con 0x7f09e006a390 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400cc00 con 0x7f09e006a390 2024-09-13T15:07:15.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e0139d90 con 0x7f09e006a390 2024-09-13T15:07:15.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.467+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f09d4005d40 con 0x7f09e006a390 2024-09-13T15:07:15.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.471+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f09d400cd60 con 0x7f09e006a390 2024-09-13T15:07:15.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.471+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e015db90 con 0x7f09e006a390 2024-09-13T15:07:15.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.475+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f09d4021060 con 0x7f09e006a390 2024-09-13T15:07:15.486 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:15.478+0000 7fdcf340c2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:07:15.547 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:15.539+0000 7f0f96f372c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:07:15.586 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:15.578+0000 7fdcf340c2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:07:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.591+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c182ec57-da4b-4749-af30-c787603621c2", "id": 4} v 0) v1 -- 0x7f09e00b5390 con 0x7f09e006a390 2024-09-13T15:07:15.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09dd600700 1 -- 172.21.15.181:0/636690207 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c182ec57-da4b-4749-af30-c787603621c2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f09d4029020 con 0x7f09e006a390 2024-09-13T15:07:15.606 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-09-13T15:07:15.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 msgr2=0x7f09e015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e015ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e930 tx=0x7f09d400ecf0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 shutdown_connections 2024-09-13T15:07:15.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09e015d350 0x7f09e0139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e00cf5c0 0x7f09e0139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 --2- 172.21.15.181:0/636690207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f09e006a390 0x7f09e015ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 >> 172.21.15.181:0/636690207 conn(0x7f09e0070d10 msgr2=0x7f09e013ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:15.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 shutdown_connections 2024-09-13T15:07:15.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.599+0000 7f09e7000700 1 -- 172.21.15.181:0/636690207 wait complete. 2024-09-13T15:07:15.626 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 045f32b9-a818-40af-ba9c-3a4e4420564e 5 2024-09-13T15:07:15.657 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:15.651+0000 7f0f96f372c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:07:15.691 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:15.686+0000 7fdcf340c2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:07:15.754 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:15.747+0000 7f0f96f372c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:07:15.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.783+0000 7f4c20c00700 1 Processor -- start 2024-09-13T15:07:15.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.787+0000 7f4c20c00700 1 -- start start 2024-09-13T15:07:15.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.787+0000 7f4c20c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c1c157470 0x7f4c1c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.787+0000 7f4c20c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c06ed70 0x7f4c1c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.787+0000 7f4c20c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c157850 con 0x7f4c1c0725c0 2024-09-13T15:07:15.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.787+0000 7f4c20c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c06f720 con 0x7f4c1c157470 2024-09-13T15:07:15.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.787+0000 7f4c20c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15dd20 con 0x7f4c1c06ed70 2024-09-13T15:07:15.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4c1c0725c0 0x7f4c1c15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50950/0 (socket says 172.21.15.181:50950) 2024-09-13T15:07:15.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19400700 1 -- 172.21.15.181:0/2424265554 learned_addr learned my addr 172.21.15.181:0/2424265554 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T15:07:15.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c1a800700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c06ed70 0x7f4c1c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19e00700 1 --2- 172.21.15.181:0/2424265554 >> v2:172.21.15.50:3300/0 conn(0x7f4c1c157470 0x7f4c1c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c18a00700 1 -- 172.21.15.181:0/2424265554 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282186204 0 0) 0x7f4c1c157850 con 0x7f4c1c0725c0 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c18a00700 1 -- 172.21.15.181:0/2424265554 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c000057e0 con 0x7f4c1c0725c0 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19e00700 1 -- 172.21.15.181:0/2424265554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c06ed70 msgr2=0x7f4c1c06f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19e00700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c06ed70 0x7f4c1c06f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19e00700 1 -- 172.21.15.181:0/2424265554 >> v1:172.21.15.181:6789/0 conn(0x7f4c1c0725c0 legacy=0x7f4c1c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19e00700 1 -- 172.21.15.181:0/2424265554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c15e000 con 0x7f4c1c157470 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c1a800700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c06ed70 0x7f4c1c06f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:15.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c19e00700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c157470 0x7f4c1c15a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009850 tx=0x7f4c0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27825c1521056d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:15.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c18a00700 1 -- 172.21.15.181:0/2424265554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c011830 con 0x7f4c1c157470 2024-09-13T15:07:15.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c18a00700 1 -- 172.21.15.181:0/2424265554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c011990 con 0x7f4c1c157470 2024-09-13T15:07:15.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c18a00700 1 -- 172.21.15.181:0/2424265554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c011d40 con 0x7f4c1c157470 2024-09-13T15:07:15.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 -- 172.21.15.181:0/2424265554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c157470 msgr2=0x7f4c1c15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c157470 0x7f4c1c15a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009850 tx=0x7f4c0c009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 -- 172.21.15.181:0/2424265554 shutdown_connections 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c06ed70 0x7f4c1c06f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 --2- 172.21.15.181:0/2424265554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c157470 0x7f4c1c15a7f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 -- 172.21.15.181:0/2424265554 >> 172.21.15.181:0/2424265554 conn(0x7f4c1c0b1e10 msgr2=0x7f4c1c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 -- 172.21.15.181:0/2424265554 shutdown_connections 2024-09-13T15:07:15.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.791+0000 7f4c20c00700 1 -- 172.21.15.181:0/2424265554 wait complete. 2024-09-13T15:07:15.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 Processor -- start 2024-09-13T15:07:15.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 -- start start 2024-09-13T15:07:15.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c06ed70 0x7f4c1c145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 0x7f4c1c0ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c1c157470 0x7f4c1c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:15.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0cbb60 con 0x7f4c1c06ed70 2024-09-13T15:07:15.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1458b0 con 0x7f4c1c157470 2024-09-13T15:07:15.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c20c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0caf50 con 0x7f4c1c0725c0 2024-09-13T15:07:15.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 0x7f4c1c0ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 0x7f4c1c0ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51320/0 (socket says 172.21.15.181:51320) 2024-09-13T15:07:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 -- 172.21.15.181:0/1609914282 learned_addr learned my addr 172.21.15.181:0/1609914282 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c1a800700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c1c157470 0x7f4c1c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19e00700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c06ed70 0x7f4c1c145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 -- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c1c157470 msgr2=0x7f4c1c158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c1c157470 0x7f4c1c158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 -- 172.21.15.181:0/1609914282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c06ed70 msgr2=0x7f4c1c145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c06ed70 0x7f4c1c145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 -- 172.21.15.181:0/1609914282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009a70 con 0x7f4c1c0725c0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.795+0000 7f4c19400700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 0x7f4c1c0ca4b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c4d0 tx=0x7f4c0800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005d90 con 0x7f4c1c0725c0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c080070d0 con 0x7f4c1c0725c0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c0094b0 con 0x7f4c1c0725c0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08007480 con 0x7f4c1c0725c0 2024-09-13T15:07:15.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0cb510 con 0x7f4c1c0725c0 2024-09-13T15:07:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4c0801c440 con 0x7f4c1c0725c0 2024-09-13T15:07:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4c08012980 con 0x7f4c1c0725c0 2024-09-13T15:07:15.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.799+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c0c5b10 con 0x7f4c1c0725c0 2024-09-13T15:07:15.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.803+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4c08017070 con 0x7f4c1c0725c0 2024-09-13T15:07:15.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.883+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "045f32b9-a818-40af-ba9c-3a4e4420564e", "id": 5} v 0) v1 -- 0x7f4c1c06f1e0 con 0x7f4c1c0725c0 2024-09-13T15:07:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c12000700 1 -- 172.21.15.181:0/1609914282 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "045f32b9-a818-40af-ba9c-3a4e4420564e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c08012400 con 0x7f4c1c0725c0 2024-09-13T15:07:15.898 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-09-13T15:07:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 msgr2=0x7f4c1c0ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 0x7f4c1c0ca4b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c4d0 tx=0x7f4c0800c890 comp rx=0 tx=0).stop 2024-09-13T15:07:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 shutdown_connections 2024-09-13T15:07:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c1c157470 0x7f4c1c158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c1c0725c0 0x7f4c1c0ca4b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 --2- 172.21.15.181:0/1609914282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c06ed70 0x7f4c1c145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 >> 172.21.15.181:0/1609914282 conn(0x7f4c1c0b1e10 msgr2=0x7f4c1c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 shutdown_connections 2024-09-13T15:07:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:15.891+0000 7f4c20c00700 1 -- 172.21.15.181:0/1609914282 wait complete. 2024-09-13T15:07:15.921 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 924895c8-931b-4603-bf8a-034884888b83 6 2024-09-13T15:07:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.131+0000 7f95f1000700 1 Processor -- start 2024-09-13T15:07:16.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.131+0000 7f95f1000700 1 -- start start 2024-09-13T15:07:16.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95f1000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95ec0b2290 0x7f95ec159500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95f1000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f95ec159a40 0x7f95ec071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95f1000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec15a920 con 0x7f95ec0b0f20 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95f1000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec15a7c0 con 0x7f95ec0b2290 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95f1000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec159f20 con 0x7f95ec159a40 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f95ec159a40 0x7f95ec071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95e9400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95ec0b2290 0x7f95ec159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f95ec159a40 0x7f95ec071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58512/0 (socket says 172.21.15.181:58512) 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95e9400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95ec0b2290 0x7f95ec159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.181:58494/0 (socket says 172.21.15.181:58494) 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 -- 172.21.15.181:0/1176356115 learned_addr learned my addr 172.21.15.181:0/1176356115 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 -- 172.21.15.181:0/1176356115 >> v2:172.21.15.50:3300/0 conn(0x7f95ec0b2290 msgr2=0x7f95ec159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 --2- 172.21.15.181:0/1176356115 >> v2:172.21.15.50:3300/0 conn(0x7f95ec0b2290 0x7f95ec159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 -- 172.21.15.181:0/1176356115 >> v1:172.21.15.50:6789/0 conn(0x7f95ec0b0f20 legacy=0x7f95ec0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 -- 172.21.15.181:0/1176356115 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec15a200 con 0x7f95ec159a40 2024-09-13T15:07:16.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95ea800700 1 --2- 172.21.15.181:0/1176356115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec071860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0706b0 tx=0x7f95e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e91b745e725b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95e8a00700 1 -- 172.21.15.181:0/1176356115 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400e070 con 0x7f95ec159a40 2024-09-13T15:07:16.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95e8a00700 1 -- 172.21.15.181:0/1176356115 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400b910 con 0x7f95ec159a40 2024-09-13T15:07:16.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.135+0000 7f95e8a00700 1 -- 172.21.15.181:0/1176356115 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400bcc0 con 0x7f95ec159a40 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 -- 172.21.15.181:0/1176356115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 msgr2=0x7f95ec071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 --2- 172.21.15.181:0/1176356115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec071860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0706b0 tx=0x7f95e400b330 comp rx=0 tx=0).stop 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 -- 172.21.15.181:0/1176356115 shutdown_connections 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 --2- 172.21.15.181:0/1176356115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec071860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 --2- 172.21.15.181:0/1176356115 >> v2:172.21.15.50:3300/0 conn(0x7f95ec0b2290 0x7f95ec159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 -- 172.21.15.181:0/1176356115 >> 172.21.15.181:0/1176356115 conn(0x7f95ec06e840 msgr2=0x7f95ec06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 -- 172.21.15.181:0/1176356115 shutdown_connections 2024-09-13T15:07:16.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 -- 172.21.15.181:0/1176356115 wait complete. 2024-09-13T15:07:16.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 Processor -- start 2024-09-13T15:07:16.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.139+0000 7f95f1000700 1 -- start start 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95ec0b0f20 0x7f95ec14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 0x7f95ec14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec1505b0 con 0x7f95ec0b0f20 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec14cfb0 con 0x7f95ec159a40 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec148830 con 0x7f95ec0b2290 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 0x7f95ec14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 0x7f95ec14ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51334/0 (socket says 172.21.15.181:51334) 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 -- 172.21.15.181:0/3676917321 learned_addr learned my addr 172.21.15.181:0/3676917321 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95ea800700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9e00700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95ec0b0f20 0x7f95ec14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 -- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 msgr2=0x7f95ec1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 -- 172.21.15.181:0/3676917321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95ec0b0f20 msgr2=0x7f95ec14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95ec0b0f20 0x7f95ec14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 -- 172.21.15.181:0/3676917321 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009b30 con 0x7f95ec0b2290 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e9400700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 0x7f95ec14ca70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95d800e9d0 tx=0x7f95d800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8009720 con 0x7f95ec0b2290 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800ee70 con 0x7f95ec0b2290 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec14d230 con 0x7f95ec0b2290 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800ca50 con 0x7f95ec0b2290 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.143+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec14d7f0 con 0x7f95ec0b2290 2024-09-13T15:07:16.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.147+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f95d8005a40 con 0x7f95ec0b2290 2024-09-13T15:07:16.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.147+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f95d80067a0 con 0x7f95ec0b2290 2024-09-13T15:07:16.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.147+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec073b70 con 0x7f95ec0b2290 2024-09-13T15:07:16.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.151+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f95d8021060 con 0x7f95ec0b2290 2024-09-13T15:07:16.212 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:16.206+0000 7fdcf340c2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:07:16.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.239+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "924895c8-931b-4603-bf8a-034884888b83", "id": 6} v 0) v1 -- 0x7f95ec0aebe0 con 0x7f95ec0b2290 2024-09-13T15:07:16.247 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:16.239+0000 7f0f96f372c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:07:16.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95e2000700 1 -- 172.21.15.181:0/3676917321 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "924895c8-931b-4603-bf8a-034884888b83", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95d8017070 con 0x7f95ec0b2290 2024-09-13T15:07:16.253 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 msgr2=0x7f95ec14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 0x7f95ec14ca70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95d800e9d0 tx=0x7f95d800ece0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 shutdown_connections 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95ec159a40 0x7f95ec1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95ec0b2290 0x7f95ec14ca70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 --2- 172.21.15.181:0/3676917321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95ec0b0f20 0x7f95ec14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 >> 172.21.15.181:0/3676917321 conn(0x7f95ec06e840 msgr2=0x7f95ec06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 shutdown_connections 2024-09-13T15:07:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.247+0000 7f95f1000700 1 -- 172.21.15.181:0/3676917321 wait complete. 2024-09-13T15:07:16.274 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 99d95a00-ff75-47da-bf7e-8c742d02cec5 7 2024-09-13T15:07:16.395 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:16.390+0000 7fdcf340c2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:07:16.420 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:16.415+0000 7f0f96f372c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:07:16.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 Processor -- start 2024-09-13T15:07:16.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 -- start start 2024-09-13T15:07:16.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc8c40cf5c0 0x7fc8c406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c413f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40b2e10 con 0x7fc8c415d350 2024-09-13T15:07:16.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c413fdd0 con 0x7fc8c40cf5c0 2024-09-13T15:07:16.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.427+0000 7fc8c3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c406b4a0 con 0x7fc8c406a390 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc8c40cf5c0 0x7fc8c406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc8c40cf5c0 0x7fc8c406b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58534/0 (socket says 172.21.15.181:58534) 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 -- 172.21.15.181:0/126725113 learned_addr learned my addr 172.21.15.181:0/126725113 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2000700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 -- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 msgr2=0x7fc8c413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c413f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 -- 172.21.15.181:0/126725113 >> v1:172.21.15.50:6789/0 conn(0x7fc8c415d350 legacy=0x7fc8c40cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 -- 172.21.15.181:0/126725113 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c406a890 con 0x7fc8c40cf5c0 2024-09-13T15:07:16.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2000700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:16.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c2a00700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c406b930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009910 tx=0x7fc8b4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dbda2ea83317438 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c1600700 1 -- 172.21.15.181:0/126725113 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4004230 con 0x7fc8c40cf5c0 2024-09-13T15:07:16.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c1600700 1 -- 172.21.15.181:0/126725113 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4004390 con 0x7fc8c40cf5c0 2024-09-13T15:07:16.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c1600700 1 -- 172.21.15.181:0/126725113 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b40036c0 con 0x7fc8c40cf5c0 2024-09-13T15:07:16.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 -- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 msgr2=0x7fc8c406b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c406b930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009910 tx=0x7fc8b4009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:16.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 -- 172.21.15.181:0/126725113 shutdown_connections 2024-09-13T15:07:16.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/126725113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c406b930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 -- 172.21.15.181:0/126725113 >> 172.21.15.181:0/126725113 conn(0x7fc8c4070d10 msgr2=0x7fc8c40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 -- 172.21.15.181:0/126725113 shutdown_connections 2024-09-13T15:07:16.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.431+0000 7fc8c3e00700 1 -- 172.21.15.181:0/126725113 wait complete. 2024-09-13T15:07:16.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 Processor -- start 2024-09-13T15:07:16.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 -- start start 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c40cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c40cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c415d350 0x7fc8c4159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4146770 con 0x7fc8c415d350 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40cc150 con 0x7fc8c40cf5c0 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40cc430 con 0x7fc8c406a390 2024-09-13T15:07:16.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c40cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c40cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c40cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:51360/0 (socket says 172.21.15.181:51360) 2024-09-13T15:07:16.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 -- 172.21.15.181:0/654843057 learned_addr learned my addr 172.21.15.181:0/654843057 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-13T15:07:16.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3400700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c415d350 0x7fc8c4159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 -- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 msgr2=0x7fc8c40cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c40cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 -- 172.21.15.181:0/654843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c415d350 msgr2=0x7fc8c4159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c415d350 0x7fc8c4159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c2a00700 1 -- 172.21.15.181:0/654843057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00094b0 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.435+0000 7fc8c3400700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c415d350 0x7fc8c4159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8c2a00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c40cb5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40b54b0 tx=0x7fc8b4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011630 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4011790 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b4009570 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011b40 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c40cc9f0 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc8b4021070 con 0x7fc8c406a390 2024-09-13T15:07:16.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc8b4024bf0 con 0x7fc8c406a390 2024-09-13T15:07:16.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.439+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c41468e0 con 0x7fc8c406a390 2024-09-13T15:07:16.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.443+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc8b4024470 con 0x7fc8c406a390 2024-09-13T15:07:16.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.523+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "99d95a00-ff75-47da-bf7e-8c742d02cec5", "id": 7} v 0) v1 -- 0x7fc8c415db90 con 0x7fc8c406a390 2024-09-13T15:07:16.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8bb400700 1 -- 172.21.15.181:0/654843057 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99d95a00-ff75-47da-bf7e-8c742d02cec5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc8b4024610 con 0x7fc8c406a390 2024-09-13T15:07:16.540 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 msgr2=0x7fc8c40cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c40cb5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40b54b0 tx=0x7fc8b4004770 comp rx=0 tx=0).stop 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 shutdown_connections 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c415d350 0x7fc8c4159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c40cf5c0 0x7fc8c40cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 --2- 172.21.15.181:0/654843057 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc8c406a390 0x7fc8c40cb5b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 >> 172.21.15.181:0/654843057 conn(0x7fc8c4070d10 msgr2=0x7fc8c415b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 shutdown_connections 2024-09-13T15:07:16.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T15:07:16.535+0000 7fc8c3e00700 1 -- 172.21.15.181:0/654843057 wait complete. 2024-09-13T15:07:16.562 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T15:07:16.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T15:07:16.569 INFO:tasks.ceph.osd.0:Started 2024-09-13T15:07:16.569 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T15:07:16.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T15:07:16.573 INFO:tasks.ceph.osd.1:Started 2024-09-13T15:07:16.573 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T15:07:16.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T15:07:16.578 INFO:tasks.ceph.osd.2:Started 2024-09-13T15:07:16.578 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T15:07:16.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T15:07:16.583 INFO:tasks.ceph.osd.3:Started 2024-09-13T15:07:16.583 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T15:07:16.584 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T15:07:16.589 INFO:tasks.ceph.osd.4:Started 2024-09-13T15:07:16.589 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T15:07:16.589 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T15:07:16.593 INFO:tasks.ceph.osd.5:Started 2024-09-13T15:07:16.594 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T15:07:16.594 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T15:07:16.598 INFO:tasks.ceph.osd.6:Started 2024-09-13T15:07:16.598 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T15:07:16.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T15:07:16.605 INFO:tasks.ceph.osd.7:Started 2024-09-13T15:07:16.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 Processor -- start 2024-09-13T15:07:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 -- start start 2024-09-13T15:07:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f982415cd90 0x7f98240b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98240cdfe0 0x7f98240ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240d1390 con 0x7f982415d170 2024-09-13T15:07:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240b2530 con 0x7f982415cd90 2024-09-13T15:07:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240d05f0 con 0x7f98240cdfe0 2024-09-13T15:07:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f982415cd90 0x7f98240b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f981a000700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f982415d170 0x7f98240cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:48366/0 (socket says 172.21.15.50:48366) 2024-09-13T15:07:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f981a000700 1 -- 172.21.15.50:0/759309782 learned_addr learned my addr 172.21.15.50:0/759309782 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9823400700 1 --2- 172.21.15.50:0/759309782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98240cdfe0 0x7f98240ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822a00700 1 -- 172.21.15.50:0/759309782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98240cdfe0 msgr2=0x7f98240ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822a00700 1 --2- 172.21.15.50:0/759309782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98240cdfe0 0x7f98240ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822a00700 1 -- 172.21.15.50:0/759309782 >> v1:172.21.15.181:6789/0 conn(0x7f982415d170 legacy=0x7f98240cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822a00700 1 -- 172.21.15.50:0/759309782 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240d1670 con 0x7f982415cd90 2024-09-13T15:07:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822000700 1 -- 172.21.15.50:0/759309782 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568609861 0 0) 0x7f98240d1390 con 0x7f982415d170 2024-09-13T15:07:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.774+0000 7f9822a00700 1 --2- 172.21.15.50:0/759309782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982415cd90 0x7f98240b1f50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9814009850 tx=0x7f9814009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1a65c8f7ba03cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9822000700 1 -- 172.21.15.50:0/759309782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011830 con 0x7f982415cd90 2024-09-13T15:07:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9822000700 1 -- 172.21.15.50:0/759309782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814011990 con 0x7f982415cd90 2024-09-13T15:07:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9822000700 1 -- 172.21.15.50:0/759309782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011d40 con 0x7f982415cd90 2024-09-13T15:07:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 -- 172.21.15.50:0/759309782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982415cd90 msgr2=0x7f98240b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 --2- 172.21.15.50:0/759309782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982415cd90 0x7f98240b1f50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9814009850 tx=0x7f9814009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 -- 172.21.15.50:0/759309782 shutdown_connections 2024-09-13T15:07:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 --2- 172.21.15.50:0/759309782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98240cdfe0 0x7f98240ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 --2- 172.21.15.50:0/759309782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982415cd90 0x7f98240b1f50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 -- 172.21.15.50:0/759309782 >> 172.21.15.50:0/759309782 conn(0x7f98240d2c10 msgr2=0x7f98240d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 -- 172.21.15.50:0/759309782 shutdown_connections 2024-09-13T15:07:16.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.778+0000 7f9823e00700 1 -- 172.21.15.50:0/759309782 wait complete. 2024-09-13T15:07:16.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 Processor -- start 2024-09-13T15:07:16.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 -- start start 2024-09-13T15:07:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 0x7f98240b8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f982415cd90 0x7f98241f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f982415d170 0x7f98240b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240ca050 con 0x7f98240cdfe0 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cc420 con 0x7f982415d170 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9823e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cc700 con 0x7f982415cd90 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9822a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 0x7f98240b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9822a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 0x7f98240b8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45350/0 (socket says 172.21.15.50:45350) 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.782+0000 7f9822a00700 1 -- 172.21.15.50:0/3690118058 learned_addr learned my addr 172.21.15.50:0/3690118058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f981a000700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f982415cd90 0x7f98241f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9823400700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f982415d170 0x7f98240b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9822a00700 1 -- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f982415cd90 msgr2=0x7f98241f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9822a00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f982415cd90 0x7f98241f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9822a00700 1 -- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f982415d170 msgr2=0x7f98240b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9822a00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f982415d170 0x7f98240b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9822a00700 1 -- 172.21.15.50:0/3690118058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140094b0 con 0x7f98240cdfe0 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9822a00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 0x7f98240b8440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140036c0 con 0x7f98240cdfe0 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981401f070 con 0x7f98240cdfe0 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240cc9e0 con 0x7f98240cdfe0 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814003a80 con 0x7f98240cdfe0 2024-09-13T15:07:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98240ccfa0 con 0x7f98240cdfe0 2024-09-13T15:07:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9814026480 con 0x7f98240cdfe0 2024-09-13T15:07:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9814021070 con 0x7f98240cdfe0 2024-09-13T15:07:16.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.786+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240cd1c0 con 0x7f98240cdfe0 2024-09-13T15:07:16.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.790+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f981402b020 con 0x7f98240cdfe0 2024-09-13T15:07:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.854+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98240672a0 con 0x7f98240cdfe0 2024-09-13T15:07:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f981b400700 1 -- 172.21.15.50:0/3690118058 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9814015020 con 0x7f98240cdfe0 2024-09-13T15:07:16.863 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:16.863 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:16.531919+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 msgr2=0x7f98240b8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 0x7f98240b8440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814004770 comp rx=0 tx=0).stop 2024-09-13T15:07:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 shutdown_connections 2024-09-13T15:07:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f982415d170 0x7f98240b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f982415cd90 0x7f98241f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 --2- 172.21.15.50:0/3690118058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98240cdfe0 0x7f98240b8440 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 >> 172.21.15.50:0/3690118058 conn(0x7f98240d2c10 msgr2=0x7f98240b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 shutdown_connections 2024-09-13T15:07:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:16.858+0000 7f9823e00700 1 -- 172.21.15.50:0/3690118058 wait complete. 2024-09-13T15:07:16.882 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T15:07:16.883 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T15:07:16.889 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:16.883+0000 7f0f96f372c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:07:16.890 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:16.882+0000 7fdcf340c2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:07:17.129 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:17.123+0000 7f0f96f372c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:07:17.148 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:17.142+0000 7fdcf340c2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:07:17.225 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:17.219+0000 7f0f96f372c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:07:17.250 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:17.242+0000 7fdcf340c2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:07:17.255 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-13T15:07:17.247+0000 7f44c18aa880 -1 Falling back to public interface 2024-09-13T15:07:17.262 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-13T15:07:17.255+0000 7f648c472880 -1 Falling back to public interface 2024-09-13T15:07:17.269 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-13T15:07:17.262+0000 7faf53611880 -1 Falling back to public interface 2024-09-13T15:07:17.278 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-13T15:07:17.271+0000 7fc949793880 -1 Falling back to public interface 2024-09-13T15:07:17.280 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-13T15:07:17.274+0000 7fe4b3d38880 -1 Falling back to public interface 2024-09-13T15:07:17.281 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-13T15:07:17.274+0000 7f15b0e82880 -1 Falling back to public interface 2024-09-13T15:07:17.286 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-13T15:07:17.278+0000 7fe4b2800700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6815/0: (98) Address already in use 2024-09-13T15:07:17.288 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-13T15:07:17.282+0000 7f715a52a880 -1 Falling back to public interface 2024-09-13T15:07:17.289 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-13T15:07:17.283+0000 7fdfaa6ac880 -1 Falling back to public interface 2024-09-13T15:07:17.438 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:17.431+0000 7f0f96f372c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:07:17.464 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:17.458+0000 7fdcf340c2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:07:17.687 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:17.838 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.830+0000 7f4179200700 1 Processor -- start 2024-09-13T15:07:17.838 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.830+0000 7f4179200700 1 -- start start 2024-09-13T15:07:17.840 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4179200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4174150b80 0x7f41740ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:17.840 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4179200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f417406cab0 0x7f41740cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:17.840 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4179200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417415ad40 con 0x7f417415b140 2024-09-13T15:07:17.840 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4179200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4174150f60 con 0x7f417406cab0 2024-09-13T15:07:17.840 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4179200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417415a1a0 con 0x7f4174150b80 2024-09-13T15:07:17.841 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4171e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4174150b80 0x7f41740ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:17.841 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4172800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f417406cab0 0x7f41740cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:17.841 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4171e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4174150b80 0x7f41740ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:46874/0 (socket says 172.21.15.50:46874) 2024-09-13T15:07:17.841 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4172800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f417406cab0 0x7f41740cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:55364/0 (socket says 172.21.15.50:55364) 2024-09-13T15:07:17.841 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4171e00700 1 -- 172.21.15.50:0/3958376246 learned_addr learned my addr 172.21.15.50:0/3958376246 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:17.842 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4172800700 1 -- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4174150b80 msgr2=0x7f41740ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:17.842 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4172800700 1 --2- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4174150b80 0x7f41740ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.842 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4172800700 1 -- 172.21.15.50:0/3958376246 >> v1:172.21.15.181:6789/0 conn(0x7f417415b140 legacy=0x7f417406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:17.842 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.834+0000 7f4172800700 1 -- 172.21.15.50:0/3958376246 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417415a410 con 0x7f417406cab0 2024-09-13T15:07:17.843 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4172800700 1 --2- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417406cab0 0x7f41740cd650 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f416c009d90 tx=0x7f416c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdebdf433971362 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:17.843 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4170a00700 1 -- 172.21.15.50:0/3958376246 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00e070 con 0x7f417406cab0 2024-09-13T15:07:17.843 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4170a00700 1 -- 172.21.15.50:0/3958376246 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00bb20 con 0x7f417406cab0 2024-09-13T15:07:17.843 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4170a00700 1 -- 172.21.15.50:0/3958376246 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c012430 con 0x7f417406cab0 2024-09-13T15:07:17.843 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 -- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417406cab0 msgr2=0x7f41740cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:17.844 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 --2- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417406cab0 0x7f41740cd650 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f416c009d90 tx=0x7f416c00b330 comp rx=0 tx=0).stop 2024-09-13T15:07:17.844 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 -- 172.21.15.50:0/3958376246 shutdown_connections 2024-09-13T15:07:17.844 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 --2- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417406cab0 0x7f41740cd650 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.844 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 --2- 172.21.15.50:0/3958376246 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4174150b80 0x7f41740ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.845 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 -- 172.21.15.50:0/3958376246 >> 172.21.15.50:0/3958376246 conn(0x7f417406e830 msgr2=0x7f417406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:17.845 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 -- 172.21.15.50:0/3958376246 shutdown_connections 2024-09-13T15:07:17.845 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 -- 172.21.15.50:0/3958376246 wait complete. 2024-09-13T15:07:17.846 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.838+0000 7f4179200700 1 Processor -- start 2024-09-13T15:07:17.846 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 -- start start 2024-09-13T15:07:17.847 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 0x7f4174151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:17.847 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174150b80 0x7f417414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:17.848 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417415b140 0x7f417415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:17.848 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174152e00 con 0x7f4174150b80 2024-09-13T15:07:17.848 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417414c740 con 0x7f417415b140 2024-09-13T15:07:17.848 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4174151e10 con 0x7f417406cab0 2024-09-13T15:07:17.849 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 0x7f4174151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:17.849 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174150b80 0x7f417414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:17.849 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 0x7f4174151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:46888/0 (socket says 172.21.15.50:46888) 2024-09-13T15:07:17.849 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 -- 172.21.15.50:0/845928768 learned_addr learned my addr 172.21.15.50:0/845928768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:17.849 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4172800700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417415b140 0x7f417415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:17.850 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 -- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417415b140 msgr2=0x7f417415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:17.850 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417415b140 0x7f417415cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.850 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 -- 172.21.15.50:0/845928768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174150b80 msgr2=0x7f417414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:17.850 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174150b80 0x7f417414bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.850 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 -- 172.21.15.50:0/845928768 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c009a70 con 0x7f417406cab0 2024-09-13T15:07:17.850 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4171e00700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 0x7f4174151100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f416400e930 tx=0x7f416400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:17.851 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41640096c0 con 0x7f417406cab0 2024-09-13T15:07:17.851 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164013680 con 0x7f417406cab0 2024-09-13T15:07:17.851 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164013a30 con 0x7f417406cab0 2024-09-13T15:07:17.851 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417414c9e0 con 0x7f417406cab0 2024-09-13T15:07:17.852 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41741520f0 con 0x7f417406cab0 2024-09-13T15:07:17.852 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.842+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4164005a40 con 0x7f417406cab0 2024-09-13T15:07:17.852 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.846+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4164006700 con 0x7f417406cab0 2024-09-13T15:07:17.852 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.846+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41740677c0 con 0x7f417406cab0 2024-09-13T15:07:17.854 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.846+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4164021060 con 0x7f417406cab0 2024-09-13T15:07:17.923 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f417406c3a0 con 0x7f417406cab0 2024-09-13T15:07:17.924 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f416a000700 1 -- 172.21.15.50:0/845928768 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4164029020 con 0x7f417406cab0 2024-09-13T15:07:17.924 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-13T15:07:17.925 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:16.531919+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:17.925 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 msgr2=0x7f4174151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:17.925 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 0x7f4174151100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f416400e930 tx=0x7f416400ec40 comp rx=0 tx=0).stop 2024-09-13T15:07:17.925 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 shutdown_connections 2024-09-13T15:07:17.925 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f417415b140 0x7f417415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.926 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4174150b80 0x7f417414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.926 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 --2- 172.21.15.50:0/845928768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f417406cab0 0x7f4174151100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:17.926 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 >> 172.21.15.50:0/845928768 conn(0x7f417406e830 msgr2=0x7f4174073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:17.926 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 shutdown_connections 2024-09-13T15:07:17.926 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:17.918+0000 7f4179200700 1 -- 172.21.15.50:0/845928768 wait complete. 2024-09-13T15:07:17.944 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T15:07:18.181 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:18.174+0000 7fdcf340c2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:07:18.214 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:18.207+0000 7f0f96f372c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:07:18.267 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:18.262+0000 7fdcf340c2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:07:18.307 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:18.299+0000 7f0f96f372c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:07:18.455 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:18.450+0000 7fdcf340c2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:07:18.483 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:18.475+0000 7f0f96f372c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:07:18.548 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:18.542+0000 7fdcf340c2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:07:18.572 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:18.567+0000 7f0f96f372c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:07:18.654 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:18.646+0000 7fdcf340c2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:07:18.672 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:18.663+0000 7f0f96f372c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:07:19.058 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:19.050+0000 7fdcf340c2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:07:19.067 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:19.059+0000 7f0f96f372c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:07:19.165 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:19.159+0000 7f0f96f372c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:07:19.166 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:19.162+0000 7fdcf340c2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:07:19.980 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:19.971+0000 7f0f96f372c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:07:20.089 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-13T15:07:20.082+0000 7fdcf340c2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:07:21.021 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:21.015+0000 7f0f7d600700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T15:07:21.022 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-13T15:07:21.015+0000 7f0f7d600700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T15:07:21.244 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-13T15:07:21.238+0000 7fe4b3d38880 -1 osd.1 0 log_to_monitors true 2024-09-13T15:07:21.263 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-13T15:07:21.255+0000 7f648c472880 -1 osd.7 0 log_to_monitors true 2024-09-13T15:07:21.275 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-13T15:07:21.270+0000 7f15b0e82880 -1 osd.2 0 log_to_monitors true 2024-09-13T15:07:21.280 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-13T15:07:21.271+0000 7f44c18aa880 -1 osd.6 0 log_to_monitors true 2024-09-13T15:07:21.306 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-13T15:07:21.299+0000 7fc949793880 -1 osd.4 0 log_to_monitors true 2024-09-13T15:07:21.320 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-13T15:07:21.311+0000 7fdfaa6ac880 -1 osd.5 0 log_to_monitors true 2024-09-13T15:07:21.482 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-13T15:07:21.474+0000 7faf53611880 -1 osd.0 0 log_to_monitors true 2024-09-13T15:07:21.511 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-13T15:07:21.506+0000 7f715a52a880 -1 osd.3 0 log_to_monitors true 2024-09-13T15:07:24.750 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:24.853 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-13T15:07:24.846+0000 7faf4e400700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T15:07:24.877 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-13T15:07:24.870+0000 7faf44000700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:24.891 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-13T15:07:24.886+0000 7f7155400700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T15:07:24.902 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-13T15:07:24.898+0000 7f714b000700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:24.935 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-13T15:07:24.930+0000 7f15abe00700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T15:07:24.941 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-13T15:07:24.934+0000 7f15a1a00700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:24.953 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.946+0000 7ff4de600700 1 Processor -- start 2024-09-13T15:07:24.953 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.946+0000 7ff4de600700 1 -- start start 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4de600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4de600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4d80b5230 0x7ff4d80cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4de600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d806d740 con 0x7ff4d815aac0 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4de600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d80b56e0 con 0x7ff4d80b5230 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4de600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8071d20 con 0x7ff4d80721e0 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4d80b5230 0x7ff4d80cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4d7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4d80b5230 0x7ff4d80cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:34718/0 (socket says 172.21.15.50:34718) 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 -- 172.21.15.50:0/3902379511 learned_addr learned my addr 172.21.15.50:0/3902379511 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:24.956 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4dd200700 1 --1- 172.21.15.50:0/3902379511 >> v1:172.21.15.50:6789/0 conn(0x7ff4d815aac0 0x7ff4d806d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57760/0 (socket says 172.21.15.50:57760) 2024-09-13T15:07:24.957 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 -- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 msgr2=0x7ff4d80b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:24.957 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 --2- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d80b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.957 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 -- 172.21.15.50:0/3902379511 >> v1:172.21.15.50:6789/0 conn(0x7ff4d815aac0 legacy=0x7ff4d806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.957 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 -- 172.21.15.50:0/3902379511 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8072730 con 0x7ff4d80b5230 2024-09-13T15:07:24.958 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4ddc00700 1 --2- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d80b5230 0x7ff4d80cdc40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009e50 tx=0x7ff4d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797abeb16d11b8a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:24.958 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4d7400700 1 -- 172.21.15.50:0/3902379511 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000e070 con 0x7ff4d80b5230 2024-09-13T15:07:24.958 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4d7400700 1 -- 172.21.15.50:0/3902379511 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d000b910 con 0x7ff4d80b5230 2024-09-13T15:07:24.958 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.950+0000 7ff4d7400700 1 -- 172.21.15.50:0/3902379511 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000bcc0 con 0x7ff4d80b5230 2024-09-13T15:07:24.959 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 -- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d80b5230 msgr2=0x7ff4d80cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.959 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 --2- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d80b5230 0x7ff4d80cdc40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009e50 tx=0x7ff4d000b330 comp rx=0 tx=0).stop 2024-09-13T15:07:24.959 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 -- 172.21.15.50:0/3902379511 shutdown_connections 2024-09-13T15:07:24.959 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 --2- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d80b5230 0x7ff4d80cdc40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.959 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 --2- 172.21.15.50:0/3902379511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d80b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.959 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 -- 172.21.15.50:0/3902379511 >> 172.21.15.50:0/3902379511 conn(0x7ff4d80b16e0 msgr2=0x7ff4d80b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:24.960 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 -- 172.21.15.50:0/3902379511 shutdown_connections 2024-09-13T15:07:24.960 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 -- 172.21.15.50:0/3902379511 wait complete. 2024-09-13T15:07:24.961 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 Processor -- start 2024-09-13T15:07:24.962 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.954+0000 7ff4de600700 1 -- start start 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d8149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 0x7ff4d80acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d815aac0 0x7ff4d80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80b36b0 con 0x7ff4d80b5230 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80b2ae0 con 0x7ff4d815aac0 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80b2d80 con 0x7ff4d80721e0 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 0x7ff4d80acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 0x7ff4d80acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42772/0 (socket says 172.21.15.50:42772) 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 -- 172.21.15.50:0/3584552542 learned_addr learned my addr 172.21.15.50:0/3584552542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:24.964 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4dd200700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d8149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.965 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4ddc00700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d815aac0 0x7ff4d80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.965 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 -- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 msgr2=0x7ff4d8149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d8149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 -- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d815aac0 msgr2=0x7ff4d80ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d815aac0 0x7ff4d80ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 -- 172.21.15.50:0/3584552542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009b30 con 0x7ff4d80b5230 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d7e00700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 0x7ff4d80acb30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400e9a0 tx=0x7ff4c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4009720 con 0x7ff4d80b5230 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400c850 con 0x7ff4d80b5230 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400cbe0 con 0x7ff4d80b5230 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d80b3060 con 0x7ff4d80b5230 2024-09-13T15:07:24.966 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.958+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d81498c0 con 0x7ff4d80b5230 2024-09-13T15:07:24.967 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.962+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d80b4cf0 con 0x7ff4d80b5230 2024-09-13T15:07:24.968 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.962+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7ff4c400cd40 con 0x7ff4d80b5230 2024-09-13T15:07:24.969 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.962+0000 7ff4d4c00700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff4b80666a0 0x7ff4b8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.970 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.962+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff4c40836b0 con 0x7ff4d80b5230 2024-09-13T15:07:24.970 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.966+0000 7ff4dd200700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff4b80666a0 0x7ff4b8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.971 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.966+0000 7ff4dd200700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff4b80666a0 0x7ff4b8068b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc000f60 tx=0x7ff4cc007ef0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:24.977 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:24.970+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4c4051900 con 0x7ff4d80b5230 2024-09-13T15:07:24.982 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-13T15:07:24.978+0000 7fe4aec00700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T15:07:24.990 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-13T15:07:24.986+0000 7fe4a4800700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:25.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.166+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d80ced50 con 0x7ff4d80b5230 2024-09-13T15:07:25.174 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.166+0000 7ff4d4c00700 1 -- 172.21.15.50:0/3584552542 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff4c4021090 con 0x7ff4d80b5230 2024-09-13T15:07:25.174 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-13T15:07:25.174 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":12,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:23.058050+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff4b80666a0 msgr2=0x7ff4b8068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff4b80666a0 0x7ff4b8068b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc000f60 tx=0x7ff4cc007ef0 comp rx=0 tx=0).stop 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 msgr2=0x7ff4d80acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 0x7ff4d80acb30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400e9a0 tx=0x7ff4c400ecb0 comp rx=0 tx=0).stop 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 shutdown_connections 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff4b80666a0 0x7ff4b8068b60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:25.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4d815aac0 0x7ff4d80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:25.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4d80b5230 0x7ff4d80acb30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:25.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 --2- 172.21.15.50:0/3584552542 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff4d80721e0 0x7ff4d8149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:25.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 >> 172.21.15.50:0/3584552542 conn(0x7ff4d80b16e0 msgr2=0x7ff4d8157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:25.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 shutdown_connections 2024-09-13T15:07:25.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:25.174+0000 7ff4de600700 1 -- 172.21.15.50:0/3584552542 wait complete. 2024-09-13T15:07:25.198 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T15:07:25.360 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-13T15:07:25.351+0000 7fc944600700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T15:07:25.366 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-13T15:07:25.359+0000 7fc93a200700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:25.397 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-13T15:07:25.391+0000 7f44bc800700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T15:07:25.401 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-13T15:07:25.395+0000 7fdfa6000700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T15:07:25.407 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-13T15:07:25.399+0000 7f44b2400700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:25.410 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-13T15:07:25.403+0000 7fdf9b200700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:25.445 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-13T15:07:25.439+0000 7f6487400700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T15:07:25.454 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-13T15:07:25.447+0000 7f647d000700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:07:32.005 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:32.167 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.162+0000 7fa8cfe00700 1 Processor -- start 2024-09-13T15:07:32.168 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.162+0000 7fa8cfe00700 1 -- start start 2024-09-13T15:07:32.171 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d01620c0 0x7fa8d00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.171 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cfe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa8d006c220 0x7fa8d0070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.171 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cfe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00b2e10 con 0x7fa8d00b29b0 2024-09-13T15:07:32.172 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cfe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d006d410 con 0x7fa8d006c220 2024-09-13T15:07:32.172 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cfe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006c800 con 0x7fa8d01620c0 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8ce000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa8d00b29b0 0x7fa8d006bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57766/0 (socket says 172.21.15.50:57766) 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8ce000700 1 -- 172.21.15.50:0/1794849727 learned_addr learned my addr 172.21.15.50:0/1794849727 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cf400700 1 --2- 172.21.15.50:0/1794849727 >> v2:172.21.15.181:3300/0 conn(0x7fa8d006c220 0x7fa8d0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cea00700 1 --2- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d01620c0 0x7fa8d00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cd600700 1 -- 172.21.15.50:0/1794849727 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192664778 0 0) 0x7fa8d00b2e10 con 0x7fa8d00b29b0 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cd600700 1 -- 172.21.15.50:0/1794849727 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b40035d0 con 0x7fa8d00b29b0 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cf400700 1 -- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d01620c0 msgr2=0x7fa8d00b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cf400700 1 --2- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d01620c0 0x7fa8d00b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cf400700 1 -- 172.21.15.50:0/1794849727 >> v1:172.21.15.50:6789/0 conn(0x7fa8d00b29b0 legacy=0x7fa8d006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.173 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cf400700 1 -- 172.21.15.50:0/1794849727 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d006cae0 con 0x7fa8d006c220 2024-09-13T15:07:32.174 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cf400700 1 --2- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d006c220 0x7fa8d0070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009d90 tx=0x7fa8c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9be711164ec1366 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.174 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.166+0000 7fa8cd600700 1 -- 172.21.15.50:0/1794849727 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800e070 con 0x7fa8d006c220 2024-09-13T15:07:32.174 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cd600700 1 -- 172.21.15.50:0/1794849727 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800bb20 con 0x7fa8d006c220 2024-09-13T15:07:32.174 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cd600700 1 -- 172.21.15.50:0/1794849727 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8012430 con 0x7fa8d006c220 2024-09-13T15:07:32.175 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 -- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d006c220 msgr2=0x7fa8d0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.175 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d006c220 0x7fa8d0070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009d90 tx=0x7fa8c800b330 comp rx=0 tx=0).stop 2024-09-13T15:07:32.175 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 -- 172.21.15.50:0/1794849727 shutdown_connections 2024-09-13T15:07:32.176 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d006c220 0x7fa8d0070690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.176 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/1794849727 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d01620c0 0x7fa8d00b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.176 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 -- 172.21.15.50:0/1794849727 >> 172.21.15.50:0/1794849727 conn(0x7fa8d006a390 msgr2=0x7fa8d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:32.176 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 -- 172.21.15.50:0/1794849727 shutdown_connections 2024-09-13T15:07:32.176 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 -- 172.21.15.50:0/1794849727 wait complete. 2024-09-13T15:07:32.178 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.170+0000 7fa8cfe00700 1 Processor -- start 2024-09-13T15:07:32.178 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 -- start start 2024-09-13T15:07:32.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 0x7fa8d0143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d00b29b0 0x7fa8d01f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d01620c0 0x7fa8d015b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01414c0 con 0x7fa8d006c220 2024-09-13T15:07:32.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0140840 con 0x7fa8d01620c0 2024-09-13T15:07:32.180 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0140b20 con 0x7fa8d00b29b0 2024-09-13T15:07:32.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 0x7fa8d0143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 0x7fa8d0143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42786/0 (socket says 172.21.15.50:42786) 2024-09-13T15:07:32.181 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 -- 172.21.15.50:0/212480710 learned_addr learned my addr 172.21.15.50:0/212480710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8ce000700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d00b29b0 0x7fa8d01f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cf400700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d01620c0 0x7fa8d015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 -- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d00b29b0 msgr2=0x7fa8d01f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d00b29b0 0x7fa8d01f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 -- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d01620c0 msgr2=0x7fa8d015b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d01620c0 0x7fa8d015b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 -- 172.21.15.50:0/212480710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009a70 con 0x7fa8d006c220 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8ce000700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d00b29b0 0x7fa8d01f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:32.182 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cea00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 0x7fa8d0143c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000e840 tx=0x7fa8c000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.183 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00095a0 con 0x7fa8d006c220 2024-09-13T15:07:32.183 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c000c690 con 0x7fa8d006c220 2024-09-13T15:07:32.183 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d0140e00 con 0x7fa8d006c220 2024-09-13T15:07:32.183 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000ca00 con 0x7fa8d006c220 2024-09-13T15:07:32.183 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.174+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d01f6600 con 0x7fa8d006c220 2024-09-13T15:07:32.184 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.178+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d0070690 con 0x7fa8d006c220 2024-09-13T15:07:32.185 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.178+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8c000cb60 con 0x7fa8d006c220 2024-09-13T15:07:32.187 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.182+0000 7fa8c6a00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa8b0066730 0x7fa8b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.187 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.182+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa8c0083e70 con 0x7fa8d006c220 2024-09-13T15:07:32.188 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.182+0000 7fa8ce000700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa8b0066730 0x7fa8b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.189 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.182+0000 7fa8ce000700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa8b0066730 0x7fa8b0068bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0163950 tx=0x7fa8bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.197 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.190+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8c0051520 con 0x7fa8d006c220 2024-09-13T15:07:32.404 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.398+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d0163980 con 0x7fa8d006c220 2024-09-13T15:07:32.405 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.398+0000 7fa8c6a00700 1 -- 172.21.15.50:0/212480710 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fa8c0054b40 con 0x7fa8d006c220 2024-09-13T15:07:32.406 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-13T15:07:32.406 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":16,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:28.879321+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:32.408 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa8b0066730 msgr2=0x7fa8b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa8b0066730 0x7fa8b0068bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0163950 tx=0x7fa8bc009040 comp rx=0 tx=0).stop 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 msgr2=0x7fa8d0143c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 0x7fa8d0143c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000e840 tx=0x7fa8c000ec00 comp rx=0 tx=0).stop 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 shutdown_connections 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa8b0066730 0x7fa8b0068bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d01620c0 0x7fa8d015b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8d00b29b0 0x7fa8d01f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 --2- 172.21.15.50:0/212480710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d006c220 0x7fa8d0143c90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 >> 172.21.15.50:0/212480710 conn(0x7fa8d006a390 msgr2=0x7fa8d0163ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 shutdown_connections 2024-09-13T15:07:32.409 INFO:teuthology.misc.health.smithi050.stderr:2024-09-13T15:07:32.402+0000 7fa8cfe00700 1 -- 172.21.15.50:0/212480710 wait complete. 2024-09-13T15:07:32.427 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T15:07:32.428 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T15:07:32.429 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:07:32.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:07:32.434 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:07:32.435 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:07:32.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:07:32.439 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:07:32.440 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:07:32.440 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:07:32.445 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:07:32.446 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:07:32.446 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:07:32.451 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:07:32.452 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T15:07:32.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:32.546 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:07:32.557 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:07:32.569 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:07:32.580 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:07:32.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.618+0000 7f7d09400700 1 Processor -- start 2024-09-13T15:07:32.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.622+0000 7f7d09400700 1 -- start start 2024-09-13T15:07:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.622+0000 7f7d09400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7d040cae70 0x7f7d040cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.622+0000 7f7d09400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d040ccfd0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.622+0000 7f7d09400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d040cb790 con 0x7f7d040abea0 2024-09-13T15:07:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.622+0000 7f7d09400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d040ae170 con 0x7f7d040cae70 2024-09-13T15:07:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d08a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d040ac2d0 0x7f7d040ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57800/0 (socket says 172.21.15.50:57800) 2024-09-13T15:07:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d08a00700 1 -- 172.21.15.50:0/1771178745 learned_addr learned my addr 172.21.15.50:0/1771178745 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d03e00700 1 --2- 172.21.15.50:0/1771178745 >> v2:172.21.15.181:3300/0 conn(0x7f7d040cae70 0x7f7d040cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d02a00700 1 -- 172.21.15.50:0/1771178745 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113741536 0 0) 0x7f7d040ccfd0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d02a00700 1 -- 172.21.15.50:0/1771178745 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce80035d0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d02a00700 1 -- 172.21.15.50:0/1771178745 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152219732 0 0) 0x7f7d040cb790 con 0x7f7d040abea0 2024-09-13T15:07:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d03e00700 1 -- 172.21.15.50:0/1771178745 >> v1:172.21.15.181:6789/0 conn(0x7f7d040abea0 legacy=0x7f7d040ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d03e00700 1 -- 172.21.15.50:0/1771178745 >> v1:172.21.15.50:6789/0 conn(0x7f7d040ac2d0 legacy=0x7f7d040ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d03e00700 1 -- 172.21.15.50:0/1771178745 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d040cd270 con 0x7f7d040cae70 2024-09-13T15:07:32.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d03e00700 1 --2- 172.21.15.50:0/1771178745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040cae70 0x7f7d040cb250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009850 tx=0x7f7cf4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce82c2f01b908db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d02a00700 1 -- 172.21.15.50:0/1771178745 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011830 con 0x7f7d040cae70 2024-09-13T15:07:32.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d02a00700 1 -- 172.21.15.50:0/1771178745 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4011990 con 0x7f7d040cae70 2024-09-13T15:07:32.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d02a00700 1 -- 172.21.15.50:0/1771178745 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011d40 con 0x7f7d040cae70 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d09400700 1 -- 172.21.15.50:0/1771178745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040cae70 msgr2=0x7f7d040cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d09400700 1 --2- 172.21.15.50:0/1771178745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040cae70 0x7f7d040cb250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009850 tx=0x7f7cf4009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d09400700 1 -- 172.21.15.50:0/1771178745 shutdown_connections 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d09400700 1 --2- 172.21.15.50:0/1771178745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040cae70 0x7f7d040cb250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.626+0000 7f7d09400700 1 -- 172.21.15.50:0/1771178745 >> 172.21.15.50:0/1771178745 conn(0x7f7d040cf0d0 msgr2=0x7f7d040cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 -- 172.21.15.50:0/1771178745 shutdown_connections 2024-09-13T15:07:32.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 -- 172.21.15.50:0/1771178745 wait complete. 2024-09-13T15:07:32.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 Processor -- start 2024-09-13T15:07:32.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 -- start start 2024-09-13T15:07:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040abea0 0x7f7d040b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 0x7f7d041f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d040cae70 0x7f7d041f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040b3fd0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040b4870 con 0x7f7d040abea0 2024-09-13T15:07:32.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d09400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041f7980 con 0x7f7d040cae70 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.630+0000 7f7d03400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 0x7f7d041f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 0x7f7d041f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42826/0 (socket says 172.21.15.50:42826) 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040abea0 0x7f7d040b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 -- 172.21.15.50:0/1652507905 learned_addr learned my addr 172.21.15.50:0/1652507905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d08a00700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d040cae70 0x7f7d041f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 -- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d040cae70 msgr2=0x7f7d041f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d040cae70 0x7f7d041f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 -- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040abea0 msgr2=0x7f7d040b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040abea0 0x7f7d040b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 -- 172.21.15.50:0/1652507905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40094b0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d03400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 0x7f7d041f7440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000c520 tx=0x7f7cf000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00054e0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00036a0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d040b4590 con 0x7f7d040ac2d0 2024-09-13T15:07:32.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0003a50 con 0x7f7d040ac2d0 2024-09-13T15:07:32.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d040b3c60 con 0x7f7d040ac2d0 2024-09-13T15:07:32.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.634+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0406c2a0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.638+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7cf0003bb0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.638+0000 7f7cfbe00700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ce4066730 0x7f7ce4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.638+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cf0083260 con 0x7f7d040ac2d0 2024-09-13T15:07:32.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.638+0000 7f7d03e00700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ce4066730 0x7f7ce4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.642+0000 7f7d03e00700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ce4066730 0x7f7ce4068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40090b0 tx=0x7f7cf4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.646+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d0406c2a0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.834+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0406c2a0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.838+0000 7f7cfbe00700 1 -- 172.21.15.50:0/1652507905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f7d0406c2a0 con 0x7f7d040ac2d0 2024-09-13T15:07:32.844 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:32.844 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:28.879321+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ce4066730 msgr2=0x7f7ce4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ce4066730 0x7f7ce4068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40090b0 tx=0x7f7cf4008030 comp rx=0 tx=0).stop 2024-09-13T15:07:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 msgr2=0x7f7d041f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 0x7f7d041f7440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000c520 tx=0x7f7cf000c830 comp rx=0 tx=0).stop 2024-09-13T15:07:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 shutdown_connections 2024-09-13T15:07:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ce4066730 0x7f7ce4068bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d040cae70 0x7f7d041f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d040ac2d0 0x7f7d041f7440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 --2- 172.21.15.50:0/1652507905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d040abea0 0x7f7d040b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 >> 172.21.15.50:0/1652507905 conn(0x7f7d040cf0d0 msgr2=0x7f7d040ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 shutdown_connections 2024-09-13T15:07:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:32.842+0000 7f7d09400700 1 -- 172.21.15.50:0/1652507905 wait complete. 2024-09-13T15:07:32.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:07:32.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:07:33.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.046+0000 7f30cd000700 1 Processor -- start 2024-09-13T15:07:33.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.046+0000 7f30cd000700 1 -- start start 2024-09-13T15:07:33.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30cd000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c8157500 0x7f30c80ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30cd000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80b57e0 con 0x7f30c815e030 2024-09-13T15:07:33.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30cd000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80b3b80 con 0x7f30c80cd140 2024-09-13T15:07:33.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30cd000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80b5a80 con 0x7f30c8157500 2024-09-13T15:07:33.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c5400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30c815e030 0x7f30c8070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57814/0 (socket says 172.21.15.50:57814) 2024-09-13T15:07:33.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c5400700 1 -- 172.21.15.50:0/1747937970 learned_addr learned my addr 172.21.15.50:0/1747937970 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:33.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c5e00700 1 --2- 172.21.15.50:0/1747937970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c8157500 0x7f30c80ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177580913 0 0) 0x7f30c80b57e0 con 0x7f30c815e030 2024-09-13T15:07:33.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ac0035d0 con 0x7f30c815e030 2024-09-13T15:07:33.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280987325 0 0) 0x7f30c80b3b80 con 0x7f30c80cd140 2024-09-13T15:07:33.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c80b57e0 con 0x7f30c80cd140 2024-09-13T15:07:33.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 212704910 0 0) 0x7f30ac0035d0 con 0x7f30c815e030 2024-09-13T15:07:33.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c5e00700 1 -- 172.21.15.50:0/1747937970 >> v1:172.21.15.181:6789/0 conn(0x7f30c80cd140 legacy=0x7f30c8160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.050+0000 7f30c5e00700 1 -- 172.21.15.50:0/1747937970 >> v1:172.21.15.50:6789/0 conn(0x7f30c815e030 legacy=0x7f30c8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30c5e00700 1 -- 172.21.15.50:0/1747937970 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80b5d60 con 0x7f30c8157500 2024-09-13T15:07:33.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30c5e00700 1 --2- 172.21.15.50:0/1747937970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c8157500 0x7f30c80ce700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009880 tx=0x7f30b8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd515c6dfbe8658 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4001670 con 0x7f30c8157500 2024-09-13T15:07:33.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b8004030 con 0x7f30c8157500 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30c4a00700 1 -- 172.21.15.50:0/1747937970 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80043c0 con 0x7f30c8157500 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 -- 172.21.15.50:0/1747937970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c8157500 msgr2=0x7f30c80ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 --2- 172.21.15.50:0/1747937970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c8157500 0x7f30c80ce700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009880 tx=0x7f30b8009b90 comp rx=0 tx=0).stop 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 -- 172.21.15.50:0/1747937970 shutdown_connections 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 --2- 172.21.15.50:0/1747937970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c8157500 0x7f30c80ce700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 -- 172.21.15.50:0/1747937970 >> 172.21.15.50:0/1747937970 conn(0x7f30c806e660 msgr2=0x7f30c806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:33.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 -- 172.21.15.50:0/1747937970 shutdown_connections 2024-09-13T15:07:33.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.054+0000 7f30cd000700 1 -- 172.21.15.50:0/1747937970 wait complete. 2024-09-13T15:07:33.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 Processor -- start 2024-09-13T15:07:33.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 -- start start 2024-09-13T15:07:33.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80cd140 0x7f30c80cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 0x7f30c81481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c815e030 0x7f30c8149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8154a80 con 0x7f30c8157500 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c806a520 con 0x7f30c815e030 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30cd000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80cbd10 con 0x7f30c80cd140 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30c5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 0x7f30c81481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30c5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 0x7f30c81481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42832/0 (socket says 172.21.15.50:42832) 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30c5400700 1 -- 172.21.15.50:0/1047052216 learned_addr learned my addr 172.21.15.50:0/1047052216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30c5e00700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80cd140 0x7f30c80cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.058+0000 7f30c6800700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c815e030 0x7f30c8149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c5400700 1 -- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80cd140 msgr2=0x7f30c80cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c5400700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80cd140 0x7f30c80cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c5400700 1 -- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c815e030 msgr2=0x7f30c8149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c5400700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c815e030 0x7f30c8149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c5400700 1 -- 172.21.15.50:0/1047052216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80094b0 con 0x7f30c8157500 2024-09-13T15:07:33.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c6800700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c815e030 0x7f30c8149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30c5400700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 0x7f30c81481a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c6e0 tx=0x7f30b400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4004ca0 con 0x7f30c8157500 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4004e00 con 0x7f30c8157500 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c814ab00 con 0x7f30c8157500 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40072d0 con 0x7f30c8157500 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c814b0c0 con 0x7f30c8157500 2024-09-13T15:07:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.062+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c80ce700 con 0x7f30c8157500 2024-09-13T15:07:33.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.066+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f30b4007430 con 0x7f30c8157500 2024-09-13T15:07:33.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.066+0000 7f30be000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30a8066730 0x7f30a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.066+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30b4083b50 con 0x7f30c8157500 2024-09-13T15:07:33.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.066+0000 7f30c5e00700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30a8066730 0x7f30a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.070+0000 7f30c5e00700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30a8066730 0x7f30a8068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.074+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f30b4051170 con 0x7f30c8157500 2024-09-13T15:07:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.250+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30c814b460 con 0x7f30c8157500 2024-09-13T15:07:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30be000700 1 -- 172.21.15.50:0/1047052216 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30b4054790 con 0x7f30c8157500 2024-09-13T15:07:33.259 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:07:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30a8066730 msgr2=0x7f30a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30a8066730 0x7f30a8068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8010000 comp rx=0 tx=0).stop 2024-09-13T15:07:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 msgr2=0x7f30c81481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 0x7f30c81481a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c6e0 tx=0x7f30b400c9f0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 shutdown_connections 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30a8066730 0x7f30a8068bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30c815e030 0x7f30c8149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.254+0000 7f30cd000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c8157500 0x7f30c81481a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.258+0000 7f30cd000700 1 --2- 172.21.15.50:0/1047052216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30c80cd140 0x7f30c80cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.258+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 >> 172.21.15.50:0/1047052216 conn(0x7f30c806e660 msgr2=0x7f30c80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.258+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 shutdown_connections 2024-09-13T15:07:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.258+0000 7f30cd000700 1 -- 172.21.15.50:0/1047052216 wait complete. 2024-09-13T15:07:33.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.446+0000 7f4b7e600700 1 Processor -- start 2024-09-13T15:07:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.446+0000 7f4b7e600700 1 -- start start 2024-09-13T15:07:33.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7e600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b7815d170 0x7f4b780b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7e600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4b780cdfe0 0x7f4b780ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7e600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780d1390 con 0x7f4b7815cd90 2024-09-13T15:07:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7e600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b780b2530 con 0x7f4b780cdfe0 2024-09-13T15:07:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7e600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780d05f0 con 0x7f4b7815d170 2024-09-13T15:07:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7d200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4b7815cd90 0x7f4b780cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43682/0 (socket says 172.21.15.50:43682) 2024-09-13T15:07:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7d200700 1 -- 172.21.15.50:0/3123634075 learned_addr learned my addr 172.21.15.50:0/3123634075 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b77e00700 1 --2- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b7815d170 0x7f4b780b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7dc00700 1 --2- 172.21.15.50:0/3123634075 >> v2:172.21.15.181:3300/0 conn(0x7f4b780cdfe0 0x7f4b780ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b77400700 1 -- 172.21.15.50:0/3123634075 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707445973 0 0) 0x7f4b780d1390 con 0x7f4b7815cd90 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b77400700 1 -- 172.21.15.50:0/3123634075 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b600035d0 con 0x7f4b7815cd90 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7dc00700 1 -- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b7815d170 msgr2=0x7f4b780b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7dc00700 1 --2- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b7815d170 0x7f4b780b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7dc00700 1 -- 172.21.15.50:0/3123634075 >> v1:172.21.15.50:6789/0 conn(0x7f4b7815cd90 legacy=0x7f4b780cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.450+0000 7f4b7dc00700 1 -- 172.21.15.50:0/3123634075 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780d1670 con 0x7f4b780cdfe0 2024-09-13T15:07:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7dc00700 1 --2- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b780cdfe0 0x7f4b780ce490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009d90 tx=0x7f4b7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d86b0765542e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b77400700 1 -- 172.21.15.50:0/3123634075 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000e070 con 0x7f4b780cdfe0 2024-09-13T15:07:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b77400700 1 -- 172.21.15.50:0/3123634075 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000bb20 con 0x7f4b780cdfe0 2024-09-13T15:07:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b77400700 1 -- 172.21.15.50:0/3123634075 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70012430 con 0x7f4b780cdfe0 2024-09-13T15:07:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 -- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b780cdfe0 msgr2=0x7f4b780ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 --2- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b780cdfe0 0x7f4b780ce490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009d90 tx=0x7f4b7000b330 comp rx=0 tx=0).stop 2024-09-13T15:07:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 -- 172.21.15.50:0/3123634075 shutdown_connections 2024-09-13T15:07:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 --2- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b780cdfe0 0x7f4b780ce490 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 --2- 172.21.15.50:0/3123634075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b7815d170 0x7f4b780b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 -- 172.21.15.50:0/3123634075 >> 172.21.15.50:0/3123634075 conn(0x7f4b780d2c10 msgr2=0x7f4b780d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 -- 172.21.15.50:0/3123634075 shutdown_connections 2024-09-13T15:07:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.454+0000 7f4b7e600700 1 -- 172.21.15.50:0/3123634075 wait complete. 2024-09-13T15:07:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 Processor -- start 2024-09-13T15:07:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 -- start start 2024-09-13T15:07:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b780cdfe0 0x7f4b780b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 0x7f4b781f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b7815d170 0x7f4b780b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780b8680 con 0x7f4b7815cd90 2024-09-13T15:07:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7814eeb0 con 0x7f4b7815d170 2024-09-13T15:07:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7814ebd0 con 0x7f4b780cdfe0 2024-09-13T15:07:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 0x7f4b781f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 0x7f4b781f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44438/0 (socket says 172.21.15.50:44438) 2024-09-13T15:07:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 -- 172.21.15.50:0/795690644 learned_addr learned my addr 172.21.15.50:0/795690644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7d200700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b780cdfe0 0x7f4b780b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7dc00700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b7815d170 0x7f4b780b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 -- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b780cdfe0 msgr2=0x7f4b780b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b780cdfe0 0x7f4b780b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 -- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b7815d170 msgr2=0x7f4b780b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b7815d170 0x7f4b780b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 -- 172.21.15.50:0/795690644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70009a70 con 0x7f4b7815cd90 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7dc00700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b7815d170 0x7f4b780b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b77e00700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 0x7f4b781f1e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009fd0 tx=0x7f4b6400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640095a0 con 0x7f4b7815cd90 2024-09-13T15:07:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64013680 con 0x7f4b7815cd90 2024-09-13T15:07:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64013a30 con 0x7f4b7815cd90 2024-09-13T15:07:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.458+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b780b6bc0 con 0x7f4b7815cd90 2024-09-13T15:07:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.462+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b780b7180 con 0x7f4b7815cd90 2024-09-13T15:07:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.462+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b780b1f50 con 0x7f4b7815cd90 2024-09-13T15:07:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.462+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b64013b90 con 0x7f4b7815cd90 2024-09-13T15:07:33.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.466+0000 7f4b74c00700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4b58066730 0x7f4b58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.466+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b64083d30 con 0x7f4b7815cd90 2024-09-13T15:07:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.466+0000 7f4b7d200700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4b58066730 0x7f4b58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.466+0000 7f4b7d200700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4b58066730 0x7f4b58068bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0011e0 tx=0x7f4b6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.470+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b640513e0 con 0x7f4b7815cd90 2024-09-13T15:07:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.706+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b780affb0 con 0x7f4b7815cd90 2024-09-13T15:07:33.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.706+0000 7f4b74c00700 1 -- 172.21.15.50:0/795690644 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f4b64017de0 con 0x7f4b7815cd90 2024-09-13T15:07:33.712 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:33.712 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4b58066730 msgr2=0x7f4b58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4b58066730 0x7f4b58068bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0011e0 tx=0x7f4b6c009040 comp rx=0 tx=0).stop 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 msgr2=0x7f4b781f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 0x7f4b781f1e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009fd0 tx=0x7f4b6400ebd0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 shutdown_connections 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4b58066730 0x7f4b58068bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b7815d170 0x7f4b780b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b7815cd90 0x7f4b781f1e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 --2- 172.21.15.50:0/795690644 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b780cdfe0 0x7f4b780b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 >> 172.21.15.50:0/795690644 conn(0x7f4b780d2c10 msgr2=0x7f4b780af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 shutdown_connections 2024-09-13T15:07:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.710+0000 7f4b7e600700 1 -- 172.21.15.50:0/795690644 wait complete. 2024-09-13T15:07:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-09-13T15:07:33.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.906+0000 7f5e1cc00700 1 Processor -- start 2024-09-13T15:07:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.906+0000 7f5e1cc00700 1 -- start start 2024-09-13T15:07:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.910+0000 7f5e1cc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1815ad00 0x7f5e1815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.910+0000 7f5e1cc00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1815e490 con 0x7f5e180ac890 2024-09-13T15:07:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.910+0000 7f5e1cc00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1806a390 con 0x7f5e180667a0 2024-09-13T15:07:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.910+0000 7f5e1cc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180b5690 con 0x7f5e1815ad00 2024-09-13T15:07:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.910+0000 7f5e15400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e180ac890 0x7f5e18066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43698/0 (socket says 172.21.15.50:43698) 2024-09-13T15:07:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.910+0000 7f5e15400700 1 -- 172.21.15.50:0/127853963 learned_addr learned my addr 172.21.15.50:0/127853963 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e15e00700 1 --2- 172.21.15.50:0/127853963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1815ad00 0x7f5e1815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e14a00700 1 -- 172.21.15.50:0/127853963 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299080211 0 0) 0x7f5e1815e490 con 0x7f5e180ac890 2024-09-13T15:07:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e14a00700 1 -- 172.21.15.50:0/127853963 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dfc0035d0 con 0x7f5e180ac890 2024-09-13T15:07:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e15e00700 1 -- 172.21.15.50:0/127853963 >> v1:172.21.15.181:6789/0 conn(0x7f5e180667a0 legacy=0x7f5e180b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e15e00700 1 -- 172.21.15.50:0/127853963 >> v1:172.21.15.50:6789/0 conn(0x7f5e180ac890 legacy=0x7f5e18066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e14a00700 1 -- 172.21.15.50:0/127853963 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553638397 0 0) 0x7f5e1806a390 con 0x7f5e180667a0 2024-09-13T15:07:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e15e00700 1 -- 172.21.15.50:0/127853963 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180ace00 con 0x7f5e1815ad00 2024-09-13T15:07:33.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e15e00700 1 --2- 172.21.15.50:0/127853963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1815ad00 0x7f5e1815df50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009880 tx=0x7f5e08009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6010de2c66926780 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e14a00700 1 -- 172.21.15.50:0/127853963 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08011830 con 0x7f5e1815ad00 2024-09-13T15:07:33.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e14a00700 1 -- 172.21.15.50:0/127853963 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08011990 con 0x7f5e1815ad00 2024-09-13T15:07:33.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e14a00700 1 -- 172.21.15.50:0/127853963 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08011d20 con 0x7f5e1815ad00 2024-09-13T15:07:33.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e1cc00700 1 -- 172.21.15.50:0/127853963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1815ad00 msgr2=0x7f5e1815df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/127853963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1815ad00 0x7f5e1815df50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009880 tx=0x7f5e08009b90 comp rx=0 tx=0).stop 2024-09-13T15:07:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e1cc00700 1 -- 172.21.15.50:0/127853963 shutdown_connections 2024-09-13T15:07:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/127853963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1815ad00 0x7f5e1815df50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e1cc00700 1 -- 172.21.15.50:0/127853963 >> 172.21.15.50:0/127853963 conn(0x7f5e180b19d0 msgr2=0x7f5e180b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.914+0000 7f5e1cc00700 1 -- 172.21.15.50:0/127853963 shutdown_connections 2024-09-13T15:07:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.918+0000 7f5e1cc00700 1 -- 172.21.15.50:0/127853963 wait complete. 2024-09-13T15:07:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.918+0000 7f5e1cc00700 1 Processor -- start 2024-09-13T15:07:33.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.918+0000 7f5e1cc00700 1 -- start start 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e180667a0 0x7f5e1814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 0x7f5e180b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1814fbd0 0x7f5e18155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1815b5a0 con 0x7f5e180ac890 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1814f980 con 0x7f5e180667a0 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180b0b80 con 0x7f5e1814fbd0 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 0x7f5e180b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e180667a0 0x7f5e1814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 0x7f5e180b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44442/0 (socket says 172.21.15.50:44442) 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 -- 172.21.15.50:0/752636414 learned_addr learned my addr 172.21.15.50:0/752636414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e16800700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1814fbd0 0x7f5e18155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 -- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1814fbd0 msgr2=0x7f5e18155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1814fbd0 0x7f5e18155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 -- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e180667a0 msgr2=0x7f5e1814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e180667a0 0x7f5e1814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 -- 172.21.15.50:0/752636414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080094b0 con 0x7f5e180ac890 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e15400700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 0x7f5e180b0330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e040010e0 tx=0x7f5e0400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04005d90 con 0x7f5e180ac890 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e040070d0 con 0x7f5e180ac890 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e180b0e60 con 0x7f5e180ac890 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04007460 con 0x7f5e180ac890 2024-09-13T15:07:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.922+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1815b840 con 0x7f5e180ac890 2024-09-13T15:07:33.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.926+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1815ba60 con 0x7f5e180ac890 2024-09-13T15:07:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.926+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e040075c0 con 0x7f5e180ac890 2024-09-13T15:07:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.930+0000 7f5e0e000700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5df8066730 0x7f5df8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.930+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e04083220 con 0x7f5e180ac890 2024-09-13T15:07:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.930+0000 7f5e15e00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5df8066730 0x7f5df8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.930+0000 7f5e15e00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5df8066730 0x7f5df8068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e080090b0 tx=0x7f5e0801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:33.934+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e040508d0 con 0x7f5e180ac890 2024-09-13T15:07:34.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.126+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e1815df50 con 0x7f5e180ac890 2024-09-13T15:07:34.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.126+0000 7f5e0e000700 1 -- 172.21.15.50:0/752636414 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f5e04053ef0 con 0x7f5e180ac890 2024-09-13T15:07:34.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:34.135 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:28.879321+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5df8066730 msgr2=0x7f5df8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5df8066730 0x7f5df8068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e080090b0 tx=0x7f5e0801c040 comp rx=0 tx=0).stop 2024-09-13T15:07:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 msgr2=0x7f5e180b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 0x7f5e180b0330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e040010e0 tx=0x7f5e0400c7d0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 shutdown_connections 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5df8066730 0x7f5df8068bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5e1814fbd0 0x7f5e18155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e180ac890 0x7f5e180b0330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 --2- 172.21.15.50:0/752636414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e180667a0 0x7f5e1814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 >> 172.21.15.50:0/752636414 conn(0x7f5e180b19d0 msgr2=0x7f5e180ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 shutdown_connections 2024-09-13T15:07:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.130+0000 7f5e1cc00700 1 -- 172.21.15.50:0/752636414 wait complete. 2024-09-13T15:07:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:07:34.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:07:34.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9174800700 1 Processor -- start 2024-09-13T15:07:34.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9174800700 1 -- start start 2024-09-13T15:07:34.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9174800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f916c06be10 0x7f916c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9174800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c06d000 con 0x7f916c0cf0b0 2024-09-13T15:07:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9174800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0cf4e0 con 0x7f916c160fc0 2024-09-13T15:07:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9174800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c06c3f0 con 0x7f916c06be10 2024-09-13T15:07:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.342+0000 7f9172800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f916c0cf0b0 0x7f916c1618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43706/0 (socket says 172.21.15.50:43706) 2024-09-13T15:07:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9172800700 1 -- 172.21.15.50:0/1387494466 learned_addr learned my addr 172.21.15.50:0/1387494466 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9171400700 1 --2- 172.21.15.50:0/1387494466 >> v2:172.21.15.181:3300/0 conn(0x7f916c06be10 0x7f916c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356697760 0 0) 0x7f916c06d000 con 0x7f916c0cf0b0 2024-09-13T15:07:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91540035d0 con 0x7f916c0cf0b0 2024-09-13T15:07:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471897932 0 0) 0x7f916c0cf4e0 con 0x7f916c160fc0 2024-09-13T15:07:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c06d000 con 0x7f916c160fc0 2024-09-13T15:07:34.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9171400700 1 -- 172.21.15.50:0/1387494466 >> v1:172.21.15.181:6789/0 conn(0x7f916c160fc0 legacy=0x7f916c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9171400700 1 -- 172.21.15.50:0/1387494466 >> v1:172.21.15.50:6789/0 conn(0x7f916c0cf0b0 legacy=0x7f916c1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9171400700 1 -- 172.21.15.50:0/1387494466 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c06c6d0 con 0x7f916c06be10 2024-09-13T15:07:34.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9171400700 1 --2- 172.21.15.50:0/1387494466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c06be10 0x7f916c0ceb70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f915c009850 tx=0x7f915c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b99a2217869ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c011830 con 0x7f916c06be10 2024-09-13T15:07:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c011990 con 0x7f916c06be10 2024-09-13T15:07:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9170a00700 1 -- 172.21.15.50:0/1387494466 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c011d40 con 0x7f916c06be10 2024-09-13T15:07:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9174800700 1 -- 172.21.15.50:0/1387494466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c06be10 msgr2=0x7f916c0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.346+0000 7f9174800700 1 --2- 172.21.15.50:0/1387494466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c06be10 0x7f916c0ceb70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f915c009850 tx=0x7f915c009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 -- 172.21.15.50:0/1387494466 shutdown_connections 2024-09-13T15:07:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 --2- 172.21.15.50:0/1387494466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c06be10 0x7f916c0ceb70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 -- 172.21.15.50:0/1387494466 >> 172.21.15.50:0/1387494466 conn(0x7f916c06a570 msgr2=0x7f916c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 -- 172.21.15.50:0/1387494466 shutdown_connections 2024-09-13T15:07:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 -- 172.21.15.50:0/1387494466 wait complete. 2024-09-13T15:07:34.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 Processor -- start 2024-09-13T15:07:34.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.350+0000 7f9174800700 1 -- start start 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 0x7f916c0a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c0cf0b0 0x7f916c0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c160fc0 0x7f916c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0abc10 con 0x7f916c06be10 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0abef0 con 0x7f916c160fc0 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0ac1d0 con 0x7f916c0cf0b0 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 0x7f916c0a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 0x7f916c0a9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44458/0 (socket says 172.21.15.50:44458) 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 -- 172.21.15.50:0/1533511708 learned_addr learned my addr 172.21.15.50:0/1533511708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171400700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c0cf0b0 0x7f916c0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9172800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c160fc0 0x7f916c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 -- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c0cf0b0 msgr2=0x7f916c0ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c0cf0b0 0x7f916c0ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 -- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c160fc0 msgr2=0x7f916c0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c160fc0 0x7f916c0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 -- 172.21.15.50:0/1533511708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0094b0 con 0x7f916c06be10 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9172800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c160fc0 0x7f916c0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9171e00700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 0x7f916c0a9e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f916000c490 tx=0x7f916000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600052d0 con 0x7f916c06be10 2024-09-13T15:07:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160005450 con 0x7f916c06be10 2024-09-13T15:07:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600038e0 con 0x7f916c06be10 2024-09-13T15:07:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c0ac4b0 con 0x7f916c06be10 2024-09-13T15:07:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.354+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c0aa350 con 0x7f916c06be10 2024-09-13T15:07:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.358+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c0ceb70 con 0x7f916c06be10 2024-09-13T15:07:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.358+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9160003a40 con 0x7f916c06be10 2024-09-13T15:07:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.362+0000 7f9166000700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9150066730 0x7f9150068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.362+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9160083320 con 0x7f916c06be10 2024-09-13T15:07:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.362+0000 7f9171400700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9150066730 0x7f9150068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.362+0000 7f9171400700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9150066730 0x7f9150068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f915c0090b0 tx=0x7f915c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.366+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9160050940 con 0x7f916c06be10 2024-09-13T15:07:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.550+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f916c0aec20 con 0x7f916c06be10 2024-09-13T15:07:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.550+0000 7f9166000700 1 -- 172.21.15.50:0/1533511708 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9160053f60 con 0x7f916c06be10 2024-09-13T15:07:34.555 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:07:34.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9150066730 msgr2=0x7f9150068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9150066730 0x7f9150068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f915c0090b0 tx=0x7f915c008030 comp rx=0 tx=0).stop 2024-09-13T15:07:34.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 msgr2=0x7f916c0a9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 0x7f916c0a9e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f916000c490 tx=0x7f916000c7a0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 shutdown_connections 2024-09-13T15:07:34.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9150066730 0x7f9150068bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f916c160fc0 0x7f916c0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f916c0cf0b0 0x7f916c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 --2- 172.21.15.50:0/1533511708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916c06be10 0x7f916c0a9e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 >> 172.21.15.50:0/1533511708 conn(0x7f916c06a570 msgr2=0x7f916c0b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:34.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 shutdown_connections 2024-09-13T15:07:34.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.554+0000 7f9174800700 1 -- 172.21.15.50:0/1533511708 wait complete. 2024-09-13T15:07:34.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:07:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.750+0000 7f5b48000700 1 Processor -- start 2024-09-13T15:07:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.750+0000 7f5b48000700 1 -- start start 2024-09-13T15:07:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b48000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b40145cb0 0x7f5b400ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b48000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b400cf370 0x7f5b400cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b48000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b400cfcf0 con 0x7f5b4006f880 2024-09-13T15:07:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b48000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b40146090 con 0x7f5b400cf370 2024-09-13T15:07:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b48000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b40161a50 con 0x7f5b40145cb0 2024-09-13T15:07:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b44c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b400cf370 0x7f5b400cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b40145cb0 0x7f5b400ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b40145cb0 0x7f5b400ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:52940/0 (socket says 172.21.15.50:52940) 2024-09-13T15:07:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 -- 172.21.15.50:0/3842542146 learned_addr learned my addr 172.21.15.50:0/3842542146 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 -- 172.21.15.50:0/3842542146 >> v2:172.21.15.50:3300/0 conn(0x7f5b400cf370 msgr2=0x7f5b400cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 --2- 172.21.15.50:0/3842542146 >> v2:172.21.15.50:3300/0 conn(0x7f5b400cf370 0x7f5b400cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 -- 172.21.15.50:0/3842542146 >> v1:172.21.15.181:6789/0 conn(0x7f5b4006f880 legacy=0x7f5b4006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 -- 172.21.15.50:0/3842542146 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400cb1c0 con 0x7f5b40145cb0 2024-09-13T15:07:34.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b44c00700 1 --2- 172.21.15.50:0/3842542146 >> v2:172.21.15.50:3300/0 conn(0x7f5b400cf370 0x7f5b400cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:34.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b45600700 1 --2- 172.21.15.50:0/3842542146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b400ce360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b400cfff0 tx=0x7f5b34009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d5f2a4b1028f73c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b3fe00700 1 -- 172.21.15.50:0/3842542146 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34011830 con 0x7f5b40145cb0 2024-09-13T15:07:34.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b3fe00700 1 -- 172.21.15.50:0/3842542146 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34011990 con 0x7f5b40145cb0 2024-09-13T15:07:34.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.754+0000 7f5b3fe00700 1 -- 172.21.15.50:0/3842542146 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34011d20 con 0x7f5b40145cb0 2024-09-13T15:07:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 -- 172.21.15.50:0/3842542146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 msgr2=0x7f5b400ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 --2- 172.21.15.50:0/3842542146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b400ce360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b400cfff0 tx=0x7f5b34009bf0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 -- 172.21.15.50:0/3842542146 shutdown_connections 2024-09-13T15:07:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 --2- 172.21.15.50:0/3842542146 >> v2:172.21.15.50:3300/0 conn(0x7f5b400cf370 0x7f5b400cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 --2- 172.21.15.50:0/3842542146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b400ce360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 -- 172.21.15.50:0/3842542146 >> 172.21.15.50:0/3842542146 conn(0x7f5b400726d0 msgr2=0x7f5b4006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 -- 172.21.15.50:0/3842542146 shutdown_connections 2024-09-13T15:07:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 -- 172.21.15.50:0/3842542146 wait complete. 2024-09-13T15:07:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.758+0000 7f5b48000700 1 Processor -- start 2024-09-13T15:07:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 -- start start 2024-09-13T15:07:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 0x7f5b401f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b400cf370 0x7f5b4013d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b40142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b401f6c70 con 0x7f5b4006f880 2024-09-13T15:07:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4013de00 con 0x7f5b40145cb0 2024-09-13T15:07:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4006d050 con 0x7f5b400cf370 2024-09-13T15:07:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 0x7f5b401f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 0x7f5b401f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44462/0 (socket says 172.21.15.50:44462) 2024-09-13T15:07:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 -- 172.21.15.50:0/400804744 learned_addr learned my addr 172.21.15.50:0/400804744 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b46000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b40142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b44c00700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b400cf370 0x7f5b4013d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 -- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b400cf370 msgr2=0x7f5b4013d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b400cf370 0x7f5b4013d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 -- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 msgr2=0x7f5b40142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b40142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 -- 172.21.15.50:0/400804744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0094b0 con 0x7f5b4006f880 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b44c00700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b400cf370 0x7f5b4013d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b45600700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 0x7f5b401f6730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34004610 con 0x7f5b4006f880 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3401e070 con 0x7f5b4006f880 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b34009570 con 0x7f5b4006f880 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.762+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340038e0 con 0x7f5b4006f880 2024-09-13T15:07:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.766+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b401f3840 con 0x7f5b4006f880 2024-09-13T15:07:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.766+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b40146920 con 0x7f5b4006f880 2024-09-13T15:07:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.766+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b34003a40 con 0x7f5b4006f880 2024-09-13T15:07:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.770+0000 7f5b3d600700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b20066730 0x7f5b20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.770+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b34084e90 con 0x7f5b4006f880 2024-09-13T15:07:34.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.770+0000 7f5b44c00700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b20066730 0x7f5b20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.770+0000 7f5b44c00700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b20066730 0x7f5b20068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b4006ca60 tx=0x7f5b2c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.774+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b34052700 con 0x7f5b4006f880 2024-09-13T15:07:34.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.962+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b40067730 con 0x7f5b4006f880 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.962+0000 7f5b3d600700 1 -- 172.21.15.50:0/400804744 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5b34015090 con 0x7f5b4006f880 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:07:34.970 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b20066730 msgr2=0x7f5b20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b20066730 0x7f5b20068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b4006ca60 tx=0x7f5b2c008040 comp rx=0 tx=0).stop 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 msgr2=0x7f5b401f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 0x7f5b401f6730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b34004770 comp rx=0 tx=0).stop 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 shutdown_connections 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b20066730 0x7f5b20068bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b40145cb0 0x7f5b40142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b400cf370 0x7f5b4013d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 --2- 172.21.15.50:0/400804744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b4006f880 0x7f5b401f6730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 >> 172.21.15.50:0/400804744 conn(0x7f5b400726d0 msgr2=0x7f5b400cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 shutdown_connections 2024-09-13T15:07:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:34.966+0000 7f5b48000700 1 -- 172.21.15.50:0/400804744 wait complete. 2024-09-13T15:07:34.994 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:07:34.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:07:35.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:35.181 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 Processor -- start 2024-09-13T15:07:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 -- start start 2024-09-13T15:07:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faff015ac50 0x7faff006d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff0071150 0x7faff0071590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faff00ac6b0 0x7faff00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00ad370 con 0x7faff015ac50 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff006d2f0 con 0x7faff00ac6b0 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7faff4a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff0071ad0 con 0x7faff0071150 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7fafee800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faff015ac50 0x7faff006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7fafee800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faff015ac50 0x7faff006d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44464/0 (socket says 172.21.15.50:44464) 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7fafee800700 1 -- 172.21.15.50:0/4198223156 learned_addr learned my addr 172.21.15.50:0/4198223156 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.170+0000 7fafef200700 1 --2- 172.21.15.50:0/4198223156 >> v2:172.21.15.181:3300/0 conn(0x7faff00ac6b0 0x7faff00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafede00700 1 --2- 172.21.15.50:0/4198223156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff0071150 0x7faff0071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafee800700 1 -- 172.21.15.50:0/4198223156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff0071150 msgr2=0x7faff0071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafee800700 1 --2- 172.21.15.50:0/4198223156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff0071150 0x7faff0071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafee800700 1 -- 172.21.15.50:0/4198223156 >> v2:172.21.15.181:3300/0 conn(0x7faff00ac6b0 msgr2=0x7faff00acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafee800700 1 --2- 172.21.15.50:0/4198223156 >> v2:172.21.15.181:3300/0 conn(0x7faff00ac6b0 0x7faff00acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafee800700 1 -- 172.21.15.50:0/4198223156 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff006c9c0 con 0x7faff015ac50 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafee800700 1 --2- 172.21.15.50:0/4198223156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff015ac50 0x7faff006d780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faff0072660 tx=0x7fafe0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27489bbd82afa8df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafed400700 1 -- 172.21.15.50:0/4198223156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000b8a0 con 0x7faff015ac50 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafed400700 1 -- 172.21.15.50:0/4198223156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000ba00 con 0x7faff015ac50 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7fafed400700 1 -- 172.21.15.50:0/4198223156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000bd90 con 0x7faff015ac50 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 -- 172.21.15.50:0/4198223156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff015ac50 msgr2=0x7faff006d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 --2- 172.21.15.50:0/4198223156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff015ac50 0x7faff006d780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faff0072660 tx=0x7fafe0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 -- 172.21.15.50:0/4198223156 shutdown_connections 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 --2- 172.21.15.50:0/4198223156 >> v2:172.21.15.181:3300/0 conn(0x7faff00ac6b0 0x7faff00acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 --2- 172.21.15.50:0/4198223156 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff0071150 0x7faff0071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 --2- 172.21.15.50:0/4198223156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff015ac50 0x7faff006d780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 -- 172.21.15.50:0/4198223156 >> 172.21.15.50:0/4198223156 conn(0x7faff006a9c0 msgr2=0x7faff00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 -- 172.21.15.50:0/4198223156 shutdown_connections 2024-09-13T15:07:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.174+0000 7faff4a00700 1 -- 172.21.15.50:0/4198223156 wait complete. 2024-09-13T15:07:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.178+0000 7faff4a00700 1 Processor -- start 2024-09-13T15:07:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.178+0000 7faff4a00700 1 -- start start 2024-09-13T15:07:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faff0071150 0x7faff009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 0x7faff0153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff015ac50 0x7faff0151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff0151db0 con 0x7faff00ac6b0 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff009a090 con 0x7faff0071150 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff009a330 con 0x7faff015ac50 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 0x7faff0153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 0x7faff0153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44476/0 (socket says 172.21.15.50:44476) 2024-09-13T15:07:35.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 -- 172.21.15.50:0/218934691 learned_addr learned my addr 172.21.15.50:0/218934691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:35.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafee800700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faff0071150 0x7faff009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 -- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff015ac50 msgr2=0x7faff0151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff015ac50 0x7faff0151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 -- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faff0071150 msgr2=0x7faff009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faff0071150 0x7faff009ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 -- 172.21.15.50:0/218934691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009570 con 0x7faff00ac6b0 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafee800700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faff0071150 0x7faff009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafede00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 0x7faff0153b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00d800 tx=0x7fafdc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc014620 con 0x7faff00ac6b0 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc014780 con 0x7faff00ac6b0 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff009a610 con 0x7faff00ac6b0 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc014b10 con 0x7faff00ac6b0 2024-09-13T15:07:35.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.182+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff0151aa0 con 0x7faff00ac6b0 2024-09-13T15:07:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.186+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafdc014c70 con 0x7faff00ac6b0 2024-09-13T15:07:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.186+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff00acb40 con 0x7faff00ac6b0 2024-09-13T15:07:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.186+0000 7fafe6a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafd0066730 0x7fafd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.186+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fafdc0844c0 con 0x7faff00ac6b0 2024-09-13T15:07:35.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.186+0000 7fafee800700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafd0066730 0x7fafd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.186+0000 7fafee800700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafd0066730 0x7fafd0068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000c00 tx=0x7fafe0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.194+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafdc051a60 con 0x7faff00ac6b0 2024-09-13T15:07:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.374+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faff00b20f0 con 0x7faff00ac6b0 2024-09-13T15:07:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.962+0000 7fafe6a00700 1 -- 172.21.15.50:0/218934691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fafdc00b440 con 0x7faff00ac6b0 2024-09-13T15:07:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.966+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafd0066730 msgr2=0x7fafd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.966+0000 7faff4a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafd0066730 0x7fafd0068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000c00 tx=0x7fafe0008030 comp rx=0 tx=0).stop 2024-09-13T15:07:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.966+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 msgr2=0x7faff0153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.966+0000 7faff4a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 0x7faff0153b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00d800 tx=0x7fafdc00dbc0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.966+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 shutdown_connections 2024-09-13T15:07:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.966+0000 7faff4a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafd0066730 0x7fafd0068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.970+0000 7faff4a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faff015ac50 0x7faff0151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.970+0000 7faff4a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff00ac6b0 0x7faff0153b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.970+0000 7faff4a00700 1 --2- 172.21.15.50:0/218934691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faff0071150 0x7faff009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.970+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 >> 172.21.15.50:0/218934691 conn(0x7faff006a9c0 msgr2=0x7faff00af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.970+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 shutdown_connections 2024-09-13T15:07:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:35.970+0000 7faff4a00700 1 -- 172.21.15.50:0/218934691 wait complete. 2024-09-13T15:07:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:07:36.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T15:07:36.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.182+0000 7f4d46e00700 1 Processor -- start 2024-09-13T15:07:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.182+0000 7f4d46e00700 1 -- start start 2024-09-13T15:07:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d46e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d40160ea0 0x7f4d400b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d46e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d40161280 0x7f4d401656a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d46e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d400b2bb0 con 0x7f4d400b3040 2024-09-13T15:07:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d46e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d400b1fa0 con 0x7f4d40161280 2024-09-13T15:07:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d46e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d400b2280 con 0x7f4d40160ea0 2024-09-13T15:07:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d40161280 0x7f4d401656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d40161280 0x7f4d401656a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44480/0 (socket says 172.21.15.50:44480) 2024-09-13T15:07:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 -- 172.21.15.50:0/3474142433 learned_addr learned my addr 172.21.15.50:0/3474142433 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45a00700 1 --2- 172.21.15.50:0/3474142433 >> v2:172.21.15.181:3300/0 conn(0x7f4d40160ea0 0x7f4d400b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 -- 172.21.15.50:0/3474142433 >> v2:172.21.15.181:3300/0 conn(0x7f4d40160ea0 msgr2=0x7f4d400b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 --2- 172.21.15.50:0/3474142433 >> v2:172.21.15.181:3300/0 conn(0x7f4d40160ea0 0x7f4d400b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 -- 172.21.15.50:0/3474142433 >> v1:172.21.15.181:6789/0 conn(0x7f4d400b3040 legacy=0x7f4d40070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 -- 172.21.15.50:0/3474142433 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400b2560 con 0x7f4d40161280 2024-09-13T15:07:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.186+0000 7f4d45000700 1 --2- 172.21.15.50:0/3474142433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d40161280 0x7f4d401656a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d4006b920 tx=0x7f4d2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2397c32df2bf9d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d3fe00700 1 -- 172.21.15.50:0/3474142433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011830 con 0x7f4d40161280 2024-09-13T15:07:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d3fe00700 1 -- 172.21.15.50:0/3474142433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c011990 con 0x7f4d40161280 2024-09-13T15:07:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d3fe00700 1 -- 172.21.15.50:0/3474142433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011d20 con 0x7f4d40161280 2024-09-13T15:07:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 -- 172.21.15.50:0/3474142433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d40161280 msgr2=0x7f4d401656a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 --2- 172.21.15.50:0/3474142433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d40161280 0x7f4d401656a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d4006b920 tx=0x7f4d2c009bf0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 -- 172.21.15.50:0/3474142433 shutdown_connections 2024-09-13T15:07:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 --2- 172.21.15.50:0/3474142433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d40161280 0x7f4d401656a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 --2- 172.21.15.50:0/3474142433 >> v2:172.21.15.181:3300/0 conn(0x7f4d40160ea0 0x7f4d400b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 -- 172.21.15.50:0/3474142433 >> 172.21.15.50:0/3474142433 conn(0x7f4d4006a390 msgr2=0x7f4d4006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 -- 172.21.15.50:0/3474142433 shutdown_connections 2024-09-13T15:07:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.190+0000 7f4d46e00700 1 -- 172.21.15.50:0/3474142433 wait complete. 2024-09-13T15:07:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 Processor -- start 2024-09-13T15:07:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 -- start start 2024-09-13T15:07:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 0x7f4d4015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d40160ea0 0x7f4d401526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d40161280 0x7f4d40155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4015e9c0 con 0x7f4d400b3040 2024-09-13T15:07:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40158a90 con 0x7f4d40161280 2024-09-13T15:07:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40153760 con 0x7f4d40160ea0 2024-09-13T15:07:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 0x7f4d4015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 0x7f4d4015da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44488/0 (socket says 172.21.15.50:44488) 2024-09-13T15:07:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 -- 172.21.15.50:0/2174531963 learned_addr learned my addr 172.21.15.50:0/2174531963 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45000700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d40160ea0 0x7f4d401526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46400700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d40161280 0x7f4d40155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 -- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d40160ea0 msgr2=0x7f4d401526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d40160ea0 0x7f4d401526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 -- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d40161280 msgr2=0x7f4d40155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d40161280 0x7f4d40155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 -- 172.21.15.50:0/2174531963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009570 con 0x7f4d400b3040 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d45a00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 0x7f4d4015da90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400e9d0 tx=0x7f4d3400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34009720 con 0x7f4d400b3040 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400c850 con 0x7f4d400b3040 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4015e120 con 0x7f4d400b3040 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.194+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400cbc0 con 0x7f4d400b3040 2024-09-13T15:07:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.198+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4015e6e0 con 0x7f4d400b3040 2024-09-13T15:07:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.198+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d400b18a0 con 0x7f4d400b3040 2024-09-13T15:07:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.198+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d3400cd20 con 0x7f4d400b3040 2024-09-13T15:07:36.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.202+0000 7f4d3d600700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4d20066730 0x7f4d20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:36.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.202+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4d34084150 con 0x7f4d400b3040 2024-09-13T15:07:36.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.202+0000 7f4d45000700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4d20066730 0x7f4d20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:36.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.202+0000 7f4d45000700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4d20066730 0x7f4d20068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c000c00 tx=0x7f4d2c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:36.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.206+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d34051600 con 0x7f4d400b3040 2024-09-13T15:07:36.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.386+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4d400b1cc0 con 0x7f4d400b3040 2024-09-13T15:07:36.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.974+0000 7f4d3d600700 1 -- 172.21.15.50:0/2174531963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4d34054c20 con 0x7f4d400b3040 2024-09-13T15:07:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4d20066730 msgr2=0x7f4d20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4d20066730 0x7f4d20068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c000c00 tx=0x7f4d2c008030 comp rx=0 tx=0).stop 2024-09-13T15:07:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 msgr2=0x7f4d4015da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 0x7f4d4015da90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400e9d0 tx=0x7f4d3400ed90 comp rx=0 tx=0).stop 2024-09-13T15:07:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 shutdown_connections 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4d20066730 0x7f4d20068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d40161280 0x7f4d40155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d40160ea0 0x7f4d401526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 --2- 172.21.15.50:0/2174531963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d400b3040 0x7f4d4015da90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 >> 172.21.15.50:0/2174531963 conn(0x7f4d4006a390 msgr2=0x7f4d40162210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 shutdown_connections 2024-09-13T15:07:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:36.982+0000 7f4d46e00700 1 -- 172.21.15.50:0/2174531963 wait complete. 2024-09-13T15:07:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:07:37.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:07:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.202+0000 7f3bf5c00700 1 Processor -- start 2024-09-13T15:07:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.202+0000 7f3bf5c00700 1 -- start start 2024-09-13T15:07:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3bf006cd80 0x7f3bf00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006ada0 0x7f3bf006b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0160680 con 0x7f3bf015ca20 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf006b750 con 0x7f3bf006cd80 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf015d670 con 0x7f3bf006ada0 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3bf006cd80 0x7f3bf00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006ada0 0x7f3bf006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3bf006cd80 0x7f3bf00b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:52982/0 (socket says 172.21.15.50:52982) 2024-09-13T15:07:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 -- 172.21.15.50:0/929384964 learned_addr learned my addr 172.21.15.50:0/929384964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 -- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006ada0 msgr2=0x7f3bf006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 --2- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006ada0 0x7f3bf006b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 -- 172.21.15.50:0/929384964 >> v1:172.21.15.181:6789/0 conn(0x7f3bf015ca20 legacy=0x7f3bf015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 -- 172.21.15.50:0/929384964 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf015d950 con 0x7f3bf006cd80 2024-09-13T15:07:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bef400700 1 --2- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf006cd80 0x7f3bf00b4310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009910 tx=0x7f3bdc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c73ae590ba82aa1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3beea00700 1 -- 172.21.15.50:0/929384964 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011830 con 0x7f3bf006cd80 2024-09-13T15:07:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3beea00700 1 -- 172.21.15.50:0/929384964 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011990 con 0x7f3bf006cd80 2024-09-13T15:07:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3beea00700 1 -- 172.21.15.50:0/929384964 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011d40 con 0x7f3bf006cd80 2024-09-13T15:07:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf006cd80 msgr2=0x7f3bf00b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf006cd80 0x7f3bf00b4310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009910 tx=0x7f3bdc009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- 172.21.15.50:0/929384964 shutdown_connections 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006ada0 0x7f3bf006b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/929384964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf006cd80 0x7f3bf00b4310 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- 172.21.15.50:0/929384964 >> 172.21.15.50:0/929384964 conn(0x7f3bf0071d20 msgr2=0x7f3bf0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- 172.21.15.50:0/929384964 shutdown_connections 2024-09-13T15:07:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- 172.21.15.50:0/929384964 wait complete. 2024-09-13T15:07:37.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 Processor -- start 2024-09-13T15:07:37.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.210+0000 7f3bf5c00700 1 -- start start 2024-09-13T15:07:37.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 0x7f3bf014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006cd80 0x7f3bf015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf015ca20 0x7f3bf015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0154050 con 0x7f3bf006ada0 2024-09-13T15:07:37.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf014f9d0 con 0x7f3bf015ca20 2024-09-13T15:07:37.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01536b0 con 0x7f3bf006cd80 2024-09-13T15:07:37.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 0x7f3bf014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 0x7f3bf014f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44492/0 (socket says 172.21.15.50:44492) 2024-09-13T15:07:37.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 -- 172.21.15.50:0/1407092954 learned_addr learned my addr 172.21.15.50:0/1407092954 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:37.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5200700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf015ca20 0x7f3bf015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bef400700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006cd80 0x7f3bf015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 -- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006cd80 msgr2=0x7f3bf015b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006cd80 0x7f3bf015b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 -- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf015ca20 msgr2=0x7f3bf015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf015ca20 0x7f3bf015b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 -- 172.21.15.50:0/1407092954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009570 con 0x7f3bf006ada0 2024-09-13T15:07:37.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3befe00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 0x7f3bf014f490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c500 tx=0x7f3be000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00052d0 con 0x7f3bf006ada0 2024-09-13T15:07:37.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0005430 con 0x7f3bf006ada0 2024-09-13T15:07:37.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf0153990 con 0x7f3bf006ada0 2024-09-13T15:07:37.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00055a0 con 0x7f3bf006ada0 2024-09-13T15:07:37.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.214+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf0154470 con 0x7f3bf006ada0 2024-09-13T15:07:37.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.218+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0154190 con 0x7f3bf006ada0 2024-09-13T15:07:37.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.218+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3be00038e0 con 0x7f3bf006ada0 2024-09-13T15:07:37.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.222+0000 7f3be7e00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bd0066730 0x7f3bd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.222+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3be0083410 con 0x7f3bf006ada0 2024-09-13T15:07:37.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.222+0000 7f3bef400700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bd0066730 0x7f3bd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.222+0000 7f3bef400700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bd0066730 0x7f3bd0068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc000c00 tx=0x7f3bdc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.226+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3bf0154190 con 0x7f3bf006ada0 2024-09-13T15:07:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.454+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3bf0154190 con 0x7f3bf006ada0 2024-09-13T15:07:37.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.466+0000 7f3be7e00700 1 -- 172.21.15.50:0/1407092954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3be00507d0 con 0x7f3bf006ada0 2024-09-13T15:07:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bd0066730 msgr2=0x7f3bd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bd0066730 0x7f3bd0068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc000c00 tx=0x7f3bdc008030 comp rx=0 tx=0).stop 2024-09-13T15:07:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 msgr2=0x7f3bf014f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 0x7f3bf014f490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c500 tx=0x7f3be000c810 comp rx=0 tx=0).stop 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 shutdown_connections 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bd0066730 0x7f3bd0068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bf015ca20 0x7f3bf015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bf006cd80 0x7f3bf015b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 --2- 172.21.15.50:0/1407092954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf006ada0 0x7f3bf014f490 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 >> 172.21.15.50:0/1407092954 conn(0x7f3bf0071d20 msgr2=0x7f3bf015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 shutdown_connections 2024-09-13T15:07:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.474+0000 7f3bf5c00700 1 -- 172.21.15.50:0/1407092954 wait complete. 2024-09-13T15:07:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T15:07:37.516 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T15:07:37.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T15:07:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.682+0000 7f4dd3e00700 1 Processor -- start 2024-09-13T15:07:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.682+0000 7f4dd3e00700 1 -- start start 2024-09-13T15:07:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4dd415cfd0 0x7f4dd4071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 0x7f4dd40c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd40cdff0 con 0x7f4dd40cd470 2024-09-13T15:07:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd40ae960 con 0x7f4dd415cfd0 2024-09-13T15:07:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd415d3b0 con 0x7f4dd40c9720 2024-09-13T15:07:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd2a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4dd415cfd0 0x7f4dd4071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 0x7f4dd40c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 0x7f4dd40c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58324/0 (socket says 172.21.15.50:58324) 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd2a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4dd415cfd0 0x7f4dd4071cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:53004/0 (socket says 172.21.15.50:53004) 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 -- 172.21.15.50:0/339522056 learned_addr learned my addr 172.21.15.50:0/339522056 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 -- 172.21.15.50:0/339522056 >> v2:172.21.15.181:3300/0 conn(0x7f4dd415cfd0 msgr2=0x7f4dd4071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 --2- 172.21.15.50:0/339522056 >> v2:172.21.15.181:3300/0 conn(0x7f4dd415cfd0 0x7f4dd4071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 -- 172.21.15.50:0/339522056 >> v1:172.21.15.181:6789/0 conn(0x7f4dd40cd470 legacy=0x7f4dd40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.686+0000 7f4dd3400700 1 -- 172.21.15.50:0/339522056 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4070c50 con 0x7f4dd40c9720 2024-09-13T15:07:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3400700 1 --2- 172.21.15.50:0/339522056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 0x7f4dd40c9b30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00d150 tx=0x7f4dcc00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f34d502764612d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd1600700 1 -- 172.21.15.50:0/339522056 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc010070 con 0x7f4dd40c9720 2024-09-13T15:07:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd1600700 1 -- 172.21.15.50:0/339522056 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00dd10 con 0x7f4dd40c9720 2024-09-13T15:07:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd1600700 1 -- 172.21.15.50:0/339522056 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00b310 con 0x7f4dd40c9720 2024-09-13T15:07:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 -- 172.21.15.50:0/339522056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 msgr2=0x7f4dd40c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/339522056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 0x7f4dd40c9b30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00d150 tx=0x7f4dcc00d460 comp rx=0 tx=0).stop 2024-09-13T15:07:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 -- 172.21.15.50:0/339522056 shutdown_connections 2024-09-13T15:07:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/339522056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40c9720 0x7f4dd40c9b30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/339522056 >> v2:172.21.15.181:3300/0 conn(0x7f4dd415cfd0 0x7f4dd4071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 -- 172.21.15.50:0/339522056 >> 172.21.15.50:0/339522056 conn(0x7f4dd40b0ca0 msgr2=0x7f4dd40b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 -- 172.21.15.50:0/339522056 shutdown_connections 2024-09-13T15:07:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.690+0000 7f4dd3e00700 1 -- 172.21.15.50:0/339522056 wait complete. 2024-09-13T15:07:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.694+0000 7f4dd3e00700 1 Processor -- start 2024-09-13T15:07:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.694+0000 7f4dd3e00700 1 -- start start 2024-09-13T15:07:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd40c9720 0x7f4dd4150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 0x7f4dd40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd415cfd0 0x7f4dd40ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd414e900 con 0x7f4dd40cd470 2024-09-13T15:07:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40ad9b0 con 0x7f4dd40c9720 2024-09-13T15:07:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd414dc00 con 0x7f4dd415cfd0 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 0x7f4dd40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd40c9720 0x7f4dd4150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 0x7f4dd40ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44508/0 (socket says 172.21.15.50:44508) 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd40c9720 0x7f4dd4150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:53008/0 (socket says 172.21.15.50:53008) 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd415cfd0 0x7f4dd40ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 -- 172.21.15.50:0/1329327586 learned_addr learned my addr 172.21.15.50:0/1329327586 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 -- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd415cfd0 msgr2=0x7f4dd40ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd415cfd0 0x7f4dd40ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 -- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd40c9720 msgr2=0x7f4dd4150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd40c9720 0x7f4dd4150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 -- 172.21.15.50:0/1329327586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc00bd40 con 0x7f4dd40cd470 2024-09-13T15:07:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3400700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd415cfd0 0x7f4dd40ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd2000700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 0x7f4dd40ca2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c530 tx=0x7f4dc000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00052d0 con 0x7f4dd40cd470 2024-09-13T15:07:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0005430 con 0x7f4dd40cd470 2024-09-13T15:07:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd4151020 con 0x7f4dd40cd470 2024-09-13T15:07:37.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00055a0 con 0x7f4dd40cd470 2024-09-13T15:07:37.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd414e240 con 0x7f4dd40cd470 2024-09-13T15:07:37.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd4067790 con 0x7f4dd40cd470 2024-09-13T15:07:37.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.702+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4dc00036a0 con 0x7f4dd40cd470 2024-09-13T15:07:37.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.706+0000 7f4dcaa00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db4066730 0x7f4db4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.706+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dc0083370 con 0x7f4dd40cd470 2024-09-13T15:07:37.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.706+0000 7f4dd2a00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db4066730 0x7f4db4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.706+0000 7f4dd2a00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db4066730 0x7f4db4068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009bf0 tx=0x7f4dc4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.710+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4dc00506d0 con 0x7f4dd40cd470 2024-09-13T15:07:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:37.918+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f4dd40707e0 con 0x7f4dd40cd470 2024-09-13T15:07:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.474+0000 7f4dcaa00700 1 -- 172.21.15.50:0/1329327586 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f4dc0053cf0 con 0x7f4dd40cd470 2024-09-13T15:07:38.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db4066730 msgr2=0x7f4db4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db4066730 0x7f4db4068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009bf0 tx=0x7f4dc4009240 comp rx=0 tx=0).stop 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 msgr2=0x7f4dd40ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 0x7f4dd40ca2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c530 tx=0x7f4dc000c840 comp rx=0 tx=0).stop 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 shutdown_connections 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db4066730 0x7f4db4068bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd415cfd0 0x7f4dd40ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd40cd470 0x7f4dd40ca2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 --2- 172.21.15.50:0/1329327586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd40c9720 0x7f4dd4150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 >> 172.21.15.50:0/1329327586 conn(0x7f4dd40b0ca0 msgr2=0x7f4dd415c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 shutdown_connections 2024-09-13T15:07:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.478+0000 7f4dd3e00700 1 -- 172.21.15.50:0/1329327586 wait complete. 2024-09-13T15:07:38.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:07:38.579 INFO:tasks.ceph.mds.b.smithi181.stderr:2024-09-13T15:07:38.571+0000 7f7b77c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:07:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.698+0000 7efee6800700 1 Processor -- start 2024-09-13T15:07:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.698+0000 7efee6800700 1 -- start start 2024-09-13T15:07:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee6800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efee015cbf0 0x7efee0072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee6800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee015e080 con 0x7efee00cfc20 2024-09-13T15:07:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee6800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00729b0 con 0x7efee015cbf0 2024-09-13T15:07:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee00d05d0 con 0x7efee015dc70 2024-09-13T15:07:38.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee4a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efee00cfc20 0x7efee015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43708/0 (socket says 172.21.15.50:43708) 2024-09-13T15:07:38.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee4a00700 1 -- 172.21.15.50:0/2063791120 learned_addr learned my addr 172.21.15.50:0/2063791120 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:38.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee5400700 1 --2- 172.21.15.50:0/2063791120 >> v2:172.21.15.181:3300/0 conn(0x7efee015cbf0 0x7efee0072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:38.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee5e00700 1 --2- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:38.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efedfe00700 1 -- 172.21.15.50:0/2063791120 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985993398 0 0) 0x7efee015e080 con 0x7efee00cfc20 2024-09-13T15:07:38.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efedfe00700 1 -- 172.21.15.50:0/2063791120 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec80035d0 con 0x7efee00cfc20 2024-09-13T15:07:38.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.702+0000 7efee5400700 1 -- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 msgr2=0x7efee00d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:38.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee5400700 1 --2- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee5400700 1 -- 172.21.15.50:0/2063791120 >> v1:172.21.15.50:6789/0 conn(0x7efee00cfc20 legacy=0x7efee015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:38.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee5400700 1 -- 172.21.15.50:0/2063791120 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00713d0 con 0x7efee015cbf0 2024-09-13T15:07:38.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee5400700 1 --2- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee015cbf0 0x7efee0072470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efed4009880 tx=0x7efed4009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5692b8981b15da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:38.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efedfe00700 1 -- 172.21.15.50:0/2063791120 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4011830 con 0x7efee015cbf0 2024-09-13T15:07:38.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efedfe00700 1 -- 172.21.15.50:0/2063791120 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed4011990 con 0x7efee015cbf0 2024-09-13T15:07:38.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efedfe00700 1 -- 172.21.15.50:0/2063791120 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4011d20 con 0x7efee015cbf0 2024-09-13T15:07:38.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 -- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee015cbf0 msgr2=0x7efee0072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:38.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 --2- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee015cbf0 0x7efee0072470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efed4009880 tx=0x7efed4009b90 comp rx=0 tx=0).stop 2024-09-13T15:07:38.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 -- 172.21.15.50:0/2063791120 shutdown_connections 2024-09-13T15:07:38.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 --2- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 --2- 172.21.15.50:0/2063791120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee015cbf0 0x7efee0072470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 -- 172.21.15.50:0/2063791120 >> 172.21.15.50:0/2063791120 conn(0x7efee006cbf0 msgr2=0x7efee006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:38.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 -- 172.21.15.50:0/2063791120 shutdown_connections 2024-09-13T15:07:38.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.706+0000 7efee6800700 1 -- 172.21.15.50:0/2063791120 wait complete. 2024-09-13T15:07:38.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 Processor -- start 2024-09-13T15:07:38.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 -- start start 2024-09-13T15:07:38.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee00cfc20 0x7efee00c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 0x7efee014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0158f60 con 0x7efee015cbf0 2024-09-13T15:07:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee015a5b0 con 0x7efee00cfc20 2024-09-13T15:07:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.710+0000 7efee6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee015a890 con 0x7efee015dc70 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 0x7efee014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee5400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee00cfc20 0x7efee00c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 0x7efee014d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44524/0 (socket says 172.21.15.50:44524) 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 -- 172.21.15.50:0/3291302471 learned_addr learned my addr 172.21.15.50:0/3291302471 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee5400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee00cfc20 0x7efee00c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:53040/0 (socket says 172.21.15.50:53040) 2024-09-13T15:07:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58358/0 (socket says 172.21.15.50:58358) 2024-09-13T15:07:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 -- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 msgr2=0x7efee00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 -- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee00cfc20 msgr2=0x7efee00c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee00cfc20 0x7efee00c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 -- 172.21.15.50:0/3291302471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40094b0 con 0x7efee015cbf0 2024-09-13T15:07:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee4a00700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 0x7efee014d340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c700 tx=0x7efecc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc005d90 con 0x7efee015cbf0 2024-09-13T15:07:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc0070d0 con 0x7efee015cbf0 2024-09-13T15:07:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee015ab70 con 0x7efee015cbf0 2024-09-13T15:07:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc007480 con 0x7efee015cbf0 2024-09-13T15:07:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.714+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee00c4db0 con 0x7efee015cbf0 2024-09-13T15:07:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.718+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0067d00 con 0x7efee015cbf0 2024-09-13T15:07:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.718+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efecc0075e0 con 0x7efee015cbf0 2024-09-13T15:07:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.718+0000 7efedd600700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efec0066730 0x7efec0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:38.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.722+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efecc0836c0 con 0x7efee015cbf0 2024-09-13T15:07:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.722+0000 7efee5400700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efec0066730 0x7efec0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.722+0000 7efee5400700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efec0066730 0x7efec0068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efed4000c00 tx=0x7efed4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:38.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.730+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efecc050940 con 0x7efee015cbf0 2024-09-13T15:07:38.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:38.910+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efee015cfd0 con 0x7efee015cbf0 2024-09-13T15:07:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.490+0000 7efedd600700 1 -- 172.21.15.50:0/3291302471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7efecc053f60 con 0x7efee015cbf0 2024-09-13T15:07:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efec0066730 msgr2=0x7efec0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efec0066730 0x7efec0068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efed4000c00 tx=0x7efed4008030 comp rx=0 tx=0).stop 2024-09-13T15:07:40.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 msgr2=0x7efee014d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 0x7efee014d340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c700 tx=0x7efecc00ca10 comp rx=0 tx=0).stop 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 shutdown_connections 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efec0066730 0x7efec0068bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efee015dc70 0x7efee00c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efee015cbf0 0x7efee014d340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 --2- 172.21.15.50:0/3291302471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efee00cfc20 0x7efee00c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 >> 172.21.15.50:0/3291302471 conn(0x7efee006cbf0 msgr2=0x7efee00af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:40.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.498+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 shutdown_connections 2024-09-13T15:07:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.502+0000 7efee6800700 1 -- 172.21.15.50:0/3291302471 wait complete. 2024-09-13T15:07:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2024-09-13T15:07:40.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T15:07:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.706+0000 7f3bd7e00700 1 Processor -- start 2024-09-13T15:07:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.706+0000 7f3bd7e00700 1 -- start start 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd7e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3bd815a9d0 0x7f3bd80afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd80b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd7e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd815adb0 con 0x7f3bd80b0000 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd7e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd80cd280 con 0x7f3bd815a9d0 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd7e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b4db0 con 0x7f3bd80b4400 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd6000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3bd80b0000 0x7f3bd80cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43716/0 (socket says 172.21.15.50:43716) 2024-09-13T15:07:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd6000700 1 -- 172.21.15.50:0/3777366240 learned_addr learned my addr 172.21.15.50:0/3777366240 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:40.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3777366240 >> v2:172.21.15.181:3300/0 conn(0x7f3bd815a9d0 0x7f3bd80afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:40.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.710+0000 7f3bd7400700 1 --2- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd80b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd5600700 1 -- 172.21.15.50:0/3777366240 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303027723 0 0) 0x7f3bd815adb0 con 0x7f3bd80b0000 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd5600700 1 -- 172.21.15.50:0/3777366240 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc0035d0 con 0x7f3bd80b0000 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd6a00700 1 -- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 msgr2=0x7f3bd80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd80b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd6a00700 1 -- 172.21.15.50:0/3777366240 >> v1:172.21.15.50:6789/0 conn(0x7f3bd80b0000 legacy=0x7f3bd80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd6a00700 1 -- 172.21.15.50:0/3777366240 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80ce850 con 0x7f3bd815a9d0 2024-09-13T15:07:40.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd815a9d0 0x7f3bd80afac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009850 tx=0x7f3bc8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f5430ab2340430d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd5600700 1 -- 172.21.15.50:0/3777366240 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8011830 con 0x7f3bd815a9d0 2024-09-13T15:07:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd5600700 1 -- 172.21.15.50:0/3777366240 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc8011990 con 0x7f3bd815a9d0 2024-09-13T15:07:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd5600700 1 -- 172.21.15.50:0/3777366240 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8011d40 con 0x7f3bd815a9d0 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd815a9d0 msgr2=0x7f3bd80afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd815a9d0 0x7f3bd80afac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009850 tx=0x7f3bc8009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3777366240 shutdown_connections 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd80b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3777366240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd815a9d0 0x7f3bd80afac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3777366240 >> 172.21.15.50:0/3777366240 conn(0x7f3bd8066270 msgr2=0x7f3bd8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3777366240 shutdown_connections 2024-09-13T15:07:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.714+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3777366240 wait complete. 2024-09-13T15:07:40.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 Processor -- start 2024-09-13T15:07:40.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 -- start start 2024-09-13T15:07:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd80b0000 0x7f3bd80aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd8157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 0x7f3bd81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8153f10 con 0x7f3bd815a9d0 2024-09-13T15:07:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8157df0 con 0x7f3bd80b0000 2024-09-13T15:07:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.718+0000 7f3bd7e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8153390 con 0x7f3bd80b4400 2024-09-13T15:07:40.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 0x7f3bd81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 0x7f3bd81578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44540/0 (socket says 172.21.15.50:44540) 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 -- 172.21.15.50:0/3343686258 learned_addr learned my addr 172.21.15.50:0/3343686258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd80b0000 0x7f3bd80aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd6000700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 -- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 msgr2=0x7f3bd8157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd8157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 -- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd80b0000 msgr2=0x7f3bd80aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:40.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd80b0000 0x7f3bd80aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:40.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 -- 172.21.15.50:0/3343686258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80094b0 con 0x7f3bd815a9d0 2024-09-13T15:07:40.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd80b0000 0x7f3bd80aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7400700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 0x7f3bd81578b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000efc0 tx=0x7f3bd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0009ea0 con 0x7f3bd815a9d0 2024-09-13T15:07:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd000f040 con 0x7f3bd815a9d0 2024-09-13T15:07:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000ced0 con 0x7f3bd815a9d0 2024-09-13T15:07:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd8153670 con 0x7f3bd815a9d0 2024-09-13T15:07:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd8153c30 con 0x7f3bd815a9d0 2024-09-13T15:07:40.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.722+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd80b4870 con 0x7f3bd815a9d0 2024-09-13T15:07:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.726+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3bd0014480 con 0x7f3bd815a9d0 2024-09-13T15:07:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.726+0000 7f3bcea00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bb8066730 0x7f3bb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.730+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3bd0084d20 con 0x7f3bd815a9d0 2024-09-13T15:07:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.730+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bb8066730 0x7f3bb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:40.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.730+0000 7f3bd6a00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bb8066730 0x7f3bb8068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80090b0 tx=0x7f3bc801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.734+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3bd0051ca0 con 0x7f3bd815a9d0 2024-09-13T15:07:40.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:40.918+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3bd80cf7a0 con 0x7f3bd815a9d0 2024-09-13T15:07:41.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.498+0000 7f3bcea00700 1 -- 172.21.15.50:0/3343686258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3bd00180c0 con 0x7f3bd815a9d0 2024-09-13T15:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.506+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bb8066730 msgr2=0x7f3bb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.506+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bb8066730 0x7f3bb8068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80090b0 tx=0x7f3bc801c040 comp rx=0 tx=0).stop 2024-09-13T15:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.506+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 msgr2=0x7f3bd81578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.506+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 0x7f3bd81578b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000efc0 tx=0x7f3bd000c3a0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.510+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 shutdown_connections 2024-09-13T15:07:41.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.510+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3bb8066730 0x7f3bb8068bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.510+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bd815a9d0 0x7f3bd81578b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.510+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3bd80b4400 0x7f3bd8157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.510+0000 7f3bd7e00700 1 --2- 172.21.15.50:0/3343686258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bd80b0000 0x7f3bd80aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.510+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 >> 172.21.15.50:0/3343686258 conn(0x7f3bd8066270 msgr2=0x7f3bd806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:41.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.518+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 shutdown_connections 2024-09-13T15:07:41.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.518+0000 7f3bd7e00700 1 -- 172.21.15.50:0/3343686258 wait complete. 2024-09-13T15:07:41.530 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T15:07:41.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T15:07:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.726+0000 7fed3a200700 1 Processor -- start 2024-09-13T15:07:41.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.726+0000 7fed3a200700 1 -- start start 2024-09-13T15:07:41.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed3a200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed3406d760 0x7fed340b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed3a200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed34144710 0x7fed340b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed3a200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3406bcf0 con 0x7fed34144330 2024-09-13T15:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed3a200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed340cce10 con 0x7fed34144710 2024-09-13T15:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed3a200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3406cb50 con 0x7fed3406d760 2024-09-13T15:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed33400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed34144330 0x7fed340cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43726/0 (socket says 172.21.15.50:43726) 2024-09-13T15:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed33400700 1 -- 172.21.15.50:0/2127507234 learned_addr learned my addr 172.21.15.50:0/2127507234 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed33e00700 1 --2- 172.21.15.50:0/2127507234 >> v2:172.21.15.181:3300/0 conn(0x7fed34144710 0x7fed340b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed2be00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed3406d760 0x7fed340b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673399503 0 0) 0x7fed3406bcf0 con 0x7fed34144330 2024-09-13T15:07:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed180035d0 con 0x7fed34144330 2024-09-13T15:07:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1756653754 0 0) 0x7fed180035d0 con 0x7fed34144330 2024-09-13T15:07:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed3406d760 msgr2=0x7fed340b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed3406d760 0x7fed340b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 >> v2:172.21.15.181:3300/0 conn(0x7fed34144710 msgr2=0x7fed340b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 --2- 172.21.15.50:0/2127507234 >> v2:172.21.15.181:3300/0 conn(0x7fed34144710 0x7fed340b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3406bf40 con 0x7fed34144330 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fed24001670 con 0x7fed34144330 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed33e00700 1 --2- 172.21.15.50:0/2127507234 >> v2:172.21.15.181:3300/0 conn(0x7fed34144710 0x7fed340b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 >> v1:172.21.15.50:6789/0 conn(0x7fed34144330 legacy=0x7fed340cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed18003a20 0x7fed18003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004410 0x7fed180048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed18004f60 0x7fed1800fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.730+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340cce10 con 0x7fed18004f60 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3406cb50 con 0x7fed18004410 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed18010380 con 0x7fed18003a20 2024-09-13T15:07:41.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed2be00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed3406d760 0x7fed340b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:41.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed18004f60 0x7fed1800fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33400700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed18003a20 0x7fed18003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed2be00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004410 0x7fed180048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 -- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed18003a20 msgr2=0x7fed18003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed18003a20 0x7fed18003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 -- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004410 msgr2=0x7fed180048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004410 0x7fed180048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 -- 172.21.15.50:0/2127507234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180035d0 con 0x7fed18004f60 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed18004f60 0x7fed1800fe40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e350 tx=0x7fed180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f94c18e600d9964 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00edf0 con 0x7fed18004f60 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c00f040 con 0x7fed18004f60 2024-09-13T15:07:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed32a00700 1 -- 172.21.15.50:0/2127507234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0146a0 con 0x7fed18004f60 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed3a200700 1 -- 172.21.15.50:0/2127507234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed18004f60 msgr2=0x7fed1800fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed3a200700 1 --2- 172.21.15.50:0/2127507234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed18004f60 0x7fed1800fe40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e350 tx=0x7fed180058a0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed33e00700 1 -- 172.21.15.50:0/2127507234 reap_dead start 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed3a200700 1 -- 172.21.15.50:0/2127507234 shutdown_connections 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed3a200700 1 -- 172.21.15.50:0/2127507234 >> 172.21.15.50:0/2127507234 conn(0x7fed3406a570 msgr2=0x7fed3406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed3a200700 1 -- 172.21.15.50:0/2127507234 shutdown_connections 2024-09-13T15:07:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.734+0000 7fed3a200700 1 -- 172.21.15.50:0/2127507234 wait complete. 2024-09-13T15:07:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 Processor -- start 2024-09-13T15:07:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 -- start start 2024-09-13T15:07:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004f60 0x7fed341f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed34151560 0x7fed34135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 0x7fed340aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34136960 con 0x7fed341364e0 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34070780 con 0x7fed18004f60 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.738+0000 7fed3a200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed34070a20 con 0x7fed34151560 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 0x7fed340aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 0x7fed340aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44564/0 (socket says 172.21.15.50:44564) 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 -- 172.21.15.50:0/1041963397 learned_addr learned my addr 172.21.15.50:0/1041963397 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed2be00700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed34151560 0x7fed34135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33400700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004f60 0x7fed341f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 -- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed34151560 msgr2=0x7fed34135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed34151560 0x7fed34135fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 -- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004f60 msgr2=0x7fed341f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004f60 0x7fed341f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 -- 172.21.15.50:0/1041963397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340ae6c0 con 0x7fed341364e0 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed33e00700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 0x7fed340aebc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed2c017040 tx=0x7fed2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c007000 con 0x7fed341364e0 2024-09-13T15:07:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c003e50 con 0x7fed341364e0 2024-09-13T15:07:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c014c40 con 0x7fed341364e0 2024-09-13T15:07:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed341401c0 con 0x7fed341364e0 2024-09-13T15:07:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed341f1d40 con 0x7fed341364e0 2024-09-13T15:07:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.742+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed340cef70 con 0x7fed341364e0 2024-09-13T15:07:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.746+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed2c024020 con 0x7fed341364e0 2024-09-13T15:07:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.746+0000 7fed2b400700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fed10066760 0x7fed10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.746+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fed2c085a80 con 0x7fed341364e0 2024-09-13T15:07:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.746+0000 7fed33400700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fed10066760 0x7fed10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.750+0000 7fed33400700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fed10066760 0x7fed10068c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed24000c00 tx=0x7fed240079a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.754+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed2c052c30 con 0x7fed341364e0 2024-09-13T15:07:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.978+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fed3406ae40 con 0x7fed341364e0 2024-09-13T15:07:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.990+0000 7fed2b400700 1 -- 172.21.15.50:0/1041963397 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fed2c02c020 con 0x7fed341364e0 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fed10066760 msgr2=0x7fed10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fed10066760 0x7fed10068c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed24000c00 tx=0x7fed240079a0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 msgr2=0x7fed340aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 0x7fed340aebc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed2c017040 tx=0x7fed2c009750 comp rx=0 tx=0).stop 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 shutdown_connections 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fed10066760 0x7fed10068c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed341364e0 0x7fed340aebc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed34151560 0x7fed34135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 --2- 172.21.15.50:0/1041963397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed18004f60 0x7fed341f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:41.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 >> 172.21.15.50:0/1041963397 conn(0x7fed3406a570 msgr2=0x7fed341373a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:41.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 shutdown_connections 2024-09-13T15:07:41.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:41.994+0000 7fed3a200700 1 -- 172.21.15.50:0/1041963397 wait complete. 2024-09-13T15:07:41.997 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 4 to fsmap 2024-09-13T15:07:42.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:42.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.186+0000 7efc22600700 1 Processor -- start 2024-09-13T15:07:42.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.186+0000 7efc22600700 1 -- start start 2024-09-13T15:07:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc1c06aaa0 0x7efc1c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c0b2670 0x7efc1c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0b3040 con 0x7efc1c1610b0 2024-09-13T15:07:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c070b30 con 0x7efc1c06aaa0 2024-09-13T15:07:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c06b450 con 0x7efc1c0b2670 2024-09-13T15:07:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc1c06aaa0 0x7efc1c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc1c06aaa0 0x7efc1c06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44566/0 (socket says 172.21.15.50:44566) 2024-09-13T15:07:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 -- 172.21.15.50:0/1731699238 learned_addr learned my addr 172.21.15.50:0/1731699238 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc21c00700 1 --2- 172.21.15.50:0/1731699238 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c0b2670 0x7efc1c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 -- 172.21.15.50:0/1731699238 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c0b2670 msgr2=0x7efc1c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:42.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 --2- 172.21.15.50:0/1731699238 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c0b2670 0x7efc1c0b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 -- 172.21.15.50:0/1731699238 >> v1:172.21.15.50:6789/0 conn(0x7efc1c1610b0 legacy=0x7efc1c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 -- 172.21.15.50:0/1731699238 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0b3560 con 0x7efc1c06aaa0 2024-09-13T15:07:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1be00700 1 --2- 172.21.15.50:0/1731699238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c06af10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc08009940 tx=0x7efc08009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc9d572d093f796 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1b400700 1 -- 172.21.15.50:0/1731699238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08011830 con 0x7efc1c06aaa0 2024-09-13T15:07:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1b400700 1 -- 172.21.15.50:0/1731699238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08011990 con 0x7efc1c06aaa0 2024-09-13T15:07:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc1b400700 1 -- 172.21.15.50:0/1731699238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08011d20 con 0x7efc1c06aaa0 2024-09-13T15:07:42.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 -- 172.21.15.50:0/1731699238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 msgr2=0x7efc1c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.190+0000 7efc22600700 1 --2- 172.21.15.50:0/1731699238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c06af10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc08009940 tx=0x7efc08009c50 comp rx=0 tx=0).stop 2024-09-13T15:07:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 -- 172.21.15.50:0/1731699238 shutdown_connections 2024-09-13T15:07:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 --2- 172.21.15.50:0/1731699238 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c0b2670 0x7efc1c0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 --2- 172.21.15.50:0/1731699238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c06af10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 -- 172.21.15.50:0/1731699238 >> 172.21.15.50:0/1731699238 conn(0x7efc1c0b0c40 msgr2=0x7efc1c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 -- 172.21.15.50:0/1731699238 shutdown_connections 2024-09-13T15:07:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 -- 172.21.15.50:0/1731699238 wait complete. 2024-09-13T15:07:42.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 Processor -- start 2024-09-13T15:07:42.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.194+0000 7efc22600700 1 -- start start 2024-09-13T15:07:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1c0b2670 0x7efc1c0acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c1610b0 0x7efc1c162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c150fc0 con 0x7efc1c06aaa0 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0ad090 con 0x7efc1c0b2670 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1f6db0 con 0x7efc1c1610b0 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44578/0 (socket says 172.21.15.50:44578) 2024-09-13T15:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 -- 172.21.15.50:0/3134718005 learned_addr learned my addr 172.21.15.50:0/3134718005 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21c00700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c1610b0 0x7efc1c162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc1be00700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1c0b2670 0x7efc1c0acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 -- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c1610b0 msgr2=0x7efc1c162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c1610b0 0x7efc1c162fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 -- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1c0b2670 msgr2=0x7efc1c0acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1c0b2670 0x7efc1c0acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 -- 172.21.15.50:0/3134718005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009570 con 0x7efc1c06aaa0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc21200700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c150a80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c500 tx=0x7efc1000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100052d0 con 0x7efc1c06aaa0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10005430 con 0x7efc1c06aaa0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100055a0 con 0x7efc1c06aaa0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c1f7090 con 0x7efc1c06aaa0 2024-09-13T15:07:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.198+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c1f7650 con 0x7efc1c06aaa0 2024-09-13T15:07:42.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.202+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c15e370 con 0x7efc1c06aaa0 2024-09-13T15:07:42.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.202+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc100038e0 con 0x7efc1c06aaa0 2024-09-13T15:07:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.206+0000 7efc18c00700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbfc066730 0x7efbfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.206+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc10083730 con 0x7efc1c06aaa0 2024-09-13T15:07:42.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.206+0000 7efc1be00700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbfc066730 0x7efbfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.206+0000 7efc1be00700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbfc066730 0x7efbfc068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc08009910 tx=0x7efc08008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:42.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.214+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc100507a0 con 0x7efc1c06aaa0 2024-09-13T15:07:42.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.446+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc1c0b3040 con 0x7efc1c06aaa0 2024-09-13T15:07:42.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.446+0000 7efc18c00700 1 -- 172.21.15.50:0/3134718005 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4727 (secure 0 0 0) 0x7efc1c0b3040 con 0x7efc1c06aaa0 2024-09-13T15:07:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:42.449 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:07:41.982118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T15:07:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbfc066730 msgr2=0x7efbfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbfc066730 0x7efbfc068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc08009910 tx=0x7efc08008030 comp rx=0 tx=0).stop 2024-09-13T15:07:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 msgr2=0x7efc1c150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c150a80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c500 tx=0x7efc1000c8c0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 shutdown_connections 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbfc066730 0x7efbfc068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc1c1610b0 0x7efc1c162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1c0b2670 0x7efc1c0acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 --2- 172.21.15.50:0/3134718005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc1c06aaa0 0x7efc1c150a80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 >> 172.21.15.50:0/3134718005 conn(0x7efc1c0b0c40 msgr2=0x7efc1c15f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 shutdown_connections 2024-09-13T15:07:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.450+0000 7efc22600700 1 -- 172.21.15.50:0/3134718005 wait complete. 2024-09-13T15:07:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-13T15:07:42.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.642+0000 7f26bf000700 1 Processor -- start 2024-09-13T15:07:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.642+0000 7f26bf000700 1 -- start start 2024-09-13T15:07:42.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bf000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f26b80cc6f0 0x7f26b815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bf000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b806aaa0 0x7f26b806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bf000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80ccb40 con 0x7f26b80cb020 2024-09-13T15:07:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bf000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b806b430 con 0x7f26b80cc6f0 2024-09-13T15:07:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bf000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80b2ad0 con 0x7f26b806aaa0 2024-09-13T15:07:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26be600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b806aaa0 0x7f26b806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f26b80cc6f0 0x7f26b815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f26b80cc6f0 0x7f26b815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:53108/0 (socket says 172.21.15.50:53108) 2024-09-13T15:07:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26be600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b806aaa0 0x7f26b806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58426/0 (socket says 172.21.15.50:58426) 2024-09-13T15:07:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 -- 172.21.15.50:0/2082297206 learned_addr learned my addr 172.21.15.50:0/2082297206 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 -- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b806aaa0 msgr2=0x7f26b806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 --2- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b806aaa0 0x7f26b806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 -- 172.21.15.50:0/2082297206 >> v1:172.21.15.181:6789/0 conn(0x7f26b80cb020 legacy=0x7f26b815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 -- 172.21.15.50:0/2082297206 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b815b960 con 0x7f26b80cc6f0 2024-09-13T15:07:42.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26bd200700 1 --2- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cc6f0 0x7f26b815b0e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009910 tx=0x7f26a4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1423c91ca2420e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:42.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26b7e00700 1 -- 172.21.15.50:0/2082297206 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4011830 con 0x7f26b80cc6f0 2024-09-13T15:07:42.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26b7e00700 1 -- 172.21.15.50:0/2082297206 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4011990 con 0x7f26b80cc6f0 2024-09-13T15:07:42.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.646+0000 7f26b7e00700 1 -- 172.21.15.50:0/2082297206 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4011d40 con 0x7f26b80cc6f0 2024-09-13T15:07:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 -- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cc6f0 msgr2=0x7f26b815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 --2- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cc6f0 0x7f26b815b0e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009910 tx=0x7f26a4009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:42.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 -- 172.21.15.50:0/2082297206 shutdown_connections 2024-09-13T15:07:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 --2- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b806aaa0 0x7f26b806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 --2- 172.21.15.50:0/2082297206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cc6f0 0x7f26b815b0e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 -- 172.21.15.50:0/2082297206 >> 172.21.15.50:0/2082297206 conn(0x7f26b80b0c40 msgr2=0x7f26b806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 -- 172.21.15.50:0/2082297206 shutdown_connections 2024-09-13T15:07:42.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.650+0000 7f26bf000700 1 -- 172.21.15.50:0/2082297206 wait complete. 2024-09-13T15:07:42.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 Processor -- start 2024-09-13T15:07:42.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 -- start start 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 0x7f26b8142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cb020 0x7f26b8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b80cc6f0 0x7f26b81541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8156280 con 0x7f26b806aaa0 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81426c0 con 0x7f26b80cb020 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bf000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81558e0 con 0x7f26b80cc6f0 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 0x7f26b8142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 0x7f26b8142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44580/0 (socket says 172.21.15.50:44580) 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 -- 172.21.15.50:0/4249078822 learned_addr learned my addr 172.21.15.50:0/4249078822 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:42.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26be600700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b80cc6f0 0x7f26b81541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bd200700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cb020 0x7f26b8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 -- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b80cc6f0 msgr2=0x7f26b81541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b80cc6f0 0x7f26b81541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 -- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cb020 msgr2=0x7f26b8153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cb020 0x7f26b8153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 -- 172.21.15.50:0/4249078822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4009570 con 0x7f26b806aaa0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26bdc00700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 0x7f26b8142180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c530 tx=0x7f26ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.654+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0052d0 con 0x7f26b806aaa0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.658+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac005430 con 0x7f26b806aaa0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.658+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b8155bc0 con 0x7f26b806aaa0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.658+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0055a0 con 0x7f26b806aaa0 2024-09-13T15:07:42.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.658+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b81429a0 con 0x7f26b806aaa0 2024-09-13T15:07:42.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.658+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b80cb400 con 0x7f26b806aaa0 2024-09-13T15:07:42.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.658+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26ac0038e0 con 0x7f26b806aaa0 2024-09-13T15:07:42.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.662+0000 7f26b5600700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2698066730 0x7f2698068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:42.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.662+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26ac083910 con 0x7f26b806aaa0 2024-09-13T15:07:42.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.662+0000 7f26bd200700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2698066730 0x7f2698068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:42.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.662+0000 7f26bd200700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2698066730 0x7f2698068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26a4000c00 tx=0x7f26a4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:42.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.670+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26ac050870 con 0x7f26b806aaa0 2024-09-13T15:07:42.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.866+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26b806be50 con 0x7f26b806aaa0 2024-09-13T15:07:42.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.870+0000 7f26b5600700 1 -- 172.21.15.50:0/4249078822 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f26ac053e90 con 0x7f26b806aaa0 2024-09-13T15:07:42.872 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:42.872 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:42.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.870+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2698066730 msgr2=0x7f2698068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.870+0000 7f26bf000700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2698066730 0x7f2698068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26a4000c00 tx=0x7f26a4008030 comp rx=0 tx=0).stop 2024-09-13T15:07:42.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.870+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 msgr2=0x7f26b8142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.870+0000 7f26bf000700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 0x7f26b8142180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c530 tx=0x7f26ac00c840 comp rx=0 tx=0).stop 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 shutdown_connections 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2698066730 0x7f2698068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f26b80cc6f0 0x7f26b81541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26b80cb020 0x7f26b8153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 --2- 172.21.15.50:0/4249078822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b806aaa0 0x7f26b8142180 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 >> 172.21.15.50:0/4249078822 conn(0x7f26b80b0c40 msgr2=0x7f26b80b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 shutdown_connections 2024-09-13T15:07:42.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:42.874+0000 7f26bf000700 1 -- 172.21.15.50:0/4249078822 wait complete. 2024-09-13T15:07:42.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:43.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.070+0000 7f0e93e00700 1 Processor -- start 2024-09-13T15:07:43.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.070+0000 7f0e93e00700 1 -- start start 2024-09-13T15:07:43.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e93e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e9406b4d0 0x7f0e9406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e93e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e9415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e93e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9406a430 con 0x7f0e94143d60 2024-09-13T15:07:43.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e93e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9406a710 con 0x7f0e9406b4d0 2024-09-13T15:07:43.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e93e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9406a9f0 con 0x7f0e9415b0e0 2024-09-13T15:07:43.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e9406b4d0 0x7f0e9406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e94143d60 0x7f0e940cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50174/0 (socket says 172.21.15.50:50174) 2024-09-13T15:07:43.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92a00700 1 -- 172.21.15.50:0/832931783 learned_addr learned my addr 172.21.15.50:0/832931783 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:43.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e93400700 1 --2- 172.21.15.50:0/832931783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e9415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e91600700 1 -- 172.21.15.50:0/832931783 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41097100 0 0) 0x7f0e9406a430 con 0x7f0e94143d60 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e91600700 1 -- 172.21.15.50:0/832931783 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e780035d0 con 0x7f0e94143d60 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92000700 1 -- 172.21.15.50:0/832931783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 msgr2=0x7f0e9415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92000700 1 --2- 172.21.15.50:0/832931783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e9415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92000700 1 -- 172.21.15.50:0/832931783 >> v1:172.21.15.50:6789/0 conn(0x7f0e94143d60 legacy=0x7f0e940cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.074+0000 7f0e92000700 1 -- 172.21.15.50:0/832931783 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9406acd0 con 0x7f0e9406b4d0 2024-09-13T15:07:43.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e92000700 1 --2- 172.21.15.50:0/832931783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e9406b4d0 0x7f0e9406b910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009850 tx=0x7f0e80009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c40fdfaacc2a341 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e91600700 1 -- 172.21.15.50:0/832931783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80011830 con 0x7f0e9406b4d0 2024-09-13T15:07:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e91600700 1 -- 172.21.15.50:0/832931783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80011990 con 0x7f0e9406b4d0 2024-09-13T15:07:43.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e91600700 1 -- 172.21.15.50:0/832931783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80011d40 con 0x7f0e9406b4d0 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 -- 172.21.15.50:0/832931783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e9406b4d0 msgr2=0x7f0e9406b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 --2- 172.21.15.50:0/832931783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e9406b4d0 0x7f0e9406b910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009850 tx=0x7f0e80009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 -- 172.21.15.50:0/832931783 shutdown_connections 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 --2- 172.21.15.50:0/832931783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e9415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 --2- 172.21.15.50:0/832931783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e9406b4d0 0x7f0e9406b910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 -- 172.21.15.50:0/832931783 >> 172.21.15.50:0/832931783 conn(0x7f0e9406ca10 msgr2=0x7f0e9406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:43.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 -- 172.21.15.50:0/832931783 shutdown_connections 2024-09-13T15:07:43.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.078+0000 7f0e93e00700 1 -- 172.21.15.50:0/832931783 wait complete. 2024-09-13T15:07:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 Processor -- start 2024-09-13T15:07:43.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 -- start start 2024-09-13T15:07:43.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e9406b4d0 0x7f0e94138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 0x7f0e9413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e94158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9413ca90 con 0x7f0e94143d60 2024-09-13T15:07:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94159240 con 0x7f0e9406b4d0 2024-09-13T15:07:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940b1d50 con 0x7f0e9415b0e0 2024-09-13T15:07:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e92000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 0x7f0e9413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e92000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 0x7f0e9413ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39384/0 (socket says 172.21.15.50:39384) 2024-09-13T15:07:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e92000700 1 -- 172.21.15.50:0/3707773471 learned_addr learned my addr 172.21.15.50:0/3707773471 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e92a00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e9406b4d0 0x7f0e94138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.082+0000 7f0e93400700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e94158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92000700 1 -- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 msgr2=0x7f0e94158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92000700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e94158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92000700 1 -- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e9406b4d0 msgr2=0x7f0e94138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92000700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e9406b4d0 0x7f0e94138010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92000700 1 -- 172.21.15.50:0/3707773471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800094b0 con 0x7f0e94143d60 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92a00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e9406b4d0 0x7f0e94138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:43.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e92000700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 0x7f0e9413ab50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e80014040 tx=0x7f0e80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80004590 con 0x7f0e94143d60 2024-09-13T15:07:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8001e070 con 0x7f0e94143d60 2024-09-13T15:07:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80003900 con 0x7f0e94143d60 2024-09-13T15:07:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9413cd10 con 0x7f0e94143d60 2024-09-13T15:07:43.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9413d2d0 con 0x7f0e94143d60 2024-09-13T15:07:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.086+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9406b910 con 0x7f0e94143d60 2024-09-13T15:07:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.090+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e80003a60 con 0x7f0e94143d60 2024-09-13T15:07:43.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.090+0000 7f0e8aa00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e74066730 0x7f0e74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.090+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e80020070 con 0x7f0e94143d60 2024-09-13T15:07:43.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.090+0000 7f0e92a00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e74066730 0x7f0e74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.094+0000 7f0e92a00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e74066730 0x7f0e74068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e840011e0 tx=0x7f0e84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.098+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e800528b0 con 0x7f0e94143d60 2024-09-13T15:07:43.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.290+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e940af3a0 con 0x7f0e94143d60 2024-09-13T15:07:43.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.290+0000 7f0e8aa00700 1 -- 172.21.15.50:0/3707773471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f0e80006ce0 con 0x7f0e94143d60 2024-09-13T15:07:43.294 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:43.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e74066730 msgr2=0x7f0e74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e74066730 0x7f0e74068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e840011e0 tx=0x7f0e84009040 comp rx=0 tx=0).stop 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 msgr2=0x7f0e9413ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 0x7f0e9413ab50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e80014040 tx=0x7f0e80004770 comp rx=0 tx=0).stop 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 shutdown_connections 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e74066730 0x7f0e74068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e9415b0e0 0x7f0e94158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e94143d60 0x7f0e9413ab50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 --2- 172.21.15.50:0/3707773471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e9406b4d0 0x7f0e94138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 >> 172.21.15.50:0/3707773471 conn(0x7f0e9406ca10 msgr2=0x7f0e9415b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 shutdown_connections 2024-09-13T15:07:43.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.298+0000 7f0e93e00700 1 -- 172.21.15.50:0/3707773471 wait complete. 2024-09-13T15:07:43.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.522+0000 7fb928e00700 1 Processor -- start 2024-09-13T15:07:43.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.522+0000 7fb928e00700 1 -- start start 2024-09-13T15:07:43.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.522+0000 7fb928e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9240cb200 0x7fb9240ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.522+0000 7fb928e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb924071150 con 0x7fb9240ccfd0 2024-09-13T15:07:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.522+0000 7fb928e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9240cd540 con 0x7fb92406e0a0 2024-09-13T15:07:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.522+0000 7fb928e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9240ceb20 con 0x7fb9240cb200 2024-09-13T15:07:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb922a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb9240ccfd0 0x7fb92406d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50184/0 (socket says 172.21.15.50:50184) 2024-09-13T15:07:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb922a00700 1 -- 172.21.15.50:0/2879159673 learned_addr learned my addr 172.21.15.50:0/2879159673 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb923400700 1 --2- 172.21.15.50:0/2879159673 >> v2:172.21.15.50:3300/0 conn(0x7fb9240cb200 0x7fb9240ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb923400700 1 -- 172.21.15.50:0/2879159673 >> v1:172.21.15.181:6789/0 conn(0x7fb92406e0a0 legacy=0x7fb9240704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb923400700 1 -- 172.21.15.50:0/2879159673 >> v1:172.21.15.50:6789/0 conn(0x7fb9240ccfd0 legacy=0x7fb92406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb923400700 1 -- 172.21.15.50:0/2879159673 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240cd820 con 0x7fb9240cb200 2024-09-13T15:07:43.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb923400700 1 --2- 172.21.15.50:0/2879159673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240cb200 0x7fb9240ce5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb914009850 tx=0x7fb914009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adba8d1eae30260 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb922000700 1 -- 172.21.15.50:0/2879159673 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011830 con 0x7fb9240cb200 2024-09-13T15:07:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb922000700 1 -- 172.21.15.50:0/2879159673 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914011990 con 0x7fb9240cb200 2024-09-13T15:07:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb922000700 1 -- 172.21.15.50:0/2879159673 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011d20 con 0x7fb9240cb200 2024-09-13T15:07:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb928e00700 1 -- 172.21.15.50:0/2879159673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240cb200 msgr2=0x7fb9240ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.526+0000 7fb928e00700 1 --2- 172.21.15.50:0/2879159673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240cb200 0x7fb9240ce5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb914009850 tx=0x7fb914009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 -- 172.21.15.50:0/2879159673 shutdown_connections 2024-09-13T15:07:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 --2- 172.21.15.50:0/2879159673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240cb200 0x7fb9240ce5e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 -- 172.21.15.50:0/2879159673 >> 172.21.15.50:0/2879159673 conn(0x7fb9240cf0d0 msgr2=0x7fb9240cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 -- 172.21.15.50:0/2879159673 shutdown_connections 2024-09-13T15:07:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 -- 172.21.15.50:0/2879159673 wait complete. 2024-09-13T15:07:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 Processor -- start 2024-09-13T15:07:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.530+0000 7fb928e00700 1 -- start start 2024-09-13T15:07:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb92406e0a0 0x7fb924099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9240cb200 0x7fb92415c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 0x7fb92409bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92409c9c0 con 0x7fb9240ccfd0 2024-09-13T15:07:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92409a0b0 con 0x7fb9240cb200 2024-09-13T15:07:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92409a390 con 0x7fb92406e0a0 2024-09-13T15:07:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 0x7fb92409bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 0x7fb92409bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39402/0 (socket says 172.21.15.50:39402) 2024-09-13T15:07:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 -- 172.21.15.50:0/2841698404 learned_addr learned my addr 172.21.15.50:0/2841698404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923400700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb92406e0a0 0x7fb924099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb922a00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9240cb200 0x7fb92415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 -- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb92406e0a0 msgr2=0x7fb924099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb92406e0a0 0x7fb924099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 -- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9240cb200 msgr2=0x7fb92415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9240cb200 0x7fb92415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 -- 172.21.15.50:0/2841698404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140094b0 con 0x7fb9240ccfd0 2024-09-13T15:07:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb923e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 0x7fb92409bc70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00cb10 tx=0x7fb91c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c003c20 con 0x7fb9240ccfd0 2024-09-13T15:07:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c003d80 con 0x7fb9240ccfd0 2024-09-13T15:07:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92409a670 con 0x7fb9240ccfd0 2024-09-13T15:07:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00a9e0 con 0x7fb9240ccfd0 2024-09-13T15:07:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.534+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92409ac30 con 0x7fb9240ccfd0 2024-09-13T15:07:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.538+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9240cb5e0 con 0x7fb9240ccfd0 2024-09-13T15:07:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.538+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb91c00ab40 con 0x7fb9240ccfd0 2024-09-13T15:07:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.538+0000 7fb91b400700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb904066730 0x7fb904068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.538+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb91c0842e0 con 0x7fb9240ccfd0 2024-09-13T15:07:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.538+0000 7fb923400700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb904066730 0x7fb904068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.542+0000 7fb923400700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb904066730 0x7fb904068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb914014040 tx=0x7fb91401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.546+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb91c051370 con 0x7fb9240ccfd0 2024-09-13T15:07:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.774+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb92415c940 con 0x7fb9240ccfd0 2024-09-13T15:07:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb91b400700 1 -- 172.21.15.50:0/2841698404 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4727 (secure 0 0 0) 0x7fb91c054990 con 0x7fb9240ccfd0 2024-09-13T15:07:43.779 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:43.779 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:07:41.982118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb904066730 msgr2=0x7fb904068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb904066730 0x7fb904068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb914014040 tx=0x7fb91401c040 comp rx=0 tx=0).stop 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 msgr2=0x7fb92409bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 0x7fb92409bc70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00cb10 tx=0x7fb91c00ce20 comp rx=0 tx=0).stop 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 shutdown_connections 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb904066730 0x7fb904068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9240ccfd0 0x7fb92409bc70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9240cb200 0x7fb92415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 --2- 172.21.15.50:0/2841698404 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb92406e0a0 0x7fb924099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 >> 172.21.15.50:0/2841698404 conn(0x7fb9240cf0d0 msgr2=0x7fb9240b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 shutdown_connections 2024-09-13T15:07:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.778+0000 7fb928e00700 1 -- 172.21.15.50:0/2841698404 wait complete. 2024-09-13T15:07:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-13T15:07:43.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 Processor -- start 2024-09-13T15:07:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 -- start start 2024-09-13T15:07:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40e00cb020 0x7f40e00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e006aaa0 0x7f40e006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e006b430 con 0x7f40e015c2a0 2024-09-13T15:07:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00b2ad0 con 0x7f40e00cb020 2024-09-13T15:07:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40df200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e015b960 con 0x7f40e006aaa0 2024-09-13T15:07:43.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40d5400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f40e015c2a0 0x7f40e015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:34264/0 (socket says 172.21.15.50:34264) 2024-09-13T15:07:43.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40d5400700 1 -- 172.21.15.50:0/2983815698 learned_addr learned my addr 172.21.15.50:0/2983815698 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:43.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40de800700 1 --2- 172.21.15.50:0/2983815698 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e006aaa0 0x7f40e006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40dde00700 1 --2- 172.21.15.50:0/2983815698 >> v2:172.21.15.181:3300/0 conn(0x7f40e00cb020 0x7f40e00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40dd400700 1 -- 172.21.15.50:0/2983815698 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141306644 0 0) 0x7f40c8001110 con 0x7f40e015c2a0 2024-09-13T15:07:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40dd400700 1 -- 172.21.15.50:0/2983815698 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40c40035d0 con 0x7f40e015c2a0 2024-09-13T15:07:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40de800700 1 -- 172.21.15.50:0/2983815698 >> v2:172.21.15.181:3300/0 conn(0x7f40e00cb020 msgr2=0x7f40e00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40de800700 1 --2- 172.21.15.50:0/2983815698 >> v2:172.21.15.181:3300/0 conn(0x7f40e00cb020 0x7f40e00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40de800700 1 -- 172.21.15.50:0/2983815698 >> v1:172.21.15.181:6789/0 conn(0x7f40e015c2a0 legacy=0x7f40e015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.974+0000 7f40de800700 1 -- 172.21.15.50:0/2983815698 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e015bc40 con 0x7f40e006aaa0 2024-09-13T15:07:43.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40de800700 1 --2- 172.21.15.50:0/2983815698 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e006aaa0 0x7f40e006aef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009d90 tx=0x7f40d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15625fef85b8dde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40dd400700 1 -- 172.21.15.50:0/2983815698 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800e070 con 0x7f40e006aaa0 2024-09-13T15:07:43.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40dd400700 1 -- 172.21.15.50:0/2983815698 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800bb20 con 0x7f40e006aaa0 2024-09-13T15:07:43.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40dd400700 1 -- 172.21.15.50:0/2983815698 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8012430 con 0x7f40e006aaa0 2024-09-13T15:07:43.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 -- 172.21.15.50:0/2983815698 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e006aaa0 msgr2=0x7f40e006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 --2- 172.21.15.50:0/2983815698 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e006aaa0 0x7f40e006aef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009d90 tx=0x7f40d800b330 comp rx=0 tx=0).stop 2024-09-13T15:07:43.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 -- 172.21.15.50:0/2983815698 shutdown_connections 2024-09-13T15:07:43.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 --2- 172.21.15.50:0/2983815698 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e006aaa0 0x7f40e006aef0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 --2- 172.21.15.50:0/2983815698 >> v2:172.21.15.181:3300/0 conn(0x7f40e00cb020 0x7f40e00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 -- 172.21.15.50:0/2983815698 >> 172.21.15.50:0/2983815698 conn(0x7f40e00b0c40 msgr2=0x7f40e006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:43.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 -- 172.21.15.50:0/2983815698 shutdown_connections 2024-09-13T15:07:43.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.978+0000 7f40df200700 1 -- 172.21.15.50:0/2983815698 wait complete. 2024-09-13T15:07:43.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 Processor -- start 2024-09-13T15:07:43.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 -- start start 2024-09-13T15:07:43.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 0x7f40e01536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40e00cb020 0x7f40e0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e015c2a0 0x7f40e0147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0154b20 con 0x7f40e006aaa0 2024-09-13T15:07:43.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e014e100 con 0x7f40e00cb020 2024-09-13T15:07:43.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40df200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e014e3e0 con 0x7f40e015c2a0 2024-09-13T15:07:43.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.982+0000 7f40dde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 0x7f40e01536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 0x7f40e01536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39418/0 (socket says 172.21.15.50:39418) 2024-09-13T15:07:43.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 -- 172.21.15.50:0/3368651741 learned_addr learned my addr 172.21.15.50:0/3368651741 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:43.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40de800700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e015c2a0 0x7f40e0147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40d5400700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40e00cb020 0x7f40e0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 -- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e015c2a0 msgr2=0x7f40e0147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e015c2a0 0x7f40e0147e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 -- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40e00cb020 msgr2=0x7f40e0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:43.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40e00cb020 0x7f40e0071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:43.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 -- 172.21.15.50:0/3368651741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8009a70 con 0x7f40e006aaa0 2024-09-13T15:07:43.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40dde00700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 0x7f40e01536b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9d0 tx=0x7f40d000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:43.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0009720 con 0x7f40e006aaa0 2024-09-13T15:07:43.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000ee70 con 0x7f40e006aaa0 2024-09-13T15:07:43.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000ca50 con 0x7f40e006aaa0 2024-09-13T15:07:43.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e014e6c0 con 0x7f40e006aaa0 2024-09-13T15:07:43.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.986+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e014ec80 con 0x7f40e006aaa0 2024-09-13T15:07:43.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.990+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e00673f0 con 0x7f40e006aaa0 2024-09-13T15:07:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.990+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40d000cbb0 con 0x7f40e006aaa0 2024-09-13T15:07:43.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.994+0000 7f40d6a00700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40bc066730 0x7f40bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:43.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.994+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40d0084540 con 0x7f40e006aaa0 2024-09-13T15:07:43.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.994+0000 7f40d5400700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40bc066730 0x7f40bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:43.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.994+0000 7f40d5400700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40bc066730 0x7f40bc068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007fd0 tx=0x7f40c8007c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:43.998+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40d0051520 con 0x7f40e006aaa0 2024-09-13T15:07:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.198+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40e00b3e90 con 0x7f40e006aaa0 2024-09-13T15:07:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40d6a00700 1 -- 172.21.15.50:0/3368651741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f40e00b3e90 con 0x7f40e006aaa0 2024-09-13T15:07:44.203 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:44.203 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40bc066730 msgr2=0x7f40bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40bc066730 0x7f40bc068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007fd0 tx=0x7f40c8007c60 comp rx=0 tx=0).stop 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 msgr2=0x7f40e01536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 0x7f40e01536b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9d0 tx=0x7f40d000ece0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 shutdown_connections 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40bc066730 0x7f40bc068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40e015c2a0 0x7f40e0147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40e00cb020 0x7f40e0071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 --2- 172.21.15.50:0/3368651741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40e006aaa0 0x7f40e01536b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 >> 172.21.15.50:0/3368651741 conn(0x7f40e00b0c40 msgr2=0x7f40e00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.202+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 shutdown_connections 2024-09-13T15:07:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.206+0000 7f40df200700 1 -- 172.21.15.50:0/3368651741 wait complete. 2024-09-13T15:07:44.631 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:07:37.462088+0000', 'modified': '2024-09-13T15:07:41.982118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.181:6835/472992043', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 472992043}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 472992043}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T15:07:44.631 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:07:44.631 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T15:07:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.850+0000 7f3120e00700 1 Processor -- start 2024-09-13T15:07:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.850+0000 7f3120e00700 1 -- start start 2024-09-13T15:07:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f3120e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f311c161020 0x7f311c071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f3120e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0ccd90 0x7f311c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f3120e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c06a390 con 0x7f311c0b2f90 2024-09-13T15:07:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f3120e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c06bc20 con 0x7f311c161020 2024-09-13T15:07:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f3120e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0cd340 con 0x7f311c0ccd90 2024-09-13T15:07:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f311be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f311c0b2f90 0x7f311c06ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50188/0 (socket says 172.21.15.50:50188) 2024-09-13T15:07:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f311be00700 1 -- 172.21.15.50:0/2292053579 learned_addr learned my addr 172.21.15.50:0/2292053579 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f311b400700 1 --2- 172.21.15.50:0/2292053579 >> v2:172.21.15.181:3300/0 conn(0x7f311c161020 0x7f311c071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f3113e00700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0ccd90 0x7f311c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f311aa00700 1 -- 172.21.15.50:0/2292053579 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548565572 0 0) 0x7f311c06a390 con 0x7f311c0b2f90 2024-09-13T15:07:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.854+0000 7f311aa00700 1 -- 172.21.15.50:0/2292053579 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31000035d0 con 0x7f311c0b2f90 2024-09-13T15:07:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311b400700 1 -- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0ccd90 msgr2=0x7f311c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311b400700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0ccd90 0x7f311c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311b400700 1 -- 172.21.15.50:0/2292053579 >> v1:172.21.15.50:6789/0 conn(0x7f311c0b2f90 legacy=0x7f311c06ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311b400700 1 -- 172.21.15.50:0/2292053579 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c071860 con 0x7f311c161020 2024-09-13T15:07:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3113e00700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0ccd90 0x7f311c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:44.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311b400700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c161020 0x7f311c071320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f310c009850 tx=0x7f310c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba10f990f8a022f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311aa00700 1 -- 172.21.15.50:0/2292053579 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c011830 con 0x7f311c161020 2024-09-13T15:07:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311aa00700 1 -- 172.21.15.50:0/2292053579 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c011990 con 0x7f311c161020 2024-09-13T15:07:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f311aa00700 1 -- 172.21.15.50:0/2292053579 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c011d40 con 0x7f311c161020 2024-09-13T15:07:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 -- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c161020 msgr2=0x7f311c071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c161020 0x7f311c071320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f310c009850 tx=0x7f310c009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 -- 172.21.15.50:0/2292053579 shutdown_connections 2024-09-13T15:07:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0ccd90 0x7f311c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 --2- 172.21.15.50:0/2292053579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c161020 0x7f311c071320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 -- 172.21.15.50:0/2292053579 >> 172.21.15.50:0/2292053579 conn(0x7f311c06ca10 msgr2=0x7f311c06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 -- 172.21.15.50:0/2292053579 shutdown_connections 2024-09-13T15:07:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.858+0000 7f3120e00700 1 -- 172.21.15.50:0/2292053579 wait complete. 2024-09-13T15:07:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.862+0000 7f3120e00700 1 Processor -- start 2024-09-13T15:07:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.862+0000 7f3120e00700 1 -- start start 2024-09-13T15:07:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 0x7f311c149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c0ccd90 0x7f311c15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c161020 0x7f311c15fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c156390 con 0x7f311c0b2f90 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1fa190 con 0x7f311c0ccd90 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0c6ce0 con 0x7f311c161020 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 0x7f311c149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 0x7f311c149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39422/0 (socket says 172.21.15.50:39422) 2024-09-13T15:07:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 -- 172.21.15.50:0/3826296347 learned_addr learned my addr 172.21.15.50:0/3826296347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3113e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c0ccd90 0x7f311c15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311be00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c161020 0x7f311c15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 -- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c161020 msgr2=0x7f311c15fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c161020 0x7f311c15fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 -- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c0ccd90 msgr2=0x7f311c15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c0ccd90 0x7f311c15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 -- 172.21.15.50:0/3826296347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040094b0 con 0x7f311c0b2f90 2024-09-13T15:07:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3113e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c0ccd90 0x7f311c15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311be00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c161020 0x7f311c15fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f311b400700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 0x7f311c149c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f310c014040 tx=0x7f310c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3113400700 1 -- 172.21.15.50:0/3826296347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0036c0 con 0x7f311c0b2f90 2024-09-13T15:07:44.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3113400700 1 -- 172.21.15.50:0/3826296347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c01e070 con 0x7f311c0b2f90 2024-09-13T15:07:44.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3113400700 1 -- 172.21.15.50:0/3826296347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c003a80 con 0x7f311c0b2f90 2024-09-13T15:07:44.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c0094b0 con 0x7f311c0b2f90 2024-09-13T15:07:44.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.866+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c1fa730 con 0x7f311c0b2f90 2024-09-13T15:07:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.870+0000 7f3113400700 1 -- 172.21.15.50:0/3826296347 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f310c003be0 con 0x7f311c0b2f90 2024-09-13T15:07:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.874+0000 7f3113400700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30f8066730 0x7f30f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.874+0000 7f3113400700 1 -- 172.21.15.50:0/3826296347 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f310c020070 con 0x7f311c0b2f90 2024-09-13T15:07:44.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.874+0000 7f3113e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30f8066730 0x7f30f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.874+0000 7f3113e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30f8066730 0x7f30f8068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f311c162f80 tx=0x7f3104008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.874+0000 7f31257c9740 1 Processor -- start 2024-09-13T15:07:44.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.874+0000 7f31257c9740 1 -- start start 2024-09-13T15:07:44.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f31257c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e86c0 0xe5b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f31257c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe50fd80 con 0xe5c6d00 2024-09-13T15:07:44.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xe50d510 con 0xe5e86c0 2024-09-13T15:07:44.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xe508e00 con 0xe5e7da0 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39428/0 (socket says 172.21.15.50:39428) 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 -- 172.21.15.50:0/1035710568 learned_addr learned my addr 172.21.15.50:0/1035710568 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f311be00700 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e86c0 0xe5b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f311b400700 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 -- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 msgr2=0xe5e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 -- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e86c0 msgr2=0xe5b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e86c0 0xe5b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 -- 172.21.15.50:0/1035710568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe37b960 con 0xe5c6d00 2024-09-13T15:07:44.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f3113e00700 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5b0890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3104011df0 tx=0x7f3104014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3470148884989c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f310be00700 1 -- 172.21.15.50:0/1035710568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104011e20 con 0xe5c6d00 2024-09-13T15:07:44.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f310be00700 1 -- 172.21.15.50:0/1035710568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104015c60 con 0xe5c6d00 2024-09-13T15:07:44.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.878+0000 7f310be00700 1 -- 172.21.15.50:0/1035710568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104021440 con 0xe5c6d00 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- 172.21.15.50:0/1035710568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 msgr2=0xe5b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5b0890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3104011df0 tx=0x7f3104014000 comp rx=0 tx=0).stop 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- 172.21.15.50:0/1035710568 shutdown_connections 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e86c0 0xe5b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5b0890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- 172.21.15.50:0/1035710568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- 172.21.15.50:0/1035710568 >> 172.21.15.50:0/1035710568 conn(0xe3304d0 msgr2=0xe5c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- 172.21.15.50:0/1035710568 shutdown_connections 2024-09-13T15:07:44.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- 172.21.15.50:0/1035710568 wait complete. 2024-09-13T15:07:44.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- start start 2024-09-13T15:07:44.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 Processor -- start 2024-09-13T15:07:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5c6d00 0xe5e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 0xe5e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe4c6730 con 0xe5e86c0 2024-09-13T15:07:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xe4cc5b0 con 0xe5c6d00 2024-09-13T15:07:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xe3b4aa0 con 0xe5e7da0 2024-09-13T15:07:44.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.882+0000 7f31257c9740 10 client.0 _ll_register_callbacks cb 0xe502610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 0xe5e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 0xe5e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39430/0 (socket says 172.21.15.50:39430) 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 -- 172.21.15.50:0/1934472477 learned_addr learned my addr 172.21.15.50:0/1934472477 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3113e00700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311b400700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5c6d00 0xe5e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 -- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 msgr2=0xe5c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 -- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5c6d00 msgr2=0xe5e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5c6d00 0xe5e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 -- 172.21.15.50:0/1934472477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3104011ad0 con 0xe5e86c0 2024-09-13T15:07:44.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3113e00700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:44.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f311be00700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 0xe5e8aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3114007950 tx=0x7f3114007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50af75ff1c1af212 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3108c00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:07:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3108c00700 1 -- 172.21.15.50:0/1934472477 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114012590 con 0xe5e86c0 2024-09-13T15:07:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe33d1e0 con 0xe5e86c0 2024-09-13T15:07:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3108c00700 1 -- 172.21.15.50:0/1934472477 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31140126f0 con 0xe5e86c0 2024-09-13T15:07:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3108c00700 1 -- 172.21.15.50:0/1934472477 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3114001df0 con 0xe5e86c0 2024-09-13T15:07:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 10 client.4392 fetch_fsmap learned FSMap version 6 2024-09-13T15:07:44.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xe4cf220 con 0xe5e86c0 2024-09-13T15:07:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3108c00700 1 -- 172.21.15.50:0/1934472477 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe33d1e0 con 0xe5e86c0 2024-09-13T15:07:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f3108c00700 1 -- 172.21.15.50:0/1934472477 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f31140128b0 con 0xe5e86c0 2024-09-13T15:07:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 10 client.4392 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T15:07:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:07:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 20 client.4392 populate_metadata read hostname 'smithi050' 2024-09-13T15:07:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe5a1450 0xe5a1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 4 client.4392 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:07:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.886+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 --> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe387460 con 0xe5a1450 2024-09-13T15:07:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f311b400700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe5a1450 0xe5a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f311b400700 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe5a1450 0xe5a1830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=517959d0a60dd42 server_cookie=24e5fa33598314e3 in_seq=0 out_seq=0 2024-09-13T15:07:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f3108c00700 10 client.4392 ms_handle_connect on v2:172.21.15.181:6834/472992043 2024-09-13T15:07:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f3108c00700 1 -- 172.21.15.50:0/1934472477 <== mds.0 v2:172.21.15.181:6834/472992043 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0xe387460 con 0xe5a1450 2024-09-13T15:07:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f3108c00700 10 client.4392 handle_command_reply: tid=0 2024-09-13T15:07:44.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f31257c9740 1 client.4392 shutdown 2024-09-13T15:07:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 msgr2=0xe5e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.890+0000 7f31257c9740 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 0xe5e8aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3114007950 tx=0x7f3114007980 comp rx=0 tx=0).stop 2024-09-13T15:07:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 shutdown_connections 2024-09-13T15:07:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5e86c0 0xe5e8aa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e7da0 0xe5c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe5a1450 0xe5a1830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 --2- 172.21.15.50:0/1934472477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5c6d00 0xe5e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 >> 172.21.15.50:0/1934472477 conn(0xe3304d0 msgr2=0xe5c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f3108c00700 0 client.4392 ms_handle_reset on v2:172.21.15.181:6834/472992043 2024-09-13T15:07:44.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 shutdown_connections 2024-09-13T15:07:44.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 1 -- 172.21.15.50:0/1934472477 wait complete. 2024-09-13T15:07:44.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.894+0000 7f31257c9740 20 client.4392 trim_cache size 0 max 16384 2024-09-13T15:07:44.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 Processor -- start 2024-09-13T15:07:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 -- start start 2024-09-13T15:07:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe5c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe5c2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe5e83a0 con 0xe5c6d00 2024-09-13T15:07:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xe5e3ec0 con 0xe5e7da0 2024-09-13T15:07:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xe4bce90 con 0xe5e86c0 2024-09-13T15:07:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f311b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f311b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39444/0 (socket says 172.21.15.50:39444) 2024-09-13T15:07:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f311b400700 1 -- 172.21.15.50:0/4138048887 learned_addr learned my addr 172.21.15.50:0/4138048887 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f311be00700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe5c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.914+0000 7f3113e00700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe5c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311b400700 1 -- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 msgr2=0xe5c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311b400700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe5c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311b400700 1 -- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 msgr2=0xe5c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311b400700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe5c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311b400700 1 -- 172.21.15.50:0/4138048887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe4b5450 con 0xe5c6d00 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f3113e00700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe5c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311be00700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe5c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f311b400700 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5c5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f310c0562f0 tx=0x7f310c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca3708f49db18bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f3110c00700 1 -- 172.21.15.50:0/4138048887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0565f0 con 0xe5c6d00 2024-09-13T15:07:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f3110c00700 1 -- 172.21.15.50:0/4138048887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c05a420 con 0xe5c6d00 2024-09-13T15:07:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f3110c00700 1 -- 172.21.15.50:0/4138048887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c05e9e0 con 0xe5c6d00 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 -- 172.21.15.50:0/4138048887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 msgr2=0xe5c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5c5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f310c0562f0 tx=0x7f310c01c040 comp rx=0 tx=0).stop 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 -- 172.21.15.50:0/4138048887 shutdown_connections 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe5c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe5c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 --2- 172.21.15.50:0/4138048887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe5c5730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 -- 172.21.15.50:0/4138048887 >> 172.21.15.50:0/4138048887 conn(0xe3304d0 msgr2=0xe600ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 -- 172.21.15.50:0/4138048887 shutdown_connections 2024-09-13T15:07:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.918+0000 7f31257c9740 1 -- 172.21.15.50:0/4138048887 wait complete. 2024-09-13T15:07:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 -- start start 2024-09-13T15:07:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 Processor -- start 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe600840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe6485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe649930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xe606e00 con 0xe5c6d00 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xe600d80 con 0xe5e7da0 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xe5c6ba0 con 0xe5e86c0 2024-09-13T15:07:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f31257c9740 10 client.0 _ll_register_callbacks cb 0xe55f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:07:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f311b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe600840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f311b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe600840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39446/0 (socket says 172.21.15.50:39446) 2024-09-13T15:07:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f311b400700 1 -- 172.21.15.50:0/544639826 learned_addr learned my addr 172.21.15.50:0/544639826 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f3113e00700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe6485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.922+0000 7f311be00700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe649930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f311b400700 1 -- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 msgr2=0xe649930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f311b400700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe649930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f311b400700 1 -- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 msgr2=0xe6485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f311b400700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe6485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f311b400700 1 -- 172.21.15.50:0/544639826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c1fa730 con 0xe5c6d00 2024-09-13T15:07:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f311b400700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe600840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f310c056580 tx=0x7f310c009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4b1af56687b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3108c00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:07:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3108c00700 1 -- 172.21.15.50:0/544639826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c05e9e0 con 0xe5c6d00 2024-09-13T15:07:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3108c00700 1 -- 172.21.15.50:0/544639826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f310c073d90 con 0xe5c6d00 2024-09-13T15:07:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3104015c60 con 0xe5c6d00 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3108c00700 1 -- 172.21.15.50:0/544639826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f310c052d00 con 0xe5c6d00 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 10 client.4398 fetch_fsmap learned FSMap version 6 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xe4a9720 con 0xe5c6d00 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3108c00700 1 -- 172.21.15.50:0/544639826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c07c020 con 0xe5c6d00 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3108c00700 1 -- 172.21.15.50:0/544639826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f310c056850 con 0xe5c6d00 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 10 client.4398 fetch_fsmap finished waiting for FSMap version 6 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 20 client.4398 populate_metadata read hostname 'smithi050' 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe64a0b0 0xe5fe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 4 client.4398 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:07:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 --> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] -- command(tid 0: {"prefix": "status"}) v1 -- 0xe3ac1e0 con 0xe64a0b0 2024-09-13T15:07:44.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.926+0000 7f3113e00700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe64a0b0 0xe5fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:44.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3108c00700 10 client.4398 ms_handle_connect on v2:172.21.15.181:6834/472992043 2024-09-13T15:07:44.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3113e00700 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe64a0b0 0xe5fe260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3650829ee6553e1 server_cookie=219745a21e5f3d2 in_seq=0 out_seq=0 2024-09-13T15:07:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3108c00700 1 -- 172.21.15.50:0/544639826 <== mds.0 v2:172.21.15.181:6834/472992043 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xe3ac1e0 con 0xe64a0b0 2024-09-13T15:07:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3108c00700 10 client.4398 handle_command_reply: tid=0 2024-09-13T15:07:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 client.4398 shutdown 2024-09-13T15:07:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 msgr2=0xe600840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe600840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f310c056580 tx=0x7f310c009440 comp rx=0 tx=0).stop 2024-09-13T15:07:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 shutdown_connections 2024-09-13T15:07:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xe5e86c0 0xe649930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0xe64a0b0 0xe5fe260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xe5e7da0 0xe6485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 --2- 172.21.15.50:0/544639826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe5c6d00 0xe600840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 >> 172.21.15.50:0/544639826 conn(0xe3304d0 msgr2=0xe59e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3108c00700 0 client.4398 ms_handle_reset on v2:172.21.15.181:6834/472992043 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 shutdown_connections 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 1 -- 172.21.15.50:0/544639826 wait complete. 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f31257c9740 20 client.4398 trim_cache size 0 max 16384 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4279, 2024-09-13T15:07:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 7.4609924679999997, 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 6, 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 24, 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 23, 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.357905814 2024-09-13T15:07:44.934 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30f8066730 msgr2=0x7f30f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30f8066730 0x7f30f8068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f311c162f80 tx=0x7f3104008040 comp rx=0 tx=0).stop 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 msgr2=0x7f311c149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 0x7f311c149c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f310c014040 tx=0x7f310c004770 comp rx=0 tx=0).stop 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 shutdown_connections 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30f8066730 0x7f30f8068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c161020 0x7f311c15fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c0ccd90 0x7f311c15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 --2- 172.21.15.50:0/3826296347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f311c0b2f90 0x7f311c149c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 >> 172.21.15.50:0/3826296347 conn(0x7f311c06ca10 msgr2=0x7f311c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 shutdown_connections 2024-09-13T15:07:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:44.930+0000 7f3120e00700 1 -- 172.21.15.50:0/3826296347 wait complete. 2024-09-13T15:07:44.962 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:07:44.962 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:44.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:07:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.142+0000 7f6323200700 1 Processor -- start 2024-09-13T15:07:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.142+0000 7f6323200700 1 -- start start 2024-09-13T15:07:45.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6323200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63240cc6f0 0x7f632415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:45.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6323200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240ccb40 con 0x7f632406aaa0 2024-09-13T15:07:45.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6323200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240b2ad0 con 0x7f63240cb020 2024-09-13T15:07:45.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6323200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632415b960 con 0x7f63240cc6f0 2024-09-13T15:07:45.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6321e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f63240cb020 0x7f632415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:34266/0 (socket says 172.21.15.50:34266) 2024-09-13T15:07:45.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6321e00700 1 -- 172.21.15.50:0/2400973261 learned_addr learned my addr 172.21.15.50:0/2400973261 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:45.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6322800700 1 --1- 172.21.15.50:0/2400973261 >> v1:172.21.15.50:6789/0 conn(0x7f632406aaa0 0x7f63240b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50200/0 (socket says 172.21.15.50:50200) 2024-09-13T15:07:45.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.146+0000 7f6321400700 1 --2- 172.21.15.50:0/2400973261 >> v2:172.21.15.50:3300/0 conn(0x7f63240cc6f0 0x7f632415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6321400700 1 -- 172.21.15.50:0/2400973261 >> v1:172.21.15.181:6789/0 conn(0x7f63240cb020 legacy=0x7f632415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6321400700 1 -- 172.21.15.50:0/2400973261 >> v1:172.21.15.50:6789/0 conn(0x7f632406aaa0 legacy=0x7f63240b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6321400700 1 -- 172.21.15.50:0/2400973261 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632415bc40 con 0x7f63240cc6f0 2024-09-13T15:07:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6320a00700 1 -- 172.21.15.50:0/2400973261 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165256630 0 0) 0x7f63240b2ad0 con 0x7f63240cb020 2024-09-13T15:07:45.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6321400700 1 --2- 172.21.15.50:0/2400973261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632415b0e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6310009850 tx=0x7f6310009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3dae08afe5b6db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6320a00700 1 -- 172.21.15.50:0/2400973261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310011830 con 0x7f63240cc6f0 2024-09-13T15:07:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6320a00700 1 -- 172.21.15.50:0/2400973261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310011990 con 0x7f63240cc6f0 2024-09-13T15:07:45.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6320a00700 1 -- 172.21.15.50:0/2400973261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310011d20 con 0x7f63240cc6f0 2024-09-13T15:07:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 -- 172.21.15.50:0/2400973261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 msgr2=0x7f632415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 --2- 172.21.15.50:0/2400973261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632415b0e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6310009850 tx=0x7f6310009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 -- 172.21.15.50:0/2400973261 shutdown_connections 2024-09-13T15:07:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 --2- 172.21.15.50:0/2400973261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632415b0e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 -- 172.21.15.50:0/2400973261 >> 172.21.15.50:0/2400973261 conn(0x7f63240b0c40 msgr2=0x7f632406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:45.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 -- 172.21.15.50:0/2400973261 shutdown_connections 2024-09-13T15:07:45.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.150+0000 7f6323200700 1 -- 172.21.15.50:0/2400973261 wait complete. 2024-09-13T15:07:45.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 Processor -- start 2024-09-13T15:07:45.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 -- start start 2024-09-13T15:07:45.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f632406aaa0 0x7f6324151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63240cb020 0x7f632406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324070280 con 0x7f63240cc6f0 2024-09-13T15:07:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324070520 con 0x7f63240cb020 2024-09-13T15:07:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6323200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6324070800 con 0x7f632406aaa0 2024-09-13T15:07:45.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.154+0000 7f6322800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:45.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632414ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39460/0 (socket says 172.21.15.50:39460) 2024-09-13T15:07:45.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 -- 172.21.15.50:0/1988425287 learned_addr learned my addr 172.21.15.50:0/1988425287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:45.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6321400700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63240cb020 0x7f632406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:45.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6321e00700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f632406aaa0 0x7f6324151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:45.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 -- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f632406aaa0 msgr2=0x7f6324151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f632406aaa0 0x7f6324151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 -- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63240cb020 msgr2=0x7f632406fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63240cb020 0x7f632406fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 -- 172.21.15.50:0/1988425287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100094b0 con 0x7f63240cc6f0 2024-09-13T15:07:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6321400700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63240cb020 0x7f632406fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:45.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6322800700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632414ffa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f631c00cbd0 tx=0x7f631c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00aaa0 con 0x7f63240cc6f0 2024-09-13T15:07:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00ac00 con 0x7f63240cc6f0 2024-09-13T15:07:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6324070ae0 con 0x7f63240cc6f0 2024-09-13T15:07:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c007070 con 0x7f63240cc6f0 2024-09-13T15:07:45.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.158+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63240710a0 con 0x7f63240cc6f0 2024-09-13T15:07:45.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.162+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6324071290 con 0x7f63240cc6f0 2024-09-13T15:07:45.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.162+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f631c0071d0 con 0x7f63240cc6f0 2024-09-13T15:07:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.162+0000 7f631a000700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6304066730 0x7f6304068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.162+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f631c083ff0 con 0x7f63240cc6f0 2024-09-13T15:07:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.166+0000 7f6321e00700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6304066730 0x7f6304068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.166+0000 7f6321e00700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6304066730 0x7f6304068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6314007b30 tx=0x7f6314007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.170+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f631c0b5db0 con 0x7f63240cc6f0 2024-09-13T15:07:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.390+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f632415b0e0 con 0x7f63240cc6f0 2024-09-13T15:07:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.390+0000 7f631a000700 1 -- 172.21.15.50:0/1988425287 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f631c017070 con 0x7f63240cc6f0 2024-09-13T15:07:45.392 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:07:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.390+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6304066730 msgr2=0x7f6304068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.390+0000 7f6323200700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6304066730 0x7f6304068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6314007b30 tx=0x7f6314007a80 comp rx=0 tx=0).stop 2024-09-13T15:07:45.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.390+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 msgr2=0x7f632414ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.390+0000 7f6323200700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632414ffa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f631c00cbd0 tx=0x7f631c00cee0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 shutdown_connections 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6304066730 0x7f6304068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63240cc6f0 0x7f632414ffa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f63240cb020 0x7f632406fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 --2- 172.21.15.50:0/1988425287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f632406aaa0 0x7f6324151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 >> 172.21.15.50:0/1988425287 conn(0x7f63240b0c40 msgr2=0x7f632406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 shutdown_connections 2024-09-13T15:07:45.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:45.394+0000 7f6323200700 1 -- 172.21.15.50:0/1988425287 wait complete. 2024-09-13T15:07:45.415 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:07:45.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:07:45.416 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T15:07:45.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.416 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:07:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42442sec preferred_lft 42442sec 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:07:45.432 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:07:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:07:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:07:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:07:45.434 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:07:45.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.434 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:07:45.434 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:07:45.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:07:45.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-09-13T15:07:45.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-09-13T15:07:45.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:07:45.435 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:07:45.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.580 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:07:45.613 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:07:45.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.616 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:07:45.708 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:07:45.708 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:07:45.708 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:07:45.708 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:07:45.708 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:07:45.708 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:07:45.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.709 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:07:45.709 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:07:45.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:07:45.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:07:45.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:07:45.709 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:07:45.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.839 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:07:45.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.856 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-13T15:07:45.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:45.916 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:07:45.917 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:07:45.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T15:07:45.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T15:07:45.917 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:07:46.025 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T15:07:46.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T15:07:46.026 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:07:46.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:46.213 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:07:46.213 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:07:46.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:07:46.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:07:46.213 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:07:46.281 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T15:07:46.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:07:46.281 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:46.296 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T15:07:46.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:07:46.296 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:46.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-09-13T15:07:46.436 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:07:46.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:07:46.511 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:07:46.514 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:07:46.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:46.515 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-09-13T15:07:46.575 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T15:07:46.575 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T15:07:46.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-09-13T15:07:46.655 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:07:46.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:07:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:07:46.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:07:46.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:46.732 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-09-13T15:07:46.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2024-09-13T15:07:46.773+0000 7fc73e842640 -1 init, newargv = 0x563fe4519d60 newargc=15 2024-09-13T15:07:46.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[31034]: starting ceph client 2024-09-13T15:07:46.795 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[31034]: starting fuse 2024-09-13T15:07:47.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-09-13T15:07:47.926 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:07:47.927 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:07:48.006 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:07:48.010 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:07:48.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:48.010 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-09-13T15:07:48.078 INFO:teuthology.orchestra.run.smithi050.stdout:50 2024-09-13T15:07:48.079 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> import re 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2024-09-13T15:07:48.079 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> return f 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T15:07:48.080 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-13T15:07:48.081 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2024-09-13T15:07:48.081 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-13T15:07:48.251 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.31034.asok 2024-09-13T15:07:48.427 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31034.asok 2024-09-13T15:07:48.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:48.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31034.asok status 2024-09-13T15:07:48.636 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:07:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2024-09-13T15:07:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T15:07:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:07:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "31034", 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4416, 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4416 2024-09-13T15:07:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1314551164 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1314551164 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4416 192.168.0.1:0/1314551164", 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1314551164", 2024-09-13T15:07:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2024-09-13T15:07:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 6, 2024-09-13T15:07:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 24, 2024-09-13T15:07:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2024-09-13T15:07:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2024-09-13T15:07:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2024-09-13T15:07:48.639 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:07:48.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:48.652 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2024-09-13T15:07:48.652 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:48.670 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2024-09-13T15:07:48.670 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:48.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:48.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:48.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:48.753 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T15:07:48.957 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2024-09-13T15:07:48.957 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T15:07:48.957 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:48.958 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:48.959 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:07:48.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:49.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.197+0000 7f5f19200700 1 Processor -- start 2024-09-13T15:07:49.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.197+0000 7f5f19200700 1 -- start start 2024-09-13T15:07:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f19200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f1406b1b0 0x7f5f141646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f19200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140707d0 con 0x7f5f14159bd0 2024-09-13T15:07:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f19200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1406fee0 con 0x7f5f140cb700 2024-09-13T15:07:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f19200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140720a0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f14159bd0 0x7f5f14071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50214/0 (socket says 172.21.15.50:50214) 2024-09-13T15:07:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13400700 1 -- 172.21.15.50:0/1751274728 learned_addr learned my addr 172.21.15.50:0/1751274728 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13e00700 1 --2- 172.21.15.50:0/1751274728 >> v2:172.21.15.50:3300/0 conn(0x7f5f1406b1b0 0x7f5f141646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282540785 0 0) 0x7f5f140707d0 con 0x7f5f14159bd0 2024-09-13T15:07:49.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef80035d0 con 0x7f5f14159bd0 2024-09-13T15:07:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810731056 0 0) 0x7f5f1406fee0 con 0x7f5f140cb700 2024-09-13T15:07:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f140707d0 con 0x7f5f140cb700 2024-09-13T15:07:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13e00700 1 -- 172.21.15.50:0/1751274728 >> v1:172.21.15.181:6789/0 conn(0x7f5f140cb700 legacy=0x7f5f1406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13e00700 1 -- 172.21.15.50:0/1751274728 >> v1:172.21.15.50:6789/0 conn(0x7f5f14159bd0 legacy=0x7f5f14071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13e00700 1 -- 172.21.15.50:0/1751274728 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140b2ef0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f13e00700 1 --2- 172.21.15.50:0/1751274728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141646c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009dc0 tx=0x7f5f0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccfd8270fb2cc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00e070 con 0x7f5f1406b1b0 2024-09-13T15:07:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00baa0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.201+0000 7f5f12000700 1 -- 172.21.15.50:0/1751274728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00be50 con 0x7f5f1406b1b0 2024-09-13T15:07:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 -- 172.21.15.50:0/1751274728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 msgr2=0x7f5f141646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 --2- 172.21.15.50:0/1751274728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141646c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009dc0 tx=0x7f5f0c00b330 comp rx=0 tx=0).stop 2024-09-13T15:07:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 -- 172.21.15.50:0/1751274728 shutdown_connections 2024-09-13T15:07:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 --2- 172.21.15.50:0/1751274728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141646c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 -- 172.21.15.50:0/1751274728 >> 172.21.15.50:0/1751274728 conn(0x7f5f140b0c40 msgr2=0x7f5f1406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 -- 172.21.15.50:0/1751274728 shutdown_connections 2024-09-13T15:07:49.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 -- 172.21.15.50:0/1751274728 wait complete. 2024-09-13T15:07:49.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 Processor -- start 2024-09-13T15:07:49.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.205+0000 7f5f19200700 1 -- start start 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f140cb700 0x7f5f1415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f14159bd0 0x7f5f14158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f141f33e0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f141f2b60 con 0x7f5f140cb700 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1415d380 con 0x7f5f14159bd0 2024-09-13T15:07:49.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141ecbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39484/0 (socket says 172.21.15.50:39484) 2024-09-13T15:07:49.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 -- 172.21.15.50:0/1125248506 learned_addr learned my addr 172.21.15.50:0/1125248506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13e00700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f14159bd0 0x7f5f14158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f12a00700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f140cb700 0x7f5f1415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 -- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f14159bd0 msgr2=0x7f5f14158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f14159bd0 0x7f5f14158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 -- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f140cb700 msgr2=0x7f5f1415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f140cb700 0x7f5f1415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 -- 172.21.15.50:0/1125248506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009a70 con 0x7f5f1406b1b0 2024-09-13T15:07:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f13400700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141ecbb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c500 tx=0x7f5f0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04005d90 con 0x7f5f1406b1b0 2024-09-13T15:07:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f040070d0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04007480 con 0x7f5f1406b1b0 2024-09-13T15:07:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f141f2d60 con 0x7f5f1406b1b0 2024-09-13T15:07:49.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.209+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f141f3000 con 0x7f5f1406b1b0 2024-09-13T15:07:49.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.213+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f141f3520 con 0x7f5f1406b1b0 2024-09-13T15:07:49.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.213+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f040075e0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.217+0000 7f5f0b400700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef4066730 0x7f5ef4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.217+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f040839e0 con 0x7f5f1406b1b0 2024-09-13T15:07:49.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.217+0000 7f5f12a00700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef4066730 0x7f5ef4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.217+0000 7f5f12a00700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef4066730 0x7f5ef4068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f1406b150 tx=0x7f5f00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:49.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.225+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f141f3520 con 0x7f5f1406b1b0 2024-09-13T15:07:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.421+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f141f3520 con 0x7f5f1406b1b0 2024-09-13T15:07:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.425+0000 7f5f0b400700 1 -- 172.21.15.50:0/1125248506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f5f141f3520 con 0x7f5f1406b1b0 2024-09-13T15:07:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:49.428 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:49.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.425+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef4066730 msgr2=0x7f5ef4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.425+0000 7f5f19200700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef4066730 0x7f5ef4068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f1406b150 tx=0x7f5f00009040 comp rx=0 tx=0).stop 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.425+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 msgr2=0x7f5f141ecbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.425+0000 7f5f19200700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141ecbb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c500 tx=0x7f5f0400c8c0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 shutdown_connections 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef4066730 0x7f5ef4068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f14159bd0 0x7f5f14158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f140cb700 0x7f5f1415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 --2- 172.21.15.50:0/1125248506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1406b1b0 0x7f5f141ecbb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 >> 172.21.15.50:0/1125248506 conn(0x7f5f140b0c40 msgr2=0x7f5f1406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 shutdown_connections 2024-09-13T15:07:49.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.429+0000 7f5f19200700 1 -- 172.21.15.50:0/1125248506 wait complete. 2024-09-13T15:07:49.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:07:49.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:07:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 Processor -- start 2024-09-13T15:07:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 -- start start 2024-09-13T15:07:49.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f48dc0b1980 0x7f48dc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48dc06c960 0x7f48dc06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc071f70 con 0x7f48dc1464c0 2024-09-13T15:07:49.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc06d330 con 0x7f48dc06c960 2024-09-13T15:07:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.641+0000 7f48dbe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc070da0 con 0x7f48dc0b1980 2024-09-13T15:07:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48d2000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f48dc0b1980 0x7f48dc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48daa00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f48dc1464c0 0x7f48dc071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:34286/0 (socket says 172.21.15.50:34286) 2024-09-13T15:07:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48daa00700 1 -- 172.21.15.50:0/1838573385 learned_addr learned my addr 172.21.15.50:0/1838573385 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48db400700 1 --2- 172.21.15.50:0/1838573385 >> v2:172.21.15.50:3300/0 conn(0x7f48dc06c960 0x7f48dc06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48d2000700 1 -- 172.21.15.50:0/1838573385 >> v2:172.21.15.50:3300/0 conn(0x7f48dc06c960 msgr2=0x7f48dc06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48d2000700 1 --2- 172.21.15.50:0/1838573385 >> v2:172.21.15.50:3300/0 conn(0x7f48dc06c960 0x7f48dc06cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48d2000700 1 -- 172.21.15.50:0/1838573385 >> v1:172.21.15.181:6789/0 conn(0x7f48dc1464c0 legacy=0x7f48dc071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48d2000700 1 -- 172.21.15.50:0/1838573385 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0b2440 con 0x7f48dc0b1980 2024-09-13T15:07:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48db400700 1 --2- 172.21.15.50:0/1838573385 >> v2:172.21.15.50:3300/0 conn(0x7f48dc06c960 0x7f48dc06cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48d2000700 1 --2- 172.21.15.50:0/1838573385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0b1df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f48dc06dae0 tx=0x7f48c4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95b3bfb1c10fe48e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48da000700 1 -- 172.21.15.50:0/1838573385 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4011830 con 0x7f48dc0b1980 2024-09-13T15:07:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48da000700 1 -- 172.21.15.50:0/1838573385 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c4011990 con 0x7f48dc0b1980 2024-09-13T15:07:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48da000700 1 -- 172.21.15.50:0/1838573385 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4011d20 con 0x7f48dc0b1980 2024-09-13T15:07:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 -- 172.21.15.50:0/1838573385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 msgr2=0x7f48dc0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 --2- 172.21.15.50:0/1838573385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0b1df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f48dc06dae0 tx=0x7f48c4009b30 comp rx=0 tx=0).stop 2024-09-13T15:07:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 -- 172.21.15.50:0/1838573385 shutdown_connections 2024-09-13T15:07:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 --2- 172.21.15.50:0/1838573385 >> v2:172.21.15.50:3300/0 conn(0x7f48dc06c960 0x7f48dc06cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 --2- 172.21.15.50:0/1838573385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0b1df0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 -- 172.21.15.50:0/1838573385 >> 172.21.15.50:0/1838573385 conn(0x7f48dc06a390 msgr2=0x7f48dc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 -- 172.21.15.50:0/1838573385 shutdown_connections 2024-09-13T15:07:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.645+0000 7f48dbe00700 1 -- 172.21.15.50:0/1838573385 wait complete. 2024-09-13T15:07:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 Processor -- start 2024-09-13T15:07:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 -- start start 2024-09-13T15:07:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48dc06c960 0x7f48dc0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 0x7f48dc0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1f6790 con 0x7f48dc1464c0 2024-09-13T15:07:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1364f0 con 0x7f48dc0b1980 2024-09-13T15:07:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48dbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1367d0 con 0x7f48dc06c960 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48db400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 0x7f48dc0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48db400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 0x7f48dc0ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39500/0 (socket says 172.21.15.50:39500) 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48db400700 1 -- 172.21.15.50:0/2949919608 learned_addr learned my addr 172.21.15.50:0/2949919608 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48daa00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48dc06c960 0x7f48dc0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.649+0000 7f48d2000700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48db400700 1 -- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48dc06c960 msgr2=0x7f48dc0a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48db400700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48dc06c960 0x7f48dc0a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48db400700 1 -- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 msgr2=0x7f48dc0a9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48db400700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0a9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48db400700 1 -- 172.21.15.50:0/2949919608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4009a70 con 0x7f48dc1464c0 2024-09-13T15:07:49.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48db400700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 0x7f48dc0ad0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48d400efc0 tx=0x7f48d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:49.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400cb40 con 0x7f48dc1464c0 2024-09-13T15:07:49.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d400f040 con 0x7f48dc1464c0 2024-09-13T15:07:49.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c40094b0 con 0x7f48dc1464c0 2024-09-13T15:07:49.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4003a40 con 0x7f48dc1464c0 2024-09-13T15:07:49.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc136d90 con 0x7f48dc1464c0 2024-09-13T15:07:49.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.653+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc06cdf0 con 0x7f48dc1464c0 2024-09-13T15:07:49.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.657+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48d4014480 con 0x7f48dc1464c0 2024-09-13T15:07:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.657+0000 7f48d3400700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f48b8066730 0x7f48b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.657+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48d4084e70 con 0x7f48dc1464c0 2024-09-13T15:07:49.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.657+0000 7f48daa00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f48b8066730 0x7f48b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:49.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.661+0000 7f48daa00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f48b8066730 0x7f48b8068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48cc005930 tx=0x7f48cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:49.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.661+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48d4051e70 con 0x7f48dc1464c0 2024-09-13T15:07:49.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.845+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48dc0ae2d0 con 0x7f48dc1464c0 2024-09-13T15:07:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.845+0000 7f48d3400700 1 -- 172.21.15.50:0/2949919608 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48d4009cd0 con 0x7f48dc1464c0 2024-09-13T15:07:49.848 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:07:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f48b8066730 msgr2=0x7f48b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f48b8066730 0x7f48b8068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48cc005930 tx=0x7f48cc009040 comp rx=0 tx=0).stop 2024-09-13T15:07:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 msgr2=0x7f48dc0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 0x7f48dc0ad0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48d400efc0 tx=0x7f48d400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 shutdown_connections 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f48b8066730 0x7f48b8068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48dc1464c0 0x7f48dc0ad0b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc0b1980 0x7f48dc0a9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 --2- 172.21.15.50:0/2949919608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f48dc06c960 0x7f48dc0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 >> 172.21.15.50:0/2949919608 conn(0x7f48dc06a390 msgr2=0x7f48dc0cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 shutdown_connections 2024-09-13T15:07:49.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:49.849+0000 7f48dbe00700 1 -- 172.21.15.50:0/2949919608 wait complete. 2024-09-13T15:07:49.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:07:50.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.061+0000 7f45b9a00700 1 Processor -- start 2024-09-13T15:07:50.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.061+0000 7f45b9a00700 1 -- start start 2024-09-13T15:07:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b9a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45b40b1f50 0x7f45b40cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b9a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415abc0 0x7f45b40ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b9a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b406b940 con 0x7f45b415a7e0 2024-09-13T15:07:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b9a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b415e6b0 con 0x7f45b40b1f50 2024-09-13T15:07:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b9a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b415e990 con 0x7f45b415abc0 2024-09-13T15:07:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45b40b1f50 0x7f45b40cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45b40b1f50 0x7f45b40cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:36544/0 (socket says 172.21.15.50:36544) 2024-09-13T15:07:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 -- 172.21.15.50:0/1031825556 learned_addr learned my addr 172.21.15.50:0/1031825556 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b9000700 1 --2- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415abc0 0x7f45b40ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 -- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415abc0 msgr2=0x7f45b40ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 --2- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415abc0 0x7f45b40ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 -- 172.21.15.50:0/1031825556 >> v1:172.21.15.181:6789/0 conn(0x7f45b415a7e0 legacy=0x7f45b40b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 -- 172.21.15.50:0/1031825556 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b415ec70 con 0x7f45b40b1f50 2024-09-13T15:07:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b3400700 1 --2- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b40cdb80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009910 tx=0x7f45a0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a1173fc378df94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b2a00700 1 -- 172.21.15.50:0/1031825556 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0011830 con 0x7f45b40b1f50 2024-09-13T15:07:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b2a00700 1 -- 172.21.15.50:0/1031825556 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a0011990 con 0x7f45b40b1f50 2024-09-13T15:07:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.065+0000 7f45b2a00700 1 -- 172.21.15.50:0/1031825556 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0011d40 con 0x7f45b40b1f50 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 -- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 msgr2=0x7f45b40cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b40cdb80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009910 tx=0x7f45a0009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 -- 172.21.15.50:0/1031825556 shutdown_connections 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415abc0 0x7f45b40ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1031825556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b40cdb80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 -- 172.21.15.50:0/1031825556 >> 172.21.15.50:0/1031825556 conn(0x7f45b406cb90 msgr2=0x7f45b406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 -- 172.21.15.50:0/1031825556 shutdown_connections 2024-09-13T15:07:50.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 -- 172.21.15.50:0/1031825556 wait complete. 2024-09-13T15:07:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 Processor -- start 2024-09-13T15:07:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.069+0000 7f45b9a00700 1 -- start start 2024-09-13T15:07:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b41ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415a7e0 0x7f45b4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 0x7f45b4156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b414ee40 con 0x7f45b415abc0 2024-09-13T15:07:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b413ed00 con 0x7f45b40b1f50 2024-09-13T15:07:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b41599e0 con 0x7f45b415a7e0 2024-09-13T15:07:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 0x7f45b4156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415a7e0 0x7f45b4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 0x7f45b4156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39502/0 (socket says 172.21.15.50:39502) 2024-09-13T15:07:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b41ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 -- 172.21.15.50:0/1959412807 learned_addr learned my addr 172.21.15.50:0/1959412807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 -- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415a7e0 msgr2=0x7f45b4156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415a7e0 0x7f45b4156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 -- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 msgr2=0x7f45b41ef6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b41ef6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 -- 172.21.15.50:0/1959412807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009570 con 0x7f45b415abc0 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9000700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 0x7f45b4156f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00efc0 tx=0x7f45ac009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac009b20 con 0x7f45b415abc0 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac00f040 con 0x7f45b415abc0 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b4159cc0 con 0x7f45b415abc0 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00cc90 con 0x7f45b415abc0 2024-09-13T15:07:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.073+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b4159fa0 con 0x7f45b415abc0 2024-09-13T15:07:50.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.077+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b414f320 con 0x7f45b415abc0 2024-09-13T15:07:50.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.077+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45ac014480 con 0x7f45b415abc0 2024-09-13T15:07:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.081+0000 7f45abe00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4594066730 0x7f4594068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.081+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45ac084df0 con 0x7f45b415abc0 2024-09-13T15:07:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.081+0000 7f45b3e00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4594066730 0x7f4594068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.081+0000 7f45b3e00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4594066730 0x7f4594068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45b415e220 tx=0x7f45a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.085+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45b414f320 con 0x7f45b415abc0 2024-09-13T15:07:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.273+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45b414f320 con 0x7f45b415abc0 2024-09-13T15:07:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.273+0000 7f45abe00700 1 -- 172.21.15.50:0/1959412807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45b414f320 con 0x7f45b415abc0 2024-09-13T15:07:50.275 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:07:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4594066730 msgr2=0x7f4594068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4594066730 0x7f4594068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45b415e220 tx=0x7f45a4009040 comp rx=0 tx=0).stop 2024-09-13T15:07:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 msgr2=0x7f45b4156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 0x7f45b4156f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00efc0 tx=0x7f45ac009f60 comp rx=0 tx=0).stop 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 shutdown_connections 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4594066730 0x7f4594068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45b415abc0 0x7f45b4156f80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45b415a7e0 0x7f45b4156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 --2- 172.21.15.50:0/1959412807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45b40b1f50 0x7f45b41ef6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 >> 172.21.15.50:0/1959412807 conn(0x7f45b406cb90 msgr2=0x7f45b40cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 shutdown_connections 2024-09-13T15:07:50.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.277+0000 7f45b9a00700 1 -- 172.21.15.50:0/1959412807 wait complete. 2024-09-13T15:07:50.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:07:50.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.473+0000 7f1106000700 1 Processor -- start 2024-09-13T15:07:50.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.473+0000 7f1106000700 1 -- start start 2024-09-13T15:07:50.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.473+0000 7f1106000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1100143b70 0x7f11000cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.473+0000 7f1106000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000b1980 con 0x7f110006d070 2024-09-13T15:07:50.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.473+0000 7f1106000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000b2500 con 0x7f110006d620 2024-09-13T15:07:50.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.473+0000 7f1106000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000b1bd0 con 0x7f1100143b70 2024-09-13T15:07:50.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1105600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f110006d070 0x7f11000b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50218/0 (socket says 172.21.15.50:50218) 2024-09-13T15:07:50.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1105600700 1 -- 172.21.15.50:0/3912157429 learned_addr learned my addr 172.21.15.50:0/3912157429 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:50.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1104c00700 1 --2- 172.21.15.50:0/3912157429 >> v2:172.21.15.181:3300/0 conn(0x7f1100143b70 0x7f11000cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965965765 0 0) 0x7f11000b1980 con 0x7f110006d070 2024-09-13T15:07:50.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e80035d0 con 0x7f110006d070 2024-09-13T15:07:50.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627412817 0 0) 0x7f11000b2500 con 0x7f110006d620 2024-09-13T15:07:50.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11000b1980 con 0x7f110006d620 2024-09-13T15:07:50.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1104c00700 1 -- 172.21.15.50:0/3912157429 >> v1:172.21.15.181:6789/0 conn(0x7f110006d620 legacy=0x7f110006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1104c00700 1 -- 172.21.15.50:0/3912157429 >> v1:172.21.15.50:6789/0 conn(0x7f110006d070 legacy=0x7f11000b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1104c00700 1 -- 172.21.15.50:0/3912157429 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000b1eb0 con 0x7f1100143b70 2024-09-13T15:07:50.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f1104c00700 1 --2- 172.21.15.50:0/3912157429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11000cde20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009850 tx=0x7f10f4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bccffb9201dd3d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4011830 con 0x7f1100143b70 2024-09-13T15:07:50.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4011990 con 0x7f1100143b70 2024-09-13T15:07:50.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.477+0000 7f10ff400700 1 -- 172.21.15.50:0/3912157429 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4011d40 con 0x7f1100143b70 2024-09-13T15:07:50.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 -- 172.21.15.50:0/3912157429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 msgr2=0x7f11000cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 --2- 172.21.15.50:0/3912157429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11000cde20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009850 tx=0x7f10f4009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:50.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 -- 172.21.15.50:0/3912157429 shutdown_connections 2024-09-13T15:07:50.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 --2- 172.21.15.50:0/3912157429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11000cde20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 -- 172.21.15.50:0/3912157429 >> 172.21.15.50:0/3912157429 conn(0x7f110006a390 msgr2=0x7f110006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:50.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 -- 172.21.15.50:0/3912157429 shutdown_connections 2024-09-13T15:07:50.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.481+0000 7f1106000700 1 -- 172.21.15.50:0/3912157429 wait complete. 2024-09-13T15:07:50.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 Processor -- start 2024-09-13T15:07:50.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 -- start start 2024-09-13T15:07:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 0x7f11001558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f110006d620 0x7f11001e4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11001e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11001365a0 con 0x7f110006d070 2024-09-13T15:07:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11001e7cc0 con 0x7f1100143b70 2024-09-13T15:07:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1106000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11001e8690 con 0x7f110006d620 2024-09-13T15:07:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 0x7f11001558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 0x7f11001558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39518/0 (socket says 172.21.15.50:39518) 2024-09-13T15:07:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 -- 172.21.15.50:0/1229209438 learned_addr learned my addr 172.21.15.50:0/1229209438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f10ffe00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f110006d620 0x7f11001e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1105600700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11001e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 -- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f110006d620 msgr2=0x7f11001e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f110006d620 0x7f11001e4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 -- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 msgr2=0x7f11001e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11001e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 -- 172.21.15.50:0/1229209438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40094b0 con 0x7f110006d070 2024-09-13T15:07:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1105600700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11001e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.485+0000 7f1104c00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 0x7f11001558d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10f40090b0 tx=0x7f10f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4019a00 con 0x7f110006d070 2024-09-13T15:07:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11001e70b0 con 0x7f110006d070 2024-09-13T15:07:50.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f401e070 con 0x7f110006d070 2024-09-13T15:07:50.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4019dc0 con 0x7f110006d070 2024-09-13T15:07:50.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11001e7670 con 0x7f110006d070 2024-09-13T15:07:50.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11000cde20 con 0x7f110006d070 2024-09-13T15:07:50.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.489+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10f402d450 con 0x7f110006d070 2024-09-13T15:07:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.493+0000 7f10fcc00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10e0066730 0x7f10e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.493+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10f4085480 con 0x7f110006d070 2024-09-13T15:07:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.493+0000 7f10ffe00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10e0066730 0x7f10e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.493+0000 7f10ffe00700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10e0066730 0x7f10e0068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1100159400 tx=0x7f10ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.501+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10f4052470 con 0x7f110006d070 2024-09-13T15:07:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.681+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11000cc530 con 0x7f110006d070 2024-09-13T15:07:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f10fcc00700 1 -- 172.21.15.50:0/1229209438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10f4055a90 con 0x7f110006d070 2024-09-13T15:07:50.687 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:07:50.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10e0066730 msgr2=0x7f10e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10e0066730 0x7f10e0068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1100159400 tx=0x7f10ec009040 comp rx=0 tx=0).stop 2024-09-13T15:07:50.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 msgr2=0x7f11001558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 0x7f11001558d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10f40090b0 tx=0x7f10f4004770 comp rx=0 tx=0).stop 2024-09-13T15:07:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 shutdown_connections 2024-09-13T15:07:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10e0066730 0x7f10e0068bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1100143b70 0x7f11001e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f110006d620 0x7f11001e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 --2- 172.21.15.50:0/1229209438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110006d070 0x7f11001558d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 >> 172.21.15.50:0/1229209438 conn(0x7f110006a390 msgr2=0x7f110015c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:50.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 shutdown_connections 2024-09-13T15:07:50.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.685+0000 7f1106000700 1 -- 172.21.15.50:0/1229209438 wait complete. 2024-09-13T15:07:50.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:07:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.885+0000 7f3baca00700 1 Processor -- start 2024-09-13T15:07:50.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.885+0000 7f3baca00700 1 -- start start 2024-09-13T15:07:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.889+0000 7f3baca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 0x7f3ba80cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.889+0000 7f3baca00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ba806d620 0x7f3ba806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.889+0000 7f3baca00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba80b1980 con 0x7f3ba806cea0 2024-09-13T15:07:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.889+0000 7f3baca00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba80b2500 con 0x7f3ba806d620 2024-09-13T15:07:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.889+0000 7f3baca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba806d2f0 con 0x7f3ba8143b70 2024-09-13T15:07:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 0x7f3ba80cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 0x7f3ba80cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:40408/0 (socket says 172.21.15.50:40408) 2024-09-13T15:07:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 -- 172.21.15.50:0/4165447227 learned_addr learned my addr 172.21.15.50:0/4165447227 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3b9ea00700 1 --2- 172.21.15.50:0/4165447227 >> v2:172.21.15.50:3300/0 conn(0x7f3ba806d620 0x7f3ba806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 -- 172.21.15.50:0/4165447227 >> v2:172.21.15.50:3300/0 conn(0x7f3ba806d620 msgr2=0x7f3ba806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 --2- 172.21.15.50:0/4165447227 >> v2:172.21.15.50:3300/0 conn(0x7f3ba806d620 0x7f3ba806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 -- 172.21.15.50:0/4165447227 >> v1:172.21.15.50:6789/0 conn(0x7f3ba806cea0 legacy=0x7f3ba815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 -- 172.21.15.50:0/4165447227 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80b1bd0 con 0x7f3ba8143b70 2024-09-13T15:07:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba7400700 1 --2- 172.21.15.50:0/4165447227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 0x7f3ba80cde20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009910 tx=0x7f3b98009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=242cbafa589ca2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba6a00700 1 -- 172.21.15.50:0/4165447227 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800ba60 con 0x7f3ba8143b70 2024-09-13T15:07:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba6a00700 1 -- 172.21.15.50:0/4165447227 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800bbc0 con 0x7f3ba8143b70 2024-09-13T15:07:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3ba6a00700 1 -- 172.21.15.50:0/4165447227 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98009e60 con 0x7f3ba8143b70 2024-09-13T15:07:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 -- 172.21.15.50:0/4165447227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 msgr2=0x7f3ba80cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 --2- 172.21.15.50:0/4165447227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 0x7f3ba80cde20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009910 tx=0x7f3b98009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 -- 172.21.15.50:0/4165447227 shutdown_connections 2024-09-13T15:07:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 --2- 172.21.15.50:0/4165447227 >> v2:172.21.15.50:3300/0 conn(0x7f3ba806d620 0x7f3ba806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 --2- 172.21.15.50:0/4165447227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba8143b70 0x7f3ba80cde20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 -- 172.21.15.50:0/4165447227 >> 172.21.15.50:0/4165447227 conn(0x7f3ba806a390 msgr2=0x7f3ba806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 -- 172.21.15.50:0/4165447227 shutdown_connections 2024-09-13T15:07:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.893+0000 7f3baca00700 1 -- 172.21.15.50:0/4165447227 wait complete. 2024-09-13T15:07:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.897+0000 7f3baca00700 1 Processor -- start 2024-09-13T15:07:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.897+0000 7f3baca00700 1 -- start start 2024-09-13T15:07:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba806cea0 0x7f3ba8142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 0x7f3ba815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ba8143b70 0x7f3ba815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81f2ad0 con 0x7f3ba806d620 2024-09-13T15:07:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81e45b0 con 0x7f3ba8143b70 2024-09-13T15:07:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81e4890 con 0x7f3ba806cea0 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 0x7f3ba815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 0x7f3ba815d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39538/0 (socket says 172.21.15.50:39538) 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 -- 172.21.15.50:0/4244456005 learned_addr learned my addr 172.21.15.50:0/4244456005 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3ba7400700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba806cea0 0x7f3ba8142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3ba7e00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ba8143b70 0x7f3ba815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 -- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba806cea0 msgr2=0x7f3ba8142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba806cea0 0x7f3ba8142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 -- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ba8143b70 msgr2=0x7f3ba815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ba8143b70 0x7f3ba815d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 -- 172.21.15.50:0/4244456005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009570 con 0x7f3ba806d620 2024-09-13T15:07:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3ba7e00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ba8143b70 0x7f3ba815d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9ea00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 0x7f3ba815d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000e760 tx=0x7f3b9000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90013610 con 0x7f3ba806d620 2024-09-13T15:07:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90013770 con 0x7f3ba806d620 2024-09-13T15:07:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba81e4b70 con 0x7f3ba806d620 2024-09-13T15:07:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90013ae0 con 0x7f3ba806d620 2024-09-13T15:07:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.901+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba81e5130 con 0x7f3ba806d620 2024-09-13T15:07:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.905+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba81e7530 con 0x7f3ba806d620 2024-09-13T15:07:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.905+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b90013c40 con 0x7f3ba806d620 2024-09-13T15:07:50.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.909+0000 7f3b9fe00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b84066730 0x7f3b84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.909+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b900840b0 con 0x7f3ba806d620 2024-09-13T15:07:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.909+0000 7f3ba7400700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b84066730 0x7f3b84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.909+0000 7f3ba7400700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b84066730 0x7f3b84068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b98000c00 tx=0x7f3b98008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:50.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:50.913+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ba81e7530 con 0x7f3ba806d620 2024-09-13T15:07:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.101+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3ba81e7530 con 0x7f3ba806d620 2024-09-13T15:07:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.101+0000 7f3b9fe00700 1 -- 172.21.15.50:0/4244456005 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3ba81e7530 con 0x7f3ba806d620 2024-09-13T15:07:51.106 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:07:51.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b84066730 msgr2=0x7f3b84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b84066730 0x7f3b84068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b98000c00 tx=0x7f3b98008030 comp rx=0 tx=0).stop 2024-09-13T15:07:51.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 msgr2=0x7f3ba815d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 0x7f3ba815d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000e760 tx=0x7f3b9000ea70 comp rx=0 tx=0).stop 2024-09-13T15:07:51.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 shutdown_connections 2024-09-13T15:07:51.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b84066730 0x7f3b84068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ba8143b70 0x7f3ba815d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba806d620 0x7f3ba815d260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 --2- 172.21.15.50:0/4244456005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ba806cea0 0x7f3ba8142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 >> 172.21.15.50:0/4244456005 conn(0x7f3ba806a390 msgr2=0x7f3ba80b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.105+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 shutdown_connections 2024-09-13T15:07:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.109+0000 7f3baca00700 1 -- 172.21.15.50:0/4244456005 wait complete. 2024-09-13T15:07:51.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:07:51.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 Processor -- start 2024-09-13T15:07:51.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 -- start start 2024-09-13T15:07:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0e00cb020 0x7fb0e00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb0e015c2a0 0x7fb0e015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e006aaa0 0x7fb0e006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e006b430 con 0x7fb0e00cb020 2024-09-13T15:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e00b2ad0 con 0x7fb0e015c2a0 2024-09-13T15:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e6a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e015b960 con 0x7fb0e006aaa0 2024-09-13T15:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.305+0000 7fb0e5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0e00cb020 0x7fb0e00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb0e015c2a0 0x7fb0e015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e006aaa0 0x7fb0e006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb0e015c2a0 0x7fb0e015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:36582/0 (socket says 172.21.15.50:36582) 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 -- 172.21.15.50:0/1787371635 learned_addr learned my addr 172.21.15.50:0/1787371635 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0e00cb020 0x7fb0e00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39552/0 (socket says 172.21.15.50:39552) 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 -- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e006aaa0 msgr2=0x7fb0e006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 --2- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e006aaa0 0x7fb0e006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 -- 172.21.15.50:0/1787371635 >> v2:172.21.15.50:3300/0 conn(0x7fb0e00cb020 msgr2=0x7fb0e00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 --2- 172.21.15.50:0/1787371635 >> v2:172.21.15.50:3300/0 conn(0x7fb0e00cb020 0x7fb0e00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 -- 172.21.15.50:0/1787371635 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e015bc40 con 0x7fb0e015c2a0 2024-09-13T15:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e4c00700 1 --2- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e015c2a0 0x7fb0e015b0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0e015e630 tx=0x7fb0cc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f819c9f0ec34b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0dfe00700 1 -- 172.21.15.50:0/1787371635 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc011830 con 0x7fb0e015c2a0 2024-09-13T15:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0dfe00700 1 -- 172.21.15.50:0/1787371635 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc011990 con 0x7fb0e015c2a0 2024-09-13T15:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0dfe00700 1 -- 172.21.15.50:0/1787371635 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc011d20 con 0x7fb0e015c2a0 2024-09-13T15:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e015c2a0 msgr2=0x7fb0e015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e015c2a0 0x7fb0e015b0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0e015e630 tx=0x7fb0cc009bf0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1787371635 shutdown_connections 2024-09-13T15:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e006aaa0 0x7fb0e006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1787371635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e015c2a0 0x7fb0e015b0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1787371635 >> v2:172.21.15.50:3300/0 conn(0x7fb0e00cb020 0x7fb0e00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1787371635 >> 172.21.15.50:0/1787371635 conn(0x7fb0e00b0c40 msgr2=0x7fb0e006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1787371635 shutdown_connections 2024-09-13T15:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.309+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1787371635 wait complete. 2024-09-13T15:07:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.313+0000 7fb0e6a00700 1 Processor -- start 2024-09-13T15:07:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.313+0000 7fb0e6a00700 1 -- start start 2024-09-13T15:07:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 0x7fb0e01490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e00cb020 0x7fb0e014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e015c2a0 0x7fb0e014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0147880 con 0x7fb0e006aaa0 2024-09-13T15:07:51.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0148010 con 0x7fb0e00cb020 2024-09-13T15:07:51.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01482f0 con 0x7fb0e015c2a0 2024-09-13T15:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 0x7fb0e01490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 0x7fb0e01490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39566/0 (socket says 172.21.15.50:39566) 2024-09-13T15:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 -- 172.21.15.50:0/1267842375 learned_addr learned my addr 172.21.15.50:0/1267842375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e4c00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e00cb020 0x7fb0e014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6000700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e015c2a0 0x7fb0e014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 -- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e015c2a0 msgr2=0x7fb0e014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e015c2a0 0x7fb0e014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 -- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e00cb020 msgr2=0x7fb0e014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e00cb020 0x7fb0e014e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 -- 172.21.15.50:0/1267842375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009570 con 0x7fb0e006aaa0 2024-09-13T15:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e5600700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 0x7fb0e01490b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400e840 tx=0x7fb0d400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40095a0 con 0x7fb0e006aaa0 2024-09-13T15:07:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d4013680 con 0x7fb0e006aaa0 2024-09-13T15:07:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e01485d0 con 0x7fb0e006aaa0 2024-09-13T15:07:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40139f0 con 0x7fb0e006aaa0 2024-09-13T15:07:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.317+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e0148b90 con 0x7fb0e006aaa0 2024-09-13T15:07:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.321+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e015c6f0 con 0x7fb0e006aaa0 2024-09-13T15:07:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.321+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0d4013b50 con 0x7fb0e006aaa0 2024-09-13T15:07:51.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.325+0000 7fb0dd600700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0c0066730 0x7fb0c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.325+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0d4084330 con 0x7fb0e006aaa0 2024-09-13T15:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.325+0000 7fb0e4c00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0c0066730 0x7fb0c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.325+0000 7fb0e4c00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0c0066730 0x7fb0c0068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000c00 tx=0x7fb0cc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:51.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.329+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0d4051310 con 0x7fb0e006aaa0 2024-09-13T15:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.529+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0e00700c0 con 0x7fb0e006aaa0 2024-09-13T15:07:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.529+0000 7fb0dd600700 1 -- 172.21.15.50:0/1267842375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb0d4054930 con 0x7fb0e006aaa0 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0c0066730 msgr2=0x7fb0c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0c0066730 0x7fb0c0068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000c00 tx=0x7fb0cc008030 comp rx=0 tx=0).stop 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 msgr2=0x7fb0e01490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 0x7fb0e01490b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400e840 tx=0x7fb0d400eb50 comp rx=0 tx=0).stop 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 shutdown_connections 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0c0066730 0x7fb0c0068bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0e015c2a0 0x7fb0e014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0e00cb020 0x7fb0e014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 --2- 172.21.15.50:0/1267842375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0e006aaa0 0x7fb0e01490b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 >> 172.21.15.50:0/1267842375 conn(0x7fb0e00b0c40 msgr2=0x7fb0e006bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 shutdown_connections 2024-09-13T15:07:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.537+0000 7fb0e6a00700 1 -- 172.21.15.50:0/1267842375 wait complete. 2024-09-13T15:07:51.541 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:07:51.561 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:07:51.561 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:07:51.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:07:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.797+0000 7ff12d800700 1 Processor -- start 2024-09-13T15:07:51.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.797+0000 7ff12d800700 1 -- start start 2024-09-13T15:07:51.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff12d800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff12806aaa0 0x7ff12806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff12d800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1280b3560 con 0x7ff1281610b0 2024-09-13T15:07:51.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff12d800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1280b3280 con 0x7ff1280b2670 2024-09-13T15:07:51.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff12d800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff128070b30 con 0x7ff12806aaa0 2024-09-13T15:07:51.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff127e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff1281610b0 0x7ff1280719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50226/0 (socket says 172.21.15.50:50226) 2024-09-13T15:07:51.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff127e00700 1 -- 172.21.15.50:0/4115115801 learned_addr learned my addr 172.21.15.50:0/4115115801 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:51.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff11fe00700 1 --2- 172.21.15.50:0/4115115801 >> v2:172.21.15.50:3300/0 conn(0x7ff12806aaa0 0x7ff12806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff11fe00700 1 -- 172.21.15.50:0/4115115801 >> v1:172.21.15.181:6789/0 conn(0x7ff1280b2670 legacy=0x7ff1280b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff11fe00700 1 -- 172.21.15.50:0/4115115801 >> v1:172.21.15.50:6789/0 conn(0x7ff1281610b0 legacy=0x7ff1280719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff11fe00700 1 -- 172.21.15.50:0/4115115801 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128070ee0 con 0x7ff12806aaa0 2024-09-13T15:07:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff127400700 1 -- 172.21.15.50:0/4115115801 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576255317 0 0) 0x7ff1280b3560 con 0x7ff1281610b0 2024-09-13T15:07:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff11fe00700 1 --2- 172.21.15.50:0/4115115801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff12806af10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff110009880 tx=0x7ff110009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83d945ba4bb754e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:51.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff127400700 1 -- 172.21.15.50:0/4115115801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110011830 con 0x7ff12806aaa0 2024-09-13T15:07:51.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff127400700 1 -- 172.21.15.50:0/4115115801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff110011990 con 0x7ff12806aaa0 2024-09-13T15:07:51.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff127400700 1 -- 172.21.15.50:0/4115115801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110011d20 con 0x7ff12806aaa0 2024-09-13T15:07:51.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff12d800700 1 -- 172.21.15.50:0/4115115801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 msgr2=0x7ff12806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.801+0000 7ff12d800700 1 --2- 172.21.15.50:0/4115115801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff12806af10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff110009880 tx=0x7ff110009b90 comp rx=0 tx=0).stop 2024-09-13T15:07:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 -- 172.21.15.50:0/4115115801 shutdown_connections 2024-09-13T15:07:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 --2- 172.21.15.50:0/4115115801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff12806af10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 -- 172.21.15.50:0/4115115801 >> 172.21.15.50:0/4115115801 conn(0x7ff1280b0c40 msgr2=0x7ff12806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 -- 172.21.15.50:0/4115115801 shutdown_connections 2024-09-13T15:07:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 -- 172.21.15.50:0/4115115801 wait complete. 2024-09-13T15:07:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 Processor -- start 2024-09-13T15:07:51.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.805+0000 7ff12d800700 1 -- start start 2024-09-13T15:07:51.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff1280ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1280b2670 0x7ff12814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1281610b0 0x7ff12814a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12814a520 con 0x7ff12806aaa0 2024-09-13T15:07:51.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12814d130 con 0x7ff1281610b0 2024-09-13T15:07:51.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff128159040 con 0x7ff1280b2670 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff1280ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff1280ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39582/0 (socket says 172.21.15.50:39582) 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 -- 172.21.15.50:0/800622060 learned_addr learned my addr 172.21.15.50:0/800622060 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12ce00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1281610b0 0x7ff12814a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff11fe00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1280b2670 0x7ff12814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 -- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1280b2670 msgr2=0x7ff12814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1280b2670 0x7ff12814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 -- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1281610b0 msgr2=0x7ff12814a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1281610b0 0x7ff12814a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:51.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 -- 172.21.15.50:0/800622060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100094b0 con 0x7ff12806aaa0 2024-09-13T15:07:51.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12ce00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1281610b0 0x7ff12814a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:51.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff127e00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff1280ad3a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff11800c4a0 tx=0x7ff11800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118004ca0 con 0x7ff12806aaa0 2024-09-13T15:07:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1281498a0 con 0x7ff12806aaa0 2024-09-13T15:07:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118004e00 con 0x7ff12806aaa0 2024-09-13T15:07:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118007310 con 0x7ff12806aaa0 2024-09-13T15:07:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.809+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff128149e60 con 0x7ff12806aaa0 2024-09-13T15:07:51.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.813+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12814a790 con 0x7ff12806aaa0 2024-09-13T15:07:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.813+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff118007470 con 0x7ff12806aaa0 2024-09-13T15:07:51.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.813+0000 7ff124c00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff104066730 0x7ff104068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:51.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.813+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff118084120 con 0x7ff12806aaa0 2024-09-13T15:07:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.817+0000 7ff11fe00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff104066730 0x7ff104068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:51.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.817+0000 7ff11fe00700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff104066730 0x7ff104068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1100090b0 tx=0x7ff110008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:51.821+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff118051080 con 0x7ff12806aaa0 2024-09-13T15:07:52.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.017+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff12806af10 con 0x7ff12806aaa0 2024-09-13T15:07:52.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.021+0000 7ff124c00700 1 -- 172.21.15.50:0/800622060 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff118007720 con 0x7ff12806aaa0 2024-09-13T15:07:52.023 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:07:52.023 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:07:52.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff104066730 msgr2=0x7ff104068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff104066730 0x7ff104068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1100090b0 tx=0x7ff110008030 comp rx=0 tx=0).stop 2024-09-13T15:07:52.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 msgr2=0x7ff1280ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff1280ad3a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff11800c4a0 tx=0x7ff11800c7b0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 shutdown_connections 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff104066730 0x7ff104068bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1281610b0 0x7ff12814a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1280b2670 0x7ff12814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 --2- 172.21.15.50:0/800622060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12806aaa0 0x7ff1280ad3a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 >> 172.21.15.50:0/800622060 conn(0x7ff1280b0c40 msgr2=0x7ff12806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 shutdown_connections 2024-09-13T15:07:52.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.025+0000 7ff12d800700 1 -- 172.21.15.50:0/800622060 wait complete. 2024-09-13T15:07:52.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:07:52.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:07:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.221+0000 7fa9a6000700 1 Processor -- start 2024-09-13T15:07:52.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.221+0000 7fa9a6000700 1 -- start start 2024-09-13T15:07:52.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa9a6000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9a01604a0 0x7fa9a00d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa9a6000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a00cfee0 0x7fa9a00ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa9a6000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a00cdb00 con 0x7fa9a00d38e0 2024-09-13T15:07:52.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa9a6000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a00cdde0 con 0x7fa9a00cfee0 2024-09-13T15:07:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa9a6000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a00ce0c0 con 0x7fa9a01604a0 2024-09-13T15:07:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a00cfee0 0x7fa9a00ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a00cfee0 0x7fa9a00ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39584/0 (socket says 172.21.15.50:39584) 2024-09-13T15:07:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 -- 172.21.15.50:0/318148809 learned_addr learned my addr 172.21.15.50:0/318148809 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99f400700 1 --2- 172.21.15.50:0/318148809 >> v2:172.21.15.181:3300/0 conn(0x7fa9a01604a0 0x7fa9a00d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 -- 172.21.15.50:0/318148809 >> v2:172.21.15.181:3300/0 conn(0x7fa9a01604a0 msgr2=0x7fa9a00d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 --2- 172.21.15.50:0/318148809 >> v2:172.21.15.181:3300/0 conn(0x7fa9a01604a0 0x7fa9a00d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 -- 172.21.15.50:0/318148809 >> v1:172.21.15.181:6789/0 conn(0x7fa9a00d38e0 legacy=0x7fa9a00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 -- 172.21.15.50:0/318148809 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00ce3a0 con 0x7fa9a00cfee0 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99f400700 1 --2- 172.21.15.50:0/318148809 >> v2:172.21.15.181:3300/0 conn(0x7fa9a01604a0 0x7fa9a00d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99fe00700 1 --2- 172.21.15.50:0/318148809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a00cfee0 0x7fa9a00ce8c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9a006e220 tx=0x7fa99800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2cae1d8c057751 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99e000700 1 -- 172.21.15.50:0/318148809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99800e070 con 0x7fa9a00cfee0 2024-09-13T15:07:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99e000700 1 -- 172.21.15.50:0/318148809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99800b9c0 con 0x7fa9a00cfee0 2024-09-13T15:07:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.225+0000 7fa99e000700 1 -- 172.21.15.50:0/318148809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99800bd70 con 0x7fa9a00cfee0 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 -- 172.21.15.50:0/318148809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a00cfee0 msgr2=0x7fa9a00ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 --2- 172.21.15.50:0/318148809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a00cfee0 0x7fa9a00ce8c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9a006e220 tx=0x7fa99800b330 comp rx=0 tx=0).stop 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 -- 172.21.15.50:0/318148809 shutdown_connections 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 --2- 172.21.15.50:0/318148809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a00cfee0 0x7fa9a00ce8c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 --2- 172.21.15.50:0/318148809 >> v2:172.21.15.181:3300/0 conn(0x7fa9a01604a0 0x7fa9a00d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 -- 172.21.15.50:0/318148809 >> 172.21.15.50:0/318148809 conn(0x7fa9a00d2dc0 msgr2=0x7fa9a00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 -- 172.21.15.50:0/318148809 shutdown_connections 2024-09-13T15:07:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 -- 172.21.15.50:0/318148809 wait complete. 2024-09-13T15:07:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 Processor -- start 2024-09-13T15:07:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.229+0000 7fa9a6000700 1 -- start start 2024-09-13T15:07:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa9a6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a00cfee0 0x7fa9a015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa9a6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a00d38e0 0x7fa9a009e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa9a6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 0x7fa9a009ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa9a6000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a009d230 con 0x7fa9a01604a0 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa9a6000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a009ccb0 con 0x7fa9a00d38e0 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa9a6000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a015ec70 con 0x7fa9a00cfee0 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 0x7fa9a009ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 0x7fa9a009ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39586/0 (socket says 172.21.15.50:39586) 2024-09-13T15:07:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 -- 172.21.15.50:0/40270780 learned_addr learned my addr 172.21.15.50:0/40270780 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99f400700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a00cfee0 0x7fa9a015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99ea00700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a00d38e0 0x7fa9a009e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 -- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a00cfee0 msgr2=0x7fa9a015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a00cfee0 0x7fa9a015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 -- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a00d38e0 msgr2=0x7fa9a009e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a00d38e0 0x7fa9a009e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 -- 172.21.15.50:0/40270780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998009b30 con 0x7fa9a01604a0 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa99fe00700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 0x7fa9a009ebb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9a006e130 tx=0x7fa998004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998004930 con 0x7fa9a01604a0 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.233+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9980099b0 con 0x7fa9a01604a0 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.237+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99801b670 con 0x7fa9a01604a0 2024-09-13T15:07:52.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.237+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a009cf50 con 0x7fa9a01604a0 2024-09-13T15:07:52.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.237+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a009f700 con 0x7fa9a01604a0 2024-09-13T15:07:52.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.237+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a00d16e0 con 0x7fa9a01604a0 2024-09-13T15:07:52.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.241+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa99801b7d0 con 0x7fa9a01604a0 2024-09-13T15:07:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.241+0000 7fa997400700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa980066730 0x7fa980068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.241+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa998085d90 con 0x7fa9a01604a0 2024-09-13T15:07:52.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.241+0000 7fa99f400700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa980066730 0x7fa980068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.241+0000 7fa99f400700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa980066730 0x7fa980068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9900099f0 tx=0x7fa990008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.249+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa998052e00 con 0x7fa9a01604a0 2024-09-13T15:07:52.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.433+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9a00cf5b0 con 0x7fa9a01604a0 2024-09-13T15:07:52.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.433+0000 7fa997400700 1 -- 172.21.15.50:0/40270780 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa99801f020 con 0x7fa9a01604a0 2024-09-13T15:07:52.436 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:07:52.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa980066730 msgr2=0x7fa980068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa980066730 0x7fa980068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9900099f0 tx=0x7fa990008040 comp rx=0 tx=0).stop 2024-09-13T15:07:52.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 msgr2=0x7fa9a009ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 0x7fa9a009ebb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9a006e130 tx=0x7fa998004af0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 shutdown_connections 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa980066730 0x7fa980068bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a01604a0 0x7fa9a009ebb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a00d38e0 0x7fa9a009e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 --2- 172.21.15.50:0/40270780 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a00cfee0 0x7fa9a015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 >> 172.21.15.50:0/40270780 conn(0x7fa9a00d2dc0 msgr2=0x7fa9a00cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 shutdown_connections 2024-09-13T15:07:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.437+0000 7fa9a6000700 1 -- 172.21.15.50:0/40270780 wait complete. 2024-09-13T15:07:52.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:07:52.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.653+0000 7f6e93e00700 1 Processor -- start 2024-09-13T15:07:52.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.653+0000 7f6e93e00700 1 -- start start 2024-09-13T15:07:52.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e93e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e9406c5a0 0x7f6e9415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e93e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940b4680 con 0x7f6e940cf830 2024-09-13T15:07:52.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e93e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940b4960 con 0x7f6e9406c980 2024-09-13T15:07:52.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e93e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940b5dd0 con 0x7f6e9406c5a0 2024-09-13T15:07:52.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e93400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e940cf830 0x7f6e940cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50234/0 (socket says 172.21.15.50:50234) 2024-09-13T15:07:52.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e92a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e9406c5a0 0x7f6e9415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e93400700 1 -- 172.21.15.50:0/3968036224 learned_addr learned my addr 172.21.15.50:0/3968036224 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:52.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e91600700 1 -- 172.21.15.50:0/3968036224 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136943822 0 0) 0x7f6e940b4680 con 0x7f6e940cf830 2024-09-13T15:07:52.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e91600700 1 -- 172.21.15.50:0/3968036224 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e780035d0 con 0x7f6e940cf830 2024-09-13T15:07:52.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e92a00700 1 -- 172.21.15.50:0/3968036224 >> v1:172.21.15.181:6789/0 conn(0x7f6e9406c980 legacy=0x7f6e940b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e92a00700 1 -- 172.21.15.50:0/3968036224 >> v1:172.21.15.50:6789/0 conn(0x7f6e940cf830 legacy=0x7f6e940cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.657+0000 7f6e92a00700 1 -- 172.21.15.50:0/3968036224 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940cf030 con 0x7f6e9406c5a0 2024-09-13T15:07:52.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e92a00700 1 --2- 172.21.15.50:0/3968036224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e9406c5a0 0x7f6e9415aa90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009850 tx=0x7f6e84009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c160ce0a6f79cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:52.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e91600700 1 -- 172.21.15.50:0/3968036224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84011830 con 0x7f6e9406c5a0 2024-09-13T15:07:52.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e91600700 1 -- 172.21.15.50:0/3968036224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84011990 con 0x7f6e9406c5a0 2024-09-13T15:07:52.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e91600700 1 -- 172.21.15.50:0/3968036224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84011d40 con 0x7f6e9406c5a0 2024-09-13T15:07:52.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 -- 172.21.15.50:0/3968036224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e9406c5a0 msgr2=0x7f6e9415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 --2- 172.21.15.50:0/3968036224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e9406c5a0 0x7f6e9415aa90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009850 tx=0x7f6e84009b60 comp rx=0 tx=0).stop 2024-09-13T15:07:52.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 -- 172.21.15.50:0/3968036224 shutdown_connections 2024-09-13T15:07:52.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 --2- 172.21.15.50:0/3968036224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e9406c5a0 0x7f6e9415aa90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 -- 172.21.15.50:0/3968036224 >> 172.21.15.50:0/3968036224 conn(0x7f6e94071d20 msgr2=0x7f6e94072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:52.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 -- 172.21.15.50:0/3968036224 shutdown_connections 2024-09-13T15:07:52.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.661+0000 7f6e93e00700 1 -- 172.21.15.50:0/3968036224 wait complete. 2024-09-13T15:07:52.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 Processor -- start 2024-09-13T15:07:52.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 -- start start 2024-09-13T15:07:52.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e9406c5a0 0x7f6e9413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e9406c980 0x7f6e9413dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 0x7f6e9413fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9413e260 con 0x7f6e940cf830 2024-09-13T15:07:52.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9413f6d0 con 0x7f6e9406c980 2024-09-13T15:07:52.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e941f2580 con 0x7f6e9406c5a0 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 0x7f6e9413fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 0x7f6e9413fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39612/0 (socket says 172.21.15.50:39612) 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 -- 172.21.15.50:0/965979331 learned_addr learned my addr 172.21.15.50:0/965979331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e92a00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e9406c5a0 0x7f6e9413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e92000700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e9406c980 0x7f6e9413dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 -- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e9406c5a0 msgr2=0x7f6e9413e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e9406c5a0 0x7f6e9413e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 -- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e9406c980 msgr2=0x7f6e9413dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e9406c980 0x7f6e9413dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 -- 172.21.15.50:0/965979331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840094b0 con 0x7f6e940cf830 2024-09-13T15:07:52.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e92000700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e9406c980 0x7f6e9413dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:52.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e93400700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 0x7f6e9413fb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00caa0 tx=0x7f6e8c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:52.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c007480 con 0x7f6e940cf830 2024-09-13T15:07:52.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c0075e0 con 0x7f6e940cf830 2024-09-13T15:07:52.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.665+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c007970 con 0x7f6e940cf830 2024-09-13T15:07:52.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.669+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e941518f0 con 0x7f6e940cf830 2024-09-13T15:07:52.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.669+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9413eda0 con 0x7f6e940cf830 2024-09-13T15:07:52.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.669+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e940cec70 con 0x7f6e940cf830 2024-09-13T15:07:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.669+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e8c01b3b0 con 0x7f6e940cf830 2024-09-13T15:07:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.673+0000 7f6e8aa00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6e74066760 0x7f6e74068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.673+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e8c083eb0 con 0x7f6e940cf830 2024-09-13T15:07:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.673+0000 7f6e92a00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6e74066760 0x7f6e74068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.673+0000 7f6e92a00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6e74066760 0x7f6e74068c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e840090b0 tx=0x7f6e84008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.677+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e8c050e00 con 0x7f6e940cf830 2024-09-13T15:07:52.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.853+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e9413f810 con 0x7f6e940cf830 2024-09-13T15:07:52.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.853+0000 7f6e8aa00700 1 -- 172.21.15.50:0/965979331 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e8c054420 con 0x7f6e940cf830 2024-09-13T15:07:52.856 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:07:52.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6e74066760 msgr2=0x7f6e74068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6e74066760 0x7f6e74068c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e840090b0 tx=0x7f6e84008030 comp rx=0 tx=0).stop 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 msgr2=0x7f6e9413fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 0x7f6e9413fb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00caa0 tx=0x7f6e8c00cad0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 shutdown_connections 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6e74066760 0x7f6e74068c20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940cf830 0x7f6e9413fb60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e9406c980 0x7f6e9413dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 --2- 172.21.15.50:0/965979331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6e9406c5a0 0x7f6e9413e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 >> 172.21.15.50:0/965979331 conn(0x7f6e94071d20 msgr2=0x7f6e940b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 shutdown_connections 2024-09-13T15:07:52.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:52.857+0000 7f6e93e00700 1 -- 172.21.15.50:0/965979331 wait complete. 2024-09-13T15:07:52.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:07:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.045+0000 7f7a3b200700 1 Processor -- start 2024-09-13T15:07:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.045+0000 7f7a3b200700 1 -- start start 2024-09-13T15:07:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3b200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a3c146740 0x7f7a3c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a3c0cd450 0x7f7a3c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c0c9df0 0x7f7a3c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3b200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c15e220 con 0x7f7a3c146740 2024-09-13T15:07:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c0cde20 con 0x7f7a3c0cd450 2024-09-13T15:07:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0cfcf0 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a3c146740 0x7f7a3c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a3c146740 0x7f7a3c0cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39616/0 (socket says 172.21.15.50:39616) 2024-09-13T15:07:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 -- 172.21.15.50:0/2013858187 learned_addr learned my addr 172.21.15.50:0/2013858187 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39400700 1 --2- 172.21.15.50:0/2013858187 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c0cd450 0x7f7a3c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a3a800700 1 --2- 172.21.15.50:0/2013858187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c0c9df0 0x7f7a3c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 -- 172.21.15.50:0/2013858187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c0c9df0 msgr2=0x7f7a3c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 --2- 172.21.15.50:0/2013858187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c0c9df0 0x7f7a3c0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 -- 172.21.15.50:0/2013858187 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c0cd450 msgr2=0x7f7a3c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 --2- 172.21.15.50:0/2013858187 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c0cd450 0x7f7a3c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39e00700 1 -- 172.21.15.50:0/2013858187 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c15d2e0 con 0x7f7a3c146740 2024-09-13T15:07:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.049+0000 7f7a39400700 1 --2- 172.21.15.50:0/2013858187 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c0cd450 0x7f7a3c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a39e00700 1 --2- 172.21.15.50:0/2013858187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c146740 0x7f7a3c0cf7b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009910 tx=0x7f7a2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450bc9ccfdad89ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a38a00700 1 -- 172.21.15.50:0/2013858187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c011830 con 0x7f7a3c146740 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a38a00700 1 -- 172.21.15.50:0/2013858187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c011990 con 0x7f7a3c146740 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a38a00700 1 -- 172.21.15.50:0/2013858187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c011d40 con 0x7f7a3c146740 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 -- 172.21.15.50:0/2013858187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c146740 msgr2=0x7f7a3c0cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 --2- 172.21.15.50:0/2013858187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c146740 0x7f7a3c0cf7b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009910 tx=0x7f7a2c009c20 comp rx=0 tx=0).stop 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 -- 172.21.15.50:0/2013858187 shutdown_connections 2024-09-13T15:07:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 --2- 172.21.15.50:0/2013858187 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c0c9df0 0x7f7a3c0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 --2- 172.21.15.50:0/2013858187 >> v2:172.21.15.181:3300/0 conn(0x7f7a3c0cd450 0x7f7a3c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 --2- 172.21.15.50:0/2013858187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c146740 0x7f7a3c0cf7b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 -- 172.21.15.50:0/2013858187 >> 172.21.15.50:0/2013858187 conn(0x7f7a3c072590 msgr2=0x7f7a3c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 -- 172.21.15.50:0/2013858187 shutdown_connections 2024-09-13T15:07:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.053+0000 7f7a3b200700 1 -- 172.21.15.50:0/2013858187 wait complete. 2024-09-13T15:07:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 Processor -- start 2024-09-13T15:07:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 -- start start 2024-09-13T15:07:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 0x7f7a3c144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c0cd450 0x7f7a3c06f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c146740 0x7f7a3c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c157980 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c156240 con 0x7f7a3c0cd450 2024-09-13T15:07:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.057+0000 7f7a3b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c156520 con 0x7f7a3c146740 2024-09-13T15:07:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 0x7f7a3c144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 0x7f7a3c144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39624/0 (socket says 172.21.15.50:39624) 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 -- 172.21.15.50:0/1523872743 learned_addr learned my addr 172.21.15.50:0/1523872743 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a3a800700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c146740 0x7f7a3c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39400700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c0cd450 0x7f7a3c06f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 -- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c146740 msgr2=0x7f7a3c06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c146740 0x7f7a3c06fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 -- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c0cd450 msgr2=0x7f7a3c06f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c0cd450 0x7f7a3c06f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 -- 172.21.15.50:0/1523872743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280094b0 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a3a800700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c146740 0x7f7a3c06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a39e00700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 0x7f7a3c144240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c000c00 tx=0x7f7a2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c004510 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c01e070 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c003900 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c009570 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c156ae0 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.061+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c156c70 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.065+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a2c003a60 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.065+0000 7f7a32000700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a1c066760 0x7f7a1c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.065+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a2c085440 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.065+0000 7f7a39400700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a1c066760 0x7f7a1c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.069+0000 7f7a39400700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a1c066760 0x7f7a1c068c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c1f6760 tx=0x7f7a28008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.069+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a2c052570 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.265+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a3c0b3560 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.265+0000 7f7a32000700 1 -- 172.21.15.50:0/1523872743 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a2c055b90 con 0x7f7a3c0c9df0 2024-09-13T15:07:53.269 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:07:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a1c066760 msgr2=0x7f7a1c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a1c066760 0x7f7a1c068c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c1f6760 tx=0x7f7a28008040 comp rx=0 tx=0).stop 2024-09-13T15:07:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 msgr2=0x7f7a3c144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 0x7f7a3c144240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c000c00 tx=0x7f7a2c004770 comp rx=0 tx=0).stop 2024-09-13T15:07:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 shutdown_connections 2024-09-13T15:07:53.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a1c066760 0x7f7a1c068c20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a3c146740 0x7f7a3c06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a3c0cd450 0x7f7a3c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 --2- 172.21.15.50:0/1523872743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a3c0c9df0 0x7f7a3c144240 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 >> 172.21.15.50:0/1523872743 conn(0x7f7a3c072590 msgr2=0x7f7a3c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 shutdown_connections 2024-09-13T15:07:53.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.269+0000 7f7a3b200700 1 -- 172.21.15.50:0/1523872743 wait complete. 2024-09-13T15:07:53.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:07:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.473+0000 7fa266600700 1 Processor -- start 2024-09-13T15:07:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.473+0000 7fa266600700 1 -- start start 2024-09-13T15:07:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.473+0000 7fa266600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa260144330 0x7fa2600cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.473+0000 7fa266600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa260144710 0x7fa2600b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.473+0000 7fa266600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26006bcf0 con 0x7fa26006d760 2024-09-13T15:07:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa266600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600cce10 con 0x7fa260144710 2024-09-13T15:07:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa266600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006cb50 con 0x7fa260144330 2024-09-13T15:07:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25ea00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa26006d760 0x7fa2600b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35256/0 (socket says 172.21.15.50:35256) 2024-09-13T15:07:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25ea00700 1 -- 172.21.15.50:0/862370218 learned_addr learned my addr 172.21.15.50:0/862370218 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 --2- 172.21.15.50:0/862370218 >> v2:172.21.15.50:3300/0 conn(0x7fa260144710 0x7fa2600b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25f400700 1 --2- 172.21.15.50:0/862370218 >> v2:172.21.15.181:3300/0 conn(0x7fa260144330 0x7fa2600cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249633783 0 0) 0x7fa26006bcf0 con 0x7fa26006d760 2024-09-13T15:07:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2440035d0 con 0x7fa26006d760 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033262156 0 0) 0x7fa2440035d0 con 0x7fa26006d760 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 >> v2:172.21.15.181:3300/0 conn(0x7fa260144330 msgr2=0x7fa2600cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 --2- 172.21.15.50:0/862370218 >> v2:172.21.15.181:3300/0 conn(0x7fa260144330 0x7fa2600cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 >> v2:172.21.15.50:3300/0 conn(0x7fa260144710 msgr2=0x7fa2600b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 --2- 172.21.15.50:0/862370218 >> v2:172.21.15.50:3300/0 conn(0x7fa260144710 0x7fa2600b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600cf4b0 con 0x7fa26006d760 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fa24c001670 con 0x7fa26006d760 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 --2- 172.21.15.50:0/862370218 >> v2:172.21.15.50:3300/0 conn(0x7fa260144710 0x7fa2600b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 >> v1:172.21.15.50:6789/0 conn(0x7fa26006d760 legacy=0x7fa2600b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa244003a20 0x7fa244003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244004870 0x7fa244004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa244005230 0x7fa24400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600cce10 con 0x7fa244005230 2024-09-13T15:07:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26006cb50 con 0x7fa244004870 2024-09-13T15:07:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400bfc0 con 0x7fa244003a20 2024-09-13T15:07:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa244005230 0x7fa24400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25ea00700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244004870 0x7fa244004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25f400700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa244003a20 0x7fa244003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 -- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa244003a20 msgr2=0x7fa244003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa244003a20 0x7fa244003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 -- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244004870 msgr2=0x7fa244004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244004870 0x7fa244004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 -- 172.21.15.50:0/862370218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440035d0 con 0x7fa244005230 2024-09-13T15:07:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.477+0000 7fa25fe00700 1 -- 172.21.15.50:0/862370218 reap_dead start 2024-09-13T15:07:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa25fe00700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa244005230 0x7fa24400ba30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa25800e320 tx=0x7fa2440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee38c20067b21c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800edc0 con 0x7fa244005230 2024-09-13T15:07:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800f040 con 0x7fa244005230 2024-09-13T15:07:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa25e000700 1 -- 172.21.15.50:0/862370218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580146c0 con 0x7fa244005230 2024-09-13T15:07:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 -- 172.21.15.50:0/862370218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa244005230 msgr2=0x7fa24400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa244005230 0x7fa24400ba30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa25800e320 tx=0x7fa2440058a0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 -- 172.21.15.50:0/862370218 shutdown_connections 2024-09-13T15:07:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 --2- 172.21.15.50:0/862370218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa244005230 0x7fa24400ba30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 -- 172.21.15.50:0/862370218 >> 172.21.15.50:0/862370218 conn(0x7fa26006a570 msgr2=0x7fa26006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 -- 172.21.15.50:0/862370218 shutdown_connections 2024-09-13T15:07:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.481+0000 7fa266600700 1 -- 172.21.15.50:0/862370218 wait complete. 2024-09-13T15:07:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 Processor -- start 2024-09-13T15:07:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 -- start start 2024-09-13T15:07:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244005230 0x7fa260138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 0x7fa260142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa260154b60 0x7fa260142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260138960 con 0x7fa2601546e0 2024-09-13T15:07:53.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260152010 con 0x7fa244005230 2024-09-13T15:07:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa260141090 con 0x7fa260154b60 2024-09-13T15:07:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 0x7fa260142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 0x7fa260142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56916/0 (socket says 172.21.15.50:56916) 2024-09-13T15:07:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 -- 172.21.15.50:0/1385694825 learned_addr learned my addr 172.21.15.50:0/1385694825 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25f400700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244005230 0x7fa260138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25fe00700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa260154b60 0x7fa260142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 -- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa260154b60 msgr2=0x7fa260142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa260154b60 0x7fa260142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 -- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244005230 msgr2=0x7fa260138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244005230 0x7fa260138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 -- 172.21.15.50:0/1385694825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260141370 con 0x7fa2601546e0 2024-09-13T15:07:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa25ea00700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 0x7fa260142210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00eaf0 tx=0x7fa24c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00c570 con 0x7fa2601546e0 2024-09-13T15:07:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c00c6d0 con 0x7fa2601546e0 2024-09-13T15:07:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00ca80 con 0x7fa2601546e0 2024-09-13T15:07:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.485+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260141650 con 0x7fa2601546e0 2024-09-13T15:07:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.489+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26013f6a0 con 0x7fa2601546e0 2024-09-13T15:07:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.489+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa260152210 con 0x7fa2601546e0 2024-09-13T15:07:53.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.493+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa24c00cbe0 con 0x7fa2601546e0 2024-09-13T15:07:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.493+0000 7fa257400700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa240066760 0x7fa240068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.493+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa24c083fd0 con 0x7fa2601546e0 2024-09-13T15:07:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.493+0000 7fa25f400700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa240066760 0x7fa240068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.493+0000 7fa25f400700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa240066760 0x7fa240068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2500045f0 tx=0x7fa250008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.497+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa260152210 con 0x7fa2601546e0 2024-09-13T15:07:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.685+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa2601521d0 con 0x7fa2601546e0 2024-09-13T15:07:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.685+0000 7fa257400700 1 -- 172.21.15.50:0/1385694825 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa24c0510e0 con 0x7fa2601546e0 2024-09-13T15:07:53.688 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:07:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa240066760 msgr2=0x7fa240068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa240066760 0x7fa240068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2500045f0 tx=0x7fa250008040 comp rx=0 tx=0).stop 2024-09-13T15:07:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 msgr2=0x7fa260142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 0x7fa260142210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00eaf0 tx=0x7fa24c00ee00 comp rx=0 tx=0).stop 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 shutdown_connections 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa240066760 0x7fa240068c20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa260154b60 0x7fa260142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2601546e0 0x7fa260142210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 --2- 172.21.15.50:0/1385694825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa244005230 0x7fa260138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 >> 172.21.15.50:0/1385694825 conn(0x7fa26006a570 msgr2=0x7fa26015dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 shutdown_connections 2024-09-13T15:07:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.689+0000 7fa266600700 1 -- 172.21.15.50:0/1385694825 wait complete. 2024-09-13T15:07:53.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:07:53.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.881+0000 7f3319600700 1 Processor -- start 2024-09-13T15:07:53.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.881+0000 7f3319600700 1 -- start start 2024-09-13T15:07:53.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3319600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f33140ccb40 0x7f33140ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3319600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f33140ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3319600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140cf020 con 0x7f3314159690 2024-09-13T15:07:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3319600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331415d530 con 0x7f33140ccb40 2024-09-13T15:07:53.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3319600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331415d810 con 0x7f3314159a70 2024-09-13T15:07:53.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3313e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3314159690 0x7f33140cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35258/0 (socket says 172.21.15.50:35258) 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3313e00700 1 -- 172.21.15.50:0/1000190895 learned_addr learned my addr 172.21.15.50:0/1000190895 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3318c00700 1 --2- 172.21.15.50:0/1000190895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f33140ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3313400700 1 --2- 172.21.15.50:0/1000190895 >> v2:172.21.15.181:3300/0 conn(0x7f33140ccb40 0x7f33140ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.885+0000 7f3312a00700 1 -- 172.21.15.50:0/1000190895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393046099 0 0) 0x7f33140cf020 con 0x7f3314159690 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3312a00700 1 -- 172.21.15.50:0/1000190895 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f80057e0 con 0x7f3314159690 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3318c00700 1 -- 172.21.15.50:0/1000190895 >> v2:172.21.15.181:3300/0 conn(0x7f33140ccb40 msgr2=0x7f33140ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3318c00700 1 --2- 172.21.15.50:0/1000190895 >> v2:172.21.15.181:3300/0 conn(0x7f33140ccb40 0x7f33140ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3318c00700 1 -- 172.21.15.50:0/1000190895 >> v1:172.21.15.50:6789/0 conn(0x7f3314159690 legacy=0x7f33140cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3318c00700 1 -- 172.21.15.50:0/1000190895 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331415daf0 con 0x7f3314159a70 2024-09-13T15:07:53.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3313400700 1 --2- 172.21.15.50:0/1000190895 >> v2:172.21.15.181:3300/0 conn(0x7f33140ccb40 0x7f33140ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3318c00700 1 --2- 172.21.15.50:0/1000190895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f33140ceae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f330c009dc0 tx=0x7f330c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39a90db32ce18ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3312a00700 1 -- 172.21.15.50:0/1000190895 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00e070 con 0x7f3314159a70 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3312a00700 1 -- 172.21.15.50:0/1000190895 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00bae0 con 0x7f3314159a70 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3312a00700 1 -- 172.21.15.50:0/1000190895 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00be90 con 0x7f3314159a70 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 -- 172.21.15.50:0/1000190895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 msgr2=0x7f33140ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 --2- 172.21.15.50:0/1000190895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f33140ceae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f330c009dc0 tx=0x7f330c00b330 comp rx=0 tx=0).stop 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 -- 172.21.15.50:0/1000190895 shutdown_connections 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 --2- 172.21.15.50:0/1000190895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f33140ceae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 --2- 172.21.15.50:0/1000190895 >> v2:172.21.15.181:3300/0 conn(0x7f33140ccb40 0x7f33140ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 -- 172.21.15.50:0/1000190895 >> 172.21.15.50:0/1000190895 conn(0x7f331406ca10 msgr2=0x7f331406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:53.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 -- 172.21.15.50:0/1000190895 shutdown_connections 2024-09-13T15:07:53.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.889+0000 7f3319600700 1 -- 172.21.15.50:0/1000190895 wait complete. 2024-09-13T15:07:53.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 Processor -- start 2024-09-13T15:07:53.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 -- start start 2024-09-13T15:07:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 0x7f331413edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314159690 0x7f3314149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f331414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314149560 con 0x7f3314159690 2024-09-13T15:07:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140cb6a0 con 0x7f33140ccb40 2024-09-13T15:07:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3319600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331414ab40 con 0x7f3314159a70 2024-09-13T15:07:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 0x7f331413edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3318c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f331414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314159690 0x7f3314149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3318c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f331414b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35988/0 (socket says 172.21.15.50:35988) 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 0x7f331413edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:55916/0 (socket says 172.21.15.50:55916) 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3318c00700 1 -- 172.21.15.50:0/4116641179 learned_addr learned my addr 172.21.15.50:0/4116641179 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 -- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 msgr2=0x7f331414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f331414b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 -- 172.21.15.50:0/4116641179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314159690 msgr2=0x7f3314149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314159690 0x7f3314149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:53.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 -- 172.21.15.50:0/4116641179 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000094b0 con 0x7f33140ccb40 2024-09-13T15:07:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.893+0000 7f3313e00700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 0x7f331413edc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f330400c500 tx=0x7f330400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.897+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304005d90 con 0x7f33140ccb40 2024-09-13T15:07:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.897+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33040070d0 con 0x7f33140ccb40 2024-09-13T15:07:53.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.897+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c009a70 con 0x7f33140ccb40 2024-09-13T15:07:53.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.897+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304007440 con 0x7f33140ccb40 2024-09-13T15:07:53.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.897+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331414b100 con 0x7f33140ccb40 2024-09-13T15:07:53.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.897+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331414b2f0 con 0x7f33140ccb40 2024-09-13T15:07:53.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.901+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33040075a0 con 0x7f33140ccb40 2024-09-13T15:07:53.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.901+0000 7f330be00700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32f4066730 0x7f32f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.901+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33040838c0 con 0x7f33140ccb40 2024-09-13T15:07:53.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.901+0000 7f3313400700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32f4066730 0x7f32f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.901+0000 7f3313400700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32f4066730 0x7f32f4068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3314154da0 tx=0x7f3300009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:53.909+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33040508a0 con 0x7f33140ccb40 2024-09-13T15:07:54.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.109+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33140cc430 con 0x7f33140ccb40 2024-09-13T15:07:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.109+0000 7f330be00700 1 -- 172.21.15.50:0/4116641179 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3304053ec0 con 0x7f33140ccb40 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32f4066730 msgr2=0x7f32f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32f4066730 0x7f32f4068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3314154da0 tx=0x7f3300009240 comp rx=0 tx=0).stop 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 msgr2=0x7f331413edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 0x7f331413edc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f330400c500 tx=0x7f330400c810 comp rx=0 tx=0).stop 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 shutdown_connections 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32f4066730 0x7f32f4068bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3314159a70 0x7f331414b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3314159690 0x7f3314149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 --2- 172.21.15.50:0/4116641179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33140ccb40 0x7f331413edc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 >> 172.21.15.50:0/4116641179 conn(0x7f331406ca10 msgr2=0x7f331406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 shutdown_connections 2024-09-13T15:07:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:07:54.113+0000 7f3319600700 1 -- 172.21.15.50:0/4116641179 wait complete. 2024-09-13T15:07:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:07:54.137 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2024-09-13T15:07:54.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:07:54.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:07:54.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[31034]: fuse finished with error 0 and tester_r 0 2024-09-13T15:07:54.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:08:00.293 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:08:00.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:00.294 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T15:08:00.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:01.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.145+0000 7f8cc2c00700 1 Processor -- start 2024-09-13T15:08:01.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.145+0000 7f8cc2c00700 1 -- start start 2024-09-13T15:08:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc0b41d0 0x7f8cbc06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8cbc142de0 0x7f8cbc06c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc0ce5f0 con 0x7f8cbc142650 2024-09-13T15:08:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cbc142a30 con 0x7f8cbc142de0 2024-09-13T15:08:01.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0ce8d0 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8cbc142de0 0x7f8cbc06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc1800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cbc142650 0x7f8cbc15d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35272/0 (socket says 172.21.15.50:35272) 2024-09-13T15:08:01.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc1800700 1 -- 172.21.15.50:0/3227038101 learned_addr learned my addr 172.21.15.50:0/3227038101 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:01.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc0e00700 1 --2- 172.21.15.50:0/3227038101 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc0b41d0 0x7f8cbc06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2200700 1 -- 172.21.15.50:0/3227038101 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc0b41d0 msgr2=0x7f8cbc06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:01.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2200700 1 --2- 172.21.15.50:0/3227038101 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc0b41d0 0x7f8cbc06c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2200700 1 -- 172.21.15.50:0/3227038101 >> v1:172.21.15.50:6789/0 conn(0x7f8cbc142650 legacy=0x7f8cbc15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2200700 1 -- 172.21.15.50:0/3227038101 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0cebb0 con 0x7f8cbc142de0 2024-09-13T15:08:01.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cc2200700 1 --2- 172.21.15.50:0/3227038101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc142de0 0x7f8cbc06c980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009d90 tx=0x7f8cb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b951b56c617ca18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:01.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cbbe00700 1 -- 172.21.15.50:0/3227038101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400e070 con 0x7f8cbc142de0 2024-09-13T15:08:01.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cbbe00700 1 -- 172.21.15.50:0/3227038101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb400bbd0 con 0x7f8cbc142de0 2024-09-13T15:08:01.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.149+0000 7f8cbbe00700 1 -- 172.21.15.50:0/3227038101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4012430 con 0x7f8cbc142de0 2024-09-13T15:08:01.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3227038101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc142de0 msgr2=0x7f8cbc06c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3227038101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc142de0 0x7f8cbc06c980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009d90 tx=0x7f8cb400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:01.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3227038101 shutdown_connections 2024-09-13T15:08:01.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3227038101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc142de0 0x7f8cbc06c980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3227038101 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc0b41d0 0x7f8cbc06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3227038101 >> 172.21.15.50:0/3227038101 conn(0x7f8cbc06a390 msgr2=0x7f8cbc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:01.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3227038101 shutdown_connections 2024-09-13T15:08:01.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.153+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3227038101 wait complete. 2024-09-13T15:08:01.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 Processor -- start 2024-09-13T15:08:01.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 -- start start 2024-09-13T15:08:01.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 0x7f8cbc138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc142650 0x7f8cbc1f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cbc142de0 0x7f8cbc1f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc157040 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc156710 con 0x7f8cbc142de0 2024-09-13T15:08:01.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc156980 con 0x7f8cbc142650 2024-09-13T15:08:01.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 0x7f8cbc138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 0x7f8cbc138b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56952/0 (socket says 172.21.15.50:56952) 2024-09-13T15:08:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 -- 172.21.15.50:0/3238665717 learned_addr learned my addr 172.21.15.50:0/3238665717 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc0e00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc142650 0x7f8cbc1f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc2200700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cbc142de0 0x7f8cbc1f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 -- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc142650 msgr2=0x7f8cbc1f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc142650 0x7f8cbc1f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 -- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cbc142de0 msgr2=0x7f8cbc1f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cbc142de0 0x7f8cbc1f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.157+0000 7f8cc1800700 1 -- 172.21.15.50:0/3238665717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4009a70 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cc1800700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 0x7f8cbc138b70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0001e90 tx=0x7f8cb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:01.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0005d90 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb00070d0 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc156c60 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0007440 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc1390b0 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc157180 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.161+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cb00075a0 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.165+0000 7f8cb9600700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c9c066730 0x7f8c9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.165+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cb00862c0 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.165+0000 7f8cc0e00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c9c066730 0x7f8c9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.165+0000 7f8cc0e00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c9c066730 0x7f8c9c068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc1544b0 tx=0x7f8ca8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.173+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8cb0053350 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.361+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cbc15d520 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.361+0000 7f8cb9600700 1 -- 172.21.15.50:0/3238665717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f8cb0056970 con 0x7f8cbc0b41d0 2024-09-13T15:08:01.366 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:01.366 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c9c066730 msgr2=0x7f8c9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c9c066730 0x7f8c9c068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc1544b0 tx=0x7f8ca8008040 comp rx=0 tx=0).stop 2024-09-13T15:08:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 msgr2=0x7f8cbc138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 0x7f8cbc138b70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0001e90 tx=0x7f8cb000c8c0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 shutdown_connections 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c9c066730 0x7f8c9c068bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8cbc142de0 0x7f8cbc1f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8cbc142650 0x7f8cbc1f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 --2- 172.21.15.50:0/3238665717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cbc0b41d0 0x7f8cbc138b70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 >> 172.21.15.50:0/3238665717 conn(0x7f8cbc06a390 msgr2=0x7f8cbc070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 shutdown_connections 2024-09-13T15:08:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.365+0000 7f8cc2c00700 1 -- 172.21.15.50:0/3238665717 wait complete. 2024-09-13T15:08:01.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.565+0000 7ff2f1200700 1 Processor -- start 2024-09-13T15:08:01.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.565+0000 7ff2f1200700 1 -- start start 2024-09-13T15:08:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2f1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec06aaa0 0x7ff2ec15d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2f1200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec15e560 con 0x7ff2ec15e9f0 2024-09-13T15:08:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2f1200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec15d920 con 0x7ff2ec0b3980 2024-09-13T15:08:01.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2f1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0adf90 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2ebe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff2ec15e9f0 0x7ff2ec15eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35278/0 (socket says 172.21.15.50:35278) 2024-09-13T15:08:01.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2ebe00700 1 -- 172.21.15.50:0/2355314816 learned_addr learned my addr 172.21.15.50:0/2355314816 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:01.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2eb400700 1 --2- 172.21.15.50:0/2355314816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec06aaa0 0x7ff2ec15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2eb400700 1 -- 172.21.15.50:0/2355314816 >> v1:172.21.15.181:6789/0 conn(0x7ff2ec0b3980 legacy=0x7ff2ec06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2eb400700 1 -- 172.21.15.50:0/2355314816 >> v1:172.21.15.50:6789/0 conn(0x7ff2ec15e9f0 legacy=0x7ff2ec15eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2eb400700 1 -- 172.21.15.50:0/2355314816 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec15dc00 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.569+0000 7ff2ea000700 1 -- 172.21.15.50:0/2355314816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247731772 0 0) 0x7ff2ec15e560 con 0x7ff2ec15e9f0 2024-09-13T15:08:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2eb400700 1 --2- 172.21.15.50:0/2355314816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec06aaa0 0x7ff2ec15d310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0098b0 tx=0x7ff2dc009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97595eb17b4c9a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2ea000700 1 -- 172.21.15.50:0/2355314816 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011830 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2ea000700 1 -- 172.21.15.50:0/2355314816 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc011990 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2ea000700 1 -- 172.21.15.50:0/2355314816 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011d20 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 -- 172.21.15.50:0/2355314816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec06aaa0 msgr2=0x7ff2ec15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2355314816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec06aaa0 0x7ff2ec15d310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0098b0 tx=0x7ff2dc009bc0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 -- 172.21.15.50:0/2355314816 shutdown_connections 2024-09-13T15:08:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2355314816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec06aaa0 0x7ff2ec15d310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 -- 172.21.15.50:0/2355314816 >> 172.21.15.50:0/2355314816 conn(0x7ff2ec0b0c40 msgr2=0x7ff2ec06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:01.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 -- 172.21.15.50:0/2355314816 shutdown_connections 2024-09-13T15:08:01.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.573+0000 7ff2f1200700 1 -- 172.21.15.50:0/2355314816 wait complete. 2024-09-13T15:08:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 Processor -- start 2024-09-13T15:08:01.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 -- start start 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 0x7ff2ec0cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0b3980 0x7ff2ec13d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15e9f0 0x7ff2ec0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0cbf90 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec143870 con 0x7ff2ec0b3980 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2f1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec13d810 con 0x7ff2ec15e9f0 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 0x7ff2ec0cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 0x7ff2ec0cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56958/0 (socket says 172.21.15.50:56958) 2024-09-13T15:08:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 -- 172.21.15.50:0/2368152332 learned_addr learned my addr 172.21.15.50:0/2368152332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eaa00700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0b3980 0x7ff2ec13d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2ebe00700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15e9f0 0x7ff2ec0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 -- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15e9f0 msgr2=0x7ff2ec0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15e9f0 0x7ff2ec0cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 -- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0b3980 msgr2=0x7ff2ec13d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0b3980 0x7ff2ec13d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2eb400700 1 -- 172.21.15.50:0/2368152332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0094b0 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.577+0000 7ff2ebe00700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15e9f0 0x7ff2ec0cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2eb400700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 0x7ff2ec0cba50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc000c00 tx=0x7ff2dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc01b8e0 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc01ba60 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc01be10 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec0cdd90 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec143ac0 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec15c7a0 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.581+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2dc023070 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.585+0000 7ff2e3400700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff2cc066730 0x7ff2cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.585+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2dc0856a0 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.585+0000 7ff2eaa00700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff2cc066730 0x7ff2cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.585+0000 7ff2eaa00700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff2cc066730 0x7ff2cc068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec15ca50 tx=0x7ff2d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:01.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.589+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2dc052730 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.777+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2ec15c4c0 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.781+0000 7ff2e3400700 1 -- 172.21.15.50:0/2368152332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff2dc055d50 con 0x7ff2ec06aaa0 2024-09-13T15:08:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:01.783 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:01.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff2cc066730 msgr2=0x7ff2cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff2cc066730 0x7ff2cc068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec15ca50 tx=0x7ff2d8009040 comp rx=0 tx=0).stop 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 msgr2=0x7ff2ec0cba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 0x7ff2ec0cba50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc000c00 tx=0x7ff2dc004770 comp rx=0 tx=0).stop 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 shutdown_connections 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff2cc066730 0x7ff2cc068bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15e9f0 0x7ff2ec0cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0b3980 0x7ff2ec13d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 --2- 172.21.15.50:0/2368152332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2ec06aaa0 0x7ff2ec0cba50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 >> 172.21.15.50:0/2368152332 conn(0x7ff2ec0b0c40 msgr2=0x7ff2ec142870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 shutdown_connections 2024-09-13T15:08:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.785+0000 7ff2f1200700 1 -- 172.21.15.50:0/2368152332 wait complete. 2024-09-13T15:08:01.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:08:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.993+0000 7f25d5600700 1 Processor -- start 2024-09-13T15:08:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.993+0000 7f25d5600700 1 -- start start 2024-09-13T15:08:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25d5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d0157500 0x7f25d00ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25d5600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f25d00cd140 0x7f25d00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25d5600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d00b57e0 con 0x7f25d015e030 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25d5600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00cdb30 con 0x7f25d0157500 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25d5600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00b3b80 con 0x7f25d00cd140 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25ce000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f25d015e030 0x7f25d0070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35280/0 (socket says 172.21.15.50:35280) 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d0157500 0x7f25d00ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25ce000700 1 -- 172.21.15.50:0/3813099989 learned_addr learned my addr 172.21.15.50:0/3813099989 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cf400700 1 --2- 172.21.15.50:0/3813099989 >> v2:172.21.15.181:3300/0 conn(0x7f25d00cd140 0x7f25d00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cf400700 1 -- 172.21.15.50:0/3813099989 >> v2:172.21.15.50:3300/0 conn(0x7f25d0157500 msgr2=0x7f25d00ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cf400700 1 --2- 172.21.15.50:0/3813099989 >> v2:172.21.15.50:3300/0 conn(0x7f25d0157500 0x7f25d00ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cf400700 1 -- 172.21.15.50:0/3813099989 >> v1:172.21.15.50:6789/0 conn(0x7f25d015e030 legacy=0x7f25d0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cf400700 1 -- 172.21.15.50:0/3813099989 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00b5a80 con 0x7f25d00cd140 2024-09-13T15:08:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cd600700 1 -- 172.21.15.50:0/3813099989 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087690189 0 0) 0x7f25d00b57e0 con 0x7f25d015e030 2024-09-13T15:08:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cea00700 1 --2- 172.21.15.50:0/3813099989 >> v2:172.21.15.50:3300/0 conn(0x7f25d0157500 0x7f25d00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cf400700 1 --2- 172.21.15.50:0/3813099989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d00cd140 0x7f25d00cd5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009d90 tx=0x7f25c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4195fa44b46caf2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cd600700 1 -- 172.21.15.50:0/3813099989 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800e070 con 0x7f25d00cd140 2024-09-13T15:08:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cd600700 1 -- 172.21.15.50:0/3813099989 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c800bae0 con 0x7f25d00cd140 2024-09-13T15:08:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:01.997+0000 7f25cd600700 1 -- 172.21.15.50:0/3813099989 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800be90 con 0x7f25d00cd140 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 -- 172.21.15.50:0/3813099989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d00cd140 msgr2=0x7f25d00cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 --2- 172.21.15.50:0/3813099989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d00cd140 0x7f25d00cd5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009d90 tx=0x7f25c800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 -- 172.21.15.50:0/3813099989 shutdown_connections 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 --2- 172.21.15.50:0/3813099989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d00cd140 0x7f25d00cd5f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 --2- 172.21.15.50:0/3813099989 >> v2:172.21.15.50:3300/0 conn(0x7f25d0157500 0x7f25d00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 -- 172.21.15.50:0/3813099989 >> 172.21.15.50:0/3813099989 conn(0x7f25d006e660 msgr2=0x7f25d006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 -- 172.21.15.50:0/3813099989 shutdown_connections 2024-09-13T15:08:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 -- 172.21.15.50:0/3813099989 wait complete. 2024-09-13T15:08:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 Processor -- start 2024-09-13T15:08:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.001+0000 7f25d5600700 1 -- start start 2024-09-13T15:08:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d00cd140 0x7f25d0151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d0157500 0x7f25d006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 0x7f25d0153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0151ab0 con 0x7f25d015e030 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0151ca0 con 0x7f25d0157500 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00cba00 con 0x7f25d00cd140 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 0x7f25d0153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 0x7f25d0153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56990/0 (socket says 172.21.15.50:56990) 2024-09-13T15:08:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 -- 172.21.15.50:0/1418493481 learned_addr learned my addr 172.21.15.50:0/1418493481 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25ce000700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d0157500 0x7f25d006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cea00700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d00cd140 0x7f25d0151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 -- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d00cd140 msgr2=0x7f25d0151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d00cd140 0x7f25d0151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 -- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d0157500 msgr2=0x7f25d006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d0157500 0x7f25d006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 -- 172.21.15.50:0/1418493481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00094b0 con 0x7f25d015e030 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25ce000700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d0157500 0x7f25d006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25cf400700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 0x7f25d0153250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25c8014040 tx=0x7f25c8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8004770 con 0x7f25d015e030 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8020070 con 0x7f25d015e030 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c8009a70 con 0x7f25d015e030 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8027480 con 0x7f25d015e030 2024-09-13T15:08:02.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.005+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d00cbfc0 con 0x7f25d015e030 2024-09-13T15:08:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.009+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d00cd5f0 con 0x7f25d015e030 2024-09-13T15:08:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.009+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25c8012430 con 0x7f25d015e030 2024-09-13T15:08:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.009+0000 7f25c6a00700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.009+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25c8022070 con 0x7f25d015e030 2024-09-13T15:08:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.009+0000 7f25cea00700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.013+0000 7f25cea00700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009d10 tx=0x7f25c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:02.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.017+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25c8057540 con 0x7f25d015e030 2024-09-13T15:08:02.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:02.233+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f25d0154830 con 0x7f25d015e030 2024-09-13T15:08:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.141+0000 7f25c6a00700 1 -- 172.21.15.50:0/1418493481 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f25c80570d0 con 0x7f25d015e030 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 msgr2=0x7f25b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009d10 tx=0x7f25c0008040 comp rx=0 tx=0).stop 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 msgr2=0x7f25d0153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 0x7f25d0153250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25c8014040 tx=0x7f25c8004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 shutdown_connections 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d015e030 0x7f25d0153250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d0157500 0x7f25d006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 --2- 172.21.15.50:0/1418493481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d00cd140 0x7f25d0151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 >> 172.21.15.50:0/1418493481 conn(0x7f25d006e660 msgr2=0x7f25d00cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:03.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 shutdown_connections 2024-09-13T15:08:03.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.149+0000 7f25d5600700 1 -- 172.21.15.50:0/1418493481 wait complete. 2024-09-13T15:08:03.175 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T15:08:03.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:08:03.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.357+0000 7f792a400700 1 Processor -- start 2024-09-13T15:08:03.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f792a400700 1 -- start start 2024-09-13T15:08:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f792a400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f792406d620 0x7f792406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f792a400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f792406cea0 0x7f79240b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f792a400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79240b1980 con 0x7f7924143b70 2024-09-13T15:08:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f792a400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79240b2500 con 0x7f792406cea0 2024-09-13T15:08:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f792a400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792406d2f0 con 0x7f792406d620 2024-09-13T15:08:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f7929a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f792406cea0 0x7f79240b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f7929a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f792406cea0 0x7f79240b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57906/0 (socket says 172.21.15.50:57906) 2024-09-13T15:08:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f7929a00700 1 -- 172.21.15.50:0/87458304 learned_addr learned my addr 172.21.15.50:0/87458304 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.361+0000 7f7923e00700 1 --2- 172.21.15.50:0/87458304 >> v2:172.21.15.181:3300/0 conn(0x7f792406d620 0x7f792406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7929a00700 1 -- 172.21.15.50:0/87458304 >> v2:172.21.15.181:3300/0 conn(0x7f792406d620 msgr2=0x7f792406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7929a00700 1 --2- 172.21.15.50:0/87458304 >> v2:172.21.15.181:3300/0 conn(0x7f792406d620 0x7f792406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7929a00700 1 -- 172.21.15.50:0/87458304 >> v1:172.21.15.181:6789/0 conn(0x7f7924143b70 legacy=0x7f79240cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7929a00700 1 -- 172.21.15.50:0/87458304 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240b1bd0 con 0x7f792406cea0 2024-09-13T15:08:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7923400700 1 -- 172.21.15.50:0/87458304 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397585714 0 0) 0x7f79240b1980 con 0x7f7924143b70 2024-09-13T15:08:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7929a00700 1 --2- 172.21.15.50:0/87458304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406cea0 0x7f79240b2990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79240ce860 tx=0x7f791c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49df817fb9e0ffba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7923400700 1 -- 172.21.15.50:0/87458304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00e070 con 0x7f792406cea0 2024-09-13T15:08:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7923400700 1 -- 172.21.15.50:0/87458304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00b910 con 0x7f792406cea0 2024-09-13T15:08:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f7923400700 1 -- 172.21.15.50:0/87458304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00bcc0 con 0x7f792406cea0 2024-09-13T15:08:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 -- 172.21.15.50:0/87458304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406cea0 msgr2=0x7f79240b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 --2- 172.21.15.50:0/87458304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406cea0 0x7f79240b2990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79240ce860 tx=0x7f791c00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 -- 172.21.15.50:0/87458304 shutdown_connections 2024-09-13T15:08:03.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 --2- 172.21.15.50:0/87458304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406cea0 0x7f79240b2990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 --2- 172.21.15.50:0/87458304 >> v2:172.21.15.181:3300/0 conn(0x7f792406d620 0x7f792406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 -- 172.21.15.50:0/87458304 >> 172.21.15.50:0/87458304 conn(0x7f792406a390 msgr2=0x7f792406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:03.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 -- 172.21.15.50:0/87458304 shutdown_connections 2024-09-13T15:08:03.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.365+0000 7f792a400700 1 -- 172.21.15.50:0/87458304 wait complete. 2024-09-13T15:08:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.369+0000 7f792a400700 1 Processor -- start 2024-09-13T15:08:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.369+0000 7f792a400700 1 -- start start 2024-09-13T15:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f792406cea0 0x7f792413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 0x7f79240af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7924143b70 0x7f79240af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79241f45c0 con 0x7f792406d620 2024-09-13T15:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792413fe20 con 0x7f792406cea0 2024-09-13T15:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79241f39b0 con 0x7f7924143b70 2024-09-13T15:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 0x7f79240af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 0x7f79240af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57922/0 (socket says 172.21.15.50:57922) 2024-09-13T15:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 -- 172.21.15.50:0/2030014564 learned_addr learned my addr 172.21.15.50:0/2030014564 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7929000700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f792406cea0 0x7f792413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7929a00700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7924143b70 0x7f79240af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 -- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7924143b70 msgr2=0x7f79240af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7924143b70 0x7f79240af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 -- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f792406cea0 msgr2=0x7f792413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f792406cea0 0x7f792413f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 -- 172.21.15.50:0/2030014564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009b30 con 0x7f792406d620 2024-09-13T15:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7923e00700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 0x7f79240af440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9d0 tx=0x7f791000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910009720 con 0x7f792406d620 2024-09-13T15:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791000ee70 con 0x7f792406d620 2024-09-13T15:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79241f3c90 con 0x7f792406d620 2024-09-13T15:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000ca50 con 0x7f792406d620 2024-09-13T15:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.373+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79241f4250 con 0x7f792406d620 2024-09-13T15:08:03.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.377+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79241f4730 con 0x7f792406d620 2024-09-13T15:08:03.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.377+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f791000cbb0 con 0x7f792406d620 2024-09-13T15:08:03.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.381+0000 7f7920c00700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:03.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.381+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7910084c00 con 0x7f792406d620 2024-09-13T15:08:03.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.381+0000 7f7929000700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:03.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.381+0000 7f7929000700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7904066730 0x7f7904068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7918007fd0 tx=0x7f7918009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.385+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7910051cf0 con 0x7f792406d620 2024-09-13T15:08:03.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:03.605+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f792406c960 con 0x7f792406d620 2024-09-13T15:08:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.153+0000 7f7920c00700 1 -- 172.21.15.50:0/2030014564 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f791000ce60 con 0x7f792406d620 2024-09-13T15:08:04.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7904066730 msgr2=0x7f7904068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7904066730 0x7f7904068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7918007fd0 tx=0x7f7918009040 comp rx=0 tx=0).stop 2024-09-13T15:08:04.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 msgr2=0x7f79240af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 0x7f79240af440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9d0 tx=0x7f791000ece0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 shutdown_connections 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7924143b70 0x7f79240af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f792406d620 0x7f79240af440 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 --2- 172.21.15.50:0/2030014564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f792406cea0 0x7f792413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 >> 172.21.15.50:0/2030014564 conn(0x7f792406a390 msgr2=0x7f79240b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 shutdown_connections 2024-09-13T15:08:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.157+0000 7f792a400700 1 -- 172.21.15.50:0/2030014564 wait complete. 2024-09-13T15:08:04.187 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:08:04.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecf000700 1 Processor -- start 2024-09-13T15:08:04.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecf000700 1 -- start start 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecf000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdec80b4d00 0x7fdec8070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecf000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec806ae60 con 0x7fdec8159600 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecf000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec806ba00 con 0x7fdec81599e0 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecf000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec80b3d70 con 0x7fdec80b4d00 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdece600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdec80b4d00 0x7fdec8070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecdc00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdec8159600 0x7fdec80b3560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57354/0 (socket says 172.21.15.50:57354) 2024-09-13T15:08:04.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.365+0000 7fdecdc00700 1 -- 172.21.15.50:0/3080403411 learned_addr learned my addr 172.21.15.50:0/3080403411 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdece600700 1 -- 172.21.15.50:0/3080403411 >> v1:172.21.15.181:6789/0 conn(0x7fdec81599e0 legacy=0x7fdec806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdece600700 1 -- 172.21.15.50:0/3080403411 >> v1:172.21.15.50:6789/0 conn(0x7fdec8159600 legacy=0x7fdec80b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdece600700 1 -- 172.21.15.50:0/3080403411 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec806a530 con 0x7fdec80b4d00 2024-09-13T15:08:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdece600700 1 --2- 172.21.15.50:0/3080403411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec80b4d00 0x7fdec8070dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009d90 tx=0x7fdec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8798ead27260f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdec7e00700 1 -- 172.21.15.50:0/3080403411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec000e070 con 0x7fdec80b4d00 2024-09-13T15:08:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdec7e00700 1 -- 172.21.15.50:0/3080403411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec000bb90 con 0x7fdec80b4d00 2024-09-13T15:08:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdec7e00700 1 -- 172.21.15.50:0/3080403411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0003a40 con 0x7fdec80b4d00 2024-09-13T15:08:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 -- 172.21.15.50:0/3080403411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec80b4d00 msgr2=0x7fdec8070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 --2- 172.21.15.50:0/3080403411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec80b4d00 0x7fdec8070dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009d90 tx=0x7fdec000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 -- 172.21.15.50:0/3080403411 shutdown_connections 2024-09-13T15:08:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 --2- 172.21.15.50:0/3080403411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec80b4d00 0x7fdec8070dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 -- 172.21.15.50:0/3080403411 >> 172.21.15.50:0/3080403411 conn(0x7fdec806e660 msgr2=0x7fdec806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 -- 172.21.15.50:0/3080403411 shutdown_connections 2024-09-13T15:08:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.369+0000 7fdecf000700 1 -- 172.21.15.50:0/3080403411 wait complete. 2024-09-13T15:08:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 Processor -- start 2024-09-13T15:08:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 -- start start 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdec80b4d00 0x7fdec814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 0x7fdec81560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdec81599e0 0x7fdec814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec814c220 con 0x7fdec8159600 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec814c500 con 0x7fdec81599e0 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecf000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec814c7e0 con 0x7fdec80b4d00 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecd200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 0x7fdec81560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecd200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 0x7fdec81560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57938/0 (socket says 172.21.15.50:57938) 2024-09-13T15:08:04.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.373+0000 7fdecd200700 1 -- 172.21.15.50:0/1224274212 learned_addr learned my addr 172.21.15.50:0/1224274212 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdece600700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdec81599e0 0x7fdec814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecdc00700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdec80b4d00 0x7fdec814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecd200700 1 -- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdec80b4d00 msgr2=0x7fdec814d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecd200700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdec80b4d00 0x7fdec814d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecd200700 1 -- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdec81599e0 msgr2=0x7fdec814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecd200700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdec81599e0 0x7fdec814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecd200700 1 -- 172.21.15.50:0/1224274212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0009a70 con 0x7fdec8159600 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdece600700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdec81599e0 0x7fdec814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:04.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecd200700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 0x7fdec81560e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400b4a0 tx=0x7fdeb400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4011830 con 0x7fdec8159600 2024-09-13T15:08:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4011990 con 0x7fdec8159600 2024-09-13T15:08:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4011d40 con 0x7fdec8159600 2024-09-13T15:08:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec814cac0 con 0x7fdec8159600 2024-09-13T15:08:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec8156620 con 0x7fdec8159600 2024-09-13T15:08:04.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.377+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec8071b20 con 0x7fdec8159600 2024-09-13T15:08:04.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.381+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdeb401a400 con 0x7fdec8159600 2024-09-13T15:08:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.381+0000 7fdec5600700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdea8066730 0x7fdea8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.381+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdeb4084540 con 0x7fdec8159600 2024-09-13T15:08:04.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.381+0000 7fdecdc00700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdea8066730 0x7fdea8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.381+0000 7fdecdc00700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdea8066730 0x7fdea8068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdec8156bb0 tx=0x7fdebc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.389+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdeb4051520 con 0x7fdec8159600 2024-09-13T15:08:04.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.617+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdec814cfe0 con 0x7fdec8159600 2024-09-13T15:08:04.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.617+0000 7fdec5600700 1 -- 172.21.15.50:0/1224274212 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7fdec814cfe0 con 0x7fdec8159600 2024-09-13T15:08:04.621 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:04.621 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdea8066730 msgr2=0x7fdea8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdea8066730 0x7fdea8068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdec8156bb0 tx=0x7fdebc009040 comp rx=0 tx=0).stop 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 msgr2=0x7fdec81560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 0x7fdec81560e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400b4a0 tx=0x7fdeb400b860 comp rx=0 tx=0).stop 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 shutdown_connections 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdea8066730 0x7fdea8068bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdec81599e0 0x7fdec814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec8159600 0x7fdec81560e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 --2- 172.21.15.50:0/1224274212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdec80b4d00 0x7fdec814d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 >> 172.21.15.50:0/1224274212 conn(0x7fdec806e660 msgr2=0x7fdec8066750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 shutdown_connections 2024-09-13T15:08:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.621+0000 7fdecf000700 1 -- 172.21.15.50:0/1224274212 wait complete. 2024-09-13T15:08:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:04.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:04.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 Processor -- start 2024-09-13T15:08:04.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 -- start start 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9ff80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9ff806aaa0 0x7f9ff806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80b2ad0 con 0x7f9ff815c2a0 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff806b450 con 0x7f9ff806aaa0 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ffe400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff815b960 con 0x7f9ff80cb020 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.821+0000 7f9ff7e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ff815c2a0 0x7f9ff815b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57362/0 (socket says 172.21.15.50:57362) 2024-09-13T15:08:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7e00700 1 -- 172.21.15.50:0/2382460133 learned_addr learned my addr 172.21.15.50:0/2382460133 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffd000700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9ff80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2382460133 >> v2:172.21.15.181:3300/0 conn(0x7f9ff806aaa0 0x7f9ff806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042762191 0 0) 0x7f9ff80b2ad0 con 0x7f9ff815c2a0 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe00035d0 con 0x7f9ff815c2a0 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798374497 0 0) 0x7f9fe00035d0 con 0x7f9ff815c2a0 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 msgr2=0x7f9ff80cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9ff80cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 >> v2:172.21.15.181:3300/0 conn(0x7f9ff806aaa0 msgr2=0x7f9ff806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 --2- 172.21.15.50:0/2382460133 >> v2:172.21.15.181:3300/0 conn(0x7f9ff806aaa0 0x7f9ff806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff815bc40 con 0x7f9ff815c2a0 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f9fe4001670 con 0x7f9ff815c2a0 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 >> v1:172.21.15.50:6789/0 conn(0x7f9ff815c2a0 legacy=0x7f9ff815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe0003a90 0x7f9fe0003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9fe0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe0004db0 0x7f9fe0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff806b450 con 0x7f9fe0004db0 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff815b960 con 0x7f9fe0003a90 2024-09-13T15:08:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe000ba30 con 0x7f9ff80cb020 2024-09-13T15:08:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe0004db0 0x7f9fe0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffd000700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe0003a90 0x7f9fe0003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7e00700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9fe0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 -- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 msgr2=0x7f9fe0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9fe0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 -- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe0003a90 msgr2=0x7f9fe0003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe0003a90 0x7f9fe0003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 -- 172.21.15.50:0/2382460133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00035d0 con 0x7f9fe0004db0 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ff7e00700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ff80cb020 0x7f9fe0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.825+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe0004db0 0x7f9fe0005230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009fc0 tx=0x7f9fe00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cf7b6b12232aea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000ec30 con 0x7f9fe0004db0 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff000f040 con 0x7f9fe0004db0 2024-09-13T15:08:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ff7400700 1 -- 172.21.15.50:0/2382460133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0014480 con 0x7f9fe0004db0 2024-09-13T15:08:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffe400700 1 -- 172.21.15.50:0/2382460133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe0004db0 msgr2=0x7f9fe0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2382460133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fe0004db0 0x7f9fe0005230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009fc0 tx=0x7f9fe00058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffda00700 1 -- 172.21.15.50:0/2382460133 reap_dead start 2024-09-13T15:08:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffe400700 1 -- 172.21.15.50:0/2382460133 shutdown_connections 2024-09-13T15:08:04.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffe400700 1 -- 172.21.15.50:0/2382460133 >> 172.21.15.50:0/2382460133 conn(0x7f9ff80b0c40 msgr2=0x7f9ff806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:04.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffe400700 1 -- 172.21.15.50:0/2382460133 shutdown_connections 2024-09-13T15:08:04.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.829+0000 7f9ffe400700 1 -- 172.21.15.50:0/2382460133 wait complete. 2024-09-13T15:08:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 Processor -- start 2024-09-13T15:08:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 -- start start 2024-09-13T15:08:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe0004db0 0x7f9ff81561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ff8157130 0x7f9ff806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 0x7f9ff81e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81e40b0 con 0x7f9ff81e6480 2024-09-13T15:08:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81e34a0 con 0x7f9ff8157130 2024-09-13T15:08:04.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffe400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81e3780 con 0x7f9fe0004db0 2024-09-13T15:08:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 0x7f9ff81e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 0x7f9ff81e6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57964/0 (socket says 172.21.15.50:57964) 2024-09-13T15:08:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 -- 172.21.15.50:0/2984713277 learned_addr learned my addr 172.21.15.50:0/2984713277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ff7e00700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ff8157130 0x7f9ff806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffd000700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe0004db0 0x7f9ff81561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 -- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe0004db0 msgr2=0x7f9ff81561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe0004db0 0x7f9ff81561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 -- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ff8157130 msgr2=0x7f9ff806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ff8157130 0x7f9ff806cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:04.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.833+0000 7f9ffda00700 1 -- 172.21.15.50:0/2984713277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff81e3a60 con 0x7f9ff81e6480 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ffda00700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 0x7f9ff81e6900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0017040 tx=0x7f9ff0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0007000 con 0x7f9ff81e6480 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0003e70 con 0x7f9ff81e6480 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0014a60 con 0x7f9ff81e6480 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff81e3d40 con 0x7f9ff81e6480 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff806d010 con 0x7f9ff81e6480 2024-09-13T15:08:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff81e4260 con 0x7f9ff81e6480 2024-09-13T15:08:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.837+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ff0024020 con 0x7f9ff81e6480 2024-09-13T15:08:04.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.841+0000 7f9ff4c00700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9fd8066730 0x7f9fd8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.841+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ff0085ba0 con 0x7f9ff81e6480 2024-09-13T15:08:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.841+0000 7f9ffd000700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9fd8066730 0x7f9fd8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.841+0000 7f9ffd000700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9fd8066730 0x7f9fd8068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009bf0 tx=0x7f9fec009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:04.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:04.845+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ff81e4260 con 0x7f9ff81e6480 2024-09-13T15:08:05.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.037+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ff806d230 con 0x7f9ff81e6480 2024-09-13T15:08:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.041+0000 7f9ff4c00700 1 -- 172.21.15.50:0/2984713277 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f9ff002c090 con 0x7f9ff81e6480 2024-09-13T15:08:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:05.044 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9fd8066730 msgr2=0x7f9fd8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9fd8066730 0x7f9fd8068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009bf0 tx=0x7f9fec009240 comp rx=0 tx=0).stop 2024-09-13T15:08:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 msgr2=0x7f9ff81e6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 0x7f9ff81e6900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0017040 tx=0x7f9ff0009750 comp rx=0 tx=0).stop 2024-09-13T15:08:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 shutdown_connections 2024-09-13T15:08:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9fd8066730 0x7f9fd8068bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff81e6480 0x7f9ff81e6900 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ff8157130 0x7f9ff806cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 --2- 172.21.15.50:0/2984713277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fe0004db0 0x7f9ff81561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 >> 172.21.15.50:0/2984713277 conn(0x7f9ff80b0c40 msgr2=0x7f9ff815de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 shutdown_connections 2024-09-13T15:08:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.045+0000 7f9ffe400700 1 -- 172.21.15.50:0/2984713277 wait complete. 2024-09-13T15:08:05.073 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:08:05.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:08:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.245+0000 7f83ea800700 1 Processor -- start 2024-09-13T15:08:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.245+0000 7f83ea800700 1 -- start start 2024-09-13T15:08:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83ea800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83ea800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f83e415e9f0 0x7f83e415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83ea800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e415e560 con 0x7f83e40b3980 2024-09-13T15:08:05.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83ea800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e40adf90 con 0x7f83e415e9f0 2024-09-13T15:08:05.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83ea800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e415d920 con 0x7f83e406aaa0 2024-09-13T15:08:05.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e8a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83e40b3980 0x7f83e406ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57378/0 (socket says 172.21.15.50:57378) 2024-09-13T15:08:05.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e8a00700 1 -- 172.21.15.50:0/780563775 learned_addr learned my addr 172.21.15.50:0/780563775 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:05.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9e00700 1 --2- 172.21.15.50:0/780563775 >> v2:172.21.15.181:3300/0 conn(0x7f83e415e9f0 0x7f83e415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9400700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e3e00700 1 -- 172.21.15.50:0/780563775 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784848431 0 0) 0x7f83e415e560 con 0x7f83e40b3980 2024-09-13T15:08:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e3e00700 1 -- 172.21.15.50:0/780563775 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83cc0035d0 con 0x7f83e40b3980 2024-09-13T15:08:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9e00700 1 -- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 msgr2=0x7f83e415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9e00700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9e00700 1 -- 172.21.15.50:0/780563775 >> v1:172.21.15.50:6789/0 conn(0x7f83e40b3980 legacy=0x7f83e406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9e00700 1 -- 172.21.15.50:0/780563775 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e415dc00 con 0x7f83e415e9f0 2024-09-13T15:08:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9400700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:05.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e9e00700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e415e9f0 0x7f83e415eea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009dc0 tx=0x7f83dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9136410ebd3718a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.249+0000 7f83e3e00700 1 -- 172.21.15.50:0/780563775 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00e070 con 0x7f83e415e9f0 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83e3e00700 1 -- 172.21.15.50:0/780563775 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00bae0 con 0x7f83e415e9f0 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83e3e00700 1 -- 172.21.15.50:0/780563775 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00be90 con 0x7f83e415e9f0 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 -- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e415e9f0 msgr2=0x7f83e415eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e415e9f0 0x7f83e415eea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009dc0 tx=0x7f83dc00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 -- 172.21.15.50:0/780563775 shutdown_connections 2024-09-13T15:08:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e415e9f0 0x7f83e415eea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 --2- 172.21.15.50:0/780563775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 -- 172.21.15.50:0/780563775 >> 172.21.15.50:0/780563775 conn(0x7f83e40b0c40 msgr2=0x7f83e406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:05.259 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 -- 172.21.15.50:0/780563775 shutdown_connections 2024-09-13T15:08:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.253+0000 7f83ea800700 1 -- 172.21.15.50:0/780563775 wait complete. 2024-09-13T15:08:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 Processor -- start 2024-09-13T15:08:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 -- start start 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e41387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e40b3980 0x7f83e40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 0x7f83e41453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4138d10 con 0x7f83e415e9f0 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40cb400 con 0x7f83e40b3980 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83ea800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40cb6e0 con 0x7f83e406aaa0 2024-09-13T15:08:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 0x7f83e41453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 0x7f83e41453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57968/0 (socket says 172.21.15.50:57968) 2024-09-13T15:08:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e8a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e40b3980 0x7f83e40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 -- 172.21.15.50:0/266657159 learned_addr learned my addr 172.21.15.50:0/266657159 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 -- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 msgr2=0x7f83e41387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e41387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 -- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e40b3980 msgr2=0x7f83e40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e40b3980 0x7f83e40ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e9e00700 1 -- 172.21.15.50:0/266657159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80094b0 con 0x7f83e415e9f0 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.257+0000 7f83e8a00700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e40b3980 0x7f83e40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83e9e00700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 0x7f83e41453e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00b370 tx=0x7f83dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc004680 con 0x7f83e415e9f0 2024-09-13T15:08:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc020070 con 0x7f83e415e9f0 2024-09-13T15:08:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc009a70 con 0x7f83e415e9f0 2024-09-13T15:08:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc027480 con 0x7f83e415e9f0 2024-09-13T15:08:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40cbca0 con 0x7f83e415e9f0 2024-09-13T15:08:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.261+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e4138f40 con 0x7f83e415e9f0 2024-09-13T15:08:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.265+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83dc012430 con 0x7f83e415e9f0 2024-09-13T15:08:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.265+0000 7f83e1600700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83c8066730 0x7f83c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.265+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83dc022070 con 0x7f83e415e9f0 2024-09-13T15:08:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.265+0000 7f83e9400700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83c8066730 0x7f83c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.265+0000 7f83e9400700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83c8066730 0x7f83c8068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f83d8006f30 tx=0x7f83d8006e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.269+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83e4138f40 con 0x7f83e415e9f0 2024-09-13T15:08:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.457+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83e40b3dc0 con 0x7f83c8066730 2024-09-13T15:08:05.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.477+0000 7f83e1600700 1 -- 172.21.15.50:0/266657159 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344947 (secure 0 0 0) 0x7f83d800e750 con 0x7f83c8066730 2024-09-13T15:08:05.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83c8066730 msgr2=0x7f83c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83c8066730 0x7f83c8068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f83d8006f30 tx=0x7f83d8006e80 comp rx=0 tx=0).stop 2024-09-13T15:08:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 msgr2=0x7f83e41453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 0x7f83e41453e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00b370 tx=0x7f83dc004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 shutdown_connections 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83c8066730 0x7f83c8068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83e415e9f0 0x7f83e41453e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83e40b3980 0x7f83e40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 --2- 172.21.15.50:0/266657159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83e406aaa0 0x7f83e41387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 >> 172.21.15.50:0/266657159 conn(0x7f83e40b0c40 msgr2=0x7f83e40afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.485+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 shutdown_connections 2024-09-13T15:08:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.489+0000 7f83ea800700 1 -- 172.21.15.50:0/266657159 wait complete. 2024-09-13T15:08:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:08:05.516 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-13T15:08:04.017463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":3272704,"data_stored":1985105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005166"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509590+0000","last_change":"2024-09-13T15:07:37.013443+0000","last_active":"2024-09-13T15:07:41.509590+0000","last_peered":"2024-09-13T15:07:41.509590+0000","last_clean":"2024-09-13T15:07:41.509590+0000","last_became_active":"2024-09-13T15:07:37.013084+0000","last_became_peered":"2024-09-13T15:07:37.013084+0000","last_unstale":"2024-09-13T15:07:41.509590+0000","last_undegraded":"2024-09-13T15:07:41.509590+0000","last_fullsized":"2024-09-13T15:07:41.509590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506356+0000","last_change":"2024-09-13T15:07:37.504754+0000","last_active":"2024-09-13T15:07:41.506356+0000","last_peered":"2024-09-13T15:07:41.506356+0000","last_clean":"2024-09-13T15:07:41.506356+0000","last_became_active":"2024-09-13T15:07:37.504435+0000","last_became_peered":"2024-09-13T15:07:37.504435+0000","last_unstale":"2024-09-13T15:07:41.506356+0000","last_undegraded":"2024-09-13T15:07:41.506356+0000","last_fullsized":"2024-09-13T15:07:41.506356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.009718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.579608+0000","last_change":"2024-09-13T15:07:41.576894+0000","last_active":"2024-09-13T15:07:41.579608+0000","last_peered":"2024-09-13T15:07:41.579608+0000","last_clean":"2024-09-13T15:07:41.579608+0000","last_became_active":"2024-09-13T15:07:41.574143+0000","last_became_peered":"2024-09-13T15:07:41.574143+0000","last_unstale":"2024-09-13T15:07:41.579608+0000","last_undegraded":"2024-09-13T15:07:41.579608+0000","last_fullsized":"2024-09-13T15:07:41.579608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:50.141042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506583+0000","last_change":"2024-09-13T15:07:37.004216+0000","last_active":"2024-09-13T15:07:41.506583+0000","last_peered":"2024-09-13T15:07:41.506583+0000","last_clean":"2024-09-13T15:07:41.506583+0000","last_became_active":"2024-09-13T15:07:37.003718+0000","last_became_peered":"2024-09-13T15:07:37.003718+0000","last_unstale":"2024-09-13T15:07:41.506583+0000","last_undegraded":"2024-09-13T15:07:41.506583+0000","last_fullsized":"2024-09-13T15:07:41.506583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509367+0000","last_change":"2024-09-13T15:07:37.503439+0000","last_active":"2024-09-13T15:07:41.509367+0000","last_peered":"2024-09-13T15:07:41.509367+0000","last_clean":"2024-09-13T15:07:41.509367+0000","last_became_active":"2024-09-13T15:07:37.502983+0000","last_became_peered":"2024-09-13T15:07:37.502983+0000","last_unstale":"2024-09-13T15:07:41.509367+0000","last_undegraded":"2024-09-13T15:07:41.509367+0000","last_fullsized":"2024-09-13T15:07:41.509367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538359+0000","last_change":"2024-09-13T15:07:41.534320+0000","last_active":"2024-09-13T15:07:41.538359+0000","last_peered":"2024-09-13T15:07:41.538359+0000","last_clean":"2024-09-13T15:07:41.538359+0000","last_became_active":"2024-09-13T15:07:41.533553+0000","last_became_peered":"2024-09-13T15:07:41.533553+0000","last_unstale":"2024-09-13T15:07:41.538359+0000","last_undegraded":"2024-09-13T15:07:41.538359+0000","last_fullsized":"2024-09-13T15:07:41.538359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:39.809595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565838+0000","last_change":"2024-09-13T15:07:37.015988+0000","last_active":"2024-09-13T15:07:41.565838+0000","last_peered":"2024-09-13T15:07:41.565838+0000","last_clean":"2024-09-13T15:07:41.565838+0000","last_became_active":"2024-09-13T15:07:37.015680+0000","last_became_peered":"2024-09-13T15:07:37.015680+0000","last_unstale":"2024-09-13T15:07:41.565838+0000","last_undegraded":"2024-09-13T15:07:41.565838+0000","last_fullsized":"2024-09-13T15:07:41.565838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:31.567643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502115+0000","last_change":"2024-09-13T15:07:37.514328+0000","last_active":"2024-09-13T15:07:41.502115+0000","last_peered":"2024-09-13T15:07:41.502115+0000","last_clean":"2024-09-13T15:07:41.502115+0000","last_became_active":"2024-09-13T15:07:37.514028+0000","last_became_peered":"2024-09-13T15:07:37.514028+0000","last_unstale":"2024-09-13T15:07:41.502115+0000","last_undegraded":"2024-09-13T15:07:41.502115+0000","last_fullsized":"2024-09-13T15:07:41.502115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538321+0000","last_change":"2024-09-13T15:07:41.534029+0000","last_active":"2024-09-13T15:07:41.538321+0000","last_peered":"2024-09-13T15:07:41.538321+0000","last_clean":"2024-09-13T15:07:41.538321+0000","last_became_active":"2024-09-13T15:07:41.533515+0000","last_became_peered":"2024-09-13T15:07:41.533515+0000","last_unstale":"2024-09-13T15:07:41.538321+0000","last_undegraded":"2024-09-13T15:07:41.538321+0000","last_fullsized":"2024-09-13T15:07:41.538321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564972+0000","last_change":"2024-09-13T15:07:37.017205+0000","last_active":"2024-09-13T15:07:41.564972+0000","last_peered":"2024-09-13T15:07:41.564972+0000","last_clean":"2024-09-13T15:07:41.564972+0000","last_became_active":"2024-09-13T15:07:37.016766+0000","last_became_peered":"2024-09-13T15:07:37.016766+0000","last_unstale":"2024-09-13T15:07:41.564972+0000","last_undegraded":"2024-09-13T15:07:41.564972+0000","last_fullsized":"2024-09-13T15:07:41.564972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505404+0000","last_change":"2024-09-13T15:07:37.502428+0000","last_active":"2024-09-13T15:07:41.505404+0000","last_peered":"2024-09-13T15:07:41.505404+0000","last_clean":"2024-09-13T15:07:41.505404+0000","last_became_active":"2024-09-13T15:07:37.501967+0000","last_became_peered":"2024-09-13T15:07:37.501967+0000","last_unstale":"2024-09-13T15:07:41.505404+0000","last_undegraded":"2024-09-13T15:07:41.505404+0000","last_fullsized":"2024-09-13T15:07:41.505404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538423+0000","last_change":"2024-09-13T15:07:41.534357+0000","last_active":"2024-09-13T15:07:41.538423+0000","last_peered":"2024-09-13T15:07:41.538423+0000","last_clean":"2024-09-13T15:07:41.538423+0000","last_became_active":"2024-09-13T15:07:41.533662+0000","last_became_peered":"2024-09-13T15:07:41.533662+0000","last_unstale":"2024-09-13T15:07:41.538423+0000","last_undegraded":"2024-09-13T15:07:41.538423+0000","last_fullsized":"2024-09-13T15:07:41.538423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512026+0000","last_change":"2024-09-13T15:07:37.506598+0000","last_active":"2024-09-13T15:07:41.512026+0000","last_peered":"2024-09-13T15:07:41.512026+0000","last_clean":"2024-09-13T15:07:41.512026+0000","last_became_active":"2024-09-13T15:07:37.506317+0000","last_became_peered":"2024-09-13T15:07:37.506317+0000","last_unstale":"2024-09-13T15:07:41.512026+0000","last_undegraded":"2024-09-13T15:07:41.512026+0000","last_fullsized":"2024-09-13T15:07:41.512026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564777+0000","last_change":"2024-09-13T15:07:37.017573+0000","last_active":"2024-09-13T15:07:41.564777+0000","last_peered":"2024-09-13T15:07:41.564777+0000","last_clean":"2024-09-13T15:07:41.564777+0000","last_became_active":"2024-09-13T15:07:37.017395+0000","last_became_peered":"2024-09-13T15:07:37.017395+0000","last_unstale":"2024-09-13T15:07:41.564777+0000","last_undegraded":"2024-09-13T15:07:41.564777+0000","last_fullsized":"2024-09-13T15:07:41.564777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:47.432256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527945+0000","last_change":"2024-09-13T15:07:41.525024+0000","last_active":"2024-09-13T15:07:41.527945+0000","last_peered":"2024-09-13T15:07:41.527945+0000","last_clean":"2024-09-13T15:07:41.527945+0000","last_became_active":"2024-09-13T15:07:41.524498+0000","last_became_peered":"2024-09-13T15:07:41.524498+0000","last_unstale":"2024-09-13T15:07:41.527945+0000","last_undegraded":"2024-09-13T15:07:41.527945+0000","last_fullsized":"2024-09-13T15:07:41.527945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:16.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505218+0000","last_change":"2024-09-13T15:07:37.489676+0000","last_active":"2024-09-13T15:07:41.505218+0000","last_peered":"2024-09-13T15:07:41.505218+0000","last_clean":"2024-09-13T15:07:41.505218+0000","last_became_active":"2024-09-13T15:07:37.487946+0000","last_became_peered":"2024-09-13T15:07:37.487946+0000","last_unstale":"2024-09-13T15:07:41.505218+0000","last_undegraded":"2024-09-13T15:07:41.505218+0000","last_fullsized":"2024-09-13T15:07:41.505218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.522108+0000","last_change":"2024-09-13T15:07:37.012004+0000","last_active":"2024-09-13T15:07:41.522108+0000","last_peered":"2024-09-13T15:07:41.522108+0000","last_clean":"2024-09-13T15:07:41.522108+0000","last_became_active":"2024-09-13T15:07:37.011199+0000","last_became_peered":"2024-09-13T15:07:37.011199+0000","last_unstale":"2024-09-13T15:07:41.522108+0000","last_undegraded":"2024-09-13T15:07:41.522108+0000","last_fullsized":"2024-09-13T15:07:41.522108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538485+0000","last_change":"2024-09-13T15:07:41.535177+0000","last_active":"2024-09-13T15:07:41.538485+0000","last_peered":"2024-09-13T15:07:41.538485+0000","last_clean":"2024-09-13T15:07:41.538485+0000","last_became_active":"2024-09-13T15:07:41.533912+0000","last_became_peered":"2024-09-13T15:07:41.533912+0000","last_unstale":"2024-09-13T15:07:41.538485+0000","last_undegraded":"2024-09-13T15:07:41.538485+0000","last_fullsized":"2024-09-13T15:07:41.538485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523603+0000","last_change":"2024-09-13T15:07:37.495579+0000","last_active":"2024-09-13T15:07:41.523603+0000","last_peered":"2024-09-13T15:07:41.523603+0000","last_clean":"2024-09-13T15:07:41.523603+0000","last_became_active":"2024-09-13T15:07:37.495337+0000","last_became_peered":"2024-09-13T15:07:37.495337+0000","last_unstale":"2024-09-13T15:07:41.523603+0000","last_undegraded":"2024-09-13T15:07:41.523603+0000","last_fullsized":"2024-09-13T15:07:41.523603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521968+0000","last_change":"2024-09-13T15:07:37.013081+0000","last_active":"2024-09-13T15:07:41.521968+0000","last_peered":"2024-09-13T15:07:41.521968+0000","last_clean":"2024-09-13T15:07:41.521968+0000","last_became_active":"2024-09-13T15:07:37.012821+0000","last_became_peered":"2024-09-13T15:07:37.012821+0000","last_unstale":"2024-09-13T15:07:41.521968+0000","last_undegraded":"2024-09-13T15:07:41.521968+0000","last_fullsized":"2024-09-13T15:07:41.521968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577610+0000","last_change":"2024-09-13T15:07:41.572919+0000","last_active":"2024-09-13T15:07:41.577610+0000","last_peered":"2024-09-13T15:07:41.577610+0000","last_clean":"2024-09-13T15:07:41.577610+0000","last_became_active":"2024-09-13T15:07:41.572534+0000","last_became_peered":"2024-09-13T15:07:41.572534+0000","last_unstale":"2024-09-13T15:07:41.577610+0000","last_undegraded":"2024-09-13T15:07:41.577610+0000","last_fullsized":"2024-09-13T15:07:41.577610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503792+0000","last_change":"2024-09-13T15:07:37.484624+0000","last_active":"2024-09-13T15:07:41.503792+0000","last_peered":"2024-09-13T15:07:41.503792+0000","last_clean":"2024-09-13T15:07:41.503792+0000","last_became_active":"2024-09-13T15:07:37.484236+0000","last_became_peered":"2024-09-13T15:07:37.484236+0000","last_unstale":"2024-09-13T15:07:41.503792+0000","last_undegraded":"2024-09-13T15:07:41.503792+0000","last_fullsized":"2024-09-13T15:07:41.503792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:25.167980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.563720+0000","last_change":"2024-09-13T15:07:37.016581+0000","last_active":"2024-09-13T15:07:41.563720+0000","last_peered":"2024-09-13T15:07:41.563720+0000","last_clean":"2024-09-13T15:07:41.563720+0000","last_became_active":"2024-09-13T15:07:37.016253+0000","last_became_peered":"2024-09-13T15:07:37.016253+0000","last_unstale":"2024-09-13T15:07:41.563720+0000","last_undegraded":"2024-09-13T15:07:41.563720+0000","last_fullsized":"2024-09-13T15:07:41.563720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538474+0000","last_change":"2024-09-13T15:07:41.534781+0000","last_active":"2024-09-13T15:07:41.538474+0000","last_peered":"2024-09-13T15:07:41.538474+0000","last_clean":"2024-09-13T15:07:41.538474+0000","last_became_active":"2024-09-13T15:07:41.533999+0000","last_became_peered":"2024-09-13T15:07:41.533999+0000","last_unstale":"2024-09-13T15:07:41.538474+0000","last_undegraded":"2024-09-13T15:07:41.538474+0000","last_fullsized":"2024-09-13T15:07:41.538474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512002+0000","last_change":"2024-09-13T15:07:37.494214+0000","last_active":"2024-09-13T15:07:41.512002+0000","last_peered":"2024-09-13T15:07:41.512002+0000","last_clean":"2024-09-13T15:07:41.512002+0000","last_became_active":"2024-09-13T15:07:37.493854+0000","last_became_peered":"2024-09-13T15:07:37.493854+0000","last_unstale":"2024-09-13T15:07:41.512002+0000","last_undegraded":"2024-09-13T15:07:41.512002+0000","last_fullsized":"2024-09-13T15:07:41.512002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516503+0000","last_change":"2024-09-13T15:07:37.007466+0000","last_active":"2024-09-13T15:07:41.516503+0000","last_peered":"2024-09-13T15:07:41.516503+0000","last_clean":"2024-09-13T15:07:41.516503+0000","last_became_active":"2024-09-13T15:07:37.007189+0000","last_became_peered":"2024-09-13T15:07:37.007189+0000","last_unstale":"2024-09-13T15:07:41.516503+0000","last_undegraded":"2024-09-13T15:07:41.516503+0000","last_fullsized":"2024-09-13T15:07:41.516503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576271+0000","last_change":"2024-09-13T15:07:41.572185+0000","last_active":"2024-09-13T15:07:41.576271+0000","last_peered":"2024-09-13T15:07:41.576271+0000","last_clean":"2024-09-13T15:07:41.576271+0000","last_became_active":"2024-09-13T15:07:41.571676+0000","last_became_peered":"2024-09-13T15:07:41.571676+0000","last_unstale":"2024-09-13T15:07:41.576271+0000","last_undegraded":"2024-09-13T15:07:41.576271+0000","last_fullsized":"2024-09-13T15:07:41.576271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:11.973002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.510056+0000","last_change":"2024-09-13T15:07:37.503628+0000","last_active":"2024-09-13T15:07:41.510056+0000","last_peered":"2024-09-13T15:07:41.510056+0000","last_clean":"2024-09-13T15:07:41.510056+0000","last_became_active":"2024-09-13T15:07:37.503337+0000","last_became_peered":"2024-09-13T15:07:37.503337+0000","last_unstale":"2024-09-13T15:07:41.510056+0000","last_undegraded":"2024-09-13T15:07:41.510056+0000","last_fullsized":"2024-09-13T15:07:41.510056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:42.582773+0000","last_change":"2024-09-13T15:07:37.010802+0000","last_active":"2024-09-13T15:07:42.582773+0000","last_peered":"2024-09-13T15:07:42.582773+0000","last_clean":"2024-09-13T15:07:42.582773+0000","last_became_active":"2024-09-13T15:07:37.010516+0000","last_became_peered":"2024-09-13T15:07:37.010516+0000","last_unstale":"2024-09-13T15:07:42.582773+0000","last_undegraded":"2024-09-13T15:07:42.582773+0000","last_fullsized":"2024-09-13T15:07:42.582773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575285+0000","last_change":"2024-09-13T15:07:41.570403+0000","last_active":"2024-09-13T15:07:41.575285+0000","last_peered":"2024-09-13T15:07:41.575285+0000","last_clean":"2024-09-13T15:07:41.575285+0000","last_became_active":"2024-09-13T15:07:41.569731+0000","last_became_peered":"2024-09-13T15:07:41.569731+0000","last_unstale":"2024-09-13T15:07:41.575285+0000","last_undegraded":"2024-09-13T15:07:41.575285+0000","last_fullsized":"2024-09-13T15:07:41.575285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:47.336008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525415+0000","last_change":"2024-09-13T15:07:37.487456+0000","last_active":"2024-09-13T15:07:41.525415+0000","last_peered":"2024-09-13T15:07:41.525415+0000","last_clean":"2024-09-13T15:07:41.525415+0000","last_became_active":"2024-09-13T15:07:37.487227+0000","last_became_peered":"2024-09-13T15:07:37.487227+0000","last_unstale":"2024-09-13T15:07:41.525415+0000","last_undegraded":"2024-09-13T15:07:41.525415+0000","last_fullsized":"2024-09-13T15:07:41.525415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566354+0000","last_change":"2024-09-13T15:07:37.015462+0000","last_active":"2024-09-13T15:07:41.566354+0000","last_peered":"2024-09-13T15:07:41.566354+0000","last_clean":"2024-09-13T15:07:41.566354+0000","last_became_active":"2024-09-13T15:07:37.015202+0000","last_became_peered":"2024-09-13T15:07:37.015202+0000","last_unstale":"2024-09-13T15:07:41.566354+0000","last_undegraded":"2024-09-13T15:07:41.566354+0000","last_fullsized":"2024-09-13T15:07:41.566354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576630+0000","last_change":"2024-09-13T15:07:41.568111+0000","last_active":"2024-09-13T15:07:41.576630+0000","last_peered":"2024-09-13T15:07:41.576630+0000","last_clean":"2024-09-13T15:07:41.576630+0000","last_became_active":"2024-09-13T15:07:41.567207+0000","last_became_peered":"2024-09-13T15:07:41.567207+0000","last_unstale":"2024-09-13T15:07:41.576630+0000","last_undegraded":"2024-09-13T15:07:41.576630+0000","last_fullsized":"2024-09-13T15:07:41.576630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505482+0000","last_change":"2024-09-13T15:07:37.495265+0000","last_active":"2024-09-13T15:07:41.505482+0000","last_peered":"2024-09-13T15:07:41.505482+0000","last_clean":"2024-09-13T15:07:41.505482+0000","last_became_active":"2024-09-13T15:07:37.494954+0000","last_became_peered":"2024-09-13T15:07:37.494954+0000","last_unstale":"2024-09-13T15:07:41.505482+0000","last_undegraded":"2024-09-13T15:07:41.505482+0000","last_fullsized":"2024-09-13T15:07:41.505482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525500+0000","last_change":"2024-09-13T15:07:37.012286+0000","last_active":"2024-09-13T15:07:41.525500+0000","last_peered":"2024-09-13T15:07:41.525500+0000","last_clean":"2024-09-13T15:07:41.525500+0000","last_became_active":"2024-09-13T15:07:37.010271+0000","last_became_peered":"2024-09-13T15:07:37.010271+0000","last_unstale":"2024-09-13T15:07:41.525500+0000","last_undegraded":"2024-09-13T15:07:41.525500+0000","last_fullsized":"2024-09-13T15:07:41.525500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539227+0000","last_change":"2024-09-13T15:07:41.535358+0000","last_active":"2024-09-13T15:07:41.539227+0000","last_peered":"2024-09-13T15:07:41.539227+0000","last_clean":"2024-09-13T15:07:41.539227+0000","last_became_active":"2024-09-13T15:07:41.534907+0000","last_became_peered":"2024-09-13T15:07:41.534907+0000","last_unstale":"2024-09-13T15:07:41.539227+0000","last_undegraded":"2024-09-13T15:07:41.539227+0000","last_fullsized":"2024-09-13T15:07:41.539227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506408+0000","last_change":"2024-09-13T15:07:37.513201+0000","last_active":"2024-09-13T15:07:41.506408+0000","last_peered":"2024-09-13T15:07:41.506408+0000","last_clean":"2024-09-13T15:07:41.506408+0000","last_became_active":"2024-09-13T15:07:37.512914+0000","last_became_peered":"2024-09-13T15:07:37.512914+0000","last_unstale":"2024-09-13T15:07:41.506408+0000","last_undegraded":"2024-09-13T15:07:41.506408+0000","last_fullsized":"2024-09-13T15:07:41.506408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503150+0000","last_change":"2024-09-13T15:07:37.007476+0000","last_active":"2024-09-13T15:07:41.503150+0000","last_peered":"2024-09-13T15:07:41.503150+0000","last_clean":"2024-09-13T15:07:41.503150+0000","last_became_active":"2024-09-13T15:07:37.006888+0000","last_became_peered":"2024-09-13T15:07:37.006888+0000","last_unstale":"2024-09-13T15:07:41.503150+0000","last_undegraded":"2024-09-13T15:07:41.503150+0000","last_fullsized":"2024-09-13T15:07:41.503150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538962+0000","last_change":"2024-09-13T15:07:41.535459+0000","last_active":"2024-09-13T15:07:41.538962+0000","last_peered":"2024-09-13T15:07:41.538962+0000","last_clean":"2024-09-13T15:07:41.538962+0000","last_became_active":"2024-09-13T15:07:41.534918+0000","last_became_peered":"2024-09-13T15:07:41.534918+0000","last_unstale":"2024-09-13T15:07:41.538962+0000","last_undegraded":"2024-09-13T15:07:41.538962+0000","last_fullsized":"2024-09-13T15:07:41.538962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521735+0000","last_change":"2024-09-13T15:07:37.492499+0000","last_active":"2024-09-13T15:07:41.521735+0000","last_peered":"2024-09-13T15:07:41.521735+0000","last_clean":"2024-09-13T15:07:41.521735+0000","last_became_active":"2024-09-13T15:07:37.492144+0000","last_became_peered":"2024-09-13T15:07:37.492144+0000","last_unstale":"2024-09-13T15:07:41.521735+0000","last_undegraded":"2024-09-13T15:07:41.521735+0000","last_fullsized":"2024-09-13T15:07:41.521735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505110+0000","last_change":"2024-09-13T15:07:37.006492+0000","last_active":"2024-09-13T15:07:41.505110+0000","last_peered":"2024-09-13T15:07:41.505110+0000","last_clean":"2024-09-13T15:07:41.505110+0000","last_became_active":"2024-09-13T15:07:37.004955+0000","last_became_peered":"2024-09-13T15:07:37.004955+0000","last_unstale":"2024-09-13T15:07:41.505110+0000","last_undegraded":"2024-09-13T15:07:41.505110+0000","last_fullsized":"2024-09-13T15:07:41.505110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539457+0000","last_change":"2024-09-13T15:07:41.536499+0000","last_active":"2024-09-13T15:07:41.539457+0000","last_peered":"2024-09-13T15:07:41.539457+0000","last_clean":"2024-09-13T15:07:41.539457+0000","last_became_active":"2024-09-13T15:07:41.536051+0000","last_became_peered":"2024-09-13T15:07:41.536051+0000","last_unstale":"2024-09-13T15:07:41.539457+0000","last_undegraded":"2024-09-13T15:07:41.539457+0000","last_fullsized":"2024-09-13T15:07:41.539457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506936+0000","last_change":"2024-09-13T15:07:37.491784+0000","last_active":"2024-09-13T15:07:41.506936+0000","last_peered":"2024-09-13T15:07:41.506936+0000","last_clean":"2024-09-13T15:07:41.506936+0000","last_became_active":"2024-09-13T15:07:37.491544+0000","last_became_peered":"2024-09-13T15:07:37.491544+0000","last_unstale":"2024-09-13T15:07:41.506936+0000","last_undegraded":"2024-09-13T15:07:41.506936+0000","last_fullsized":"2024-09-13T15:07:41.506936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:13.919211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564277+0000","last_change":"2024-09-13T15:07:37.014778+0000","last_active":"2024-09-13T15:07:41.564277+0000","last_peered":"2024-09-13T15:07:41.564277+0000","last_clean":"2024-09-13T15:07:41.564277+0000","last_became_active":"2024-09-13T15:07:37.014475+0000","last_became_peered":"2024-09-13T15:07:37.014475+0000","last_unstale":"2024-09-13T15:07:41.564277+0000","last_undegraded":"2024-09-13T15:07:41.564277+0000","last_fullsized":"2024-09-13T15:07:41.564277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577706+0000","last_change":"2024-09-13T15:07:41.572783+0000","last_active":"2024-09-13T15:07:41.577706+0000","last_peered":"2024-09-13T15:07:41.577706+0000","last_clean":"2024-09-13T15:07:41.577706+0000","last_became_active":"2024-09-13T15:07:41.571654+0000","last_became_peered":"2024-09-13T15:07:41.571654+0000","last_unstale":"2024-09-13T15:07:41.577706+0000","last_undegraded":"2024-09-13T15:07:41.577706+0000","last_fullsized":"2024-09-13T15:07:41.577706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.506083+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.505793+0000","last_became_peered":"2024-09-13T15:07:37.505793+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503229+0000","last_change":"2024-09-13T15:07:36.995886+0000","last_active":"2024-09-13T15:07:41.503229+0000","last_peered":"2024-09-13T15:07:41.503229+0000","last_clean":"2024-09-13T15:07:41.503229+0000","last_became_active":"2024-09-13T15:07:36.995560+0000","last_became_peered":"2024-09-13T15:07:36.995560+0000","last_unstale":"2024-09-13T15:07:41.503229+0000","last_undegraded":"2024-09-13T15:07:41.503229+0000","last_fullsized":"2024-09-13T15:07:41.503229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564508+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:07:41.564508+0000","last_peered":"2024-09-13T15:07:41.564508+0000","last_clean":"2024-09-13T15:07:41.564508+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:07:41.564508+0000","last_undegraded":"2024-09-13T15:07:41.564508+0000","last_fullsized":"2024-09-13T15:07:41.564508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573389+0000","last_change":"2024-09-13T15:07:41.568736+0000","last_active":"2024-09-13T15:07:41.573389+0000","last_peered":"2024-09-13T15:07:41.573389+0000","last_clean":"2024-09-13T15:07:41.573389+0000","last_became_active":"2024-09-13T15:07:41.568356+0000","last_became_peered":"2024-09-13T15:07:41.568356+0000","last_unstale":"2024-09-13T15:07:41.573389+0000","last_undegraded":"2024-09-13T15:07:41.573389+0000","last_fullsized":"2024-09-13T15:07:41.573389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:32.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565674+0000","last_change":"2024-09-13T15:07:37.500315+0000","last_active":"2024-09-13T15:07:41.565674+0000","last_peered":"2024-09-13T15:07:41.565674+0000","last_clean":"2024-09-13T15:07:41.565674+0000","last_became_active":"2024-09-13T15:07:37.499912+0000","last_became_peered":"2024-09-13T15:07:37.499912+0000","last_unstale":"2024-09-13T15:07:41.565674+0000","last_undegraded":"2024-09-13T15:07:41.565674+0000","last_fullsized":"2024-09-13T15:07:41.565674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511110+0000","last_change":"2024-09-13T15:07:37.005731+0000","last_active":"2024-09-13T15:07:41.511110+0000","last_peered":"2024-09-13T15:07:41.511110+0000","last_clean":"2024-09-13T15:07:41.511110+0000","last_became_active":"2024-09-13T15:07:37.005196+0000","last_became_peered":"2024-09-13T15:07:37.005196+0000","last_unstale":"2024-09-13T15:07:41.511110+0000","last_undegraded":"2024-09-13T15:07:41.511110+0000","last_fullsized":"2024-09-13T15:07:41.511110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.567559+0000","last_change":"2024-09-13T15:07:41.565589+0000","last_active":"2024-09-13T15:07:41.567559+0000","last_peered":"2024-09-13T15:07:41.567559+0000","last_clean":"2024-09-13T15:07:41.567559+0000","last_became_active":"2024-09-13T15:07:41.565135+0000","last_became_peered":"2024-09-13T15:07:41.565135+0000","last_unstale":"2024-09-13T15:07:41.567559+0000","last_undegraded":"2024-09-13T15:07:41.567559+0000","last_fullsized":"2024-09-13T15:07:41.567559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:41.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504783+0000","last_change":"2024-09-13T15:07:37.494952+0000","last_active":"2024-09-13T15:07:41.504783+0000","last_peered":"2024-09-13T15:07:41.504783+0000","last_clean":"2024-09-13T15:07:41.504783+0000","last_became_active":"2024-09-13T15:07:37.494616+0000","last_became_peered":"2024-09-13T15:07:37.494616+0000","last_unstale":"2024-09-13T15:07:41.504783+0000","last_undegraded":"2024-09-13T15:07:41.504783+0000","last_fullsized":"2024-09-13T15:07:41.504783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526436+0000","last_change":"2024-09-13T15:07:37.016938+0000","last_active":"2024-09-13T15:07:41.526436+0000","last_peered":"2024-09-13T15:07:41.526436+0000","last_clean":"2024-09-13T15:07:41.526436+0000","last_became_active":"2024-09-13T15:07:37.016416+0000","last_became_peered":"2024-09-13T15:07:37.016416+0000","last_unstale":"2024-09-13T15:07:41.526436+0000","last_undegraded":"2024-09-13T15:07:41.526436+0000","last_fullsized":"2024-09-13T15:07:41.526436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533876+0000","last_change":"2024-09-13T15:07:41.530568+0000","last_active":"2024-09-13T15:07:41.533876+0000","last_peered":"2024-09-13T15:07:41.533876+0000","last_clean":"2024-09-13T15:07:41.533876+0000","last_became_active":"2024-09-13T15:07:41.528769+0000","last_became_peered":"2024-09-13T15:07:41.528769+0000","last_unstale":"2024-09-13T15:07:41.533876+0000","last_undegraded":"2024-09-13T15:07:41.533876+0000","last_fullsized":"2024-09-13T15:07:41.533876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:21.253459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566675+0000","last_change":"2024-09-13T15:07:37.516289+0000","last_active":"2024-09-13T15:07:41.566675+0000","last_peered":"2024-09-13T15:07:41.566675+0000","last_clean":"2024-09-13T15:07:41.566675+0000","last_became_active":"2024-09-13T15:07:37.515469+0000","last_became_peered":"2024-09-13T15:07:37.515469+0000","last_unstale":"2024-09-13T15:07:41.566675+0000","last_undegraded":"2024-09-13T15:07:41.566675+0000","last_fullsized":"2024-09-13T15:07:41.566675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505710+0000","last_change":"2024-09-13T15:07:37.004010+0000","last_active":"2024-09-13T15:07:41.505710+0000","last_peered":"2024-09-13T15:07:41.505710+0000","last_clean":"2024-09-13T15:07:41.505710+0000","last_became_active":"2024-09-13T15:07:37.003685+0000","last_became_peered":"2024-09-13T15:07:37.003685+0000","last_unstale":"2024-09-13T15:07:41.505710+0000","last_undegraded":"2024-09-13T15:07:41.505710+0000","last_fullsized":"2024-09-13T15:07:41.505710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.571567+0000","last_change":"2024-09-13T15:07:41.570035+0000","last_active":"2024-09-13T15:07:41.571567+0000","last_peered":"2024-09-13T15:07:41.571567+0000","last_clean":"2024-09-13T15:07:41.571567+0000","last_became_active":"2024-09-13T15:07:41.566940+0000","last_became_peered":"2024-09-13T15:07:41.566940+0000","last_unstale":"2024-09-13T15:07:41.571567+0000","last_undegraded":"2024-09-13T15:07:41.571567+0000","last_fullsized":"2024-09-13T15:07:41.571567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565356+0000","last_change":"2024-09-13T15:07:37.519128+0000","last_active":"2024-09-13T15:07:41.565356+0000","last_peered":"2024-09-13T15:07:41.565356+0000","last_clean":"2024-09-13T15:07:41.565356+0000","last_became_active":"2024-09-13T15:07:37.518869+0000","last_became_peered":"2024-09-13T15:07:37.518869+0000","last_unstale":"2024-09-13T15:07:41.565356+0000","last_undegraded":"2024-09-13T15:07:41.565356+0000","last_fullsized":"2024-09-13T15:07:41.565356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503446+0000","last_change":"2024-09-13T15:07:37.010518+0000","last_active":"2024-09-13T15:07:41.503446+0000","last_peered":"2024-09-13T15:07:41.503446+0000","last_clean":"2024-09-13T15:07:41.503446+0000","last_became_active":"2024-09-13T15:07:37.008427+0000","last_became_peered":"2024-09-13T15:07:37.008427+0000","last_unstale":"2024-09-13T15:07:41.503446+0000","last_undegraded":"2024-09-13T15:07:41.503446+0000","last_fullsized":"2024-09-13T15:07:41.503446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.536864+0000","last_change":"2024-09-13T15:07:41.532322+0000","last_active":"2024-09-13T15:07:41.536864+0000","last_peered":"2024-09-13T15:07:41.536864+0000","last_clean":"2024-09-13T15:07:41.536864+0000","last_became_active":"2024-09-13T15:07:41.531912+0000","last_became_peered":"2024-09-13T15:07:41.531912+0000","last_unstale":"2024-09-13T15:07:41.536864+0000","last_undegraded":"2024-09-13T15:07:41.536864+0000","last_fullsized":"2024-09-13T15:07:41.536864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:30.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564696+0000","last_change":"2024-09-13T15:07:37.515251+0000","last_active":"2024-09-13T15:07:41.564696+0000","last_peered":"2024-09-13T15:07:41.564696+0000","last_clean":"2024-09-13T15:07:41.564696+0000","last_became_active":"2024-09-13T15:07:37.514972+0000","last_became_peered":"2024-09-13T15:07:37.514972+0000","last_unstale":"2024-09-13T15:07:41.564696+0000","last_undegraded":"2024-09-13T15:07:41.564696+0000","last_fullsized":"2024-09-13T15:07:41.564696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504636+0000","last_change":"2024-09-13T15:07:37.004826+0000","last_active":"2024-09-13T15:07:41.504636+0000","last_peered":"2024-09-13T15:07:41.504636+0000","last_clean":"2024-09-13T15:07:41.504636+0000","last_became_active":"2024-09-13T15:07:37.004447+0000","last_became_peered":"2024-09-13T15:07:37.004447+0000","last_unstale":"2024-09-13T15:07:41.504636+0000","last_undegraded":"2024-09-13T15:07:41.504636+0000","last_fullsized":"2024-09-13T15:07:41.504636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.540805+0000","last_change":"2024-09-13T15:07:41.537561+0000","last_active":"2024-09-13T15:07:41.540805+0000","last_peered":"2024-09-13T15:07:41.540805+0000","last_clean":"2024-09-13T15:07:41.540805+0000","last_became_active":"2024-09-13T15:07:41.536984+0000","last_became_peered":"2024-09-13T15:07:41.536984+0000","last_unstale":"2024-09-13T15:07:41.540805+0000","last_undegraded":"2024-09-13T15:07:41.540805+0000","last_fullsized":"2024-09-13T15:07:41.540805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511993+0000","last_change":"2024-09-13T15:07:37.498344+0000","last_active":"2024-09-13T15:07:41.511993+0000","last_peered":"2024-09-13T15:07:41.511993+0000","last_clean":"2024-09-13T15:07:41.511993+0000","last_became_active":"2024-09-13T15:07:37.498068+0000","last_became_peered":"2024-09-13T15:07:37.498068+0000","last_unstale":"2024-09-13T15:07:41.511993+0000","last_undegraded":"2024-09-13T15:07:41.511993+0000","last_fullsized":"2024-09-13T15:07:41.511993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511905+0000","last_change":"2024-09-13T15:07:36.997359+0000","last_active":"2024-09-13T15:07:41.511905+0000","last_peered":"2024-09-13T15:07:41.511905+0000","last_clean":"2024-09-13T15:07:41.511905+0000","last_became_active":"2024-09-13T15:07:36.997095+0000","last_became_peered":"2024-09-13T15:07:36.997095+0000","last_unstale":"2024-09-13T15:07:41.511905+0000","last_undegraded":"2024-09-13T15:07:41.511905+0000","last_fullsized":"2024-09-13T15:07:41.511905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578693+0000","last_change":"2024-09-13T15:07:41.574687+0000","last_active":"2024-09-13T15:07:41.578693+0000","last_peered":"2024-09-13T15:07:41.578693+0000","last_clean":"2024-09-13T15:07:41.578693+0000","last_became_active":"2024-09-13T15:07:41.573353+0000","last_became_peered":"2024-09-13T15:07:41.573353+0000","last_unstale":"2024-09-13T15:07:41.578693+0000","last_undegraded":"2024-09-13T15:07:41.578693+0000","last_fullsized":"2024-09-13T15:07:41.578693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:52.778665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564643+0000","last_change":"2024-09-13T15:07:37.518920+0000","last_active":"2024-09-13T15:07:41.564643+0000","last_peered":"2024-09-13T15:07:41.564643+0000","last_clean":"2024-09-13T15:07:41.564643+0000","last_became_active":"2024-09-13T15:07:37.518651+0000","last_became_peered":"2024-09-13T15:07:37.518651+0000","last_unstale":"2024-09-13T15:07:41.564643+0000","last_undegraded":"2024-09-13T15:07:41.564643+0000","last_fullsized":"2024-09-13T15:07:41.564643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503060+0000","last_change":"2024-09-13T15:07:37.007685+0000","last_active":"2024-09-13T15:07:41.503060+0000","last_peered":"2024-09-13T15:07:41.503060+0000","last_clean":"2024-09-13T15:07:41.503060+0000","last_became_active":"2024-09-13T15:07:37.007213+0000","last_became_peered":"2024-09-13T15:07:37.007213+0000","last_unstale":"2024-09-13T15:07:41.503060+0000","last_undegraded":"2024-09-13T15:07:41.503060+0000","last_fullsized":"2024-09-13T15:07:41.503060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573282+0000","last_change":"2024-09-13T15:07:41.568051+0000","last_active":"2024-09-13T15:07:41.573282+0000","last_peered":"2024-09-13T15:07:41.573282+0000","last_clean":"2024-09-13T15:07:41.573282+0000","last_became_active":"2024-09-13T15:07:41.566715+0000","last_became_peered":"2024-09-13T15:07:41.566715+0000","last_unstale":"2024-09-13T15:07:41.573282+0000","last_undegraded":"2024-09-13T15:07:41.573282+0000","last_fullsized":"2024-09-13T15:07:41.573282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505146+0000","last_change":"2024-09-13T15:07:37.506015+0000","last_active":"2024-09-13T15:07:41.505146+0000","last_peered":"2024-09-13T15:07:41.505146+0000","last_clean":"2024-09-13T15:07:41.505146+0000","last_became_active":"2024-09-13T15:07:37.505661+0000","last_became_peered":"2024-09-13T15:07:37.505661+0000","last_unstale":"2024-09-13T15:07:41.505146+0000","last_undegraded":"2024-09-13T15:07:41.505146+0000","last_fullsized":"2024-09-13T15:07:41.505146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515345+0000","last_change":"2024-09-13T15:07:37.009882+0000","last_active":"2024-09-13T15:07:41.515345+0000","last_peered":"2024-09-13T15:07:41.515345+0000","last_clean":"2024-09-13T15:07:41.515345+0000","last_became_active":"2024-09-13T15:07:37.009351+0000","last_became_peered":"2024-09-13T15:07:37.009351+0000","last_unstale":"2024-09-13T15:07:41.515345+0000","last_undegraded":"2024-09-13T15:07:41.515345+0000","last_fullsized":"2024-09-13T15:07:41.515345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575567+0000","last_change":"2024-09-13T15:07:41.571228+0000","last_active":"2024-09-13T15:07:41.575567+0000","last_peered":"2024-09-13T15:07:41.575567+0000","last_clean":"2024-09-13T15:07:41.575567+0000","last_became_active":"2024-09-13T15:07:41.570618+0000","last_became_peered":"2024-09-13T15:07:41.570618+0000","last_unstale":"2024-09-13T15:07:41.575567+0000","last_undegraded":"2024-09-13T15:07:41.575567+0000","last_fullsized":"2024-09-13T15:07:41.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:29.764351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565542+0000","last_change":"2024-09-13T15:07:37.500097+0000","last_active":"2024-09-13T15:07:41.565542+0000","last_peered":"2024-09-13T15:07:41.565542+0000","last_clean":"2024-09-13T15:07:41.565542+0000","last_became_active":"2024-09-13T15:07:37.499700+0000","last_became_peered":"2024-09-13T15:07:37.499700+0000","last_unstale":"2024-09-13T15:07:41.565542+0000","last_undegraded":"2024-09-13T15:07:41.565542+0000","last_fullsized":"2024-09-13T15:07:41.565542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:54.189933+0000","last_change":"2024-09-13T15:07:37.004068+0000","last_active":"2024-09-13T15:07:54.189933+0000","last_peered":"2024-09-13T15:07:54.189933+0000","last_clean":"2024-09-13T15:07:54.189933+0000","last_became_active":"2024-09-13T15:07:37.003828+0000","last_became_peered":"2024-09-13T15:07:37.003828+0000","last_unstale":"2024-09-13T15:07:54.189933+0000","last_undegraded":"2024-09-13T15:07:54.189933+0000","last_fullsized":"2024-09-13T15:07:54.189933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533775+0000","last_change":"2024-09-13T15:07:41.531428+0000","last_active":"2024-09-13T15:07:41.533775+0000","last_peered":"2024-09-13T15:07:41.533775+0000","last_clean":"2024-09-13T15:07:41.533775+0000","last_became_active":"2024-09-13T15:07:41.531005+0000","last_became_peered":"2024-09-13T15:07:41.531005+0000","last_unstale":"2024-09-13T15:07:41.533775+0000","last_undegraded":"2024-09-13T15:07:41.533775+0000","last_fullsized":"2024-09-13T15:07:41.533775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:12.805480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504532+0000","last_change":"2024-09-13T15:07:37.515016+0000","last_active":"2024-09-13T15:07:41.504532+0000","last_peered":"2024-09-13T15:07:41.504532+0000","last_clean":"2024-09-13T15:07:41.504532+0000","last_became_active":"2024-09-13T15:07:37.514791+0000","last_became_peered":"2024-09-13T15:07:37.514791+0000","last_unstale":"2024-09-13T15:07:41.504532+0000","last_undegraded":"2024-09-13T15:07:41.504532+0000","last_fullsized":"2024-09-13T15:07:41.504532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526346+0000","last_change":"2024-09-13T15:07:37.015782+0000","last_active":"2024-09-13T15:07:41.526346+0000","last_peered":"2024-09-13T15:07:41.526346+0000","last_clean":"2024-09-13T15:07:41.526346+0000","last_became_active":"2024-09-13T15:07:37.015458+0000","last_became_peered":"2024-09-13T15:07:37.015458+0000","last_unstale":"2024-09-13T15:07:41.526346+0000","last_undegraded":"2024-09-13T15:07:41.526346+0000","last_fullsized":"2024-09-13T15:07:41.526346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.528017+0000","last_change":"2024-09-13T15:07:41.525109+0000","last_active":"2024-09-13T15:07:41.528017+0000","last_peered":"2024-09-13T15:07:41.528017+0000","last_clean":"2024-09-13T15:07:41.528017+0000","last_became_active":"2024-09-13T15:07:41.524368+0000","last_became_peered":"2024-09-13T15:07:41.524368+0000","last_unstale":"2024-09-13T15:07:41.528017+0000","last_undegraded":"2024-09-13T15:07:41.528017+0000","last_fullsized":"2024-09-13T15:07:41.528017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.479957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509473+0000","last_change":"2024-09-13T15:07:37.503285+0000","last_active":"2024-09-13T15:07:41.509473+0000","last_peered":"2024-09-13T15:07:41.509473+0000","last_clean":"2024-09-13T15:07:41.509473+0000","last_became_active":"2024-09-13T15:07:37.502590+0000","last_became_peered":"2024-09-13T15:07:37.502590+0000","last_unstale":"2024-09-13T15:07:41.509473+0000","last_undegraded":"2024-09-13T15:07:41.509473+0000","last_fullsized":"2024-09-13T15:07:41.509473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:19.522117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505205+0000","last_change":"2024-09-13T15:07:37.006134+0000","last_active":"2024-09-13T15:07:41.505205+0000","last_peered":"2024-09-13T15:07:41.505205+0000","last_clean":"2024-09-13T15:07:41.505205+0000","last_became_active":"2024-09-13T15:07:37.005639+0000","last_became_peered":"2024-09-13T15:07:37.005639+0000","last_unstale":"2024-09-13T15:07:41.505205+0000","last_undegraded":"2024-09-13T15:07:41.505205+0000","last_fullsized":"2024-09-13T15:07:41.505205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.534013+0000","last_change":"2024-09-13T15:07:41.531809+0000","last_active":"2024-09-13T15:07:41.534013+0000","last_peered":"2024-09-13T15:07:41.534013+0000","last_clean":"2024-09-13T15:07:41.534013+0000","last_became_active":"2024-09-13T15:07:41.527321+0000","last_became_peered":"2024-09-13T15:07:41.527321+0000","last_unstale":"2024-09-13T15:07:41.534013+0000","last_undegraded":"2024-09-13T15:07:41.534013+0000","last_fullsized":"2024-09-13T15:07:41.534013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:39.844754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505119+0000","last_change":"2024-09-13T15:07:37.504536+0000","last_active":"2024-09-13T15:07:41.505119+0000","last_peered":"2024-09-13T15:07:41.505119+0000","last_clean":"2024-09-13T15:07:41.505119+0000","last_became_active":"2024-09-13T15:07:37.504176+0000","last_became_peered":"2024-09-13T15:07:37.504176+0000","last_unstale":"2024-09-13T15:07:41.505119+0000","last_undegraded":"2024-09-13T15:07:41.505119+0000","last_fullsized":"2024-09-13T15:07:41.505119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516435+0000","last_change":"2024-09-13T15:07:37.005951+0000","last_active":"2024-09-13T15:07:41.516435+0000","last_peered":"2024-09-13T15:07:41.516435+0000","last_clean":"2024-09-13T15:07:41.516435+0000","last_became_active":"2024-09-13T15:07:37.005548+0000","last_became_peered":"2024-09-13T15:07:37.005548+0000","last_unstale":"2024-09-13T15:07:41.516435+0000","last_undegraded":"2024-09-13T15:07:41.516435+0000","last_fullsized":"2024-09-13T15:07:41.516435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578487+0000","last_change":"2024-09-13T15:07:41.571875+0000","last_active":"2024-09-13T15:07:41.578487+0000","last_peered":"2024-09-13T15:07:41.578487+0000","last_clean":"2024-09-13T15:07:41.578487+0000","last_became_active":"2024-09-13T15:07:41.569987+0000","last_became_peered":"2024-09-13T15:07:41.569987+0000","last_unstale":"2024-09-13T15:07:41.578487+0000","last_undegraded":"2024-09-13T15:07:41.578487+0000","last_fullsized":"2024-09-13T15:07:41.578487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577725+0000","last_change":"2024-09-13T15:07:41.573083+0000","last_active":"2024-09-13T15:07:41.577725+0000","last_peered":"2024-09-13T15:07:41.577725+0000","last_clean":"2024-09-13T15:07:41.577725+0000","last_became_active":"2024-09-13T15:07:41.572220+0000","last_became_peered":"2024-09-13T15:07:41.572220+0000","last_unstale":"2024-09-13T15:07:41.577725+0000","last_undegraded":"2024-09-13T15:07:41.577725+0000","last_fullsized":"2024-09-13T15:07:41.577725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521874+0000","last_change":"2024-09-13T15:07:37.493152+0000","last_active":"2024-09-13T15:07:41.521874+0000","last_peered":"2024-09-13T15:07:41.521874+0000","last_clean":"2024-09-13T15:07:41.521874+0000","last_became_active":"2024-09-13T15:07:37.492891+0000","last_became_peered":"2024-09-13T15:07:37.492891+0000","last_unstale":"2024-09-13T15:07:41.521874+0000","last_undegraded":"2024-09-13T15:07:41.521874+0000","last_fullsized":"2024-09-13T15:07:41.521874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503103+0000","last_change":"2024-09-13T15:07:37.002734+0000","last_active":"2024-09-13T15:07:41.503103+0000","last_peered":"2024-09-13T15:07:41.503103+0000","last_clean":"2024-09-13T15:07:41.503103+0000","last_became_active":"2024-09-13T15:07:37.002305+0000","last_became_peered":"2024-09-13T15:07:37.002305+0000","last_unstale":"2024-09-13T15:07:41.503103+0000","last_undegraded":"2024-09-13T15:07:41.503103+0000","last_fullsized":"2024-09-13T15:07:41.503103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533380+0000","last_change":"2024-09-13T15:07:41.527871+0000","last_active":"2024-09-13T15:07:41.533380+0000","last_peered":"2024-09-13T15:07:41.533380+0000","last_clean":"2024-09-13T15:07:41.533380+0000","last_became_active":"2024-09-13T15:07:41.527114+0000","last_became_peered":"2024-09-13T15:07:41.527114+0000","last_unstale":"2024-09-13T15:07:41.533380+0000","last_undegraded":"2024-09-13T15:07:41.533380+0000","last_fullsized":"2024-09-13T15:07:41.533380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523542+0000","last_change":"2024-09-13T15:07:37.490427+0000","last_active":"2024-09-13T15:07:41.523542+0000","last_peered":"2024-09-13T15:07:41.523542+0000","last_clean":"2024-09-13T15:07:41.523542+0000","last_became_active":"2024-09-13T15:07:37.490022+0000","last_became_peered":"2024-09-13T15:07:37.490022+0000","last_unstale":"2024-09-13T15:07:41.523542+0000","last_undegraded":"2024-09-13T15:07:41.523542+0000","last_fullsized":"2024-09-13T15:07:41.523542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506961+0000","last_change":"2024-09-13T15:07:37.007543+0000","last_active":"2024-09-13T15:07:41.506961+0000","last_peered":"2024-09-13T15:07:41.506961+0000","last_clean":"2024-09-13T15:07:41.506961+0000","last_became_active":"2024-09-13T15:07:37.007134+0000","last_became_peered":"2024-09-13T15:07:37.007134+0000","last_unstale":"2024-09-13T15:07:41.506961+0000","last_undegraded":"2024-09-13T15:07:41.506961+0000","last_fullsized":"2024-09-13T15:07:41.506961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512143+0000","last_change":"2024-09-13T15:07:37.003099+0000","last_active":"2024-09-13T15:07:41.512143+0000","last_peered":"2024-09-13T15:07:41.512143+0000","last_clean":"2024-09-13T15:07:41.512143+0000","last_became_active":"2024-09-13T15:07:37.001875+0000","last_became_peered":"2024-09-13T15:07:37.001875+0000","last_unstale":"2024-09-13T15:07:41.512143+0000","last_undegraded":"2024-09-13T15:07:41.512143+0000","last_fullsized":"2024-09-13T15:07:41.512143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515252+0000","last_change":"2024-09-13T15:07:37.514343+0000","last_active":"2024-09-13T15:07:41.515252+0000","last_peered":"2024-09-13T15:07:41.515252+0000","last_clean":"2024-09-13T15:07:41.515252+0000","last_became_active":"2024-09-13T15:07:37.514044+0000","last_became_peered":"2024-09-13T15:07:37.514044+0000","last_unstale":"2024-09-13T15:07:41.515252+0000","last_undegraded":"2024-09-13T15:07:41.515252+0000","last_fullsized":"2024-09-13T15:07:41.515252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538959+0000","last_change":"2024-09-13T15:07:41.536373+0000","last_active":"2024-09-13T15:07:41.538959+0000","last_peered":"2024-09-13T15:07:41.538959+0000","last_clean":"2024-09-13T15:07:41.538959+0000","last_became_active":"2024-09-13T15:07:41.535945+0000","last_became_peered":"2024-09-13T15:07:41.535945+0000","last_unstale":"2024-09-13T15:07:41.538959+0000","last_undegraded":"2024-09-13T15:07:41.538959+0000","last_fullsized":"2024-09-13T15:07:41.538959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:09.980333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505339+0000","last_change":"2024-09-13T15:07:37.008842+0000","last_active":"2024-09-13T15:07:41.505339+0000","last_peered":"2024-09-13T15:07:41.505339+0000","last_clean":"2024-09-13T15:07:41.505339+0000","last_became_active":"2024-09-13T15:07:37.008556+0000","last_became_peered":"2024-09-13T15:07:37.008556+0000","last_unstale":"2024-09-13T15:07:41.505339+0000","last_undegraded":"2024-09-13T15:07:41.505339+0000","last_fullsized":"2024-09-13T15:07:41.505339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507931+0000","last_change":"2024-09-13T15:07:37.493138+0000","last_active":"2024-09-13T15:07:41.507931+0000","last_peered":"2024-09-13T15:07:41.507931+0000","last_clean":"2024-09-13T15:07:41.507931+0000","last_became_active":"2024-09-13T15:07:37.492811+0000","last_became_peered":"2024-09-13T15:07:37.492811+0000","last_unstale":"2024-09-13T15:07:41.507931+0000","last_undegraded":"2024-09-13T15:07:41.507931+0000","last_fullsized":"2024-09-13T15:07:41.507931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533522+0000","last_change":"2024-09-13T15:07:41.531188+0000","last_active":"2024-09-13T15:07:41.533522+0000","last_peered":"2024-09-13T15:07:41.533522+0000","last_clean":"2024-09-13T15:07:41.533522+0000","last_became_active":"2024-09-13T15:07:41.530750+0000","last_became_peered":"2024-09-13T15:07:41.530750+0000","last_unstale":"2024-09-13T15:07:41.533522+0000","last_undegraded":"2024-09-13T15:07:41.533522+0000","last_fullsized":"2024-09-13T15:07:41.533522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:17.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511841+0000","last_change":"2024-09-13T15:07:37.502829+0000","last_active":"2024-09-13T15:07:41.511841+0000","last_peered":"2024-09-13T15:07:41.511841+0000","last_clean":"2024-09-13T15:07:41.511841+0000","last_became_active":"2024-09-13T15:07:37.502567+0000","last_became_peered":"2024-09-13T15:07:37.502567+0000","last_unstale":"2024-09-13T15:07:41.511841+0000","last_undegraded":"2024-09-13T15:07:41.511841+0000","last_fullsized":"2024-09-13T15:07:41.511841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505009+0000","last_change":"2024-09-13T15:07:37.499515+0000","last_active":"2024-09-13T15:07:41.505009+0000","last_peered":"2024-09-13T15:07:41.505009+0000","last_clean":"2024-09-13T15:07:41.505009+0000","last_became_active":"2024-09-13T15:07:37.499249+0000","last_became_peered":"2024-09-13T15:07:37.499249+0000","last_unstale":"2024-09-13T15:07:41.505009+0000","last_undegraded":"2024-09-13T15:07:41.505009+0000","last_fullsized":"2024-09-13T15:07:41.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502954+0000","last_change":"2024-09-13T15:07:37.491947+0000","last_active":"2024-09-13T15:07:41.502954+0000","last_peered":"2024-09-13T15:07:41.502954+0000","last_clean":"2024-09-13T15:07:41.502954+0000","last_became_active":"2024-09-13T15:07:37.491654+0000","last_became_peered":"2024-09-13T15:07:37.491654+0000","last_unstale":"2024-09-13T15:07:41.502954+0000","last_undegraded":"2024-09-13T15:07:41.502954+0000","last_fullsized":"2024-09-13T15:07:41.502954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515163+0000","last_change":"2024-09-13T15:07:37.492083+0000","last_active":"2024-09-13T15:07:41.515163+0000","last_peered":"2024-09-13T15:07:41.515163+0000","last_clean":"2024-09-13T15:07:41.515163+0000","last_became_active":"2024-09-13T15:07:37.491195+0000","last_became_peered":"2024-09-13T15:07:37.491195+0000","last_unstale":"2024-09-13T15:07:41.515163+0000","last_undegraded":"2024-09-13T15:07:41.515163+0000","last_fullsized":"2024-09-13T15:07:41.515163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507538+0000","last_change":"2024-09-13T15:07:37.510538+0000","last_active":"2024-09-13T15:07:41.507538+0000","last_peered":"2024-09-13T15:07:41.507538+0000","last_clean":"2024-09-13T15:07:41.507538+0000","last_became_active":"2024-09-13T15:07:37.510162+0000","last_became_peered":"2024-09-13T15:07:37.510162+0000","last_unstale":"2024-09-13T15:07:41.507538+0000","last_undegraded":"2024-09-13T15:07:41.507538+0000","last_fullsized":"2024-09-13T15:07:41.507538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525991+0000","last_change":"2024-09-13T15:07:37.494524+0000","last_active":"2024-09-13T15:07:41.525991+0000","last_peered":"2024-09-13T15:07:41.525991+0000","last_clean":"2024-09-13T15:07:41.525991+0000","last_became_active":"2024-09-13T15:07:37.494249+0000","last_became_peered":"2024-09-13T15:07:37.494249+0000","last_unstale":"2024-09-13T15:07:41.525991+0000","last_undegraded":"2024-09-13T15:07:41.525991+0000","last_fullsized":"2024-09-13T15:07:41.525991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516203+0000","last_change":"2024-09-13T15:07:37.504649+0000","last_active":"2024-09-13T15:07:41.516203+0000","last_peered":"2024-09-13T15:07:41.516203+0000","last_clean":"2024-09-13T15:07:41.516203+0000","last_became_active":"2024-09-13T15:07:37.504400+0000","last_became_peered":"2024-09-13T15:07:37.504400+0000","last_unstale":"2024-09-13T15:07:41.516203+0000","last_undegraded":"2024-09-13T15:07:41.516203+0000","last_fullsized":"2024-09-13T15:07:41.516203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509917+0000","last_change":"2024-09-13T15:07:37.506438+0000","last_active":"2024-09-13T15:07:41.509917+0000","last_peered":"2024-09-13T15:07:41.509917+0000","last_clean":"2024-09-13T15:07:41.509917+0000","last_became_active":"2024-09-13T15:07:37.506038+0000","last_became_peered":"2024-09-13T15:07:37.506038+0000","last_unstale":"2024-09-13T15:07:41.509917+0000","last_undegraded":"2024-09-13T15:07:41.509917+0000","last_fullsized":"2024-09-13T15:07:41.509917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502985+0000","last_change":"2024-09-13T15:07:37.491788+0000","last_active":"2024-09-13T15:07:41.502985+0000","last_peered":"2024-09-13T15:07:41.502985+0000","last_clean":"2024-09-13T15:07:41.502985+0000","last_became_active":"2024-09-13T15:07:37.491487+0000","last_became_peered":"2024-09-13T15:07:37.491487+0000","last_unstale":"2024-09-13T15:07:41.502985+0000","last_undegraded":"2024-09-13T15:07:41.502985+0000","last_fullsized":"2024-09-13T15:07:41.502985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506888+0000","last_change":"2024-09-13T15:07:37.493714+0000","last_active":"2024-09-13T15:07:41.506888+0000","last_peered":"2024-09-13T15:07:41.506888+0000","last_clean":"2024-09-13T15:07:41.506888+0000","last_became_active":"2024-09-13T15:07:37.493434+0000","last_became_peered":"2024-09-13T15:07:37.493434+0000","last_unstale":"2024-09-13T15:07:41.506888+0000","last_undegraded":"2024-09-13T15:07:41.506888+0000","last_fullsized":"2024-09-13T15:07:41.506888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502861+0000","last_change":"2024-09-13T15:07:37.505382+0000","last_active":"2024-09-13T15:07:41.502861+0000","last_peered":"2024-09-13T15:07:41.502861+0000","last_clean":"2024-09-13T15:07:41.502861+0000","last_became_active":"2024-09-13T15:07:37.504958+0000","last_became_peered":"2024-09-13T15:07:37.504958+0000","last_unstale":"2024-09-13T15:07:41.502861+0000","last_undegraded":"2024-09-13T15:07:41.502861+0000","last_fullsized":"2024-09-13T15:07:41.502861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515039+0000","last_change":"2024-09-13T15:07:37.504610+0000","last_active":"2024-09-13T15:07:41.515039+0000","last_peered":"2024-09-13T15:07:41.515039+0000","last_clean":"2024-09-13T15:07:41.515039+0000","last_became_active":"2024-09-13T15:07:37.502014+0000","last_became_peered":"2024-09-13T15:07:37.502014+0000","last_unstale":"2024-09-13T15:07:41.515039+0000","last_undegraded":"2024-09-13T15:07:41.515039+0000","last_fullsized":"2024-09-13T15:07:41.515039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512035+0000","last_change":"2024-09-13T15:07:37.507065+0000","last_active":"2024-09-13T15:07:41.512035+0000","last_peered":"2024-09-13T15:07:41.512035+0000","last_clean":"2024-09-13T15:07:41.512035+0000","last_became_active":"2024-09-13T15:07:37.506779+0000","last_became_peered":"2024-09-13T15:07:37.506779+0000","last_unstale":"2024-09-13T15:07:41.512035+0000","last_undegraded":"2024-09-13T15:07:41.512035+0000","last_fullsized":"2024-09-13T15:07:41.512035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565939+0000","last_change":"2024-09-13T15:07:37.500769+0000","last_active":"2024-09-13T15:07:41.565939+0000","last_peered":"2024-09-13T15:07:41.565939+0000","last_clean":"2024-09-13T15:07:41.565939+0000","last_became_active":"2024-09-13T15:07:37.500527+0000","last_became_peered":"2024-09-13T15:07:37.500527+0000","last_unstale":"2024-09-13T15:07:41.565939+0000","last_undegraded":"2024-09-13T15:07:41.565939+0000","last_fullsized":"2024-09-13T15:07:41.565939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505254+0000","last_change":"2024-09-13T15:07:37.501370+0000","last_active":"2024-09-13T15:07:41.505254+0000","last_peered":"2024-09-13T15:07:41.505254+0000","last_clean":"2024-09-13T15:07:41.505254+0000","last_became_active":"2024-09-13T15:07:37.501117+0000","last_became_peered":"2024-09-13T15:07:37.501117+0000","last_unstale":"2024-09-13T15:07:41.505254+0000","last_undegraded":"2024-09-13T15:07:41.505254+0000","last_fullsized":"2024-09-13T15:07:41.505254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.499033+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.498785+0000","last_became_peered":"2024-09-13T15:07:37.498785+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502879+0000","last_change":"2024-09-13T15:07:37.496894+0000","last_active":"2024-09-13T15:07:41.502879+0000","last_peered":"2024-09-13T15:07:41.502879+0000","last_clean":"2024-09-13T15:07:41.502879+0000","last_became_active":"2024-09-13T15:07:37.496688+0000","last_became_peered":"2024-09-13T15:07:37.496688+0000","last_unstale":"2024-09-13T15:07:41.502879+0000","last_undegraded":"2024-09-13T15:07:41.502879+0000","last_fullsized":"2024-09-13T15:07:41.502879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521879+0000","last_change":"2024-09-13T15:07:37.496945+0000","last_active":"2024-09-13T15:07:41.521879+0000","last_peered":"2024-09-13T15:07:41.521879+0000","last_clean":"2024-09-13T15:07:41.521879+0000","last_became_active":"2024-09-13T15:07:37.496509+0000","last_became_peered":"2024-09-13T15:07:37.496509+0000","last_unstale":"2024-09-13T15:07:41.521879+0000","last_undegraded":"2024-09-13T15:07:41.521879+0000","last_fullsized":"2024-09-13T15:07:41.521879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504987+0000","last_change":"2024-09-13T15:07:37.495060+0000","last_active":"2024-09-13T15:07:41.504987+0000","last_peered":"2024-09-13T15:07:41.504987+0000","last_clean":"2024-09-13T15:07:41.504987+0000","last_became_active":"2024-09-13T15:07:37.494788+0000","last_became_peered":"2024-09-13T15:07:37.494788+0000","last_unstale":"2024-09-13T15:07:41.504987+0000","last_undegraded":"2024-09-13T15:07:41.504987+0000","last_fullsized":"2024-09-13T15:07:41.504987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505104+0000","last_change":"2024-09-13T15:07:37.491940+0000","last_active":"2024-09-13T15:07:41.505104+0000","last_peered":"2024-09-13T15:07:41.505104+0000","last_clean":"2024-09-13T15:07:41.505104+0000","last_became_active":"2024-09-13T15:07:37.491714+0000","last_became_peered":"2024-09-13T15:07:37.491714+0000","last_unstale":"2024-09-13T15:07:41.505104+0000","last_undegraded":"2024-09-13T15:07:41.505104+0000","last_fullsized":"2024-09-13T15:07:41.505104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504221+0000","last_change":"2024-09-13T15:07:37.493155+0000","last_active":"2024-09-13T15:07:41.504221+0000","last_peered":"2024-09-13T15:07:41.504221+0000","last_clean":"2024-09-13T15:07:41.504221+0000","last_became_active":"2024-09-13T15:07:37.492896+0000","last_became_peered":"2024-09-13T15:07:37.492896+0000","last_unstale":"2024-09-13T15:07:41.504221+0000","last_undegraded":"2024-09-13T15:07:41.504221+0000","last_fullsized":"2024-09-13T15:07:41.504221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:56.485405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512790+0000","last_change":"2024-09-13T15:07:37.502884+0000","last_active":"2024-09-13T15:07:41.512790+0000","last_peered":"2024-09-13T15:07:41.512790+0000","last_clean":"2024-09-13T15:07:41.512790+0000","last_became_active":"2024-09-13T15:07:37.502542+0000","last_became_peered":"2024-09-13T15:07:37.502542+0000","last_unstale":"2024-09-13T15:07:41.512790+0000","last_undegraded":"2024-09-13T15:07:41.512790+0000","last_fullsized":"2024-09-13T15:07:41.512790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516072+0000","last_change":"2024-09-13T15:07:37.509728+0000","last_active":"2024-09-13T15:07:41.516072+0000","last_peered":"2024-09-13T15:07:41.516072+0000","last_clean":"2024-09-13T15:07:41.516072+0000","last_became_active":"2024-09-13T15:07:37.509264+0000","last_became_peered":"2024-09-13T15:07:37.509264+0000","last_unstale":"2024-09-13T15:07:41.516072+0000","last_undegraded":"2024-09-13T15:07:41.516072+0000","last_fullsized":"2024-09-13T15:07:41.516072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566575+0000","last_change":"2024-09-13T15:07:37.506122+0000","last_active":"2024-09-13T15:07:41.566575+0000","last_peered":"2024-09-13T15:07:41.566575+0000","last_clean":"2024-09-13T15:07:41.566575+0000","last_became_active":"2024-09-13T15:07:37.505859+0000","last_became_peered":"2024-09-13T15:07:37.505859+0000","last_unstale":"2024-09-13T15:07:41.566575+0000","last_undegraded":"2024-09-13T15:07:41.566575+0000","last_fullsized":"2024-09-13T15:07:41.566575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:24.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523490+0000","last_change":"2024-09-13T15:07:37.506044+0000","last_active":"2024-09-13T15:07:41.523490+0000","last_peered":"2024-09-13T15:07:41.523490+0000","last_clean":"2024-09-13T15:07:41.523490+0000","last_became_active":"2024-09-13T15:07:37.505769+0000","last_became_peered":"2024-09-13T15:07:37.505769+0000","last_unstale":"2024-09-13T15:07:41.523490+0000","last_undegraded":"2024-09-13T15:07:41.523490+0000","last_fullsized":"2024-09-13T15:07:41.523490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564537+0000","last_change":"2024-09-13T15:07:37.499277+0000","last_active":"2024-09-13T15:07:41.564537+0000","last_peered":"2024-09-13T15:07:41.564537+0000","last_clean":"2024-09-13T15:07:41.564537+0000","last_became_active":"2024-09-13T15:07:37.499015+0000","last_became_peered":"2024-09-13T15:07:37.499015+0000","last_unstale":"2024-09-13T15:07:41.564537+0000","last_undegraded":"2024-09-13T15:07:41.564537+0000","last_fullsized":"2024-09-13T15:07:41.564537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502767+0000","last_change":"2024-09-13T15:07:37.490609+0000","last_active":"2024-09-13T15:07:41.502767+0000","last_peered":"2024-09-13T15:07:41.502767+0000","last_clean":"2024-09-13T15:07:41.502767+0000","last_became_active":"2024-09-13T15:07:37.490347+0000","last_became_peered":"2024-09-13T15:07:37.490347+0000","last_unstale":"2024-09-13T15:07:41.502767+0000","last_undegraded":"2024-09-13T15:07:41.502767+0000","last_fullsized":"2024-09-13T15:07:41.502767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564563+0000","last_change":"2024-09-13T15:07:37.509408+0000","last_active":"2024-09-13T15:07:41.564563+0000","last_peered":"2024-09-13T15:07:41.564563+0000","last_clean":"2024-09-13T15:07:41.564563+0000","last_became_active":"2024-09-13T15:07:37.509076+0000","last_became_peered":"2024-09-13T15:07:37.509076+0000","last_unstale":"2024-09-13T15:07:41.564563+0000","last_undegraded":"2024-09-13T15:07:41.564563+0000","last_fullsized":"2024-09-13T15:07:41.564563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502014+0000","last_change":"2024-09-13T15:07:37.496397+0000","last_active":"2024-09-13T15:07:41.502014+0000","last_peered":"2024-09-13T15:07:41.502014+0000","last_clean":"2024-09-13T15:07:41.502014+0000","last_became_active":"2024-09-13T15:07:37.495306+0000","last_became_peered":"2024-09-13T15:07:37.495306+0000","last_unstale":"2024-09-13T15:07:41.502014+0000","last_undegraded":"2024-09-13T15:07:41.502014+0000","last_fullsized":"2024-09-13T15:07:41.502014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506055+0000","last_change":"2024-09-13T15:07:37.485483+0000","last_active":"2024-09-13T15:07:41.506055+0000","last_peered":"2024-09-13T15:07:41.506055+0000","last_clean":"2024-09-13T15:07:41.506055+0000","last_became_active":"2024-09-13T15:07:37.485197+0000","last_became_peered":"2024-09-13T15:07:37.485197+0000","last_unstale":"2024-09-13T15:07:41.506055+0000","last_undegraded":"2024-09-13T15:07:41.506055+0000","last_fullsized":"2024-09-13T15:07:41.506055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527325+0000","last_change":"2024-09-13T15:07:37.493235+0000","last_active":"2024-09-13T15:07:41.527325+0000","last_peered":"2024-09-13T15:07:41.527325+0000","last_clean":"2024-09-13T15:07:41.527325+0000","last_became_active":"2024-09-13T15:07:37.493000+0000","last_became_peered":"2024-09-13T15:07:37.493000+0000","last_unstale":"2024-09-13T15:07:41.527325+0000","last_undegraded":"2024-09-13T15:07:41.527325+0000","last_fullsized":"2024-09-13T15:07:41.527325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566439+0000","last_change":"2024-09-13T15:07:37.509845+0000","last_active":"2024-09-13T15:07:41.566439+0000","last_peered":"2024-09-13T15:07:41.566439+0000","last_clean":"2024-09-13T15:07:41.566439+0000","last_became_active":"2024-09-13T15:07:37.505933+0000","last_became_peered":"2024-09-13T15:07:37.505933+0000","last_unstale":"2024-09-13T15:07:41.566439+0000","last_undegraded":"2024-09-13T15:07:41.566439+0000","last_fullsized":"2024-09-13T15:07:41.566439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:08.463346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8460000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:08:05.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:08:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d61400700 1 Processor -- start 2024-09-13T15:08:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d61400700 1 -- start start 2024-09-13T15:08:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d61400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d61400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c0ccb40 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d61400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c06b430 con 0x7f6d5c0cb020 2024-09-13T15:08:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d61400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0b2ad0 con 0x7f6d5c06aaa0 2024-09-13T15:08:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d53400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d5c0cc6f0 0x7f6d5c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57388/0 (socket says 172.21.15.50:57388) 2024-09-13T15:08:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d53400700 1 -- 172.21.15.50:0/2279307710 learned_addr learned my addr 172.21.15.50:0/2279307710 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:05.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.729+0000 7f6d60a00700 1 --2- 172.21.15.50:0/2279307710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988016628 0 0) 0x7f6d4c001110 con 0x7f6d5c0cb020 2024-09-13T15:08:05.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d400035d0 con 0x7f6d5c0cb020 2024-09-13T15:08:05.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718478085 0 0) 0x7f6d5c0ccb40 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d4c001110 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d60a00700 1 -- 172.21.15.50:0/2279307710 >> v1:172.21.15.181:6789/0 conn(0x7f6d5c0cb020 legacy=0x7f6d5c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d60a00700 1 -- 172.21.15.50:0/2279307710 >> v1:172.21.15.50:6789/0 conn(0x7f6d5c0cc6f0 legacy=0x7f6d5c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515921945 0 0) 0x7f6d4c001110 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d60a00700 1 -- 172.21.15.50:0/2279307710 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c15b960 con 0x7f6d5c06aaa0 2024-09-13T15:08:05.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d60a00700 1 --2- 172.21.15.50:0/2279307710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c06aef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009dc0 tx=0x7f6d5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6350435547a9a3af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400e070 con 0x7f6d5c06aaa0 2024-09-13T15:08:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54003a40 con 0x7f6d5c06aaa0 2024-09-13T15:08:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d5b400700 1 -- 172.21.15.50:0/2279307710 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440015f0 con 0x7f6d5c06aaa0 2024-09-13T15:08:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d61400700 1 -- 172.21.15.50:0/2279307710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 msgr2=0x7f6d5c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d61400700 1 --2- 172.21.15.50:0/2279307710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c06aef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009dc0 tx=0x7f6d5400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d61400700 1 -- 172.21.15.50:0/2279307710 shutdown_connections 2024-09-13T15:08:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d61400700 1 --2- 172.21.15.50:0/2279307710 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c06aef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.733+0000 7f6d61400700 1 -- 172.21.15.50:0/2279307710 >> 172.21.15.50:0/2279307710 conn(0x7f6d5c0b0c40 msgr2=0x7f6d5c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.737+0000 7f6d61400700 1 -- 172.21.15.50:0/2279307710 shutdown_connections 2024-09-13T15:08:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.737+0000 7f6d61400700 1 -- 172.21.15.50:0/2279307710 wait complete. 2024-09-13T15:08:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.737+0000 7f6d61400700 1 Processor -- start 2024-09-13T15:08:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.737+0000 7f6d61400700 1 -- start start 2024-09-13T15:08:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d5c0cb020 0x7f6d5c1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d5c0cc6f0 0x7f6d5c14cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0ca020 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0c7c90 con 0x7f6d5c0cb020 2024-09-13T15:08:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0c9820 con 0x7f6d5c06aaa0 2024-09-13T15:08:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d5be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d5c0cc6f0 0x7f6d5c14cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d5be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c0c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35786/0 (socket says 172.21.15.50:35786) 2024-09-13T15:08:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d5be00700 1 -- 172.21.15.50:0/2854773263 learned_addr learned my addr 172.21.15.50:0/2854773263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d53400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d5c0cb020 0x7f6d5c1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 -- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 msgr2=0x7f6d5c0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 -- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d5c0cb020 msgr2=0x7f6d5c1f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d5c0cb020 0x7f6d5c1f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 -- 172.21.15.50:0/2854773263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009a70 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d53400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d5c0cb020 0x7f6d5c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d60a00700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d5c0cc6f0 0x7f6d5c14cdd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009fd0 tx=0x7f6d54004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540043c0 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54004560 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54004910 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c1f5e70 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.741+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c1f6430 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.745+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c0c7e00 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.745+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d5401c460 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.749+0000 7f6d58c00700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6d38066730 0x7f6d38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:05.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.749+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d54085a90 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.749+0000 7f6d5be00700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6d38066730 0x7f6d38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:05.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.749+0000 7f6d5be00700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6d38066730 0x7f6d38068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c001370 tx=0x7f6d4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.753+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d54056590 con 0x7f6d5c0cc6f0 2024-09-13T15:08:05.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.945+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d5c0b2d20 con 0x7f6d38066730 2024-09-13T15:08:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.961+0000 7f6d58c00700 1 -- 172.21.15.50:0/2854773263 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344947 (secure 0 0 0) 0x7f6d4c00f690 con 0x7f6d38066730 2024-09-13T15:08:05.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6d38066730 msgr2=0x7f6d38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6d38066730 0x7f6d38068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c001370 tx=0x7f6d4c009040 comp rx=0 tx=0).stop 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d5c0cc6f0 msgr2=0x7f6d5c14cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d5c0cc6f0 0x7f6d5c14cdd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009fd0 tx=0x7f6d54004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 shutdown_connections 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6d38066730 0x7f6d38068bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d5c0cc6f0 0x7f6d5c14cdd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d5c0cb020 0x7f6d5c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 --2- 172.21.15.50:0/2854773263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d5c06aaa0 0x7f6d5c0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 >> 172.21.15.50:0/2854773263 conn(0x7f6d5c0b0c40 msgr2=0x7f6d5c159680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 shutdown_connections 2024-09-13T15:08:05.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:05.969+0000 7f6d61400700 1 -- 172.21.15.50:0/2854773263 wait complete. 2024-09-13T15:08:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:08:05.995 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-13T15:08:04.017463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":3272704,"data_stored":1985105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005166"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509590+0000","last_change":"2024-09-13T15:07:37.013443+0000","last_active":"2024-09-13T15:07:41.509590+0000","last_peered":"2024-09-13T15:07:41.509590+0000","last_clean":"2024-09-13T15:07:41.509590+0000","last_became_active":"2024-09-13T15:07:37.013084+0000","last_became_peered":"2024-09-13T15:07:37.013084+0000","last_unstale":"2024-09-13T15:07:41.509590+0000","last_undegraded":"2024-09-13T15:07:41.509590+0000","last_fullsized":"2024-09-13T15:07:41.509590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506356+0000","last_change":"2024-09-13T15:07:37.504754+0000","last_active":"2024-09-13T15:07:41.506356+0000","last_peered":"2024-09-13T15:07:41.506356+0000","last_clean":"2024-09-13T15:07:41.506356+0000","last_became_active":"2024-09-13T15:07:37.504435+0000","last_became_peered":"2024-09-13T15:07:37.504435+0000","last_unstale":"2024-09-13T15:07:41.506356+0000","last_undegraded":"2024-09-13T15:07:41.506356+0000","last_fullsized":"2024-09-13T15:07:41.506356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.009718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.579608+0000","last_change":"2024-09-13T15:07:41.576894+0000","last_active":"2024-09-13T15:07:41.579608+0000","last_peered":"2024-09-13T15:07:41.579608+0000","last_clean":"2024-09-13T15:07:41.579608+0000","last_became_active":"2024-09-13T15:07:41.574143+0000","last_became_peered":"2024-09-13T15:07:41.574143+0000","last_unstale":"2024-09-13T15:07:41.579608+0000","last_undegraded":"2024-09-13T15:07:41.579608+0000","last_fullsized":"2024-09-13T15:07:41.579608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:50.141042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506583+0000","last_change":"2024-09-13T15:07:37.004216+0000","last_active":"2024-09-13T15:07:41.506583+0000","last_peered":"2024-09-13T15:07:41.506583+0000","last_clean":"2024-09-13T15:07:41.506583+0000","last_became_active":"2024-09-13T15:07:37.003718+0000","last_became_peered":"2024-09-13T15:07:37.003718+0000","last_unstale":"2024-09-13T15:07:41.506583+0000","last_undegraded":"2024-09-13T15:07:41.506583+0000","last_fullsized":"2024-09-13T15:07:41.506583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509367+0000","last_change":"2024-09-13T15:07:37.503439+0000","last_active":"2024-09-13T15:07:41.509367+0000","last_peered":"2024-09-13T15:07:41.509367+0000","last_clean":"2024-09-13T15:07:41.509367+0000","last_became_active":"2024-09-13T15:07:37.502983+0000","last_became_peered":"2024-09-13T15:07:37.502983+0000","last_unstale":"2024-09-13T15:07:41.509367+0000","last_undegraded":"2024-09-13T15:07:41.509367+0000","last_fullsized":"2024-09-13T15:07:41.509367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538359+0000","last_change":"2024-09-13T15:07:41.534320+0000","last_active":"2024-09-13T15:07:41.538359+0000","last_peered":"2024-09-13T15:07:41.538359+0000","last_clean":"2024-09-13T15:07:41.538359+0000","last_became_active":"2024-09-13T15:07:41.533553+0000","last_became_peered":"2024-09-13T15:07:41.533553+0000","last_unstale":"2024-09-13T15:07:41.538359+0000","last_undegraded":"2024-09-13T15:07:41.538359+0000","last_fullsized":"2024-09-13T15:07:41.538359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:39.809595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565838+0000","last_change":"2024-09-13T15:07:37.015988+0000","last_active":"2024-09-13T15:07:41.565838+0000","last_peered":"2024-09-13T15:07:41.565838+0000","last_clean":"2024-09-13T15:07:41.565838+0000","last_became_active":"2024-09-13T15:07:37.015680+0000","last_became_peered":"2024-09-13T15:07:37.015680+0000","last_unstale":"2024-09-13T15:07:41.565838+0000","last_undegraded":"2024-09-13T15:07:41.565838+0000","last_fullsized":"2024-09-13T15:07:41.565838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:31.567643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502115+0000","last_change":"2024-09-13T15:07:37.514328+0000","last_active":"2024-09-13T15:07:41.502115+0000","last_peered":"2024-09-13T15:07:41.502115+0000","last_clean":"2024-09-13T15:07:41.502115+0000","last_became_active":"2024-09-13T15:07:37.514028+0000","last_became_peered":"2024-09-13T15:07:37.514028+0000","last_unstale":"2024-09-13T15:07:41.502115+0000","last_undegraded":"2024-09-13T15:07:41.502115+0000","last_fullsized":"2024-09-13T15:07:41.502115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538321+0000","last_change":"2024-09-13T15:07:41.534029+0000","last_active":"2024-09-13T15:07:41.538321+0000","last_peered":"2024-09-13T15:07:41.538321+0000","last_clean":"2024-09-13T15:07:41.538321+0000","last_became_active":"2024-09-13T15:07:41.533515+0000","last_became_peered":"2024-09-13T15:07:41.533515+0000","last_unstale":"2024-09-13T15:07:41.538321+0000","last_undegraded":"2024-09-13T15:07:41.538321+0000","last_fullsized":"2024-09-13T15:07:41.538321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564972+0000","last_change":"2024-09-13T15:07:37.017205+0000","last_active":"2024-09-13T15:07:41.564972+0000","last_peered":"2024-09-13T15:07:41.564972+0000","last_clean":"2024-09-13T15:07:41.564972+0000","last_became_active":"2024-09-13T15:07:37.016766+0000","last_became_peered":"2024-09-13T15:07:37.016766+0000","last_unstale":"2024-09-13T15:07:41.564972+0000","last_undegraded":"2024-09-13T15:07:41.564972+0000","last_fullsized":"2024-09-13T15:07:41.564972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505404+0000","last_change":"2024-09-13T15:07:37.502428+0000","last_active":"2024-09-13T15:07:41.505404+0000","last_peered":"2024-09-13T15:07:41.505404+0000","last_clean":"2024-09-13T15:07:41.505404+0000","last_became_active":"2024-09-13T15:07:37.501967+0000","last_became_peered":"2024-09-13T15:07:37.501967+0000","last_unstale":"2024-09-13T15:07:41.505404+0000","last_undegraded":"2024-09-13T15:07:41.505404+0000","last_fullsized":"2024-09-13T15:07:41.505404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538423+0000","last_change":"2024-09-13T15:07:41.534357+0000","last_active":"2024-09-13T15:07:41.538423+0000","last_peered":"2024-09-13T15:07:41.538423+0000","last_clean":"2024-09-13T15:07:41.538423+0000","last_became_active":"2024-09-13T15:07:41.533662+0000","last_became_peered":"2024-09-13T15:07:41.533662+0000","last_unstale":"2024-09-13T15:07:41.538423+0000","last_undegraded":"2024-09-13T15:07:41.538423+0000","last_fullsized":"2024-09-13T15:07:41.538423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512026+0000","last_change":"2024-09-13T15:07:37.506598+0000","last_active":"2024-09-13T15:07:41.512026+0000","last_peered":"2024-09-13T15:07:41.512026+0000","last_clean":"2024-09-13T15:07:41.512026+0000","last_became_active":"2024-09-13T15:07:37.506317+0000","last_became_peered":"2024-09-13T15:07:37.506317+0000","last_unstale":"2024-09-13T15:07:41.512026+0000","last_undegraded":"2024-09-13T15:07:41.512026+0000","last_fullsized":"2024-09-13T15:07:41.512026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564777+0000","last_change":"2024-09-13T15:07:37.017573+0000","last_active":"2024-09-13T15:07:41.564777+0000","last_peered":"2024-09-13T15:07:41.564777+0000","last_clean":"2024-09-13T15:07:41.564777+0000","last_became_active":"2024-09-13T15:07:37.017395+0000","last_became_peered":"2024-09-13T15:07:37.017395+0000","last_unstale":"2024-09-13T15:07:41.564777+0000","last_undegraded":"2024-09-13T15:07:41.564777+0000","last_fullsized":"2024-09-13T15:07:41.564777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:47.432256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527945+0000","last_change":"2024-09-13T15:07:41.525024+0000","last_active":"2024-09-13T15:07:41.527945+0000","last_peered":"2024-09-13T15:07:41.527945+0000","last_clean":"2024-09-13T15:07:41.527945+0000","last_became_active":"2024-09-13T15:07:41.524498+0000","last_became_peered":"2024-09-13T15:07:41.524498+0000","last_unstale":"2024-09-13T15:07:41.527945+0000","last_undegraded":"2024-09-13T15:07:41.527945+0000","last_fullsized":"2024-09-13T15:07:41.527945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:16.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505218+0000","last_change":"2024-09-13T15:07:37.489676+0000","last_active":"2024-09-13T15:07:41.505218+0000","last_peered":"2024-09-13T15:07:41.505218+0000","last_clean":"2024-09-13T15:07:41.505218+0000","last_became_active":"2024-09-13T15:07:37.487946+0000","last_became_peered":"2024-09-13T15:07:37.487946+0000","last_unstale":"2024-09-13T15:07:41.505218+0000","last_undegraded":"2024-09-13T15:07:41.505218+0000","last_fullsized":"2024-09-13T15:07:41.505218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.522108+0000","last_change":"2024-09-13T15:07:37.012004+0000","last_active":"2024-09-13T15:07:41.522108+0000","last_peered":"2024-09-13T15:07:41.522108+0000","last_clean":"2024-09-13T15:07:41.522108+0000","last_became_active":"2024-09-13T15:07:37.011199+0000","last_became_peered":"2024-09-13T15:07:37.011199+0000","last_unstale":"2024-09-13T15:07:41.522108+0000","last_undegraded":"2024-09-13T15:07:41.522108+0000","last_fullsized":"2024-09-13T15:07:41.522108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538485+0000","last_change":"2024-09-13T15:07:41.535177+0000","last_active":"2024-09-13T15:07:41.538485+0000","last_peered":"2024-09-13T15:07:41.538485+0000","last_clean":"2024-09-13T15:07:41.538485+0000","last_became_active":"2024-09-13T15:07:41.533912+0000","last_became_peered":"2024-09-13T15:07:41.533912+0000","last_unstale":"2024-09-13T15:07:41.538485+0000","last_undegraded":"2024-09-13T15:07:41.538485+0000","last_fullsized":"2024-09-13T15:07:41.538485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523603+0000","last_change":"2024-09-13T15:07:37.495579+0000","last_active":"2024-09-13T15:07:41.523603+0000","last_peered":"2024-09-13T15:07:41.523603+0000","last_clean":"2024-09-13T15:07:41.523603+0000","last_became_active":"2024-09-13T15:07:37.495337+0000","last_became_peered":"2024-09-13T15:07:37.495337+0000","last_unstale":"2024-09-13T15:07:41.523603+0000","last_undegraded":"2024-09-13T15:07:41.523603+0000","last_fullsized":"2024-09-13T15:07:41.523603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521968+0000","last_change":"2024-09-13T15:07:37.013081+0000","last_active":"2024-09-13T15:07:41.521968+0000","last_peered":"2024-09-13T15:07:41.521968+0000","last_clean":"2024-09-13T15:07:41.521968+0000","last_became_active":"2024-09-13T15:07:37.012821+0000","last_became_peered":"2024-09-13T15:07:37.012821+0000","last_unstale":"2024-09-13T15:07:41.521968+0000","last_undegraded":"2024-09-13T15:07:41.521968+0000","last_fullsized":"2024-09-13T15:07:41.521968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577610+0000","last_change":"2024-09-13T15:07:41.572919+0000","last_active":"2024-09-13T15:07:41.577610+0000","last_peered":"2024-09-13T15:07:41.577610+0000","last_clean":"2024-09-13T15:07:41.577610+0000","last_became_active":"2024-09-13T15:07:41.572534+0000","last_became_peered":"2024-09-13T15:07:41.572534+0000","last_unstale":"2024-09-13T15:07:41.577610+0000","last_undegraded":"2024-09-13T15:07:41.577610+0000","last_fullsized":"2024-09-13T15:07:41.577610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503792+0000","last_change":"2024-09-13T15:07:37.484624+0000","last_active":"2024-09-13T15:07:41.503792+0000","last_peered":"2024-09-13T15:07:41.503792+0000","last_clean":"2024-09-13T15:07:41.503792+0000","last_became_active":"2024-09-13T15:07:37.484236+0000","last_became_peered":"2024-09-13T15:07:37.484236+0000","last_unstale":"2024-09-13T15:07:41.503792+0000","last_undegraded":"2024-09-13T15:07:41.503792+0000","last_fullsized":"2024-09-13T15:07:41.503792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:25.167980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.563720+0000","last_change":"2024-09-13T15:07:37.016581+0000","last_active":"2024-09-13T15:07:41.563720+0000","last_peered":"2024-09-13T15:07:41.563720+0000","last_clean":"2024-09-13T15:07:41.563720+0000","last_became_active":"2024-09-13T15:07:37.016253+0000","last_became_peered":"2024-09-13T15:07:37.016253+0000","last_unstale":"2024-09-13T15:07:41.563720+0000","last_undegraded":"2024-09-13T15:07:41.563720+0000","last_fullsized":"2024-09-13T15:07:41.563720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538474+0000","last_change":"2024-09-13T15:07:41.534781+0000","last_active":"2024-09-13T15:07:41.538474+0000","last_peered":"2024-09-13T15:07:41.538474+0000","last_clean":"2024-09-13T15:07:41.538474+0000","last_became_active":"2024-09-13T15:07:41.533999+0000","last_became_peered":"2024-09-13T15:07:41.533999+0000","last_unstale":"2024-09-13T15:07:41.538474+0000","last_undegraded":"2024-09-13T15:07:41.538474+0000","last_fullsized":"2024-09-13T15:07:41.538474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512002+0000","last_change":"2024-09-13T15:07:37.494214+0000","last_active":"2024-09-13T15:07:41.512002+0000","last_peered":"2024-09-13T15:07:41.512002+0000","last_clean":"2024-09-13T15:07:41.512002+0000","last_became_active":"2024-09-13T15:07:37.493854+0000","last_became_peered":"2024-09-13T15:07:37.493854+0000","last_unstale":"2024-09-13T15:07:41.512002+0000","last_undegraded":"2024-09-13T15:07:41.512002+0000","last_fullsized":"2024-09-13T15:07:41.512002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516503+0000","last_change":"2024-09-13T15:07:37.007466+0000","last_active":"2024-09-13T15:07:41.516503+0000","last_peered":"2024-09-13T15:07:41.516503+0000","last_clean":"2024-09-13T15:07:41.516503+0000","last_became_active":"2024-09-13T15:07:37.007189+0000","last_became_peered":"2024-09-13T15:07:37.007189+0000","last_unstale":"2024-09-13T15:07:41.516503+0000","last_undegraded":"2024-09-13T15:07:41.516503+0000","last_fullsized":"2024-09-13T15:07:41.516503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576271+0000","last_change":"2024-09-13T15:07:41.572185+0000","last_active":"2024-09-13T15:07:41.576271+0000","last_peered":"2024-09-13T15:07:41.576271+0000","last_clean":"2024-09-13T15:07:41.576271+0000","last_became_active":"2024-09-13T15:07:41.571676+0000","last_became_peered":"2024-09-13T15:07:41.571676+0000","last_unstale":"2024-09-13T15:07:41.576271+0000","last_undegraded":"2024-09-13T15:07:41.576271+0000","last_fullsized":"2024-09-13T15:07:41.576271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:11.973002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.510056+0000","last_change":"2024-09-13T15:07:37.503628+0000","last_active":"2024-09-13T15:07:41.510056+0000","last_peered":"2024-09-13T15:07:41.510056+0000","last_clean":"2024-09-13T15:07:41.510056+0000","last_became_active":"2024-09-13T15:07:37.503337+0000","last_became_peered":"2024-09-13T15:07:37.503337+0000","last_unstale":"2024-09-13T15:07:41.510056+0000","last_undegraded":"2024-09-13T15:07:41.510056+0000","last_fullsized":"2024-09-13T15:07:41.510056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:42.582773+0000","last_change":"2024-09-13T15:07:37.010802+0000","last_active":"2024-09-13T15:07:42.582773+0000","last_peered":"2024-09-13T15:07:42.582773+0000","last_clean":"2024-09-13T15:07:42.582773+0000","last_became_active":"2024-09-13T15:07:37.010516+0000","last_became_peered":"2024-09-13T15:07:37.010516+0000","last_unstale":"2024-09-13T15:07:42.582773+0000","last_undegraded":"2024-09-13T15:07:42.582773+0000","last_fullsized":"2024-09-13T15:07:42.582773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575285+0000","last_change":"2024-09-13T15:07:41.570403+0000","last_active":"2024-09-13T15:07:41.575285+0000","last_peered":"2024-09-13T15:07:41.575285+0000","last_clean":"2024-09-13T15:07:41.575285+0000","last_became_active":"2024-09-13T15:07:41.569731+0000","last_became_peered":"2024-09-13T15:07:41.569731+0000","last_unstale":"2024-09-13T15:07:41.575285+0000","last_undegraded":"2024-09-13T15:07:41.575285+0000","last_fullsized":"2024-09-13T15:07:41.575285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:47.336008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525415+0000","last_change":"2024-09-13T15:07:37.487456+0000","last_active":"2024-09-13T15:07:41.525415+0000","last_peered":"2024-09-13T15:07:41.525415+0000","last_clean":"2024-09-13T15:07:41.525415+0000","last_became_active":"2024-09-13T15:07:37.487227+0000","last_became_peered":"2024-09-13T15:07:37.487227+0000","last_unstale":"2024-09-13T15:07:41.525415+0000","last_undegraded":"2024-09-13T15:07:41.525415+0000","last_fullsized":"2024-09-13T15:07:41.525415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566354+0000","last_change":"2024-09-13T15:07:37.015462+0000","last_active":"2024-09-13T15:07:41.566354+0000","last_peered":"2024-09-13T15:07:41.566354+0000","last_clean":"2024-09-13T15:07:41.566354+0000","last_became_active":"2024-09-13T15:07:37.015202+0000","last_became_peered":"2024-09-13T15:07:37.015202+0000","last_unstale":"2024-09-13T15:07:41.566354+0000","last_undegraded":"2024-09-13T15:07:41.566354+0000","last_fullsized":"2024-09-13T15:07:41.566354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576630+0000","last_change":"2024-09-13T15:07:41.568111+0000","last_active":"2024-09-13T15:07:41.576630+0000","last_peered":"2024-09-13T15:07:41.576630+0000","last_clean":"2024-09-13T15:07:41.576630+0000","last_became_active":"2024-09-13T15:07:41.567207+0000","last_became_peered":"2024-09-13T15:07:41.567207+0000","last_unstale":"2024-09-13T15:07:41.576630+0000","last_undegraded":"2024-09-13T15:07:41.576630+0000","last_fullsized":"2024-09-13T15:07:41.576630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505482+0000","last_change":"2024-09-13T15:07:37.495265+0000","last_active":"2024-09-13T15:07:41.505482+0000","last_peered":"2024-09-13T15:07:41.505482+0000","last_clean":"2024-09-13T15:07:41.505482+0000","last_became_active":"2024-09-13T15:07:37.494954+0000","last_became_peered":"2024-09-13T15:07:37.494954+0000","last_unstale":"2024-09-13T15:07:41.505482+0000","last_undegraded":"2024-09-13T15:07:41.505482+0000","last_fullsized":"2024-09-13T15:07:41.505482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525500+0000","last_change":"2024-09-13T15:07:37.012286+0000","last_active":"2024-09-13T15:07:41.525500+0000","last_peered":"2024-09-13T15:07:41.525500+0000","last_clean":"2024-09-13T15:07:41.525500+0000","last_became_active":"2024-09-13T15:07:37.010271+0000","last_became_peered":"2024-09-13T15:07:37.010271+0000","last_unstale":"2024-09-13T15:07:41.525500+0000","last_undegraded":"2024-09-13T15:07:41.525500+0000","last_fullsized":"2024-09-13T15:07:41.525500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539227+0000","last_change":"2024-09-13T15:07:41.535358+0000","last_active":"2024-09-13T15:07:41.539227+0000","last_peered":"2024-09-13T15:07:41.539227+0000","last_clean":"2024-09-13T15:07:41.539227+0000","last_became_active":"2024-09-13T15:07:41.534907+0000","last_became_peered":"2024-09-13T15:07:41.534907+0000","last_unstale":"2024-09-13T15:07:41.539227+0000","last_undegraded":"2024-09-13T15:07:41.539227+0000","last_fullsized":"2024-09-13T15:07:41.539227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506408+0000","last_change":"2024-09-13T15:07:37.513201+0000","last_active":"2024-09-13T15:07:41.506408+0000","last_peered":"2024-09-13T15:07:41.506408+0000","last_clean":"2024-09-13T15:07:41.506408+0000","last_became_active":"2024-09-13T15:07:37.512914+0000","last_became_peered":"2024-09-13T15:07:37.512914+0000","last_unstale":"2024-09-13T15:07:41.506408+0000","last_undegraded":"2024-09-13T15:07:41.506408+0000","last_fullsized":"2024-09-13T15:07:41.506408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503150+0000","last_change":"2024-09-13T15:07:37.007476+0000","last_active":"2024-09-13T15:07:41.503150+0000","last_peered":"2024-09-13T15:07:41.503150+0000","last_clean":"2024-09-13T15:07:41.503150+0000","last_became_active":"2024-09-13T15:07:37.006888+0000","last_became_peered":"2024-09-13T15:07:37.006888+0000","last_unstale":"2024-09-13T15:07:41.503150+0000","last_undegraded":"2024-09-13T15:07:41.503150+0000","last_fullsized":"2024-09-13T15:07:41.503150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538962+0000","last_change":"2024-09-13T15:07:41.535459+0000","last_active":"2024-09-13T15:07:41.538962+0000","last_peered":"2024-09-13T15:07:41.538962+0000","last_clean":"2024-09-13T15:07:41.538962+0000","last_became_active":"2024-09-13T15:07:41.534918+0000","last_became_peered":"2024-09-13T15:07:41.534918+0000","last_unstale":"2024-09-13T15:07:41.538962+0000","last_undegraded":"2024-09-13T15:07:41.538962+0000","last_fullsized":"2024-09-13T15:07:41.538962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521735+0000","last_change":"2024-09-13T15:07:37.492499+0000","last_active":"2024-09-13T15:07:41.521735+0000","last_peered":"2024-09-13T15:07:41.521735+0000","last_clean":"2024-09-13T15:07:41.521735+0000","last_became_active":"2024-09-13T15:07:37.492144+0000","last_became_peered":"2024-09-13T15:07:37.492144+0000","last_unstale":"2024-09-13T15:07:41.521735+0000","last_undegraded":"2024-09-13T15:07:41.521735+0000","last_fullsized":"2024-09-13T15:07:41.521735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505110+0000","last_change":"2024-09-13T15:07:37.006492+0000","last_active":"2024-09-13T15:07:41.505110+0000","last_peered":"2024-09-13T15:07:41.505110+0000","last_clean":"2024-09-13T15:07:41.505110+0000","last_became_active":"2024-09-13T15:07:37.004955+0000","last_became_peered":"2024-09-13T15:07:37.004955+0000","last_unstale":"2024-09-13T15:07:41.505110+0000","last_undegraded":"2024-09-13T15:07:41.505110+0000","last_fullsized":"2024-09-13T15:07:41.505110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539457+0000","last_change":"2024-09-13T15:07:41.536499+0000","last_active":"2024-09-13T15:07:41.539457+0000","last_peered":"2024-09-13T15:07:41.539457+0000","last_clean":"2024-09-13T15:07:41.539457+0000","last_became_active":"2024-09-13T15:07:41.536051+0000","last_became_peered":"2024-09-13T15:07:41.536051+0000","last_unstale":"2024-09-13T15:07:41.539457+0000","last_undegraded":"2024-09-13T15:07:41.539457+0000","last_fullsized":"2024-09-13T15:07:41.539457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506936+0000","last_change":"2024-09-13T15:07:37.491784+0000","last_active":"2024-09-13T15:07:41.506936+0000","last_peered":"2024-09-13T15:07:41.506936+0000","last_clean":"2024-09-13T15:07:41.506936+0000","last_became_active":"2024-09-13T15:07:37.491544+0000","last_became_peered":"2024-09-13T15:07:37.491544+0000","last_unstale":"2024-09-13T15:07:41.506936+0000","last_undegraded":"2024-09-13T15:07:41.506936+0000","last_fullsized":"2024-09-13T15:07:41.506936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:13.919211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564277+0000","last_change":"2024-09-13T15:07:37.014778+0000","last_active":"2024-09-13T15:07:41.564277+0000","last_peered":"2024-09-13T15:07:41.564277+0000","last_clean":"2024-09-13T15:07:41.564277+0000","last_became_active":"2024-09-13T15:07:37.014475+0000","last_became_peered":"2024-09-13T15:07:37.014475+0000","last_unstale":"2024-09-13T15:07:41.564277+0000","last_undegraded":"2024-09-13T15:07:41.564277+0000","last_fullsized":"2024-09-13T15:07:41.564277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577706+0000","last_change":"2024-09-13T15:07:41.572783+0000","last_active":"2024-09-13T15:07:41.577706+0000","last_peered":"2024-09-13T15:07:41.577706+0000","last_clean":"2024-09-13T15:07:41.577706+0000","last_became_active":"2024-09-13T15:07:41.571654+0000","last_became_peered":"2024-09-13T15:07:41.571654+0000","last_unstale":"2024-09-13T15:07:41.577706+0000","last_undegraded":"2024-09-13T15:07:41.577706+0000","last_fullsized":"2024-09-13T15:07:41.577706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.506083+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.505793+0000","last_became_peered":"2024-09-13T15:07:37.505793+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503229+0000","last_change":"2024-09-13T15:07:36.995886+0000","last_active":"2024-09-13T15:07:41.503229+0000","last_peered":"2024-09-13T15:07:41.503229+0000","last_clean":"2024-09-13T15:07:41.503229+0000","last_became_active":"2024-09-13T15:07:36.995560+0000","last_became_peered":"2024-09-13T15:07:36.995560+0000","last_unstale":"2024-09-13T15:07:41.503229+0000","last_undegraded":"2024-09-13T15:07:41.503229+0000","last_fullsized":"2024-09-13T15:07:41.503229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564508+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:07:41.564508+0000","last_peered":"2024-09-13T15:07:41.564508+0000","last_clean":"2024-09-13T15:07:41.564508+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:07:41.564508+0000","last_undegraded":"2024-09-13T15:07:41.564508+0000","last_fullsized":"2024-09-13T15:07:41.564508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573389+0000","last_change":"2024-09-13T15:07:41.568736+0000","last_active":"2024-09-13T15:07:41.573389+0000","last_peered":"2024-09-13T15:07:41.573389+0000","last_clean":"2024-09-13T15:07:41.573389+0000","last_became_active":"2024-09-13T15:07:41.568356+0000","last_became_peered":"2024-09-13T15:07:41.568356+0000","last_unstale":"2024-09-13T15:07:41.573389+0000","last_undegraded":"2024-09-13T15:07:41.573389+0000","last_fullsized":"2024-09-13T15:07:41.573389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:32.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565674+0000","last_change":"2024-09-13T15:07:37.500315+0000","last_active":"2024-09-13T15:07:41.565674+0000","last_peered":"2024-09-13T15:07:41.565674+0000","last_clean":"2024-09-13T15:07:41.565674+0000","last_became_active":"2024-09-13T15:07:37.499912+0000","last_became_peered":"2024-09-13T15:07:37.499912+0000","last_unstale":"2024-09-13T15:07:41.565674+0000","last_undegraded":"2024-09-13T15:07:41.565674+0000","last_fullsized":"2024-09-13T15:07:41.565674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511110+0000","last_change":"2024-09-13T15:07:37.005731+0000","last_active":"2024-09-13T15:07:41.511110+0000","last_peered":"2024-09-13T15:07:41.511110+0000","last_clean":"2024-09-13T15:07:41.511110+0000","last_became_active":"2024-09-13T15:07:37.005196+0000","last_became_peered":"2024-09-13T15:07:37.005196+0000","last_unstale":"2024-09-13T15:07:41.511110+0000","last_undegraded":"2024-09-13T15:07:41.511110+0000","last_fullsized":"2024-09-13T15:07:41.511110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.567559+0000","last_change":"2024-09-13T15:07:41.565589+0000","last_active":"2024-09-13T15:07:41.567559+0000","last_peered":"2024-09-13T15:07:41.567559+0000","last_clean":"2024-09-13T15:07:41.567559+0000","last_became_active":"2024-09-13T15:07:41.565135+0000","last_became_peered":"2024-09-13T15:07:41.565135+0000","last_unstale":"2024-09-13T15:07:41.567559+0000","last_undegraded":"2024-09-13T15:07:41.567559+0000","last_fullsized":"2024-09-13T15:07:41.567559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:41.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504783+0000","last_change":"2024-09-13T15:07:37.494952+0000","last_active":"2024-09-13T15:07:41.504783+0000","last_peered":"2024-09-13T15:07:41.504783+0000","last_clean":"2024-09-13T15:07:41.504783+0000","last_became_active":"2024-09-13T15:07:37.494616+0000","last_became_peered":"2024-09-13T15:07:37.494616+0000","last_unstale":"2024-09-13T15:07:41.504783+0000","last_undegraded":"2024-09-13T15:07:41.504783+0000","last_fullsized":"2024-09-13T15:07:41.504783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526436+0000","last_change":"2024-09-13T15:07:37.016938+0000","last_active":"2024-09-13T15:07:41.526436+0000","last_peered":"2024-09-13T15:07:41.526436+0000","last_clean":"2024-09-13T15:07:41.526436+0000","last_became_active":"2024-09-13T15:07:37.016416+0000","last_became_peered":"2024-09-13T15:07:37.016416+0000","last_unstale":"2024-09-13T15:07:41.526436+0000","last_undegraded":"2024-09-13T15:07:41.526436+0000","last_fullsized":"2024-09-13T15:07:41.526436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533876+0000","last_change":"2024-09-13T15:07:41.530568+0000","last_active":"2024-09-13T15:07:41.533876+0000","last_peered":"2024-09-13T15:07:41.533876+0000","last_clean":"2024-09-13T15:07:41.533876+0000","last_became_active":"2024-09-13T15:07:41.528769+0000","last_became_peered":"2024-09-13T15:07:41.528769+0000","last_unstale":"2024-09-13T15:07:41.533876+0000","last_undegraded":"2024-09-13T15:07:41.533876+0000","last_fullsized":"2024-09-13T15:07:41.533876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:21.253459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566675+0000","last_change":"2024-09-13T15:07:37.516289+0000","last_active":"2024-09-13T15:07:41.566675+0000","last_peered":"2024-09-13T15:07:41.566675+0000","last_clean":"2024-09-13T15:07:41.566675+0000","last_became_active":"2024-09-13T15:07:37.515469+0000","last_became_peered":"2024-09-13T15:07:37.515469+0000","last_unstale":"2024-09-13T15:07:41.566675+0000","last_undegraded":"2024-09-13T15:07:41.566675+0000","last_fullsized":"2024-09-13T15:07:41.566675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505710+0000","last_change":"2024-09-13T15:07:37.004010+0000","last_active":"2024-09-13T15:07:41.505710+0000","last_peered":"2024-09-13T15:07:41.505710+0000","last_clean":"2024-09-13T15:07:41.505710+0000","last_became_active":"2024-09-13T15:07:37.003685+0000","last_became_peered":"2024-09-13T15:07:37.003685+0000","last_unstale":"2024-09-13T15:07:41.505710+0000","last_undegraded":"2024-09-13T15:07:41.505710+0000","last_fullsized":"2024-09-13T15:07:41.505710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.571567+0000","last_change":"2024-09-13T15:07:41.570035+0000","last_active":"2024-09-13T15:07:41.571567+0000","last_peered":"2024-09-13T15:07:41.571567+0000","last_clean":"2024-09-13T15:07:41.571567+0000","last_became_active":"2024-09-13T15:07:41.566940+0000","last_became_peered":"2024-09-13T15:07:41.566940+0000","last_unstale":"2024-09-13T15:07:41.571567+0000","last_undegraded":"2024-09-13T15:07:41.571567+0000","last_fullsized":"2024-09-13T15:07:41.571567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565356+0000","last_change":"2024-09-13T15:07:37.519128+0000","last_active":"2024-09-13T15:07:41.565356+0000","last_peered":"2024-09-13T15:07:41.565356+0000","last_clean":"2024-09-13T15:07:41.565356+0000","last_became_active":"2024-09-13T15:07:37.518869+0000","last_became_peered":"2024-09-13T15:07:37.518869+0000","last_unstale":"2024-09-13T15:07:41.565356+0000","last_undegraded":"2024-09-13T15:07:41.565356+0000","last_fullsized":"2024-09-13T15:07:41.565356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503446+0000","last_change":"2024-09-13T15:07:37.010518+0000","last_active":"2024-09-13T15:07:41.503446+0000","last_peered":"2024-09-13T15:07:41.503446+0000","last_clean":"2024-09-13T15:07:41.503446+0000","last_became_active":"2024-09-13T15:07:37.008427+0000","last_became_peered":"2024-09-13T15:07:37.008427+0000","last_unstale":"2024-09-13T15:07:41.503446+0000","last_undegraded":"2024-09-13T15:07:41.503446+0000","last_fullsized":"2024-09-13T15:07:41.503446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.536864+0000","last_change":"2024-09-13T15:07:41.532322+0000","last_active":"2024-09-13T15:07:41.536864+0000","last_peered":"2024-09-13T15:07:41.536864+0000","last_clean":"2024-09-13T15:07:41.536864+0000","last_became_active":"2024-09-13T15:07:41.531912+0000","last_became_peered":"2024-09-13T15:07:41.531912+0000","last_unstale":"2024-09-13T15:07:41.536864+0000","last_undegraded":"2024-09-13T15:07:41.536864+0000","last_fullsized":"2024-09-13T15:07:41.536864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:30.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564696+0000","last_change":"2024-09-13T15:07:37.515251+0000","last_active":"2024-09-13T15:07:41.564696+0000","last_peered":"2024-09-13T15:07:41.564696+0000","last_clean":"2024-09-13T15:07:41.564696+0000","last_became_active":"2024-09-13T15:07:37.514972+0000","last_became_peered":"2024-09-13T15:07:37.514972+0000","last_unstale":"2024-09-13T15:07:41.564696+0000","last_undegraded":"2024-09-13T15:07:41.564696+0000","last_fullsized":"2024-09-13T15:07:41.564696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504636+0000","last_change":"2024-09-13T15:07:37.004826+0000","last_active":"2024-09-13T15:07:41.504636+0000","last_peered":"2024-09-13T15:07:41.504636+0000","last_clean":"2024-09-13T15:07:41.504636+0000","last_became_active":"2024-09-13T15:07:37.004447+0000","last_became_peered":"2024-09-13T15:07:37.004447+0000","last_unstale":"2024-09-13T15:07:41.504636+0000","last_undegraded":"2024-09-13T15:07:41.504636+0000","last_fullsized":"2024-09-13T15:07:41.504636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.540805+0000","last_change":"2024-09-13T15:07:41.537561+0000","last_active":"2024-09-13T15:07:41.540805+0000","last_peered":"2024-09-13T15:07:41.540805+0000","last_clean":"2024-09-13T15:07:41.540805+0000","last_became_active":"2024-09-13T15:07:41.536984+0000","last_became_peered":"2024-09-13T15:07:41.536984+0000","last_unstale":"2024-09-13T15:07:41.540805+0000","last_undegraded":"2024-09-13T15:07:41.540805+0000","last_fullsized":"2024-09-13T15:07:41.540805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511993+0000","last_change":"2024-09-13T15:07:37.498344+0000","last_active":"2024-09-13T15:07:41.511993+0000","last_peered":"2024-09-13T15:07:41.511993+0000","last_clean":"2024-09-13T15:07:41.511993+0000","last_became_active":"2024-09-13T15:07:37.498068+0000","last_became_peered":"2024-09-13T15:07:37.498068+0000","last_unstale":"2024-09-13T15:07:41.511993+0000","last_undegraded":"2024-09-13T15:07:41.511993+0000","last_fullsized":"2024-09-13T15:07:41.511993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511905+0000","last_change":"2024-09-13T15:07:36.997359+0000","last_active":"2024-09-13T15:07:41.511905+0000","last_peered":"2024-09-13T15:07:41.511905+0000","last_clean":"2024-09-13T15:07:41.511905+0000","last_became_active":"2024-09-13T15:07:36.997095+0000","last_became_peered":"2024-09-13T15:07:36.997095+0000","last_unstale":"2024-09-13T15:07:41.511905+0000","last_undegraded":"2024-09-13T15:07:41.511905+0000","last_fullsized":"2024-09-13T15:07:41.511905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578693+0000","last_change":"2024-09-13T15:07:41.574687+0000","last_active":"2024-09-13T15:07:41.578693+0000","last_peered":"2024-09-13T15:07:41.578693+0000","last_clean":"2024-09-13T15:07:41.578693+0000","last_became_active":"2024-09-13T15:07:41.573353+0000","last_became_peered":"2024-09-13T15:07:41.573353+0000","last_unstale":"2024-09-13T15:07:41.578693+0000","last_undegraded":"2024-09-13T15:07:41.578693+0000","last_fullsized":"2024-09-13T15:07:41.578693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:52.778665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564643+0000","last_change":"2024-09-13T15:07:37.518920+0000","last_active":"2024-09-13T15:07:41.564643+0000","last_peered":"2024-09-13T15:07:41.564643+0000","last_clean":"2024-09-13T15:07:41.564643+0000","last_became_active":"2024-09-13T15:07:37.518651+0000","last_became_peered":"2024-09-13T15:07:37.518651+0000","last_unstale":"2024-09-13T15:07:41.564643+0000","last_undegraded":"2024-09-13T15:07:41.564643+0000","last_fullsized":"2024-09-13T15:07:41.564643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503060+0000","last_change":"2024-09-13T15:07:37.007685+0000","last_active":"2024-09-13T15:07:41.503060+0000","last_peered":"2024-09-13T15:07:41.503060+0000","last_clean":"2024-09-13T15:07:41.503060+0000","last_became_active":"2024-09-13T15:07:37.007213+0000","last_became_peered":"2024-09-13T15:07:37.007213+0000","last_unstale":"2024-09-13T15:07:41.503060+0000","last_undegraded":"2024-09-13T15:07:41.503060+0000","last_fullsized":"2024-09-13T15:07:41.503060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573282+0000","last_change":"2024-09-13T15:07:41.568051+0000","last_active":"2024-09-13T15:07:41.573282+0000","last_peered":"2024-09-13T15:07:41.573282+0000","last_clean":"2024-09-13T15:07:41.573282+0000","last_became_active":"2024-09-13T15:07:41.566715+0000","last_became_peered":"2024-09-13T15:07:41.566715+0000","last_unstale":"2024-09-13T15:07:41.573282+0000","last_undegraded":"2024-09-13T15:07:41.573282+0000","last_fullsized":"2024-09-13T15:07:41.573282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505146+0000","last_change":"2024-09-13T15:07:37.506015+0000","last_active":"2024-09-13T15:07:41.505146+0000","last_peered":"2024-09-13T15:07:41.505146+0000","last_clean":"2024-09-13T15:07:41.505146+0000","last_became_active":"2024-09-13T15:07:37.505661+0000","last_became_peered":"2024-09-13T15:07:37.505661+0000","last_unstale":"2024-09-13T15:07:41.505146+0000","last_undegraded":"2024-09-13T15:07:41.505146+0000","last_fullsized":"2024-09-13T15:07:41.505146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515345+0000","last_change":"2024-09-13T15:07:37.009882+0000","last_active":"2024-09-13T15:07:41.515345+0000","last_peered":"2024-09-13T15:07:41.515345+0000","last_clean":"2024-09-13T15:07:41.515345+0000","last_became_active":"2024-09-13T15:07:37.009351+0000","last_became_peered":"2024-09-13T15:07:37.009351+0000","last_unstale":"2024-09-13T15:07:41.515345+0000","last_undegraded":"2024-09-13T15:07:41.515345+0000","last_fullsized":"2024-09-13T15:07:41.515345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575567+0000","last_change":"2024-09-13T15:07:41.571228+0000","last_active":"2024-09-13T15:07:41.575567+0000","last_peered":"2024-09-13T15:07:41.575567+0000","last_clean":"2024-09-13T15:07:41.575567+0000","last_became_active":"2024-09-13T15:07:41.570618+0000","last_became_peered":"2024-09-13T15:07:41.570618+0000","last_unstale":"2024-09-13T15:07:41.575567+0000","last_undegraded":"2024-09-13T15:07:41.575567+0000","last_fullsized":"2024-09-13T15:07:41.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:29.764351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565542+0000","last_change":"2024-09-13T15:07:37.500097+0000","last_active":"2024-09-13T15:07:41.565542+0000","last_peered":"2024-09-13T15:07:41.565542+0000","last_clean":"2024-09-13T15:07:41.565542+0000","last_became_active":"2024-09-13T15:07:37.499700+0000","last_became_peered":"2024-09-13T15:07:37.499700+0000","last_unstale":"2024-09-13T15:07:41.565542+0000","last_undegraded":"2024-09-13T15:07:41.565542+0000","last_fullsized":"2024-09-13T15:07:41.565542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:54.189933+0000","last_change":"2024-09-13T15:07:37.004068+0000","last_active":"2024-09-13T15:07:54.189933+0000","last_peered":"2024-09-13T15:07:54.189933+0000","last_clean":"2024-09-13T15:07:54.189933+0000","last_became_active":"2024-09-13T15:07:37.003828+0000","last_became_peered":"2024-09-13T15:07:37.003828+0000","last_unstale":"2024-09-13T15:07:54.189933+0000","last_undegraded":"2024-09-13T15:07:54.189933+0000","last_fullsized":"2024-09-13T15:07:54.189933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533775+0000","last_change":"2024-09-13T15:07:41.531428+0000","last_active":"2024-09-13T15:07:41.533775+0000","last_peered":"2024-09-13T15:07:41.533775+0000","last_clean":"2024-09-13T15:07:41.533775+0000","last_became_active":"2024-09-13T15:07:41.531005+0000","last_became_peered":"2024-09-13T15:07:41.531005+0000","last_unstale":"2024-09-13T15:07:41.533775+0000","last_undegraded":"2024-09-13T15:07:41.533775+0000","last_fullsized":"2024-09-13T15:07:41.533775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:12.805480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504532+0000","last_change":"2024-09-13T15:07:37.515016+0000","last_active":"2024-09-13T15:07:41.504532+0000","last_peered":"2024-09-13T15:07:41.504532+0000","last_clean":"2024-09-13T15:07:41.504532+0000","last_became_active":"2024-09-13T15:07:37.514791+0000","last_became_peered":"2024-09-13T15:07:37.514791+0000","last_unstale":"2024-09-13T15:07:41.504532+0000","last_undegraded":"2024-09-13T15:07:41.504532+0000","last_fullsized":"2024-09-13T15:07:41.504532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526346+0000","last_change":"2024-09-13T15:07:37.015782+0000","last_active":"2024-09-13T15:07:41.526346+0000","last_peered":"2024-09-13T15:07:41.526346+0000","last_clean":"2024-09-13T15:07:41.526346+0000","last_became_active":"2024-09-13T15:07:37.015458+0000","last_became_peered":"2024-09-13T15:07:37.015458+0000","last_unstale":"2024-09-13T15:07:41.526346+0000","last_undegraded":"2024-09-13T15:07:41.526346+0000","last_fullsized":"2024-09-13T15:07:41.526346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.528017+0000","last_change":"2024-09-13T15:07:41.525109+0000","last_active":"2024-09-13T15:07:41.528017+0000","last_peered":"2024-09-13T15:07:41.528017+0000","last_clean":"2024-09-13T15:07:41.528017+0000","last_became_active":"2024-09-13T15:07:41.524368+0000","last_became_peered":"2024-09-13T15:07:41.524368+0000","last_unstale":"2024-09-13T15:07:41.528017+0000","last_undegraded":"2024-09-13T15:07:41.528017+0000","last_fullsized":"2024-09-13T15:07:41.528017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.479957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509473+0000","last_change":"2024-09-13T15:07:37.503285+0000","last_active":"2024-09-13T15:07:41.509473+0000","last_peered":"2024-09-13T15:07:41.509473+0000","last_clean":"2024-09-13T15:07:41.509473+0000","last_became_active":"2024-09-13T15:07:37.502590+0000","last_became_peered":"2024-09-13T15:07:37.502590+0000","last_unstale":"2024-09-13T15:07:41.509473+0000","last_undegraded":"2024-09-13T15:07:41.509473+0000","last_fullsized":"2024-09-13T15:07:41.509473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:19.522117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505205+0000","last_change":"2024-09-13T15:07:37.006134+0000","last_active":"2024-09-13T15:07:41.505205+0000","last_peered":"2024-09-13T15:07:41.505205+0000","last_clean":"2024-09-13T15:07:41.505205+0000","last_became_active":"2024-09-13T15:07:37.005639+0000","last_became_peered":"2024-09-13T15:07:37.005639+0000","last_unstale":"2024-09-13T15:07:41.505205+0000","last_undegraded":"2024-09-13T15:07:41.505205+0000","last_fullsized":"2024-09-13T15:07:41.505205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.534013+0000","last_change":"2024-09-13T15:07:41.531809+0000","last_active":"2024-09-13T15:07:41.534013+0000","last_peered":"2024-09-13T15:07:41.534013+0000","last_clean":"2024-09-13T15:07:41.534013+0000","last_became_active":"2024-09-13T15:07:41.527321+0000","last_became_peered":"2024-09-13T15:07:41.527321+0000","last_unstale":"2024-09-13T15:07:41.534013+0000","last_undegraded":"2024-09-13T15:07:41.534013+0000","last_fullsized":"2024-09-13T15:07:41.534013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:39.844754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505119+0000","last_change":"2024-09-13T15:07:37.504536+0000","last_active":"2024-09-13T15:07:41.505119+0000","last_peered":"2024-09-13T15:07:41.505119+0000","last_clean":"2024-09-13T15:07:41.505119+0000","last_became_active":"2024-09-13T15:07:37.504176+0000","last_became_peered":"2024-09-13T15:07:37.504176+0000","last_unstale":"2024-09-13T15:07:41.505119+0000","last_undegraded":"2024-09-13T15:07:41.505119+0000","last_fullsized":"2024-09-13T15:07:41.505119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516435+0000","last_change":"2024-09-13T15:07:37.005951+0000","last_active":"2024-09-13T15:07:41.516435+0000","last_peered":"2024-09-13T15:07:41.516435+0000","last_clean":"2024-09-13T15:07:41.516435+0000","last_became_active":"2024-09-13T15:07:37.005548+0000","last_became_peered":"2024-09-13T15:07:37.005548+0000","last_unstale":"2024-09-13T15:07:41.516435+0000","last_undegraded":"2024-09-13T15:07:41.516435+0000","last_fullsized":"2024-09-13T15:07:41.516435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578487+0000","last_change":"2024-09-13T15:07:41.571875+0000","last_active":"2024-09-13T15:07:41.578487+0000","last_peered":"2024-09-13T15:07:41.578487+0000","last_clean":"2024-09-13T15:07:41.578487+0000","last_became_active":"2024-09-13T15:07:41.569987+0000","last_became_peered":"2024-09-13T15:07:41.569987+0000","last_unstale":"2024-09-13T15:07:41.578487+0000","last_undegraded":"2024-09-13T15:07:41.578487+0000","last_fullsized":"2024-09-13T15:07:41.578487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577725+0000","last_change":"2024-09-13T15:07:41.573083+0000","last_active":"2024-09-13T15:07:41.577725+0000","last_peered":"2024-09-13T15:07:41.577725+0000","last_clean":"2024-09-13T15:07:41.577725+0000","last_became_active":"2024-09-13T15:07:41.572220+0000","last_became_peered":"2024-09-13T15:07:41.572220+0000","last_unstale":"2024-09-13T15:07:41.577725+0000","last_undegraded":"2024-09-13T15:07:41.577725+0000","last_fullsized":"2024-09-13T15:07:41.577725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521874+0000","last_change":"2024-09-13T15:07:37.493152+0000","last_active":"2024-09-13T15:07:41.521874+0000","last_peered":"2024-09-13T15:07:41.521874+0000","last_clean":"2024-09-13T15:07:41.521874+0000","last_became_active":"2024-09-13T15:07:37.492891+0000","last_became_peered":"2024-09-13T15:07:37.492891+0000","last_unstale":"2024-09-13T15:07:41.521874+0000","last_undegraded":"2024-09-13T15:07:41.521874+0000","last_fullsized":"2024-09-13T15:07:41.521874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503103+0000","last_change":"2024-09-13T15:07:37.002734+0000","last_active":"2024-09-13T15:07:41.503103+0000","last_peered":"2024-09-13T15:07:41.503103+0000","last_clean":"2024-09-13T15:07:41.503103+0000","last_became_active":"2024-09-13T15:07:37.002305+0000","last_became_peered":"2024-09-13T15:07:37.002305+0000","last_unstale":"2024-09-13T15:07:41.503103+0000","last_undegraded":"2024-09-13T15:07:41.503103+0000","last_fullsized":"2024-09-13T15:07:41.503103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533380+0000","last_change":"2024-09-13T15:07:41.527871+0000","last_active":"2024-09-13T15:07:41.533380+0000","last_peered":"2024-09-13T15:07:41.533380+0000","last_clean":"2024-09-13T15:07:41.533380+0000","last_became_active":"2024-09-13T15:07:41.527114+0000","last_became_peered":"2024-09-13T15:07:41.527114+0000","last_unstale":"2024-09-13T15:07:41.533380+0000","last_undegraded":"2024-09-13T15:07:41.533380+0000","last_fullsized":"2024-09-13T15:07:41.533380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523542+0000","last_change":"2024-09-13T15:07:37.490427+0000","last_active":"2024-09-13T15:07:41.523542+0000","last_peered":"2024-09-13T15:07:41.523542+0000","last_clean":"2024-09-13T15:07:41.523542+0000","last_became_active":"2024-09-13T15:07:37.490022+0000","last_became_peered":"2024-09-13T15:07:37.490022+0000","last_unstale":"2024-09-13T15:07:41.523542+0000","last_undegraded":"2024-09-13T15:07:41.523542+0000","last_fullsized":"2024-09-13T15:07:41.523542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506961+0000","last_change":"2024-09-13T15:07:37.007543+0000","last_active":"2024-09-13T15:07:41.506961+0000","last_peered":"2024-09-13T15:07:41.506961+0000","last_clean":"2024-09-13T15:07:41.506961+0000","last_became_active":"2024-09-13T15:07:37.007134+0000","last_became_peered":"2024-09-13T15:07:37.007134+0000","last_unstale":"2024-09-13T15:07:41.506961+0000","last_undegraded":"2024-09-13T15:07:41.506961+0000","last_fullsized":"2024-09-13T15:07:41.506961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512143+0000","last_change":"2024-09-13T15:07:37.003099+0000","last_active":"2024-09-13T15:07:41.512143+0000","last_peered":"2024-09-13T15:07:41.512143+0000","last_clean":"2024-09-13T15:07:41.512143+0000","last_became_active":"2024-09-13T15:07:37.001875+0000","last_became_peered":"2024-09-13T15:07:37.001875+0000","last_unstale":"2024-09-13T15:07:41.512143+0000","last_undegraded":"2024-09-13T15:07:41.512143+0000","last_fullsized":"2024-09-13T15:07:41.512143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515252+0000","last_change":"2024-09-13T15:07:37.514343+0000","last_active":"2024-09-13T15:07:41.515252+0000","last_peered":"2024-09-13T15:07:41.515252+0000","last_clean":"2024-09-13T15:07:41.515252+0000","last_became_active":"2024-09-13T15:07:37.514044+0000","last_became_peered":"2024-09-13T15:07:37.514044+0000","last_unstale":"2024-09-13T15:07:41.515252+0000","last_undegraded":"2024-09-13T15:07:41.515252+0000","last_fullsized":"2024-09-13T15:07:41.515252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538959+0000","last_change":"2024-09-13T15:07:41.536373+0000","last_active":"2024-09-13T15:07:41.538959+0000","last_peered":"2024-09-13T15:07:41.538959+0000","last_clean":"2024-09-13T15:07:41.538959+0000","last_became_active":"2024-09-13T15:07:41.535945+0000","last_became_peered":"2024-09-13T15:07:41.535945+0000","last_unstale":"2024-09-13T15:07:41.538959+0000","last_undegraded":"2024-09-13T15:07:41.538959+0000","last_fullsized":"2024-09-13T15:07:41.538959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:09.980333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505339+0000","last_change":"2024-09-13T15:07:37.008842+0000","last_active":"2024-09-13T15:07:41.505339+0000","last_peered":"2024-09-13T15:07:41.505339+0000","last_clean":"2024-09-13T15:07:41.505339+0000","last_became_active":"2024-09-13T15:07:37.008556+0000","last_became_peered":"2024-09-13T15:07:37.008556+0000","last_unstale":"2024-09-13T15:07:41.505339+0000","last_undegraded":"2024-09-13T15:07:41.505339+0000","last_fullsized":"2024-09-13T15:07:41.505339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507931+0000","last_change":"2024-09-13T15:07:37.493138+0000","last_active":"2024-09-13T15:07:41.507931+0000","last_peered":"2024-09-13T15:07:41.507931+0000","last_clean":"2024-09-13T15:07:41.507931+0000","last_became_active":"2024-09-13T15:07:37.492811+0000","last_became_peered":"2024-09-13T15:07:37.492811+0000","last_unstale":"2024-09-13T15:07:41.507931+0000","last_undegraded":"2024-09-13T15:07:41.507931+0000","last_fullsized":"2024-09-13T15:07:41.507931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533522+0000","last_change":"2024-09-13T15:07:41.531188+0000","last_active":"2024-09-13T15:07:41.533522+0000","last_peered":"2024-09-13T15:07:41.533522+0000","last_clean":"2024-09-13T15:07:41.533522+0000","last_became_active":"2024-09-13T15:07:41.530750+0000","last_became_peered":"2024-09-13T15:07:41.530750+0000","last_unstale":"2024-09-13T15:07:41.533522+0000","last_undegraded":"2024-09-13T15:07:41.533522+0000","last_fullsized":"2024-09-13T15:07:41.533522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:17.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511841+0000","last_change":"2024-09-13T15:07:37.502829+0000","last_active":"2024-09-13T15:07:41.511841+0000","last_peered":"2024-09-13T15:07:41.511841+0000","last_clean":"2024-09-13T15:07:41.511841+0000","last_became_active":"2024-09-13T15:07:37.502567+0000","last_became_peered":"2024-09-13T15:07:37.502567+0000","last_unstale":"2024-09-13T15:07:41.511841+0000","last_undegraded":"2024-09-13T15:07:41.511841+0000","last_fullsized":"2024-09-13T15:07:41.511841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505009+0000","last_change":"2024-09-13T15:07:37.499515+0000","last_active":"2024-09-13T15:07:41.505009+0000","last_peered":"2024-09-13T15:07:41.505009+0000","last_clean":"2024-09-13T15:07:41.505009+0000","last_became_active":"2024-09-13T15:07:37.499249+0000","last_became_peered":"2024-09-13T15:07:37.499249+0000","last_unstale":"2024-09-13T15:07:41.505009+0000","last_undegraded":"2024-09-13T15:07:41.505009+0000","last_fullsized":"2024-09-13T15:07:41.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502954+0000","last_change":"2024-09-13T15:07:37.491947+0000","last_active":"2024-09-13T15:07:41.502954+0000","last_peered":"2024-09-13T15:07:41.502954+0000","last_clean":"2024-09-13T15:07:41.502954+0000","last_became_active":"2024-09-13T15:07:37.491654+0000","last_became_peered":"2024-09-13T15:07:37.491654+0000","last_unstale":"2024-09-13T15:07:41.502954+0000","last_undegraded":"2024-09-13T15:07:41.502954+0000","last_fullsized":"2024-09-13T15:07:41.502954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515163+0000","last_change":"2024-09-13T15:07:37.492083+0000","last_active":"2024-09-13T15:07:41.515163+0000","last_peered":"2024-09-13T15:07:41.515163+0000","last_clean":"2024-09-13T15:07:41.515163+0000","last_became_active":"2024-09-13T15:07:37.491195+0000","last_became_peered":"2024-09-13T15:07:37.491195+0000","last_unstale":"2024-09-13T15:07:41.515163+0000","last_undegraded":"2024-09-13T15:07:41.515163+0000","last_fullsized":"2024-09-13T15:07:41.515163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507538+0000","last_change":"2024-09-13T15:07:37.510538+0000","last_active":"2024-09-13T15:07:41.507538+0000","last_peered":"2024-09-13T15:07:41.507538+0000","last_clean":"2024-09-13T15:07:41.507538+0000","last_became_active":"2024-09-13T15:07:37.510162+0000","last_became_peered":"2024-09-13T15:07:37.510162+0000","last_unstale":"2024-09-13T15:07:41.507538+0000","last_undegraded":"2024-09-13T15:07:41.507538+0000","last_fullsized":"2024-09-13T15:07:41.507538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525991+0000","last_change":"2024-09-13T15:07:37.494524+0000","last_active":"2024-09-13T15:07:41.525991+0000","last_peered":"2024-09-13T15:07:41.525991+0000","last_clean":"2024-09-13T15:07:41.525991+0000","last_became_active":"2024-09-13T15:07:37.494249+0000","last_became_peered":"2024-09-13T15:07:37.494249+0000","last_unstale":"2024-09-13T15:07:41.525991+0000","last_undegraded":"2024-09-13T15:07:41.525991+0000","last_fullsized":"2024-09-13T15:07:41.525991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516203+0000","last_change":"2024-09-13T15:07:37.504649+0000","last_active":"2024-09-13T15:07:41.516203+0000","last_peered":"2024-09-13T15:07:41.516203+0000","last_clean":"2024-09-13T15:07:41.516203+0000","last_became_active":"2024-09-13T15:07:37.504400+0000","last_became_peered":"2024-09-13T15:07:37.504400+0000","last_unstale":"2024-09-13T15:07:41.516203+0000","last_undegraded":"2024-09-13T15:07:41.516203+0000","last_fullsized":"2024-09-13T15:07:41.516203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509917+0000","last_change":"2024-09-13T15:07:37.506438+0000","last_active":"2024-09-13T15:07:41.509917+0000","last_peered":"2024-09-13T15:07:41.509917+0000","last_clean":"2024-09-13T15:07:41.509917+0000","last_became_active":"2024-09-13T15:07:37.506038+0000","last_became_peered":"2024-09-13T15:07:37.506038+0000","last_unstale":"2024-09-13T15:07:41.509917+0000","last_undegraded":"2024-09-13T15:07:41.509917+0000","last_fullsized":"2024-09-13T15:07:41.509917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502985+0000","last_change":"2024-09-13T15:07:37.491788+0000","last_active":"2024-09-13T15:07:41.502985+0000","last_peered":"2024-09-13T15:07:41.502985+0000","last_clean":"2024-09-13T15:07:41.502985+0000","last_became_active":"2024-09-13T15:07:37.491487+0000","last_became_peered":"2024-09-13T15:07:37.491487+0000","last_unstale":"2024-09-13T15:07:41.502985+0000","last_undegraded":"2024-09-13T15:07:41.502985+0000","last_fullsized":"2024-09-13T15:07:41.502985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506888+0000","last_change":"2024-09-13T15:07:37.493714+0000","last_active":"2024-09-13T15:07:41.506888+0000","last_peered":"2024-09-13T15:07:41.506888+0000","last_clean":"2024-09-13T15:07:41.506888+0000","last_became_active":"2024-09-13T15:07:37.493434+0000","last_became_peered":"2024-09-13T15:07:37.493434+0000","last_unstale":"2024-09-13T15:07:41.506888+0000","last_undegraded":"2024-09-13T15:07:41.506888+0000","last_fullsized":"2024-09-13T15:07:41.506888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502861+0000","last_change":"2024-09-13T15:07:37.505382+0000","last_active":"2024-09-13T15:07:41.502861+0000","last_peered":"2024-09-13T15:07:41.502861+0000","last_clean":"2024-09-13T15:07:41.502861+0000","last_became_active":"2024-09-13T15:07:37.504958+0000","last_became_peered":"2024-09-13T15:07:37.504958+0000","last_unstale":"2024-09-13T15:07:41.502861+0000","last_undegraded":"2024-09-13T15:07:41.502861+0000","last_fullsized":"2024-09-13T15:07:41.502861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515039+0000","last_change":"2024-09-13T15:07:37.504610+0000","last_active":"2024-09-13T15:07:41.515039+0000","last_peered":"2024-09-13T15:07:41.515039+0000","last_clean":"2024-09-13T15:07:41.515039+0000","last_became_active":"2024-09-13T15:07:37.502014+0000","last_became_peered":"2024-09-13T15:07:37.502014+0000","last_unstale":"2024-09-13T15:07:41.515039+0000","last_undegraded":"2024-09-13T15:07:41.515039+0000","last_fullsized":"2024-09-13T15:07:41.515039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512035+0000","last_change":"2024-09-13T15:07:37.507065+0000","last_active":"2024-09-13T15:07:41.512035+0000","last_peered":"2024-09-13T15:07:41.512035+0000","last_clean":"2024-09-13T15:07:41.512035+0000","last_became_active":"2024-09-13T15:07:37.506779+0000","last_became_peered":"2024-09-13T15:07:37.506779+0000","last_unstale":"2024-09-13T15:07:41.512035+0000","last_undegraded":"2024-09-13T15:07:41.512035+0000","last_fullsized":"2024-09-13T15:07:41.512035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565939+0000","last_change":"2024-09-13T15:07:37.500769+0000","last_active":"2024-09-13T15:07:41.565939+0000","last_peered":"2024-09-13T15:07:41.565939+0000","last_clean":"2024-09-13T15:07:41.565939+0000","last_became_active":"2024-09-13T15:07:37.500527+0000","last_became_peered":"2024-09-13T15:07:37.500527+0000","last_unstale":"2024-09-13T15:07:41.565939+0000","last_undegraded":"2024-09-13T15:07:41.565939+0000","last_fullsized":"2024-09-13T15:07:41.565939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505254+0000","last_change":"2024-09-13T15:07:37.501370+0000","last_active":"2024-09-13T15:07:41.505254+0000","last_peered":"2024-09-13T15:07:41.505254+0000","last_clean":"2024-09-13T15:07:41.505254+0000","last_became_active":"2024-09-13T15:07:37.501117+0000","last_became_peered":"2024-09-13T15:07:37.501117+0000","last_unstale":"2024-09-13T15:07:41.505254+0000","last_undegraded":"2024-09-13T15:07:41.505254+0000","last_fullsized":"2024-09-13T15:07:41.505254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.499033+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.498785+0000","last_became_peered":"2024-09-13T15:07:37.498785+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502879+0000","last_change":"2024-09-13T15:07:37.496894+0000","last_active":"2024-09-13T15:07:41.502879+0000","last_peered":"2024-09-13T15:07:41.502879+0000","last_clean":"2024-09-13T15:07:41.502879+0000","last_became_active":"2024-09-13T15:07:37.496688+0000","last_became_peered":"2024-09-13T15:07:37.496688+0000","last_unstale":"2024-09-13T15:07:41.502879+0000","last_undegraded":"2024-09-13T15:07:41.502879+0000","last_fullsized":"2024-09-13T15:07:41.502879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521879+0000","last_change":"2024-09-13T15:07:37.496945+0000","last_active":"2024-09-13T15:07:41.521879+0000","last_peered":"2024-09-13T15:07:41.521879+0000","last_clean":"2024-09-13T15:07:41.521879+0000","last_became_active":"2024-09-13T15:07:37.496509+0000","last_became_peered":"2024-09-13T15:07:37.496509+0000","last_unstale":"2024-09-13T15:07:41.521879+0000","last_undegraded":"2024-09-13T15:07:41.521879+0000","last_fullsized":"2024-09-13T15:07:41.521879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504987+0000","last_change":"2024-09-13T15:07:37.495060+0000","last_active":"2024-09-13T15:07:41.504987+0000","last_peered":"2024-09-13T15:07:41.504987+0000","last_clean":"2024-09-13T15:07:41.504987+0000","last_became_active":"2024-09-13T15:07:37.494788+0000","last_became_peered":"2024-09-13T15:07:37.494788+0000","last_unstale":"2024-09-13T15:07:41.504987+0000","last_undegraded":"2024-09-13T15:07:41.504987+0000","last_fullsized":"2024-09-13T15:07:41.504987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505104+0000","last_change":"2024-09-13T15:07:37.491940+0000","last_active":"2024-09-13T15:07:41.505104+0000","last_peered":"2024-09-13T15:07:41.505104+0000","last_clean":"2024-09-13T15:07:41.505104+0000","last_became_active":"2024-09-13T15:07:37.491714+0000","last_became_peered":"2024-09-13T15:07:37.491714+0000","last_unstale":"2024-09-13T15:07:41.505104+0000","last_undegraded":"2024-09-13T15:07:41.505104+0000","last_fullsized":"2024-09-13T15:07:41.505104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504221+0000","last_change":"2024-09-13T15:07:37.493155+0000","last_active":"2024-09-13T15:07:41.504221+0000","last_peered":"2024-09-13T15:07:41.504221+0000","last_clean":"2024-09-13T15:07:41.504221+0000","last_became_active":"2024-09-13T15:07:37.492896+0000","last_became_peered":"2024-09-13T15:07:37.492896+0000","last_unstale":"2024-09-13T15:07:41.504221+0000","last_undegraded":"2024-09-13T15:07:41.504221+0000","last_fullsized":"2024-09-13T15:07:41.504221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:56.485405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512790+0000","last_change":"2024-09-13T15:07:37.502884+0000","last_active":"2024-09-13T15:07:41.512790+0000","last_peered":"2024-09-13T15:07:41.512790+0000","last_clean":"2024-09-13T15:07:41.512790+0000","last_became_active":"2024-09-13T15:07:37.502542+0000","last_became_peered":"2024-09-13T15:07:37.502542+0000","last_unstale":"2024-09-13T15:07:41.512790+0000","last_undegraded":"2024-09-13T15:07:41.512790+0000","last_fullsized":"2024-09-13T15:07:41.512790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516072+0000","last_change":"2024-09-13T15:07:37.509728+0000","last_active":"2024-09-13T15:07:41.516072+0000","last_peered":"2024-09-13T15:07:41.516072+0000","last_clean":"2024-09-13T15:07:41.516072+0000","last_became_active":"2024-09-13T15:07:37.509264+0000","last_became_peered":"2024-09-13T15:07:37.509264+0000","last_unstale":"2024-09-13T15:07:41.516072+0000","last_undegraded":"2024-09-13T15:07:41.516072+0000","last_fullsized":"2024-09-13T15:07:41.516072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566575+0000","last_change":"2024-09-13T15:07:37.506122+0000","last_active":"2024-09-13T15:07:41.566575+0000","last_peered":"2024-09-13T15:07:41.566575+0000","last_clean":"2024-09-13T15:07:41.566575+0000","last_became_active":"2024-09-13T15:07:37.505859+0000","last_became_peered":"2024-09-13T15:07:37.505859+0000","last_unstale":"2024-09-13T15:07:41.566575+0000","last_undegraded":"2024-09-13T15:07:41.566575+0000","last_fullsized":"2024-09-13T15:07:41.566575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:24.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523490+0000","last_change":"2024-09-13T15:07:37.506044+0000","last_active":"2024-09-13T15:07:41.523490+0000","last_peered":"2024-09-13T15:07:41.523490+0000","last_clean":"2024-09-13T15:07:41.523490+0000","last_became_active":"2024-09-13T15:07:37.505769+0000","last_became_peered":"2024-09-13T15:07:37.505769+0000","last_unstale":"2024-09-13T15:07:41.523490+0000","last_undegraded":"2024-09-13T15:07:41.523490+0000","last_fullsized":"2024-09-13T15:07:41.523490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564537+0000","last_change":"2024-09-13T15:07:37.499277+0000","last_active":"2024-09-13T15:07:41.564537+0000","last_peered":"2024-09-13T15:07:41.564537+0000","last_clean":"2024-09-13T15:07:41.564537+0000","last_became_active":"2024-09-13T15:07:37.499015+0000","last_became_peered":"2024-09-13T15:07:37.499015+0000","last_unstale":"2024-09-13T15:07:41.564537+0000","last_undegraded":"2024-09-13T15:07:41.564537+0000","last_fullsized":"2024-09-13T15:07:41.564537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502767+0000","last_change":"2024-09-13T15:07:37.490609+0000","last_active":"2024-09-13T15:07:41.502767+0000","last_peered":"2024-09-13T15:07:41.502767+0000","last_clean":"2024-09-13T15:07:41.502767+0000","last_became_active":"2024-09-13T15:07:37.490347+0000","last_became_peered":"2024-09-13T15:07:37.490347+0000","last_unstale":"2024-09-13T15:07:41.502767+0000","last_undegraded":"2024-09-13T15:07:41.502767+0000","last_fullsized":"2024-09-13T15:07:41.502767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564563+0000","last_change":"2024-09-13T15:07:37.509408+0000","last_active":"2024-09-13T15:07:41.564563+0000","last_peered":"2024-09-13T15:07:41.564563+0000","last_clean":"2024-09-13T15:07:41.564563+0000","last_became_active":"2024-09-13T15:07:37.509076+0000","last_became_peered":"2024-09-13T15:07:37.509076+0000","last_unstale":"2024-09-13T15:07:41.564563+0000","last_undegraded":"2024-09-13T15:07:41.564563+0000","last_fullsized":"2024-09-13T15:07:41.564563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502014+0000","last_change":"2024-09-13T15:07:37.496397+0000","last_active":"2024-09-13T15:07:41.502014+0000","last_peered":"2024-09-13T15:07:41.502014+0000","last_clean":"2024-09-13T15:07:41.502014+0000","last_became_active":"2024-09-13T15:07:37.495306+0000","last_became_peered":"2024-09-13T15:07:37.495306+0000","last_unstale":"2024-09-13T15:07:41.502014+0000","last_undegraded":"2024-09-13T15:07:41.502014+0000","last_fullsized":"2024-09-13T15:07:41.502014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506055+0000","last_change":"2024-09-13T15:07:37.485483+0000","last_active":"2024-09-13T15:07:41.506055+0000","last_peered":"2024-09-13T15:07:41.506055+0000","last_clean":"2024-09-13T15:07:41.506055+0000","last_became_active":"2024-09-13T15:07:37.485197+0000","last_became_peered":"2024-09-13T15:07:37.485197+0000","last_unstale":"2024-09-13T15:07:41.506055+0000","last_undegraded":"2024-09-13T15:07:41.506055+0000","last_fullsized":"2024-09-13T15:07:41.506055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527325+0000","last_change":"2024-09-13T15:07:37.493235+0000","last_active":"2024-09-13T15:07:41.527325+0000","last_peered":"2024-09-13T15:07:41.527325+0000","last_clean":"2024-09-13T15:07:41.527325+0000","last_became_active":"2024-09-13T15:07:37.493000+0000","last_became_peered":"2024-09-13T15:07:37.493000+0000","last_unstale":"2024-09-13T15:07:41.527325+0000","last_undegraded":"2024-09-13T15:07:41.527325+0000","last_fullsized":"2024-09-13T15:07:41.527325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566439+0000","last_change":"2024-09-13T15:07:37.509845+0000","last_active":"2024-09-13T15:07:41.566439+0000","last_peered":"2024-09-13T15:07:41.566439+0000","last_clean":"2024-09-13T15:07:41.566439+0000","last_became_active":"2024-09-13T15:07:37.505933+0000","last_became_peered":"2024-09-13T15:07:37.505933+0000","last_unstale":"2024-09-13T15:07:41.566439+0000","last_undegraded":"2024-09-13T15:07:41.566439+0000","last_fullsized":"2024-09-13T15:07:41.566439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:08.463346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8460000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:08:06.001 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:08:06.001 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T15:08:06.001 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T15:08:06.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T15:08:06.002 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T15:08:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.229+0000 7f61bfa00700 1 Processor -- start 2024-09-13T15:08:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bfa00700 1 -- start start 2024-09-13T15:08:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bfa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61b81446c0 0x7f61b80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bfa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61b80cfcf0 0x7f61b80cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bfa00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b80b4d10 con 0x7f61b80cc650 2024-09-13T15:08:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bfa00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b8144aa0 con 0x7f61b80cfcf0 2024-09-13T15:08:06.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bfa00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80b4100 con 0x7f61b81446c0 2024-09-13T15:08:06.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61b80cfcf0 0x7f61b80cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61b80cfcf0 0x7f61b80cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57986/0 (socket says 172.21.15.50:57986) 2024-09-13T15:08:06.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 -- 172.21.15.50:0/2559381524 learned_addr learned my addr 172.21.15.50:0/2559381524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61bd000700 1 --2- 172.21.15.50:0/2559381524 >> v2:172.21.15.181:3300/0 conn(0x7f61b81446c0 0x7f61b80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 -- 172.21.15.50:0/2559381524 >> v2:172.21.15.181:3300/0 conn(0x7f61b81446c0 msgr2=0x7f61b80b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 --2- 172.21.15.50:0/2559381524 >> v2:172.21.15.181:3300/0 conn(0x7f61b81446c0 0x7f61b80b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 -- 172.21.15.50:0/2559381524 >> v1:172.21.15.181:6789/0 conn(0x7f61b80cc650 legacy=0x7f61b80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 -- 172.21.15.50:0/2559381524 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b80b43e0 con 0x7f61b80cfcf0 2024-09-13T15:08:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.233+0000 7f61b7e00700 1 --2- 172.21.15.50:0/2559381524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b80cfcf0 0x7f61b80cc110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b3810 tx=0x7f61a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa5276228e632ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61b7400700 1 -- 172.21.15.50:0/2559381524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011830 con 0x7f61b80cfcf0 2024-09-13T15:08:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61b7400700 1 -- 172.21.15.50:0/2559381524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a4011990 con 0x7f61b80cfcf0 2024-09-13T15:08:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61b7400700 1 -- 172.21.15.50:0/2559381524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011d20 con 0x7f61b80cfcf0 2024-09-13T15:08:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 -- 172.21.15.50:0/2559381524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b80cfcf0 msgr2=0x7f61b80cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 --2- 172.21.15.50:0/2559381524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b80cfcf0 0x7f61b80cc110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b3810 tx=0x7f61a4009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 -- 172.21.15.50:0/2559381524 shutdown_connections 2024-09-13T15:08:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 --2- 172.21.15.50:0/2559381524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b80cfcf0 0x7f61b80cc110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 --2- 172.21.15.50:0/2559381524 >> v2:172.21.15.181:3300/0 conn(0x7f61b81446c0 0x7f61b80b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 -- 172.21.15.50:0/2559381524 >> 172.21.15.50:0/2559381524 conn(0x7f61b80726d0 msgr2=0x7f61b806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 -- 172.21.15.50:0/2559381524 shutdown_connections 2024-09-13T15:08:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.237+0000 7f61bfa00700 1 -- 172.21.15.50:0/2559381524 wait complete. 2024-09-13T15:08:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 Processor -- start 2024-09-13T15:08:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 -- start start 2024-09-13T15:08:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b80cc650 0x7f61b815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b80cfcf0 0x7f61b81428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 0x7f61b815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b814e2d0 con 0x7f61b81446c0 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8142e20 con 0x7f61b80cc650 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bfa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b8143960 con 0x7f61b80cfcf0 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bda00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 0x7f61b815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b80cc650 0x7f61b815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bda00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 0x7f61b815c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57994/0 (socket says 172.21.15.50:57994) 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bda00700 1 -- 172.21.15.50:0/1563272177 learned_addr learned my addr 172.21.15.50:0/1563272177 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61b7e00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b80cfcf0 0x7f61b81428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 -- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b80cfcf0 msgr2=0x7f61b81428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b80cfcf0 0x7f61b81428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 -- 172.21.15.50:0/1563272177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 msgr2=0x7f61b815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 0x7f61b815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 -- 172.21.15.50:0/1563272177 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009570 con 0x7f61b80cc650 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bda00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 0x7f61b815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.241+0000 7f61bd000700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b80cc650 0x7f61b815d850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00e870 tx=0x7f61ac00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac013680 con 0x7f61b80cc650 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0137e0 con 0x7f61b80cc650 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b81430c0 con 0x7f61b80cc650 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac013b70 con 0x7f61b80cc650 2024-09-13T15:08:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b8143680 con 0x7f61b80cc650 2024-09-13T15:08:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b80cc110 con 0x7f61b80cc650 2024-09-13T15:08:06.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.245+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61ac013cd0 con 0x7f61b80cc650 2024-09-13T15:08:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.249+0000 7f61b4c00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6198066730 0x7f6198068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.249+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61ac084240 con 0x7f61b80cc650 2024-09-13T15:08:06.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.249+0000 7f61b7e00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6198066730 0x7f6198068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.249+0000 7f61b7e00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6198066730 0x7f6198068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000c00 tx=0x7f61a4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.261+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61ac051230 con 0x7f61b80cc650 2024-09-13T15:08:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.501+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f61b8067730 con 0x7f61b80cc650 2024-09-13T15:08:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.509+0000 7f61b4c00700 1 -- 172.21.15.50:0/1563272177 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164906 (secure 0 0 0) 0x7f61ac054850 con 0x7f61b80cc650 2024-09-13T15:08:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:06.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6198066730 msgr2=0x7f6198068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6198066730 0x7f6198068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000c00 tx=0x7f61a4008030 comp rx=0 tx=0).stop 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b80cc650 msgr2=0x7f61b815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b80cc650 0x7f61b815d850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00e870 tx=0x7f61ac00eb80 comp rx=0 tx=0).stop 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 shutdown_connections 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6198066730 0x7f6198068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61b81446c0 0x7f61b815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61b80cfcf0 0x7f61b81428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 --2- 172.21.15.50:0/1563272177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61b80cc650 0x7f61b815d850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 >> 172.21.15.50:0/1563272177 conn(0x7f61b80726d0 msgr2=0x7f61b806f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 shutdown_connections 2024-09-13T15:08:06.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.513+0000 7f61bfa00700 1 -- 172.21.15.50:0/1563272177 wait complete. 2024-09-13T15:08:06.539 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":3430379714},{"type":"v1","addr":"172.21.15.181:6833","nonce":3430379714}]},"active_addr":"172.21.15.181:6833/3430379714","active_change":"2024-09-13T15:07:19.985615+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":2503626490}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":1213921470}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":522432025}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":1904339900}]}]} 2024-09-13T15:08:06.544 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T15:08:06.544 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T15:08:06.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.705+0000 7fc4da000700 1 Processor -- start 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.705+0000 7fc4da000700 1 -- start start 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4da000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc4d41610b0 0x7fc4d40719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4da000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4da000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d40b3560 con 0x7fc4d406aaa0 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4da000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d4070b30 con 0x7fc4d41610b0 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4da000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d406b450 con 0x7fc4d40b2d80 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d8c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc4d41610b0 0x7fc4d40719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d3e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc4d406aaa0 0x7fc4d40b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47164/0 (socket says 172.21.15.50:47164) 2024-09-13T15:08:06.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d3e00700 1 -- 172.21.15.50:0/1801981411 learned_addr learned my addr 172.21.15.50:0/1801981411 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:06.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d8c00700 1 -- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 msgr2=0x7fc4d406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:06.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d8c00700 1 --2- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d8c00700 1 -- 172.21.15.50:0/1801981411 >> v1:172.21.15.181:6789/0 conn(0x7fc4d406aaa0 legacy=0x7fc4d40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d3400700 1 -- 172.21.15.50:0/1801981411 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456074772 0 0) 0x7fc4d40b3560 con 0x7fc4d406aaa0 2024-09-13T15:08:06.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d8c00700 1 -- 172.21.15.50:0/1801981411 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40b3280 con 0x7fc4d41610b0 2024-09-13T15:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d8c00700 1 --2- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d41610b0 0x7fc4d40719c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80098b0 tx=0x7fc4c8009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6377b0207fbb392b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.709+0000 7fc4d3400700 1 -- 172.21.15.50:0/1801981411 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8011830 con 0x7fc4d41610b0 2024-09-13T15:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4d3400700 1 -- 172.21.15.50:0/1801981411 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8011990 con 0x7fc4d41610b0 2024-09-13T15:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4d3400700 1 -- 172.21.15.50:0/1801981411 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8011d20 con 0x7fc4d41610b0 2024-09-13T15:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 -- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d41610b0 msgr2=0x7fc4d40719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 --2- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d41610b0 0x7fc4d40719c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80098b0 tx=0x7fc4c8009bc0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 -- 172.21.15.50:0/1801981411 shutdown_connections 2024-09-13T15:08:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 --2- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 --2- 172.21.15.50:0/1801981411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d41610b0 0x7fc4d40719c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 -- 172.21.15.50:0/1801981411 >> 172.21.15.50:0/1801981411 conn(0x7fc4d40b0c40 msgr2=0x7fc4d406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 -- 172.21.15.50:0/1801981411 shutdown_connections 2024-09-13T15:08:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.713+0000 7fc4da000700 1 -- 172.21.15.50:0/1801981411 wait complete. 2024-09-13T15:08:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 Processor -- start 2024-09-13T15:08:06.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 -- start start 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 0x7fc4d415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d41597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d41610b0 0x7fc4d4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4159d20 con 0x7fc4d41610b0 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4158130 con 0x7fc4d406aaa0 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4da000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4159f80 con 0x7fc4d40b2d80 2024-09-13T15:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4d9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d41610b0 0x7fc4d4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4d8c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 0x7fc4d415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4d3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d41597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4d8c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 0x7fc4d415efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48802/0 (socket says 172.21.15.50:48802) 2024-09-13T15:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.717+0000 7fc4d8c00700 1 -- 172.21.15.50:0/2345186092 learned_addr learned my addr 172.21.15.50:0/2345186092 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d8c00700 1 -- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 msgr2=0x7fc4d41597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d8c00700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d41597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d8c00700 1 -- 172.21.15.50:0/2345186092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d41610b0 msgr2=0x7fc4d4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d8c00700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d41610b0 0x7fc4d4157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d8c00700 1 -- 172.21.15.50:0/2345186092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80094b0 con 0x7fc4d406aaa0 2024-09-13T15:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d8c00700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 0x7fc4d415efd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097d0 tx=0x7fc4c8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80045d0 con 0x7fc4d406aaa0 2024-09-13T15:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c801e070 con 0x7fc4d406aaa0 2024-09-13T15:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8003900 con 0x7fc4d406aaa0 2024-09-13T15:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d415a260 con 0x7fc4d406aaa0 2024-09-13T15:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d4162890 con 0x7fc4d406aaa0 2024-09-13T15:08:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.721+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d415a780 con 0x7fc4d406aaa0 2024-09-13T15:08:06.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.725+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4c8003a60 con 0x7fc4d406aaa0 2024-09-13T15:08:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.725+0000 7fc4d0c00700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc4b4066730 0x7fc4b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.725+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4c80855a0 con 0x7fc4d406aaa0 2024-09-13T15:08:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.725+0000 7fc4d3e00700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc4b4066730 0x7fc4b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.725+0000 7fc4d3e00700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc4b4066730 0x7fc4b4068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4d415f510 tx=0x7fc4c0007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.733+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4c8052690 con 0x7fc4d406aaa0 2024-09-13T15:08:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.925+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4d41626f0 con 0x7fc4d406aaa0 2024-09-13T15:08:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.929+0000 7fc4d0c00700 1 -- 172.21.15.50:0/2345186092 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fc4d41626f0 con 0x7fc4d406aaa0 2024-09-13T15:08:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:06.932 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc4b4066730 msgr2=0x7fc4b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc4b4066730 0x7fc4b4068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4d415f510 tx=0x7fc4c0007e00 comp rx=0 tx=0).stop 2024-09-13T15:08:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 msgr2=0x7fc4d415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 0x7fc4d415efd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097d0 tx=0x7fc4c8004770 comp rx=0 tx=0).stop 2024-09-13T15:08:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 shutdown_connections 2024-09-13T15:08:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc4b4066730 0x7fc4b4068bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4d41610b0 0x7fc4d4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4d40b2d80 0x7fc4d41597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 --2- 172.21.15.50:0/2345186092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4d406aaa0 0x7fc4d415efd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 >> 172.21.15.50:0/2345186092 conn(0x7fc4d40b0c40 msgr2=0x7fc4d415fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 shutdown_connections 2024-09-13T15:08:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:06.933+0000 7fc4da000700 1 -- 172.21.15.50:0/2345186092 wait complete. 2024-09-13T15:08:06.961 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T15:08:06.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.129+0000 7fc9d7200700 1 Processor -- start 2024-09-13T15:08:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.129+0000 7fc9d7200700 1 -- start start 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9d7200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc9d00705a0 0x7fc9d01648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9d7200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d013fcc0 con 0x7fc9d013ebc0 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9d7200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d0070a50 con 0x7fc9d006ace0 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9cfe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc9d013ebc0 0x7fc9d006a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57396/0 (socket says 172.21.15.50:57396) 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9d7200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d013f0f0 con 0x7fc9d00705a0 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9cfe00700 1 -- 172.21.15.50:0/3710116093 learned_addr learned my addr 172.21.15.50:0/3710116093 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.133+0000 7fc9d5200700 1 --2- 172.21.15.50:0/3710116093 >> v2:172.21.15.181:3300/0 conn(0x7fc9d00705a0 0x7fc9d01648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9cf400700 1 -- 172.21.15.50:0/3710116093 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240166085 0 0) 0x7fc9d013fcc0 con 0x7fc9d013ebc0 2024-09-13T15:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9cf400700 1 -- 172.21.15.50:0/3710116093 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b40057e0 con 0x7fc9d013ebc0 2024-09-13T15:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d5200700 1 -- 172.21.15.50:0/3710116093 >> v1:172.21.15.181:6789/0 conn(0x7fc9d006ace0 legacy=0x7fc9d006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d5200700 1 -- 172.21.15.50:0/3710116093 >> v1:172.21.15.50:6789/0 conn(0x7fc9d013ebc0 legacy=0x7fc9d006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d5200700 1 -- 172.21.15.50:0/3710116093 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d013f390 con 0x7fc9d00705a0 2024-09-13T15:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d5200700 1 --2- 172.21.15.50:0/3710116093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d00705a0 0x7fc9d01648f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009d90 tx=0x7fc9c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b41ef151e68c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9cf400700 1 -- 172.21.15.50:0/3710116093 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800e070 con 0x7fc9d00705a0 2024-09-13T15:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9cf400700 1 -- 172.21.15.50:0/3710116093 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800bb20 con 0x7fc9d00705a0 2024-09-13T15:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9cf400700 1 -- 172.21.15.50:0/3710116093 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8012430 con 0x7fc9d00705a0 2024-09-13T15:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 -- 172.21.15.50:0/3710116093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d00705a0 msgr2=0x7fc9d01648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3710116093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d00705a0 0x7fc9d01648f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009d90 tx=0x7fc9c800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 -- 172.21.15.50:0/3710116093 shutdown_connections 2024-09-13T15:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3710116093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d00705a0 0x7fc9d01648f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 -- 172.21.15.50:0/3710116093 >> 172.21.15.50:0/3710116093 conn(0x7fc9d00b08d0 msgr2=0x7fc9d00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 -- 172.21.15.50:0/3710116093 shutdown_connections 2024-09-13T15:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.137+0000 7fc9d7200700 1 -- 172.21.15.50:0/3710116093 wait complete. 2024-09-13T15:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 Processor -- start 2024-09-13T15:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 -- start start 2024-09-13T15:08:07.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d006ace0 0x7fc9d013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 0x7fc9d01ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9d013ebc0 0x7fc9d00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d013c8f0 con 0x7fc9d00705a0 2024-09-13T15:08:07.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d015d980 con 0x7fc9d006ace0 2024-09-13T15:08:07.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d015dc60 con 0x7fc9d013ebc0 2024-09-13T15:08:07.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 0x7fc9d01ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 0x7fc9d01ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58012/0 (socket says 172.21.15.50:58012) 2024-09-13T15:08:07.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 -- 172.21.15.50:0/3190304046 learned_addr learned my addr 172.21.15.50:0/3190304046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9cfe00700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d006ace0 0x7fc9d013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d5200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9d013ebc0 0x7fc9d00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 -- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9d013ebc0 msgr2=0x7fc9d00b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9d013ebc0 0x7fc9d00b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 -- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d006ace0 msgr2=0x7fc9d013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d006ace0 0x7fc9d013c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9c7400700 1 -- 172.21.15.50:0/3190304046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009a70 con 0x7fc9d00705a0 2024-09-13T15:08:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.141+0000 7fc9d5200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9d013ebc0 0x7fc9d00b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:07.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9c7400700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 0x7fc9d01ef170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c500 tx=0x7fc9b800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80052d0 con 0x7fc9d00705a0 2024-09-13T15:08:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8005430 con 0x7fc9d00705a0 2024-09-13T15:08:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d015df40 con 0x7fc9d00705a0 2024-09-13T15:08:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80055a0 con 0x7fc9d00705a0 2024-09-13T15:08:07.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d015b650 con 0x7fc9d00705a0 2024-09-13T15:08:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.145+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d006fe90 con 0x7fc9d00705a0 2024-09-13T15:08:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.149+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9b80038e0 con 0x7fc9d00705a0 2024-09-13T15:08:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.149+0000 7fc9ccc00700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9ac066730 0x7fc9ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.149+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9b80839b0 con 0x7fc9d00705a0 2024-09-13T15:08:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.149+0000 7fc9cfe00700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9ac066730 0x7fc9ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.149+0000 7fc9cfe00700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9ac066730 0x7fc9ac068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0007fd0 tx=0x7fc9c0007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.157+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9b8050900 con 0x7fc9d00705a0 2024-09-13T15:08:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.345+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9d006d530 con 0x7fc9d00705a0 2024-09-13T15:08:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.349+0000 7fc9ccc00700 1 -- 172.21.15.50:0/3190304046 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fc9b8017090 con 0x7fc9d00705a0 2024-09-13T15:08:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:07.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9ac066730 msgr2=0x7fc9ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9ac066730 0x7fc9ac068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0007fd0 tx=0x7fc9c0007de0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 msgr2=0x7fc9d01ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 0x7fc9d01ef170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c500 tx=0x7fc9b800c810 comp rx=0 tx=0).stop 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 shutdown_connections 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9ac066730 0x7fc9ac068bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9d013ebc0 0x7fc9d00b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d00705a0 0x7fc9d01ef170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 --2- 172.21.15.50:0/3190304046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9d006ace0 0x7fc9d013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 >> 172.21.15.50:0/3190304046 conn(0x7fc9d00b08d0 msgr2=0x7fc9d00afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 shutdown_connections 2024-09-13T15:08:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.353+0000 7fc9d7200700 1 -- 172.21.15.50:0/3190304046 wait complete. 2024-09-13T15:08:07.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T15:08:07.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T15:08:07.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T15:08:07.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T15:08:07.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T15:08:07.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T15:08:07.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T15:08:07.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T15:08:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 Processor -- start 2024-09-13T15:08:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 -- start start 2024-09-13T15:08:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7ff2b6800700 1 Processor -- start 2024-09-13T15:08:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7f1117e00700 1 Processor -- start 2024-09-13T15:08:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7f1117e00700 1 -- start start 2024-09-13T15:08:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe33014a540 0x7fe3300b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7ff2b6800700 1 -- start start 2024-09-13T15:08:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3300b1910 0x7fe3300b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33014af60 con 0x7fe330070d50 2024-09-13T15:08:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33006da60 con 0x7fe33014a540 2024-09-13T15:08:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe335200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300b24d0 con 0x7fe3300b1910 2024-09-13T15:08:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fb79a400700 1 Processor -- start 2024-09-13T15:08:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fb79a400700 1 -- start start 2024-09-13T15:08:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe32f400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe33014a540 0x7fe3300b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe32f400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe33014a540 0x7fe3300b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48832/0 (socket says 172.21.15.50:48832) 2024-09-13T15:08:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe32f400700 1 -- 172.21.15.50:0/539117017 learned_addr learned my addr 172.21.15.50:0/539117017 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.617+0000 7fe32ea00700 1 --2- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3300b1910 0x7fe3300b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11180b3370 0x7f111816bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11180b3ab0 con 0x7f11181610c0 2024-09-13T15:08:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11180cd000 con 0x7f111806d3d0 2024-09-13T15:08:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11180b51a0 con 0x7f11180b3370 2024-09-13T15:08:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32f400700 1 -- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3300b1910 msgr2=0x7fe3300b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32f400700 1 --2- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3300b1910 0x7fe3300b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32f400700 1 -- 172.21.15.50:0/539117017 >> v1:172.21.15.181:6789/0 conn(0x7fe330070d50 legacy=0x7fe3300cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32f400700 1 -- 172.21.15.50:0/539117017 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300b22a0 con 0x7fe33014a540 2024-09-13T15:08:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1116a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11181610c0 0x7f1118066aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57398/0 (socket says 172.21.15.50:57398) 2024-09-13T15:08:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1116a00700 1 -- 172.21.15.50:0/61037575 learned_addr learned my addr 172.21.15.50:0/61037575 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb79a400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32f400700 1 --2- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe33014a540 0x7fe3300b3570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009910 tx=0x7fe31c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ccfd5a90e9fa88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb79a400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb78c0389f0 0x7fb78c0543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb79a400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c051a10 con 0x7fb78c051550 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb79a400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c0e1f10 con 0x7fb78c0389f0 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb79a400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c051cf0 con 0x7fb78c0e0ae0 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb792a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb78c051550 0x7fb78c0382e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57404/0 (socket says 172.21.15.50:57404) 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb792a00700 1 -- 172.21.15.50:0/2844704051 learned_addr learned my addr 172.21.15.50:0/2844704051 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32e000700 1 -- 172.21.15.50:0/539117017 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c004230 con 0x7fe33014a540 2024-09-13T15:08:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32e000700 1 -- 172.21.15.50:0/539117017 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c004390 con 0x7fe33014a540 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe32e000700 1 -- 172.21.15.50:0/539117017 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0036c0 con 0x7fe33014a540 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217982801 0 0) 0x7f11180b3ab0 con 0x7f11181610c0 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10fc0035d0 con 0x7f11181610c0 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117400700 1 --2- 172.21.15.50:0/61037575 >> v2:172.21.15.181:3300/0 conn(0x7f11180b3370 0x7f111816bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978172847 0 0) 0x7f11180cd000 con 0x7f111806d3d0 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11180b3ab0 con 0x7f111806d3d0 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b6800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff2a80524f0 0x7ff2a8007800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b6800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a8009040 con 0x7ff2a80382e0 2024-09-13T15:08:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b6800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a8009320 con 0x7ff2a800be50 2024-09-13T15:08:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b6800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a8009600 con 0x7ff2a80524f0 2024-09-13T15:08:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb793e00700 1 --2- 172.21.15.50:0/2844704051 >> v2:172.21.15.50:3300/0 conn(0x7fb78c0389f0 0x7fb78c0543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb792000700 1 -- 172.21.15.50:0/2844704051 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354751642 0 0) 0x7fb78c051a10 con 0x7fb78c051550 2024-09-13T15:08:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb792000700 1 -- 172.21.15.50:0/2844704051 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77c0035d0 con 0x7fb78c051550 2024-09-13T15:08:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fb793400700 1 --2- 172.21.15.50:0/2844704051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b4a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff2a80524f0 0x7ff2a8007800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b4a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff2a80524f0 0x7ff2a8007800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48860/0 (socket says 172.21.15.50:48860) 2024-09-13T15:08:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7ff2b4a00700 1 -- 172.21.15.50:0/3268668142 learned_addr learned my addr 172.21.15.50:0/3268668142 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117400700 1 -- 172.21.15.50:0/61037575 >> v1:172.21.15.181:6789/0 conn(0x7f111806d3d0 legacy=0x7f11180b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117400700 1 -- 172.21.15.50:0/61037575 >> v1:172.21.15.50:6789/0 conn(0x7f11181610c0 legacy=0x7f1118066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7f1117400700 1 -- 172.21.15.50:0/61037575 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180b3d00 con 0x7f11180b3370 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe335200700 1 -- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe33014a540 msgr2=0x7fe3300b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.621+0000 7fe335200700 1 --2- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe33014a540 0x7fe3300b3570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009910 tx=0x7fe31c009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 -- 172.21.15.50:0/539117017 shutdown_connections 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 --2- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3300b1910 0x7fe3300b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 --2- 172.21.15.50:0/539117017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe33014a540 0x7fe3300b3570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 -- 172.21.15.50:0/539117017 >> 172.21.15.50:0/539117017 conn(0x7fe33006a390 msgr2=0x7fe33006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb792000700 1 -- 172.21.15.50:0/2844704051 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659939790 0 0) 0x7fb77c0035d0 con 0x7fb78c051550 2024-09-13T15:08:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb793400700 1 -- 172.21.15.50:0/2844704051 >> v2:172.21.15.50:3300/0 conn(0x7fb78c0389f0 msgr2=0x7fb78c0543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb793400700 1 --2- 172.21.15.50:0/2844704051 >> v2:172.21.15.50:3300/0 conn(0x7fb78c0389f0 0x7fb78c0543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb793400700 1 -- 172.21.15.50:0/2844704051 >> v1:172.21.15.50:6789/0 conn(0x7fb78c051550 legacy=0x7fb78c0382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb793400700 1 -- 172.21.15.50:0/2844704051 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c051fd0 con 0x7fb78c0e0ae0 2024-09-13T15:08:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117400700 1 --2- 172.21.15.50:0/61037575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11180b3370 0x7f111816bc70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1108009850 tx=0x7f1108009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea4606e18dde388 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 -- 172.21.15.50:0/539117017 shutdown_connections 2024-09-13T15:08:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7ff2b4a00700 1 -- 172.21.15.50:0/3268668142 >> v1:172.21.15.181:6789/0 conn(0x7ff2a800be50 legacy=0x7ff2a800c230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:08:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7ff2b4a00700 1 -- 172.21.15.50:0/3268668142 >> v1:172.21.15.50:6789/0 conn(0x7ff2a80382e0 legacy=0x7ff2a8007d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7ff2b4a00700 1 -- 172.21.15.50:0/3268668142 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8050fc0 con 0x7ff2a80524f0 2024-09-13T15:08:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 Processor -- start 2024-09-13T15:08:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011830 con 0x7f11180b3370 2024-09-13T15:08:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1108011990 con 0x7f11180b3370 2024-09-13T15:08:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1115600700 1 -- 172.21.15.50:0/61037575 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011d40 con 0x7f11180b3370 2024-09-13T15:08:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb793400700 1 --2- 172.21.15.50:0/2844704051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0e19d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb788009840 tx=0x7fb788009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f4fade113036bed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 -- 172.21.15.50:0/61037575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11180b3370 msgr2=0x7f111816bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 --2- 172.21.15.50:0/61037575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11180b3370 0x7f111816bc70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1108009850 tx=0x7f1108009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:07.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 -- start start 2024-09-13T15:08:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 -- 172.21.15.50:0/539117017 wait complete. 2024-09-13T15:08:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 -- 172.21.15.50:0/61037575 shutdown_connections 2024-09-13T15:08:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 --2- 172.21.15.50:0/61037575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11180b3370 0x7f111816bc70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 -- 172.21.15.50:0/61037575 >> 172.21.15.50:0/61037575 conn(0x7f111806c8e0 msgr2=0x7f111806ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 -- 172.21.15.50:0/61037575 shutdown_connections 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1117e00700 1 -- 172.21.15.50:0/61037575 wait complete. 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7ff2b4a00700 1 --2- 172.21.15.50:0/3268668142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80524f0 0x7ff2a8007800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009940 tx=0x7ff29c009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321c684305912311 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb792000700 1 -- 172.21.15.50:0/2844704051 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780001670 con 0x7fb78c0e0ae0 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb792000700 1 -- 172.21.15.50:0/2844704051 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788004030 con 0x7fb78c0e0ae0 2024-09-13T15:08:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb792000700 1 -- 172.21.15.50:0/2844704051 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880043a0 con 0x7fb78c0e0ae0 2024-09-13T15:08:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1c941610c0 0x7f1c94066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 Processor -- start 2024-09-13T15:08:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 0x7f1c940cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940b3ab0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c940b51a0 con 0x7f1c941610c0 2024-09-13T15:08:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c99800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c94066fe0 con 0x7f1c940b3370 2024-09-13T15:08:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fe335200700 1 -- start start 2024-09-13T15:08:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c93400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 0x7f1c940cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c93400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 0x7f1c940cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35830/0 (socket says 172.21.15.50:35830) 2024-09-13T15:08:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7f1c93400700 1 -- 172.21.15.50:0/3165395111 learned_addr learned my addr 172.21.15.50:0/3165395111 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1c92a00700 1 --2- 172.21.15.50:0/3165395111 >> v2:172.21.15.181:3300/0 conn(0x7f1c941610c0 0x7f1c94066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1c93400700 1 -- 172.21.15.50:0/3165395111 >> v2:172.21.15.181:3300/0 conn(0x7f1c941610c0 msgr2=0x7f1c94066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1c93400700 1 --2- 172.21.15.50:0/3165395111 >> v2:172.21.15.181:3300/0 conn(0x7f1c941610c0 0x7f1c94066aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1c93400700 1 -- 172.21.15.50:0/3165395111 >> v1:172.21.15.50:6789/0 conn(0x7f1c9406d3d0 legacy=0x7f1c940b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 Processor -- start 2024-09-13T15:08:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1c93400700 1 -- 172.21.15.50:0/3165395111 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940cd000 con 0x7f1c940b3370 2024-09-13T15:08:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7ff2afe00700 1 -- 172.21.15.50:0/3268668142 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004230 con 0x7ff2a80524f0 2024-09-13T15:08:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7ff2afe00700 1 -- 172.21.15.50:0/3268668142 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c009e90 con 0x7ff2a80524f0 2024-09-13T15:08:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7ff2afe00700 1 -- 172.21.15.50:0/3268668142 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0045b0 con 0x7ff2a80524f0 2024-09-13T15:08:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb79a400700 1 -- 172.21.15.50:0/2844704051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 msgr2=0x7fb78c0e19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.625+0000 7fb79a400700 1 --2- 172.21.15.50:0/2844704051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0e19d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb788009840 tx=0x7fb788009b50 comp rx=0 tx=0).stop 2024-09-13T15:08:07.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe335200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe330070d50 0x7fe3301463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe335200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3300b1910 0x7fe3300a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe335200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33014a540 0x7fe33015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 -- start start 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 -- 172.21.15.50:0/2844704051 shutdown_connections 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 --2- 172.21.15.50:0/2844704051 >> v2:172.21.15.50:3300/0 conn(0x7fb78c0389f0 0x7fb78c0543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 --2- 172.21.15.50:0/2844704051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0e19d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 -- 172.21.15.50:0/2844704051 >> 172.21.15.50:0/2844704051 conn(0x7fb78c056860 msgr2=0x7fb78c056c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 -- 172.21.15.50:0/2844704051 shutdown_connections 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 -- 172.21.15.50:0/2844704051 wait complete. 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3300b1910 0x7fe3300a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3300b1910 0x7fe3300a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48880/0 (socket says 172.21.15.50:48880) 2024-09-13T15:08:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f542f200700 1 Processor -- start 2024-09-13T15:08:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fd3e8400700 1 Processor -- start 2024-09-13T15:08:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fd3e8400700 1 -- start start 2024-09-13T15:08:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1117e00700 1 Processor -- start 2024-09-13T15:08:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 -- 172.21.15.50:0/1235887332 learned_addr learned my addr 172.21.15.50:0/1235887332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe330160900 con 0x7fe33014a540 2024-09-13T15:08:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe330160620 con 0x7fe3300b1910 2024-09-13T15:08:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300abdb0 con 0x7fe330070d50 2024-09-13T15:08:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32f400700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe330070d50 0x7fe3301463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32fe00700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33014a540 0x7fe33015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1117e00700 1 -- start start 2024-09-13T15:08:07.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7ff2b6800700 1 -- 172.21.15.50:0/3268668142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80524f0 msgr2=0x7ff2a8007800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7ff2b6800700 1 --2- 172.21.15.50:0/3268668142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80524f0 0x7ff2a8007800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009940 tx=0x7ff29c009c50 comp rx=0 tx=0).stop 2024-09-13T15:08:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75b80cece0 0x7f75b809bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f75b80b5cd0 0x7f75b80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f1c93400700 1 --2- 172.21.15.50:0/3165395111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 0x7f1c940cd4c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009910 tx=0x7f1c8c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b113588c95ea40f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c91600700 1 -- 172.21.15.50:0/3165395111 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c004230 con 0x7f1c940b3370 2024-09-13T15:08:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c91600700 1 -- 172.21.15.50:0/3165395111 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c004390 con 0x7f1c940b3370 2024-09-13T15:08:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c91600700 1 -- 172.21.15.50:0/3165395111 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c009e60 con 0x7f1c940b3370 2024-09-13T15:08:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7ff2b6800700 1 -- 172.21.15.50:0/3268668142 shutdown_connections 2024-09-13T15:08:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7ff2b6800700 1 --2- 172.21.15.50:0/3268668142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80524f0 0x7ff2a8007800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7ff2b6800700 1 -- 172.21.15.50:0/3268668142 >> 172.21.15.50:0/3268668142 conn(0x7ff2a8056860 msgr2=0x7ff2a8056c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fb79a400700 1 Processor -- start 2024-09-13T15:08:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 -- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe330070d50 msgr2=0x7fe3301463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe330070d50 0x7fe3301463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 -- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33014a540 msgr2=0x7fe33015fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe33014a540 0x7fe33015fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7fe32ea00700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c009570 con 0x7fe3300b1910 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fe32ea00700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3300b1910 0x7fe3300a94d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e9d0 tx=0x7fe32000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000c850 con 0x7fe3300b1910 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000c9b0 con 0x7fe3300b1910 2024-09-13T15:08:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f111806d3d0 0x7f111814af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b806ae30 con 0x7f75b80cf0c0 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80d2cd0 con 0x7f75b80cece0 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bfc00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b809b870 con 0x7f75b80b5cd0 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bd200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75b80cece0 0x7f75b809bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bd200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75b80cece0 0x7f75b809bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58042/0 (socket says 172.21.15.50:58042) 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bd200700 1 -- 172.21.15.50:0/3714855503 learned_addr learned my addr 172.21.15.50:0/3714855503 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f75bdc00700 1 --2- 172.21.15.50:0/3714855503 >> v2:172.21.15.181:3300/0 conn(0x7f75b80b5cd0 0x7f75b80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75bdc00700 1 -- 172.21.15.50:0/3714855503 >> v2:172.21.15.50:3300/0 conn(0x7f75b80cece0 msgr2=0x7f75b809bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75bdc00700 1 --2- 172.21.15.50:0/3714855503 >> v2:172.21.15.50:3300/0 conn(0x7f75b80cece0 0x7f75b809bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75bdc00700 1 -- 172.21.15.50:0/3714855503 >> v1:172.21.15.50:6789/0 conn(0x7f75b80cf0c0 legacy=0x7f75b806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.629+0000 7f542f200700 1 -- start start 2024-09-13T15:08:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542f200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f54301610b0 0x7f54300719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000cd20 con 0x7fe3300b1910 2024-09-13T15:08:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 -- 172.21.15.50:0/3165395111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 msgr2=0x7f1c940cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 --2- 172.21.15.50:0/3165395111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 0x7f1c940cd4c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009910 tx=0x7f1c8c009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7ff2b6800700 1 -- 172.21.15.50:0/3268668142 shutdown_connections 2024-09-13T15:08:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 -- start start 2024-09-13T15:08:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78c0389f0 0x7fb78c04d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb78c051550 0x7fb78c0398b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb793400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78c0389f0 0x7fb78c04d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3300ac090 con 0x7fe3300b1910 2024-09-13T15:08:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11180b3370 0x7f1118162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11181610c0 0x7f11181573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f111806d3d0 0x7f111814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f111806d3d0 0x7f111814af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58054/0 (socket says 172.21.15.50:58054) 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111815afe0 con 0x7f111806d3d0 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11180b3370 0x7f1118162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11180b3370 0x7f1118162a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35846/0 (socket says 172.21.15.50:35846) 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 -- 172.21.15.50:0/2178589225 learned_addr learned my addr 172.21.15.50:0/2178589225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111814b4a0 con 0x7f11181610c0 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111815a460 con 0x7f11180b3370 2024-09-13T15:08:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542de00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f54301610b0 0x7f54300719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542de00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f54301610b0 0x7f54300719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48898/0 (socket says 172.21.15.50:48898) 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542de00700 1 -- 172.21.15.50:0/1790553215 learned_addr learned my addr 172.21.15.50:0/1790553215 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54300b3560 con 0x7f543006aaa0 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54300b3280 con 0x7f54300b2d80 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5430070b30 con 0x7f54301610b0 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb793400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78c0389f0 0x7fb78c04d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48914/0 (socket says 172.21.15.50:48914) 2024-09-13T15:08:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1117400700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11181610c0 0x7f11181573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb793400700 1 -- 172.21.15.50:0/3064237390 learned_addr learned my addr 172.21.15.50:0/3064237390 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c04d560 con 0x7fb78c051550 2024-09-13T15:08:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75bdc00700 1 -- 172.21.15.50:0/3714855503 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b809af40 con 0x7f75b80b5cd0 2024-09-13T15:08:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c03c700 con 0x7fb78c0389f0 2024-09-13T15:08:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c04af90 con 0x7fb78c0e0ae0 2024-09-13T15:08:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe330146920 con 0x7fe3300b1910 2024-09-13T15:08:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb793e00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75bdc00700 1 --2- 172.21.15.50:0/3714855503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80b5cd0 0x7f75b80b6120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f75b808c0f0 tx=0x7f75b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=310b3ed4ee67de2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7ff2b6800700 1 -- 172.21.15.50:0/3268668142 wait complete. 2024-09-13T15:08:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb792a00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb78c051550 0x7fb78c0398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e8400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd3e006a5a0 0x7fd3e006fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e8400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 0x7fd3e0160d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e8400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e0070360 con 0x7fd3e015d3d0 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e8400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e015d8d0 con 0x7fd3e006a5a0 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e8400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e015dbb0 con 0x7fd3e00add30 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 -- 172.21.15.50:0/3165395111 shutdown_connections 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 --2- 172.21.15.50:0/3165395111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c940b3370 0x7f1c940cd4c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 --2- 172.21.15.50:0/3165395111 >> v2:172.21.15.181:3300/0 conn(0x7f1c941610c0 0x7f1c94066aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 -- 172.21.15.50:0/3165395111 >> 172.21.15.50:0/3165395111 conn(0x7f1c9406c8e0 msgr2=0x7f1c9406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 -- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11181610c0 msgr2=0x7f11181573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11181610c0 0x7f11181573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 -- 172.21.15.50:0/2178589225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f111806d3d0 msgr2=0x7f111814af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f111806d3d0 0x7f111814af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11080094b0 con 0x7f11180b3370 2024-09-13T15:08:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 -- 172.21.15.50:0/3165395111 shutdown_connections 2024-09-13T15:08:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb793400700 1 -- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 msgr2=0x7fb78c0345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542ca00700 1 -- 172.21.15.50:0/1790553215 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451143567 0 0) 0x7f54300b3560 con 0x7f543006aaa0 2024-09-13T15:08:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542ca00700 1 -- 172.21.15.50:0/1790553215 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54140035d0 con 0x7f543006aaa0 2024-09-13T15:08:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1c99800700 1 -- 172.21.15.50:0/3165395111 wait complete. 2024-09-13T15:08:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e5000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd3e015d3d0 0x7fd3e006a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57442/0 (socket says 172.21.15.50:57442) 2024-09-13T15:08:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fd3e5000700 1 -- 172.21.15.50:0/1980068257 learned_addr learned my addr 172.21.15.50:0/1980068257 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542de00700 1 -- 172.21.15.50:0/1790553215 >> v1:172.21.15.181:6789/0 conn(0x7f54300b2d80 legacy=0x7f54300cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542de00700 1 -- 172.21.15.50:0/1790553215 >> v1:172.21.15.50:6789/0 conn(0x7f543006aaa0 legacy=0x7f54300b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f1116000700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11180b3370 0x7f1118162a70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f110400c730 tx=0x7f110400caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75b7400700 1 -- 172.21.15.50:0/3714855503 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b000e070 con 0x7f75b80b5cd0 2024-09-13T15:08:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7fb793400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb793400700 1 -- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb78c051550 msgr2=0x7fb78c0398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb793400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb78c051550 0x7fb78c0398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb793400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788009450 con 0x7fb78c0389f0 2024-09-13T15:08:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb793e00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78c0e0ae0 0x7fb78c0345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75b7400700 1 -- 172.21.15.50:0/3714855503 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000bbd0 con 0x7f75b80b5cd0 2024-09-13T15:08:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f75b7400700 1 -- 172.21.15.50:0/3714855503 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0012430 con 0x7f75b80b5cd0 2024-09-13T15:08:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.633+0000 7f542de00700 1 -- 172.21.15.50:0/1790553215 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430070ee0 con 0x7f54301610b0 2024-09-13T15:08:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040052d0 con 0x7f11180b3370 2024-09-13T15:08:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe320013470 con 0x7fe3300b1910 2024-09-13T15:08:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111815a740 con 0x7f11180b3370 2024-09-13T15:08:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111815ad00 con 0x7f11180b3370 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 -- 172.21.15.50:0/3714855503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80b5cd0 msgr2=0x7f75b80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 --2- 172.21.15.50:0/3714855503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80b5cd0 0x7f75b80b6120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f75b808c0f0 tx=0x7f75b000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 -- 172.21.15.50:0/3714855503 shutdown_connections 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 --2- 172.21.15.50:0/3714855503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80b5cd0 0x7f75b80b6120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 --2- 172.21.15.50:0/3714855503 >> v2:172.21.15.50:3300/0 conn(0x7f75b80cece0 0x7f75b809bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 -- 172.21.15.50:0/3714855503 >> 172.21.15.50:0/3714855503 conn(0x7f75b80d2e80 msgr2=0x7f75b80d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f542de00700 1 --2- 172.21.15.50:0/1790553215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54301610b0 0x7f54300719c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5420009940 tx=0x7f5420009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5700cf1e10399883 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f542ca00700 1 -- 172.21.15.50:0/1790553215 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420004230 con 0x7f54301610b0 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187396448 0 0) 0x7fd3e0070360 con 0x7fd3e015d3d0 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c80035d0 con 0x7fd3e015d3d0 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3e6400700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 0x7fd3e0160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642222537 0 0) 0x7fd3c80035d0 con 0x7fd3e015d3d0 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 msgr2=0x7fd3e0160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 0x7fd3e0160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 >> v2:172.21.15.181:3300/0 conn(0x7fd3e006a5a0 msgr2=0x7fd3e006fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 --2- 172.21.15.50:0/1980068257 >> v2:172.21.15.181:3300/0 conn(0x7fd3e006a5a0 0x7fd3e006fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e015de90 con 0x7fd3e015d3d0 2024-09-13T15:08:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fd3cc001670 con 0x7fd3e015d3d0 2024-09-13T15:08:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 >> v1:172.21.15.50:6789/0 conn(0x7fd3e015d3d0 legacy=0x7fd3e006a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3c8003a20 0x7fd3c8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb793400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78c0389f0 0x7fb78c04d020 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7880046d0 tx=0x7fb788004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3300b2d70 con 0x7fe3300b1910 2024-09-13T15:08:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 0x7fd3c8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104005430 con 0x7f11180b3370 2024-09-13T15:08:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040052d0 con 0x7f11180b3370 2024-09-13T15:08:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10f0000fc0 con 0x7f11180b3370 2024-09-13T15:08:07.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3c8005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788003b00 con 0x7fb78c0389f0 2024-09-13T15:08:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c03c420 con 0x7fb78c0389f0 2024-09-13T15:08:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e015d8d0 con 0x7fd3c8003a20 2024-09-13T15:08:07.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c04ac20 con 0x7fb78c0389f0 2024-09-13T15:08:07.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe327400700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe310066730 0x7fe310068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e015dbb0 con 0x7fd3c8004e00 2024-09-13T15:08:07.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788020070 con 0x7fb78c0389f0 2024-09-13T15:08:07.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c800bc90 con 0x7fd3e00add30 2024-09-13T15:08:07.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3200846d0 con 0x7fe3300b1910 2024-09-13T15:08:07.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f1c99800700 1 Processor -- start 2024-09-13T15:08:07.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7ff2b6800700 1 Processor -- start 2024-09-13T15:08:07.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f542ca00700 1 -- 172.21.15.50:0/1790553215 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420004390 con 0x7f54301610b0 2024-09-13T15:08:07.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f542ca00700 1 -- 172.21.15.50:0/1790553215 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200036c0 con 0x7f54301610b0 2024-09-13T15:08:07.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f1c99800700 1 -- start start 2024-09-13T15:08:07.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 -- 172.21.15.50:0/3714855503 shutdown_connections 2024-09-13T15:08:07.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7f75bfc00700 1 -- 172.21.15.50:0/3714855503 wait complete. 2024-09-13T15:08:07.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3e5000700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 0x7fd3c8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe327400700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7fe31006fcf0 0x7fe310072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe310072800 con 0x7fe31006fcf0 2024-09-13T15:08:07.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3e6400700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3c8005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe320086cb0 con 0x7fe3300b1910 2024-09-13T15:08:07.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788003b00 con 0x7fb78c0389f0 2024-09-13T15:08:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb770000fc0 con 0x7fb78c0389f0 2024-09-13T15:08:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fe32f400700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe310066730 0x7fe310068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.637+0000 7fd3e5a00700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3c8003a20 0x7fd3c8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54301610b0 msgr2=0x7f54300719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 --2- 172.21.15.50:0/1790553215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54301610b0 0x7f54300719c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5420009940 tx=0x7f5420009c50 comp rx=0 tx=0).stop 2024-09-13T15:08:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 Processor -- start 2024-09-13T15:08:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 -- start start 2024-09-13T15:08:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c99800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9406d3d0 0x7f1c941fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 shutdown_connections 2024-09-13T15:08:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 --2- 172.21.15.50:0/1790553215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54301610b0 0x7f54300719c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 >> 172.21.15.50:0/1790553215 conn(0x7f54300b0c40 msgr2=0x7f543006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 -- start start 2024-09-13T15:08:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 shutdown_connections 2024-09-13T15:08:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b80b5cd0 0x7f75b80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11040036a0 con 0x7f11180b3370 2024-09-13T15:08:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80cece0 0x7f75b80b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b80cf0c0 0x7f75b81f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80b1500 con 0x7f75b80b5cd0 2024-09-13T15:08:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80ca8e0 con 0x7f75b80cece0 2024-09-13T15:08:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bfc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80c9ff0 con 0x7f75b80cf0c0 2024-09-13T15:08:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fe32fe00700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7fe31006fcf0 0x7fe310072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fd3e6400700 1 -- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 msgr2=0x7fd3c8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a800be50 0x7ff2a80e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fd3e6400700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e00add30 0x7fd3c8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b80cf0c0 0x7f75b81f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b80cf0c0 0x7f75b81f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35884/0 (socket says 172.21.15.50:35884) 2024-09-13T15:08:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 -- 172.21.15.50:0/2496711886 learned_addr learned my addr 172.21.15.50:0/2496711886 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fd3e6400700 1 -- 172.21.15.50:0/1980068257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3c8003a20 msgr2=0x7fd3c8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f542f200700 1 -- 172.21.15.50:0/1790553215 wait complete. 2024-09-13T15:08:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb788022030 con 0x7fb78c0389f0 2024-09-13T15:08:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c99800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c940b3370 0x7f1c94163680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c99800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c941610c0 0x7f1c94163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c99800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c941ffd00 con 0x7f1c941610c0 2024-09-13T15:08:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c99800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c94162560 con 0x7f1c940b3370 2024-09-13T15:08:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fd3e6400700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3c8003a20 0x7fd3c8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c99800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c941fcc40 con 0x7f1c9406d3d0 2024-09-13T15:08:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75b7e00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80cece0 0x7f75b80b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fe32f400700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe310066730 0x7fe310068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009910 tx=0x7fe31c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c92a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9406d3d0 0x7f1c941fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c92a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9406d3d0 0x7f1c941fc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35900/0 (socket says 172.21.15.50:35900) 2024-09-13T15:08:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c92a00700 1 -- 172.21.15.50:0/1881380538 learned_addr learned my addr 172.21.15.50:0/1881380538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 -- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80cece0 msgr2=0x7f75b80b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f110ea00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10f8066790 0x7f10f8068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b80cece0 0x7f75b80b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 -- 172.21.15.50:0/2496711886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b80b5cd0 msgr2=0x7f75b80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b80b5cd0 0x7f75b80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f75bdc00700 1 -- 172.21.15.50:0/2496711886 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0009a70 con 0x7f75b80cf0c0 2024-09-13T15:08:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fd3e6400700 1 -- 172.21.15.50:0/1980068257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e015de90 con 0x7fd3c8004e00 2024-09-13T15:08:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80382e0 0x7ff2a804fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2a80524f0 0x7ff2a80501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80e54a0 con 0x7ff2a800be50 2024-09-13T15:08:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a803b870 con 0x7ff2a80382e0 2024-09-13T15:08:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7ff2b6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a803bb50 con 0x7ff2a80524f0 2024-09-13T15:08:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7fd3e5a00700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3c8003a20 0x7fd3c8003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1104084220 con 0x7f11180b3370 2024-09-13T15:08:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1116a00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10f8066790 0x7f10f8068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.641+0000 7f1c92000700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c940b3370 0x7f1c94163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c92a00700 1 -- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c940b3370 msgr2=0x7f1c94163680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb787400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb774066790 0x7fb774068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c92a00700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c940b3370 0x7f1c94163680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c92a00700 1 -- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c941610c0 msgr2=0x7f1c94163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c92a00700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c941610c0 0x7f1c94163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c92a00700 1 -- 172.21.15.50:0/1881380538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c009570 con 0x7f1c9406d3d0 2024-09-13T15:08:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a800be50 0x7ff2a80e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a800be50 0x7ff2a80e3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58102/0 (socket says 172.21.15.50:58102) 2024-09-13T15:08:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 -- 172.21.15.50:0/586031272 learned_addr learned my addr 172.21.15.50:0/586031272 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5e00700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2a80524f0 0x7ff2a80501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb788085b60 con 0x7fb78c0389f0 2024-09-13T15:08:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f110ea00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f10f806fdd0 0x7f10f8072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75bdc00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b80cf0c0 0x7f75b81f6600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75b0014040 tx=0x7f75b0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10f80728e0 con 0x7f10f806fdd0 2024-09-13T15:08:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0004830 con 0x7f75b80cf0c0 2024-09-13T15:08:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb787400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7fb77406fcd0 0x7fb774072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11040845d0 con 0x7f11180b3370 2024-09-13T15:08:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7740727e0 con 0x7fb77406fcd0 2024-09-13T15:08:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb788085fb0 con 0x7fb78c0389f0 2024-09-13T15:08:07.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f542f200700 1 Processor -- start 2024-09-13T15:08:07.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fd3e6400700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3c8005280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8007f60 tx=0x7fd3c80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7765b8d690fef438 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1117400700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f10f806fdd0 0x7f10f8072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c92a00700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9406d3d0 0x7f1c941fc700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c84007e60 tx=0x7f1c8400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0020070 con 0x7f75b80cf0c0 2024-09-13T15:08:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b00276c0 con 0x7f75b80cf0c0 2024-09-13T15:08:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f542f200700 1 -- start start 2024-09-13T15:08:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b80b2dc0 con 0x7f75b80cf0c0 2024-09-13T15:08:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 -- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2a80524f0 msgr2=0x7ff2a80501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2a80524f0 0x7ff2a80501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 -- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80382e0 msgr2=0x7ff2a804fc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:08:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2a80382e0 0x7ff2a804fc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400eea0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 -- 172.21.15.50:0/586031272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009570 con 0x7ff2a800be50 2024-09-13T15:08:07.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fe32fe00700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7fe31006fcf0 0x7fe310072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84014420 con 0x7f1c9406d3d0 2024-09-13T15:08:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840147b0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c941641f0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1116a00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10f8066790 0x7f10f8068c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11100012e0 tx=0x7f1110009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb792a00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb774066790 0x7fb774068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c941ff640 con 0x7f1c9406d3d0 2024-09-13T15:08:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2b5400700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a800be50 0x7ff2a80e3ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400b550 tx=0x7ff2a400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f1117400700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f10f806fdd0 0x7f10f8072210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b80ca570 con 0x7f75b80cf0c0 2024-09-13T15:08:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb793e00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7fb77406fcd0 0x7fb774072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fb792a00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb774066790 0x7fb774068c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb78c17fd50 tx=0x7fb780007bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80079d0 con 0x7fd3c8004e00 2024-09-13T15:08:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d800cde0 con 0x7fd3c8004e00 2024-09-13T15:08:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fd3dfe00700 1 -- 172.21.15.50:0/1980068257 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80176c0 con 0x7fd3c8004e00 2024-09-13T15:08:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4005a70 con 0x7ff2a800be50 2024-09-13T15:08:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f542f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f543006aaa0 0x7f543014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== osd.3 v2:172.21.15.50:6821/2543403071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe310072800 con 0x7fe31006fcf0 2024-09-13T15:08:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75b80b7d20 con 0x7f75b80cf0c0 2024-09-13T15:08:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.645+0000 7f542f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54300b2d80 0x7f5430158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f543006aaa0 0x7f543014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f543006aaa0 0x7f543014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48956/0 (socket says 172.21.15.50:48956) 2024-09-13T15:08:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 -- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 msgr2=0x7fd3c8005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 --2- 172.21.15.50:0/1980068257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3c8005280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8007f60 tx=0x7fd3c80058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4005bf0 con 0x7ff2a800be50 2024-09-13T15:08:07.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== osd.4 v2:172.21.15.181:6816/2078065177 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f10f80728e0 con 0x7f10f806fdd0 2024-09-13T15:08:07.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54300b2d80 0x7f5430158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54300b2d80 0x7f5430158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58124/0 (socket says 172.21.15.50:58124) 2024-09-13T15:08:07.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542d400700 1 -- 172.21.15.50:0/2516469190 learned_addr learned my addr 172.21.15.50:0/2516469190 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4011630 con 0x7ff2a800be50 2024-09-13T15:08:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fb793e00700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7fb77406fcd0 0x7fb774072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542f200700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54301610b0 0x7f543015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e6400700 1 -- 172.21.15.50:0/1980068257 reap_dead start 2024-09-13T15:08:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 -- 172.21.15.50:0/1980068257 shutdown_connections 2024-09-13T15:08:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 -- 172.21.15.50:0/1980068257 >> 172.21.15.50:0/1980068257 conn(0x7fd3e00b06f0 msgr2=0x7fd3e00b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a803be30 con 0x7ff2a800be50 2024-09-13T15:08:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a804dc20 con 0x7ff2a800be50 2024-09-13T15:08:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 -- 172.21.15.50:0/1980068257 shutdown_connections 2024-09-13T15:08:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 -- 172.21.15.50:0/1980068257 wait complete. 2024-09-13T15:08:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2a80ea9d0 con 0x7ff2a800be50 2024-09-13T15:08:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542f200700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543014ef80 con 0x7f54300b2d80 2024-09-13T15:08:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542f200700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301f6e80 con 0x7f543006aaa0 2024-09-13T15:08:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542f200700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54301596b0 con 0x7f54301610b0 2024-09-13T15:08:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542e800700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54301610b0 0x7f543015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c6c000fc0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 -- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54301610b0 msgr2=0x7f543015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54301610b0 0x7f543015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 -- 172.21.15.50:0/2516469190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54300b2d80 msgr2=0x7f5430158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54300b2d80 0x7f5430158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f542de00700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009570 con 0x7f543006aaa0 2024-09-13T15:08:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c84014910 con 0x7f1c9406d3d0 2024-09-13T15:08:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fd3e8400700 1 Processor -- start 2024-09-13T15:08:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.649+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== osd.2 v2:172.21.15.50:6809/1292655960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb7740727e0 con 0x7fb77406fcd0 2024-09-13T15:08:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f542de00700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f543006aaa0 0x7f543014ea40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5420015000 tx=0x7f5420004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f1c8aa00700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c70066780 0x7f1c70068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c84084ad0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420003ea0 con 0x7f543006aaa0 2024-09-13T15:08:07.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e8400700 1 -- start start 2024-09-13T15:08:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420011630 con 0x7f543006aaa0 2024-09-13T15:08:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f1c8aa00700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7f1c7006fdc0 0x7f1c70072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 --> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c700728d0 con 0x7f1c7006fdc0 2024-09-13T15:08:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c840892c0 con 0x7f1c9406d3d0 2024-09-13T15:08:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200119e0 con 0x7f543006aaa0 2024-09-13T15:08:07.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e8400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3e00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f542f200700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5430159990 con 0x7f543006aaa0 2024-09-13T15:08:07.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e8400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e0155cd0 0x7fd3e0155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75b0012430 con 0x7f75b80cf0c0 2024-09-13T15:08:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f542f200700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5430161b10 con 0x7f543006aaa0 2024-09-13T15:08:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e8400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3e015aa40 0x7fd3e015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e5a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3e00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e5a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3e00ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48964/0 (socket says 172.21.15.50:48964) 2024-09-13T15:08:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e5000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e0155cd0 0x7fd3e0155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e5000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e0155cd0 0x7fd3e0155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35930/0 (socket says 172.21.15.50:35930) 2024-09-13T15:08:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2a4011790 con 0x7ff2a800be50 2024-09-13T15:08:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7ff2ad600700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff290066730 0x7ff290068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2a4084040 con 0x7ff2a800be50 2024-09-13T15:08:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7ff2ad600700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7ff29006fcf0 0x7ff290072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 --> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff290072800 con 0x7ff29006fcf0 2024-09-13T15:08:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e6400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3e015aa40 0x7fd3e015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e6400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3e015aa40 0x7fd3e015aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58134/0 (socket says 172.21.15.50:58134) 2024-09-13T15:08:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7fd3e5a00700 1 -- 172.21.15.50:0/68347730 learned_addr learned my addr 172.21.15.50:0/68347730 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5430071f00 con 0x7f543006aaa0 2024-09-13T15:08:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f1c92000700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c70066780 0x7f1c70068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f1c93400700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7f1c7006fdc0 0x7f1c70072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2a4009340 con 0x7ff2a800be50 2024-09-13T15:08:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7ff2b5e00700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7ff29006fcf0 0x7ff290072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.653+0000 7f75b4c00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7598066830 0x7f7598068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75bd200700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7598066830 0x7f7598068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7fd3e8400700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e015b400 con 0x7fd3e015aa40 2024-09-13T15:08:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7fd3e8400700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e015f1d0 con 0x7fd3c8004e00 2024-09-13T15:08:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7ff2b4a00700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff290066730 0x7ff290068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7ff2b5e00700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7ff29006fcf0 0x7ff290072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75b0022070 con 0x7f75b80cf0c0 2024-09-13T15:08:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75bd200700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7598066830 0x7f7598068cf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009830 tx=0x7f75ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75b4c00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f759806fe70 0x7f75980722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 --> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7598072980 con 0x7f759806fe70 2024-09-13T15:08:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75b0086a60 con 0x7f75b80cf0c0 2024-09-13T15:08:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5420011b40 con 0x7f543006aaa0 2024-09-13T15:08:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7fd3e8400700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e015e450 con 0x7fd3e0155cd0 2024-09-13T15:08:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f1c92000700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c70066780 0x7f1c70068c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c94158650 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f1c93400700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7f1c7006fdc0 0x7f1c70072200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f75b7e00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f759806fe70 0x7f75980722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f5426000700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5410066830 0x7f5410068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5420085d30 con 0x7f543006aaa0 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f5426000700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7f541006fe70 0x7f54100722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5410072980 con 0x7f541006fe70 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54200882f0 con 0x7f543006aaa0 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7f542d400700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5410066830 0x7f5410068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e5000700 1 -- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 msgr2=0x7fd3e00ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.657+0000 7ff2b4a00700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff290066730 0x7ff290068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8000f60 tx=0x7ff29c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e5000700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c8004e00 0x7fd3e00ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e5000700 1 -- 172.21.15.50:0/68347730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3e015aa40 msgr2=0x7fd3e015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== osd.1 v2:172.21.15.50:6808/2789289607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff290072800 con 0x7ff29006fcf0 2024-09-13T15:08:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7f75b7e00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f759806fe70 0x7f75980722b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e5000700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3e015aa40 0x7fd3e015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7f542d400700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5410066830 0x7f5410068cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5430163420 tx=0x7f541c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e5000700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e015e730 con 0x7fd3e0155cd0 2024-09-13T15:08:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== osd.0 v2:172.21.15.50:6800/2782884030 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1c700728d0 con 0x7f1c7006fdc0 2024-09-13T15:08:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== osd.5 v2:172.21.15.181:6824/1243766751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7598072980 con 0x7f759806fe70 2024-09-13T15:08:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7f542e800700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7f541006fe70 0x7f54100722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e5000700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e0155cd0 0x7fd3e0155400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3e015d800 tx=0x7fd3cc0075c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00f600 con 0x7fd3e0155cd0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00f760 con 0x7fd3e0155cd0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e8400700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e015ea10 con 0x7fd3e0155cd0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3e8400700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e01564c0 con 0x7fd3e0155cd0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.661+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00fb10 con 0x7fd3e0155cd0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.665+0000 7f542e800700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7f541006fe70 0x7f54100722b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.665+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== osd.6 v2:172.21.15.181:6800/89220898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5410072980 con 0x7f541006fe70 2024-09-13T15:08:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.665+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3b4000fc0 con 0x7fd3e0155cd0 2024-09-13T15:08:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.669+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3cc00fc70 con 0x7fd3e0155cd0 2024-09-13T15:08:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.669+0000 7fd3dd600700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd3c0066800 0x7fd3c0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.669+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3cc0843d0 con 0x7fd3e0155cd0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.669+0000 7fd3dd600700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fd3c006fdc0 0x7fd3c0072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.669+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3c00728d0 con 0x7fd3c006fdc0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.669+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3cc051440 con 0x7fd3e0155cd0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7fd3e5a00700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd3c0066800 0x7fd3c0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7fd3e6400700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fd3c006fdc0 0x7fd3c0072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7fd3e6400700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fd3c006fdc0 0x7fd3c0072200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7fd3e5a00700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd3c0066800 0x7fd3c0068cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4004650 tx=0x7fd3d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 --> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10f0002d60 con 0x7f10f806fdd0 2024-09-13T15:08:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== osd.7 v2:172.21.15.181:6808/2747791304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd3c00728d0 con 0x7fd3c006fdc0 2024-09-13T15:08:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.673+0000 7f110ea00700 1 -- 172.21.15.50:0/2178589225 <== osd.4 v2:172.21.15.181:6816/2078065177 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f10f0002d60 con 0x7f10f806fdd0 2024-09-13T15:08:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.677+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 --> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3300b2a90 con 0x7fe31006fcf0 2024-09-13T15:08:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.677+0000 7fe327400700 1 -- 172.21.15.50:0/1235887332 <== osd.3 v2:172.21.15.50:6821/2543403071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe328005620 con 0x7fe31006fcf0 2024-09-13T15:08:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f10f806fdd0 msgr2=0x7f10f8072210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f10f806fdd0 0x7f10f8072210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7fe31006fcf0 msgr2=0x7fe310072130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10f8066790 msgr2=0x7f10f8068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f10f8066790 0x7f10f8068c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11100012e0 tx=0x7f1110009040 comp rx=0 tx=0).stop 2024-09-13T15:08:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11180b3370 msgr2=0x7f1118162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 --2- 172.21.15.50:0/2178589225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f11180b3370 0x7f1118162a70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f110400c730 tx=0x7f110400caf0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7fe31006fcf0 0x7fe310072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe310066730 msgr2=0x7fe310068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117400700 1 -- 172.21.15.50:0/2178589225 reap_dead start 2024-09-13T15:08:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe310066730 0x7fe310068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009910 tx=0x7fe31c008030 comp rx=0 tx=0).stop 2024-09-13T15:08:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3300b1910 msgr2=0x7fe3300a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 --2- 172.21.15.50:0/1235887332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3300b1910 0x7fe3300a94d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e9d0 tx=0x7fe32000ed90 comp rx=0 tx=0).stop 2024-09-13T15:08:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe32fe00700 1 -- 172.21.15.50:0/1235887332 reap_dead start 2024-09-13T15:08:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 shutdown_connections 2024-09-13T15:08:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 >> 172.21.15.50:0/2178589225 conn(0x7f111806c8e0 msgr2=0x7f111815f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 shutdown_connections 2024-09-13T15:08:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 >> 172.21.15.50:0/1235887332 conn(0x7fe33006a390 msgr2=0x7fe3300ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 shutdown_connections 2024-09-13T15:08:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7f1117e00700 1 -- 172.21.15.50:0/2178589225 wait complete. 2024-09-13T15:08:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 shutdown_connections 2024-09-13T15:08:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fe335200700 1 -- 172.21.15.50:0/1235887332 wait complete. 2024-09-13T15:08:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.681+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb770002d60 con 0x7fb77406fcd0 2024-09-13T15:08:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.685+0000 7fb787400700 1 -- 172.21.15.50:0/3064237390 <== osd.2 v2:172.21.15.50:6809/1292655960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb770002d60 con 0x7fb77406fcd0 2024-09-13T15:08:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.685+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7fb77406fcd0 msgr2=0x7fb774072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.685+0000 7fb79a400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7fb77406fcd0 0x7fb774072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.685+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 --> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75b80cdcd0 con 0x7f759806fe70 2024-09-13T15:08:07.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 --> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2a8008990 con 0x7ff29006fcf0 2024-09-13T15:08:07.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb774066790 msgr2=0x7fb774068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb774066790 0x7fb774068c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb78c17fd50 tx=0x7fb780007bc0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78c0389f0 msgr2=0x7fb78c04d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 --2- 172.21.15.50:0/3064237390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78c0389f0 0x7fb78c04d020 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7880046d0 tx=0x7fb788004770 comp rx=0 tx=0).stop 2024-09-13T15:08:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb793e00700 1 -- 172.21.15.50:0/3064237390 reap_dead start 2024-09-13T15:08:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 shutdown_connections 2024-09-13T15:08:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 >> 172.21.15.50:0/3064237390 conn(0x7fb78c056860 msgr2=0x7fb78c00d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2ad600700 1 -- 172.21.15.50:0/586031272 <== osd.1 v2:172.21.15.50:6808/2789289607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2a8008990 con 0x7ff29006fcf0 2024-09-13T15:08:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 shutdown_connections 2024-09-13T15:08:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7fb79a400700 1 -- 172.21.15.50:0/3064237390 wait complete. 2024-09-13T15:08:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75b4c00700 1 -- 172.21.15.50:0/2496711886 <== osd.5 v2:172.21.15.181:6824/1243766751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75b80cdcd0 con 0x7f759806fe70 2024-09-13T15:08:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7ff29006fcf0 msgr2=0x7ff290072130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7ff29006fcf0 0x7ff290072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f759806fe70 msgr2=0x7f75980722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bfc00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f759806fe70 0x7f75980722b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff290066730 msgr2=0x7ff290068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff290066730 0x7ff290068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8000f60 tx=0x7ff29c008030 comp rx=0 tx=0).stop 2024-09-13T15:08:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a800be50 msgr2=0x7ff2a80e3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 --2- 172.21.15.50:0/586031272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a800be50 0x7ff2a80e3ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400b550 tx=0x7ff2a400b860 comp rx=0 tx=0).stop 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b5e00700 1 -- 172.21.15.50:0/586031272 reap_dead start 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7598066830 msgr2=0x7f7598068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bfc00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7598066830 0x7f7598068cf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009830 tx=0x7f75ac008040 comp rx=0 tx=0).stop 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b80cf0c0 msgr2=0x7f75b81f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bfc00700 1 --2- 172.21.15.50:0/2496711886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b80cf0c0 0x7f75b81f6600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75b0014040 tx=0x7f75b0004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7f75bdc00700 1 -- 172.21.15.50:0/2496711886 reap_dead start 2024-09-13T15:08:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 shutdown_connections 2024-09-13T15:08:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 >> 172.21.15.50:0/586031272 conn(0x7ff2a8056860 msgr2=0x7ff2a8036560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 shutdown_connections 2024-09-13T15:08:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.689+0000 7ff2b6800700 1 -- 172.21.15.50:0/586031272 wait complete. 2024-09-13T15:08:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.693+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 shutdown_connections 2024-09-13T15:08:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.693+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 >> 172.21.15.50:0/2496711886 conn(0x7f75b80d2e80 msgr2=0x7f75b809bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.693+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 shutdown_connections 2024-09-13T15:08:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.693+0000 7f75bfc00700 1 -- 172.21.15.50:0/2496711886 wait complete. 2024-09-13T15:08:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 --> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c6c002d60 con 0x7f1c7006fdc0 2024-09-13T15:08:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 --> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54300714a0 con 0x7f541006fe70 2024-09-13T15:08:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c8aa00700 1 -- 172.21.15.50:0/1881380538 <== osd.0 v2:172.21.15.50:6800/2782884030 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c6c002d60 con 0x7f1c7006fdc0 2024-09-13T15:08:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f5426000700 1 -- 172.21.15.50:0/2516469190 <== osd.6 v2:172.21.15.181:6800/89220898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5428005040 con 0x7f541006fe70 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7f1c7006fdc0 msgr2=0x7f1c70072200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7f1c7006fdc0 0x7f1c70072200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c70066780 msgr2=0x7f1c70068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c70066780 0x7f1c70068c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c94158650 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9406d3d0 msgr2=0x7f1c941fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 --2- 172.21.15.50:0/1881380538 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9406d3d0 0x7f1c941fc700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c84007e60 tx=0x7f1c8400e3c0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c93400700 1 -- 172.21.15.50:0/1881380538 reap_dead start 2024-09-13T15:08:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 shutdown_connections 2024-09-13T15:08:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.697+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 >> 172.21.15.50:0/1881380538 conn(0x7f1c9406c8e0 msgr2=0x7f1c9406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.701+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7f541006fe70 msgr2=0x7f54100722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.701+0000 7f541b400700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7f541006fe70 0x7f54100722b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.701+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 --> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3b4002d60 con 0x7fd3c006fdc0 2024-09-13T15:08:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.701+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 shutdown_connections 2024-09-13T15:08:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f1c99800700 1 -- 172.21.15.50:0/1881380538 wait complete. 2024-09-13T15:08:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5410066830 msgr2=0x7f5410068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5410066830 0x7f5410068cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5430163420 tx=0x7f541c009040 comp rx=0 tx=0).stop 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f543006aaa0 msgr2=0x7f543014ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 --2- 172.21.15.50:0/2516469190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f543006aaa0 0x7f543014ea40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5420015000 tx=0x7f5420004770 comp rx=0 tx=0).stop 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f542e800700 1 -- 172.21.15.50:0/2516469190 reap_dead start 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 shutdown_connections 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 >> 172.21.15.50:0/2516469190 conn(0x7f54300b0c40 msgr2=0x7f54300cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 shutdown_connections 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7f541b400700 1 -- 172.21.15.50:0/2516469190 wait complete. 2024-09-13T15:08:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.705+0000 7fd3dd600700 1 -- 172.21.15.50:0/68347730 <== osd.7 v2:172.21.15.181:6808/2747791304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3b4002d60 con 0x7fd3c006fdc0 2024-09-13T15:08:07.750 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:07.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T15:08:07.751 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:07.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fd3c006fdc0 msgr2=0x7fd3c0072200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fd3c006fdc0 0x7fd3c0072200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd3c0066800 msgr2=0x7fd3c0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd3c0066800 0x7fd3c0068cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4004650 tx=0x7fd3d4008040 comp rx=0 tx=0).stop 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e0155cd0 msgr2=0x7fd3e0155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 --2- 172.21.15.50:0/68347730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3e0155cd0 0x7fd3e0155400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3e015d800 tx=0x7fd3cc0075c0 comp rx=0 tx=0).stop 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3e6400700 1 -- 172.21.15.50:0/68347730 reap_dead start 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 shutdown_connections 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 >> 172.21.15.50:0/68347730 conn(0x7fd3e00b06f0 msgr2=0x7fd3e00acbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 shutdown_connections 2024-09-13T15:08:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:07.709+0000 7fd3d2a00700 1 -- 172.21.15.50:0/68347730 wait complete. 2024-09-13T15:08:07.754 INFO:teuthology.orchestra.run.smithi050.stdout:55834574860 2024-09-13T15:08:07.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T15:08:07.755 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-09-13T15:08:07.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T15:08:07.756 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-09-13T15:08:07.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T15:08:07.757 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:07.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T15:08:07.758 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:07.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T15:08:07.759 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-09-13T15:08:07.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T15:08:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.029+0000 7f98ba600700 1 Processor -- start 2024-09-13T15:08:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.029+0000 7f98ba600700 1 -- start start 2024-09-13T15:08:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 Processor -- start 2024-09-13T15:08:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98ba600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98b415b620 0x7f98b406a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98ba600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b4164d30 con 0x7f98b4165a60 2024-09-13T15:08:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98ba600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b4162590 con 0x7f98b415ba00 2024-09-13T15:08:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98ba600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b4164f80 con 0x7f98b415b620 2024-09-13T15:08:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98b4165a60 0x7f98b4070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57446/0 (socket says 172.21.15.50:57446) 2024-09-13T15:08:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3e00700 1 -- 172.21.15.50:0/2142605013 learned_addr learned my addr 172.21.15.50:0/2142605013 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3400700 1 --2- 172.21.15.50:0/2142605013 >> v2:172.21.15.181:3300/0 conn(0x7f98b415b620 0x7f98b406a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 -- start start 2024-09-13T15:08:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3400700 1 -- 172.21.15.50:0/2142605013 >> v1:172.21.15.181:6789/0 conn(0x7f98b415ba00 legacy=0x7f98b4161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3400700 1 -- 172.21.15.50:0/2142605013 >> v1:172.21.15.50:6789/0 conn(0x7f98b4165a60 legacy=0x7f98b4070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3400700 1 -- 172.21.15.50:0/2142605013 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b4165260 con 0x7f98b415b620 2024-09-13T15:08:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b3400700 1 --2- 172.21.15.50:0/2142605013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b406a570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009880 tx=0x7f98a4009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ede82ddc94bdcad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7fe0d5800700 1 Processor -- start 2024-09-13T15:08:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b2000700 1 -- 172.21.15.50:0/2142605013 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011830 con 0x7f98b415b620 2024-09-13T15:08:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b2000700 1 -- 172.21.15.50:0/2142605013 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4011990 con 0x7f98b415b620 2024-09-13T15:08:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f98b2000700 1 -- 172.21.15.50:0/2142605013 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011d20 con 0x7f98b415b620 2024-09-13T15:08:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7fb71ee00700 1 Processor -- start 2024-09-13T15:08:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47881610b0 0x7f47880719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f478806aaa0 0x7f478806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f47880b2670 0x7f47880b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4788070b30 con 0x7f47881610b0 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880b3040 con 0x7f47880b2670 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478e200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880b3560 con 0x7f478806aaa0 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47881610b0 0x7f47880719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f4787e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f478806aaa0 0x7f478806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47881610b0 0x7f47880719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58140/0 (socket says 172.21.15.50:58140) 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478ce00700 1 -- 172.21.15.50:0/1614123316 learned_addr learned my addr 172.21.15.50:0/1614123316 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f478d800700 1 --2- 172.21.15.50:0/1614123316 >> v2:172.21.15.181:3300/0 conn(0x7f47880b2670 0x7f47880b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7f32ea200700 1 Processor -- start 2024-09-13T15:08:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32ea200700 1 -- start start 2024-09-13T15:08:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 -- 172.21.15.50:0/2142605013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 msgr2=0x7f98b406a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 --2- 172.21.15.50:0/2142605013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b406a570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009880 tx=0x7f98a4009b90 comp rx=0 tx=0).stop 2024-09-13T15:08:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f478d800700 1 -- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f478806aaa0 msgr2=0x7f478806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f478d800700 1 --2- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f478806aaa0 0x7f478806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f478d800700 1 -- 172.21.15.50:0/1614123316 >> v2:172.21.15.50:3300/0 conn(0x7f47881610b0 msgr2=0x7f47880719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f478d800700 1 --2- 172.21.15.50:0/1614123316 >> v2:172.21.15.50:3300/0 conn(0x7f47881610b0 0x7f47880719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f478d800700 1 -- 172.21.15.50:0/1614123316 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478806b420 con 0x7f47880b2670 2024-09-13T15:08:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 -- 172.21.15.50:0/2142605013 shutdown_connections 2024-09-13T15:08:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 --2- 172.21.15.50:0/2142605013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b406a570 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 -- 172.21.15.50:0/2142605013 >> 172.21.15.50:0/2142605013 conn(0x7f98b40b06f0 msgr2=0x7f98b40b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 Processor -- start 2024-09-13T15:08:08.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 -- 172.21.15.50:0/2142605013 shutdown_connections 2024-09-13T15:08:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f478d800700 1 --2- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47880b2670 0x7f47880b2b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f478806dc50 tx=0x7f478000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aecc0d14f1b0478f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 -- start start 2024-09-13T15:08:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32ea200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32e406dc30 0x7f32e414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32ea200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e40ae110 0x7f32e415c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32ea200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e4159ba0 con 0x7f32e415a030 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32ea200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e415d920 con 0x7f32e406dc30 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32ea200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4159340 con 0x7f32e40ae110 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0d5800700 1 -- start start 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0d5800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe0d0159bd0 0x7fe0d0163a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0d5800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d015a000 con 0x7fe0d0153420 2024-09-13T15:08:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0d5800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d015a230 con 0x7fe0d0071460 2024-09-13T15:08:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0d5800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d00b2800 con 0x7fe0d0159bd0 2024-09-13T15:08:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f98ba600700 1 -- 172.21.15.50:0/2142605013 wait complete. 2024-09-13T15:08:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f4787400700 1 -- 172.21.15.50:0/1614123316 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000e070 con 0x7f47880b2670 2024-09-13T15:08:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f4787400700 1 -- 172.21.15.50:0/1614123316 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000bb20 con 0x7f47880b2670 2024-09-13T15:08:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f4787400700 1 -- 172.21.15.50:0/1614123316 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780012430 con 0x7f47880b2670 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66a40d0f90 0x7f66a40d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f66a40cf730 0x7f66a40cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40d3df0 con 0x7f66a40d0f90 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40b27e0 con 0x7f66a40cf730 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66ac000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40b3080 con 0x7f66a40ce650 2024-09-13T15:08:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32e3e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f32e415a030 0x7f32e40ada00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47204/0 (socket says 172.21.15.50:47204) 2024-09-13T15:08:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32e3e00700 1 -- 172.21.15.50:0/2976554518 learned_addr learned my addr 172.21.15.50:0/2976554518 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32e9800700 1 --2- 172.21.15.50:0/2976554518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e40ae110 0x7f32e415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f32e8e00700 1 --2- 172.21.15.50:0/2976554518 >> v2:172.21.15.181:3300/0 conn(0x7f32e406dc30 0x7f32e414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66a9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66a40d0f90 0x7f66a40d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0cf400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe0d0071460 0x7fe0d01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47216/0 (socket says 172.21.15.50:47216) 2024-09-13T15:08:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0cf400700 1 -- 172.21.15.50:0/2975406160 learned_addr learned my addr 172.21.15.50:0/2975406160 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66a9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66a40d0f90 0x7f66a40d38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58150/0 (socket says 172.21.15.50:58150) 2024-09-13T15:08:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66a9600700 1 -- 172.21.15.50:0/3053175229 learned_addr learned my addr 172.21.15.50:0/3053175229 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7f66aa000700 1 --2- 172.21.15.50:0/3053175229 >> v2:172.21.15.181:3300/0 conn(0x7f66a40cf730 0x7f66a40cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fe0d4e00700 1 --2- 172.21.15.50:0/2975406160 >> v2:172.21.15.181:3300/0 conn(0x7fe0d0159bd0 0x7fe0d0163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 Processor -- start 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.033+0000 7fb71ee00700 1 -- start start 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fb71ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7100dfa00 0x7fb7100371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.037+0000 7fb71ee00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb710053cb0 0x7fb710037720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71ee00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710054220 con 0x7fb710056250 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71ee00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb710054500 con 0x7fb710053cb0 2024-09-13T15:08:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71000ae80 con 0x7fb7100dfa00 2024-09-13T15:08:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a8c00700 1 --2- 172.21.15.50:0/3053175229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 Processor -- start 2024-09-13T15:08:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 -- start start 2024-09-13T15:08:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e3400700 1 -- 172.21.15.50:0/2976554518 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518387360 0 0) 0x7f32e4159ba0 con 0x7f32e415a030 2024-09-13T15:08:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e3400700 1 -- 172.21.15.50:0/2976554518 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c80035d0 con 0x7f32e415a030 2024-09-13T15:08:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a9600700 1 -- 172.21.15.50:0/3053175229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 msgr2=0x7f66a40d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a9600700 1 --2- 172.21.15.50:0/3053175229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a9600700 1 -- 172.21.15.50:0/3053175229 >> v2:172.21.15.181:3300/0 conn(0x7f66a40cf730 msgr2=0x7f66a40cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a9600700 1 --2- 172.21.15.50:0/3053175229 >> v2:172.21.15.181:3300/0 conn(0x7f66a40cf730 0x7f66a40cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 -- start start 2024-09-13T15:08:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a9600700 1 -- 172.21.15.50:0/3053175229 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40d18b0 con 0x7f66a40d0f90 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0d4e00700 1 -- 172.21.15.50:0/2975406160 >> v1:172.21.15.181:6789/0 conn(0x7fe0d0071460 legacy=0x7fe0d01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0d4e00700 1 -- 172.21.15.50:0/2975406160 >> v1:172.21.15.50:6789/0 conn(0x7fe0d0153420 legacy=0x7fe0d0070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0d4e00700 1 -- 172.21.15.50:0/2975406160 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d00b1a40 con 0x7fe0d0159bd0 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71e400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb710056250 0x7fb710050390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57478/0 (socket says 172.21.15.50:57478) 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71e400700 1 -- 172.21.15.50:0/3362288263 learned_addr learned my addr 172.21.15.50:0/3362288263 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71da00700 1 --2- 172.21.15.50:0/3362288263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7100dfa00 0x7fb7100371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71d000700 1 --2- 172.21.15.50:0/3362288263 >> v2:172.21.15.181:3300/0 conn(0x7fb710053cb0 0x7fb710037720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b41600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98b415ba00 0x7f98b4147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b4165a60 0x7f98b4159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4154790 con 0x7f98b415ba00 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4154a70 con 0x7f98b415b620 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98ba600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4154d50 con 0x7f98b4165a60 2024-09-13T15:08:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0d4e00700 1 --2- 172.21.15.50:0/2975406160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0159bd0 0x7fe0d0163a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800aea0 tx=0x7fe0c800c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3166f221f5d3a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0cea00700 1 -- 172.21.15.50:0/2975406160 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c800f070 con 0x7fe0d0159bd0 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0cea00700 1 -- 172.21.15.50:0/2975406160 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8003a40 con 0x7fe0d0159bd0 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fe0cea00700 1 -- 172.21.15.50:0/2975406160 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8003dd0 con 0x7fe0d0159bd0 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71da00700 1 -- 172.21.15.50:0/3362288263 >> v2:172.21.15.181:3300/0 conn(0x7fb710053cb0 msgr2=0x7fb710037720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71da00700 1 --2- 172.21.15.50:0/3362288263 >> v2:172.21.15.181:3300/0 conn(0x7fb710053cb0 0x7fb710037720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71da00700 1 -- 172.21.15.50:0/3362288263 >> v1:172.21.15.50:6789/0 conn(0x7fb710056250 legacy=0x7fb710050390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71da00700 1 -- 172.21.15.50:0/3362288263 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71000b160 con 0x7fb7100dfa00 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb71da00700 1 --2- 172.21.15.50:0/3362288263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7100dfa00 0x7fb7100371e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb718000b60 tx=0x7fb71804f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3326a19d0ddec626 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 -- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47880b2670 msgr2=0x7f47880b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 --2- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47880b2670 0x7f47880b2b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f478806dc50 tx=0x7f478000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e9800700 1 -- 172.21.15.50:0/2976554518 >> v2:172.21.15.181:3300/0 conn(0x7f32e406dc30 msgr2=0x7f32e414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e9800700 1 --2- 172.21.15.50:0/2976554518 >> v2:172.21.15.181:3300/0 conn(0x7f32e406dc30 0x7f32e414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e9800700 1 -- 172.21.15.50:0/2976554518 >> v1:172.21.15.181:6789/0 conn(0x7f32e415a030 legacy=0x7f32e40ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e9800700 1 -- 172.21.15.50:0/2976554518 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4159550 con 0x7f32e40ae110 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e9800700 1 --2- 172.21.15.50:0/2976554518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e40ae110 0x7f32e415c930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009850 tx=0x7f32d0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7a6e7761ee87b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b41600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b41600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49008/0 (socket says 172.21.15.50:49008) 2024-09-13T15:08:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 -- 172.21.15.50:0/1677260562 learned_addr learned my addr 172.21.15.50:0/1677260562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e3400700 1 -- 172.21.15.50:0/2976554518 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011830 con 0x7f32e40ae110 2024-09-13T15:08:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e3400700 1 -- 172.21.15.50:0/2976554518 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0011990 con 0x7f32e40ae110 2024-09-13T15:08:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f32e3400700 1 -- 172.21.15.50:0/2976554518 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011d20 con 0x7f32e40ae110 2024-09-13T15:08:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3e00700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b4165a60 0x7f98b4159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f66a9600700 1 --2- 172.21.15.50:0/3053175229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40d0f90 0x7f66a40d38b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6698009910 tx=0x7f6698009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0d6ccda48ff189 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 -- 172.21.15.50:0/1614123316 shutdown_connections 2024-09-13T15:08:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 --2- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47880b2670 0x7f47880b2b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 --2- 172.21.15.50:0/1614123316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f478806aaa0 0x7f478806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 --2- 172.21.15.50:0/1614123316 >> v2:172.21.15.50:3300/0 conn(0x7f47881610b0 0x7f47880719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f478e200700 1 -- 172.21.15.50:0/1614123316 >> 172.21.15.50:0/1614123316 conn(0x7f47880b0c40 msgr2=0x7f478806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 0x7f0d5c0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d5c071810 0x7f0d5c06c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c070720 con 0x7f0d5c070220 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0cee10 con 0x7f0d5c071810 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d63c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0cf0f0 con 0x7f0d5c15e370 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d61200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 0x7f0d5c0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d61200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 0x7f0d5c0ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35970/0 (socket says 172.21.15.50:35970) 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d61200700 1 -- 172.21.15.50:0/776467525 learned_addr learned my addr 172.21.15.50:0/776467525 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb717e00700 1 -- 172.21.15.50:0/3362288263 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71804f010 con 0x7fb7100dfa00 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb717e00700 1 -- 172.21.15.50:0/3362288263 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7180672a0 con 0x7fb7100dfa00 2024-09-13T15:08:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7fb717e00700 1 -- 172.21.15.50:0/3362288263 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718067650 con 0x7fb7100dfa00 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f883f800700 1 Processor -- start 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f883f800700 1 -- start start 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 -- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b4165a60 msgr2=0x7f98b4159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b4165a60 0x7f98b4159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 -- 172.21.15.50:0/1677260562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98b415ba00 msgr2=0x7f98b4147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98b415ba00 0x7f98b4147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f98b3400700 1 -- 172.21.15.50:0/1677260562 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40094b0 con 0x7f98b415b620 2024-09-13T15:08:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f478e200700 1 -- 172.21.15.50:0/1614123316 shutdown_connections 2024-09-13T15:08:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 -- 172.21.15.50:0/2976554518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e40ae110 msgr2=0x7f32e415c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 --2- 172.21.15.50:0/2976554518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e40ae110 0x7f32e415c930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009850 tx=0x7f32d0009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 -- 172.21.15.50:0/3362288263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7100dfa00 msgr2=0x7fb7100371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3362288263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7100dfa00 0x7fb7100371e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb718000b60 tx=0x7fb71804f690 comp rx=0 tx=0).stop 2024-09-13T15:08:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98b3400700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b41600e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98a40090b0 tx=0x7f98a4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 -- 172.21.15.50:0/2976554518 shutdown_connections 2024-09-13T15:08:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f478e200700 1 -- 172.21.15.50:0/1614123316 wait complete. 2024-09-13T15:08:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 --2- 172.21.15.50:0/2976554518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e40ae110 0x7f32e415c930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 --2- 172.21.15.50:0/2976554518 >> v2:172.21.15.181:3300/0 conn(0x7f32e406dc30 0x7f32e414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 -- 172.21.15.50:0/2976554518 >> 172.21.15.50:0/2976554518 conn(0x7f32e40b0c40 msgr2=0x7f32e406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.041+0000 7f0d61c00700 1 --2- 172.21.15.50:0/776467525 >> v2:172.21.15.50:3300/0 conn(0x7f0d5c071810 0x7f0d5c06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f0d61200700 1 -- 172.21.15.50:0/776467525 >> v2:172.21.15.50:3300/0 conn(0x7f0d5c071810 msgr2=0x7f0d5c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 -- 172.21.15.50:0/2976554518 shutdown_connections 2024-09-13T15:08:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f32ea200700 1 -- 172.21.15.50:0/2976554518 wait complete. 2024-09-13T15:08:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66a3e00700 1 -- 172.21.15.50:0/3053175229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698011830 con 0x7f66a40d0f90 2024-09-13T15:08:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66a3e00700 1 -- 172.21.15.50:0/3053175229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698011990 con 0x7f66a40d0f90 2024-09-13T15:08:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f0d61200700 1 --2- 172.21.15.50:0/776467525 >> v2:172.21.15.50:3300/0 conn(0x7f0d5c071810 0x7f0d5c06c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f0d61200700 1 -- 172.21.15.50:0/776467525 >> v1:172.21.15.50:6789/0 conn(0x7f0d5c070220 legacy=0x7f0d5c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 -- 172.21.15.50:0/3362288263 shutdown_connections 2024-09-13T15:08:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66a3e00700 1 -- 172.21.15.50:0/3053175229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698011d40 con 0x7f66a40d0f90 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3362288263 >> v2:172.21.15.181:3300/0 conn(0x7fb710053cb0 0x7fb710037720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3362288263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7100dfa00 0x7fb7100371e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 -- 172.21.15.50:0/3362288263 >> 172.21.15.50:0/3362288263 conn(0x7fb710055760 msgr2=0x7fb710055b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4004530 con 0x7f98b415b620 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a401f070 con 0x7f98b415b620 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4003900 con 0x7f98b415b620 2024-09-13T15:08:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4155030 con 0x7f98b415b620 2024-09-13T15:08:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 -- 172.21.15.50:0/3053175229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40d0f90 msgr2=0x7f66a40d38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 --2- 172.21.15.50:0/3053175229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40d0f90 0x7f66a40d38b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6698009910 tx=0x7f6698009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b41555f0 con 0x7f98b415b620 2024-09-13T15:08:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 -- 172.21.15.50:0/3053175229 shutdown_connections 2024-09-13T15:08:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 --2- 172.21.15.50:0/3053175229 >> v2:172.21.15.181:3300/0 conn(0x7f66a40cf730 0x7f66a40cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 --2- 172.21.15.50:0/3053175229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 --2- 172.21.15.50:0/3053175229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40d0f90 0x7f66a40d38b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 -- 172.21.15.50:0/3053175229 >> 172.21.15.50:0/3053175229 conn(0x7f66a409c190 msgr2=0x7f66a40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 -- 172.21.15.50:0/3362288263 shutdown_connections 2024-09-13T15:08:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fb71ee00700 1 -- 172.21.15.50:0/3362288263 wait complete. 2024-09-13T15:08:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883f800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88300e2b60 0x7f88300e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883f800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8830033a60 0x7f8830005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883f800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8830006050 0x7f883004f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883f800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300064e0 con 0x7f88300e2b60 2024-09-13T15:08:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883f800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883001c9e0 con 0x7f8830033a60 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883f800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88300e74c0 con 0x7f8830006050 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8830033a60 0x7f8830005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8830033a60 0x7f8830005b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49018/0 (socket says 172.21.15.50:49018) 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 -- 172.21.15.50:0/3797930362 learned_addr learned my addr 172.21.15.50:0/3797930362 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883d800700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8830006050 0x7f883004f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883ce00700 1 --2- 172.21.15.50:0/3797930362 >> v2:172.21.15.50:3300/0 conn(0x7f88300e2b60 0x7f88300e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 -- 172.21.15.50:0/3053175229 shutdown_connections 2024-09-13T15:08:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f66ac000700 1 -- 172.21.15.50:0/3053175229 wait complete. 2024-09-13T15:08:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fe0d5800700 1 -- 172.21.15.50:0/2975406160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0159bd0 msgr2=0x7fe0d0163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7fe0d5800700 1 --2- 172.21.15.50:0/2975406160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0159bd0 0x7fe0d0163a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800aea0 tx=0x7fe0c800c330 comp rx=0 tx=0).stop 2024-09-13T15:08:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f478e200700 1 Processor -- start 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f0d61200700 1 -- 172.21.15.50:0/776467525 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0cf3d0 con 0x7f0d5c15e370 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 -- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8830006050 msgr2=0x7f883004f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8830006050 0x7f883004f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 -- 172.21.15.50:0/3797930362 >> v2:172.21.15.50:3300/0 conn(0x7f88300e2b60 msgr2=0x7f88300e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 --2- 172.21.15.50:0/3797930362 >> v2:172.21.15.50:3300/0 conn(0x7f88300e2b60 0x7f88300e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f8837e00700 1 -- 172.21.15.50:0/3797930362 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830006e60 con 0x7f8830033a60 2024-09-13T15:08:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f883d800700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8830006050 0x7f883004f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f0d61c00700 1 --2- 172.21.15.50:0/776467525 >> v2:172.21.15.50:3300/0 conn(0x7f0d5c071810 0x7f0d5c06c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b4155810 con 0x7f98b415b620 2024-09-13T15:08:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.045+0000 7f478e200700 1 -- start start 2024-09-13T15:08:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f8837e00700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830033a60 0x7f8830005b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88300480c0 tx=0x7f8824009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883e14a0a6826f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d61200700 1 --2- 172.21.15.50:0/776467525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 0x7f0d5c0ae380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009eb0 tx=0x7f0d5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e692b423b89f9fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f32ea200700 1 Processor -- start 2024-09-13T15:08:08.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f32ea200700 1 -- start start 2024-09-13T15:08:08.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7fe0d5800700 1 -- 172.21.15.50:0/2975406160 shutdown_connections 2024-09-13T15:08:08.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7fe0d5800700 1 --2- 172.21.15.50:0/2975406160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0159bd0 0x7fe0d0163a70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7fe0d5800700 1 -- 172.21.15.50:0/2975406160 >> 172.21.15.50:0/2975406160 conn(0x7fe0d006a390 msgr2=0x7fe0d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f8837400700 1 -- 172.21.15.50:0/3797930362 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824011830 con 0x7f8830033a60 2024-09-13T15:08:08.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f8837400700 1 -- 172.21.15.50:0/3797930362 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824011990 con 0x7f8830033a60 2024-09-13T15:08:08.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98a4021030 con 0x7f98b415b620 2024-09-13T15:08:08.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d5b400700 1 -- 172.21.15.50:0/776467525 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400bb40 con 0x7f0d5c15e370 2024-09-13T15:08:08.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d5b400700 1 -- 172.21.15.50:0/776467525 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5400bca0 con 0x7f0d5c15e370 2024-09-13T15:08:08.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d5b400700 1 -- 172.21.15.50:0/776467525 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540104d0 con 0x7f0d5c15e370 2024-09-13T15:08:08.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7fe0d5800700 1 -- 172.21.15.50:0/2975406160 shutdown_connections 2024-09-13T15:08:08.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f8837400700 1 -- 172.21.15.50:0/3797930362 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824011d20 con 0x7f8830033a60 2024-09-13T15:08:08.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 -- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830033a60 msgr2=0x7f8830005b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830033a60 0x7f8830005b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88300480c0 tx=0x7f8824009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478e200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 0x7f4788137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 -- 172.21.15.50:0/3797930362 shutdown_connections 2024-09-13T15:08:08.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8830006050 0x7f883004f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 --2- 172.21.15.50:0/3797930362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830033a60 0x7f8830005b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 --2- 172.21.15.50:0/3797930362 >> v2:172.21.15.50:3300/0 conn(0x7f88300e2b60 0x7f88300e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 -- 172.21.15.50:0/3797930362 >> 172.21.15.50:0/3797930362 conn(0x7f8830036140 msgr2=0x7f8830036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478e200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47880b2670 0x7f47881527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 0x7f4788137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 -- 172.21.15.50:0/776467525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 msgr2=0x7f0d5c0ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 --2- 172.21.15.50:0/776467525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 0x7f0d5c0ae380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009eb0 tx=0x7f0d5400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 0x7f4788137060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58180/0 (socket says 172.21.15.50:58180) 2024-09-13T15:08:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 -- 172.21.15.50:0/3797930362 shutdown_connections 2024-09-13T15:08:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 -- 172.21.15.50:0/776467525 shutdown_connections 2024-09-13T15:08:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 --2- 172.21.15.50:0/776467525 >> v2:172.21.15.50:3300/0 conn(0x7f0d5c071810 0x7f0d5c06c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 --2- 172.21.15.50:0/776467525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15e370 0x7f0d5c0ae380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 -- 172.21.15.50:0/776467525 >> 172.21.15.50:0/776467525 conn(0x7f0d5c0b0b50 msgr2=0x7f0d5c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478ce00700 1 -- 172.21.15.50:0/4207904393 learned_addr learned my addr 172.21.15.50:0/4207904393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f883f800700 1 -- 172.21.15.50:0/3797930362 wait complete. 2024-09-13T15:08:08.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 Processor -- start 2024-09-13T15:08:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47881610b0 0x7f478814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 -- start start 2024-09-13T15:08:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f98ab400700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9894066780 0x7f9894068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98a4085980 con 0x7f98b415b620 2024-09-13T15:08:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f4787e00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47880b2670 0x7f47881527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 -- 172.21.15.50:0/776467525 shutdown_connections 2024-09-13T15:08:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f98b2a00700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9894066780 0x7f9894068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32ea200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 0x7f32e4136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f478d800700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47881610b0 0x7f478814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40cf730 0x7f66a41566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66a40d0f90 0x7f66a40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40b7280 con 0x7f66a40cf730 2024-09-13T15:08:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40c9260 con 0x7f66a40d0f90 2024-09-13T15:08:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f66ac000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40b6950 con 0x7f66a40ce650 2024-09-13T15:08:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32ea200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e40ae110 0x7f32e4140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35988/0 (socket says 172.21.15.50:35988) 2024-09-13T15:08:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 -- 172.21.15.50:0/1200820226 learned_addr learned my addr 172.21.15.50:0/1200820226 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47881641e0 con 0x7f478806aaa0 2024-09-13T15:08:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 0x7f32e4136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 0x7f32e4136a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35998/0 (socket says 172.21.15.50:35998) 2024-09-13T15:08:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32ea200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e415a030 0x7f32e4141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f98b2a00700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9894066780 0x7f9894068c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98a0000f60 tx=0x7f98a0007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 -- 172.21.15.50:0/1249944032 learned_addr learned my addr 172.21.15.50:0/1249944032 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32ea200700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4137970 con 0x7f32e40ae110 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32ea200700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e40b3590 con 0x7f32e415a030 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32ea200700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4136fa0 con 0x7f32e406dc30 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 -- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66a40d0f90 msgr2=0x7f66a40ca160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66a40d0f90 0x7f66a40ca160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 -- 172.21.15.50:0/1200820226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40cf730 msgr2=0x7f66a41566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40cf730 0x7f66a41566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 -- 172.21.15.50:0/1200820226 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698009570 con 0x7f66a40ce650 2024-09-13T15:08:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e9800700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e415a030 0x7f32e4141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a9600700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40cce40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6698009c60 tx=0x7f6698004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47881638b0 con 0x7f47881610b0 2024-09-13T15:08:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4788163b90 con 0x7f47880b2670 2024-09-13T15:08:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7fe0d5800700 1 -- 172.21.15.50:0/2975406160 wait complete. 2024-09-13T15:08:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 Processor -- start 2024-09-13T15:08:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fb71ee00700 1 Processor -- start 2024-09-13T15:08:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698004510 con 0x7f66a40ce650 2024-09-13T15:08:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669801e070 con 0x7f66a40ce650 2024-09-13T15:08:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698003900 con 0x7f66a40ce650 2024-09-13T15:08:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.049+0000 7f0d63c00700 1 -- 172.21.15.50:0/776467525 wait complete. 2024-09-13T15:08:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f0d63c00700 1 Processor -- start 2024-09-13T15:08:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f883f800700 1 Processor -- start 2024-09-13T15:08:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4787e00700 1 -- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47881610b0 msgr2=0x7f478814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4787e00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47881610b0 0x7f478814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4787e00700 1 -- 172.21.15.50:0/4207904393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 msgr2=0x7f4788137060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4787e00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 0x7f4788137060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4787e00700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780009a70 con 0x7f47880b2670 2024-09-13T15:08:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f478ce00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 0x7f4788137060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fb71ee00700 1 -- start start 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 -- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e415a030 msgr2=0x7f32e4141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e415a030 0x7f32e4141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 -- 172.21.15.50:0/1249944032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e40ae110 msgr2=0x7f32e4140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e40ae110 0x7f32e4140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d00094b0 con 0x7f32e406dc30 2024-09-13T15:08:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e8e00700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 0x7f32e4136a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009db0 tx=0x7f32dc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f883f800700 1 -- start start 2024-09-13T15:08:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f0d63c00700 1 -- start start 2024-09-13T15:08:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 -- start start 2024-09-13T15:08:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc009c20 con 0x7f32e406dc30 2024-09-13T15:08:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0071460 0x7fe0d01feb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d0153420 0x7fe0d00cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d0159bd0 0x7fe0d00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4787e00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47880b2670 0x7f47881527b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f477801f620 tx=0x7f477801f930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01ff080 con 0x7fe0d0153420 2024-09-13T15:08:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0158fd0 con 0x7fe0d0071460 2024-09-13T15:08:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7fe0d5800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0156d40 con 0x7fe0d0159bd0 2024-09-13T15:08:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc00f040 con 0x7f32e406dc30 2024-09-13T15:08:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc014480 con 0x7f32e406dc30 2024-09-13T15:08:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a40b6c30 con 0x7f66a40ce650 2024-09-13T15:08:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40ca6a0 con 0x7f66a40ce650 2024-09-13T15:08:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f32ea200700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e40b2fd0 con 0x7f32e406dc30 2024-09-13T15:08:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f32ea200700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e40b1a40 con 0x7f32e406dc30 2024-09-13T15:08:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0cfe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0071460 0x7fe0d01feb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778024890 con 0x7f47880b2670 2024-09-13T15:08:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47780249f0 con 0x7f47880b2670 2024-09-13T15:08:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.053+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778024d80 con 0x7f47880b2670 2024-09-13T15:08:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0cfe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0071460 0x7fe0d01feb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49036/0 (socket says 172.21.15.50:49036) 2024-09-13T15:08:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0cf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d0153420 0x7fe0d00cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0cfe00700 1 -- 172.21.15.50:0/4077318391 learned_addr learned my addr 172.21.15.50:0/4077318391 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0d4e00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d0159bd0 0x7fe0d00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d63c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c070220 0x7f0d5c0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d63c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c071810 0x7f0d5c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4788163e70 con 0x7f47880b2670 2024-09-13T15:08:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4788152cf0 con 0x7f47880b2670 2024-09-13T15:08:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d63c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c1f5590 0x7f0d5c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e415d290 con 0x7f32e406dc30 2024-09-13T15:08:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d5be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c071810 0x7f0d5c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d61200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c070220 0x7f0d5c0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a415d3c0 con 0x7f66a40ce650 2024-09-13T15:08:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d61200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c070220 0x7f0d5c0ad290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49050/0 (socket says 172.21.15.50:49050) 2024-09-13T15:08:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0d4e00700 1 -- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0071460 msgr2=0x7fe0d01feb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0d4e00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0071460 0x7fe0d01feb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0d4e00700 1 -- 172.21.15.50:0/4077318391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d0153420 msgr2=0x7fe0d00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0d4e00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d0153420 0x7fe0d00cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fe0d4e00700 1 -- 172.21.15.50:0/4077318391 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c800ab80 con 0x7fe0d0159bd0 2024-09-13T15:08:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d5be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c071810 0x7f0d5c156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58200/0 (socket says 172.21.15.50:58200) 2024-09-13T15:08:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb710053cb0 0x7fb7100d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb710056250 0x7fb7100385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71ee00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100dfa00 0x7fb7101806d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71ee00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100db160 con 0x7fb7100dfa00 2024-09-13T15:08:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100da4e0 con 0x7fb710053cb0 2024-09-13T15:08:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100da7c0 con 0x7fb710056250 2024-09-13T15:08:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d61200700 1 -- 172.21.15.50:0/4059591008 learned_addr learned my addr 172.21.15.50:0/4059591008 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0ad7d0 con 0x7f0d5c071810 2024-09-13T15:08:08.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c14fa00 con 0x7f0d5c070220 2024-09-13T15:08:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c156a80 con 0x7f0d5c1f5590 2024-09-13T15:08:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f883f800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 0x7f883017ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98a4052a70 con 0x7f98b415b620 2024-09-13T15:08:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4788164000 con 0x7f47880b2670 2024-09-13T15:08:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100dfa00 0x7fb7101806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100dfa00 0x7fb7101806d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58208/0 (socket says 172.21.15.50:58208) 2024-09-13T15:08:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71e400700 1 -- 172.21.15.50:0/3953983326 learned_addr learned my addr 172.21.15.50:0/3953983326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71da00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb710053cb0 0x7fb7100d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7f883f800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 0x7f883017c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.057+0000 7fb71d000700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb710056250 0x7fb7100385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fe0d4e00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d0159bd0 0x7fe0d00cdd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0071aa0 tx=0x7fe0c8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c1f5590 0x7f0d5c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71da00700 1 -- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb710056250 msgr2=0x7fb7100385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71da00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb710056250 0x7fb7100385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71da00700 1 -- 172.21.15.50:0/3953983326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100dfa00 msgr2=0x7fb7101806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71da00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100dfa00 0x7fb7101806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883f800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88300e2b60 0x7f88300cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 0x7f883017ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71da00700 1 -- 172.21.15.50:0/3953983326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100daaa0 con 0x7fb710053cb0 2024-09-13T15:08:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71da00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb710053cb0 0x7fb7100d9c00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb718069130 tx=0x7fb718068970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 -- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c070220 msgr2=0x7f0d5c0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c070220 0x7f0d5c0ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 -- 172.21.15.50:0/4059591008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c071810 msgr2=0x7f0d5c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c071810 0x7f0d5c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009b30 con 0x7f0d5c1f5590 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180684e0 con 0x7fb710053cb0 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718068660 con 0x7fb710053cb0 2024-09-13T15:08:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180687d0 con 0x7fb710053cb0 2024-09-13T15:08:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32dc0145e0 con 0x7f32e406dc30 2024-09-13T15:08:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4778005a40 con 0x7f47880b2670 2024-09-13T15:08:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100dad80 con 0x7fb710053cb0 2024-09-13T15:08:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb710038af0 con 0x7fb710053cb0 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883f800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8830048190 con 0x7f8830033a60 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883f800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883017cee0 con 0x7f8830006050 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883f800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8830048430 con 0x7f88300e2b60 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 0x7f883017c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 0x7f883017c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58224/0 (socket says 172.21.15.50:58224) 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 -- 172.21.15.50:0/3406968232 learned_addr learned my addr 172.21.15.50:0/3406968232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 -- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88300e2b60 msgr2=0x7f88300cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 0x7f883017ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49076/0 (socket says 172.21.15.50:49076) 2024-09-13T15:08:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6698003a60 con 0x7f66a40ce650 2024-09-13T15:08:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f66a1600700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6684066780 0x7f6684068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66980857b0 con 0x7f66a40ce650 2024-09-13T15:08:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88300e2b60 0x7f88300cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f0d61c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c1f5590 0x7f0d5c153a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400e570 tx=0x7f0d4400e880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88300e2b60 0x7f88300cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 -- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 msgr2=0x7f883017ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 0x7f883017ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f8837e00700 1 -- 172.21.15.50:0/3406968232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824009570 con 0x7f8830033a60 2024-09-13T15:08:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f4784c00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4768066730 0x7f4768068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883ce00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 0x7f883017ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4778095770 con 0x7f47880b2670 2024-09-13T15:08:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f883d800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88300e2b60 0x7f88300cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f32e0c00700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32c4066780 0x7f32c4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f66a8c00700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6684066780 0x7f6684068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32dc085090 con 0x7f32e406dc30 2024-09-13T15:08:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f8837e00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 0x7f883017c9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8824000c00 tx=0x7f8824004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f32e3e00700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32c4066780 0x7f32c4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.061+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7100371e0 con 0x7fb710053cb0 2024-09-13T15:08:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f478ce00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4768066730 0x7f4768068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824004610 con 0x7f8830033a60 2024-09-13T15:08:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8830048710 con 0x7f8830033a60 2024-09-13T15:08:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8830048cd0 con 0x7f8830033a60 2024-09-13T15:08:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882401e070 con 0x7f8830033a60 2024-09-13T15:08:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240038e0 con 0x7f8830033a60 2024-09-13T15:08:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f32e3e00700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32c4066780 0x7f32c4068c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32e4141950 tx=0x7f32d40079e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f66a8c00700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6684066780 0x7f6684068c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6690006b40 tx=0x7f6690006ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8814005310 con 0x7f8830033a60 2024-09-13T15:08:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7f478ce00700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4768066730 0x7f4768068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4774006fd0 tx=0x7f4774008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb718090070 con 0x7fb710053cb0 2024-09-13T15:08:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7fb715600700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb6f8066780 0x7fb6f8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7180fe750 con 0x7fb710053cb0 2024-09-13T15:08:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.065+0000 7fb71d000700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb6f8066780 0x7fb6f8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7fb71d000700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb6f8066780 0x7fb6f8068c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7100dc390 tx=0x7fb70c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8824003a40 con 0x7f8830033a60 2024-09-13T15:08:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32dc052180 con 0x7f32e406dc30 2024-09-13T15:08:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7f8834c00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8818066760 0x7f8818068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8824084f40 con 0x7f8830033a60 2024-09-13T15:08:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7f883ce00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8818066760 0x7f8818068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.069+0000 7f883ce00700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8818066760 0x7f8818068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f882c006fd0 tx=0x7f882c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8004440 con 0x7fe0d0159bd0 2024-09-13T15:08:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d0153be0 con 0x7fe0d0159bd0 2024-09-13T15:08:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44013610 con 0x7f0d5c1f5590 2024-09-13T15:08:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c0ac1f0 con 0x7f0d5c1f5590 2024-09-13T15:08:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c0ac7b0 con 0x7f0d5c1f5590 2024-09-13T15:08:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d01541a0 con 0x7fe0d0159bd0 2024-09-13T15:08:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6698052a60 con 0x7f66a40ce650 2024-09-13T15:08:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.073+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7180cb940 con 0x7fb710053cb0 2024-09-13T15:08:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c0b3fa0 con 0x7f0d5c1f5590 2024-09-13T15:08:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d0156eb0 con 0x7fe0d0159bd0 2024-09-13T15:08:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f47780627d0 con 0x7f47880b2670 2024-09-13T15:08:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44004020 con 0x7f0d5c1f5590 2024-09-13T15:08:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d440043b0 con 0x7f0d5c1f5590 2024-09-13T15:08:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80045a0 con 0x7fe0d0159bd0 2024-09-13T15:08:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88240520d0 con 0x7f8830033a60 2024-09-13T15:08:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.077+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8004440 con 0x7fe0d0159bd0 2024-09-13T15:08:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.081+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d44013770 con 0x7f0d5c1f5590 2024-09-13T15:08:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7f0d58c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d38066730 0x7f0d38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.081+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0c801a040 con 0x7fe0d0159bd0 2024-09-13T15:08:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d44084430 con 0x7f0d5c1f5590 2024-09-13T15:08:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7f0d61200700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d38066730 0x7f0d38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7fe0c7e00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b00667f0 0x7fe0b0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0c8085930 con 0x7fe0d0159bd0 2024-09-13T15:08:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0c80b0e70 con 0x7fe0d0159bd0 2024-09-13T15:08:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7fe0cfe00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b00667f0 0x7fe0b0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.085+0000 7f0d61200700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d38066730 0x7f0d38068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009440 tx=0x7f0d5400d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.089+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d44051490 con 0x7f0d5c1f5590 2024-09-13T15:08:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.089+0000 7fe0cfe00700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b00667f0 0x7fe0b0068cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0001970 tx=0x7fe0c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.409+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f32e4072000 con 0x7f32e406dc30 2024-09-13T15:08:08.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.409+0000 7f32e0c00700 1 -- 172.21.15.50:0/1249944032 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32dc0557a0 con 0x7f32e406dc30 2024-09-13T15:08:08.414 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32c4066780 msgr2=0x7f32c4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32c4066780 0x7f32c4068c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32e4141950 tx=0x7f32d40079e0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 msgr2=0x7f32e4136a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 0x7f32e4136a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009db0 tx=0x7f32dc00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 shutdown_connections 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32c4066780 0x7f32c4068c40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32e415a030 0x7f32e4141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e40ae110 0x7f32e4140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 --2- 172.21.15.50:0/1249944032 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32e406dc30 0x7f32e4136a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 >> 172.21.15.50:0/1249944032 conn(0x7f32e40b0c40 msgr2=0x7f32e4157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 shutdown_connections 2024-09-13T15:08:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.413+0000 7f32da000700 1 -- 172.21.15.50:0/1249944032 wait complete. 2024-09-13T15:08:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.421+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98b406abd0 con 0x7f98b415b620 2024-09-13T15:08:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.421+0000 7f98ab400700 1 -- 172.21.15.50:0/1677260562 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98a4056090 con 0x7f98b415b620 2024-09-13T15:08:08.426 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.425+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9894066780 msgr2=0x7f9894068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.425+0000 7f98ba600700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9894066780 0x7f9894068c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98a0000f60 tx=0x7f98a0007a60 comp rx=0 tx=0).stop 2024-09-13T15:08:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.425+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 msgr2=0x7f98b41600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.425+0000 7f98ba600700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b41600e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98a40090b0 tx=0x7f98a4004770 comp rx=0 tx=0).stop 2024-09-13T15:08:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.429+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 shutdown_connections 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.429+0000 7f98ba600700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9894066780 0x7f9894068c40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f98ba600700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98b4165a60 0x7f98b4159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f98ba600700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98b415ba00 0x7f98b4147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f98ba600700 1 --2- 172.21.15.50:0/1677260562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98b415b620 0x7f98b41600e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 >> 172.21.15.50:0/1677260562 conn(0x7f98b40b06f0 msgr2=0x7f98b40ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 shutdown_connections 2024-09-13T15:08:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f98ba600700 1 -- 172.21.15.50:0/1677260562 wait complete. 2024-09-13T15:08:08.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f88140055c0 con 0x7f8830033a60 2024-09-13T15:08:08.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.433+0000 7f8834c00700 1 -- 172.21.15.50:0/3406968232 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8824015090 con 0x7f8830033a60 2024-09-13T15:08:08.438 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-09-13T15:08:08.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.437+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8818066760 msgr2=0x7f8818068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.437+0000 7f883f800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8818066760 0x7f8818068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f882c006fd0 tx=0x7f882c008040 comp rx=0 tx=0).stop 2024-09-13T15:08:08.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.437+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 msgr2=0x7f883017c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.437+0000 7f883f800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 0x7f883017c9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8824000c00 tx=0x7f8824004770 comp rx=0 tx=0).stop 2024-09-13T15:08:08.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-09-13T15:08:08.443 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 shutdown_connections 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8818066760 0x7f8818068c20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f88300e2b60 0x7f88300cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8830033a60 0x7f883017c9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 --2- 172.21.15.50:0/3406968232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8830006050 0x7f883017ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 >> 172.21.15.50:0/3406968232 conn(0x7f8830036140 msgr2=0x7f8830052190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 shutdown_connections 2024-09-13T15:08:08.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f883f800700 1 -- 172.21.15.50:0/3406968232 wait complete. 2024-09-13T15:08:08.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66a40b6a90 con 0x7f66a40ce650 2024-09-13T15:08:08.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4788164320 con 0x7f47880b2670 2024-09-13T15:08:08.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f66a1600700 1 -- 172.21.15.50:0/1200820226 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66a40b6a90 con 0x7f66a40ce650 2024-09-13T15:08:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.441+0000 7f4784c00700 1 -- 172.21.15.50:0/4207904393 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4778032020 con 0x7f47880b2670 2024-09-13T15:08:08.447 INFO:teuthology.orchestra.run.smithi050.stdout:55834574860 2024-09-13T15:08:08.448 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-09-13T15:08:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb710051c90 con 0x7fb710053cb0 2024-09-13T15:08:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7fb715600700 1 -- 172.21.15.50:0/3953983326 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7180cef60 con 0x7fb710053cb0 2024-09-13T15:08:08.449 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4768066730 msgr2=0x7f4768068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6684066780 msgr2=0x7f6684068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f66ac000700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6684066780 0x7f6684068c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6690006b40 tx=0x7f6690006ad0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 msgr2=0x7f66a40cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f66ac000700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40cce40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6698009c60 tx=0x7f6698004770 comp rx=0 tx=0).stop 2024-09-13T15:08:08.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4768066730 0x7f4768068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4774006fd0 tx=0x7f4774008040 comp rx=0 tx=0).stop 2024-09-13T15:08:08.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.445+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47880b2670 msgr2=0x7f47881527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47880b2670 0x7f47881527b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f477801f620 tx=0x7f477801f930 comp rx=0 tx=0).stop 2024-09-13T15:08:08.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 shutdown_connections 2024-09-13T15:08:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4768066730 0x7f4768068bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47881610b0 0x7f478814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 shutdown_connections 2024-09-13T15:08:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6684066780 0x7f6684068c40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66a40d0f90 0x7f66a40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66a40cf730 0x7f66a41566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 --2- 172.21.15.50:0/1200820226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66a40ce650 0x7f66a40cce40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 >> 172.21.15.50:0/1200820226 conn(0x7f66a409c190 msgr2=0x7f66a40d1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47880b2670 0x7f47881527b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 --2- 172.21.15.50:0/4207904393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f478806aaa0 0x7f4788137060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 >> 172.21.15.50:0/4207904393 conn(0x7f47880b0c40 msgr2=0x7f4788159300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 shutdown_connections 2024-09-13T15:08:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f478e200700 1 -- 172.21.15.50:0/4207904393 wait complete. 2024-09-13T15:08:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 shutdown_connections 2024-09-13T15:08:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7f66ac000700 1 -- 172.21.15.50:0/1200820226 wait complete. 2024-09-13T15:08:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb6f8066780 msgr2=0x7fb6f8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb6f8066780 0x7fb6f8068c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7100dc390 tx=0x7fb70c008040 comp rx=0 tx=0).stop 2024-09-13T15:08:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb710053cb0 msgr2=0x7fb7100d9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb710053cb0 0x7fb7100d9c00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb718069130 tx=0x7fb718068970 comp rx=0 tx=0).stop 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 shutdown_connections 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb6f8066780 0x7fb6f8068c40 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7100dc390 tx=0x7fb70c008040 comp rx=0 tx=0).stop 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100dfa00 0x7fb7101806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb710056250 0x7fb7100385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 --2- 172.21.15.50:0/3953983326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb710053cb0 0x7fb7100d9c00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 >> 172.21.15.50:0/3953983326 conn(0x7fb710055760 msgr2=0x7fb710006f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 shutdown_connections 2024-09-13T15:08:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.449+0000 7fb71ee00700 1 -- 172.21.15.50:0/3953983326 wait complete. 2024-09-13T15:08:08.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-09-13T15:08:08.463 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.461+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0d006ae80 con 0x7fe0d0159bd0 2024-09-13T15:08:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.461+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0d5c0ae380 con 0x7f0d5c1f5590 2024-09-13T15:08:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.461+0000 7fe0c7e00700 1 -- 172.21.15.50:0/4077318391 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0c8052b60 con 0x7fe0d0159bd0 2024-09-13T15:08:08.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.461+0000 7f0d58c00700 1 -- 172.21.15.50:0/4059591008 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d44054ab0 con 0x7f0d5c1f5590 2024-09-13T15:08:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2024-09-13T15:08:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2024-09-13T15:08:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b00667f0 msgr2=0x7fe0b0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b00667f0 0x7fe0b0068cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0001970 tx=0x7fe0c0009040 comp rx=0 tx=0).stop 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d0159bd0 msgr2=0x7fe0d00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d0159bd0 0x7fe0d00cdd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0071aa0 tx=0x7fe0c8004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 shutdown_connections 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b00667f0 0x7fe0b0068cb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d0159bd0 0x7fe0d00cdd80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d0153420 0x7fe0d00cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 --2- 172.21.15.50:0/4077318391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d0071460 0x7fe0d01feb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 >> 172.21.15.50:0/4077318391 conn(0x7fe0d006a390 msgr2=0x7fe0d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 shutdown_connections 2024-09-13T15:08:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.465+0000 7fe0d5800700 1 -- 172.21.15.50:0/4077318391 wait complete. 2024-09-13T15:08:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.469+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d38066730 msgr2=0x7f0d38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.469+0000 7f0d63c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d38066730 0x7f0d38068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009440 tx=0x7f0d5400d040 comp rx=0 tx=0).stop 2024-09-13T15:08:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.469+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c1f5590 msgr2=0x7f0d5c153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.469+0000 7f0d63c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c1f5590 0x7f0d5c153a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400e570 tx=0x7f0d4400e880 comp rx=0 tx=0).stop 2024-09-13T15:08:08.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-09-13T15:08:08.472 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 shutdown_connections 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d38066730 0x7f0d38068bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c1f5590 0x7f0d5c153a80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d5c071810 0x7f0d5c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 --2- 172.21.15.50:0/4059591008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c070220 0x7f0d5c0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 >> 172.21.15.50:0/4059591008 conn(0x7f0d5c0b0b50 msgr2=0x7f0d5c071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 shutdown_connections 2024-09-13T15:08:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.473+0000 7f0d63c00700 1 -- 172.21.15.50:0/4059591008 wait complete. 2024-09-13T15:08:08.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-09-13T15:08:08.476 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-09-13T15:08:08.477 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2024-09-13T15:08:08.478 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-09-13T15:08:08.488 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-09-13T15:08:08.495 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:08.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T15:08:08.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:08:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.709+0000 7f5edbe00700 1 Processor -- start 2024-09-13T15:08:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.709+0000 7f5edbe00700 1 -- start start 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5edbe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5ed406a5d0 0x7f5ed4071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5edbe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ed40b19f0 0x7f5ed406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5edbe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40ce140 con 0x7f5ed40cd610 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5edbe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40b1e60 con 0x7f5ed40b19f0 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5edbe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed406aef0 con 0x7f5ed406a5d0 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ed40b19f0 0x7f5ed406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ed40b19f0 0x7f5ed406a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58226/0 (socket says 172.21.15.50:58226) 2024-09-13T15:08:08.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 -- 172.21.15.50:0/25107287 learned_addr learned my addr 172.21.15.50:0/25107287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 -- 172.21.15.50:0/25107287 >> v2:172.21.15.181:3300/0 conn(0x7f5ed406a5d0 msgr2=0x7f5ed4071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed9400700 1 --2- 172.21.15.50:0/25107287 >> v2:172.21.15.181:3300/0 conn(0x7f5ed406a5d0 0x7f5ed4071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 --2- 172.21.15.50:0/25107287 >> v2:172.21.15.181:3300/0 conn(0x7f5ed406a5d0 0x7f5ed4071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 -- 172.21.15.50:0/25107287 >> v1:172.21.15.181:6789/0 conn(0x7f5ed40cd610 legacy=0x7f5ed406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 -- 172.21.15.50:0/25107287 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40cde60 con 0x7f5ed40b19f0 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed9400700 1 --2- 172.21.15.50:0/25107287 >> v2:172.21.15.181:3300/0 conn(0x7f5ed406a5d0 0x7f5ed4071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed8a00700 1 --2- 172.21.15.50:0/25107287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40b19f0 0x7f5ed406a9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40cc4e0 tx=0x7f5ec0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1ca3d5a81ef0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed3e00700 1 -- 172.21.15.50:0/25107287 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0004230 con 0x7f5ed40b19f0 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed3e00700 1 -- 172.21.15.50:0/25107287 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0004390 con 0x7f5ed40b19f0 2024-09-13T15:08:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.713+0000 7f5ed3e00700 1 -- 172.21.15.50:0/25107287 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00036c0 con 0x7f5ed40b19f0 2024-09-13T15:08:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 -- 172.21.15.50:0/25107287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40b19f0 msgr2=0x7f5ed406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 --2- 172.21.15.50:0/25107287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40b19f0 0x7f5ed406a9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40cc4e0 tx=0x7f5ec0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 -- 172.21.15.50:0/25107287 shutdown_connections 2024-09-13T15:08:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 --2- 172.21.15.50:0/25107287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40b19f0 0x7f5ed406a9b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 --2- 172.21.15.50:0/25107287 >> v2:172.21.15.181:3300/0 conn(0x7f5ed406a5d0 0x7f5ed4071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 -- 172.21.15.50:0/25107287 >> 172.21.15.50:0/25107287 conn(0x7f5ed40b08d0 msgr2=0x7f5ed40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 -- 172.21.15.50:0/25107287 shutdown_connections 2024-09-13T15:08:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.717+0000 7f5edbe00700 1 -- 172.21.15.50:0/25107287 wait complete. 2024-09-13T15:08:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 Processor -- start 2024-09-13T15:08:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 -- start start 2024-09-13T15:08:08.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 0x7f5ed41458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed40b19f0 0x7f5ed41f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40cd610 0x7f5ed4146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed41f7800 con 0x7f5ed40cd610 2024-09-13T15:08:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed41474a0 con 0x7f5ed40b19f0 2024-09-13T15:08:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.721+0000 7f5edbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed41f6800 con 0x7f5ed406a5d0 2024-09-13T15:08:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 0x7f5ed41458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 0x7f5ed41458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36042/0 (socket says 172.21.15.50:36042) 2024-09-13T15:08:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 -- 172.21.15.50:0/4042917732 learned_addr learned my addr 172.21.15.50:0/4042917732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9e00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40cd610 0x7f5ed4146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed8a00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed40b19f0 0x7f5ed41f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 -- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed40b19f0 msgr2=0x7f5ed41f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed40b19f0 0x7f5ed41f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 -- 172.21.15.50:0/4042917732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40cd610 msgr2=0x7f5ed4146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40cd610 0x7f5ed4146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 -- 172.21.15.50:0/4042917732 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009570 con 0x7f5ed406a5d0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9e00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40cd610 0x7f5ed4146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed9400700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 0x7f5ed41458b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800c7c0 tx=0x7f5ec800cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8011800 con 0x7f5ed406a5d0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed4147700 con 0x7f5ed406a5d0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec8011960 con 0x7f5ed406a5d0 2024-09-13T15:08:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8011cf0 con 0x7f5ed406a5d0 2024-09-13T15:08:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed41f6ac0 con 0x7f5ed406a5d0 2024-09-13T15:08:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.725+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed40cda40 con 0x7f5ed406a5d0 2024-09-13T15:08:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.729+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ec8021350 con 0x7f5ed406a5d0 2024-09-13T15:08:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.729+0000 7f5ed1600700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5eb4066730 0x7f5eb4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.729+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ec8084320 con 0x7f5ed406a5d0 2024-09-13T15:08:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.733+0000 7f5ed8a00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5eb4066730 0x7f5eb4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.733+0000 7f5ed8a00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5eb4066730 0x7f5eb4068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40cc4e0 tx=0x7f5ec0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:08.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.741+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ec8051310 con 0x7f5ed406a5d0 2024-09-13T15:08:08.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.933+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ed406c970 con 0x7f5eb4066730 2024-09-13T15:08:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.949+0000 7f5ed1600700 1 -- 172.21.15.50:0/4042917732 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345012 (secure 0 0 0) 0x7f5ec00041e0 con 0x7f5eb4066730 2024-09-13T15:08:08.954 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5eb4066730 msgr2=0x7f5eb4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5eb4066730 0x7f5eb4068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40cc4e0 tx=0x7f5ec0008030 comp rx=0 tx=0).stop 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 msgr2=0x7f5ed41458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 0x7f5ed41458b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800c7c0 tx=0x7f5ec800cad0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 shutdown_connections 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5eb4066730 0x7f5eb4068bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed40cd610 0x7f5ed4146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed40b19f0 0x7f5ed41f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 --2- 172.21.15.50:0/4042917732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ed406a5d0 0x7f5ed41458b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 >> 172.21.15.50:0/4042917732 conn(0x7f5ed40b08d0 msgr2=0x7f5ed41495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 shutdown_connections 2024-09-13T15:08:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:08.961+0000 7f5edbe00700 1 -- 172.21.15.50:0/4042917732 wait complete. 2024-09-13T15:08:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:08:08.984 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-13T15:08:08.018599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":3272704,"data_stored":1985105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004610"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509590+0000","last_change":"2024-09-13T15:07:37.013443+0000","last_active":"2024-09-13T15:07:41.509590+0000","last_peered":"2024-09-13T15:07:41.509590+0000","last_clean":"2024-09-13T15:07:41.509590+0000","last_became_active":"2024-09-13T15:07:37.013084+0000","last_became_peered":"2024-09-13T15:07:37.013084+0000","last_unstale":"2024-09-13T15:07:41.509590+0000","last_undegraded":"2024-09-13T15:07:41.509590+0000","last_fullsized":"2024-09-13T15:07:41.509590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506356+0000","last_change":"2024-09-13T15:07:37.504754+0000","last_active":"2024-09-13T15:07:41.506356+0000","last_peered":"2024-09-13T15:07:41.506356+0000","last_clean":"2024-09-13T15:07:41.506356+0000","last_became_active":"2024-09-13T15:07:37.504435+0000","last_became_peered":"2024-09-13T15:07:37.504435+0000","last_unstale":"2024-09-13T15:07:41.506356+0000","last_undegraded":"2024-09-13T15:07:41.506356+0000","last_fullsized":"2024-09-13T15:07:41.506356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.009718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.579608+0000","last_change":"2024-09-13T15:07:41.576894+0000","last_active":"2024-09-13T15:07:41.579608+0000","last_peered":"2024-09-13T15:07:41.579608+0000","last_clean":"2024-09-13T15:07:41.579608+0000","last_became_active":"2024-09-13T15:07:41.574143+0000","last_became_peered":"2024-09-13T15:07:41.574143+0000","last_unstale":"2024-09-13T15:07:41.579608+0000","last_undegraded":"2024-09-13T15:07:41.579608+0000","last_fullsized":"2024-09-13T15:07:41.579608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:50.141042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506583+0000","last_change":"2024-09-13T15:07:37.004216+0000","last_active":"2024-09-13T15:07:41.506583+0000","last_peered":"2024-09-13T15:07:41.506583+0000","last_clean":"2024-09-13T15:07:41.506583+0000","last_became_active":"2024-09-13T15:07:37.003718+0000","last_became_peered":"2024-09-13T15:07:37.003718+0000","last_unstale":"2024-09-13T15:07:41.506583+0000","last_undegraded":"2024-09-13T15:07:41.506583+0000","last_fullsized":"2024-09-13T15:07:41.506583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509367+0000","last_change":"2024-09-13T15:07:37.503439+0000","last_active":"2024-09-13T15:07:41.509367+0000","last_peered":"2024-09-13T15:07:41.509367+0000","last_clean":"2024-09-13T15:07:41.509367+0000","last_became_active":"2024-09-13T15:07:37.502983+0000","last_became_peered":"2024-09-13T15:07:37.502983+0000","last_unstale":"2024-09-13T15:07:41.509367+0000","last_undegraded":"2024-09-13T15:07:41.509367+0000","last_fullsized":"2024-09-13T15:07:41.509367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538359+0000","last_change":"2024-09-13T15:07:41.534320+0000","last_active":"2024-09-13T15:07:41.538359+0000","last_peered":"2024-09-13T15:07:41.538359+0000","last_clean":"2024-09-13T15:07:41.538359+0000","last_became_active":"2024-09-13T15:07:41.533553+0000","last_became_peered":"2024-09-13T15:07:41.533553+0000","last_unstale":"2024-09-13T15:07:41.538359+0000","last_undegraded":"2024-09-13T15:07:41.538359+0000","last_fullsized":"2024-09-13T15:07:41.538359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:39.809595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565838+0000","last_change":"2024-09-13T15:07:37.015988+0000","last_active":"2024-09-13T15:07:41.565838+0000","last_peered":"2024-09-13T15:07:41.565838+0000","last_clean":"2024-09-13T15:07:41.565838+0000","last_became_active":"2024-09-13T15:07:37.015680+0000","last_became_peered":"2024-09-13T15:07:37.015680+0000","last_unstale":"2024-09-13T15:07:41.565838+0000","last_undegraded":"2024-09-13T15:07:41.565838+0000","last_fullsized":"2024-09-13T15:07:41.565838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:31.567643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502115+0000","last_change":"2024-09-13T15:07:37.514328+0000","last_active":"2024-09-13T15:07:41.502115+0000","last_peered":"2024-09-13T15:07:41.502115+0000","last_clean":"2024-09-13T15:07:41.502115+0000","last_became_active":"2024-09-13T15:07:37.514028+0000","last_became_peered":"2024-09-13T15:07:37.514028+0000","last_unstale":"2024-09-13T15:07:41.502115+0000","last_undegraded":"2024-09-13T15:07:41.502115+0000","last_fullsized":"2024-09-13T15:07:41.502115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538321+0000","last_change":"2024-09-13T15:07:41.534029+0000","last_active":"2024-09-13T15:07:41.538321+0000","last_peered":"2024-09-13T15:07:41.538321+0000","last_clean":"2024-09-13T15:07:41.538321+0000","last_became_active":"2024-09-13T15:07:41.533515+0000","last_became_peered":"2024-09-13T15:07:41.533515+0000","last_unstale":"2024-09-13T15:07:41.538321+0000","last_undegraded":"2024-09-13T15:07:41.538321+0000","last_fullsized":"2024-09-13T15:07:41.538321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564972+0000","last_change":"2024-09-13T15:07:37.017205+0000","last_active":"2024-09-13T15:07:41.564972+0000","last_peered":"2024-09-13T15:07:41.564972+0000","last_clean":"2024-09-13T15:07:41.564972+0000","last_became_active":"2024-09-13T15:07:37.016766+0000","last_became_peered":"2024-09-13T15:07:37.016766+0000","last_unstale":"2024-09-13T15:07:41.564972+0000","last_undegraded":"2024-09-13T15:07:41.564972+0000","last_fullsized":"2024-09-13T15:07:41.564972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505404+0000","last_change":"2024-09-13T15:07:37.502428+0000","last_active":"2024-09-13T15:07:41.505404+0000","last_peered":"2024-09-13T15:07:41.505404+0000","last_clean":"2024-09-13T15:07:41.505404+0000","last_became_active":"2024-09-13T15:07:37.501967+0000","last_became_peered":"2024-09-13T15:07:37.501967+0000","last_unstale":"2024-09-13T15:07:41.505404+0000","last_undegraded":"2024-09-13T15:07:41.505404+0000","last_fullsized":"2024-09-13T15:07:41.505404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538423+0000","last_change":"2024-09-13T15:07:41.534357+0000","last_active":"2024-09-13T15:07:41.538423+0000","last_peered":"2024-09-13T15:07:41.538423+0000","last_clean":"2024-09-13T15:07:41.538423+0000","last_became_active":"2024-09-13T15:07:41.533662+0000","last_became_peered":"2024-09-13T15:07:41.533662+0000","last_unstale":"2024-09-13T15:07:41.538423+0000","last_undegraded":"2024-09-13T15:07:41.538423+0000","last_fullsized":"2024-09-13T15:07:41.538423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512026+0000","last_change":"2024-09-13T15:07:37.506598+0000","last_active":"2024-09-13T15:07:41.512026+0000","last_peered":"2024-09-13T15:07:41.512026+0000","last_clean":"2024-09-13T15:07:41.512026+0000","last_became_active":"2024-09-13T15:07:37.506317+0000","last_became_peered":"2024-09-13T15:07:37.506317+0000","last_unstale":"2024-09-13T15:07:41.512026+0000","last_undegraded":"2024-09-13T15:07:41.512026+0000","last_fullsized":"2024-09-13T15:07:41.512026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564777+0000","last_change":"2024-09-13T15:07:37.017573+0000","last_active":"2024-09-13T15:07:41.564777+0000","last_peered":"2024-09-13T15:07:41.564777+0000","last_clean":"2024-09-13T15:07:41.564777+0000","last_became_active":"2024-09-13T15:07:37.017395+0000","last_became_peered":"2024-09-13T15:07:37.017395+0000","last_unstale":"2024-09-13T15:07:41.564777+0000","last_undegraded":"2024-09-13T15:07:41.564777+0000","last_fullsized":"2024-09-13T15:07:41.564777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:47.432256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527945+0000","last_change":"2024-09-13T15:07:41.525024+0000","last_active":"2024-09-13T15:07:41.527945+0000","last_peered":"2024-09-13T15:07:41.527945+0000","last_clean":"2024-09-13T15:07:41.527945+0000","last_became_active":"2024-09-13T15:07:41.524498+0000","last_became_peered":"2024-09-13T15:07:41.524498+0000","last_unstale":"2024-09-13T15:07:41.527945+0000","last_undegraded":"2024-09-13T15:07:41.527945+0000","last_fullsized":"2024-09-13T15:07:41.527945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:16.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505218+0000","last_change":"2024-09-13T15:07:37.489676+0000","last_active":"2024-09-13T15:07:41.505218+0000","last_peered":"2024-09-13T15:07:41.505218+0000","last_clean":"2024-09-13T15:07:41.505218+0000","last_became_active":"2024-09-13T15:07:37.487946+0000","last_became_peered":"2024-09-13T15:07:37.487946+0000","last_unstale":"2024-09-13T15:07:41.505218+0000","last_undegraded":"2024-09-13T15:07:41.505218+0000","last_fullsized":"2024-09-13T15:07:41.505218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.522108+0000","last_change":"2024-09-13T15:07:37.012004+0000","last_active":"2024-09-13T15:07:41.522108+0000","last_peered":"2024-09-13T15:07:41.522108+0000","last_clean":"2024-09-13T15:07:41.522108+0000","last_became_active":"2024-09-13T15:07:37.011199+0000","last_became_peered":"2024-09-13T15:07:37.011199+0000","last_unstale":"2024-09-13T15:07:41.522108+0000","last_undegraded":"2024-09-13T15:07:41.522108+0000","last_fullsized":"2024-09-13T15:07:41.522108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538485+0000","last_change":"2024-09-13T15:07:41.535177+0000","last_active":"2024-09-13T15:07:41.538485+0000","last_peered":"2024-09-13T15:07:41.538485+0000","last_clean":"2024-09-13T15:07:41.538485+0000","last_became_active":"2024-09-13T15:07:41.533912+0000","last_became_peered":"2024-09-13T15:07:41.533912+0000","last_unstale":"2024-09-13T15:07:41.538485+0000","last_undegraded":"2024-09-13T15:07:41.538485+0000","last_fullsized":"2024-09-13T15:07:41.538485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523603+0000","last_change":"2024-09-13T15:07:37.495579+0000","last_active":"2024-09-13T15:07:41.523603+0000","last_peered":"2024-09-13T15:07:41.523603+0000","last_clean":"2024-09-13T15:07:41.523603+0000","last_became_active":"2024-09-13T15:07:37.495337+0000","last_became_peered":"2024-09-13T15:07:37.495337+0000","last_unstale":"2024-09-13T15:07:41.523603+0000","last_undegraded":"2024-09-13T15:07:41.523603+0000","last_fullsized":"2024-09-13T15:07:41.523603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521968+0000","last_change":"2024-09-13T15:07:37.013081+0000","last_active":"2024-09-13T15:07:41.521968+0000","last_peered":"2024-09-13T15:07:41.521968+0000","last_clean":"2024-09-13T15:07:41.521968+0000","last_became_active":"2024-09-13T15:07:37.012821+0000","last_became_peered":"2024-09-13T15:07:37.012821+0000","last_unstale":"2024-09-13T15:07:41.521968+0000","last_undegraded":"2024-09-13T15:07:41.521968+0000","last_fullsized":"2024-09-13T15:07:41.521968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577610+0000","last_change":"2024-09-13T15:07:41.572919+0000","last_active":"2024-09-13T15:07:41.577610+0000","last_peered":"2024-09-13T15:07:41.577610+0000","last_clean":"2024-09-13T15:07:41.577610+0000","last_became_active":"2024-09-13T15:07:41.572534+0000","last_became_peered":"2024-09-13T15:07:41.572534+0000","last_unstale":"2024-09-13T15:07:41.577610+0000","last_undegraded":"2024-09-13T15:07:41.577610+0000","last_fullsized":"2024-09-13T15:07:41.577610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503792+0000","last_change":"2024-09-13T15:07:37.484624+0000","last_active":"2024-09-13T15:07:41.503792+0000","last_peered":"2024-09-13T15:07:41.503792+0000","last_clean":"2024-09-13T15:07:41.503792+0000","last_became_active":"2024-09-13T15:07:37.484236+0000","last_became_peered":"2024-09-13T15:07:37.484236+0000","last_unstale":"2024-09-13T15:07:41.503792+0000","last_undegraded":"2024-09-13T15:07:41.503792+0000","last_fullsized":"2024-09-13T15:07:41.503792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:25.167980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.563720+0000","last_change":"2024-09-13T15:07:37.016581+0000","last_active":"2024-09-13T15:07:41.563720+0000","last_peered":"2024-09-13T15:07:41.563720+0000","last_clean":"2024-09-13T15:07:41.563720+0000","last_became_active":"2024-09-13T15:07:37.016253+0000","last_became_peered":"2024-09-13T15:07:37.016253+0000","last_unstale":"2024-09-13T15:07:41.563720+0000","last_undegraded":"2024-09-13T15:07:41.563720+0000","last_fullsized":"2024-09-13T15:07:41.563720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538474+0000","last_change":"2024-09-13T15:07:41.534781+0000","last_active":"2024-09-13T15:07:41.538474+0000","last_peered":"2024-09-13T15:07:41.538474+0000","last_clean":"2024-09-13T15:07:41.538474+0000","last_became_active":"2024-09-13T15:07:41.533999+0000","last_became_peered":"2024-09-13T15:07:41.533999+0000","last_unstale":"2024-09-13T15:07:41.538474+0000","last_undegraded":"2024-09-13T15:07:41.538474+0000","last_fullsized":"2024-09-13T15:07:41.538474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512002+0000","last_change":"2024-09-13T15:07:37.494214+0000","last_active":"2024-09-13T15:07:41.512002+0000","last_peered":"2024-09-13T15:07:41.512002+0000","last_clean":"2024-09-13T15:07:41.512002+0000","last_became_active":"2024-09-13T15:07:37.493854+0000","last_became_peered":"2024-09-13T15:07:37.493854+0000","last_unstale":"2024-09-13T15:07:41.512002+0000","last_undegraded":"2024-09-13T15:07:41.512002+0000","last_fullsized":"2024-09-13T15:07:41.512002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516503+0000","last_change":"2024-09-13T15:07:37.007466+0000","last_active":"2024-09-13T15:07:41.516503+0000","last_peered":"2024-09-13T15:07:41.516503+0000","last_clean":"2024-09-13T15:07:41.516503+0000","last_became_active":"2024-09-13T15:07:37.007189+0000","last_became_peered":"2024-09-13T15:07:37.007189+0000","last_unstale":"2024-09-13T15:07:41.516503+0000","last_undegraded":"2024-09-13T15:07:41.516503+0000","last_fullsized":"2024-09-13T15:07:41.516503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576271+0000","last_change":"2024-09-13T15:07:41.572185+0000","last_active":"2024-09-13T15:07:41.576271+0000","last_peered":"2024-09-13T15:07:41.576271+0000","last_clean":"2024-09-13T15:07:41.576271+0000","last_became_active":"2024-09-13T15:07:41.571676+0000","last_became_peered":"2024-09-13T15:07:41.571676+0000","last_unstale":"2024-09-13T15:07:41.576271+0000","last_undegraded":"2024-09-13T15:07:41.576271+0000","last_fullsized":"2024-09-13T15:07:41.576271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:11.973002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.510056+0000","last_change":"2024-09-13T15:07:37.503628+0000","last_active":"2024-09-13T15:07:41.510056+0000","last_peered":"2024-09-13T15:07:41.510056+0000","last_clean":"2024-09-13T15:07:41.510056+0000","last_became_active":"2024-09-13T15:07:37.503337+0000","last_became_peered":"2024-09-13T15:07:37.503337+0000","last_unstale":"2024-09-13T15:07:41.510056+0000","last_undegraded":"2024-09-13T15:07:41.510056+0000","last_fullsized":"2024-09-13T15:07:41.510056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:42.582773+0000","last_change":"2024-09-13T15:07:37.010802+0000","last_active":"2024-09-13T15:07:42.582773+0000","last_peered":"2024-09-13T15:07:42.582773+0000","last_clean":"2024-09-13T15:07:42.582773+0000","last_became_active":"2024-09-13T15:07:37.010516+0000","last_became_peered":"2024-09-13T15:07:37.010516+0000","last_unstale":"2024-09-13T15:07:42.582773+0000","last_undegraded":"2024-09-13T15:07:42.582773+0000","last_fullsized":"2024-09-13T15:07:42.582773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575285+0000","last_change":"2024-09-13T15:07:41.570403+0000","last_active":"2024-09-13T15:07:41.575285+0000","last_peered":"2024-09-13T15:07:41.575285+0000","last_clean":"2024-09-13T15:07:41.575285+0000","last_became_active":"2024-09-13T15:07:41.569731+0000","last_became_peered":"2024-09-13T15:07:41.569731+0000","last_unstale":"2024-09-13T15:07:41.575285+0000","last_undegraded":"2024-09-13T15:07:41.575285+0000","last_fullsized":"2024-09-13T15:07:41.575285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:47.336008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525415+0000","last_change":"2024-09-13T15:07:37.487456+0000","last_active":"2024-09-13T15:07:41.525415+0000","last_peered":"2024-09-13T15:07:41.525415+0000","last_clean":"2024-09-13T15:07:41.525415+0000","last_became_active":"2024-09-13T15:07:37.487227+0000","last_became_peered":"2024-09-13T15:07:37.487227+0000","last_unstale":"2024-09-13T15:07:41.525415+0000","last_undegraded":"2024-09-13T15:07:41.525415+0000","last_fullsized":"2024-09-13T15:07:41.525415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566354+0000","last_change":"2024-09-13T15:07:37.015462+0000","last_active":"2024-09-13T15:07:41.566354+0000","last_peered":"2024-09-13T15:07:41.566354+0000","last_clean":"2024-09-13T15:07:41.566354+0000","last_became_active":"2024-09-13T15:07:37.015202+0000","last_became_peered":"2024-09-13T15:07:37.015202+0000","last_unstale":"2024-09-13T15:07:41.566354+0000","last_undegraded":"2024-09-13T15:07:41.566354+0000","last_fullsized":"2024-09-13T15:07:41.566354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576630+0000","last_change":"2024-09-13T15:07:41.568111+0000","last_active":"2024-09-13T15:07:41.576630+0000","last_peered":"2024-09-13T15:07:41.576630+0000","last_clean":"2024-09-13T15:07:41.576630+0000","last_became_active":"2024-09-13T15:07:41.567207+0000","last_became_peered":"2024-09-13T15:07:41.567207+0000","last_unstale":"2024-09-13T15:07:41.576630+0000","last_undegraded":"2024-09-13T15:07:41.576630+0000","last_fullsized":"2024-09-13T15:07:41.576630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505482+0000","last_change":"2024-09-13T15:07:37.495265+0000","last_active":"2024-09-13T15:07:41.505482+0000","last_peered":"2024-09-13T15:07:41.505482+0000","last_clean":"2024-09-13T15:07:41.505482+0000","last_became_active":"2024-09-13T15:07:37.494954+0000","last_became_peered":"2024-09-13T15:07:37.494954+0000","last_unstale":"2024-09-13T15:07:41.505482+0000","last_undegraded":"2024-09-13T15:07:41.505482+0000","last_fullsized":"2024-09-13T15:07:41.505482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525500+0000","last_change":"2024-09-13T15:07:37.012286+0000","last_active":"2024-09-13T15:07:41.525500+0000","last_peered":"2024-09-13T15:07:41.525500+0000","last_clean":"2024-09-13T15:07:41.525500+0000","last_became_active":"2024-09-13T15:07:37.010271+0000","last_became_peered":"2024-09-13T15:07:37.010271+0000","last_unstale":"2024-09-13T15:07:41.525500+0000","last_undegraded":"2024-09-13T15:07:41.525500+0000","last_fullsized":"2024-09-13T15:07:41.525500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539227+0000","last_change":"2024-09-13T15:07:41.535358+0000","last_active":"2024-09-13T15:07:41.539227+0000","last_peered":"2024-09-13T15:07:41.539227+0000","last_clean":"2024-09-13T15:07:41.539227+0000","last_became_active":"2024-09-13T15:07:41.534907+0000","last_became_peered":"2024-09-13T15:07:41.534907+0000","last_unstale":"2024-09-13T15:07:41.539227+0000","last_undegraded":"2024-09-13T15:07:41.539227+0000","last_fullsized":"2024-09-13T15:07:41.539227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506408+0000","last_change":"2024-09-13T15:07:37.513201+0000","last_active":"2024-09-13T15:07:41.506408+0000","last_peered":"2024-09-13T15:07:41.506408+0000","last_clean":"2024-09-13T15:07:41.506408+0000","last_became_active":"2024-09-13T15:07:37.512914+0000","last_became_peered":"2024-09-13T15:07:37.512914+0000","last_unstale":"2024-09-13T15:07:41.506408+0000","last_undegraded":"2024-09-13T15:07:41.506408+0000","last_fullsized":"2024-09-13T15:07:41.506408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503150+0000","last_change":"2024-09-13T15:07:37.007476+0000","last_active":"2024-09-13T15:07:41.503150+0000","last_peered":"2024-09-13T15:07:41.503150+0000","last_clean":"2024-09-13T15:07:41.503150+0000","last_became_active":"2024-09-13T15:07:37.006888+0000","last_became_peered":"2024-09-13T15:07:37.006888+0000","last_unstale":"2024-09-13T15:07:41.503150+0000","last_undegraded":"2024-09-13T15:07:41.503150+0000","last_fullsized":"2024-09-13T15:07:41.503150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538962+0000","last_change":"2024-09-13T15:07:41.535459+0000","last_active":"2024-09-13T15:07:41.538962+0000","last_peered":"2024-09-13T15:07:41.538962+0000","last_clean":"2024-09-13T15:07:41.538962+0000","last_became_active":"2024-09-13T15:07:41.534918+0000","last_became_peered":"2024-09-13T15:07:41.534918+0000","last_unstale":"2024-09-13T15:07:41.538962+0000","last_undegraded":"2024-09-13T15:07:41.538962+0000","last_fullsized":"2024-09-13T15:07:41.538962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521735+0000","last_change":"2024-09-13T15:07:37.492499+0000","last_active":"2024-09-13T15:07:41.521735+0000","last_peered":"2024-09-13T15:07:41.521735+0000","last_clean":"2024-09-13T15:07:41.521735+0000","last_became_active":"2024-09-13T15:07:37.492144+0000","last_became_peered":"2024-09-13T15:07:37.492144+0000","last_unstale":"2024-09-13T15:07:41.521735+0000","last_undegraded":"2024-09-13T15:07:41.521735+0000","last_fullsized":"2024-09-13T15:07:41.521735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505110+0000","last_change":"2024-09-13T15:07:37.006492+0000","last_active":"2024-09-13T15:07:41.505110+0000","last_peered":"2024-09-13T15:07:41.505110+0000","last_clean":"2024-09-13T15:07:41.505110+0000","last_became_active":"2024-09-13T15:07:37.004955+0000","last_became_peered":"2024-09-13T15:07:37.004955+0000","last_unstale":"2024-09-13T15:07:41.505110+0000","last_undegraded":"2024-09-13T15:07:41.505110+0000","last_fullsized":"2024-09-13T15:07:41.505110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539457+0000","last_change":"2024-09-13T15:07:41.536499+0000","last_active":"2024-09-13T15:07:41.539457+0000","last_peered":"2024-09-13T15:07:41.539457+0000","last_clean":"2024-09-13T15:07:41.539457+0000","last_became_active":"2024-09-13T15:07:41.536051+0000","last_became_peered":"2024-09-13T15:07:41.536051+0000","last_unstale":"2024-09-13T15:07:41.539457+0000","last_undegraded":"2024-09-13T15:07:41.539457+0000","last_fullsized":"2024-09-13T15:07:41.539457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506936+0000","last_change":"2024-09-13T15:07:37.491784+0000","last_active":"2024-09-13T15:07:41.506936+0000","last_peered":"2024-09-13T15:07:41.506936+0000","last_clean":"2024-09-13T15:07:41.506936+0000","last_became_active":"2024-09-13T15:07:37.491544+0000","last_became_peered":"2024-09-13T15:07:37.491544+0000","last_unstale":"2024-09-13T15:07:41.506936+0000","last_undegraded":"2024-09-13T15:07:41.506936+0000","last_fullsized":"2024-09-13T15:07:41.506936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:13.919211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564277+0000","last_change":"2024-09-13T15:07:37.014778+0000","last_active":"2024-09-13T15:07:41.564277+0000","last_peered":"2024-09-13T15:07:41.564277+0000","last_clean":"2024-09-13T15:07:41.564277+0000","last_became_active":"2024-09-13T15:07:37.014475+0000","last_became_peered":"2024-09-13T15:07:37.014475+0000","last_unstale":"2024-09-13T15:07:41.564277+0000","last_undegraded":"2024-09-13T15:07:41.564277+0000","last_fullsized":"2024-09-13T15:07:41.564277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577706+0000","last_change":"2024-09-13T15:07:41.572783+0000","last_active":"2024-09-13T15:07:41.577706+0000","last_peered":"2024-09-13T15:07:41.577706+0000","last_clean":"2024-09-13T15:07:41.577706+0000","last_became_active":"2024-09-13T15:07:41.571654+0000","last_became_peered":"2024-09-13T15:07:41.571654+0000","last_unstale":"2024-09-13T15:07:41.577706+0000","last_undegraded":"2024-09-13T15:07:41.577706+0000","last_fullsized":"2024-09-13T15:07:41.577706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.506083+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.505793+0000","last_became_peered":"2024-09-13T15:07:37.505793+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503229+0000","last_change":"2024-09-13T15:07:36.995886+0000","last_active":"2024-09-13T15:07:41.503229+0000","last_peered":"2024-09-13T15:07:41.503229+0000","last_clean":"2024-09-13T15:07:41.503229+0000","last_became_active":"2024-09-13T15:07:36.995560+0000","last_became_peered":"2024-09-13T15:07:36.995560+0000","last_unstale":"2024-09-13T15:07:41.503229+0000","last_undegraded":"2024-09-13T15:07:41.503229+0000","last_fullsized":"2024-09-13T15:07:41.503229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564508+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:07:41.564508+0000","last_peered":"2024-09-13T15:07:41.564508+0000","last_clean":"2024-09-13T15:07:41.564508+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:07:41.564508+0000","last_undegraded":"2024-09-13T15:07:41.564508+0000","last_fullsized":"2024-09-13T15:07:41.564508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573389+0000","last_change":"2024-09-13T15:07:41.568736+0000","last_active":"2024-09-13T15:07:41.573389+0000","last_peered":"2024-09-13T15:07:41.573389+0000","last_clean":"2024-09-13T15:07:41.573389+0000","last_became_active":"2024-09-13T15:07:41.568356+0000","last_became_peered":"2024-09-13T15:07:41.568356+0000","last_unstale":"2024-09-13T15:07:41.573389+0000","last_undegraded":"2024-09-13T15:07:41.573389+0000","last_fullsized":"2024-09-13T15:07:41.573389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:32.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565674+0000","last_change":"2024-09-13T15:07:37.500315+0000","last_active":"2024-09-13T15:07:41.565674+0000","last_peered":"2024-09-13T15:07:41.565674+0000","last_clean":"2024-09-13T15:07:41.565674+0000","last_became_active":"2024-09-13T15:07:37.499912+0000","last_became_peered":"2024-09-13T15:07:37.499912+0000","last_unstale":"2024-09-13T15:07:41.565674+0000","last_undegraded":"2024-09-13T15:07:41.565674+0000","last_fullsized":"2024-09-13T15:07:41.565674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511110+0000","last_change":"2024-09-13T15:07:37.005731+0000","last_active":"2024-09-13T15:07:41.511110+0000","last_peered":"2024-09-13T15:07:41.511110+0000","last_clean":"2024-09-13T15:07:41.511110+0000","last_became_active":"2024-09-13T15:07:37.005196+0000","last_became_peered":"2024-09-13T15:07:37.005196+0000","last_unstale":"2024-09-13T15:07:41.511110+0000","last_undegraded":"2024-09-13T15:07:41.511110+0000","last_fullsized":"2024-09-13T15:07:41.511110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.567559+0000","last_change":"2024-09-13T15:07:41.565589+0000","last_active":"2024-09-13T15:07:41.567559+0000","last_peered":"2024-09-13T15:07:41.567559+0000","last_clean":"2024-09-13T15:07:41.567559+0000","last_became_active":"2024-09-13T15:07:41.565135+0000","last_became_peered":"2024-09-13T15:07:41.565135+0000","last_unstale":"2024-09-13T15:07:41.567559+0000","last_undegraded":"2024-09-13T15:07:41.567559+0000","last_fullsized":"2024-09-13T15:07:41.567559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:41.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504783+0000","last_change":"2024-09-13T15:07:37.494952+0000","last_active":"2024-09-13T15:07:41.504783+0000","last_peered":"2024-09-13T15:07:41.504783+0000","last_clean":"2024-09-13T15:07:41.504783+0000","last_became_active":"2024-09-13T15:07:37.494616+0000","last_became_peered":"2024-09-13T15:07:37.494616+0000","last_unstale":"2024-09-13T15:07:41.504783+0000","last_undegraded":"2024-09-13T15:07:41.504783+0000","last_fullsized":"2024-09-13T15:07:41.504783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526436+0000","last_change":"2024-09-13T15:07:37.016938+0000","last_active":"2024-09-13T15:07:41.526436+0000","last_peered":"2024-09-13T15:07:41.526436+0000","last_clean":"2024-09-13T15:07:41.526436+0000","last_became_active":"2024-09-13T15:07:37.016416+0000","last_became_peered":"2024-09-13T15:07:37.016416+0000","last_unstale":"2024-09-13T15:07:41.526436+0000","last_undegraded":"2024-09-13T15:07:41.526436+0000","last_fullsized":"2024-09-13T15:07:41.526436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533876+0000","last_change":"2024-09-13T15:07:41.530568+0000","last_active":"2024-09-13T15:07:41.533876+0000","last_peered":"2024-09-13T15:07:41.533876+0000","last_clean":"2024-09-13T15:07:41.533876+0000","last_became_active":"2024-09-13T15:07:41.528769+0000","last_became_peered":"2024-09-13T15:07:41.528769+0000","last_unstale":"2024-09-13T15:07:41.533876+0000","last_undegraded":"2024-09-13T15:07:41.533876+0000","last_fullsized":"2024-09-13T15:07:41.533876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:21.253459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566675+0000","last_change":"2024-09-13T15:07:37.516289+0000","last_active":"2024-09-13T15:07:41.566675+0000","last_peered":"2024-09-13T15:07:41.566675+0000","last_clean":"2024-09-13T15:07:41.566675+0000","last_became_active":"2024-09-13T15:07:37.515469+0000","last_became_peered":"2024-09-13T15:07:37.515469+0000","last_unstale":"2024-09-13T15:07:41.566675+0000","last_undegraded":"2024-09-13T15:07:41.566675+0000","last_fullsized":"2024-09-13T15:07:41.566675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505710+0000","last_change":"2024-09-13T15:07:37.004010+0000","last_active":"2024-09-13T15:07:41.505710+0000","last_peered":"2024-09-13T15:07:41.505710+0000","last_clean":"2024-09-13T15:07:41.505710+0000","last_became_active":"2024-09-13T15:07:37.003685+0000","last_became_peered":"2024-09-13T15:07:37.003685+0000","last_unstale":"2024-09-13T15:07:41.505710+0000","last_undegraded":"2024-09-13T15:07:41.505710+0000","last_fullsized":"2024-09-13T15:07:41.505710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.571567+0000","last_change":"2024-09-13T15:07:41.570035+0000","last_active":"2024-09-13T15:07:41.571567+0000","last_peered":"2024-09-13T15:07:41.571567+0000","last_clean":"2024-09-13T15:07:41.571567+0000","last_became_active":"2024-09-13T15:07:41.566940+0000","last_became_peered":"2024-09-13T15:07:41.566940+0000","last_unstale":"2024-09-13T15:07:41.571567+0000","last_undegraded":"2024-09-13T15:07:41.571567+0000","last_fullsized":"2024-09-13T15:07:41.571567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565356+0000","last_change":"2024-09-13T15:07:37.519128+0000","last_active":"2024-09-13T15:07:41.565356+0000","last_peered":"2024-09-13T15:07:41.565356+0000","last_clean":"2024-09-13T15:07:41.565356+0000","last_became_active":"2024-09-13T15:07:37.518869+0000","last_became_peered":"2024-09-13T15:07:37.518869+0000","last_unstale":"2024-09-13T15:07:41.565356+0000","last_undegraded":"2024-09-13T15:07:41.565356+0000","last_fullsized":"2024-09-13T15:07:41.565356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503446+0000","last_change":"2024-09-13T15:07:37.010518+0000","last_active":"2024-09-13T15:07:41.503446+0000","last_peered":"2024-09-13T15:07:41.503446+0000","last_clean":"2024-09-13T15:07:41.503446+0000","last_became_active":"2024-09-13T15:07:37.008427+0000","last_became_peered":"2024-09-13T15:07:37.008427+0000","last_unstale":"2024-09-13T15:07:41.503446+0000","last_undegraded":"2024-09-13T15:07:41.503446+0000","last_fullsized":"2024-09-13T15:07:41.503446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.536864+0000","last_change":"2024-09-13T15:07:41.532322+0000","last_active":"2024-09-13T15:07:41.536864+0000","last_peered":"2024-09-13T15:07:41.536864+0000","last_clean":"2024-09-13T15:07:41.536864+0000","last_became_active":"2024-09-13T15:07:41.531912+0000","last_became_peered":"2024-09-13T15:07:41.531912+0000","last_unstale":"2024-09-13T15:07:41.536864+0000","last_undegraded":"2024-09-13T15:07:41.536864+0000","last_fullsized":"2024-09-13T15:07:41.536864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:30.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564696+0000","last_change":"2024-09-13T15:07:37.515251+0000","last_active":"2024-09-13T15:07:41.564696+0000","last_peered":"2024-09-13T15:07:41.564696+0000","last_clean":"2024-09-13T15:07:41.564696+0000","last_became_active":"2024-09-13T15:07:37.514972+0000","last_became_peered":"2024-09-13T15:07:37.514972+0000","last_unstale":"2024-09-13T15:07:41.564696+0000","last_undegraded":"2024-09-13T15:07:41.564696+0000","last_fullsized":"2024-09-13T15:07:41.564696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504636+0000","last_change":"2024-09-13T15:07:37.004826+0000","last_active":"2024-09-13T15:07:41.504636+0000","last_peered":"2024-09-13T15:07:41.504636+0000","last_clean":"2024-09-13T15:07:41.504636+0000","last_became_active":"2024-09-13T15:07:37.004447+0000","last_became_peered":"2024-09-13T15:07:37.004447+0000","last_unstale":"2024-09-13T15:07:41.504636+0000","last_undegraded":"2024-09-13T15:07:41.504636+0000","last_fullsized":"2024-09-13T15:07:41.504636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.540805+0000","last_change":"2024-09-13T15:07:41.537561+0000","last_active":"2024-09-13T15:07:41.540805+0000","last_peered":"2024-09-13T15:07:41.540805+0000","last_clean":"2024-09-13T15:07:41.540805+0000","last_became_active":"2024-09-13T15:07:41.536984+0000","last_became_peered":"2024-09-13T15:07:41.536984+0000","last_unstale":"2024-09-13T15:07:41.540805+0000","last_undegraded":"2024-09-13T15:07:41.540805+0000","last_fullsized":"2024-09-13T15:07:41.540805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511993+0000","last_change":"2024-09-13T15:07:37.498344+0000","last_active":"2024-09-13T15:07:41.511993+0000","last_peered":"2024-09-13T15:07:41.511993+0000","last_clean":"2024-09-13T15:07:41.511993+0000","last_became_active":"2024-09-13T15:07:37.498068+0000","last_became_peered":"2024-09-13T15:07:37.498068+0000","last_unstale":"2024-09-13T15:07:41.511993+0000","last_undegraded":"2024-09-13T15:07:41.511993+0000","last_fullsized":"2024-09-13T15:07:41.511993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511905+0000","last_change":"2024-09-13T15:07:36.997359+0000","last_active":"2024-09-13T15:07:41.511905+0000","last_peered":"2024-09-13T15:07:41.511905+0000","last_clean":"2024-09-13T15:07:41.511905+0000","last_became_active":"2024-09-13T15:07:36.997095+0000","last_became_peered":"2024-09-13T15:07:36.997095+0000","last_unstale":"2024-09-13T15:07:41.511905+0000","last_undegraded":"2024-09-13T15:07:41.511905+0000","last_fullsized":"2024-09-13T15:07:41.511905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578693+0000","last_change":"2024-09-13T15:07:41.574687+0000","last_active":"2024-09-13T15:07:41.578693+0000","last_peered":"2024-09-13T15:07:41.578693+0000","last_clean":"2024-09-13T15:07:41.578693+0000","last_became_active":"2024-09-13T15:07:41.573353+0000","last_became_peered":"2024-09-13T15:07:41.573353+0000","last_unstale":"2024-09-13T15:07:41.578693+0000","last_undegraded":"2024-09-13T15:07:41.578693+0000","last_fullsized":"2024-09-13T15:07:41.578693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:52.778665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564643+0000","last_change":"2024-09-13T15:07:37.518920+0000","last_active":"2024-09-13T15:07:41.564643+0000","last_peered":"2024-09-13T15:07:41.564643+0000","last_clean":"2024-09-13T15:07:41.564643+0000","last_became_active":"2024-09-13T15:07:37.518651+0000","last_became_peered":"2024-09-13T15:07:37.518651+0000","last_unstale":"2024-09-13T15:07:41.564643+0000","last_undegraded":"2024-09-13T15:07:41.564643+0000","last_fullsized":"2024-09-13T15:07:41.564643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503060+0000","last_change":"2024-09-13T15:07:37.007685+0000","last_active":"2024-09-13T15:07:41.503060+0000","last_peered":"2024-09-13T15:07:41.503060+0000","last_clean":"2024-09-13T15:07:41.503060+0000","last_became_active":"2024-09-13T15:07:37.007213+0000","last_became_peered":"2024-09-13T15:07:37.007213+0000","last_unstale":"2024-09-13T15:07:41.503060+0000","last_undegraded":"2024-09-13T15:07:41.503060+0000","last_fullsized":"2024-09-13T15:07:41.503060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573282+0000","last_change":"2024-09-13T15:07:41.568051+0000","last_active":"2024-09-13T15:07:41.573282+0000","last_peered":"2024-09-13T15:07:41.573282+0000","last_clean":"2024-09-13T15:07:41.573282+0000","last_became_active":"2024-09-13T15:07:41.566715+0000","last_became_peered":"2024-09-13T15:07:41.566715+0000","last_unstale":"2024-09-13T15:07:41.573282+0000","last_undegraded":"2024-09-13T15:07:41.573282+0000","last_fullsized":"2024-09-13T15:07:41.573282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505146+0000","last_change":"2024-09-13T15:07:37.506015+0000","last_active":"2024-09-13T15:07:41.505146+0000","last_peered":"2024-09-13T15:07:41.505146+0000","last_clean":"2024-09-13T15:07:41.505146+0000","last_became_active":"2024-09-13T15:07:37.505661+0000","last_became_peered":"2024-09-13T15:07:37.505661+0000","last_unstale":"2024-09-13T15:07:41.505146+0000","last_undegraded":"2024-09-13T15:07:41.505146+0000","last_fullsized":"2024-09-13T15:07:41.505146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515345+0000","last_change":"2024-09-13T15:07:37.009882+0000","last_active":"2024-09-13T15:07:41.515345+0000","last_peered":"2024-09-13T15:07:41.515345+0000","last_clean":"2024-09-13T15:07:41.515345+0000","last_became_active":"2024-09-13T15:07:37.009351+0000","last_became_peered":"2024-09-13T15:07:37.009351+0000","last_unstale":"2024-09-13T15:07:41.515345+0000","last_undegraded":"2024-09-13T15:07:41.515345+0000","last_fullsized":"2024-09-13T15:07:41.515345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575567+0000","last_change":"2024-09-13T15:07:41.571228+0000","last_active":"2024-09-13T15:07:41.575567+0000","last_peered":"2024-09-13T15:07:41.575567+0000","last_clean":"2024-09-13T15:07:41.575567+0000","last_became_active":"2024-09-13T15:07:41.570618+0000","last_became_peered":"2024-09-13T15:07:41.570618+0000","last_unstale":"2024-09-13T15:07:41.575567+0000","last_undegraded":"2024-09-13T15:07:41.575567+0000","last_fullsized":"2024-09-13T15:07:41.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:29.764351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565542+0000","last_change":"2024-09-13T15:07:37.500097+0000","last_active":"2024-09-13T15:07:41.565542+0000","last_peered":"2024-09-13T15:07:41.565542+0000","last_clean":"2024-09-13T15:07:41.565542+0000","last_became_active":"2024-09-13T15:07:37.499700+0000","last_became_peered":"2024-09-13T15:07:37.499700+0000","last_unstale":"2024-09-13T15:07:41.565542+0000","last_undegraded":"2024-09-13T15:07:41.565542+0000","last_fullsized":"2024-09-13T15:07:41.565542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:54.189933+0000","last_change":"2024-09-13T15:07:37.004068+0000","last_active":"2024-09-13T15:07:54.189933+0000","last_peered":"2024-09-13T15:07:54.189933+0000","last_clean":"2024-09-13T15:07:54.189933+0000","last_became_active":"2024-09-13T15:07:37.003828+0000","last_became_peered":"2024-09-13T15:07:37.003828+0000","last_unstale":"2024-09-13T15:07:54.189933+0000","last_undegraded":"2024-09-13T15:07:54.189933+0000","last_fullsized":"2024-09-13T15:07:54.189933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533775+0000","last_change":"2024-09-13T15:07:41.531428+0000","last_active":"2024-09-13T15:07:41.533775+0000","last_peered":"2024-09-13T15:07:41.533775+0000","last_clean":"2024-09-13T15:07:41.533775+0000","last_became_active":"2024-09-13T15:07:41.531005+0000","last_became_peered":"2024-09-13T15:07:41.531005+0000","last_unstale":"2024-09-13T15:07:41.533775+0000","last_undegraded":"2024-09-13T15:07:41.533775+0000","last_fullsized":"2024-09-13T15:07:41.533775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:12.805480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504532+0000","last_change":"2024-09-13T15:07:37.515016+0000","last_active":"2024-09-13T15:07:41.504532+0000","last_peered":"2024-09-13T15:07:41.504532+0000","last_clean":"2024-09-13T15:07:41.504532+0000","last_became_active":"2024-09-13T15:07:37.514791+0000","last_became_peered":"2024-09-13T15:07:37.514791+0000","last_unstale":"2024-09-13T15:07:41.504532+0000","last_undegraded":"2024-09-13T15:07:41.504532+0000","last_fullsized":"2024-09-13T15:07:41.504532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526346+0000","last_change":"2024-09-13T15:07:37.015782+0000","last_active":"2024-09-13T15:07:41.526346+0000","last_peered":"2024-09-13T15:07:41.526346+0000","last_clean":"2024-09-13T15:07:41.526346+0000","last_became_active":"2024-09-13T15:07:37.015458+0000","last_became_peered":"2024-09-13T15:07:37.015458+0000","last_unstale":"2024-09-13T15:07:41.526346+0000","last_undegraded":"2024-09-13T15:07:41.526346+0000","last_fullsized":"2024-09-13T15:07:41.526346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.528017+0000","last_change":"2024-09-13T15:07:41.525109+0000","last_active":"2024-09-13T15:07:41.528017+0000","last_peered":"2024-09-13T15:07:41.528017+0000","last_clean":"2024-09-13T15:07:41.528017+0000","last_became_active":"2024-09-13T15:07:41.524368+0000","last_became_peered":"2024-09-13T15:07:41.524368+0000","last_unstale":"2024-09-13T15:07:41.528017+0000","last_undegraded":"2024-09-13T15:07:41.528017+0000","last_fullsized":"2024-09-13T15:07:41.528017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.479957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509473+0000","last_change":"2024-09-13T15:07:37.503285+0000","last_active":"2024-09-13T15:07:41.509473+0000","last_peered":"2024-09-13T15:07:41.509473+0000","last_clean":"2024-09-13T15:07:41.509473+0000","last_became_active":"2024-09-13T15:07:37.502590+0000","last_became_peered":"2024-09-13T15:07:37.502590+0000","last_unstale":"2024-09-13T15:07:41.509473+0000","last_undegraded":"2024-09-13T15:07:41.509473+0000","last_fullsized":"2024-09-13T15:07:41.509473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:19.522117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505205+0000","last_change":"2024-09-13T15:07:37.006134+0000","last_active":"2024-09-13T15:07:41.505205+0000","last_peered":"2024-09-13T15:07:41.505205+0000","last_clean":"2024-09-13T15:07:41.505205+0000","last_became_active":"2024-09-13T15:07:37.005639+0000","last_became_peered":"2024-09-13T15:07:37.005639+0000","last_unstale":"2024-09-13T15:07:41.505205+0000","last_undegraded":"2024-09-13T15:07:41.505205+0000","last_fullsized":"2024-09-13T15:07:41.505205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.534013+0000","last_change":"2024-09-13T15:07:41.531809+0000","last_active":"2024-09-13T15:07:41.534013+0000","last_peered":"2024-09-13T15:07:41.534013+0000","last_clean":"2024-09-13T15:07:41.534013+0000","last_became_active":"2024-09-13T15:07:41.527321+0000","last_became_peered":"2024-09-13T15:07:41.527321+0000","last_unstale":"2024-09-13T15:07:41.534013+0000","last_undegraded":"2024-09-13T15:07:41.534013+0000","last_fullsized":"2024-09-13T15:07:41.534013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:39.844754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505119+0000","last_change":"2024-09-13T15:07:37.504536+0000","last_active":"2024-09-13T15:07:41.505119+0000","last_peered":"2024-09-13T15:07:41.505119+0000","last_clean":"2024-09-13T15:07:41.505119+0000","last_became_active":"2024-09-13T15:07:37.504176+0000","last_became_peered":"2024-09-13T15:07:37.504176+0000","last_unstale":"2024-09-13T15:07:41.505119+0000","last_undegraded":"2024-09-13T15:07:41.505119+0000","last_fullsized":"2024-09-13T15:07:41.505119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516435+0000","last_change":"2024-09-13T15:07:37.005951+0000","last_active":"2024-09-13T15:07:41.516435+0000","last_peered":"2024-09-13T15:07:41.516435+0000","last_clean":"2024-09-13T15:07:41.516435+0000","last_became_active":"2024-09-13T15:07:37.005548+0000","last_became_peered":"2024-09-13T15:07:37.005548+0000","last_unstale":"2024-09-13T15:07:41.516435+0000","last_undegraded":"2024-09-13T15:07:41.516435+0000","last_fullsized":"2024-09-13T15:07:41.516435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578487+0000","last_change":"2024-09-13T15:07:41.571875+0000","last_active":"2024-09-13T15:07:41.578487+0000","last_peered":"2024-09-13T15:07:41.578487+0000","last_clean":"2024-09-13T15:07:41.578487+0000","last_became_active":"2024-09-13T15:07:41.569987+0000","last_became_peered":"2024-09-13T15:07:41.569987+0000","last_unstale":"2024-09-13T15:07:41.578487+0000","last_undegraded":"2024-09-13T15:07:41.578487+0000","last_fullsized":"2024-09-13T15:07:41.578487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577725+0000","last_change":"2024-09-13T15:07:41.573083+0000","last_active":"2024-09-13T15:07:41.577725+0000","last_peered":"2024-09-13T15:07:41.577725+0000","last_clean":"2024-09-13T15:07:41.577725+0000","last_became_active":"2024-09-13T15:07:41.572220+0000","last_became_peered":"2024-09-13T15:07:41.572220+0000","last_unstale":"2024-09-13T15:07:41.577725+0000","last_undegraded":"2024-09-13T15:07:41.577725+0000","last_fullsized":"2024-09-13T15:07:41.577725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521874+0000","last_change":"2024-09-13T15:07:37.493152+0000","last_active":"2024-09-13T15:07:41.521874+0000","last_peered":"2024-09-13T15:07:41.521874+0000","last_clean":"2024-09-13T15:07:41.521874+0000","last_became_active":"2024-09-13T15:07:37.492891+0000","last_became_peered":"2024-09-13T15:07:37.492891+0000","last_unstale":"2024-09-13T15:07:41.521874+0000","last_undegraded":"2024-09-13T15:07:41.521874+0000","last_fullsized":"2024-09-13T15:07:41.521874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503103+0000","last_change":"2024-09-13T15:07:37.002734+0000","last_active":"2024-09-13T15:07:41.503103+0000","last_peered":"2024-09-13T15:07:41.503103+0000","last_clean":"2024-09-13T15:07:41.503103+0000","last_became_active":"2024-09-13T15:07:37.002305+0000","last_became_peered":"2024-09-13T15:07:37.002305+0000","last_unstale":"2024-09-13T15:07:41.503103+0000","last_undegraded":"2024-09-13T15:07:41.503103+0000","last_fullsized":"2024-09-13T15:07:41.503103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533380+0000","last_change":"2024-09-13T15:07:41.527871+0000","last_active":"2024-09-13T15:07:41.533380+0000","last_peered":"2024-09-13T15:07:41.533380+0000","last_clean":"2024-09-13T15:07:41.533380+0000","last_became_active":"2024-09-13T15:07:41.527114+0000","last_became_peered":"2024-09-13T15:07:41.527114+0000","last_unstale":"2024-09-13T15:07:41.533380+0000","last_undegraded":"2024-09-13T15:07:41.533380+0000","last_fullsized":"2024-09-13T15:07:41.533380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523542+0000","last_change":"2024-09-13T15:07:37.490427+0000","last_active":"2024-09-13T15:07:41.523542+0000","last_peered":"2024-09-13T15:07:41.523542+0000","last_clean":"2024-09-13T15:07:41.523542+0000","last_became_active":"2024-09-13T15:07:37.490022+0000","last_became_peered":"2024-09-13T15:07:37.490022+0000","last_unstale":"2024-09-13T15:07:41.523542+0000","last_undegraded":"2024-09-13T15:07:41.523542+0000","last_fullsized":"2024-09-13T15:07:41.523542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506961+0000","last_change":"2024-09-13T15:07:37.007543+0000","last_active":"2024-09-13T15:07:41.506961+0000","last_peered":"2024-09-13T15:07:41.506961+0000","last_clean":"2024-09-13T15:07:41.506961+0000","last_became_active":"2024-09-13T15:07:37.007134+0000","last_became_peered":"2024-09-13T15:07:37.007134+0000","last_unstale":"2024-09-13T15:07:41.506961+0000","last_undegraded":"2024-09-13T15:07:41.506961+0000","last_fullsized":"2024-09-13T15:07:41.506961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512143+0000","last_change":"2024-09-13T15:07:37.003099+0000","last_active":"2024-09-13T15:07:41.512143+0000","last_peered":"2024-09-13T15:07:41.512143+0000","last_clean":"2024-09-13T15:07:41.512143+0000","last_became_active":"2024-09-13T15:07:37.001875+0000","last_became_peered":"2024-09-13T15:07:37.001875+0000","last_unstale":"2024-09-13T15:07:41.512143+0000","last_undegraded":"2024-09-13T15:07:41.512143+0000","last_fullsized":"2024-09-13T15:07:41.512143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515252+0000","last_change":"2024-09-13T15:07:37.514343+0000","last_active":"2024-09-13T15:07:41.515252+0000","last_peered":"2024-09-13T15:07:41.515252+0000","last_clean":"2024-09-13T15:07:41.515252+0000","last_became_active":"2024-09-13T15:07:37.514044+0000","last_became_peered":"2024-09-13T15:07:37.514044+0000","last_unstale":"2024-09-13T15:07:41.515252+0000","last_undegraded":"2024-09-13T15:07:41.515252+0000","last_fullsized":"2024-09-13T15:07:41.515252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538959+0000","last_change":"2024-09-13T15:07:41.536373+0000","last_active":"2024-09-13T15:07:41.538959+0000","last_peered":"2024-09-13T15:07:41.538959+0000","last_clean":"2024-09-13T15:07:41.538959+0000","last_became_active":"2024-09-13T15:07:41.535945+0000","last_became_peered":"2024-09-13T15:07:41.535945+0000","last_unstale":"2024-09-13T15:07:41.538959+0000","last_undegraded":"2024-09-13T15:07:41.538959+0000","last_fullsized":"2024-09-13T15:07:41.538959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:09.980333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505339+0000","last_change":"2024-09-13T15:07:37.008842+0000","last_active":"2024-09-13T15:07:41.505339+0000","last_peered":"2024-09-13T15:07:41.505339+0000","last_clean":"2024-09-13T15:07:41.505339+0000","last_became_active":"2024-09-13T15:07:37.008556+0000","last_became_peered":"2024-09-13T15:07:37.008556+0000","last_unstale":"2024-09-13T15:07:41.505339+0000","last_undegraded":"2024-09-13T15:07:41.505339+0000","last_fullsized":"2024-09-13T15:07:41.505339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507931+0000","last_change":"2024-09-13T15:07:37.493138+0000","last_active":"2024-09-13T15:07:41.507931+0000","last_peered":"2024-09-13T15:07:41.507931+0000","last_clean":"2024-09-13T15:07:41.507931+0000","last_became_active":"2024-09-13T15:07:37.492811+0000","last_became_peered":"2024-09-13T15:07:37.492811+0000","last_unstale":"2024-09-13T15:07:41.507931+0000","last_undegraded":"2024-09-13T15:07:41.507931+0000","last_fullsized":"2024-09-13T15:07:41.507931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533522+0000","last_change":"2024-09-13T15:07:41.531188+0000","last_active":"2024-09-13T15:07:41.533522+0000","last_peered":"2024-09-13T15:07:41.533522+0000","last_clean":"2024-09-13T15:07:41.533522+0000","last_became_active":"2024-09-13T15:07:41.530750+0000","last_became_peered":"2024-09-13T15:07:41.530750+0000","last_unstale":"2024-09-13T15:07:41.533522+0000","last_undegraded":"2024-09-13T15:07:41.533522+0000","last_fullsized":"2024-09-13T15:07:41.533522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:17.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511841+0000","last_change":"2024-09-13T15:07:37.502829+0000","last_active":"2024-09-13T15:07:41.511841+0000","last_peered":"2024-09-13T15:07:41.511841+0000","last_clean":"2024-09-13T15:07:41.511841+0000","last_became_active":"2024-09-13T15:07:37.502567+0000","last_became_peered":"2024-09-13T15:07:37.502567+0000","last_unstale":"2024-09-13T15:07:41.511841+0000","last_undegraded":"2024-09-13T15:07:41.511841+0000","last_fullsized":"2024-09-13T15:07:41.511841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505009+0000","last_change":"2024-09-13T15:07:37.499515+0000","last_active":"2024-09-13T15:07:41.505009+0000","last_peered":"2024-09-13T15:07:41.505009+0000","last_clean":"2024-09-13T15:07:41.505009+0000","last_became_active":"2024-09-13T15:07:37.499249+0000","last_became_peered":"2024-09-13T15:07:37.499249+0000","last_unstale":"2024-09-13T15:07:41.505009+0000","last_undegraded":"2024-09-13T15:07:41.505009+0000","last_fullsized":"2024-09-13T15:07:41.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502954+0000","last_change":"2024-09-13T15:07:37.491947+0000","last_active":"2024-09-13T15:07:41.502954+0000","last_peered":"2024-09-13T15:07:41.502954+0000","last_clean":"2024-09-13T15:07:41.502954+0000","last_became_active":"2024-09-13T15:07:37.491654+0000","last_became_peered":"2024-09-13T15:07:37.491654+0000","last_unstale":"2024-09-13T15:07:41.502954+0000","last_undegraded":"2024-09-13T15:07:41.502954+0000","last_fullsized":"2024-09-13T15:07:41.502954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515163+0000","last_change":"2024-09-13T15:07:37.492083+0000","last_active":"2024-09-13T15:07:41.515163+0000","last_peered":"2024-09-13T15:07:41.515163+0000","last_clean":"2024-09-13T15:07:41.515163+0000","last_became_active":"2024-09-13T15:07:37.491195+0000","last_became_peered":"2024-09-13T15:07:37.491195+0000","last_unstale":"2024-09-13T15:07:41.515163+0000","last_undegraded":"2024-09-13T15:07:41.515163+0000","last_fullsized":"2024-09-13T15:07:41.515163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507538+0000","last_change":"2024-09-13T15:07:37.510538+0000","last_active":"2024-09-13T15:07:41.507538+0000","last_peered":"2024-09-13T15:07:41.507538+0000","last_clean":"2024-09-13T15:07:41.507538+0000","last_became_active":"2024-09-13T15:07:37.510162+0000","last_became_peered":"2024-09-13T15:07:37.510162+0000","last_unstale":"2024-09-13T15:07:41.507538+0000","last_undegraded":"2024-09-13T15:07:41.507538+0000","last_fullsized":"2024-09-13T15:07:41.507538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525991+0000","last_change":"2024-09-13T15:07:37.494524+0000","last_active":"2024-09-13T15:07:41.525991+0000","last_peered":"2024-09-13T15:07:41.525991+0000","last_clean":"2024-09-13T15:07:41.525991+0000","last_became_active":"2024-09-13T15:07:37.494249+0000","last_became_peered":"2024-09-13T15:07:37.494249+0000","last_unstale":"2024-09-13T15:07:41.525991+0000","last_undegraded":"2024-09-13T15:07:41.525991+0000","last_fullsized":"2024-09-13T15:07:41.525991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516203+0000","last_change":"2024-09-13T15:07:37.504649+0000","last_active":"2024-09-13T15:07:41.516203+0000","last_peered":"2024-09-13T15:07:41.516203+0000","last_clean":"2024-09-13T15:07:41.516203+0000","last_became_active":"2024-09-13T15:07:37.504400+0000","last_became_peered":"2024-09-13T15:07:37.504400+0000","last_unstale":"2024-09-13T15:07:41.516203+0000","last_undegraded":"2024-09-13T15:07:41.516203+0000","last_fullsized":"2024-09-13T15:07:41.516203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509917+0000","last_change":"2024-09-13T15:07:37.506438+0000","last_active":"2024-09-13T15:07:41.509917+0000","last_peered":"2024-09-13T15:07:41.509917+0000","last_clean":"2024-09-13T15:07:41.509917+0000","last_became_active":"2024-09-13T15:07:37.506038+0000","last_became_peered":"2024-09-13T15:07:37.506038+0000","last_unstale":"2024-09-13T15:07:41.509917+0000","last_undegraded":"2024-09-13T15:07:41.509917+0000","last_fullsized":"2024-09-13T15:07:41.509917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502985+0000","last_change":"2024-09-13T15:07:37.491788+0000","last_active":"2024-09-13T15:07:41.502985+0000","last_peered":"2024-09-13T15:07:41.502985+0000","last_clean":"2024-09-13T15:07:41.502985+0000","last_became_active":"2024-09-13T15:07:37.491487+0000","last_became_peered":"2024-09-13T15:07:37.491487+0000","last_unstale":"2024-09-13T15:07:41.502985+0000","last_undegraded":"2024-09-13T15:07:41.502985+0000","last_fullsized":"2024-09-13T15:07:41.502985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506888+0000","last_change":"2024-09-13T15:07:37.493714+0000","last_active":"2024-09-13T15:07:41.506888+0000","last_peered":"2024-09-13T15:07:41.506888+0000","last_clean":"2024-09-13T15:07:41.506888+0000","last_became_active":"2024-09-13T15:07:37.493434+0000","last_became_peered":"2024-09-13T15:07:37.493434+0000","last_unstale":"2024-09-13T15:07:41.506888+0000","last_undegraded":"2024-09-13T15:07:41.506888+0000","last_fullsized":"2024-09-13T15:07:41.506888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502861+0000","last_change":"2024-09-13T15:07:37.505382+0000","last_active":"2024-09-13T15:07:41.502861+0000","last_peered":"2024-09-13T15:07:41.502861+0000","last_clean":"2024-09-13T15:07:41.502861+0000","last_became_active":"2024-09-13T15:07:37.504958+0000","last_became_peered":"2024-09-13T15:07:37.504958+0000","last_unstale":"2024-09-13T15:07:41.502861+0000","last_undegraded":"2024-09-13T15:07:41.502861+0000","last_fullsized":"2024-09-13T15:07:41.502861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515039+0000","last_change":"2024-09-13T15:07:37.504610+0000","last_active":"2024-09-13T15:07:41.515039+0000","last_peered":"2024-09-13T15:07:41.515039+0000","last_clean":"2024-09-13T15:07:41.515039+0000","last_became_active":"2024-09-13T15:07:37.502014+0000","last_became_peered":"2024-09-13T15:07:37.502014+0000","last_unstale":"2024-09-13T15:07:41.515039+0000","last_undegraded":"2024-09-13T15:07:41.515039+0000","last_fullsized":"2024-09-13T15:07:41.515039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512035+0000","last_change":"2024-09-13T15:07:37.507065+0000","last_active":"2024-09-13T15:07:41.512035+0000","last_peered":"2024-09-13T15:07:41.512035+0000","last_clean":"2024-09-13T15:07:41.512035+0000","last_became_active":"2024-09-13T15:07:37.506779+0000","last_became_peered":"2024-09-13T15:07:37.506779+0000","last_unstale":"2024-09-13T15:07:41.512035+0000","last_undegraded":"2024-09-13T15:07:41.512035+0000","last_fullsized":"2024-09-13T15:07:41.512035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565939+0000","last_change":"2024-09-13T15:07:37.500769+0000","last_active":"2024-09-13T15:07:41.565939+0000","last_peered":"2024-09-13T15:07:41.565939+0000","last_clean":"2024-09-13T15:07:41.565939+0000","last_became_active":"2024-09-13T15:07:37.500527+0000","last_became_peered":"2024-09-13T15:07:37.500527+0000","last_unstale":"2024-09-13T15:07:41.565939+0000","last_undegraded":"2024-09-13T15:07:41.565939+0000","last_fullsized":"2024-09-13T15:07:41.565939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505254+0000","last_change":"2024-09-13T15:07:37.501370+0000","last_active":"2024-09-13T15:07:41.505254+0000","last_peered":"2024-09-13T15:07:41.505254+0000","last_clean":"2024-09-13T15:07:41.505254+0000","last_became_active":"2024-09-13T15:07:37.501117+0000","last_became_peered":"2024-09-13T15:07:37.501117+0000","last_unstale":"2024-09-13T15:07:41.505254+0000","last_undegraded":"2024-09-13T15:07:41.505254+0000","last_fullsized":"2024-09-13T15:07:41.505254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.499033+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.498785+0000","last_became_peered":"2024-09-13T15:07:37.498785+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502879+0000","last_change":"2024-09-13T15:07:37.496894+0000","last_active":"2024-09-13T15:07:41.502879+0000","last_peered":"2024-09-13T15:07:41.502879+0000","last_clean":"2024-09-13T15:07:41.502879+0000","last_became_active":"2024-09-13T15:07:37.496688+0000","last_became_peered":"2024-09-13T15:07:37.496688+0000","last_unstale":"2024-09-13T15:07:41.502879+0000","last_undegraded":"2024-09-13T15:07:41.502879+0000","last_fullsized":"2024-09-13T15:07:41.502879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521879+0000","last_change":"2024-09-13T15:07:37.496945+0000","last_active":"2024-09-13T15:07:41.521879+0000","last_peered":"2024-09-13T15:07:41.521879+0000","last_clean":"2024-09-13T15:07:41.521879+0000","last_became_active":"2024-09-13T15:07:37.496509+0000","last_became_peered":"2024-09-13T15:07:37.496509+0000","last_unstale":"2024-09-13T15:07:41.521879+0000","last_undegraded":"2024-09-13T15:07:41.521879+0000","last_fullsized":"2024-09-13T15:07:41.521879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504987+0000","last_change":"2024-09-13T15:07:37.495060+0000","last_active":"2024-09-13T15:07:41.504987+0000","last_peered":"2024-09-13T15:07:41.504987+0000","last_clean":"2024-09-13T15:07:41.504987+0000","last_became_active":"2024-09-13T15:07:37.494788+0000","last_became_peered":"2024-09-13T15:07:37.494788+0000","last_unstale":"2024-09-13T15:07:41.504987+0000","last_undegraded":"2024-09-13T15:07:41.504987+0000","last_fullsized":"2024-09-13T15:07:41.504987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505104+0000","last_change":"2024-09-13T15:07:37.491940+0000","last_active":"2024-09-13T15:07:41.505104+0000","last_peered":"2024-09-13T15:07:41.505104+0000","last_clean":"2024-09-13T15:07:41.505104+0000","last_became_active":"2024-09-13T15:07:37.491714+0000","last_became_peered":"2024-09-13T15:07:37.491714+0000","last_unstale":"2024-09-13T15:07:41.505104+0000","last_undegraded":"2024-09-13T15:07:41.505104+0000","last_fullsized":"2024-09-13T15:07:41.505104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504221+0000","last_change":"2024-09-13T15:07:37.493155+0000","last_active":"2024-09-13T15:07:41.504221+0000","last_peered":"2024-09-13T15:07:41.504221+0000","last_clean":"2024-09-13T15:07:41.504221+0000","last_became_active":"2024-09-13T15:07:37.492896+0000","last_became_peered":"2024-09-13T15:07:37.492896+0000","last_unstale":"2024-09-13T15:07:41.504221+0000","last_undegraded":"2024-09-13T15:07:41.504221+0000","last_fullsized":"2024-09-13T15:07:41.504221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:56.485405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512790+0000","last_change":"2024-09-13T15:07:37.502884+0000","last_active":"2024-09-13T15:07:41.512790+0000","last_peered":"2024-09-13T15:07:41.512790+0000","last_clean":"2024-09-13T15:07:41.512790+0000","last_became_active":"2024-09-13T15:07:37.502542+0000","last_became_peered":"2024-09-13T15:07:37.502542+0000","last_unstale":"2024-09-13T15:07:41.512790+0000","last_undegraded":"2024-09-13T15:07:41.512790+0000","last_fullsized":"2024-09-13T15:07:41.512790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516072+0000","last_change":"2024-09-13T15:07:37.509728+0000","last_active":"2024-09-13T15:07:41.516072+0000","last_peered":"2024-09-13T15:07:41.516072+0000","last_clean":"2024-09-13T15:07:41.516072+0000","last_became_active":"2024-09-13T15:07:37.509264+0000","last_became_peered":"2024-09-13T15:07:37.509264+0000","last_unstale":"2024-09-13T15:07:41.516072+0000","last_undegraded":"2024-09-13T15:07:41.516072+0000","last_fullsized":"2024-09-13T15:07:41.516072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566575+0000","last_change":"2024-09-13T15:07:37.506122+0000","last_active":"2024-09-13T15:07:41.566575+0000","last_peered":"2024-09-13T15:07:41.566575+0000","last_clean":"2024-09-13T15:07:41.566575+0000","last_became_active":"2024-09-13T15:07:37.505859+0000","last_became_peered":"2024-09-13T15:07:37.505859+0000","last_unstale":"2024-09-13T15:07:41.566575+0000","last_undegraded":"2024-09-13T15:07:41.566575+0000","last_fullsized":"2024-09-13T15:07:41.566575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:24.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523490+0000","last_change":"2024-09-13T15:07:37.506044+0000","last_active":"2024-09-13T15:07:41.523490+0000","last_peered":"2024-09-13T15:07:41.523490+0000","last_clean":"2024-09-13T15:07:41.523490+0000","last_became_active":"2024-09-13T15:07:37.505769+0000","last_became_peered":"2024-09-13T15:07:37.505769+0000","last_unstale":"2024-09-13T15:07:41.523490+0000","last_undegraded":"2024-09-13T15:07:41.523490+0000","last_fullsized":"2024-09-13T15:07:41.523490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564537+0000","last_change":"2024-09-13T15:07:37.499277+0000","last_active":"2024-09-13T15:07:41.564537+0000","last_peered":"2024-09-13T15:07:41.564537+0000","last_clean":"2024-09-13T15:07:41.564537+0000","last_became_active":"2024-09-13T15:07:37.499015+0000","last_became_peered":"2024-09-13T15:07:37.499015+0000","last_unstale":"2024-09-13T15:07:41.564537+0000","last_undegraded":"2024-09-13T15:07:41.564537+0000","last_fullsized":"2024-09-13T15:07:41.564537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502767+0000","last_change":"2024-09-13T15:07:37.490609+0000","last_active":"2024-09-13T15:07:41.502767+0000","last_peered":"2024-09-13T15:07:41.502767+0000","last_clean":"2024-09-13T15:07:41.502767+0000","last_became_active":"2024-09-13T15:07:37.490347+0000","last_became_peered":"2024-09-13T15:07:37.490347+0000","last_unstale":"2024-09-13T15:07:41.502767+0000","last_undegraded":"2024-09-13T15:07:41.502767+0000","last_fullsized":"2024-09-13T15:07:41.502767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564563+0000","last_change":"2024-09-13T15:07:37.509408+0000","last_active":"2024-09-13T15:07:41.564563+0000","last_peered":"2024-09-13T15:07:41.564563+0000","last_clean":"2024-09-13T15:07:41.564563+0000","last_became_active":"2024-09-13T15:07:37.509076+0000","last_became_peered":"2024-09-13T15:07:37.509076+0000","last_unstale":"2024-09-13T15:07:41.564563+0000","last_undegraded":"2024-09-13T15:07:41.564563+0000","last_fullsized":"2024-09-13T15:07:41.564563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502014+0000","last_change":"2024-09-13T15:07:37.496397+0000","last_active":"2024-09-13T15:07:41.502014+0000","last_peered":"2024-09-13T15:07:41.502014+0000","last_clean":"2024-09-13T15:07:41.502014+0000","last_became_active":"2024-09-13T15:07:37.495306+0000","last_became_peered":"2024-09-13T15:07:37.495306+0000","last_unstale":"2024-09-13T15:07:41.502014+0000","last_undegraded":"2024-09-13T15:07:41.502014+0000","last_fullsized":"2024-09-13T15:07:41.502014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506055+0000","last_change":"2024-09-13T15:07:37.485483+0000","last_active":"2024-09-13T15:07:41.506055+0000","last_peered":"2024-09-13T15:07:41.506055+0000","last_clean":"2024-09-13T15:07:41.506055+0000","last_became_active":"2024-09-13T15:07:37.485197+0000","last_became_peered":"2024-09-13T15:07:37.485197+0000","last_unstale":"2024-09-13T15:07:41.506055+0000","last_undegraded":"2024-09-13T15:07:41.506055+0000","last_fullsized":"2024-09-13T15:07:41.506055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527325+0000","last_change":"2024-09-13T15:07:37.493235+0000","last_active":"2024-09-13T15:07:41.527325+0000","last_peered":"2024-09-13T15:07:41.527325+0000","last_clean":"2024-09-13T15:07:41.527325+0000","last_became_active":"2024-09-13T15:07:37.493000+0000","last_became_peered":"2024-09-13T15:07:37.493000+0000","last_unstale":"2024-09-13T15:07:41.527325+0000","last_undegraded":"2024-09-13T15:07:41.527325+0000","last_fullsized":"2024-09-13T15:07:41.527325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566439+0000","last_change":"2024-09-13T15:07:37.509845+0000","last_active":"2024-09-13T15:07:41.566439+0000","last_peered":"2024-09-13T15:07:41.566439+0000","last_clean":"2024-09-13T15:07:41.566439+0000","last_became_active":"2024-09-13T15:07:37.505933+0000","last_became_peered":"2024-09-13T15:07:37.505933+0000","last_unstale":"2024-09-13T15:07:41.566439+0000","last_undegraded":"2024-09-13T15:07:41.566439+0000","last_fullsized":"2024-09-13T15:07:41.566439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:08.463346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.976}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7869999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.897}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:08:08.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:08:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.189+0000 7fe49be00700 1 Processor -- start 2024-09-13T15:08:09.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.189+0000 7fe49be00700 1 -- start start 2024-09-13T15:08:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c15cb30 0x7fe49c06bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe49c06c040 0x7fe49c06ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe49c06cf90 0x7fe49c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49be00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0cd7a0 con 0x7fe49c06c040 2024-09-13T15:08:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c06d440 con 0x7fe49c06cf90 2024-09-13T15:08:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c06b140 con 0x7fe49c15cb30 2024-09-13T15:08:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe49c06c040 0x7fe49c06ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe49c06c040 0x7fe49c06ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58246/0 (socket says 172.21.15.50:58246) 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 -- 172.21.15.50:0/637757794 learned_addr learned my addr 172.21.15.50:0/637757794 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49b400700 1 --2- 172.21.15.50:0/637757794 >> v2:172.21.15.181:3300/0 conn(0x7fe49c06cf90 0x7fe49c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49aa00700 1 --2- 172.21.15.50:0/637757794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c15cb30 0x7fe49c06bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 -- 172.21.15.50:0/637757794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c15cb30 msgr2=0x7fe49c06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 --2- 172.21.15.50:0/637757794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c15cb30 0x7fe49c06bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 -- 172.21.15.50:0/637757794 >> v2:172.21.15.181:3300/0 conn(0x7fe49c06cf90 msgr2=0x7fe49c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 --2- 172.21.15.50:0/637757794 >> v2:172.21.15.181:3300/0 conn(0x7fe49c06cf90 0x7fe49c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 -- 172.21.15.50:0/637757794 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c06a530 con 0x7fe49c06c040 2024-09-13T15:08:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49b400700 1 --2- 172.21.15.50:0/637757794 >> v2:172.21.15.181:3300/0 conn(0x7fe49c06cf90 0x7fe49c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe49a000700 1 --2- 172.21.15.50:0/637757794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c06ca50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0d0d70 tx=0x7fe488009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395dc49b10b6e3f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.193+0000 7fe499600700 1 -- 172.21.15.50:0/637757794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48800b8a0 con 0x7fe49c06c040 2024-09-13T15:08:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe499600700 1 -- 172.21.15.50:0/637757794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48800ba00 con 0x7fe49c06c040 2024-09-13T15:08:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe499600700 1 -- 172.21.15.50:0/637757794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48800bd90 con 0x7fe49c06c040 2024-09-13T15:08:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 -- 172.21.15.50:0/637757794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 msgr2=0x7fe49c06ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 --2- 172.21.15.50:0/637757794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c06ca50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0d0d70 tx=0x7fe488009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 -- 172.21.15.50:0/637757794 shutdown_connections 2024-09-13T15:08:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 --2- 172.21.15.50:0/637757794 >> v2:172.21.15.181:3300/0 conn(0x7fe49c06cf90 0x7fe49c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 --2- 172.21.15.50:0/637757794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c06ca50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 --2- 172.21.15.50:0/637757794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c15cb30 0x7fe49c06bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 -- 172.21.15.50:0/637757794 >> 172.21.15.50:0/637757794 conn(0x7fe49c071f00 msgr2=0x7fe49c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 -- 172.21.15.50:0/637757794 shutdown_connections 2024-09-13T15:08:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.197+0000 7fe49be00700 1 -- 172.21.15.50:0/637757794 wait complete. 2024-09-13T15:08:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 Processor -- start 2024-09-13T15:08:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 -- start start 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c06cf90 0x7fe49c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe49c15cb30 0x7fe49c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15ee70 con 0x7fe49c06c040 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15f150 con 0x7fe49c15cb30 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15f430 con 0x7fe49c06cf90 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe49c15cb30 0x7fe49c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c1f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58262/0 (socket says 172.21.15.50:58262) 2024-09-13T15:08:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49aa00700 1 -- 172.21.15.50:0/1850509009 learned_addr learned my addr 172.21.15.50:0/1850509009 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.201+0000 7fe49a000700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c06cf90 0x7fe49c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49aa00700 1 -- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c06cf90 msgr2=0x7fe49c15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49aa00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c06cf90 0x7fe49c15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49aa00700 1 -- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe49c15cb30 msgr2=0x7fe49c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49aa00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe49c15cb30 0x7fe49c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49aa00700 1 -- 172.21.15.50:0/1850509009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488009570 con 0x7fe49c06c040 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49aa00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c1f1f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00d800 tx=0x7fe48c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0125f0 con 0x7fe49c06c040 2024-09-13T15:08:09.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c012750 con 0x7fe49c06c040 2024-09-13T15:08:09.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c15f710 con 0x7fe49c06c040 2024-09-13T15:08:09.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c012b00 con 0x7fe49c06c040 2024-09-13T15:08:09.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c0b6840 con 0x7fe49c06c040 2024-09-13T15:08:09.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.205+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c0d03d0 con 0x7fe49c06c040 2024-09-13T15:08:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.209+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe48c012c60 con 0x7fe49c06c040 2024-09-13T15:08:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.209+0000 7fe493400700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe47c066760 0x7fe47c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.209+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe48c084560 con 0x7fe49c06c040 2024-09-13T15:08:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.209+0000 7fe49a000700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe47c066760 0x7fe47c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.213+0000 7fe49a000700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe47c066760 0x7fe47c068c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0d0d70 tx=0x7fe488008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:09.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.217+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe48c051540 con 0x7fe49c06c040 2024-09-13T15:08:09.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.393+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe49c15f2c0 con 0x7fe47c066760 2024-09-13T15:08:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.417+0000 7fe493400700 1 -- 172.21.15.50:0/1850509009 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345012 (secure 0 0 0) 0x7fe49c15f2c0 con 0x7fe47c066760 2024-09-13T15:08:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe47c066760 msgr2=0x7fe47c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe47c066760 0x7fe47c068c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0d0d70 tx=0x7fe488008030 comp rx=0 tx=0).stop 2024-09-13T15:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 msgr2=0x7fe49c1f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c1f1f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00d800 tx=0x7fe48c00db10 comp rx=0 tx=0).stop 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 shutdown_connections 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe47c066760 0x7fe47c068c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe49c15cb30 0x7fe49c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe49c06cf90 0x7fe49c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 --2- 172.21.15.50:0/1850509009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe49c06c040 0x7fe49c1f1f90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 >> 172.21.15.50:0/1850509009 conn(0x7fe49c071f00 msgr2=0x7fe49c0c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 shutdown_connections 2024-09-13T15:08:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.425+0000 7fe49be00700 1 -- 172.21.15.50:0/1850509009 wait complete. 2024-09-13T15:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:08:09.453 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-13T15:08:08.018599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":3272704,"data_stored":1985105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004610"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509590+0000","last_change":"2024-09-13T15:07:37.013443+0000","last_active":"2024-09-13T15:07:41.509590+0000","last_peered":"2024-09-13T15:07:41.509590+0000","last_clean":"2024-09-13T15:07:41.509590+0000","last_became_active":"2024-09-13T15:07:37.013084+0000","last_became_peered":"2024-09-13T15:07:37.013084+0000","last_unstale":"2024-09-13T15:07:41.509590+0000","last_undegraded":"2024-09-13T15:07:41.509590+0000","last_fullsized":"2024-09-13T15:07:41.509590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506356+0000","last_change":"2024-09-13T15:07:37.504754+0000","last_active":"2024-09-13T15:07:41.506356+0000","last_peered":"2024-09-13T15:07:41.506356+0000","last_clean":"2024-09-13T15:07:41.506356+0000","last_became_active":"2024-09-13T15:07:37.504435+0000","last_became_peered":"2024-09-13T15:07:37.504435+0000","last_unstale":"2024-09-13T15:07:41.506356+0000","last_undegraded":"2024-09-13T15:07:41.506356+0000","last_fullsized":"2024-09-13T15:07:41.506356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.009718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.579608+0000","last_change":"2024-09-13T15:07:41.576894+0000","last_active":"2024-09-13T15:07:41.579608+0000","last_peered":"2024-09-13T15:07:41.579608+0000","last_clean":"2024-09-13T15:07:41.579608+0000","last_became_active":"2024-09-13T15:07:41.574143+0000","last_became_peered":"2024-09-13T15:07:41.574143+0000","last_unstale":"2024-09-13T15:07:41.579608+0000","last_undegraded":"2024-09-13T15:07:41.579608+0000","last_fullsized":"2024-09-13T15:07:41.579608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:50.141042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506583+0000","last_change":"2024-09-13T15:07:37.004216+0000","last_active":"2024-09-13T15:07:41.506583+0000","last_peered":"2024-09-13T15:07:41.506583+0000","last_clean":"2024-09-13T15:07:41.506583+0000","last_became_active":"2024-09-13T15:07:37.003718+0000","last_became_peered":"2024-09-13T15:07:37.003718+0000","last_unstale":"2024-09-13T15:07:41.506583+0000","last_undegraded":"2024-09-13T15:07:41.506583+0000","last_fullsized":"2024-09-13T15:07:41.506583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509367+0000","last_change":"2024-09-13T15:07:37.503439+0000","last_active":"2024-09-13T15:07:41.509367+0000","last_peered":"2024-09-13T15:07:41.509367+0000","last_clean":"2024-09-13T15:07:41.509367+0000","last_became_active":"2024-09-13T15:07:37.502983+0000","last_became_peered":"2024-09-13T15:07:37.502983+0000","last_unstale":"2024-09-13T15:07:41.509367+0000","last_undegraded":"2024-09-13T15:07:41.509367+0000","last_fullsized":"2024-09-13T15:07:41.509367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538359+0000","last_change":"2024-09-13T15:07:41.534320+0000","last_active":"2024-09-13T15:07:41.538359+0000","last_peered":"2024-09-13T15:07:41.538359+0000","last_clean":"2024-09-13T15:07:41.538359+0000","last_became_active":"2024-09-13T15:07:41.533553+0000","last_became_peered":"2024-09-13T15:07:41.533553+0000","last_unstale":"2024-09-13T15:07:41.538359+0000","last_undegraded":"2024-09-13T15:07:41.538359+0000","last_fullsized":"2024-09-13T15:07:41.538359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:39.809595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565838+0000","last_change":"2024-09-13T15:07:37.015988+0000","last_active":"2024-09-13T15:07:41.565838+0000","last_peered":"2024-09-13T15:07:41.565838+0000","last_clean":"2024-09-13T15:07:41.565838+0000","last_became_active":"2024-09-13T15:07:37.015680+0000","last_became_peered":"2024-09-13T15:07:37.015680+0000","last_unstale":"2024-09-13T15:07:41.565838+0000","last_undegraded":"2024-09-13T15:07:41.565838+0000","last_fullsized":"2024-09-13T15:07:41.565838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:31.567643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502115+0000","last_change":"2024-09-13T15:07:37.514328+0000","last_active":"2024-09-13T15:07:41.502115+0000","last_peered":"2024-09-13T15:07:41.502115+0000","last_clean":"2024-09-13T15:07:41.502115+0000","last_became_active":"2024-09-13T15:07:37.514028+0000","last_became_peered":"2024-09-13T15:07:37.514028+0000","last_unstale":"2024-09-13T15:07:41.502115+0000","last_undegraded":"2024-09-13T15:07:41.502115+0000","last_fullsized":"2024-09-13T15:07:41.502115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538321+0000","last_change":"2024-09-13T15:07:41.534029+0000","last_active":"2024-09-13T15:07:41.538321+0000","last_peered":"2024-09-13T15:07:41.538321+0000","last_clean":"2024-09-13T15:07:41.538321+0000","last_became_active":"2024-09-13T15:07:41.533515+0000","last_became_peered":"2024-09-13T15:07:41.533515+0000","last_unstale":"2024-09-13T15:07:41.538321+0000","last_undegraded":"2024-09-13T15:07:41.538321+0000","last_fullsized":"2024-09-13T15:07:41.538321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564972+0000","last_change":"2024-09-13T15:07:37.017205+0000","last_active":"2024-09-13T15:07:41.564972+0000","last_peered":"2024-09-13T15:07:41.564972+0000","last_clean":"2024-09-13T15:07:41.564972+0000","last_became_active":"2024-09-13T15:07:37.016766+0000","last_became_peered":"2024-09-13T15:07:37.016766+0000","last_unstale":"2024-09-13T15:07:41.564972+0000","last_undegraded":"2024-09-13T15:07:41.564972+0000","last_fullsized":"2024-09-13T15:07:41.564972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505404+0000","last_change":"2024-09-13T15:07:37.502428+0000","last_active":"2024-09-13T15:07:41.505404+0000","last_peered":"2024-09-13T15:07:41.505404+0000","last_clean":"2024-09-13T15:07:41.505404+0000","last_became_active":"2024-09-13T15:07:37.501967+0000","last_became_peered":"2024-09-13T15:07:37.501967+0000","last_unstale":"2024-09-13T15:07:41.505404+0000","last_undegraded":"2024-09-13T15:07:41.505404+0000","last_fullsized":"2024-09-13T15:07:41.505404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538423+0000","last_change":"2024-09-13T15:07:41.534357+0000","last_active":"2024-09-13T15:07:41.538423+0000","last_peered":"2024-09-13T15:07:41.538423+0000","last_clean":"2024-09-13T15:07:41.538423+0000","last_became_active":"2024-09-13T15:07:41.533662+0000","last_became_peered":"2024-09-13T15:07:41.533662+0000","last_unstale":"2024-09-13T15:07:41.538423+0000","last_undegraded":"2024-09-13T15:07:41.538423+0000","last_fullsized":"2024-09-13T15:07:41.538423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512026+0000","last_change":"2024-09-13T15:07:37.506598+0000","last_active":"2024-09-13T15:07:41.512026+0000","last_peered":"2024-09-13T15:07:41.512026+0000","last_clean":"2024-09-13T15:07:41.512026+0000","last_became_active":"2024-09-13T15:07:37.506317+0000","last_became_peered":"2024-09-13T15:07:37.506317+0000","last_unstale":"2024-09-13T15:07:41.512026+0000","last_undegraded":"2024-09-13T15:07:41.512026+0000","last_fullsized":"2024-09-13T15:07:41.512026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564777+0000","last_change":"2024-09-13T15:07:37.017573+0000","last_active":"2024-09-13T15:07:41.564777+0000","last_peered":"2024-09-13T15:07:41.564777+0000","last_clean":"2024-09-13T15:07:41.564777+0000","last_became_active":"2024-09-13T15:07:37.017395+0000","last_became_peered":"2024-09-13T15:07:37.017395+0000","last_unstale":"2024-09-13T15:07:41.564777+0000","last_undegraded":"2024-09-13T15:07:41.564777+0000","last_fullsized":"2024-09-13T15:07:41.564777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:47.432256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527945+0000","last_change":"2024-09-13T15:07:41.525024+0000","last_active":"2024-09-13T15:07:41.527945+0000","last_peered":"2024-09-13T15:07:41.527945+0000","last_clean":"2024-09-13T15:07:41.527945+0000","last_became_active":"2024-09-13T15:07:41.524498+0000","last_became_peered":"2024-09-13T15:07:41.524498+0000","last_unstale":"2024-09-13T15:07:41.527945+0000","last_undegraded":"2024-09-13T15:07:41.527945+0000","last_fullsized":"2024-09-13T15:07:41.527945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:16.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505218+0000","last_change":"2024-09-13T15:07:37.489676+0000","last_active":"2024-09-13T15:07:41.505218+0000","last_peered":"2024-09-13T15:07:41.505218+0000","last_clean":"2024-09-13T15:07:41.505218+0000","last_became_active":"2024-09-13T15:07:37.487946+0000","last_became_peered":"2024-09-13T15:07:37.487946+0000","last_unstale":"2024-09-13T15:07:41.505218+0000","last_undegraded":"2024-09-13T15:07:41.505218+0000","last_fullsized":"2024-09-13T15:07:41.505218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.522108+0000","last_change":"2024-09-13T15:07:37.012004+0000","last_active":"2024-09-13T15:07:41.522108+0000","last_peered":"2024-09-13T15:07:41.522108+0000","last_clean":"2024-09-13T15:07:41.522108+0000","last_became_active":"2024-09-13T15:07:37.011199+0000","last_became_peered":"2024-09-13T15:07:37.011199+0000","last_unstale":"2024-09-13T15:07:41.522108+0000","last_undegraded":"2024-09-13T15:07:41.522108+0000","last_fullsized":"2024-09-13T15:07:41.522108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538485+0000","last_change":"2024-09-13T15:07:41.535177+0000","last_active":"2024-09-13T15:07:41.538485+0000","last_peered":"2024-09-13T15:07:41.538485+0000","last_clean":"2024-09-13T15:07:41.538485+0000","last_became_active":"2024-09-13T15:07:41.533912+0000","last_became_peered":"2024-09-13T15:07:41.533912+0000","last_unstale":"2024-09-13T15:07:41.538485+0000","last_undegraded":"2024-09-13T15:07:41.538485+0000","last_fullsized":"2024-09-13T15:07:41.538485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523603+0000","last_change":"2024-09-13T15:07:37.495579+0000","last_active":"2024-09-13T15:07:41.523603+0000","last_peered":"2024-09-13T15:07:41.523603+0000","last_clean":"2024-09-13T15:07:41.523603+0000","last_became_active":"2024-09-13T15:07:37.495337+0000","last_became_peered":"2024-09-13T15:07:37.495337+0000","last_unstale":"2024-09-13T15:07:41.523603+0000","last_undegraded":"2024-09-13T15:07:41.523603+0000","last_fullsized":"2024-09-13T15:07:41.523603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521968+0000","last_change":"2024-09-13T15:07:37.013081+0000","last_active":"2024-09-13T15:07:41.521968+0000","last_peered":"2024-09-13T15:07:41.521968+0000","last_clean":"2024-09-13T15:07:41.521968+0000","last_became_active":"2024-09-13T15:07:37.012821+0000","last_became_peered":"2024-09-13T15:07:37.012821+0000","last_unstale":"2024-09-13T15:07:41.521968+0000","last_undegraded":"2024-09-13T15:07:41.521968+0000","last_fullsized":"2024-09-13T15:07:41.521968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577610+0000","last_change":"2024-09-13T15:07:41.572919+0000","last_active":"2024-09-13T15:07:41.577610+0000","last_peered":"2024-09-13T15:07:41.577610+0000","last_clean":"2024-09-13T15:07:41.577610+0000","last_became_active":"2024-09-13T15:07:41.572534+0000","last_became_peered":"2024-09-13T15:07:41.572534+0000","last_unstale":"2024-09-13T15:07:41.577610+0000","last_undegraded":"2024-09-13T15:07:41.577610+0000","last_fullsized":"2024-09-13T15:07:41.577610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503792+0000","last_change":"2024-09-13T15:07:37.484624+0000","last_active":"2024-09-13T15:07:41.503792+0000","last_peered":"2024-09-13T15:07:41.503792+0000","last_clean":"2024-09-13T15:07:41.503792+0000","last_became_active":"2024-09-13T15:07:37.484236+0000","last_became_peered":"2024-09-13T15:07:37.484236+0000","last_unstale":"2024-09-13T15:07:41.503792+0000","last_undegraded":"2024-09-13T15:07:41.503792+0000","last_fullsized":"2024-09-13T15:07:41.503792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:25.167980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.563720+0000","last_change":"2024-09-13T15:07:37.016581+0000","last_active":"2024-09-13T15:07:41.563720+0000","last_peered":"2024-09-13T15:07:41.563720+0000","last_clean":"2024-09-13T15:07:41.563720+0000","last_became_active":"2024-09-13T15:07:37.016253+0000","last_became_peered":"2024-09-13T15:07:37.016253+0000","last_unstale":"2024-09-13T15:07:41.563720+0000","last_undegraded":"2024-09-13T15:07:41.563720+0000","last_fullsized":"2024-09-13T15:07:41.563720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538474+0000","last_change":"2024-09-13T15:07:41.534781+0000","last_active":"2024-09-13T15:07:41.538474+0000","last_peered":"2024-09-13T15:07:41.538474+0000","last_clean":"2024-09-13T15:07:41.538474+0000","last_became_active":"2024-09-13T15:07:41.533999+0000","last_became_peered":"2024-09-13T15:07:41.533999+0000","last_unstale":"2024-09-13T15:07:41.538474+0000","last_undegraded":"2024-09-13T15:07:41.538474+0000","last_fullsized":"2024-09-13T15:07:41.538474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512002+0000","last_change":"2024-09-13T15:07:37.494214+0000","last_active":"2024-09-13T15:07:41.512002+0000","last_peered":"2024-09-13T15:07:41.512002+0000","last_clean":"2024-09-13T15:07:41.512002+0000","last_became_active":"2024-09-13T15:07:37.493854+0000","last_became_peered":"2024-09-13T15:07:37.493854+0000","last_unstale":"2024-09-13T15:07:41.512002+0000","last_undegraded":"2024-09-13T15:07:41.512002+0000","last_fullsized":"2024-09-13T15:07:41.512002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516503+0000","last_change":"2024-09-13T15:07:37.007466+0000","last_active":"2024-09-13T15:07:41.516503+0000","last_peered":"2024-09-13T15:07:41.516503+0000","last_clean":"2024-09-13T15:07:41.516503+0000","last_became_active":"2024-09-13T15:07:37.007189+0000","last_became_peered":"2024-09-13T15:07:37.007189+0000","last_unstale":"2024-09-13T15:07:41.516503+0000","last_undegraded":"2024-09-13T15:07:41.516503+0000","last_fullsized":"2024-09-13T15:07:41.516503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576271+0000","last_change":"2024-09-13T15:07:41.572185+0000","last_active":"2024-09-13T15:07:41.576271+0000","last_peered":"2024-09-13T15:07:41.576271+0000","last_clean":"2024-09-13T15:07:41.576271+0000","last_became_active":"2024-09-13T15:07:41.571676+0000","last_became_peered":"2024-09-13T15:07:41.571676+0000","last_unstale":"2024-09-13T15:07:41.576271+0000","last_undegraded":"2024-09-13T15:07:41.576271+0000","last_fullsized":"2024-09-13T15:07:41.576271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:11.973002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.510056+0000","last_change":"2024-09-13T15:07:37.503628+0000","last_active":"2024-09-13T15:07:41.510056+0000","last_peered":"2024-09-13T15:07:41.510056+0000","last_clean":"2024-09-13T15:07:41.510056+0000","last_became_active":"2024-09-13T15:07:37.503337+0000","last_became_peered":"2024-09-13T15:07:37.503337+0000","last_unstale":"2024-09-13T15:07:41.510056+0000","last_undegraded":"2024-09-13T15:07:41.510056+0000","last_fullsized":"2024-09-13T15:07:41.510056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:42.582773+0000","last_change":"2024-09-13T15:07:37.010802+0000","last_active":"2024-09-13T15:07:42.582773+0000","last_peered":"2024-09-13T15:07:42.582773+0000","last_clean":"2024-09-13T15:07:42.582773+0000","last_became_active":"2024-09-13T15:07:37.010516+0000","last_became_peered":"2024-09-13T15:07:37.010516+0000","last_unstale":"2024-09-13T15:07:42.582773+0000","last_undegraded":"2024-09-13T15:07:42.582773+0000","last_fullsized":"2024-09-13T15:07:42.582773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575285+0000","last_change":"2024-09-13T15:07:41.570403+0000","last_active":"2024-09-13T15:07:41.575285+0000","last_peered":"2024-09-13T15:07:41.575285+0000","last_clean":"2024-09-13T15:07:41.575285+0000","last_became_active":"2024-09-13T15:07:41.569731+0000","last_became_peered":"2024-09-13T15:07:41.569731+0000","last_unstale":"2024-09-13T15:07:41.575285+0000","last_undegraded":"2024-09-13T15:07:41.575285+0000","last_fullsized":"2024-09-13T15:07:41.575285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:47.336008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525415+0000","last_change":"2024-09-13T15:07:37.487456+0000","last_active":"2024-09-13T15:07:41.525415+0000","last_peered":"2024-09-13T15:07:41.525415+0000","last_clean":"2024-09-13T15:07:41.525415+0000","last_became_active":"2024-09-13T15:07:37.487227+0000","last_became_peered":"2024-09-13T15:07:37.487227+0000","last_unstale":"2024-09-13T15:07:41.525415+0000","last_undegraded":"2024-09-13T15:07:41.525415+0000","last_fullsized":"2024-09-13T15:07:41.525415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566354+0000","last_change":"2024-09-13T15:07:37.015462+0000","last_active":"2024-09-13T15:07:41.566354+0000","last_peered":"2024-09-13T15:07:41.566354+0000","last_clean":"2024-09-13T15:07:41.566354+0000","last_became_active":"2024-09-13T15:07:37.015202+0000","last_became_peered":"2024-09-13T15:07:37.015202+0000","last_unstale":"2024-09-13T15:07:41.566354+0000","last_undegraded":"2024-09-13T15:07:41.566354+0000","last_fullsized":"2024-09-13T15:07:41.566354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.576630+0000","last_change":"2024-09-13T15:07:41.568111+0000","last_active":"2024-09-13T15:07:41.576630+0000","last_peered":"2024-09-13T15:07:41.576630+0000","last_clean":"2024-09-13T15:07:41.576630+0000","last_became_active":"2024-09-13T15:07:41.567207+0000","last_became_peered":"2024-09-13T15:07:41.567207+0000","last_unstale":"2024-09-13T15:07:41.576630+0000","last_undegraded":"2024-09-13T15:07:41.576630+0000","last_fullsized":"2024-09-13T15:07:41.576630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505482+0000","last_change":"2024-09-13T15:07:37.495265+0000","last_active":"2024-09-13T15:07:41.505482+0000","last_peered":"2024-09-13T15:07:41.505482+0000","last_clean":"2024-09-13T15:07:41.505482+0000","last_became_active":"2024-09-13T15:07:37.494954+0000","last_became_peered":"2024-09-13T15:07:37.494954+0000","last_unstale":"2024-09-13T15:07:41.505482+0000","last_undegraded":"2024-09-13T15:07:41.505482+0000","last_fullsized":"2024-09-13T15:07:41.505482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525500+0000","last_change":"2024-09-13T15:07:37.012286+0000","last_active":"2024-09-13T15:07:41.525500+0000","last_peered":"2024-09-13T15:07:41.525500+0000","last_clean":"2024-09-13T15:07:41.525500+0000","last_became_active":"2024-09-13T15:07:37.010271+0000","last_became_peered":"2024-09-13T15:07:37.010271+0000","last_unstale":"2024-09-13T15:07:41.525500+0000","last_undegraded":"2024-09-13T15:07:41.525500+0000","last_fullsized":"2024-09-13T15:07:41.525500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539227+0000","last_change":"2024-09-13T15:07:41.535358+0000","last_active":"2024-09-13T15:07:41.539227+0000","last_peered":"2024-09-13T15:07:41.539227+0000","last_clean":"2024-09-13T15:07:41.539227+0000","last_became_active":"2024-09-13T15:07:41.534907+0000","last_became_peered":"2024-09-13T15:07:41.534907+0000","last_unstale":"2024-09-13T15:07:41.539227+0000","last_undegraded":"2024-09-13T15:07:41.539227+0000","last_fullsized":"2024-09-13T15:07:41.539227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506408+0000","last_change":"2024-09-13T15:07:37.513201+0000","last_active":"2024-09-13T15:07:41.506408+0000","last_peered":"2024-09-13T15:07:41.506408+0000","last_clean":"2024-09-13T15:07:41.506408+0000","last_became_active":"2024-09-13T15:07:37.512914+0000","last_became_peered":"2024-09-13T15:07:37.512914+0000","last_unstale":"2024-09-13T15:07:41.506408+0000","last_undegraded":"2024-09-13T15:07:41.506408+0000","last_fullsized":"2024-09-13T15:07:41.506408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503150+0000","last_change":"2024-09-13T15:07:37.007476+0000","last_active":"2024-09-13T15:07:41.503150+0000","last_peered":"2024-09-13T15:07:41.503150+0000","last_clean":"2024-09-13T15:07:41.503150+0000","last_became_active":"2024-09-13T15:07:37.006888+0000","last_became_peered":"2024-09-13T15:07:37.006888+0000","last_unstale":"2024-09-13T15:07:41.503150+0000","last_undegraded":"2024-09-13T15:07:41.503150+0000","last_fullsized":"2024-09-13T15:07:41.503150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538962+0000","last_change":"2024-09-13T15:07:41.535459+0000","last_active":"2024-09-13T15:07:41.538962+0000","last_peered":"2024-09-13T15:07:41.538962+0000","last_clean":"2024-09-13T15:07:41.538962+0000","last_became_active":"2024-09-13T15:07:41.534918+0000","last_became_peered":"2024-09-13T15:07:41.534918+0000","last_unstale":"2024-09-13T15:07:41.538962+0000","last_undegraded":"2024-09-13T15:07:41.538962+0000","last_fullsized":"2024-09-13T15:07:41.538962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521735+0000","last_change":"2024-09-13T15:07:37.492499+0000","last_active":"2024-09-13T15:07:41.521735+0000","last_peered":"2024-09-13T15:07:41.521735+0000","last_clean":"2024-09-13T15:07:41.521735+0000","last_became_active":"2024-09-13T15:07:37.492144+0000","last_became_peered":"2024-09-13T15:07:37.492144+0000","last_unstale":"2024-09-13T15:07:41.521735+0000","last_undegraded":"2024-09-13T15:07:41.521735+0000","last_fullsized":"2024-09-13T15:07:41.521735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505110+0000","last_change":"2024-09-13T15:07:37.006492+0000","last_active":"2024-09-13T15:07:41.505110+0000","last_peered":"2024-09-13T15:07:41.505110+0000","last_clean":"2024-09-13T15:07:41.505110+0000","last_became_active":"2024-09-13T15:07:37.004955+0000","last_became_peered":"2024-09-13T15:07:37.004955+0000","last_unstale":"2024-09-13T15:07:41.505110+0000","last_undegraded":"2024-09-13T15:07:41.505110+0000","last_fullsized":"2024-09-13T15:07:41.505110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.539457+0000","last_change":"2024-09-13T15:07:41.536499+0000","last_active":"2024-09-13T15:07:41.539457+0000","last_peered":"2024-09-13T15:07:41.539457+0000","last_clean":"2024-09-13T15:07:41.539457+0000","last_became_active":"2024-09-13T15:07:41.536051+0000","last_became_peered":"2024-09-13T15:07:41.536051+0000","last_unstale":"2024-09-13T15:07:41.539457+0000","last_undegraded":"2024-09-13T15:07:41.539457+0000","last_fullsized":"2024-09-13T15:07:41.539457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506936+0000","last_change":"2024-09-13T15:07:37.491784+0000","last_active":"2024-09-13T15:07:41.506936+0000","last_peered":"2024-09-13T15:07:41.506936+0000","last_clean":"2024-09-13T15:07:41.506936+0000","last_became_active":"2024-09-13T15:07:37.491544+0000","last_became_peered":"2024-09-13T15:07:37.491544+0000","last_unstale":"2024-09-13T15:07:41.506936+0000","last_undegraded":"2024-09-13T15:07:41.506936+0000","last_fullsized":"2024-09-13T15:07:41.506936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:13.919211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564277+0000","last_change":"2024-09-13T15:07:37.014778+0000","last_active":"2024-09-13T15:07:41.564277+0000","last_peered":"2024-09-13T15:07:41.564277+0000","last_clean":"2024-09-13T15:07:41.564277+0000","last_became_active":"2024-09-13T15:07:37.014475+0000","last_became_peered":"2024-09-13T15:07:37.014475+0000","last_unstale":"2024-09-13T15:07:41.564277+0000","last_undegraded":"2024-09-13T15:07:41.564277+0000","last_fullsized":"2024-09-13T15:07:41.564277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:33.515165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577706+0000","last_change":"2024-09-13T15:07:41.572783+0000","last_active":"2024-09-13T15:07:41.577706+0000","last_peered":"2024-09-13T15:07:41.577706+0000","last_clean":"2024-09-13T15:07:41.577706+0000","last_became_active":"2024-09-13T15:07:41.571654+0000","last_became_peered":"2024-09-13T15:07:41.571654+0000","last_unstale":"2024-09-13T15:07:41.577706+0000","last_undegraded":"2024-09-13T15:07:41.577706+0000","last_fullsized":"2024-09-13T15:07:41.577706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.506083+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.505793+0000","last_became_peered":"2024-09-13T15:07:37.505793+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503229+0000","last_change":"2024-09-13T15:07:36.995886+0000","last_active":"2024-09-13T15:07:41.503229+0000","last_peered":"2024-09-13T15:07:41.503229+0000","last_clean":"2024-09-13T15:07:41.503229+0000","last_became_active":"2024-09-13T15:07:36.995560+0000","last_became_peered":"2024-09-13T15:07:36.995560+0000","last_unstale":"2024-09-13T15:07:41.503229+0000","last_undegraded":"2024-09-13T15:07:41.503229+0000","last_fullsized":"2024-09-13T15:07:41.503229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564508+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:07:41.564508+0000","last_peered":"2024-09-13T15:07:41.564508+0000","last_clean":"2024-09-13T15:07:41.564508+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:07:41.564508+0000","last_undegraded":"2024-09-13T15:07:41.564508+0000","last_fullsized":"2024-09-13T15:07:41.564508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573389+0000","last_change":"2024-09-13T15:07:41.568736+0000","last_active":"2024-09-13T15:07:41.573389+0000","last_peered":"2024-09-13T15:07:41.573389+0000","last_clean":"2024-09-13T15:07:41.573389+0000","last_became_active":"2024-09-13T15:07:41.568356+0000","last_became_peered":"2024-09-13T15:07:41.568356+0000","last_unstale":"2024-09-13T15:07:41.573389+0000","last_undegraded":"2024-09-13T15:07:41.573389+0000","last_fullsized":"2024-09-13T15:07:41.573389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:32.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565674+0000","last_change":"2024-09-13T15:07:37.500315+0000","last_active":"2024-09-13T15:07:41.565674+0000","last_peered":"2024-09-13T15:07:41.565674+0000","last_clean":"2024-09-13T15:07:41.565674+0000","last_became_active":"2024-09-13T15:07:37.499912+0000","last_became_peered":"2024-09-13T15:07:37.499912+0000","last_unstale":"2024-09-13T15:07:41.565674+0000","last_undegraded":"2024-09-13T15:07:41.565674+0000","last_fullsized":"2024-09-13T15:07:41.565674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:37.433264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511110+0000","last_change":"2024-09-13T15:07:37.005731+0000","last_active":"2024-09-13T15:07:41.511110+0000","last_peered":"2024-09-13T15:07:41.511110+0000","last_clean":"2024-09-13T15:07:41.511110+0000","last_became_active":"2024-09-13T15:07:37.005196+0000","last_became_peered":"2024-09-13T15:07:37.005196+0000","last_unstale":"2024-09-13T15:07:41.511110+0000","last_undegraded":"2024-09-13T15:07:41.511110+0000","last_fullsized":"2024-09-13T15:07:41.511110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.567559+0000","last_change":"2024-09-13T15:07:41.565589+0000","last_active":"2024-09-13T15:07:41.567559+0000","last_peered":"2024-09-13T15:07:41.567559+0000","last_clean":"2024-09-13T15:07:41.567559+0000","last_became_active":"2024-09-13T15:07:41.565135+0000","last_became_peered":"2024-09-13T15:07:41.565135+0000","last_unstale":"2024-09-13T15:07:41.567559+0000","last_undegraded":"2024-09-13T15:07:41.567559+0000","last_fullsized":"2024-09-13T15:07:41.567559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:41.331515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504783+0000","last_change":"2024-09-13T15:07:37.494952+0000","last_active":"2024-09-13T15:07:41.504783+0000","last_peered":"2024-09-13T15:07:41.504783+0000","last_clean":"2024-09-13T15:07:41.504783+0000","last_became_active":"2024-09-13T15:07:37.494616+0000","last_became_peered":"2024-09-13T15:07:37.494616+0000","last_unstale":"2024-09-13T15:07:41.504783+0000","last_undegraded":"2024-09-13T15:07:41.504783+0000","last_fullsized":"2024-09-13T15:07:41.504783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526436+0000","last_change":"2024-09-13T15:07:37.016938+0000","last_active":"2024-09-13T15:07:41.526436+0000","last_peered":"2024-09-13T15:07:41.526436+0000","last_clean":"2024-09-13T15:07:41.526436+0000","last_became_active":"2024-09-13T15:07:37.016416+0000","last_became_peered":"2024-09-13T15:07:37.016416+0000","last_unstale":"2024-09-13T15:07:41.526436+0000","last_undegraded":"2024-09-13T15:07:41.526436+0000","last_fullsized":"2024-09-13T15:07:41.526436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533876+0000","last_change":"2024-09-13T15:07:41.530568+0000","last_active":"2024-09-13T15:07:41.533876+0000","last_peered":"2024-09-13T15:07:41.533876+0000","last_clean":"2024-09-13T15:07:41.533876+0000","last_became_active":"2024-09-13T15:07:41.528769+0000","last_became_peered":"2024-09-13T15:07:41.528769+0000","last_unstale":"2024-09-13T15:07:41.533876+0000","last_undegraded":"2024-09-13T15:07:41.533876+0000","last_fullsized":"2024-09-13T15:07:41.533876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:21.253459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566675+0000","last_change":"2024-09-13T15:07:37.516289+0000","last_active":"2024-09-13T15:07:41.566675+0000","last_peered":"2024-09-13T15:07:41.566675+0000","last_clean":"2024-09-13T15:07:41.566675+0000","last_became_active":"2024-09-13T15:07:37.515469+0000","last_became_peered":"2024-09-13T15:07:37.515469+0000","last_unstale":"2024-09-13T15:07:41.566675+0000","last_undegraded":"2024-09-13T15:07:41.566675+0000","last_fullsized":"2024-09-13T15:07:41.566675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505710+0000","last_change":"2024-09-13T15:07:37.004010+0000","last_active":"2024-09-13T15:07:41.505710+0000","last_peered":"2024-09-13T15:07:41.505710+0000","last_clean":"2024-09-13T15:07:41.505710+0000","last_became_active":"2024-09-13T15:07:37.003685+0000","last_became_peered":"2024-09-13T15:07:37.003685+0000","last_unstale":"2024-09-13T15:07:41.505710+0000","last_undegraded":"2024-09-13T15:07:41.505710+0000","last_fullsized":"2024-09-13T15:07:41.505710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.571567+0000","last_change":"2024-09-13T15:07:41.570035+0000","last_active":"2024-09-13T15:07:41.571567+0000","last_peered":"2024-09-13T15:07:41.571567+0000","last_clean":"2024-09-13T15:07:41.571567+0000","last_became_active":"2024-09-13T15:07:41.566940+0000","last_became_peered":"2024-09-13T15:07:41.566940+0000","last_unstale":"2024-09-13T15:07:41.571567+0000","last_undegraded":"2024-09-13T15:07:41.571567+0000","last_fullsized":"2024-09-13T15:07:41.571567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:12.402544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565356+0000","last_change":"2024-09-13T15:07:37.519128+0000","last_active":"2024-09-13T15:07:41.565356+0000","last_peered":"2024-09-13T15:07:41.565356+0000","last_clean":"2024-09-13T15:07:41.565356+0000","last_became_active":"2024-09-13T15:07:37.518869+0000","last_became_peered":"2024-09-13T15:07:37.518869+0000","last_unstale":"2024-09-13T15:07:41.565356+0000","last_undegraded":"2024-09-13T15:07:41.565356+0000","last_fullsized":"2024-09-13T15:07:41.565356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503446+0000","last_change":"2024-09-13T15:07:37.010518+0000","last_active":"2024-09-13T15:07:41.503446+0000","last_peered":"2024-09-13T15:07:41.503446+0000","last_clean":"2024-09-13T15:07:41.503446+0000","last_became_active":"2024-09-13T15:07:37.008427+0000","last_became_peered":"2024-09-13T15:07:37.008427+0000","last_unstale":"2024-09-13T15:07:41.503446+0000","last_undegraded":"2024-09-13T15:07:41.503446+0000","last_fullsized":"2024-09-13T15:07:41.503446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:58.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.536864+0000","last_change":"2024-09-13T15:07:41.532322+0000","last_active":"2024-09-13T15:07:41.536864+0000","last_peered":"2024-09-13T15:07:41.536864+0000","last_clean":"2024-09-13T15:07:41.536864+0000","last_became_active":"2024-09-13T15:07:41.531912+0000","last_became_peered":"2024-09-13T15:07:41.531912+0000","last_unstale":"2024-09-13T15:07:41.536864+0000","last_undegraded":"2024-09-13T15:07:41.536864+0000","last_fullsized":"2024-09-13T15:07:41.536864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:30.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564696+0000","last_change":"2024-09-13T15:07:37.515251+0000","last_active":"2024-09-13T15:07:41.564696+0000","last_peered":"2024-09-13T15:07:41.564696+0000","last_clean":"2024-09-13T15:07:41.564696+0000","last_became_active":"2024-09-13T15:07:37.514972+0000","last_became_peered":"2024-09-13T15:07:37.514972+0000","last_unstale":"2024-09-13T15:07:41.564696+0000","last_undegraded":"2024-09-13T15:07:41.564696+0000","last_fullsized":"2024-09-13T15:07:41.564696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504636+0000","last_change":"2024-09-13T15:07:37.004826+0000","last_active":"2024-09-13T15:07:41.504636+0000","last_peered":"2024-09-13T15:07:41.504636+0000","last_clean":"2024-09-13T15:07:41.504636+0000","last_became_active":"2024-09-13T15:07:37.004447+0000","last_became_peered":"2024-09-13T15:07:37.004447+0000","last_unstale":"2024-09-13T15:07:41.504636+0000","last_undegraded":"2024-09-13T15:07:41.504636+0000","last_fullsized":"2024-09-13T15:07:41.504636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.540805+0000","last_change":"2024-09-13T15:07:41.537561+0000","last_active":"2024-09-13T15:07:41.540805+0000","last_peered":"2024-09-13T15:07:41.540805+0000","last_clean":"2024-09-13T15:07:41.540805+0000","last_became_active":"2024-09-13T15:07:41.536984+0000","last_became_peered":"2024-09-13T15:07:41.536984+0000","last_unstale":"2024-09-13T15:07:41.540805+0000","last_undegraded":"2024-09-13T15:07:41.540805+0000","last_fullsized":"2024-09-13T15:07:41.540805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:18.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511993+0000","last_change":"2024-09-13T15:07:37.498344+0000","last_active":"2024-09-13T15:07:41.511993+0000","last_peered":"2024-09-13T15:07:41.511993+0000","last_clean":"2024-09-13T15:07:41.511993+0000","last_became_active":"2024-09-13T15:07:37.498068+0000","last_became_peered":"2024-09-13T15:07:37.498068+0000","last_unstale":"2024-09-13T15:07:41.511993+0000","last_undegraded":"2024-09-13T15:07:41.511993+0000","last_fullsized":"2024-09-13T15:07:41.511993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511905+0000","last_change":"2024-09-13T15:07:36.997359+0000","last_active":"2024-09-13T15:07:41.511905+0000","last_peered":"2024-09-13T15:07:41.511905+0000","last_clean":"2024-09-13T15:07:41.511905+0000","last_became_active":"2024-09-13T15:07:36.997095+0000","last_became_peered":"2024-09-13T15:07:36.997095+0000","last_unstale":"2024-09-13T15:07:41.511905+0000","last_undegraded":"2024-09-13T15:07:41.511905+0000","last_fullsized":"2024-09-13T15:07:41.511905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.145082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578693+0000","last_change":"2024-09-13T15:07:41.574687+0000","last_active":"2024-09-13T15:07:41.578693+0000","last_peered":"2024-09-13T15:07:41.578693+0000","last_clean":"2024-09-13T15:07:41.578693+0000","last_became_active":"2024-09-13T15:07:41.573353+0000","last_became_peered":"2024-09-13T15:07:41.573353+0000","last_unstale":"2024-09-13T15:07:41.578693+0000","last_undegraded":"2024-09-13T15:07:41.578693+0000","last_fullsized":"2024-09-13T15:07:41.578693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:52.778665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564643+0000","last_change":"2024-09-13T15:07:37.518920+0000","last_active":"2024-09-13T15:07:41.564643+0000","last_peered":"2024-09-13T15:07:41.564643+0000","last_clean":"2024-09-13T15:07:41.564643+0000","last_became_active":"2024-09-13T15:07:37.518651+0000","last_became_peered":"2024-09-13T15:07:37.518651+0000","last_unstale":"2024-09-13T15:07:41.564643+0000","last_undegraded":"2024-09-13T15:07:41.564643+0000","last_fullsized":"2024-09-13T15:07:41.564643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503060+0000","last_change":"2024-09-13T15:07:37.007685+0000","last_active":"2024-09-13T15:07:41.503060+0000","last_peered":"2024-09-13T15:07:41.503060+0000","last_clean":"2024-09-13T15:07:41.503060+0000","last_became_active":"2024-09-13T15:07:37.007213+0000","last_became_peered":"2024-09-13T15:07:37.007213+0000","last_unstale":"2024-09-13T15:07:41.503060+0000","last_undegraded":"2024-09-13T15:07:41.503060+0000","last_fullsized":"2024-09-13T15:07:41.503060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.573282+0000","last_change":"2024-09-13T15:07:41.568051+0000","last_active":"2024-09-13T15:07:41.573282+0000","last_peered":"2024-09-13T15:07:41.573282+0000","last_clean":"2024-09-13T15:07:41.573282+0000","last_became_active":"2024-09-13T15:07:41.566715+0000","last_became_peered":"2024-09-13T15:07:41.566715+0000","last_unstale":"2024-09-13T15:07:41.573282+0000","last_undegraded":"2024-09-13T15:07:41.573282+0000","last_fullsized":"2024-09-13T15:07:41.573282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:34.569239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505146+0000","last_change":"2024-09-13T15:07:37.506015+0000","last_active":"2024-09-13T15:07:41.505146+0000","last_peered":"2024-09-13T15:07:41.505146+0000","last_clean":"2024-09-13T15:07:41.505146+0000","last_became_active":"2024-09-13T15:07:37.505661+0000","last_became_peered":"2024-09-13T15:07:37.505661+0000","last_unstale":"2024-09-13T15:07:41.505146+0000","last_undegraded":"2024-09-13T15:07:41.505146+0000","last_fullsized":"2024-09-13T15:07:41.505146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515345+0000","last_change":"2024-09-13T15:07:37.009882+0000","last_active":"2024-09-13T15:07:41.515345+0000","last_peered":"2024-09-13T15:07:41.515345+0000","last_clean":"2024-09-13T15:07:41.515345+0000","last_became_active":"2024-09-13T15:07:37.009351+0000","last_became_peered":"2024-09-13T15:07:37.009351+0000","last_unstale":"2024-09-13T15:07:41.515345+0000","last_undegraded":"2024-09-13T15:07:41.515345+0000","last_fullsized":"2024-09-13T15:07:41.515345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:18.345950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.575567+0000","last_change":"2024-09-13T15:07:41.571228+0000","last_active":"2024-09-13T15:07:41.575567+0000","last_peered":"2024-09-13T15:07:41.575567+0000","last_clean":"2024-09-13T15:07:41.575567+0000","last_became_active":"2024-09-13T15:07:41.570618+0000","last_became_peered":"2024-09-13T15:07:41.570618+0000","last_unstale":"2024-09-13T15:07:41.575567+0000","last_undegraded":"2024-09-13T15:07:41.575567+0000","last_fullsized":"2024-09-13T15:07:41.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:29.764351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565542+0000","last_change":"2024-09-13T15:07:37.500097+0000","last_active":"2024-09-13T15:07:41.565542+0000","last_peered":"2024-09-13T15:07:41.565542+0000","last_clean":"2024-09-13T15:07:41.565542+0000","last_became_active":"2024-09-13T15:07:37.499700+0000","last_became_peered":"2024-09-13T15:07:37.499700+0000","last_unstale":"2024-09-13T15:07:41.565542+0000","last_undegraded":"2024-09-13T15:07:41.565542+0000","last_fullsized":"2024-09-13T15:07:41.565542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T15:07:54.189933+0000","last_change":"2024-09-13T15:07:37.004068+0000","last_active":"2024-09-13T15:07:54.189933+0000","last_peered":"2024-09-13T15:07:54.189933+0000","last_clean":"2024-09-13T15:07:54.189933+0000","last_became_active":"2024-09-13T15:07:37.003828+0000","last_became_peered":"2024-09-13T15:07:37.003828+0000","last_unstale":"2024-09-13T15:07:54.189933+0000","last_undegraded":"2024-09-13T15:07:54.189933+0000","last_fullsized":"2024-09-13T15:07:54.189933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:24.154623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533775+0000","last_change":"2024-09-13T15:07:41.531428+0000","last_active":"2024-09-13T15:07:41.533775+0000","last_peered":"2024-09-13T15:07:41.533775+0000","last_clean":"2024-09-13T15:07:41.533775+0000","last_became_active":"2024-09-13T15:07:41.531005+0000","last_became_peered":"2024-09-13T15:07:41.531005+0000","last_unstale":"2024-09-13T15:07:41.533775+0000","last_undegraded":"2024-09-13T15:07:41.533775+0000","last_fullsized":"2024-09-13T15:07:41.533775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:12.805480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504532+0000","last_change":"2024-09-13T15:07:37.515016+0000","last_active":"2024-09-13T15:07:41.504532+0000","last_peered":"2024-09-13T15:07:41.504532+0000","last_clean":"2024-09-13T15:07:41.504532+0000","last_became_active":"2024-09-13T15:07:37.514791+0000","last_became_peered":"2024-09-13T15:07:37.514791+0000","last_unstale":"2024-09-13T15:07:41.504532+0000","last_undegraded":"2024-09-13T15:07:41.504532+0000","last_fullsized":"2024-09-13T15:07:41.504532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.526346+0000","last_change":"2024-09-13T15:07:37.015782+0000","last_active":"2024-09-13T15:07:41.526346+0000","last_peered":"2024-09-13T15:07:41.526346+0000","last_clean":"2024-09-13T15:07:41.526346+0000","last_became_active":"2024-09-13T15:07:37.015458+0000","last_became_peered":"2024-09-13T15:07:37.015458+0000","last_unstale":"2024-09-13T15:07:41.526346+0000","last_undegraded":"2024-09-13T15:07:41.526346+0000","last_fullsized":"2024-09-13T15:07:41.526346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:40.258507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.528017+0000","last_change":"2024-09-13T15:07:41.525109+0000","last_active":"2024-09-13T15:07:41.528017+0000","last_peered":"2024-09-13T15:07:41.528017+0000","last_clean":"2024-09-13T15:07:41.528017+0000","last_became_active":"2024-09-13T15:07:41.524368+0000","last_became_peered":"2024-09-13T15:07:41.524368+0000","last_unstale":"2024-09-13T15:07:41.528017+0000","last_undegraded":"2024-09-13T15:07:41.528017+0000","last_fullsized":"2024-09-13T15:07:41.528017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.479957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509473+0000","last_change":"2024-09-13T15:07:37.503285+0000","last_active":"2024-09-13T15:07:41.509473+0000","last_peered":"2024-09-13T15:07:41.509473+0000","last_clean":"2024-09-13T15:07:41.509473+0000","last_became_active":"2024-09-13T15:07:37.502590+0000","last_became_peered":"2024-09-13T15:07:37.502590+0000","last_unstale":"2024-09-13T15:07:41.509473+0000","last_undegraded":"2024-09-13T15:07:41.509473+0000","last_fullsized":"2024-09-13T15:07:41.509473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:19.522117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505205+0000","last_change":"2024-09-13T15:07:37.006134+0000","last_active":"2024-09-13T15:07:41.505205+0000","last_peered":"2024-09-13T15:07:41.505205+0000","last_clean":"2024-09-13T15:07:41.505205+0000","last_became_active":"2024-09-13T15:07:37.005639+0000","last_became_peered":"2024-09-13T15:07:37.005639+0000","last_unstale":"2024-09-13T15:07:41.505205+0000","last_undegraded":"2024-09-13T15:07:41.505205+0000","last_fullsized":"2024-09-13T15:07:41.505205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.534013+0000","last_change":"2024-09-13T15:07:41.531809+0000","last_active":"2024-09-13T15:07:41.534013+0000","last_peered":"2024-09-13T15:07:41.534013+0000","last_clean":"2024-09-13T15:07:41.534013+0000","last_became_active":"2024-09-13T15:07:41.527321+0000","last_became_peered":"2024-09-13T15:07:41.527321+0000","last_unstale":"2024-09-13T15:07:41.534013+0000","last_undegraded":"2024-09-13T15:07:41.534013+0000","last_fullsized":"2024-09-13T15:07:41.534013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:39.844754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505119+0000","last_change":"2024-09-13T15:07:37.504536+0000","last_active":"2024-09-13T15:07:41.505119+0000","last_peered":"2024-09-13T15:07:41.505119+0000","last_clean":"2024-09-13T15:07:41.505119+0000","last_became_active":"2024-09-13T15:07:37.504176+0000","last_became_peered":"2024-09-13T15:07:37.504176+0000","last_unstale":"2024-09-13T15:07:41.505119+0000","last_undegraded":"2024-09-13T15:07:41.505119+0000","last_fullsized":"2024-09-13T15:07:41.505119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516435+0000","last_change":"2024-09-13T15:07:37.005951+0000","last_active":"2024-09-13T15:07:41.516435+0000","last_peered":"2024-09-13T15:07:41.516435+0000","last_clean":"2024-09-13T15:07:41.516435+0000","last_became_active":"2024-09-13T15:07:37.005548+0000","last_became_peered":"2024-09-13T15:07:37.005548+0000","last_unstale":"2024-09-13T15:07:41.516435+0000","last_undegraded":"2024-09-13T15:07:41.516435+0000","last_fullsized":"2024-09-13T15:07:41.516435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.578487+0000","last_change":"2024-09-13T15:07:41.571875+0000","last_active":"2024-09-13T15:07:41.578487+0000","last_peered":"2024-09-13T15:07:41.578487+0000","last_clean":"2024-09-13T15:07:41.578487+0000","last_became_active":"2024-09-13T15:07:41.569987+0000","last_became_peered":"2024-09-13T15:07:41.569987+0000","last_unstale":"2024-09-13T15:07:41.578487+0000","last_undegraded":"2024-09-13T15:07:41.578487+0000","last_fullsized":"2024-09-13T15:07:41.578487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:00.976764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.577725+0000","last_change":"2024-09-13T15:07:41.573083+0000","last_active":"2024-09-13T15:07:41.577725+0000","last_peered":"2024-09-13T15:07:41.577725+0000","last_clean":"2024-09-13T15:07:41.577725+0000","last_became_active":"2024-09-13T15:07:41.572220+0000","last_became_peered":"2024-09-13T15:07:41.572220+0000","last_unstale":"2024-09-13T15:07:41.577725+0000","last_undegraded":"2024-09-13T15:07:41.577725+0000","last_fullsized":"2024-09-13T15:07:41.577725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:55.361603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521874+0000","last_change":"2024-09-13T15:07:37.493152+0000","last_active":"2024-09-13T15:07:41.521874+0000","last_peered":"2024-09-13T15:07:41.521874+0000","last_clean":"2024-09-13T15:07:41.521874+0000","last_became_active":"2024-09-13T15:07:37.492891+0000","last_became_peered":"2024-09-13T15:07:37.492891+0000","last_unstale":"2024-09-13T15:07:41.521874+0000","last_undegraded":"2024-09-13T15:07:41.521874+0000","last_fullsized":"2024-09-13T15:07:41.521874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.503103+0000","last_change":"2024-09-13T15:07:37.002734+0000","last_active":"2024-09-13T15:07:41.503103+0000","last_peered":"2024-09-13T15:07:41.503103+0000","last_clean":"2024-09-13T15:07:41.503103+0000","last_became_active":"2024-09-13T15:07:37.002305+0000","last_became_peered":"2024-09-13T15:07:37.002305+0000","last_unstale":"2024-09-13T15:07:41.503103+0000","last_undegraded":"2024-09-13T15:07:41.503103+0000","last_fullsized":"2024-09-13T15:07:41.503103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:45.791739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533380+0000","last_change":"2024-09-13T15:07:41.527871+0000","last_active":"2024-09-13T15:07:41.533380+0000","last_peered":"2024-09-13T15:07:41.533380+0000","last_clean":"2024-09-13T15:07:41.533380+0000","last_became_active":"2024-09-13T15:07:41.527114+0000","last_became_peered":"2024-09-13T15:07:41.527114+0000","last_unstale":"2024-09-13T15:07:41.533380+0000","last_undegraded":"2024-09-13T15:07:41.533380+0000","last_fullsized":"2024-09-13T15:07:41.533380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:30.239217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523542+0000","last_change":"2024-09-13T15:07:37.490427+0000","last_active":"2024-09-13T15:07:41.523542+0000","last_peered":"2024-09-13T15:07:41.523542+0000","last_clean":"2024-09-13T15:07:41.523542+0000","last_became_active":"2024-09-13T15:07:37.490022+0000","last_became_peered":"2024-09-13T15:07:37.490022+0000","last_unstale":"2024-09-13T15:07:41.523542+0000","last_undegraded":"2024-09-13T15:07:41.523542+0000","last_fullsized":"2024-09-13T15:07:41.523542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506961+0000","last_change":"2024-09-13T15:07:37.007543+0000","last_active":"2024-09-13T15:07:41.506961+0000","last_peered":"2024-09-13T15:07:41.506961+0000","last_clean":"2024-09-13T15:07:41.506961+0000","last_became_active":"2024-09-13T15:07:37.007134+0000","last_became_peered":"2024-09-13T15:07:37.007134+0000","last_unstale":"2024-09-13T15:07:41.506961+0000","last_undegraded":"2024-09-13T15:07:41.506961+0000","last_fullsized":"2024-09-13T15:07:41.506961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:23.380536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512143+0000","last_change":"2024-09-13T15:07:37.003099+0000","last_active":"2024-09-13T15:07:41.512143+0000","last_peered":"2024-09-13T15:07:41.512143+0000","last_clean":"2024-09-13T15:07:41.512143+0000","last_became_active":"2024-09-13T15:07:37.001875+0000","last_became_peered":"2024-09-13T15:07:37.001875+0000","last_unstale":"2024-09-13T15:07:41.512143+0000","last_undegraded":"2024-09-13T15:07:41.512143+0000","last_fullsized":"2024-09-13T15:07:41.512143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:55.472048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515252+0000","last_change":"2024-09-13T15:07:37.514343+0000","last_active":"2024-09-13T15:07:41.515252+0000","last_peered":"2024-09-13T15:07:41.515252+0000","last_clean":"2024-09-13T15:07:41.515252+0000","last_became_active":"2024-09-13T15:07:37.514044+0000","last_became_peered":"2024-09-13T15:07:37.514044+0000","last_unstale":"2024-09-13T15:07:41.515252+0000","last_undegraded":"2024-09-13T15:07:41.515252+0000","last_fullsized":"2024-09-13T15:07:41.515252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.538959+0000","last_change":"2024-09-13T15:07:41.536373+0000","last_active":"2024-09-13T15:07:41.538959+0000","last_peered":"2024-09-13T15:07:41.538959+0000","last_clean":"2024-09-13T15:07:41.538959+0000","last_became_active":"2024-09-13T15:07:41.535945+0000","last_became_peered":"2024-09-13T15:07:41.535945+0000","last_unstale":"2024-09-13T15:07:41.538959+0000","last_undegraded":"2024-09-13T15:07:41.538959+0000","last_fullsized":"2024-09-13T15:07:41.538959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:09.980333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505339+0000","last_change":"2024-09-13T15:07:37.008842+0000","last_active":"2024-09-13T15:07:41.505339+0000","last_peered":"2024-09-13T15:07:41.505339+0000","last_clean":"2024-09-13T15:07:41.505339+0000","last_became_active":"2024-09-13T15:07:37.008556+0000","last_became_peered":"2024-09-13T15:07:37.008556+0000","last_unstale":"2024-09-13T15:07:41.505339+0000","last_undegraded":"2024-09-13T15:07:41.505339+0000","last_fullsized":"2024-09-13T15:07:41.505339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:35.952637+0000","last_clean_scrub_stamp":"2024-09-13T15:07:35.952637+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:22.871742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507931+0000","last_change":"2024-09-13T15:07:37.493138+0000","last_active":"2024-09-13T15:07:41.507931+0000","last_peered":"2024-09-13T15:07:41.507931+0000","last_clean":"2024-09-13T15:07:41.507931+0000","last_became_active":"2024-09-13T15:07:37.492811+0000","last_became_peered":"2024-09-13T15:07:37.492811+0000","last_unstale":"2024-09-13T15:07:41.507931+0000","last_undegraded":"2024-09-13T15:07:41.507931+0000","last_fullsized":"2024-09-13T15:07:41.507931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.533522+0000","last_change":"2024-09-13T15:07:41.531188+0000","last_active":"2024-09-13T15:07:41.533522+0000","last_peered":"2024-09-13T15:07:41.533522+0000","last_clean":"2024-09-13T15:07:41.533522+0000","last_became_active":"2024-09-13T15:07:41.530750+0000","last_became_peered":"2024-09-13T15:07:41.530750+0000","last_unstale":"2024-09-13T15:07:41.533522+0000","last_undegraded":"2024-09-13T15:07:41.533522+0000","last_fullsized":"2024-09-13T15:07:41.533522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:40.475650+0000","last_clean_scrub_stamp":"2024-09-13T15:07:40.475650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:17.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.511841+0000","last_change":"2024-09-13T15:07:37.502829+0000","last_active":"2024-09-13T15:07:41.511841+0000","last_peered":"2024-09-13T15:07:41.511841+0000","last_clean":"2024-09-13T15:07:41.511841+0000","last_became_active":"2024-09-13T15:07:37.502567+0000","last_became_peered":"2024-09-13T15:07:37.502567+0000","last_unstale":"2024-09-13T15:07:41.511841+0000","last_undegraded":"2024-09-13T15:07:41.511841+0000","last_fullsized":"2024-09-13T15:07:41.511841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505009+0000","last_change":"2024-09-13T15:07:37.499515+0000","last_active":"2024-09-13T15:07:41.505009+0000","last_peered":"2024-09-13T15:07:41.505009+0000","last_clean":"2024-09-13T15:07:41.505009+0000","last_became_active":"2024-09-13T15:07:37.499249+0000","last_became_peered":"2024-09-13T15:07:37.499249+0000","last_unstale":"2024-09-13T15:07:41.505009+0000","last_undegraded":"2024-09-13T15:07:41.505009+0000","last_fullsized":"2024-09-13T15:07:41.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:34.528523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502954+0000","last_change":"2024-09-13T15:07:37.491947+0000","last_active":"2024-09-13T15:07:41.502954+0000","last_peered":"2024-09-13T15:07:41.502954+0000","last_clean":"2024-09-13T15:07:41.502954+0000","last_became_active":"2024-09-13T15:07:37.491654+0000","last_became_peered":"2024-09-13T15:07:37.491654+0000","last_unstale":"2024-09-13T15:07:41.502954+0000","last_undegraded":"2024-09-13T15:07:41.502954+0000","last_fullsized":"2024-09-13T15:07:41.502954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515163+0000","last_change":"2024-09-13T15:07:37.492083+0000","last_active":"2024-09-13T15:07:41.515163+0000","last_peered":"2024-09-13T15:07:41.515163+0000","last_clean":"2024-09-13T15:07:41.515163+0000","last_became_active":"2024-09-13T15:07:37.491195+0000","last_became_peered":"2024-09-13T15:07:37.491195+0000","last_unstale":"2024-09-13T15:07:41.515163+0000","last_undegraded":"2024-09-13T15:07:41.515163+0000","last_fullsized":"2024-09-13T15:07:41.515163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.507538+0000","last_change":"2024-09-13T15:07:37.510538+0000","last_active":"2024-09-13T15:07:41.507538+0000","last_peered":"2024-09-13T15:07:41.507538+0000","last_clean":"2024-09-13T15:07:41.507538+0000","last_became_active":"2024-09-13T15:07:37.510162+0000","last_became_peered":"2024-09-13T15:07:37.510162+0000","last_unstale":"2024-09-13T15:07:41.507538+0000","last_undegraded":"2024-09-13T15:07:41.507538+0000","last_fullsized":"2024-09-13T15:07:41.507538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.525991+0000","last_change":"2024-09-13T15:07:37.494524+0000","last_active":"2024-09-13T15:07:41.525991+0000","last_peered":"2024-09-13T15:07:41.525991+0000","last_clean":"2024-09-13T15:07:41.525991+0000","last_became_active":"2024-09-13T15:07:37.494249+0000","last_became_peered":"2024-09-13T15:07:37.494249+0000","last_unstale":"2024-09-13T15:07:41.525991+0000","last_undegraded":"2024-09-13T15:07:41.525991+0000","last_fullsized":"2024-09-13T15:07:41.525991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516203+0000","last_change":"2024-09-13T15:07:37.504649+0000","last_active":"2024-09-13T15:07:41.516203+0000","last_peered":"2024-09-13T15:07:41.516203+0000","last_clean":"2024-09-13T15:07:41.516203+0000","last_became_active":"2024-09-13T15:07:37.504400+0000","last_became_peered":"2024-09-13T15:07:37.504400+0000","last_unstale":"2024-09-13T15:07:41.516203+0000","last_undegraded":"2024-09-13T15:07:41.516203+0000","last_fullsized":"2024-09-13T15:07:41.516203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:34.264722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.509917+0000","last_change":"2024-09-13T15:07:37.506438+0000","last_active":"2024-09-13T15:07:41.509917+0000","last_peered":"2024-09-13T15:07:41.509917+0000","last_clean":"2024-09-13T15:07:41.509917+0000","last_became_active":"2024-09-13T15:07:37.506038+0000","last_became_peered":"2024-09-13T15:07:37.506038+0000","last_unstale":"2024-09-13T15:07:41.509917+0000","last_undegraded":"2024-09-13T15:07:41.509917+0000","last_fullsized":"2024-09-13T15:07:41.509917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502985+0000","last_change":"2024-09-13T15:07:37.491788+0000","last_active":"2024-09-13T15:07:41.502985+0000","last_peered":"2024-09-13T15:07:41.502985+0000","last_clean":"2024-09-13T15:07:41.502985+0000","last_became_active":"2024-09-13T15:07:37.491487+0000","last_became_peered":"2024-09-13T15:07:37.491487+0000","last_unstale":"2024-09-13T15:07:41.502985+0000","last_undegraded":"2024-09-13T15:07:41.502985+0000","last_fullsized":"2024-09-13T15:07:41.502985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:15.098915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506888+0000","last_change":"2024-09-13T15:07:37.493714+0000","last_active":"2024-09-13T15:07:41.506888+0000","last_peered":"2024-09-13T15:07:41.506888+0000","last_clean":"2024-09-13T15:07:41.506888+0000","last_became_active":"2024-09-13T15:07:37.493434+0000","last_became_peered":"2024-09-13T15:07:37.493434+0000","last_unstale":"2024-09-13T15:07:41.506888+0000","last_undegraded":"2024-09-13T15:07:41.506888+0000","last_fullsized":"2024-09-13T15:07:41.506888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502861+0000","last_change":"2024-09-13T15:07:37.505382+0000","last_active":"2024-09-13T15:07:41.502861+0000","last_peered":"2024-09-13T15:07:41.502861+0000","last_clean":"2024-09-13T15:07:41.502861+0000","last_became_active":"2024-09-13T15:07:37.504958+0000","last_became_peered":"2024-09-13T15:07:37.504958+0000","last_unstale":"2024-09-13T15:07:41.502861+0000","last_undegraded":"2024-09-13T15:07:41.502861+0000","last_fullsized":"2024-09-13T15:07:41.502861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.515039+0000","last_change":"2024-09-13T15:07:37.504610+0000","last_active":"2024-09-13T15:07:41.515039+0000","last_peered":"2024-09-13T15:07:41.515039+0000","last_clean":"2024-09-13T15:07:41.515039+0000","last_became_active":"2024-09-13T15:07:37.502014+0000","last_became_peered":"2024-09-13T15:07:37.502014+0000","last_unstale":"2024-09-13T15:07:41.515039+0000","last_undegraded":"2024-09-13T15:07:41.515039+0000","last_fullsized":"2024-09-13T15:07:41.515039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512035+0000","last_change":"2024-09-13T15:07:37.507065+0000","last_active":"2024-09-13T15:07:41.512035+0000","last_peered":"2024-09-13T15:07:41.512035+0000","last_clean":"2024-09-13T15:07:41.512035+0000","last_became_active":"2024-09-13T15:07:37.506779+0000","last_became_peered":"2024-09-13T15:07:37.506779+0000","last_unstale":"2024-09-13T15:07:41.512035+0000","last_undegraded":"2024-09-13T15:07:41.512035+0000","last_fullsized":"2024-09-13T15:07:41.512035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.565939+0000","last_change":"2024-09-13T15:07:37.500769+0000","last_active":"2024-09-13T15:07:41.565939+0000","last_peered":"2024-09-13T15:07:41.565939+0000","last_clean":"2024-09-13T15:07:41.565939+0000","last_became_active":"2024-09-13T15:07:37.500527+0000","last_became_peered":"2024-09-13T15:07:37.500527+0000","last_unstale":"2024-09-13T15:07:41.565939+0000","last_undegraded":"2024-09-13T15:07:41.565939+0000","last_fullsized":"2024-09-13T15:07:41.565939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:09.494094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505254+0000","last_change":"2024-09-13T15:07:37.501370+0000","last_active":"2024-09-13T15:07:41.505254+0000","last_peered":"2024-09-13T15:07:41.505254+0000","last_clean":"2024-09-13T15:07:41.505254+0000","last_became_active":"2024-09-13T15:07:37.501117+0000","last_became_peered":"2024-09-13T15:07:37.501117+0000","last_unstale":"2024-09-13T15:07:41.505254+0000","last_undegraded":"2024-09-13T15:07:41.505254+0000","last_fullsized":"2024-09-13T15:07:41.505254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:32.581001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505360+0000","last_change":"2024-09-13T15:07:37.499033+0000","last_active":"2024-09-13T15:07:41.505360+0000","last_peered":"2024-09-13T15:07:41.505360+0000","last_clean":"2024-09-13T15:07:41.505360+0000","last_became_active":"2024-09-13T15:07:37.498785+0000","last_became_peered":"2024-09-13T15:07:37.498785+0000","last_unstale":"2024-09-13T15:07:41.505360+0000","last_undegraded":"2024-09-13T15:07:41.505360+0000","last_fullsized":"2024-09-13T15:07:41.505360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:42.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502879+0000","last_change":"2024-09-13T15:07:37.496894+0000","last_active":"2024-09-13T15:07:41.502879+0000","last_peered":"2024-09-13T15:07:41.502879+0000","last_clean":"2024-09-13T15:07:41.502879+0000","last_became_active":"2024-09-13T15:07:37.496688+0000","last_became_peered":"2024-09-13T15:07:37.496688+0000","last_unstale":"2024-09-13T15:07:41.502879+0000","last_undegraded":"2024-09-13T15:07:41.502879+0000","last_fullsized":"2024-09-13T15:07:41.502879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:24.908909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.521879+0000","last_change":"2024-09-13T15:07:37.496945+0000","last_active":"2024-09-13T15:07:41.521879+0000","last_peered":"2024-09-13T15:07:41.521879+0000","last_clean":"2024-09-13T15:07:41.521879+0000","last_became_active":"2024-09-13T15:07:37.496509+0000","last_became_peered":"2024-09-13T15:07:37.496509+0000","last_unstale":"2024-09-13T15:07:41.521879+0000","last_undegraded":"2024-09-13T15:07:41.521879+0000","last_fullsized":"2024-09-13T15:07:41.521879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:21.414007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504987+0000","last_change":"2024-09-13T15:07:37.495060+0000","last_active":"2024-09-13T15:07:41.504987+0000","last_peered":"2024-09-13T15:07:41.504987+0000","last_clean":"2024-09-13T15:07:41.504987+0000","last_became_active":"2024-09-13T15:07:37.494788+0000","last_became_peered":"2024-09-13T15:07:37.494788+0000","last_unstale":"2024-09-13T15:07:41.504987+0000","last_undegraded":"2024-09-13T15:07:41.504987+0000","last_fullsized":"2024-09-13T15:07:41.504987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:06.470677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.505104+0000","last_change":"2024-09-13T15:07:37.491940+0000","last_active":"2024-09-13T15:07:41.505104+0000","last_peered":"2024-09-13T15:07:41.505104+0000","last_clean":"2024-09-13T15:07:41.505104+0000","last_became_active":"2024-09-13T15:07:37.491714+0000","last_became_peered":"2024-09-13T15:07:37.491714+0000","last_unstale":"2024-09-13T15:07:41.505104+0000","last_undegraded":"2024-09-13T15:07:41.505104+0000","last_fullsized":"2024-09-13T15:07:41.505104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:25.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.504221+0000","last_change":"2024-09-13T15:07:37.493155+0000","last_active":"2024-09-13T15:07:41.504221+0000","last_peered":"2024-09-13T15:07:41.504221+0000","last_clean":"2024-09-13T15:07:41.504221+0000","last_became_active":"2024-09-13T15:07:37.492896+0000","last_became_peered":"2024-09-13T15:07:37.492896+0000","last_unstale":"2024-09-13T15:07:41.504221+0000","last_undegraded":"2024-09-13T15:07:41.504221+0000","last_fullsized":"2024-09-13T15:07:41.504221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:56.485405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.512790+0000","last_change":"2024-09-13T15:07:37.502884+0000","last_active":"2024-09-13T15:07:41.512790+0000","last_peered":"2024-09-13T15:07:41.512790+0000","last_clean":"2024-09-13T15:07:41.512790+0000","last_became_active":"2024-09-13T15:07:37.502542+0000","last_became_peered":"2024-09-13T15:07:37.502542+0000","last_unstale":"2024-09-13T15:07:41.512790+0000","last_undegraded":"2024-09-13T15:07:41.512790+0000","last_fullsized":"2024-09-13T15:07:41.512790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:25.540235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.516072+0000","last_change":"2024-09-13T15:07:37.509728+0000","last_active":"2024-09-13T15:07:41.516072+0000","last_peered":"2024-09-13T15:07:41.516072+0000","last_clean":"2024-09-13T15:07:41.516072+0000","last_became_active":"2024-09-13T15:07:37.509264+0000","last_became_peered":"2024-09-13T15:07:37.509264+0000","last_unstale":"2024-09-13T15:07:41.516072+0000","last_undegraded":"2024-09-13T15:07:41.516072+0000","last_fullsized":"2024-09-13T15:07:41.516072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:31.725639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566575+0000","last_change":"2024-09-13T15:07:37.506122+0000","last_active":"2024-09-13T15:07:41.566575+0000","last_peered":"2024-09-13T15:07:41.566575+0000","last_clean":"2024-09-13T15:07:41.566575+0000","last_became_active":"2024-09-13T15:07:37.505859+0000","last_became_peered":"2024-09-13T15:07:37.505859+0000","last_unstale":"2024-09-13T15:07:41.566575+0000","last_undegraded":"2024-09-13T15:07:41.566575+0000","last_fullsized":"2024-09-13T15:07:41.566575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:24.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.523490+0000","last_change":"2024-09-13T15:07:37.506044+0000","last_active":"2024-09-13T15:07:41.523490+0000","last_peered":"2024-09-13T15:07:41.523490+0000","last_clean":"2024-09-13T15:07:41.523490+0000","last_became_active":"2024-09-13T15:07:37.505769+0000","last_became_peered":"2024-09-13T15:07:37.505769+0000","last_unstale":"2024-09-13T15:07:41.523490+0000","last_undegraded":"2024-09-13T15:07:41.523490+0000","last_fullsized":"2024-09-13T15:07:41.523490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:05.877661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564537+0000","last_change":"2024-09-13T15:07:37.499277+0000","last_active":"2024-09-13T15:07:41.564537+0000","last_peered":"2024-09-13T15:07:41.564537+0000","last_clean":"2024-09-13T15:07:41.564537+0000","last_became_active":"2024-09-13T15:07:37.499015+0000","last_became_peered":"2024-09-13T15:07:37.499015+0000","last_unstale":"2024-09-13T15:07:41.564537+0000","last_undegraded":"2024-09-13T15:07:41.564537+0000","last_fullsized":"2024-09-13T15:07:41.564537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:59.956060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502767+0000","last_change":"2024-09-13T15:07:37.490609+0000","last_active":"2024-09-13T15:07:41.502767+0000","last_peered":"2024-09-13T15:07:41.502767+0000","last_clean":"2024-09-13T15:07:41.502767+0000","last_became_active":"2024-09-13T15:07:37.490347+0000","last_became_peered":"2024-09-13T15:07:37.490347+0000","last_unstale":"2024-09-13T15:07:41.502767+0000","last_undegraded":"2024-09-13T15:07:41.502767+0000","last_fullsized":"2024-09-13T15:07:41.502767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.564563+0000","last_change":"2024-09-13T15:07:37.509408+0000","last_active":"2024-09-13T15:07:41.564563+0000","last_peered":"2024-09-13T15:07:41.564563+0000","last_clean":"2024-09-13T15:07:41.564563+0000","last_became_active":"2024-09-13T15:07:37.509076+0000","last_became_peered":"2024-09-13T15:07:37.509076+0000","last_unstale":"2024-09-13T15:07:41.564563+0000","last_undegraded":"2024-09-13T15:07:41.564563+0000","last_fullsized":"2024-09-13T15:07:41.564563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.502014+0000","last_change":"2024-09-13T15:07:37.496397+0000","last_active":"2024-09-13T15:07:41.502014+0000","last_peered":"2024-09-13T15:07:41.502014+0000","last_clean":"2024-09-13T15:07:41.502014+0000","last_became_active":"2024-09-13T15:07:37.495306+0000","last_became_peered":"2024-09-13T15:07:37.495306+0000","last_unstale":"2024-09-13T15:07:41.502014+0000","last_undegraded":"2024-09-13T15:07:41.502014+0000","last_fullsized":"2024-09-13T15:07:41.502014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:21.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.506055+0000","last_change":"2024-09-13T15:07:37.485483+0000","last_active":"2024-09-13T15:07:41.506055+0000","last_peered":"2024-09-13T15:07:41.506055+0000","last_clean":"2024-09-13T15:07:41.506055+0000","last_became_active":"2024-09-13T15:07:37.485197+0000","last_became_peered":"2024-09-13T15:07:37.485197+0000","last_unstale":"2024-09-13T15:07:41.506055+0000","last_undegraded":"2024-09-13T15:07:41.506055+0000","last_fullsized":"2024-09-13T15:07:41.506055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:55:48.445613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.527325+0000","last_change":"2024-09-13T15:07:37.493235+0000","last_active":"2024-09-13T15:07:41.527325+0000","last_peered":"2024-09-13T15:07:41.527325+0000","last_clean":"2024-09-13T15:07:41.527325+0000","last_became_active":"2024-09-13T15:07:37.493000+0000","last_became_peered":"2024-09-13T15:07:37.493000+0000","last_unstale":"2024-09-13T15:07:41.527325+0000","last_undegraded":"2024-09-13T15:07:41.527325+0000","last_fullsized":"2024-09-13T15:07:41.527325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.284190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T15:07:41.566439+0000","last_change":"2024-09-13T15:07:37.509845+0000","last_active":"2024-09-13T15:07:41.566439+0000","last_peered":"2024-09-13T15:07:41.566439+0000","last_clean":"2024-09-13T15:07:41.566439+0000","last_became_active":"2024-09-13T15:07:37.505933+0000","last_became_peered":"2024-09-13T15:07:37.505933+0000","last_unstale":"2024-09-13T15:07:41.566439+0000","last_undegraded":"2024-09-13T15:07:41.566439+0000","last_fullsized":"2024-09-13T15:07:41.566439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:36.965994+0000","last_clean_scrub_stamp":"2024-09-13T15:07:36.965994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:08.463346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.976}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7869999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.897}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":262144,"data_stored":102556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:08:09.459 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T15:08:09.459 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T15:08:09.459 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T15:08:09.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T15:08:09.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.661+0000 7f1674c00700 1 Processor -- start 2024-09-13T15:08:09.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.661+0000 7f1674c00700 1 -- start start 2024-09-13T15:08:09.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f1674c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f1674c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f167006cae0 0x7f16700b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f1674c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1670158880 con 0x7f16701584a0 2024-09-13T15:08:09.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f1674c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167006cf70 con 0x7f167006cae0 2024-09-13T15:08:09.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f1674c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16700b38b0 con 0x7f16700ceb10 2024-09-13T15:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16701584a0 0x7f167015ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57502/0 (socket says 172.21.15.50:57502) 2024-09-13T15:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166f400700 1 -- 172.21.15.50:0/959847743 learned_addr learned my addr 172.21.15.50:0/959847743 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166fe00700 1 --2- 172.21.15.50:0/959847743 >> v2:172.21.15.181:3300/0 conn(0x7f167006cae0 0x7f16700b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652667962 0 0) 0x7f1670158880 con 0x7f16701584a0 2024-09-13T15:08:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16540035d0 con 0x7f16701584a0 2024-09-13T15:08:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166ea00700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787906589 0 0) 0x7f16540035d0 con 0x7f16701584a0 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 msgr2=0x7f167006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 >> v2:172.21.15.181:3300/0 conn(0x7f167006cae0 msgr2=0x7f16700b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 --2- 172.21.15.50:0/959847743 >> v2:172.21.15.181:3300/0 conn(0x7f167006cae0 0x7f16700b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167015b930 con 0x7f16701584a0 2024-09-13T15:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f16600019f0 con 0x7f16701584a0 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166ea00700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166fe00700 1 --2- 172.21.15.50:0/959847743 >> v2:172.21.15.181:3300/0 conn(0x7f167006cae0 0x7f16700b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 >> v1:172.21.15.50:6789/0 conn(0x7f16701584a0 legacy=0x7f167015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f1654003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1654003f60 0x7f1654004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1654004db0 0x7f1654005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167006cf70 con 0x7f1654004db0 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700b38b0 con 0x7f1654003f60 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.665+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165400ba60 con 0x7f16700ceb10 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f1654003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166ea00700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1654003f60 0x7f1654004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166fe00700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1654004db0 0x7f1654005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 -- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1654003f60 msgr2=0x7f1654004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1654003f60 0x7f1654004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 -- 172.21.15.50:0/959847743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1654004db0 msgr2=0x7f1654005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1654004db0 0x7f1654005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 -- 172.21.15.50:0/959847743 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540035d0 con 0x7f16700ceb10 2024-09-13T15:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166f400700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f1654003a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f166000a860 tx=0x7f16540058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a0e688d87ac566f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16600072d0 con 0x7f16700ceb10 2024-09-13T15:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660007450 con 0x7f16700ceb10 2024-09-13T15:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166e000700 1 -- 172.21.15.50:0/959847743 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660007800 con 0x7f16700ceb10 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f1674c00700 1 -- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 msgr2=0x7f1654003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f1674c00700 1 --2- 172.21.15.50:0/959847743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f1654003a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f166000a860 tx=0x7f16540058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f166fe00700 1 -- 172.21.15.50:0/959847743 reap_dead start 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f1674c00700 1 -- 172.21.15.50:0/959847743 shutdown_connections 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f1674c00700 1 -- 172.21.15.50:0/959847743 >> 172.21.15.50:0/959847743 conn(0x7f16700b5fb0 msgr2=0x7f16700b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f1674c00700 1 -- 172.21.15.50:0/959847743 shutdown_connections 2024-09-13T15:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.669+0000 7f1674c00700 1 -- 172.21.15.50:0/959847743 wait complete. 2024-09-13T15:08:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 Processor -- start 2024-09-13T15:08:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 -- start start 2024-09-13T15:08:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167013d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 0x7f1670159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16701576f0 0x7f1670159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167014db40 con 0x7f1670157270 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167014dd50 con 0x7f16701576f0 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f1674c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167014e030 con 0x7f16700ceb10 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f166ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 0x7f1670159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f166ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 0x7f1670159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58284/0 (socket says 172.21.15.50:58284) 2024-09-13T15:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.673+0000 7f166ea00700 1 -- 172.21.15.50:0/1184631929 learned_addr learned my addr 172.21.15.50:0/1184631929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:09.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166f400700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167013d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166fe00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16701576f0 0x7f1670159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166ea00700 1 -- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 msgr2=0x7f167013d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166ea00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167013d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166ea00700 1 -- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16701576f0 msgr2=0x7f1670159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166ea00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16701576f0 0x7f1670159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166ea00700 1 -- 172.21.15.50:0/1184631929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167014ba70 con 0x7f1670157270 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f166ea00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 0x7f1670159a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f165c0098d0 tx=0x7f165c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0040f0 con 0x7f1670157270 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c0108e0 con 0x7f1670157270 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c010c50 con 0x7f1670157270 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167014bd50 con 0x7f1670157270 2024-09-13T15:08:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167013d690 con 0x7f1670157270 2024-09-13T15:08:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.677+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167014b8a0 con 0x7f1670157270 2024-09-13T15:08:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.681+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f165c015470 con 0x7f1670157270 2024-09-13T15:08:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.681+0000 7f1667400700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1650066730 0x7f1650068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.681+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f165c084c50 con 0x7f1670157270 2024-09-13T15:08:09.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.681+0000 7f166f400700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1650066730 0x7f1650068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:09.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.685+0000 7f166f400700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1650066730 0x7f1650068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1660016040 tx=0x7f1660009070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:09.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.685+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f165c051c30 con 0x7f1670157270 2024-09-13T15:08:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.909+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f16700d15f0 con 0x7f1670157270 2024-09-13T15:08:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1667400700 1 -- 172.21.15.50:0/1184631929 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f165c055250 con 0x7f1670157270 2024-09-13T15:08:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:09.915 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T15:08:09.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1650066730 msgr2=0x7f1650068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1650066730 0x7f1650068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1660016040 tx=0x7f1660009070 comp rx=0 tx=0).stop 2024-09-13T15:08:09.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 msgr2=0x7f1670159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:09.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 0x7f1670159a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f165c0098d0 tx=0x7f165c009c90 comp rx=0 tx=0).stop 2024-09-13T15:08:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 shutdown_connections 2024-09-13T15:08:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1650066730 0x7f1650068bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16701576f0 0x7f1670159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670157270 0x7f1670159a90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 --2- 172.21.15.50:0/1184631929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16700ceb10 0x7f167013d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.913+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 >> 172.21.15.50:0/1184631929 conn(0x7f16700b5fb0 msgr2=0x7f16700b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.917+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 shutdown_connections 2024-09-13T15:08:09.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:09.917+0000 7f1674c00700 1 -- 172.21.15.50:0/1184631929 wait complete. 2024-09-13T15:08:09.939 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T15:08:09.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 Processor -- start 2024-09-13T15:08:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 -- start start 2024-09-13T15:08:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f866c1610b0 0x7f866c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c06aaa0 0x7f866c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c0b3560 con 0x7f866c0b2670 2024-09-13T15:08:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c070b30 con 0x7f866c1610b0 2024-09-13T15:08:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f8671400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c06b420 con 0x7f866c06aaa0 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f866be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f866c1610b0 0x7f866c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f866be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f866c1610b0 0x7f866c0719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58300/0 (socket says 172.21.15.50:58300) 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.113+0000 7f866be00700 1 -- 172.21.15.50:0/3274661606 learned_addr learned my addr 172.21.15.50:0/3274661606 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8663400700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c06aaa0 0x7f866c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866be00700 1 -- 172.21.15.50:0/3274661606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c06aaa0 msgr2=0x7f866c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866be00700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c06aaa0 0x7f866c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866be00700 1 -- 172.21.15.50:0/3274661606 >> v1:172.21.15.181:6789/0 conn(0x7f866c0b2670 legacy=0x7f866c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866be00700 1 -- 172.21.15.50:0/3274661606 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0b3280 con 0x7f866c1610b0 2024-09-13T15:08:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8663400700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c06aaa0 0x7f866c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866be00700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c1610b0 0x7f866c0719c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f865c009910 tx=0x7f865c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253d0660fdeb386 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866b400700 1 -- 172.21.15.50:0/3274661606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00ba60 con 0x7f866c1610b0 2024-09-13T15:08:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866b400700 1 -- 172.21.15.50:0/3274661606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00bbc0 con 0x7f866c1610b0 2024-09-13T15:08:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f866b400700 1 -- 172.21.15.50:0/3274661606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c009e60 con 0x7f866c1610b0 2024-09-13T15:08:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 -- 172.21.15.50:0/3274661606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c1610b0 msgr2=0x7f866c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c1610b0 0x7f866c0719c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f865c009910 tx=0x7f865c009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 -- 172.21.15.50:0/3274661606 shutdown_connections 2024-09-13T15:08:10.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c06aaa0 0x7f866c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 --2- 172.21.15.50:0/3274661606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c1610b0 0x7f866c0719c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 -- 172.21.15.50:0/3274661606 >> 172.21.15.50:0/3274661606 conn(0x7f866c0b0c40 msgr2=0x7f866c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 -- 172.21.15.50:0/3274661606 shutdown_connections 2024-09-13T15:08:10.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.117+0000 7f8671400700 1 -- 172.21.15.50:0/3274661606 wait complete. 2024-09-13T15:08:10.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.121+0000 7f8671400700 1 Processor -- start 2024-09-13T15:08:10.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.121+0000 7f8671400700 1 -- start start 2024-09-13T15:08:10.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f866c06aaa0 0x7f866c14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 0x7f866c150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c1610b0 0x7f866c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c14de00 con 0x7f866c0b2670 2024-09-13T15:08:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c153ec0 con 0x7f866c06aaa0 2024-09-13T15:08:10.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c150fe0 con 0x7f866c1610b0 2024-09-13T15:08:10.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 0x7f866c150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 0x7f866c150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58308/0 (socket says 172.21.15.50:58308) 2024-09-13T15:08:10.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 -- 172.21.15.50:0/2942319555 learned_addr learned my addr 172.21.15.50:0/2942319555 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:10.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f866be00700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f866c06aaa0 0x7f866c14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8670a00700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c1610b0 0x7f866c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 -- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c1610b0 msgr2=0x7f866c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c1610b0 0x7f866c151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 -- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f866c06aaa0 msgr2=0x7f866c14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f866c06aaa0 0x7f866c14d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 -- 172.21.15.50:0/2942319555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009570 con 0x7f866c0b2670 2024-09-13T15:08:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8663400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 0x7f866c150aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f865400c770 tx=0x7f865400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011800 con 0x7f866c0b2670 2024-09-13T15:08:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c14e510 con 0x7f866c0b2670 2024-09-13T15:08:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8654011960 con 0x7f866c0b2670 2024-09-13T15:08:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011d10 con 0x7f866c0b2670 2024-09-13T15:08:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.125+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c14ead0 con 0x7f866c0b2670 2024-09-13T15:08:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.129+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c161490 con 0x7f866c0b2670 2024-09-13T15:08:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.129+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8654018360 con 0x7f866c0b2670 2024-09-13T15:08:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.129+0000 7f8668c00700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8648066730 0x7f8648068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.129+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86540843e0 con 0x7f866c0b2670 2024-09-13T15:08:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.129+0000 7f866be00700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8648066730 0x7f8648068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.133+0000 7f866be00700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8648066730 0x7f8648068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.137+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8654051470 con 0x7f866c0b2670 2024-09-13T15:08:10.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.333+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f866c0cb4a0 con 0x7f866c0b2670 2024-09-13T15:08:10.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.333+0000 7f8668c00700 1 -- 172.21.15.50:0/2942319555 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f866c0cb4a0 con 0x7f866c0b2670 2024-09-13T15:08:10.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:10.338 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8648066730 msgr2=0x7f8648068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8648066730 0x7f8648068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c008030 comp rx=0 tx=0).stop 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 msgr2=0x7f866c150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 0x7f866c150aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f865400c770 tx=0x7f865400ca80 comp rx=0 tx=0).stop 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 shutdown_connections 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8648066730 0x7f8648068bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f866c1610b0 0x7f866c151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866c0b2670 0x7f866c150aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 --2- 172.21.15.50:0/2942319555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f866c06aaa0 0x7f866c14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 >> 172.21.15.50:0/2942319555 conn(0x7f866c0b0c40 msgr2=0x7f866c15efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 shutdown_connections 2024-09-13T15:08:10.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.337+0000 7f8671400700 1 -- 172.21.15.50:0/2942319555 wait complete. 2024-09-13T15:08:10.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:10.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89cc200700 1 Processor -- start 2024-09-13T15:08:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89cc200700 1 -- start start 2024-09-13T15:08:10.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89cc200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f89c4160fc0 0x7f89c406be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89cc200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c406d000 con 0x7f89c40b3990 2024-09-13T15:08:10.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89cc200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c406c3f0 con 0x7f89c40cf280 2024-09-13T15:08:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89cc200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c406c6d0 con 0x7f89c4160fc0 2024-09-13T15:08:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.541+0000 7f89c8e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89c40b3990 0x7f89c40ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57518/0 (socket says 172.21.15.50:57518) 2024-09-13T15:08:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c8e00700 1 -- 172.21.15.50:0/1719517149 learned_addr learned my addr 172.21.15.50:0/1719517149 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c9800700 1 --2- 172.21.15.50:0/1719517149 >> v2:172.21.15.181:3300/0 conn(0x7f89c4160fc0 0x7f89c406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927906922 0 0) 0x7f89c406d000 con 0x7f89c40b3990 2024-09-13T15:08:10.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ac0035d0 con 0x7f89c40b3990 2024-09-13T15:08:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309919283 0 0) 0x7f89c406c3f0 con 0x7f89c40cf280 2024-09-13T15:08:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c406d000 con 0x7f89c40cf280 2024-09-13T15:08:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c9800700 1 -- 172.21.15.50:0/1719517149 >> v1:172.21.15.181:6789/0 conn(0x7f89c40cf280 legacy=0x7f89c41618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c9800700 1 -- 172.21.15.50:0/1719517149 >> v1:172.21.15.50:6789/0 conn(0x7f89c40b3990 legacy=0x7f89c40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c9800700 1 -- 172.21.15.50:0/1719517149 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c406c9b0 con 0x7f89c4160fc0 2024-09-13T15:08:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c9800700 1 --2- 172.21.15.50:0/1719517149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c4160fc0 0x7f89c406be10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009850 tx=0x7f89b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db6d034836347e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8011830 con 0x7f89c4160fc0 2024-09-13T15:08:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b8011990 con 0x7f89c4160fc0 2024-09-13T15:08:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.545+0000 7f89c3e00700 1 -- 172.21.15.50:0/1719517149 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8011d40 con 0x7f89c4160fc0 2024-09-13T15:08:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 -- 172.21.15.50:0/1719517149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c4160fc0 msgr2=0x7f89c406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 --2- 172.21.15.50:0/1719517149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c4160fc0 0x7f89c406be10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009850 tx=0x7f89b8009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 -- 172.21.15.50:0/1719517149 shutdown_connections 2024-09-13T15:08:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 --2- 172.21.15.50:0/1719517149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c4160fc0 0x7f89c406be10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 -- 172.21.15.50:0/1719517149 >> 172.21.15.50:0/1719517149 conn(0x7f89c406a570 msgr2=0x7f89c406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 -- 172.21.15.50:0/1719517149 shutdown_connections 2024-09-13T15:08:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 -- 172.21.15.50:0/1719517149 wait complete. 2024-09-13T15:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 Processor -- start 2024-09-13T15:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.549+0000 7f89cc200700 1 -- start start 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c40b3990 0x7f89c415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 0x7f89c41497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c4160fc0 0x7f89c4149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40a8e70 con 0x7f89c40cf280 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40ce270 con 0x7f89c40b3990 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40cd660 con 0x7f89c4160fc0 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 0x7f89c41497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 0x7f89c41497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58324/0 (socket says 172.21.15.50:58324) 2024-09-13T15:08:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 -- 172.21.15.50:0/1790951409 learned_addr learned my addr 172.21.15.50:0/1790951409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c9800700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c40b3990 0x7f89c415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89ca200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c4160fc0 0x7f89c4149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 -- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c4160fc0 msgr2=0x7f89c4149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c4160fc0 0x7f89c4149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 -- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c40b3990 msgr2=0x7f89c415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c40b3990 0x7f89c415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 -- 172.21.15.50:0/1790951409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80094b0 con 0x7f89c40cf280 2024-09-13T15:08:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c8e00700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 0x7f89c41497b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89b000c560 tx=0x7f89b000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0005d90 con 0x7f89c40cf280 2024-09-13T15:08:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b00070d0 con 0x7f89c40cf280 2024-09-13T15:08:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c40b3f50 con 0x7f89c40cf280 2024-09-13T15:08:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0007440 con 0x7f89c40cf280 2024-09-13T15:08:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.553+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c40cdc20 con 0x7f89c40cf280 2024-09-13T15:08:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.557+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c40ce3b0 con 0x7f89c40cf280 2024-09-13T15:08:10.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.557+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89b00075a0 con 0x7f89c40cf280 2024-09-13T15:08:10.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.561+0000 7f89c1600700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89a4066760 0x7f89a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.561+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89b0083830 con 0x7f89c40cf280 2024-09-13T15:08:10.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.561+0000 7f89c9800700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89a4066760 0x7f89a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.561+0000 7f89c9800700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89a4066760 0x7f89a4068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f89b80090b0 tx=0x7f89b801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.565+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89c40ce3b0 con 0x7f89c40cf280 2024-09-13T15:08:10.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.749+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89c40ce3b0 con 0x7f89c40cf280 2024-09-13T15:08:10.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89c1600700 1 -- 172.21.15.50:0/1790951409 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89c40ce3b0 con 0x7f89c40cf280 2024-09-13T15:08:10.755 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89a4066760 msgr2=0x7f89a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89a4066760 0x7f89a4068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f89b80090b0 tx=0x7f89b801c040 comp rx=0 tx=0).stop 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 msgr2=0x7f89c41497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 0x7f89c41497b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89b000c560 tx=0x7f89b000c870 comp rx=0 tx=0).stop 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 shutdown_connections 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89a4066760 0x7f89a4068c20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c4160fc0 0x7f89c4149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c40cf280 0x7f89c41497b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 --2- 172.21.15.50:0/1790951409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c40b3990 0x7f89c415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 >> 172.21.15.50:0/1790951409 conn(0x7f89c406a570 msgr2=0x7f89c40b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.753+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 shutdown_connections 2024-09-13T15:08:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.757+0000 7f89cc200700 1 -- 172.21.15.50:0/1790951409 wait complete. 2024-09-13T15:08:10.779 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.965+0000 7fd702c00700 1 Processor -- start 2024-09-13T15:08:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.965+0000 7fd702c00700 1 -- start start 2024-09-13T15:08:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6fc15ca20 0x7fd6fc15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06cd80 0x7fd6fc0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc160680 con 0x7fd6fc06ada0 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc15d670 con 0x7fd6fc15ca20 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc15d950 con 0x7fd6fc06cd80 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6fc06ada0 0x7fd6fc160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57526/0 (socket says 172.21.15.50:57526) 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd702200700 1 -- 172.21.15.50:0/1035007453 learned_addr learned my addr 172.21.15.50:0/1035007453 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd701800700 1 --2- 172.21.15.50:0/1035007453 >> v2:172.21.15.50:3300/0 conn(0x7fd6fc15ca20 0x7fd6fc15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd700e00700 1 --2- 172.21.15.50:0/1035007453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06cd80 0x7fd6fc0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd701800700 1 -- 172.21.15.50:0/1035007453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06cd80 msgr2=0x7fd6fc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd6fbe00700 1 -- 172.21.15.50:0/1035007453 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633686596 0 0) 0x7fd6fc160680 con 0x7fd6fc06ada0 2024-09-13T15:08:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd701800700 1 --2- 172.21.15.50:0/1035007453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06cd80 0x7fd6fc0b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd701800700 1 -- 172.21.15.50:0/1035007453 >> v1:172.21.15.50:6789/0 conn(0x7fd6fc06ada0 legacy=0x7fd6fc160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd701800700 1 -- 172.21.15.50:0/1035007453 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc15dc30 con 0x7fd6fc15ca20 2024-09-13T15:08:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd701800700 1 --2- 172.21.15.50:0/1035007453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc15ce00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009850 tx=0x7fd6f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6e5c180509b776 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.969+0000 7fd6fbe00700 1 -- 172.21.15.50:0/1035007453 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011830 con 0x7fd6fc15ca20 2024-09-13T15:08:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd6fbe00700 1 -- 172.21.15.50:0/1035007453 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0011990 con 0x7fd6fc15ca20 2024-09-13T15:08:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd6fbe00700 1 -- 172.21.15.50:0/1035007453 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011d40 con 0x7fd6fc15ca20 2024-09-13T15:08:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 -- 172.21.15.50:0/1035007453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc15ca20 msgr2=0x7fd6fc15ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 --2- 172.21.15.50:0/1035007453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc15ce00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009850 tx=0x7fd6f0009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 -- 172.21.15.50:0/1035007453 shutdown_connections 2024-09-13T15:08:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 --2- 172.21.15.50:0/1035007453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06cd80 0x7fd6fc0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 --2- 172.21.15.50:0/1035007453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc15ce00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 -- 172.21.15.50:0/1035007453 >> 172.21.15.50:0/1035007453 conn(0x7fd6fc071d20 msgr2=0x7fd6fc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 -- 172.21.15.50:0/1035007453 shutdown_connections 2024-09-13T15:08:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 -- 172.21.15.50:0/1035007453 wait complete. 2024-09-13T15:08:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 Processor -- start 2024-09-13T15:08:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.973+0000 7fd702c00700 1 -- start start 2024-09-13T15:08:10.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06ada0 0x7fd6fc1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 0x7fd6fc1f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc1f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc152b20 con 0x7fd6fc06cd80 2024-09-13T15:08:10.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0ce7e0 con 0x7fd6fc15ca20 2024-09-13T15:08:10.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0ceac0 con 0x7fd6fc06ada0 2024-09-13T15:08:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 0x7fd6fc1f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 0x7fd6fc1f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58346/0 (socket says 172.21.15.50:58346) 2024-09-13T15:08:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 -- 172.21.15.50:0/2668721724 learned_addr learned my addr 172.21.15.50:0/2668721724 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd701800700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06ada0 0x7fd6fc1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702200700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc1f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 -- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06ada0 msgr2=0x7fd6fc1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06ada0 0x7fd6fc1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 -- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6fc15ca20 msgr2=0x7fd6fc1f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc1f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 -- 172.21.15.50:0/2668721724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00094b0 con 0x7fd6fc06cd80 2024-09-13T15:08:10.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd700e00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 0x7fd6fc1f37f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800e9d0 tx=0x7fd6e800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8009720 con 0x7fd6fc06cd80 2024-09-13T15:08:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800c850 con 0x7fd6fc06cd80 2024-09-13T15:08:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0ceda0 con 0x7fd6fc06cd80 2024-09-13T15:08:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800cbc0 con 0x7fd6fc06cd80 2024-09-13T15:08:10.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.977+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc0cf360 con 0x7fd6fc06cd80 2024-09-13T15:08:10.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.981+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc06d1c0 con 0x7fd6fc06cd80 2024-09-13T15:08:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.981+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6e800cd20 con 0x7fd6fc06cd80 2024-09-13T15:08:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.985+0000 7fd6f9600700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.985+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6e80845b0 con 0x7fd6fc06cd80 2024-09-13T15:08:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.985+0000 7fd701800700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.985+0000 7fd701800700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00090b0 tx=0x7fd6f001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:10.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:10.989+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6e8051590 con 0x7fd6fc06cd80 2024-09-13T15:08:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.169+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6fc06ab80 con 0x7fd6fc06cd80 2024-09-13T15:08:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.169+0000 7fd6f9600700 1 -- 172.21.15.50:0/2668721724 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6e8054bb0 con 0x7fd6fc06cd80 2024-09-13T15:08:11.173 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 msgr2=0x7fd6dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00090b0 tx=0x7fd6f001c040 comp rx=0 tx=0).stop 2024-09-13T15:08:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 msgr2=0x7fd6fc1f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 0x7fd6fc1f37f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800e9d0 tx=0x7fd6e800ece0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 shutdown_connections 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6fc15ca20 0x7fd6fc1f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6fc06cd80 0x7fd6fc1f37f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 --2- 172.21.15.50:0/2668721724 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6fc06ada0 0x7fd6fc1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 >> 172.21.15.50:0/2668721724 conn(0x7fd6fc071d20 msgr2=0x7fd6fc15e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 shutdown_connections 2024-09-13T15:08:11.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.173+0000 7fd702c00700 1 -- 172.21.15.50:0/2668721724 wait complete. 2024-09-13T15:08:11.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.373+0000 7f66e6e00700 1 Processor -- start 2024-09-13T15:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.373+0000 7f66e6e00700 1 -- start start 2024-09-13T15:08:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f66e006cd80 0x7f66e00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e006ada0 0x7f66e006b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e0160680 con 0x7f66e015ca20 2024-09-13T15:08:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e006b750 con 0x7f66e006cd80 2024-09-13T15:08:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e015d670 con 0x7f66e006ada0 2024-09-13T15:08:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e5a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f66e015ca20 0x7f66e015ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57536/0 (socket says 172.21.15.50:57536) 2024-09-13T15:08:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e5a00700 1 -- 172.21.15.50:0/1202726046 learned_addr learned my addr 172.21.15.50:0/1202726046 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6400700 1 --2- 172.21.15.50:0/1202726046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e006ada0 0x7f66e006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e5000700 1 --2- 172.21.15.50:0/1202726046 >> v2:172.21.15.181:3300/0 conn(0x7f66e006cd80 0x7f66e00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66dfe00700 1 -- 172.21.15.50:0/1202726046 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996009497 0 0) 0x7f66e0160680 con 0x7f66e015ca20 2024-09-13T15:08:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66dfe00700 1 -- 172.21.15.50:0/1202726046 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c80035d0 con 0x7f66e015ca20 2024-09-13T15:08:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6400700 1 -- 172.21.15.50:0/1202726046 >> v2:172.21.15.181:3300/0 conn(0x7f66e006cd80 msgr2=0x7f66e00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6400700 1 --2- 172.21.15.50:0/1202726046 >> v2:172.21.15.181:3300/0 conn(0x7f66e006cd80 0x7f66e00b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6400700 1 -- 172.21.15.50:0/1202726046 >> v1:172.21.15.50:6789/0 conn(0x7f66e015ca20 legacy=0x7f66e015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6400700 1 -- 172.21.15.50:0/1202726046 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e015d950 con 0x7f66e006ada0 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.377+0000 7f66e6400700 1 --2- 172.21.15.50:0/1202726046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e006ada0 0x7f66e006b210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009d90 tx=0x7f66d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0152dd8bc98d27b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66dfe00700 1 -- 172.21.15.50:0/1202726046 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800e070 con 0x7f66e006ada0 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66dfe00700 1 -- 172.21.15.50:0/1202726046 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800bb20 con 0x7f66e006ada0 2024-09-13T15:08:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66dfe00700 1 -- 172.21.15.50:0/1202726046 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8012430 con 0x7f66e006ada0 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 -- 172.21.15.50:0/1202726046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e006ada0 msgr2=0x7f66e006b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 --2- 172.21.15.50:0/1202726046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e006ada0 0x7f66e006b210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009d90 tx=0x7f66d800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 -- 172.21.15.50:0/1202726046 shutdown_connections 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 --2- 172.21.15.50:0/1202726046 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e006ada0 0x7f66e006b210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 --2- 172.21.15.50:0/1202726046 >> v2:172.21.15.181:3300/0 conn(0x7f66e006cd80 0x7f66e00b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 -- 172.21.15.50:0/1202726046 >> 172.21.15.50:0/1202726046 conn(0x7f66e0071d20 msgr2=0x7f66e0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 -- 172.21.15.50:0/1202726046 shutdown_connections 2024-09-13T15:08:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.381+0000 7f66e6e00700 1 -- 172.21.15.50:0/1202726046 wait complete. 2024-09-13T15:08:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 Processor -- start 2024-09-13T15:08:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 -- start start 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006ada0 0x7f66e01525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e006cd80 0x7f66e0153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e015ca20 0x7f66e00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00cb2d0 con 0x7f66e006ada0 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00cb5b0 con 0x7f66e006cd80 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00cb890 con 0x7f66e015ca20 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006ada0 0x7f66e01525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e6400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e015ca20 0x7f66e00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006ada0 0x7f66e01525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58356/0 (socket says 172.21.15.50:58356) 2024-09-13T15:08:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e5a00700 1 -- 172.21.15.50:0/2027514772 learned_addr learned my addr 172.21.15.50:0/2027514772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.385+0000 7f66e5000700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e006cd80 0x7f66e0153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6400700 1 -- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e006cd80 msgr2=0x7f66e0153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6400700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e006cd80 0x7f66e0153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6400700 1 -- 172.21.15.50:0/2027514772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006ada0 msgr2=0x7f66e01525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6400700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006ada0 0x7f66e01525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6400700 1 -- 172.21.15.50:0/2027514772 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8009a70 con 0x7f66e015ca20 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6400700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e015ca20 0x7f66e00cf550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66d8016000 tx=0x7f66d8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8012430 con 0x7f66e015ca20 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d8020070 con 0x7f66e015ca20 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d80098f0 con 0x7f66e015ca20 2024-09-13T15:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e00cbb70 con 0x7f66e015ca20 2024-09-13T15:08:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e0152b00 con 0x7f66e015ca20 2024-09-13T15:08:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.389+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e006d1c0 con 0x7f66e015ca20 2024-09-13T15:08:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.393+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66d8004040 con 0x7f66e015ca20 2024-09-13T15:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.393+0000 7f66dd600700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66c0066760 0x7f66c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.393+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66d8022070 con 0x7f66e015ca20 2024-09-13T15:08:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.393+0000 7f66e5a00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66c0066760 0x7f66c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.397+0000 7f66e5a00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66c0066760 0x7f66c0068c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66e015faa0 tx=0x7f66d4006b50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.401+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66d8053200 con 0x7f66e015ca20 2024-09-13T15:08:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.585+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66e00cb6f0 con 0x7f66e015ca20 2024-09-13T15:08:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66dd600700 1 -- 172.21.15.50:0/2027514772 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66e00cb6f0 con 0x7f66e015ca20 2024-09-13T15:08:11.591 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66c0066760 msgr2=0x7f66c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66c0066760 0x7f66c0068c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66e015faa0 tx=0x7f66d4006b50 comp rx=0 tx=0).stop 2024-09-13T15:08:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e015ca20 msgr2=0x7f66e00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e015ca20 0x7f66e00cf550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66d8016000 tx=0x7f66d8004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 shutdown_connections 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66c0066760 0x7f66c0068c20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66e015ca20 0x7f66e00cf550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e006cd80 0x7f66e0153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 --2- 172.21.15.50:0/2027514772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e006ada0 0x7f66e01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 >> 172.21.15.50:0/2027514772 conn(0x7f66e0071d20 msgr2=0x7f66e015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 shutdown_connections 2024-09-13T15:08:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.589+0000 7f66e6e00700 1 -- 172.21.15.50:0/2027514772 wait complete. 2024-09-13T15:08:11.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.793+0000 7f36d5200700 1 Processor -- start 2024-09-13T15:08:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.793+0000 7f36d5200700 1 -- start start 2024-09-13T15:08:11.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36d5200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f36d0146490 0x7f36d00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36d5200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00cff10 con 0x7f36d00b2700 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36d5200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d015e130 con 0x7f36d015dce0 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36d5200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d00cf340 con 0x7f36d0146490 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36c6a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36d00b2700 0x7f36d015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57538/0 (socket says 172.21.15.50:57538) 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36c6a00700 1 -- 172.21.15.50:0/281804359 learned_addr learned my addr 172.21.15.50:0/281804359 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cf400700 1 --2- 172.21.15.50:0/281804359 >> v2:172.21.15.181:3300/0 conn(0x7f36d0146490 0x7f36d00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cea00700 1 -- 172.21.15.50:0/281804359 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134735525 0 0) 0x7f36d00cff10 con 0x7f36d00b2700 2024-09-13T15:08:11.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cea00700 1 -- 172.21.15.50:0/281804359 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b40035d0 con 0x7f36d00b2700 2024-09-13T15:08:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cf400700 1 -- 172.21.15.50:0/281804359 >> v1:172.21.15.181:6789/0 conn(0x7f36d015dce0 legacy=0x7f36d015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cea00700 1 -- 172.21.15.50:0/281804359 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160665753 0 0) 0x7f36d015e130 con 0x7f36d015dce0 2024-09-13T15:08:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cf400700 1 -- 172.21.15.50:0/281804359 >> v1:172.21.15.50:6789/0 conn(0x7f36d00b2700 legacy=0x7f36d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cf400700 1 -- 172.21.15.50:0/281804359 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00cf5e0 con 0x7f36d0146490 2024-09-13T15:08:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.797+0000 7f36cf400700 1 --2- 172.21.15.50:0/281804359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d00d03a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009850 tx=0x7f36c0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=234a2c792836815 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36cea00700 1 -- 172.21.15.50:0/281804359 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0011830 con 0x7f36d0146490 2024-09-13T15:08:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36cea00700 1 -- 172.21.15.50:0/281804359 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c0011990 con 0x7f36d0146490 2024-09-13T15:08:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36cea00700 1 -- 172.21.15.50:0/281804359 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0011d00 con 0x7f36d0146490 2024-09-13T15:08:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 -- 172.21.15.50:0/281804359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 msgr2=0x7f36d00d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 --2- 172.21.15.50:0/281804359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d00d03a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009850 tx=0x7f36c0009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:11.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 -- 172.21.15.50:0/281804359 shutdown_connections 2024-09-13T15:08:11.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 --2- 172.21.15.50:0/281804359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d00d03a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 -- 172.21.15.50:0/281804359 >> 172.21.15.50:0/281804359 conn(0x7f36d0071d90 msgr2=0x7f36d0072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:11.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 -- 172.21.15.50:0/281804359 shutdown_connections 2024-09-13T15:08:11.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.801+0000 7f36d5200700 1 -- 172.21.15.50:0/281804359 wait complete. 2024-09-13T15:08:11.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 Processor -- start 2024-09-13T15:08:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 -- start start 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36d00b2700 0x7f36d013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d013e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 0x7f36d015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d013fa30 con 0x7f36d015dce0 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d013eef0 con 0x7f36d0146490 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36d5200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d013f190 con 0x7f36d00b2700 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 0x7f36d015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 0x7f36d015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58366/0 (socket says 172.21.15.50:58366) 2024-09-13T15:08:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 -- 172.21.15.50:0/4127692484 learned_addr learned my addr 172.21.15.50:0/4127692484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cf400700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36d00b2700 0x7f36d013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36c6a00700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d013e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 -- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36d00b2700 msgr2=0x7f36d013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36d00b2700 0x7f36d013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 -- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 msgr2=0x7f36d013e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d013e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.805+0000 7f36cfe00700 1 -- 172.21.15.50:0/4127692484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c00094b0 con 0x7f36d015dce0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36cfe00700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 0x7f36d015bb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36c800cb60 tx=0x7f36c800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8003e50 con 0x7f36d015dce0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8005070 con 0x7f36d015dce0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d013f470 con 0x7f36d015dce0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8005420 con 0x7f36d015dce0 2024-09-13T15:08:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d013b560 con 0x7f36d015dce0 2024-09-13T15:08:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.809+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d00b2ea0 con 0x7f36d015dce0 2024-09-13T15:08:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.813+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36c8005580 con 0x7f36d015dce0 2024-09-13T15:08:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.813+0000 7f36c7e00700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36ac066730 0x7f36ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.813+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36c8083ca0 con 0x7f36d015dce0 2024-09-13T15:08:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.813+0000 7f36cf400700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36ac066730 0x7f36ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.817+0000 7f36cf400700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36ac066730 0x7f36ac068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36c00090b0 tx=0x7f36c0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:11.817+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36c8050d90 con 0x7f36d015dce0 2024-09-13T15:08:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.001+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f36d0143f40 con 0x7f36d015dce0 2024-09-13T15:08:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.001+0000 7f36c7e00700 1 -- 172.21.15.50:0/4127692484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f36c8017070 con 0x7f36d015dce0 2024-09-13T15:08:12.005 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36ac066730 msgr2=0x7f36ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36ac066730 0x7f36ac068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36c00090b0 tx=0x7f36c0008030 comp rx=0 tx=0).stop 2024-09-13T15:08:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 msgr2=0x7f36d015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 0x7f36d015bb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36c800cb60 tx=0x7f36c800ce70 comp rx=0 tx=0).stop 2024-09-13T15:08:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 shutdown_connections 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36ac066730 0x7f36ac068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36d015dce0 0x7f36d015bb40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36d0146490 0x7f36d013e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 --2- 172.21.15.50:0/4127692484 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36d00b2700 0x7f36d013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 >> 172.21.15.50:0/4127692484 conn(0x7f36d0071d90 msgr2=0x7f36d006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 shutdown_connections 2024-09-13T15:08:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.005+0000 7f36d5200700 1 -- 172.21.15.50:0/4127692484 wait complete. 2024-09-13T15:08:12.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:12.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.205+0000 7f66fec00700 1 Processor -- start 2024-09-13T15:08:12.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fec00700 1 -- start start 2024-09-13T15:08:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fec00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f815b700 0x7f66f815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fec00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f66f806a5d0 0x7f66f806aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fec00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f80cdd90 con 0x7f66f806c460 2024-09-13T15:08:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fec00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f806afc0 con 0x7f66f806a5d0 2024-09-13T15:08:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fec00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f806ce10 con 0x7f66f815b700 2024-09-13T15:08:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66f7400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f66f806c460 0x7f66f806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57554/0 (socket says 172.21.15.50:57554) 2024-09-13T15:08:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66f7400700 1 -- 172.21.15.50:0/946992518 learned_addr learned my addr 172.21.15.50:0/946992518 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66fcc00700 1 --2- 172.21.15.50:0/946992518 >> v2:172.21.15.181:3300/0 conn(0x7f66f806a5d0 0x7f66f806aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.209+0000 7f66f7e00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f815b700 0x7f66f815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.213+0000 7f66fcc00700 1 -- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f815b700 msgr2=0x7f66f815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.213+0000 7f66fcc00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f815b700 0x7f66f815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.213+0000 7f66fcc00700 1 -- 172.21.15.50:0/946992518 >> v1:172.21.15.50:6789/0 conn(0x7f66f806c460 legacy=0x7f66f806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.213+0000 7f66fcc00700 1 -- 172.21.15.50:0/946992518 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f815c020 con 0x7f66f806a5d0 2024-09-13T15:08:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.213+0000 7f66f7e00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f815b700 0x7f66f815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.213+0000 7f66fcc00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806a5d0 0x7f66f806aa80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249887a82182d766 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.217+0000 7f66f6a00700 1 -- 172.21.15.50:0/946992518 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000e070 con 0x7f66f806a5d0 2024-09-13T15:08:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.217+0000 7f66f6a00700 1 -- 172.21.15.50:0/946992518 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000bb20 con 0x7f66f806a5d0 2024-09-13T15:08:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.217+0000 7f66f6a00700 1 -- 172.21.15.50:0/946992518 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0012430 con 0x7f66f806a5d0 2024-09-13T15:08:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.217+0000 7f66fec00700 1 -- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806a5d0 msgr2=0x7f66f806aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.217+0000 7f66fec00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806a5d0 0x7f66f806aa80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 -- 172.21.15.50:0/946992518 shutdown_connections 2024-09-13T15:08:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806a5d0 0x7f66f806aa80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 --2- 172.21.15.50:0/946992518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f815b700 0x7f66f815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 -- 172.21.15.50:0/946992518 >> 172.21.15.50:0/946992518 conn(0x7f66f80b08d0 msgr2=0x7f66f80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 -- 172.21.15.50:0/946992518 shutdown_connections 2024-09-13T15:08:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 -- 172.21.15.50:0/946992518 wait complete. 2024-09-13T15:08:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 Processor -- start 2024-09-13T15:08:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.221+0000 7f66fec00700 1 -- start start 2024-09-13T15:08:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fec00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f806a5d0 0x7f66f8153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fec00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806c460 0x7f66f81f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fec00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 0x7f66f8155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fec00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f81538a0 con 0x7f66f815b700 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fec00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8152c20 con 0x7f66f806c460 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fec00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8152f00 con 0x7f66f806a5d0 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 0x7f66f8155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 0x7f66f8155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58382/0 (socket says 172.21.15.50:58382) 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 -- 172.21.15.50:0/3153043970 learned_addr learned my addr 172.21.15.50:0/3153043970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66f7e00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f806a5d0 0x7f66f8153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66f7400700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806c460 0x7f66f81f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 -- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f806a5d0 msgr2=0x7f66f8153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f806a5d0 0x7f66f8153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 -- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806c460 msgr2=0x7f66f81f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806c460 0x7f66f81f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 -- 172.21.15.50:0/3153043970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e80094b0 con 0x7f66f815b700 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.225+0000 7f66fcc00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 0x7f66f8155540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66f0014040 tx=0x7f66f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0012430 con 0x7f66f815b700 2024-09-13T15:08:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0020070 con 0x7f66f815b700 2024-09-13T15:08:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0004040 con 0x7f66f815b700 2024-09-13T15:08:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0009a70 con 0x7f66f815b700 2024-09-13T15:08:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f81534c0 con 0x7f66f815b700 2024-09-13T15:08:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f81539e0 con 0x7f66f815b700 2024-09-13T15:08:12.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.229+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66f00041a0 con 0x7f66f815b700 2024-09-13T15:08:12.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.233+0000 7f66efe00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66d8066730 0x7f66d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.233+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66f0022070 con 0x7f66f815b700 2024-09-13T15:08:12.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.233+0000 7f66f7e00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66d8066730 0x7f66d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.233+0000 7f66f7e00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66d8066730 0x7f66d8068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009ce0 tx=0x7f66e8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.241+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66f81539e0 con 0x7f66f815b700 2024-09-13T15:08:12.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.473+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66f81539e0 con 0x7f66f815b700 2024-09-13T15:08:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66efe00700 1 -- 172.21.15.50:0/3153043970 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f66f81539e0 con 0x7f66f815b700 2024-09-13T15:08:12.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:12.478 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66d8066730 msgr2=0x7f66d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66d8066730 0x7f66d8068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009ce0 tx=0x7f66e8009240 comp rx=0 tx=0).stop 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 msgr2=0x7f66f8155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 0x7f66f8155540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66f0014040 tx=0x7f66f0004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 shutdown_connections 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f66d8066730 0x7f66d8068bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66f815b700 0x7f66f8155540 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f806c460 0x7f66f81f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 --2- 172.21.15.50:0/3153043970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f66f806a5d0 0x7f66f8153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 >> 172.21.15.50:0/3153043970 conn(0x7f66f80b08d0 msgr2=0x7f66f806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 shutdown_connections 2024-09-13T15:08:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.477+0000 7f66fec00700 1 -- 172.21.15.50:0/3153043970 wait complete. 2024-09-13T15:08:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:12.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.673+0000 7f7b1ca00700 1 Processor -- start 2024-09-13T15:08:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.673+0000 7f7b1ca00700 1 -- start start 2024-09-13T15:08:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b1ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b181597b0 0x7f7b180b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b1ca00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b180b3f80 0x7f7b18159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b1ca00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180cde20 con 0x7f7b1806a390 2024-09-13T15:08:12.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b1ca00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180b49e0 con 0x7f7b180b3f80 2024-09-13T15:08:12.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b1ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180b4420 con 0x7f7b181597b0 2024-09-13T15:08:12.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b16a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b180b3f80 0x7f7b18159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b16a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b180b3f80 0x7f7b18159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58384/0 (socket says 172.21.15.50:58384) 2024-09-13T15:08:12.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b16a00700 1 -- 172.21.15.50:0/3196058784 learned_addr learned my addr 172.21.15.50:0/3196058784 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:12.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b17400700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b181597b0 0x7f7b180b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.677+0000 7f7b16000700 1 -- 172.21.15.50:0/3196058784 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118918211 0 0) 0x7f7b180cde20 con 0x7f7b1806a390 2024-09-13T15:08:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16000700 1 -- 172.21.15.50:0/3196058784 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7afc0035d0 con 0x7f7b1806a390 2024-09-13T15:08:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16a00700 1 -- 172.21.15.50:0/3196058784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b181597b0 msgr2=0x7f7b180b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16a00700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b181597b0 0x7f7b180b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16a00700 1 -- 172.21.15.50:0/3196058784 >> v1:172.21.15.50:6789/0 conn(0x7f7b1806a390 legacy=0x7f7b1815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16a00700 1 -- 172.21.15.50:0/3196058784 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180b4700 con 0x7f7b180b3f80 2024-09-13T15:08:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b17400700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b181597b0 0x7f7b180b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:12.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16a00700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b180b3f80 0x7f7b18159b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400bbb0 tx=0x7f7b0400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36ec2fe0bcf1caa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:12.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16000700 1 -- 172.21.15.50:0/3196058784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400dd30 con 0x7f7b180b3f80 2024-09-13T15:08:12.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16000700 1 -- 172.21.15.50:0/3196058784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0400de90 con 0x7f7b180b3f80 2024-09-13T15:08:12.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b16000700 1 -- 172.21.15.50:0/3196058784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04010690 con 0x7f7b180b3f80 2024-09-13T15:08:12.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3196058784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b180b3f80 msgr2=0x7f7b18159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b180b3f80 0x7f7b18159b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400bbb0 tx=0x7f7b0400bec0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3196058784 shutdown_connections 2024-09-13T15:08:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b180b3f80 0x7f7b18159b90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3196058784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b181597b0 0x7f7b180b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3196058784 >> 172.21.15.50:0/3196058784 conn(0x7f7b1806c8e0 msgr2=0x7f7b1806ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3196058784 shutdown_connections 2024-09-13T15:08:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.681+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3196058784 wait complete. 2024-09-13T15:08:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.685+0000 7f7b1ca00700 1 Processor -- start 2024-09-13T15:08:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.685+0000 7f7b1ca00700 1 -- start start 2024-09-13T15:08:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 0x7f7b18140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b180b3f80 0x7f7b180ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b181597b0 0x7f7b181582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181483b0 con 0x7f7b1806a390 2024-09-13T15:08:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180ae440 con 0x7f7b181597b0 2024-09-13T15:08:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b180ae720 con 0x7f7b180b3f80 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 0x7f7b18140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 0x7f7b18140420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58392/0 (socket says 172.21.15.50:58392) 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 -- 172.21.15.50:0/3565062521 learned_addr learned my addr 172.21.15.50:0/3565062521 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b16a00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b180b3f80 0x7f7b180ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 -- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b180b3f80 msgr2=0x7f7b180ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b180b3f80 0x7f7b180ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 -- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b181597b0 msgr2=0x7f7b181582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b181597b0 0x7f7b181582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 -- 172.21.15.50:0/3565062521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b080094b0 con 0x7f7b1806a390 2024-09-13T15:08:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b17400700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 0x7f7b18140420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800ebe0 tx=0x7f7b08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800c8b0 con 0x7f7b1806a390 2024-09-13T15:08:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0800ca10 con 0x7f7b1806a390 2024-09-13T15:08:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0400b810 con 0x7f7b1806a390 2024-09-13T15:08:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800cda0 con 0x7f7b1806a390 2024-09-13T15:08:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1815a960 con 0x7f7b1806a390 2024-09-13T15:08:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.689+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b180b5540 con 0x7f7b1806a390 2024-09-13T15:08:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.693+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b08013470 con 0x7f7b1806a390 2024-09-13T15:08:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.693+0000 7f7b0f400700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7af8066760 0x7f7af8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.693+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b08084560 con 0x7f7b1806a390 2024-09-13T15:08:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.693+0000 7f7b16a00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7af8066760 0x7f7af8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:12.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.697+0000 7f7b16a00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7af8066760 0x7f7af8068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400bfd0 tx=0x7f7b04013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:12.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.701+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b080515e0 con 0x7f7b1806a390 2024-09-13T15:08:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.889+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b18066780 con 0x7f7b1806a390 2024-09-13T15:08:12.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.889+0000 7f7b0f400700 1 -- 172.21.15.50:0/3565062521 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f7b08054c00 con 0x7f7b1806a390 2024-09-13T15:08:12.894 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:12.894 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:12.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7af8066760 msgr2=0x7f7af8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7af8066760 0x7f7af8068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400bfd0 tx=0x7f7b04013000 comp rx=0 tx=0).stop 2024-09-13T15:08:12.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 msgr2=0x7f7b18140420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 0x7f7b18140420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800ebe0 tx=0x7f7b08009e30 comp rx=0 tx=0).stop 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 shutdown_connections 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7af8066760 0x7f7af8068c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b181597b0 0x7f7b181582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b180b3f80 0x7f7b180ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 --2- 172.21.15.50:0/3565062521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b1806a390 0x7f7b18140420 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 >> 172.21.15.50:0/3565062521 conn(0x7f7b1806c8e0 msgr2=0x7f7b1814be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 shutdown_connections 2024-09-13T15:08:12.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:12.893+0000 7f7b1ca00700 1 -- 172.21.15.50:0/3565062521 wait complete. 2024-09-13T15:08:12.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:12.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.097+0000 7fa927e00700 1 Processor -- start 2024-09-13T15:08:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa927e00700 1 -- start start 2024-09-13T15:08:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa927e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa92815db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa927e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280b1c20 con 0x7fa92806dfb0 2024-09-13T15:08:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa927e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280b2800 con 0x7fa928070a40 2024-09-13T15:08:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa927e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280b3c90 con 0x7fa928072000 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa926a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa92806dfb0 0x7fa9280718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33760/0 (socket says 172.21.15.50:33760) 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa926a00700 1 -- 172.21.15.50:0/4267553216 learned_addr learned my addr 172.21.15.50:0/4267553216 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.101+0000 7fa926000700 1 --2- 172.21.15.50:0/4267553216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa92815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563637881 0 0) 0x7fa9280b1c20 con 0x7fa92806dfb0 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa90c0035d0 con 0x7fa92806dfb0 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524104860 0 0) 0x7fa920001490 con 0x7fa928070a40 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9280b1c20 con 0x7fa928070a40 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa926000700 1 -- 172.21.15.50:0/4267553216 >> v1:172.21.15.181:6789/0 conn(0x7fa928070a40 legacy=0x7fa928159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa926000700 1 -- 172.21.15.50:0/4267553216 >> v1:172.21.15.50:6789/0 conn(0x7fa92806dfb0 legacy=0x7fa9280718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa926000700 1 -- 172.21.15.50:0/4267553216 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280b3f10 con 0x7fa928072000 2024-09-13T15:08:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa926000700 1 --2- 172.21.15.50:0/4267553216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa92815db40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa914009880 tx=0x7fa914009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3839a42dbfadbc45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914011830 con 0x7fa928072000 2024-09-13T15:08:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914011990 con 0x7fa928072000 2024-09-13T15:08:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa925600700 1 -- 172.21.15.50:0/4267553216 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914011d00 con 0x7fa928072000 2024-09-13T15:08:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 -- 172.21.15.50:0/4267553216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 msgr2=0x7fa92815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 --2- 172.21.15.50:0/4267553216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa92815db40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa914009880 tx=0x7fa914009b90 comp rx=0 tx=0).stop 2024-09-13T15:08:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 -- 172.21.15.50:0/4267553216 shutdown_connections 2024-09-13T15:08:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 --2- 172.21.15.50:0/4267553216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa92815db40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 -- 172.21.15.50:0/4267553216 >> 172.21.15.50:0/4267553216 conn(0x7fa9280b4770 msgr2=0x7fa9280b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:13.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 -- 172.21.15.50:0/4267553216 shutdown_connections 2024-09-13T15:08:13.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.105+0000 7fa927e00700 1 -- 172.21.15.50:0/4267553216 wait complete. 2024-09-13T15:08:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.109+0000 7fa927e00700 1 Processor -- start 2024-09-13T15:08:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.109+0000 7fa927e00700 1 -- start start 2024-09-13T15:08:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 0x7fa92809c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa928070a40 0x7fa928158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa9281e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa928156dc0 con 0x7fa92806dfb0 2024-09-13T15:08:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9281570a0 con 0x7fa928070a40 2024-09-13T15:08:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa928157380 con 0x7fa928072000 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 0x7fa92809c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 0x7fa92809c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37520/0 (socket says 172.21.15.50:37520) 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 -- 172.21.15.50:0/1011234969 learned_addr learned my addr 172.21.15.50:0/1011234969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926000700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa928070a40 0x7fa928158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927400700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa9281e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 -- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 msgr2=0x7fa9281e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa9281e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 -- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa928070a40 msgr2=0x7fa928158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa928070a40 0x7fa928158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 -- 172.21.15.50:0/1011234969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140094b0 con 0x7fa92806dfb0 2024-09-13T15:08:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa926a00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 0x7fa92809c680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa91800c560 tx=0x7fa91800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918005d90 con 0x7fa92806dfb0 2024-09-13T15:08:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9180070d0 con 0x7fa92806dfb0 2024-09-13T15:08:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa928157660 con 0x7fa92806dfb0 2024-09-13T15:08:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918007440 con 0x7fa92806dfb0 2024-09-13T15:08:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.113+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92809cbc0 con 0x7fa92806dfb0 2024-09-13T15:08:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.117+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa928157b80 con 0x7fa92806dfb0 2024-09-13T15:08:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.117+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9180075a0 con 0x7fa92806dfb0 2024-09-13T15:08:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.121+0000 7fa91ea00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa908066730 0x7fa908068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.121+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa918083700 con 0x7fa92806dfb0 2024-09-13T15:08:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.121+0000 7fa926000700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa908066730 0x7fa908068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.125+0000 7fa926000700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa908066730 0x7fa908068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9280cf010 tx=0x7fa914010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.129+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa928157b80 con 0x7fa92806dfb0 2024-09-13T15:08:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.313+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa928157b80 con 0x7fa92806dfb0 2024-09-13T15:08:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa91ea00700 1 -- 172.21.15.50:0/1011234969 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa928157b80 con 0x7fa92806dfb0 2024-09-13T15:08:13.320 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa908066730 msgr2=0x7fa908068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa908066730 0x7fa908068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9280cf010 tx=0x7fa914010000 comp rx=0 tx=0).stop 2024-09-13T15:08:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 msgr2=0x7fa92809c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 0x7fa92809c680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa91800c560 tx=0x7fa91800c870 comp rx=0 tx=0).stop 2024-09-13T15:08:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 shutdown_connections 2024-09-13T15:08:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa908066730 0x7fa908068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa928072000 0x7fa9281e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa928070a40 0x7fa928158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 --2- 172.21.15.50:0/1011234969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92806dfb0 0x7fa92809c680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 >> 172.21.15.50:0/1011234969 conn(0x7fa9280b4770 msgr2=0x7fa928160610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 shutdown_connections 2024-09-13T15:08:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.317+0000 7fa927e00700 1 -- 172.21.15.50:0/1011234969 wait complete. 2024-09-13T15:08:13.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:13.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.517+0000 7fd3c2200700 1 Processor -- start 2024-09-13T15:08:13.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.517+0000 7fd3c2200700 1 -- start start 2024-09-13T15:08:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.517+0000 7fd3c2200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd3bc160fc0 0x7fd3bc06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3c2200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 0x7fd3bc1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3c2200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc06d000 con 0x7fd3bc0b3990 2024-09-13T15:08:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3c2200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc06c3f0 con 0x7fd3bc160fc0 2024-09-13T15:08:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3c2200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc06c6d0 con 0x7fd3bc0cf280 2024-09-13T15:08:13.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3baa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd3bc0b3990 0x7fd3bc0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33766/0 (socket says 172.21.15.50:33766) 2024-09-13T15:08:13.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3baa00700 1 -- 172.21.15.50:0/3583171006 learned_addr learned my addr 172.21.15.50:0/3583171006 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:13.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3bb400700 1 --2- 172.21.15.50:0/3583171006 >> v2:172.21.15.181:3300/0 conn(0x7fd3bc160fc0 0x7fd3bc06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 0x7fd3bc1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305317464 0 0) 0x7fd3bc06d000 con 0x7fd3bc0b3990 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a00035d0 con 0x7fd3bc0b3990 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986616853 0 0) 0x7fd3a00035d0 con 0x7fd3bc0b3990 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 msgr2=0x7fd3bc1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 0x7fd3bc1618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 >> v2:172.21.15.181:3300/0 conn(0x7fd3bc160fc0 msgr2=0x7fd3bc06be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 --2- 172.21.15.50:0/3583171006 >> v2:172.21.15.181:3300/0 conn(0x7fd3bc160fc0 0x7fd3bc06be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc06c9b0 con 0x7fd3bc0b3990 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fd3a8001670 con 0x7fd3bc0b3990 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 >> v1:172.21.15.50:6789/0 conn(0x7fd3bc0b3990 legacy=0x7fd3bc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3a0003a20 0x7fd3a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3a0004870 0x7fd3a0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 0x7fd3a0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc06c3f0 con 0x7fd3a0003a20 2024-09-13T15:08:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc06c6d0 con 0x7fd3a0004870 2024-09-13T15:08:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a000ba30 con 0x7fd3bc0cf280 2024-09-13T15:08:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3bb400700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3a0003a20 0x7fd3a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3baa00700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3a0004870 0x7fd3a0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.521+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 0x7fd3a0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bb400700 1 -- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 msgr2=0x7fd3a0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bb400700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0cf280 0x7fd3a0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bb400700 1 -- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3a0004870 msgr2=0x7fd3a0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bb400700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3a0004870 0x7fd3a0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bb400700 1 -- 172.21.15.50:0/3583171006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00035d0 con 0x7fd3a0003a20 2024-09-13T15:08:13.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bb400700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3a0003a20 0x7fd3a0003e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009b70 tx=0x7fd3a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f918d22034b7308b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00e6c0 con 0x7fd3a0003a20 2024-09-13T15:08:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00e820 con 0x7fd3a0003a20 2024-09-13T15:08:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3ba000700 1 -- 172.21.15.50:0/3583171006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00eb90 con 0x7fd3a0003a20 2024-09-13T15:08:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3c2200700 1 -- 172.21.15.50:0/3583171006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3a0003a20 msgr2=0x7fd3a0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3c2200700 1 --2- 172.21.15.50:0/3583171006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3a0003a20 0x7fd3a0003e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009b70 tx=0x7fd3a00058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3bbe00700 1 -- 172.21.15.50:0/3583171006 reap_dead start 2024-09-13T15:08:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3c2200700 1 -- 172.21.15.50:0/3583171006 shutdown_connections 2024-09-13T15:08:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3c2200700 1 -- 172.21.15.50:0/3583171006 >> 172.21.15.50:0/3583171006 conn(0x7fd3bc06a570 msgr2=0x7fd3bc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3c2200700 1 -- 172.21.15.50:0/3583171006 shutdown_connections 2024-09-13T15:08:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.525+0000 7fd3c2200700 1 -- 172.21.15.50:0/3583171006 wait complete. 2024-09-13T15:08:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.529+0000 7fd3c2200700 1 Processor -- start 2024-09-13T15:08:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.529+0000 7fd3c2200700 1 -- start start 2024-09-13T15:08:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.529+0000 7fd3c2200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3a0003a20 0x7fd3bc14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.529+0000 7fd3c2200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc1eadc0 0x7fd3bc1ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3c2200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 0x7fd3bc1ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3c2200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1eb780 con 0x7fd3bc1eb220 2024-09-13T15:08:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3c2200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1eba60 con 0x7fd3bc1eadc0 2024-09-13T15:08:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3c2200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0a8520 con 0x7fd3a0003a20 2024-09-13T15:08:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 0x7fd3bc1ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 0x7fd3bc1ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37548/0 (socket says 172.21.15.50:37548) 2024-09-13T15:08:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2961049638 learned_addr learned my addr 172.21.15.50:0/2961049638 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bb400700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3a0003a20 0x7fd3bc14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3baa00700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc1eadc0 0x7fd3bc1ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3a0003a20 msgr2=0x7fd3bc14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3a0003a20 0x7fd3bc14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc1eadc0 msgr2=0x7fd3bc1ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc1eadc0 0x7fd3bc1ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2961049638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0b3f50 con 0x7fd3bc1eb220 2024-09-13T15:08:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 0x7fd3bc1ed710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc070f90 tx=0x7fd3b4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400e040 con 0x7fd3bc1eb220 2024-09-13T15:08:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400f040 con 0x7fd3bc1eb220 2024-09-13T15:08:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc0a8800 con 0x7fd3bc1eb220 2024-09-13T15:08:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400fc40 con 0x7fd3bc1eb220 2024-09-13T15:08:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.533+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc15ccf0 con 0x7fd3bc1eb220 2024-09-13T15:08:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.537+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0a89f0 con 0x7fd3bc1eb220 2024-09-13T15:08:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.537+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3b4015430 con 0x7fd3bc1eb220 2024-09-13T15:08:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.541+0000 7fd3b3400700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c0667b0 0x7fd39c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.541+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3b4084be0 con 0x7fd3bc1eb220 2024-09-13T15:08:13.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.541+0000 7fd3bb400700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c0667b0 0x7fd39c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.541+0000 7fd3bb400700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c0667b0 0x7fd39c068c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0090b0 tx=0x7fd3ac01f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.545+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3b4051c40 con 0x7fd3bc1eb220 2024-09-13T15:08:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.729+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3bc06be10 con 0x7fd3bc1eb220 2024-09-13T15:08:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.733+0000 7fd3b3400700 1 -- 172.21.15.50:0/2961049638 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3b4055260 con 0x7fd3bc1eb220 2024-09-13T15:08:13.735 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c0667b0 msgr2=0x7fd39c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c0667b0 0x7fd39c068c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0090b0 tx=0x7fd3ac01f040 comp rx=0 tx=0).stop 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 msgr2=0x7fd3bc1ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 0x7fd3bc1ed710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc070f90 tx=0x7fd3b4011e20 comp rx=0 tx=0).stop 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 shutdown_connections 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c0667b0 0x7fd39c068c70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc1eb220 0x7fd3bc1ed710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc1eadc0 0x7fd3bc1ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 --2- 172.21.15.50:0/2961049638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3a0003a20 0x7fd3bc14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 >> 172.21.15.50:0/2961049638 conn(0x7fd3bc06a570 msgr2=0x7fd3bc0afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 shutdown_connections 2024-09-13T15:08:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.737+0000 7fd3c2200700 1 -- 172.21.15.50:0/2961049638 wait complete. 2024-09-13T15:08:13.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.941+0000 7f93c3000700 1 Processor -- start 2024-09-13T15:08:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.941+0000 7f93c3000700 1 -- start start 2024-09-13T15:08:13.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c3000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93bc15ca20 0x7f93bc15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c3000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f93bc06ada0 0x7f93bc06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c3000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc06b710 con 0x7f93bc06cd80 2024-09-13T15:08:13.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c3000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0b4a20 con 0x7f93bc15ca20 2024-09-13T15:08:13.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c3000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc160680 con 0x7f93bc06ada0 2024-09-13T15:08:13.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93bc15ca20 0x7f93bc15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93bc06cd80 0x7f93bc0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33768/0 (socket says 172.21.15.50:33768) 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93bc15ca20 0x7f93bc15ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37552/0 (socket says 172.21.15.50:37552) 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1200700 1 -- 172.21.15.50:0/1328498491 learned_addr learned my addr 172.21.15.50:0/1328498491 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c2600700 1 --2- 172.21.15.50:0/1328498491 >> v2:172.21.15.181:3300/0 conn(0x7f93bc06ada0 0x7f93bc06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 -- 172.21.15.50:0/1328498491 >> v2:172.21.15.181:3300/0 conn(0x7f93bc06ada0 msgr2=0x7f93bc06b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 --2- 172.21.15.50:0/1328498491 >> v2:172.21.15.181:3300/0 conn(0x7f93bc06ada0 0x7f93bc06b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 -- 172.21.15.50:0/1328498491 >> v1:172.21.15.50:6789/0 conn(0x7f93bc06cd80 legacy=0x7f93bc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 -- 172.21.15.50:0/1328498491 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc15d670 con 0x7f93bc15ca20 2024-09-13T15:08:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c2600700 1 --2- 172.21.15.50:0/1328498491 >> v2:172.21.15.181:3300/0 conn(0x7f93bc06ada0 0x7f93bc06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93c1c00700 1 --2- 172.21.15.50:0/1328498491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc15ce00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b3290 tx=0x7f93b0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9dd64c764a7b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93bbe00700 1 -- 172.21.15.50:0/1328498491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0011830 con 0x7f93bc15ca20 2024-09-13T15:08:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93bbe00700 1 -- 172.21.15.50:0/1328498491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b0011990 con 0x7f93bc15ca20 2024-09-13T15:08:13.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.945+0000 7f93bbe00700 1 -- 172.21.15.50:0/1328498491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0011d40 con 0x7f93bc15ca20 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 -- 172.21.15.50:0/1328498491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 msgr2=0x7f93bc15ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 --2- 172.21.15.50:0/1328498491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc15ce00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b3290 tx=0x7f93b0009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 -- 172.21.15.50:0/1328498491 shutdown_connections 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 --2- 172.21.15.50:0/1328498491 >> v2:172.21.15.181:3300/0 conn(0x7f93bc06ada0 0x7f93bc06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 --2- 172.21.15.50:0/1328498491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc15ce00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 -- 172.21.15.50:0/1328498491 >> 172.21.15.50:0/1328498491 conn(0x7f93bc071d20 msgr2=0x7f93bc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 -- 172.21.15.50:0/1328498491 shutdown_connections 2024-09-13T15:08:13.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 -- 172.21.15.50:0/1328498491 wait complete. 2024-09-13T15:08:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 Processor -- start 2024-09-13T15:08:13.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.949+0000 7f93c3000700 1 -- start start 2024-09-13T15:08:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93bc06ada0 0x7f93bc0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93bc06cd80 0x7f93bc153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc141280 con 0x7f93bc15ca20 2024-09-13T15:08:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc141560 con 0x7f93bc06ada0 2024-09-13T15:08:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc141840 con 0x7f93bc06cd80 2024-09-13T15:08:13.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37568/0 (socket says 172.21.15.50:37568) 2024-09-13T15:08:13.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 -- 172.21.15.50:0/3852668393 learned_addr learned my addr 172.21.15.50:0/3852668393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c1c00700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93bc06ada0 0x7f93bc0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c1200700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93bc06cd80 0x7f93bc153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 -- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93bc06cd80 msgr2=0x7f93bc153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93bc06cd80 0x7f93bc153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 -- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93bc06ada0 msgr2=0x7f93bc0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93bc06ada0 0x7f93bc0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 -- 172.21.15.50:0/3852668393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b00094b0 con 0x7f93bc15ca20 2024-09-13T15:08:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c2600700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc153a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009fa0 tx=0x7f93b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400de60 con 0x7f93bc15ca20 2024-09-13T15:08:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400f040 con 0x7f93bc15ca20 2024-09-13T15:08:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4003ca0 con 0x7f93bc15ca20 2024-09-13T15:08:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc141b20 con 0x7f93bc15ca20 2024-09-13T15:08:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.953+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc142320 con 0x7f93bc15ca20 2024-09-13T15:08:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.957+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc142040 con 0x7f93bc15ca20 2024-09-13T15:08:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.957+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93b4004030 con 0x7f93bc15ca20 2024-09-13T15:08:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.961+0000 7f93b9600700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f939c066730 0x7f939c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.961+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93b4084610 con 0x7f93bc15ca20 2024-09-13T15:08:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.961+0000 7f93c1c00700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f939c066730 0x7f939c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.961+0000 7f93c1c00700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f939c066730 0x7f939c068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f93b00090b0 tx=0x7f93b001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:13.969+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93bc142040 con 0x7f93bc15ca20 2024-09-13T15:08:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.145+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93bc142040 con 0x7f93bc15ca20 2024-09-13T15:08:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.149+0000 7f93b9600700 1 -- 172.21.15.50:0/3852668393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93bc142040 con 0x7f93bc15ca20 2024-09-13T15:08:14.151 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:14.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f939c066730 msgr2=0x7f939c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f939c066730 0x7f939c068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f93b00090b0 tx=0x7f93b001c040 comp rx=0 tx=0).stop 2024-09-13T15:08:14.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 msgr2=0x7f93bc153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc153a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009fa0 tx=0x7f93b400d3b0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 shutdown_connections 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f939c066730 0x7f939c068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93bc15ca20 0x7f93bc153a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93bc06cd80 0x7f93bc153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 --2- 172.21.15.50:0/3852668393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93bc06ada0 0x7f93bc0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 >> 172.21.15.50:0/3852668393 conn(0x7f93bc071d20 msgr2=0x7f93bc152670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 shutdown_connections 2024-09-13T15:08:14.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.153+0000 7f93c3000700 1 -- 172.21.15.50:0/3852668393 wait complete. 2024-09-13T15:08:14.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.353+0000 7f73ffe00700 1 Processor -- start 2024-09-13T15:08:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.353+0000 7f73ffe00700 1 -- start start 2024-09-13T15:08:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73ffe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f74000b20a0 0x7f7400164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73ffe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740015a020 con 0x7f7400159660 2024-09-13T15:08:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73ffe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740015a300 con 0x7f7400159a40 2024-09-13T15:08:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73ffe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740015a5e0 con 0x7f74000b20a0 2024-09-13T15:08:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73fea00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7400159660 0x7f74000b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33776/0 (socket says 172.21.15.50:33776) 2024-09-13T15:08:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73fea00700 1 -- 172.21.15.50:0/1833962943 learned_addr learned my addr 172.21.15.50:0/1833962943 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.357+0000 7f73ff400700 1 --2- 172.21.15.50:0/1833962943 >> v2:172.21.15.181:3300/0 conn(0x7f74000b20a0 0x7f7400164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232402312 0 0) 0x7f740015a020 con 0x7f7400159660 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e40035d0 con 0x7f7400159660 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568545909 0 0) 0x7f740015a300 con 0x7f7400159a40 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f740015a020 con 0x7f7400159a40 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ff400700 1 -- 172.21.15.50:0/1833962943 >> v1:172.21.15.181:6789/0 conn(0x7f7400159a40 legacy=0x7f74000b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ff400700 1 -- 172.21.15.50:0/1833962943 >> v1:172.21.15.50:6789/0 conn(0x7f7400159660 legacy=0x7f74000b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ff400700 1 -- 172.21.15.50:0/1833962943 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740015a8c0 con 0x7f74000b20a0 2024-09-13T15:08:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ff400700 1 --2- 172.21.15.50:0/1833962943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74000b20a0 0x7f7400164400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009d90 tx=0x7f73f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429e14e0a6623553 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f800e070 con 0x7f74000b20a0 2024-09-13T15:08:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f800bb20 con 0x7f74000b20a0 2024-09-13T15:08:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73fd600700 1 -- 172.21.15.50:0/1833962943 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f800be90 con 0x7f74000b20a0 2024-09-13T15:08:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 -- 172.21.15.50:0/1833962943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74000b20a0 msgr2=0x7f7400164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 --2- 172.21.15.50:0/1833962943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74000b20a0 0x7f7400164400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009d90 tx=0x7f73f800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 -- 172.21.15.50:0/1833962943 shutdown_connections 2024-09-13T15:08:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 --2- 172.21.15.50:0/1833962943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74000b20a0 0x7f7400164400 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 -- 172.21.15.50:0/1833962943 >> 172.21.15.50:0/1833962943 conn(0x7f740006cb90 msgr2=0x7f740006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:14.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 -- 172.21.15.50:0/1833962943 shutdown_connections 2024-09-13T15:08:14.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.361+0000 7f73ffe00700 1 -- 172.21.15.50:0/1833962943 wait complete. 2024-09-13T15:08:14.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 Processor -- start 2024-09-13T15:08:14.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 -- start start 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 0x7f74000cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7400159660 0x7f74000ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7400159a40 0x7f74001e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74000ce610 con 0x7f74000b20a0 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74001e3180 con 0x7f7400159a40 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ffe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74001e3460 con 0x7f7400159660 2024-09-13T15:08:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73fea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 0x7f74000cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73fea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 0x7f74000cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37584/0 (socket says 172.21.15.50:37584) 2024-09-13T15:08:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73fea00700 1 -- 172.21.15.50:0/4044169419 learned_addr learned my addr 172.21.15.50:0/4044169419 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73fe000700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7400159660 0x7f74000ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.365+0000 7f73ff400700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7400159a40 0x7f74001e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73fea00700 1 -- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7400159660 msgr2=0x7f74000ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73fea00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7400159660 0x7f74000ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73fea00700 1 -- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7400159a40 msgr2=0x7f74001e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73fea00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7400159a40 0x7f74001e3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73fea00700 1 -- 172.21.15.50:0/4044169419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009a70 con 0x7f74000b20a0 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73fea00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 0x7f74000cd130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c560 tx=0x7f73f000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0005d90 con 0x7f74000b20a0 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00070d0 con 0x7f74000b20a0 2024-09-13T15:08:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0007460 con 0x7f74000b20a0 2024-09-13T15:08:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74001e3740 con 0x7f74000b20a0 2024-09-13T15:08:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74001e4480 con 0x7f74000b20a0 2024-09-13T15:08:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.369+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74001e3c60 con 0x7f74000b20a0 2024-09-13T15:08:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.373+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f73f00075c0 con 0x7f74000b20a0 2024-09-13T15:08:14.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.373+0000 7f73f6a00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73e0066730 0x7f73e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.373+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73f00838d0 con 0x7f74000b20a0 2024-09-13T15:08:14.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.373+0000 7f73fe000700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73e0066730 0x7f73e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.377+0000 7f73fe000700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73e0066730 0x7f73e0068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0011e0 tx=0x7f73ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.381+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f73f0050940 con 0x7f74000b20a0 2024-09-13T15:08:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.561+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f74000b3c20 con 0x7f74000b20a0 2024-09-13T15:08:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.561+0000 7f73f6a00700 1 -- 172.21.15.50:0/4044169419 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f73f0053f60 con 0x7f74000b20a0 2024-09-13T15:08:14.566 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73e0066730 msgr2=0x7f73e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73e0066730 0x7f73e0068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0011e0 tx=0x7f73ec009040 comp rx=0 tx=0).stop 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 msgr2=0x7f74000cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 0x7f74000cd130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c560 tx=0x7f73f000c870 comp rx=0 tx=0).stop 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 shutdown_connections 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73e0066730 0x7f73e0068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7400159a40 0x7f74001e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7400159660 0x7f74000ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 --2- 172.21.15.50:0/4044169419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74000b20a0 0x7f74000cd130 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 >> 172.21.15.50:0/4044169419 conn(0x7f740006cb90 msgr2=0x7f7400071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 shutdown_connections 2024-09-13T15:08:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.565+0000 7f73ffe00700 1 -- 172.21.15.50:0/4044169419 wait complete. 2024-09-13T15:08:14.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.761+0000 7f5f58c00700 1 Processor -- start 2024-09-13T15:08:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f58c00700 1 -- start start 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f58c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f540b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f58c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5f540b3960 0x7f5f540b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f58c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5415e000 con 0x7f5f5415a830 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f58c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5415ac10 con 0x7f5f540b3960 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f58c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5415d1e0 con 0x7f5f540667a0 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f51e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f5415a830 0x7f5f54066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33792/0 (socket says 172.21.15.50:33792) 2024-09-13T15:08:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f51e00700 1 -- 172.21.15.50:0/3940977097 learned_addr learned my addr 172.21.15.50:0/3940977097 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f52800700 1 --2- 172.21.15.50:0/3940977097 >> v2:172.21.15.181:3300/0 conn(0x7f5f540b3960 0x7f5f540b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f51400700 1 --2- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f540b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f50a00700 1 -- 172.21.15.50:0/3940977097 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806587151 0 0) 0x7f5f5415e000 con 0x7f5f5415a830 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.765+0000 7f5f50a00700 1 -- 172.21.15.50:0/3940977097 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f380035d0 con 0x7f5f5415a830 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f52800700 1 -- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 msgr2=0x7f5f540b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f52800700 1 --2- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f540b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f52800700 1 -- 172.21.15.50:0/3940977097 >> v1:172.21.15.50:6789/0 conn(0x7f5f5415a830 legacy=0x7f5f54066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f52800700 1 -- 172.21.15.50:0/3940977097 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5415d3f0 con 0x7f5f540b3960 2024-09-13T15:08:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f52800700 1 --2- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f540b5840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009850 tx=0x7f5f4c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02ad766789ecb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f50a00700 1 -- 172.21.15.50:0/3940977097 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c011830 con 0x7f5f540b3960 2024-09-13T15:08:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f50a00700 1 -- 172.21.15.50:0/3940977097 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c011990 con 0x7f5f540b3960 2024-09-13T15:08:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f50a00700 1 -- 172.21.15.50:0/3940977097 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c011d40 con 0x7f5f540b3960 2024-09-13T15:08:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 -- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 msgr2=0x7f5f540b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f540b5840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009850 tx=0x7f5f4c009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 -- 172.21.15.50:0/3940977097 shutdown_connections 2024-09-13T15:08:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f540b5840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3940977097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f540b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 -- 172.21.15.50:0/3940977097 >> 172.21.15.50:0/3940977097 conn(0x7f5f5406e660 msgr2=0x7f5f5406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 -- 172.21.15.50:0/3940977097 shutdown_connections 2024-09-13T15:08:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.769+0000 7f5f58c00700 1 -- 172.21.15.50:0/3940977097 wait complete. 2024-09-13T15:08:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 Processor -- start 2024-09-13T15:08:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 -- start start 2024-09-13T15:08:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f5413c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f5413f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 0x7f5f5413f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54151420 con 0x7f5f5415a830 2024-09-13T15:08:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54151140 con 0x7f5f540b3960 2024-09-13T15:08:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f58c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54154de0 con 0x7f5f540667a0 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 0x7f5f5413f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 0x7f5f5413f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37600/0 (socket says 172.21.15.50:37600) 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 -- 172.21.15.50:0/3882332368 learned_addr learned my addr 172.21.15.50:0/3882332368 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f51400700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f5413f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f51e00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f5413c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 -- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 msgr2=0x7f5f5413c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f5413c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 -- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 msgr2=0x7f5f5413f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f5413f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 -- 172.21.15.50:0/3882332368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0094b0 con 0x7f5f5415a830 2024-09-13T15:08:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f51e00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f5413c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.773+0000 7f5f52800700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 0x7f5f5413f650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f54067e60 tx=0x7f5f4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c004380 con 0x7f5f5415a830 2024-09-13T15:08:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c01f070 con 0x7f5f5415a830 2024-09-13T15:08:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0036c0 con 0x7f5f5415a830 2024-09-13T15:08:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f541550c0 con 0x7f5f5415a830 2024-09-13T15:08:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54150cb0 con 0x7f5f5415a830 2024-09-13T15:08:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54154c40 con 0x7f5f5415a830 2024-09-13T15:08:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.777+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f4c021030 con 0x7f5f5415a830 2024-09-13T15:08:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.781+0000 7f5f4a000700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f34066730 0x7f5f34068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.781+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f4c085610 con 0x7f5f5415a830 2024-09-13T15:08:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.781+0000 7f5f51e00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f34066730 0x7f5f34068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.781+0000 7f5f51e00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f34066730 0x7f5f34068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f44001560 tx=0x7f5f44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:14.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:14.789+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f54154c40 con 0x7f5f5415a830 2024-09-13T15:08:15.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.037+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f541555e0 con 0x7f5f5415a830 2024-09-13T15:08:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.037+0000 7f5f4a000700 1 -- 172.21.15.50:0/3882332368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f5f541555e0 con 0x7f5f5415a830 2024-09-13T15:08:15.041 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:15.041 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f34066730 msgr2=0x7f5f34068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f34066730 0x7f5f34068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f44001560 tx=0x7f5f44009040 comp rx=0 tx=0).stop 2024-09-13T15:08:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 msgr2=0x7f5f5413f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 0x7f5f5413f650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f54067e60 tx=0x7f5f4c004770 comp rx=0 tx=0).stop 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 shutdown_connections 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f34066730 0x7f5f34068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5415a830 0x7f5f5413f650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f540b3960 0x7f5f5413f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 --2- 172.21.15.50:0/3882332368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f540667a0 0x7f5f5413c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 >> 172.21.15.50:0/3882332368 conn(0x7f5f5406e660 msgr2=0x7f5f540af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 shutdown_connections 2024-09-13T15:08:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.041+0000 7f5f58c00700 1 -- 172.21.15.50:0/3882332368 wait complete. 2024-09-13T15:08:15.047 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:15.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:15.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.237+0000 7f13fca00700 1 Processor -- start 2024-09-13T15:08:15.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.237+0000 7f13fca00700 1 -- start start 2024-09-13T15:08:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13f806a390 0x7f13f806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f806b4d0 con 0x7f13f8066090 2024-09-13T15:08:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f806a8c0 con 0x7f13f8144440 2024-09-13T15:08:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f806aba0 con 0x7f13f806a390 2024-09-13T15:08:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13f806a390 0x7f13f806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13f806a390 0x7f13f806b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37608/0 (socket says 172.21.15.50:37608) 2024-09-13T15:08:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 -- 172.21.15.50:0/3666725701 learned_addr learned my addr 172.21.15.50:0/3666725701 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 -- 172.21.15.50:0/3666725701 >> v1:172.21.15.181:6789/0 conn(0x7f13f8144440 legacy=0x7f13f80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 -- 172.21.15.50:0/3666725701 >> v1:172.21.15.50:6789/0 conn(0x7f13f8066090 legacy=0x7f13f815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 -- 172.21.15.50:0/3666725701 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f806ae80 con 0x7f13f806a390 2024-09-13T15:08:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5e00700 1 --2- 172.21.15.50:0/3666725701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f806b960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009910 tx=0x7f13e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d120820a162f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5400700 1 -- 172.21.15.50:0/3666725701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4004230 con 0x7f13f806a390 2024-09-13T15:08:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5400700 1 -- 172.21.15.50:0/3666725701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e4004390 con 0x7f13f806a390 2024-09-13T15:08:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13f5400700 1 -- 172.21.15.50:0/3666725701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4009e60 con 0x7f13f806a390 2024-09-13T15:08:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- 172.21.15.50:0/3666725701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 msgr2=0x7f13f806b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 --2- 172.21.15.50:0/3666725701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f806b960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009910 tx=0x7f13e4009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- 172.21.15.50:0/3666725701 shutdown_connections 2024-09-13T15:08:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 --2- 172.21.15.50:0/3666725701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f806b960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- 172.21.15.50:0/3666725701 >> 172.21.15.50:0/3666725701 conn(0x7f13f806e660 msgr2=0x7f13f806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- 172.21.15.50:0/3666725701 shutdown_connections 2024-09-13T15:08:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.241+0000 7f13fca00700 1 -- 172.21.15.50:0/3666725701 wait complete. 2024-09-13T15:08:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 Processor -- start 2024-09-13T15:08:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 -- start start 2024-09-13T15:08:15.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13f8066090 0x7f13f81f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f81f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f8144440 0x7f13f8159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8143210 con 0x7f13f806a390 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8140490 con 0x7f13f8144440 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13fca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81f3a80 con 0x7f13f8066090 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13f5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f81f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13f5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f81f58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37624/0 (socket says 172.21.15.50:37624) 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13f5e00700 1 -- 172.21.15.50:0/449962255 learned_addr learned my addr 172.21.15.50:0/449962255 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13f6800700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13f8066090 0x7f13f81f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.245+0000 7f13f7200700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f8144440 0x7f13f8159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f5e00700 1 -- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13f8066090 msgr2=0x7f13f81f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f5e00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13f8066090 0x7f13f81f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f5e00700 1 -- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f8144440 msgr2=0x7f13f8159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f5e00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f8144440 0x7f13f8159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f5e00700 1 -- 172.21.15.50:0/449962255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e4009570 con 0x7f13f806a390 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f7200700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f8144440 0x7f13f8159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13f5e00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f81f58b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f13e4004000 tx=0x7f13e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400bd50 con 0x7f13f806a390 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e401f070 con 0x7f13f806a390 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f8142690 con 0x7f13f806a390 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4003900 con 0x7f13f806a390 2024-09-13T15:08:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f8142c50 con 0x7f13f806a390 2024-09-13T15:08:15.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.249+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f8140600 con 0x7f13f806a390 2024-09-13T15:08:15.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.253+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13e4021030 con 0x7f13f806a390 2024-09-13T15:08:15.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.253+0000 7f13eea00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f13d8066730 0x7f13d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.253+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13e4085a40 con 0x7f13f806a390 2024-09-13T15:08:15.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.253+0000 7f13f6800700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f13d8066730 0x7f13d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.253+0000 7f13f6800700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f13d8066730 0x7f13d8068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000f60 tx=0x7f13e8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:15.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.261+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f13f8140600 con 0x7f13f806a390 2024-09-13T15:08:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.449+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13f8140600 con 0x7f13f806a390 2024-09-13T15:08:15.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13eea00700 1 -- 172.21.15.50:0/449962255 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f13f8140600 con 0x7f13f806a390 2024-09-13T15:08:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:15.455 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:07:41.981610+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f13d8066730 msgr2=0x7f13d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f13d8066730 0x7f13d8068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000f60 tx=0x7f13e8009040 comp rx=0 tx=0).stop 2024-09-13T15:08:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 msgr2=0x7f13f81f58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f81f58b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f13e4004000 tx=0x7f13e4004770 comp rx=0 tx=0).stop 2024-09-13T15:08:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 shutdown_connections 2024-09-13T15:08:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f13d8066730 0x7f13d8068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f8144440 0x7f13f8159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f806a390 0x7f13f81f58b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 --2- 172.21.15.50:0/449962255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13f8066090 0x7f13f81f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.453+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 >> 172.21.15.50:0/449962255 conn(0x7f13f806e660 msgr2=0x7f13f806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.457+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 shutdown_connections 2024-09-13T15:08:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.457+0000 7f13fca00700 1 -- 172.21.15.50:0/449962255 wait complete. 2024-09-13T15:08:15.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.645+0000 7f5fb6000700 1 Processor -- start 2024-09-13T15:08:15.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.645+0000 7f5fb6000700 1 -- start start 2024-09-13T15:08:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fb6000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5fb006a5d0 0x7f5fb006aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fb6000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00cdd90 con 0x7f5fb006c460 2024-09-13T15:08:15.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fb6000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb006ce10 con 0x7f5fb015b700 2024-09-13T15:08:15.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fb6000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb006afa0 con 0x7f5fb006a5d0 2024-09-13T15:08:15.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fa6a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fb006c460 0x7f5fb006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33802/0 (socket says 172.21.15.50:33802) 2024-09-13T15:08:15.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fa6a00700 1 -- 172.21.15.50:0/185728722 learned_addr learned my addr 172.21.15.50:0/185728722 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:15.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fafe00700 1 --2- 172.21.15.50:0/185728722 >> v2:172.21.15.181:3300/0 conn(0x7f5fb006a5d0 0x7f5fb006aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5faea00700 1 -- 172.21.15.50:0/185728722 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341584157 0 0) 0x7f5fb00cdd90 con 0x7f5fb006c460 2024-09-13T15:08:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5faea00700 1 -- 172.21.15.50:0/185728722 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f940035d0 con 0x7f5fb006c460 2024-09-13T15:08:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fafe00700 1 -- 172.21.15.50:0/185728722 >> v1:172.21.15.181:6789/0 conn(0x7f5fb015b700 legacy=0x7f5fb015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5faea00700 1 -- 172.21.15.50:0/185728722 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013767298 0 0) 0x7f5f940035d0 con 0x7f5fb006c460 2024-09-13T15:08:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fafe00700 1 -- 172.21.15.50:0/185728722 >> v1:172.21.15.50:6789/0 conn(0x7f5fb006c460 legacy=0x7f5fb006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fafe00700 1 -- 172.21.15.50:0/185728722 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00cd4f0 con 0x7f5fb006a5d0 2024-09-13T15:08:15.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5fafe00700 1 --2- 172.21.15.50:0/185728722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb006a5d0 0x7f5fb006aa60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77b4e9662df2886 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5faea00700 1 -- 172.21.15.50:0/185728722 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800e070 con 0x7f5fb006a5d0 2024-09-13T15:08:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5faea00700 1 -- 172.21.15.50:0/185728722 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8003a40 con 0x7f5fb006a5d0 2024-09-13T15:08:15.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.649+0000 7f5faea00700 1 -- 172.21.15.50:0/185728722 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98001670 con 0x7f5fb006a5d0 2024-09-13T15:08:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 -- 172.21.15.50:0/185728722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb006a5d0 msgr2=0x7f5fb006aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 --2- 172.21.15.50:0/185728722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb006a5d0 0x7f5fb006aa60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 -- 172.21.15.50:0/185728722 shutdown_connections 2024-09-13T15:08:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 --2- 172.21.15.50:0/185728722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb006a5d0 0x7f5fb006aa60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 -- 172.21.15.50:0/185728722 >> 172.21.15.50:0/185728722 conn(0x7f5fb00b08d0 msgr2=0x7f5fb00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 -- 172.21.15.50:0/185728722 shutdown_connections 2024-09-13T15:08:15.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.653+0000 7f5fb6000700 1 -- 172.21.15.50:0/185728722 wait complete. 2024-09-13T15:08:15.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 Processor -- start 2024-09-13T15:08:15.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 -- start start 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 0x7f5fb0159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fb006c460 0x7f5fb0070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb015b700 0x7f5fb00afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0071620 con 0x7f5fb006a5d0 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01596d0 con 0x7f5fb015b700 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fb6000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0070770 con 0x7f5fb006c460 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 0x7f5fb0159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 0x7f5fb0159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37640/0 (socket says 172.21.15.50:37640) 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 -- 172.21.15.50:0/535168498 learned_addr learned my addr 172.21.15.50:0/535168498 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fafe00700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb015b700 0x7f5fb00afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5fa6a00700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fb006c460 0x7f5fb0070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 -- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fb006c460 msgr2=0x7f5fb0070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fb006c460 0x7f5fb0070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 -- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb015b700 msgr2=0x7f5fb00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb015b700 0x7f5fb00afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.657+0000 7f5faf400700 1 -- 172.21.15.50:0/535168498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009a70 con 0x7f5fb006a5d0 2024-09-13T15:08:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5faf400700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 0x7f5fb0159190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c750 tx=0x7f5fa000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00054e0 con 0x7f5fb006a5d0 2024-09-13T15:08:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa00036a0 con 0x7f5fb006a5d0 2024-09-13T15:08:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0003a30 con 0x7f5fb006a5d0 2024-09-13T15:08:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00709a0 con 0x7f5fb006a5d0 2024-09-13T15:08:15.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0070f60 con 0x7f5fb006a5d0 2024-09-13T15:08:15.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.661+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb006aa60 con 0x7f5fb006a5d0 2024-09-13T15:08:15.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.665+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5fa0003b90 con 0x7f5fb006a5d0 2024-09-13T15:08:15.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.665+0000 7f5fa7e00700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f8c066730 0x7f5f8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:15.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.665+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fa0083920 con 0x7f5fb006a5d0 2024-09-13T15:08:15.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.665+0000 7f5fa6a00700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f8c066730 0x7f5f8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:15.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.665+0000 7f5fa6a00700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f8c066730 0x7f5f8c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0158c50 tx=0x7f5f98001230 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.673+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5fa0050900 con 0x7f5fb006a5d0 2024-09-13T15:08:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.905+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fb006c240 con 0x7f5fb006a5d0 2024-09-13T15:08:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.905+0000 7f5fa7e00700 1 -- 172.21.15.50:0/535168498 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f5fa0017090 con 0x7f5fb006a5d0 2024-09-13T15:08:15.909 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:15.909 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f8c066730 msgr2=0x7f5f8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f8c066730 0x7f5f8c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0158c50 tx=0x7f5f98001230 comp rx=0 tx=0).stop 2024-09-13T15:08:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 msgr2=0x7f5fb0159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 0x7f5fb0159190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c750 tx=0x7f5fa000ca60 comp rx=0 tx=0).stop 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 shutdown_connections 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f8c066730 0x7f5f8c068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fb015b700 0x7f5fb00afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fb006c460 0x7f5fb0070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 --2- 172.21.15.50:0/535168498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb006a5d0 0x7f5fb0159190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 >> 172.21.15.50:0/535168498 conn(0x7f5fb00b08d0 msgr2=0x7f5fb00b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 shutdown_connections 2024-09-13T15:08:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:15.909+0000 7f5fb6000700 1 -- 172.21.15.50:0/535168498 wait complete. 2024-09-13T15:08:15.914 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:16.336 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:07:37.462088+0000', 'modified': '2024-09-13T15:08:04.144510+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.181:6835/472992043', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 472992043}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 472992043}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:08:16.336 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:08:16.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T15:08:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.509+0000 7fda77200700 1 Processor -- start 2024-09-13T15:08:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.509+0000 7fda77200700 1 -- start start 2024-09-13T15:08:16.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda77200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fda7806e0a0 0x7fda780ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda77200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda78071150 con 0x7fda780cb200 2024-09-13T15:08:16.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda77200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780cd540 con 0x7fda780ccfd0 2024-09-13T15:08:16.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda77200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780ceb20 con 0x7fda7806e0a0 2024-09-13T15:08:16.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda780cb200 0x7fda7806d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33806/0 (socket says 172.21.15.50:33806) 2024-09-13T15:08:16.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75e00700 1 -- 172.21.15.50:0/3865546908 learned_addr learned my addr 172.21.15.50:0/3865546908 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:16.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75400700 1 --2- 172.21.15.50:0/3865546908 >> v2:172.21.15.181:3300/0 conn(0x7fda7806e0a0 0x7fda780ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda74a00700 1 -- 172.21.15.50:0/3865546908 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921734268 0 0) 0x7fda78071150 con 0x7fda780cb200 2024-09-13T15:08:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda74a00700 1 -- 172.21.15.50:0/3865546908 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda5c0035d0 con 0x7fda780cb200 2024-09-13T15:08:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75400700 1 -- 172.21.15.50:0/3865546908 >> v1:172.21.15.181:6789/0 conn(0x7fda780ccfd0 legacy=0x7fda780704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75400700 1 -- 172.21.15.50:0/3865546908 >> v1:172.21.15.50:6789/0 conn(0x7fda780cb200 legacy=0x7fda7806d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75400700 1 -- 172.21.15.50:0/3865546908 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780cd820 con 0x7fda7806e0a0 2024-09-13T15:08:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.513+0000 7fda75400700 1 --2- 172.21.15.50:0/3865546908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780ce5e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda64009850 tx=0x7fda64009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb31842472f7933 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda74a00700 1 -- 172.21.15.50:0/3865546908 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64004230 con 0x7fda7806e0a0 2024-09-13T15:08:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda74a00700 1 -- 172.21.15.50:0/3865546908 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda64004390 con 0x7fda7806e0a0 2024-09-13T15:08:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda74a00700 1 -- 172.21.15.50:0/3865546908 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda640036c0 con 0x7fda7806e0a0 2024-09-13T15:08:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 -- 172.21.15.50:0/3865546908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 msgr2=0x7fda780ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 --2- 172.21.15.50:0/3865546908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780ce5e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda64009850 tx=0x7fda64009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 -- 172.21.15.50:0/3865546908 shutdown_connections 2024-09-13T15:08:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 --2- 172.21.15.50:0/3865546908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780ce5e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 -- 172.21.15.50:0/3865546908 >> 172.21.15.50:0/3865546908 conn(0x7fda780cf0d0 msgr2=0x7fda780cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 -- 172.21.15.50:0/3865546908 shutdown_connections 2024-09-13T15:08:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 -- 172.21.15.50:0/3865546908 wait complete. 2024-09-13T15:08:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 Processor -- start 2024-09-13T15:08:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.517+0000 7fda77200700 1 -- start start 2024-09-13T15:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fda780cb200 0x7fda7815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 0x7fda7815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c6b70 con 0x7fda780ccfd0 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c3ba0 con 0x7fda7806e0a0 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7815e890 con 0x7fda780cb200 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 0x7fda7815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 0x7fda7815dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37646/0 (socket says 172.21.15.50:37646) 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 -- 172.21.15.50:0/3414750714 learned_addr learned my addr 172.21.15.50:0/3414750714 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda75400700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fda780cb200 0x7fda7815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda75e00700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 -- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fda780cb200 msgr2=0x7fda7815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fda780cb200 0x7fda7815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 -- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 msgr2=0x7fda780c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 -- 172.21.15.50:0/3414750714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640094b0 con 0x7fda780ccfd0 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda75e00700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda76800700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 0x7fda7815dfb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda7000cba0 tx=0x7fda7000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda6e000700 1 -- 172.21.15.50:0/3414750714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70003c20 con 0x7fda780ccfd0 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda6e000700 1 -- 172.21.15.50:0/3414750714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70003d80 con 0x7fda780ccfd0 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda6e000700 1 -- 172.21.15.50:0/3414750714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000ab10 con 0x7fda780ccfd0 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780c6240 con 0x7fda780ccfd0 2024-09-13T15:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.521+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda780c6800 con 0x7fda780ccfd0 2024-09-13T15:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.525+0000 7fda6e000700 1 -- 172.21.15.50:0/3414750714 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda7000ac70 con 0x7fda780ccfd0 2024-09-13T15:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.525+0000 7fda6e000700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda58066730 0x7fda58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.525+0000 7fda6e000700 1 -- 172.21.15.50:0/3414750714 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda70084530 con 0x7fda780ccfd0 2024-09-13T15:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.529+0000 7fda75e00700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda58066730 0x7fda58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.529+0000 7fda75e00700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda58066730 0x7fda58068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda68000f60 tx=0x7fda68007d00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.529+0000 7fda7fff4740 1 Processor -- start 2024-09-13T15:08:16.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.529+0000 7fda7fff4740 1 -- start start 2024-09-13T15:08:16.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.529+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1cea2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.529+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1ce6a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cdc9d80 con 0x1cea1da0 2024-09-13T15:08:16.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cdc7510 con 0x1cea26c0 2024-09-13T15:08:16.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cdc2e00 con 0x1ce80d00 2024-09-13T15:08:16.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1cea2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1cea2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37662/0 (socket says 172.21.15.50:37662) 2024-09-13T15:08:16.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 -- 172.21.15.50:0/335613267 learned_addr learned my addr 172.21.15.50:0/335613267 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:16.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda76800700 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75400700 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1ce6a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 -- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 msgr2=0x1ce6a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1ce6a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 -- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 msgr2=0x1ce6add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce6add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 -- 172.21.15.50:0/335613267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cc35960 con 0x1cea1da0 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda75e00700 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1cea2180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fda68015640 tx=0x7fda68012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b7d208a59fd26a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda62600700 1 -- 172.21.15.50:0/335613267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68015ea0 con 0x1cea1da0 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda62600700 1 -- 172.21.15.50:0/335613267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68015320 con 0x1cea1da0 2024-09-13T15:08:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda62600700 1 -- 172.21.15.50:0/335613267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68021650 con 0x1cea1da0 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- 172.21.15.50:0/335613267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 msgr2=0x1cea2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1cea2180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fda68015640 tx=0x7fda68012000 comp rx=0 tx=0).stop 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- 172.21.15.50:0/335613267 shutdown_connections 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce6add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1ce6a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 --2- 172.21.15.50:0/335613267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1cea2180 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- 172.21.15.50:0/335613267 >> 172.21.15.50:0/335613267 conn(0x1cbea4d0 msgr2=0x1ce83c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- 172.21.15.50:0/335613267 shutdown_connections 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.533+0000 7fda7fff4740 1 -- 172.21.15.50:0/335613267 wait complete. 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 -- start start 2024-09-13T15:08:16.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 Processor -- start 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1cea2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1ce9d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1cea8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cd80730 con 0x1cea1da0 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cd865b0 con 0x1cea26c0 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cc6eaa0 con 0x1ce80d00 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda7fff4740 10 client.0 _ll_register_callbacks cb 0x1cdbc610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1ce9d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1ce9d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37664/0 (socket says 172.21.15.50:37664) 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 -- 172.21.15.50:0/2503940611 learned_addr learned my addr 172.21.15.50:0/2503940611 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75e00700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1cea2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda76800700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1cea8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 -- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 msgr2=0x1cea2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1cea2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 -- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 msgr2=0x1cea8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1cea8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.537+0000 7fda75400700 1 -- 172.21.15.50:0/2503940611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6800f040 con 0x1cea1da0 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda75400700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1ce9d720 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fda64004000 tx=0x7fda640047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ec876a01abbe4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 1 -- 172.21.15.50:0/2503940611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64020070 con 0x1cea1da0 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 1 -- 172.21.15.50:0/2503940611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda64003aa0 con 0x1cea1da0 2024-09-13T15:08:16.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1cbf71e0 con 0x1cea1da0 2024-09-13T15:08:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 1 -- 172.21.15.50:0/2503940611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda64006ea0 con 0x1cea1da0 2024-09-13T15:08:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 10 client.4761 fetch_fsmap learned FSMap version 8 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x1cd89220 con 0x1cea1da0 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 1 -- 172.21.15.50:0/2503940611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1cbf71e0 con 0x1cea1da0 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 1 -- 172.21.15.50:0/2503940611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fda64018070 con 0x1cea1da0 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 10 client.4761 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 10 client.4761 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 20 client.4761 populate_metadata read hostname 'smithi050' 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1ce9de80 0x1ce5a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 4 client.4761 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 --> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1cc41460 con 0x1ce9de80 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda75e00700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1ce9de80 0x1ce5a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda56a00700 10 client.4761 ms_handle_connect on v2:172.21.15.181:6834/472992043 2024-09-13T15:08:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.541+0000 7fda75e00700 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1ce9de80 0x1ce5a530 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b41b67fe1628e33 server_cookie=718ca5ec4b91b895 in_seq=0 out_seq=0 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda56a00700 1 -- 172.21.15.50:0/2503940611 <== mds.0 v2:172.21.15.181:6834/472992043 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x1cc41460 con 0x1ce9de80 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda56a00700 10 client.4761 handle_command_reply: tid=0 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 client.4761 shutdown 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 msgr2=0x1ce9d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1ce9d720 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fda64004000 tx=0x7fda640047e0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 shutdown_connections 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1ce9de80 0x1ce5a530 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1cea8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1cea1da0 0x1ce9d720 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda56a00700 0 client.4761 ms_handle_reset on v2:172.21.15.181:6834/472992043 2024-09-13T15:08:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 --2- 172.21.15.50:0/2503940611 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1ce80d00 0x1cea2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 >> 172.21.15.50:0/2503940611 conn(0x1cbea4d0 msgr2=0x1ce7d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 shutdown_connections 2024-09-13T15:08:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 1 -- 172.21.15.50:0/2503940611 wait complete. 2024-09-13T15:08:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.545+0000 7fda7fff4740 20 client.4761 trim_cache size 0 max 16384 2024-09-13T15:08:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.565+0000 7fda7fff4740 1 Processor -- start 2024-09-13T15:08:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.565+0000 7fda7fff4740 1 -- start start 2024-09-13T15:08:16.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ceb1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea1da0 0x1ceb2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce7fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cdf1ec0 con 0x1ce80d00 2024-09-13T15:08:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cd8d4f0 con 0x1cea26c0 2024-09-13T15:08:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cdc2610 con 0x1cea1da0 2024-09-13T15:08:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ceb1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ceb1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37668/0 (socket says 172.21.15.50:37668) 2024-09-13T15:08:16.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 -- 172.21.15.50:0/1713270031 learned_addr learned my addr 172.21.15.50:0/1713270031 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:16.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 -- 172.21.15.50:0/1713270031 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea1da0 msgr2=0x1ceb2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea1da0 0x1ceb2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 -- 172.21.15.50:0/1713270031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 msgr2=0x1ce7fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce7fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 -- 172.21.15.50:0/1713270031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cd6f450 con 0x1ce80d00 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda75e00700 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ceb1d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda68014000 tx=0x7fda68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1839fba12c86bbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda63000700 1 -- 172.21.15.50:0/1713270031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68026030 con 0x1ce80d00 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda63000700 1 -- 172.21.15.50:0/1713270031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68019030 con 0x1ce80d00 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda63000700 1 -- 172.21.15.50:0/1713270031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68015ea0 con 0x1ce80d00 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- 172.21.15.50:0/1713270031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 msgr2=0x1ceb1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ceb1d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda68014000 tx=0x7fda68013000 comp rx=0 tx=0).stop 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- 172.21.15.50:0/1713270031 shutdown_connections 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea26c0 0x1ce7fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea1da0 0x1ceb2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 --2- 172.21.15.50:0/1713270031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ceb1d20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- 172.21.15.50:0/1713270031 >> 172.21.15.50:0/1713270031 conn(0x1cbea4d0 msgr2=0x1ce7f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- 172.21.15.50:0/1713270031 shutdown_connections 2024-09-13T15:08:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.569+0000 7fda7fff4740 1 -- 172.21.15.50:0/1713270031 wait complete. 2024-09-13T15:08:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 -- start start 2024-09-13T15:08:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 Processor -- start 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ce80130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea1da0 0x1ce80670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea26c0 0x1cf05ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ce5cbe0 con 0x1ce80d00 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ce80bb0 con 0x1cea1da0 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cea6bb0 con 0x1cea26c0 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda7fff4740 10 client.0 _ll_register_callbacks cb 0x1ce19710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:08:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ce80130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ce80130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37678/0 (socket says 172.21.15.50:37678) 2024-09-13T15:08:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 -- 172.21.15.50:0/3251362396 learned_addr learned my addr 172.21.15.50:0/3251362396 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 -- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea26c0 msgr2=0x1cf05ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda76800700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea26c0 0x1cf05ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75400700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea1da0 0x1ce80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea26c0 0x1cf05ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 -- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea1da0 msgr2=0x1ce80670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea1da0 0x1ce80670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 -- 172.21.15.50:0/3251362396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1cc35960 con 0x1ce80d00 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda76800700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea26c0 0x1cf05ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75400700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea1da0 0x1ce80670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda75e00700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ce80130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda68015640 tx=0x7fda68007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bcab6a08427d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.573+0000 7fda56a00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 1 -- 172.21.15.50:0/3251362396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68026070 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 1 -- 172.21.15.50:0/3251362396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda6802f800 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda68015320 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 1 -- 172.21.15.50:0/3251362396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda68004890 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 10 client.4767 fetch_fsmap learned FSMap version 8 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x1cd63720 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 1 -- 172.21.15.50:0/3251362396 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68015320 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 1 -- 172.21.15.50:0/3251362396 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fda680049f0 con 0x1ce80d00 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 10 client.4767 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T15:08:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 10 client.4767 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:08:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 20 client.4767 populate_metadata read hostname 'smithi050' 2024-09-13T15:08:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1cea5de0 0x1cea61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 4 client.4767 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:08:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 --> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1cc661e0 con 0x1cea5de0 2024-09-13T15:08:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda75400700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1cea5de0 0x1cea61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:16.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda75400700 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1cea5de0 0x1cea61c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c257be3b13b885e4 server_cookie=af47ef21fa2c46d0 in_seq=0 out_seq=0 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 10 client.4767 ms_handle_connect on v2:172.21.15.181:6834/472992043 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 1 -- 172.21.15.50:0/3251362396 <== mds.0 v2:172.21.15.181:6834/472992043 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1cc661e0 con 0x1cea5de0 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda56a00700 10 client.4767 handle_command_reply: tid=0 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 client.4767 shutdown 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 msgr2=0x1ce80130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.577+0000 7fda7fff4740 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ce80130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda68015640 tx=0x7fda68007ac0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 shutdown_connections 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1cea26c0 0x1cf05ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:6834/472992043,v1:172.21.15.181:6835/472992043] conn(0x1cea5de0 0x1cea61c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1cea1da0 0x1ce80670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 --2- 172.21.15.50:0/3251362396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ce80d00 0x1ce80130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda56a00700 0 client.4767 ms_handle_reset on v2:172.21.15.181:6834/472992043 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 >> 172.21.15.50:0/3251362396 conn(0x1cbea4d0 msgr2=0x1ce5d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 shutdown_connections 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 1 -- 172.21.15.50:0/3251362396 wait complete. 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda7fff4740 20 client.4767 trim_cache size 0 max 16384 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:08:16.585 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4279, 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 39.111540697000002, 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 8, 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 24, 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 44.008455200999997 2024-09-13T15:08:16.586 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda58066730 msgr2=0x7fda58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda58066730 0x7fda58068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda68000f60 tx=0x7fda68007d00 comp rx=0 tx=0).stop 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 msgr2=0x7fda7815dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 0x7fda7815dfb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda7000cba0 tx=0x7fda7000ceb0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 shutdown_connections 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda58066730 0x7fda58068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda780ccfd0 0x7fda7815dfb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fda780cb200 0x7fda7815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 --2- 172.21.15.50:0/3414750714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda7806e0a0 0x7fda780c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 >> 172.21.15.50:0/3414750714 conn(0x7fda780cf0d0 msgr2=0x7fda780ad290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 shutdown_connections 2024-09-13T15:08:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:16.581+0000 7fda77200700 1 -- 172.21.15.50:0/3414750714 wait complete. 2024-09-13T15:08:16.610 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T15:08:16.620 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T15:08:16.621 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T15:08:16.621 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T15:08:16.621 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T15:08:16.669 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T15:08:16.670 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T15:08:16.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:16.670 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:08:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T15:08:16.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:16.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T15:08:16.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:16.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-13T15:08:17.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:17.407 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:08:17.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:17.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-13T15:08:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-09-13T15:08:17.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:08:17.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:17.508 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:08:17.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:17.523 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-09-13T15:08:17.604 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-09-13T15:08:17.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:08:17.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:17.609 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:08:17.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:17.669 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-09-13T15:08:17.757 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-09-13T15:08:17.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:08:17.761 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-13T15:08:17.762 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:08:17.762 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:08:17.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:08:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.937+0000 7f86e3e00700 1 Processor -- start 2024-09-13T15:08:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.937+0000 7f86e3e00700 1 -- start start 2024-09-13T15:08:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86e406aaa0 0x7f86e406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86e40b2670 0x7f86e40b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40b3560 con 0x7f86e41610b0 2024-09-13T15:08:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e4070b30 con 0x7f86e40b2670 2024-09-13T15:08:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e406b450 con 0x7f86e406aaa0 2024-09-13T15:08:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86e40b2670 0x7f86e40b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86e40b2670 0x7f86e40b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37690/0 (socket says 172.21.15.50:37690) 2024-09-13T15:08:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 -- 172.21.15.50:0/3725069719 learned_addr learned my addr 172.21.15.50:0/3725069719 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e2000700 1 --2- 172.21.15.50:0/3725069719 >> v2:172.21.15.181:3300/0 conn(0x7f86e406aaa0 0x7f86e406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 -- 172.21.15.50:0/3725069719 >> v2:172.21.15.181:3300/0 conn(0x7f86e406aaa0 msgr2=0x7f86e406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 --2- 172.21.15.50:0/3725069719 >> v2:172.21.15.181:3300/0 conn(0x7f86e406aaa0 0x7f86e406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 -- 172.21.15.50:0/3725069719 >> v1:172.21.15.181:6789/0 conn(0x7f86e41610b0 legacy=0x7f86e40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 -- 172.21.15.50:0/3725069719 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40b3000 con 0x7f86e40b2670 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e3400700 1 --2- 172.21.15.50:0/3725069719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40b2ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e80 tx=0x7f86dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3e8d4ca267131c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.941+0000 7f86e1600700 1 -- 172.21.15.50:0/3725069719 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00e070 con 0x7f86e40b2670 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e1600700 1 -- 172.21.15.50:0/3725069719 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00b940 con 0x7f86e40b2670 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e1600700 1 -- 172.21.15.50:0/3725069719 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00bcf0 con 0x7f86e40b2670 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 -- 172.21.15.50:0/3725069719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 msgr2=0x7f86e40b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 --2- 172.21.15.50:0/3725069719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40b2ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009e80 tx=0x7f86dc00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 -- 172.21.15.50:0/3725069719 shutdown_connections 2024-09-13T15:08:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 --2- 172.21.15.50:0/3725069719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40b2ac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 --2- 172.21.15.50:0/3725069719 >> v2:172.21.15.181:3300/0 conn(0x7f86e406aaa0 0x7f86e406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 -- 172.21.15.50:0/3725069719 >> 172.21.15.50:0/3725069719 conn(0x7f86e40b0c40 msgr2=0x7f86e406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 -- 172.21.15.50:0/3725069719 shutdown_connections 2024-09-13T15:08:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 -- 172.21.15.50:0/3725069719 wait complete. 2024-09-13T15:08:17.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 Processor -- start 2024-09-13T15:08:17.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.945+0000 7f86e3e00700 1 -- start start 2024-09-13T15:08:17.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86e406aaa0 0x7f86e40acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:17.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86e41610b0 0x7f86e41f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e414e290 con 0x7f86e40b2670 2024-09-13T15:08:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40aa170 con 0x7f86e406aaa0 2024-09-13T15:08:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c3bf0 con 0x7f86e41610b0 2024-09-13T15:08:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86e406aaa0 0x7f86e40acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37702/0 (socket says 172.21.15.50:37702) 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 -- 172.21.15.50:0/1959145778 learned_addr learned my addr 172.21.15.50:0/1959145778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3400700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86e41610b0 0x7f86e41f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 -- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86e41610b0 msgr2=0x7f86e41f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86e41610b0 0x7f86e41f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 -- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86e406aaa0 msgr2=0x7f86e40acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86e406aaa0 0x7f86e40acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 -- 172.21.15.50:0/1959145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009b30 con 0x7f86e40b2670 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3400700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86e41610b0 0x7f86e41f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e2000700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40a9c30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d800 tx=0x7f86d000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00125f0 con 0x7f86e40b2670 2024-09-13T15:08:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0012750 con 0x7f86e40b2670 2024-09-13T15:08:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0012b00 con 0x7f86e40b2670 2024-09-13T15:08:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40a9150 con 0x7f86e40b2670 2024-09-13T15:08:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.949+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40a9710 con 0x7f86e40b2670 2024-09-13T15:08:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.953+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4161490 con 0x7f86e40b2670 2024-09-13T15:08:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.953+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86d0012c60 con 0x7f86e40b2670 2024-09-13T15:08:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.957+0000 7f86db400700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86c4066730 0x7f86c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.957+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86d0084850 con 0x7f86e40b2670 2024-09-13T15:08:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.957+0000 7f86e2a00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86c4066730 0x7f86c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.957+0000 7f86e2a00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86c4066730 0x7f86c4068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86d4000f60 tx=0x7f86d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:17.961+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f86d0051830 con 0x7f86e40b2670 2024-09-13T15:08:18.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.269+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86e406d700 con 0x7f86e40b2670 2024-09-13T15:08:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.273+0000 7f86db400700 1 -- 172.21.15.50:0/1959145778 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f86d0054e50 con 0x7f86e40b2670 2024-09-13T15:08:18.275 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:08:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86c4066730 msgr2=0x7f86c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86c4066730 0x7f86c4068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86d4000f60 tx=0x7f86d4009040 comp rx=0 tx=0).stop 2024-09-13T15:08:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 msgr2=0x7f86e40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40a9c30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d800 tx=0x7f86d000db10 comp rx=0 tx=0).stop 2024-09-13T15:08:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 shutdown_connections 2024-09-13T15:08:18.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86c4066730 0x7f86c4068bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86e41610b0 0x7f86e41f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86e40b2670 0x7f86e40a9c30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 --2- 172.21.15.50:0/1959145778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86e406aaa0 0x7f86e40acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 >> 172.21.15.50:0/1959145778 conn(0x7f86e40b0c40 msgr2=0x7f86e40afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 shutdown_connections 2024-09-13T15:08:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:18.277+0000 7f86e3e00700 1 -- 172.21.15.50:0/1959145778 wait complete. 2024-09-13T15:08:18.302 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T15:08:18.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:08:18.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:08:18.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:08:18.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:08:18.303 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T15:08:18.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:08:18.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:08:18.303 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:08:18.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.303 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:18.319 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42409sec preferred_lft 42409sec 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:08:18.320 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:18.321 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:08:18.321 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:18.322 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:08:18.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:08:18.322 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:18.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.470 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:08:18.503 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:08:18.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.507 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:08:18.568 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:08:18.568 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:08:18.568 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:08:18.568 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:08:18.568 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:08:18.569 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:08:18.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.570 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:18.570 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:18.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:08:18.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:08:18.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:08:18.570 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:18.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.708 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:08:18.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.721 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-13T15:08:18.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.783 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:18.783 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:18.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:08:18.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T15:08:18.783 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:18.902 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T15:08:18.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:18.902 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:18.902 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:18.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T15:08:18.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:08:18.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T15:08:18.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T15:08:18.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T15:08:18.903 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:19.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:19.044 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:19.044 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:19.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:08:19.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:08:19.044 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:19.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:19.107 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:08:19.122 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:08:19.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:19.123 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:08:19.181 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:08:19.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:19.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:19.313 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:19.313 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:20.043 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:20.043 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:20.043 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:08:20.043 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:08:20.043 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:08:20.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:08:20.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:20.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:08:20.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:20.078 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:20.148 INFO:teuthology.orchestra.run.smithi050.stdout:client4804 2024-09-13T15:08:20.148 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:20.148 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:20.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:20.212 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:20.285 INFO:teuthology.orchestra.run.smithi050.stdout:client4804 2024-09-13T15:08:20.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:20.285 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:20.353 INFO:teuthology.orchestra.run.smithi050.stdout:client4804 2024-09-13T15:08:20.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:20.354 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73923987-4656-4194-a4fe-9d4ec875d2d3.client4804/status') 2024-09-13T15:08:20.435 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4804 (3)172.21.15.50:0/3827446222 2024-09-13T15:08:20.435 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-09-13T15:08:20.435 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-09-13T15:08:20.435 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-09-13T15:08:20.436 INFO:teuthology.orchestra.run.smithi050.stderr:70 bytes copied, 9.8417e-05 s, 711 kB/s 2024-09-13T15:08:20.438 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-13T15:08:20.439 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:08:20.439 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T15:08:20.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:08:20.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 Processor -- start 2024-09-13T15:08:20.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 -- start start 2024-09-13T15:08:20.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a9c15d0a0 0x7f3a9c0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:20.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3a9c15d480 0x7f3a9c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:20.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9c15e970 con 0x7f3a9c15de50 2024-09-13T15:08:20.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c0ca4f0 con 0x7f3a9c15d0a0 2024-09-13T15:08:20.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa3600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c0ca7d0 con 0x7f3a9c15d480 2024-09-13T15:08:20.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa0c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a9c15d0a0 0x7f3a9c0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:20.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa0c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a9c15d0a0 0x7f3a9c0b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37708/0 (socket says 172.21.15.50:37708) 2024-09-13T15:08:20.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa0c00700 1 -- 172.21.15.50:0/1336352182 learned_addr learned my addr 172.21.15.50:0/1336352182 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:20.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3a9be00700 1 --2- 172.21.15.50:0/1336352182 >> v2:172.21.15.181:3300/0 conn(0x7f3a9c15d480 0x7f3a9c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:20.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa0c00700 1 -- 172.21.15.50:0/1336352182 >> v2:172.21.15.181:3300/0 conn(0x7f3a9c15d480 msgr2=0x7f3a9c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:20.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.697+0000 7f3aa0c00700 1 --2- 172.21.15.50:0/1336352182 >> v2:172.21.15.181:3300/0 conn(0x7f3a9c15d480 0x7f3a9c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa0c00700 1 -- 172.21.15.50:0/1336352182 >> v1:172.21.15.181:6789/0 conn(0x7f3a9c15de50 legacy=0x7f3a9c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa0c00700 1 -- 172.21.15.50:0/1336352182 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c0caab0 con 0x7f3a9c15d0a0 2024-09-13T15:08:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa0c00700 1 --2- 172.21.15.50:0/1336352182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0b3e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c070500 tx=0x7f3a90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a8174c8e859cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3a9b400700 1 -- 172.21.15.50:0/1336352182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90004230 con 0x7f3a9c15d0a0 2024-09-13T15:08:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3a9b400700 1 -- 172.21.15.50:0/1336352182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a90004390 con 0x7f3a9c15d0a0 2024-09-13T15:08:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3a9b400700 1 -- 172.21.15.50:0/1336352182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a900036c0 con 0x7f3a9c15d0a0 2024-09-13T15:08:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 -- 172.21.15.50:0/1336352182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15d0a0 msgr2=0x7f3a9c0b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 --2- 172.21.15.50:0/1336352182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0b3e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c070500 tx=0x7f3a90009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 -- 172.21.15.50:0/1336352182 shutdown_connections 2024-09-13T15:08:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 --2- 172.21.15.50:0/1336352182 >> v2:172.21.15.181:3300/0 conn(0x7f3a9c15d480 0x7f3a9c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 --2- 172.21.15.50:0/1336352182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0b3e10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 -- 172.21.15.50:0/1336352182 >> 172.21.15.50:0/1336352182 conn(0x7f3a9c071960 msgr2=0x7f3a9c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 -- 172.21.15.50:0/1336352182 shutdown_connections 2024-09-13T15:08:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.701+0000 7f3aa3600700 1 -- 172.21.15.50:0/1336352182 wait complete. 2024-09-13T15:08:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 Processor -- start 2024-09-13T15:08:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 -- start start 2024-09-13T15:08:20.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a9c15d480 0x7f3a9c1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 0x7f3a9c06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c0ad960 con 0x7f3a9c15de50 2024-09-13T15:08:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c1f38a0 con 0x7f3a9c15d0a0 2024-09-13T15:08:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa3600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c0acac0 con 0x7f3a9c15d480 2024-09-13T15:08:20.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa1600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 0x7f3a9c06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:20.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa0c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:20.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa1600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 0x7f3a9c06c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37710/0 (socket says 172.21.15.50:37710) 2024-09-13T15:08:20.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3aa1600700 1 -- 172.21.15.50:0/575781324 learned_addr learned my addr 172.21.15.50:0/575781324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:20.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.705+0000 7f3a9be00700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a9c15d480 0x7f3a9c1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa1600700 1 -- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a9c15d480 msgr2=0x7f3a9c1f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa1600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a9c15d480 0x7f3a9c1f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa1600700 1 -- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a9c15d0a0 msgr2=0x7f3a9c0ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa1600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa1600700 1 -- 172.21.15.50:0/575781324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90009570 con 0x7f3a9c15de50 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa1600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 0x7f3a9c06c9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b9a0 tx=0x7f3a9400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400c930 con 0x7f3a9c15de50 2024-09-13T15:08:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c0acda0 con 0x7f3a9c15de50 2024-09-13T15:08:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9400ca90 con 0x7f3a9c15de50 2024-09-13T15:08:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400ce40 con 0x7f3a9c15de50 2024-09-13T15:08:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c0ad360 con 0x7f3a9c15de50 2024-09-13T15:08:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.709+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c0b3e10 con 0x7f3a9c15de50 2024-09-13T15:08:20.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.713+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a94003a20 con 0x7f3a9c15de50 2024-09-13T15:08:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.713+0000 7f3a98c00700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3a7c066760 0x7f3a7c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.713+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a94084330 con 0x7f3a9c15de50 2024-09-13T15:08:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.713+0000 7f3aa0c00700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3a7c066760 0x7f3a7c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.717+0000 7f3aa0c00700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3a7c066760 0x7f3a7c068c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c070500 tx=0x7f3a90008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.717+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a940512c0 con 0x7f3a9c15de50 2024-09-13T15:08:20.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.953+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3a9c0ac2c0 con 0x7f3a9c15de50 2024-09-13T15:08:20.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.957+0000 7f3a98c00700 1 -- 172.21.15.50:0/575781324 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3a940548e0 con 0x7f3a9c15de50 2024-09-13T15:08:20.958 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3a7c066760 msgr2=0x7f3a7c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3a7c066760 0x7f3a7c068c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c070500 tx=0x7f3a90008030 comp rx=0 tx=0).stop 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 msgr2=0x7f3a9c06c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 0x7f3a9c06c9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b9a0 tx=0x7f3a9400bcb0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 shutdown_connections 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3a7c066760 0x7f3a7c068c20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a9c15de50 0x7f3a9c06c9f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a9c15d480 0x7f3a9c1f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 --2- 172.21.15.50:0/575781324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a9c15d0a0 0x7f3a9c0ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 >> 172.21.15.50:0/575781324 conn(0x7f3a9c071960 msgr2=0x7f3a9c073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 shutdown_connections 2024-09-13T15:08:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:20.961+0000 7f3aa3600700 1 -- 172.21.15.50:0/575781324 wait complete. 2024-09-13T15:08:20.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:08:20.987 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T15:08:20.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:20.987 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:08:21.004 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:21.004 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:21.004 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:08:21.005 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42406sec preferred_lft 42406sec 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:08:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.007 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:08:21.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.087 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:08:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:08:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:08:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:08:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:08:21.150 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:08:21.150 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:08:21.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.150 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:21.150 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:21.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:08:21.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:08:21.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:08:21.150 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:21.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.279 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:08:21.294 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:08:21.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.295 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-13T15:08:21.354 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T15:08:21.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.355 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:21.355 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:21.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:08:21.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T15:08:21.356 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:21.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T15:08:21.509 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:21.509 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:21.509 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:21.509 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:04:1a:7a:be:85 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac04:1aff:fe7a:be85/64 scope link 2024-09-13T15:08:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T15:08:21.594 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:21.594 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:21.594 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:21.594 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.594 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:21.594 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.595 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:08:21.595 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:04:1a:7a:be:85 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T15:08:21.595 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T15:08:21.595 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.595 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac04:1aff:fe7a:be85/64 scope link 2024-09-13T15:08:21.595 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:21.598 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T15:08:21.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T15:08:21.599 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:21.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.793 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:08:21.793 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:08:21.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2024-09-13T15:08:21.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T15:08:21.793 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:08:21.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:21.858 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T15:08:21.875 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T15:08:21.875 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:21.875 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T15:08:21.935 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-13T15:08:21.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:21.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:22.068 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:22.069 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:22.094 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:22.094 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:22.094 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:08:22.094 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 2@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:08:22.094 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:08:22.103 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:08:22.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:22.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T15:08:22.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:22.134 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout:client4782 2024-09-13T15:08:22.205 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:22.205 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:22.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:22.265 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:22.332 INFO:teuthology.orchestra.run.smithi050.stdout:client4782 2024-09-13T15:08:22.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:22.332 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:22.400 INFO:teuthology.orchestra.run.smithi050.stdout:client4782 2024-09-13T15:08:22.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:22.400 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73923987-4656-4194-a4fe-9d4ec875d2d3.client4782/status') 2024-09-13T15:08:22.479 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4782 (3)192.168.0.2:0/653616672 2024-09-13T15:08:22.480 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-09-13T15:08:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-09-13T15:08:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-09-13T15:08:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:68 bytes copied, 0.000177336 s, 383 kB/s 2024-09-13T15:08:22.483 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-13T15:08:22.483 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:08:22.483 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:08:22.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:08:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.705+0000 7fe3a6e00700 1 Processor -- start 2024-09-13T15:08:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a6e00700 1 -- start start 2024-09-13T15:08:22.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a6e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 0x7fe3a00b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a6e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3a00ce2a0 0x7fe3a00b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a6e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00b3050 con 0x7fe3a00b2c40 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a6e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a0161490 con 0x7fe3a00ce2a0 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a6e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00cfe90 con 0x7fe3a01610b0 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a5000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3a00ce2a0 0x7fe3a00b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a5a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 0x7fe3a00b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:22.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a5a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 0x7fe3a00b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:38120/0 (socket says 172.21.15.50:38120) 2024-09-13T15:08:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.709+0000 7fe3a5a00700 1 -- 172.21.15.50:0/3794307327 learned_addr learned my addr 172.21.15.50:0/3794307327 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a5000700 1 -- 172.21.15.50:0/3794307327 >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 msgr2=0x7fe3a00b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a5000700 1 --2- 172.21.15.50:0/3794307327 >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 0x7fe3a00b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a5000700 1 -- 172.21.15.50:0/3794307327 >> v1:172.21.15.181:6789/0 conn(0x7fe3a00b2c40 legacy=0x7fe3a0164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a5000700 1 -- 172.21.15.50:0/3794307327 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00b3a70 con 0x7fe3a00ce2a0 2024-09-13T15:08:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a5a00700 1 --2- 172.21.15.50:0/3794307327 >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 0x7fe3a00b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a5000700 1 --2- 172.21.15.50:0/3794307327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a00b2700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0067d70 tx=0x7fe38c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9919de088184e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe39fe00700 1 -- 172.21.15.50:0/3794307327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011830 con 0x7fe3a00ce2a0 2024-09-13T15:08:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe39fe00700 1 -- 172.21.15.50:0/3794307327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c011990 con 0x7fe3a00ce2a0 2024-09-13T15:08:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe39fe00700 1 -- 172.21.15.50:0/3794307327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011d20 con 0x7fe3a00ce2a0 2024-09-13T15:08:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 -- 172.21.15.50:0/3794307327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a00ce2a0 msgr2=0x7fe3a00b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/3794307327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a00b2700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0067d70 tx=0x7fe38c009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 -- 172.21.15.50:0/3794307327 shutdown_connections 2024-09-13T15:08:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/3794307327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a00b2700 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/3794307327 >> v2:172.21.15.181:3300/0 conn(0x7fe3a01610b0 0x7fe3a00b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 -- 172.21.15.50:0/3794307327 >> 172.21.15.50:0/3794307327 conn(0x7fe3a0071d90 msgr2=0x7fe3a0072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 -- 172.21.15.50:0/3794307327 shutdown_connections 2024-09-13T15:08:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.713+0000 7fe3a6e00700 1 -- 172.21.15.50:0/3794307327 wait complete. 2024-09-13T15:08:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 Processor -- start 2024-09-13T15:08:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 -- start start 2024-09-13T15:08:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3a00b2c40 0x7fe3a0150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 0x7fe3a0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01514a0 con 0x7fe3a01610b0 2024-09-13T15:08:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a006a430 con 0x7fe3a00ce2a0 2024-09-13T15:08:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a006a710 con 0x7fe3a00b2c40 2024-09-13T15:08:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 0x7fe3a0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 0x7fe3a0159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37730/0 (socket says 172.21.15.50:37730) 2024-09-13T15:08:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6400700 1 -- 172.21.15.50:0/649375463 learned_addr learned my addr 172.21.15.50:0/649375463 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a5a00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3a00b2c40 0x7fe3a0150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a5000700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.717+0000 7fe3a6400700 1 -- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3a00b2c40 msgr2=0x7fe3a0150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6400700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3a00b2c40 0x7fe3a0150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6400700 1 -- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3a00ce2a0 msgr2=0x7fe3a006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6400700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a006b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6400700 1 -- 172.21.15.50:0/649375463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009b30 con 0x7fe3a01610b0 2024-09-13T15:08:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6400700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 0x7fe3a0159d00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c390 tx=0x7fe39800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980052d0 con 0x7fe3a01610b0 2024-09-13T15:08:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398005430 con 0x7fe3a01610b0 2024-09-13T15:08:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980055a0 con 0x7fe3a01610b0 2024-09-13T15:08:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c0094b0 con 0x7fe3a01610b0 2024-09-13T15:08:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a006acd0 con 0x7fe3a01610b0 2024-09-13T15:08:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.721+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a00b3230 con 0x7fe3a01610b0 2024-09-13T15:08:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.725+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3980038c0 con 0x7fe3a01610b0 2024-09-13T15:08:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.725+0000 7fe39d600700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe380066730 0x7fe380068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.725+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3980837b0 con 0x7fe3a01610b0 2024-09-13T15:08:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.725+0000 7fe3a5a00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe380066730 0x7fe380068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:22.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.725+0000 7fe3a5a00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe380066730 0x7fe380068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3940072c0 tx=0x7fe39400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:22.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.729+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3980506c0 con 0x7fe3a01610b0 2024-09-13T15:08:22.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.961+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3a00b4030 con 0x7fe3a01610b0 2024-09-13T15:08:22.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.961+0000 7fe39d600700 1 -- 172.21.15.50:0/649375463 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe398053ce0 con 0x7fe3a01610b0 2024-09-13T15:08:22.964 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe380066730 msgr2=0x7fe380068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe380066730 0x7fe380068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3940072c0 tx=0x7fe39400b040 comp rx=0 tx=0).stop 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 msgr2=0x7fe3a0159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 0x7fe3a0159d00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c390 tx=0x7fe39800c6a0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 shutdown_connections 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe380066730 0x7fe380068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a01610b0 0x7fe3a0159d00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3a00ce2a0 0x7fe3a006b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 --2- 172.21.15.50:0/649375463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3a00b2c40 0x7fe3a0150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 >> 172.21.15.50:0/649375463 conn(0x7fe3a0071d90 msgr2=0x7fe3a00cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:22.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 shutdown_connections 2024-09-13T15:08:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:22.965+0000 7fe3a6e00700 1 -- 172.21.15.50:0/649375463 wait complete. 2024-09-13T15:08:22.992 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T15:08:22.992 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:08:22.992 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:08:22.992 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:08:22.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:08:22.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T15:08:22.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:08:22.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:08:22.993 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:08:22.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:22.993 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:23.010 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42394sec preferred_lft 42394sec 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:08:23.011 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:23.012 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:08:23.012 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:23.012 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:08:23.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr flush dev ceph-brx 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set ceph-brx up 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:08:23.013 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:23.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.173 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:08:23.204 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:08:23.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.207 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:08:23.290 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:08:23.291 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:08:23.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.292 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:23.292 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:23.292 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:08:23.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:08:23.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:08:23.293 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:23.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.424 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:08:23.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.442 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-09-13T15:08:23.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.503 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:23.503 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:23.503 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:08:23.503 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T15:08:23.503 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:23.614 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T15:08:23.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.614 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:23.614 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:23.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T15:08:23.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:08:23.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T15:08:23.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T15:08:23.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T15:08:23.615 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:23.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.791 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:23.792 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:23.792 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:08:23.792 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:08:23.792 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:23.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:23.861 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:08:23.877 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:08:23.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:23.878 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:08:23.938 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:08:23.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:23.939 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:24.073 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:24.073 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:24.791 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:24.791 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:24.791 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:08:24.791 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:08:24.791 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:08:24.799 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:08:24.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:24.799 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:08:24.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:24.826 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:24.905 INFO:teuthology.orchestra.run.smithi181.stdout:client4822 2024-09-13T15:08:24.905 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:24.905 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:24.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:24.965 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:25.032 INFO:teuthology.orchestra.run.smithi181.stdout:client4822 2024-09-13T15:08:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.032 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:25.102 INFO:teuthology.orchestra.run.smithi181.stdout:client4822 2024-09-13T15:08:25.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.102 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73923987-4656-4194-a4fe-9d4ec875d2d3.client4822/status') 2024-09-13T15:08:25.180 INFO:teuthology.orchestra.run.smithi181.stdout:instance: client.4822 (3)192.168.0.1:0/2335382633 2024-09-13T15:08:25.180 INFO:teuthology.orchestra.run.smithi181.stdout:blocklisted: false 2024-09-13T15:08:25.180 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records in 2024-09-13T15:08:25.180 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records out 2024-09-13T15:08:25.180 INFO:teuthology.orchestra.run.smithi181.stderr:69 bytes copied, 0.000173154 s, 398 kB/s 2024-09-13T15:08:25.183 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-13T15:08:25.183 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:08:25.183 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T15:08:25.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:08:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.361+0000 7ff43ce00700 1 Processor -- start 2024-09-13T15:08:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.361+0000 7ff43ce00700 1 -- start start 2024-09-13T15:08:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff43ce00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4380cc6f0 0x7ff43815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff43ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff43806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff43ce00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380ccb40 con 0x7ff4380cb020 2024-09-13T15:08:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff43ce00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43806b430 con 0x7ff4380cc6f0 2024-09-13T15:08:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff43ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380b2ad0 con 0x7ff43806aaa0 2024-09-13T15:08:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff437e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff43806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:25.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff437400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff4380cb020 0x7ff43815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:60792/0 (socket says 172.21.15.50:60792) 2024-09-13T15:08:25.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff437e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff43806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35914/0 (socket says 172.21.15.50:35914) 2024-09-13T15:08:25.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff437400700 1 -- 172.21.15.50:0/1296174808 learned_addr learned my addr 172.21.15.50:0/1296174808 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:25.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.365+0000 7ff436a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff4380cc6f0 0x7ff43815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff437e00700 1 -- 172.21.15.50:0/1296174808 >> v2:172.21.15.181:3300/0 conn(0x7ff4380cc6f0 msgr2=0x7ff43815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff437e00700 1 --2- 172.21.15.50:0/1296174808 >> v2:172.21.15.181:3300/0 conn(0x7ff4380cc6f0 0x7ff43815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff437e00700 1 -- 172.21.15.50:0/1296174808 >> v1:172.21.15.181:6789/0 conn(0x7ff4380cb020 legacy=0x7ff43815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff437e00700 1 -- 172.21.15.50:0/1296174808 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43815b960 con 0x7ff43806aaa0 2024-09-13T15:08:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff436a00700 1 --2- 172.21.15.50:0/1296174808 >> v2:172.21.15.181:3300/0 conn(0x7ff4380cc6f0 0x7ff43815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff437e00700 1 --2- 172.21.15.50:0/1296174808 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff43806aef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff430009d90 tx=0x7ff43000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57783b6acf2a4e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff436000700 1 -- 172.21.15.50:0/1296174808 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000e070 con 0x7ff43806aaa0 2024-09-13T15:08:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff436000700 1 -- 172.21.15.50:0/1296174808 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff430003a40 con 0x7ff43806aaa0 2024-09-13T15:08:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff436000700 1 -- 172.21.15.50:0/1296174808 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430003df0 con 0x7ff43806aaa0 2024-09-13T15:08:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 -- 172.21.15.50:0/1296174808 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 msgr2=0x7ff43806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:25.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1296174808 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff43806aef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff430009d90 tx=0x7ff43000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:25.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 -- 172.21.15.50:0/1296174808 shutdown_connections 2024-09-13T15:08:25.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1296174808 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff43806aef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1296174808 >> v2:172.21.15.181:3300/0 conn(0x7ff4380cc6f0 0x7ff43815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 -- 172.21.15.50:0/1296174808 >> 172.21.15.50:0/1296174808 conn(0x7ff4380b0c40 msgr2=0x7ff43806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:25.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 -- 172.21.15.50:0/1296174808 shutdown_connections 2024-09-13T15:08:25.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.369+0000 7ff43ce00700 1 -- 172.21.15.50:0/1296174808 wait complete. 2024-09-13T15:08:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.373+0000 7ff43ce00700 1 Processor -- start 2024-09-13T15:08:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.373+0000 7ff43ce00700 1 -- start start 2024-09-13T15:08:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff4381fab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4380cb020 0x7ff43814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 0x7ff4381f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43814d470 con 0x7ff4380cc6f0 2024-09-13T15:08:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438142a30 con 0x7ff4380cb020 2024-09-13T15:08:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff438143290 con 0x7ff43806aaa0 2024-09-13T15:08:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 0x7ff4381f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 0x7ff4381f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53890/0 (socket says 172.21.15.50:53890) 2024-09-13T15:08:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 -- 172.21.15.50:0/1279630500 learned_addr learned my addr 172.21.15.50:0/1279630500 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff436a00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4380cb020 0x7ff43814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437400700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff4381fab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 -- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 msgr2=0x7ff4381fab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff4381fab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 -- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4380cb020 msgr2=0x7ff43814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4380cb020 0x7ff43814c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 -- 172.21.15.50:0/1279630500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240094b0 con 0x7ff4380cc6f0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff436a00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4380cb020 0x7ff43814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff437e00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 0x7ff4381f6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4380b2c10 tx=0x7ff430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300046a0 con 0x7ff4380cc6f0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff430004820 con 0x7ff4380cc6f0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff430009a70 con 0x7ff4380cc6f0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430004990 con 0x7ff4380cc6f0 2024-09-13T15:08:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.377+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438142f20 con 0x7ff4380cc6f0 2024-09-13T15:08:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.381+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4380cb400 con 0x7ff4380cc6f0 2024-09-13T15:08:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.381+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff430012670 con 0x7ff4380cc6f0 2024-09-13T15:08:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.381+0000 7ff42f400700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff418066730 0x7ff418068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.381+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff4300865e0 con 0x7ff4380cc6f0 2024-09-13T15:08:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.381+0000 7ff437400700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff418066730 0x7ff418068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:25.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.385+0000 7ff437400700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff418066730 0x7ff418068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4381fa000 tx=0x7ff428007d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:25.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.389+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4300570b0 con 0x7ff4380cc6f0 2024-09-13T15:08:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.629+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4381433d0 con 0x7ff4380cc6f0 2024-09-13T15:08:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.633+0000 7ff42f400700 1 -- 172.21.15.50:0/1279630500 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff430056c40 con 0x7ff4380cc6f0 2024-09-13T15:08:25.635 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:08:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff418066730 msgr2=0x7ff418068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff418066730 0x7ff418068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4381fa000 tx=0x7ff428007d90 comp rx=0 tx=0).stop 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 msgr2=0x7ff4381f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 0x7ff4381f6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4380b2c10 tx=0x7ff430004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 shutdown_connections 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff418066730 0x7ff418068bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4380cc6f0 0x7ff4381f6120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4380cb020 0x7ff43814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 --2- 172.21.15.50:0/1279630500 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff43806aaa0 0x7ff4381fab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 >> 172.21.15.50:0/1279630500 conn(0x7ff4380b0c40 msgr2=0x7ff438158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 shutdown_connections 2024-09-13T15:08:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:25.637+0000 7ff43ce00700 1 -- 172.21.15.50:0/1279630500 wait complete. 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:08:25.663 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T15:08:25.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.664 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:08:25.684 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:25.684 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:25.684 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:25.684 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:08:25.685 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42391sec preferred_lft 42391sec 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:08:25.686 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.687 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:08:25.687 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:08:25.687 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:08:25.687 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:25.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.688 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:08:25.763 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:08:25.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.766 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:08:25.827 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:08:25.828 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:08:25.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.829 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:25.829 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:25.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:08:25.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:08:25.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:08:25.830 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:25.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.962 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:08:25.974 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:08:25.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:25.975 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list-id 2024-09-13T15:08:26.031 INFO:teuthology.orchestra.run.smithi181.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T15:08:26.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.033 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:26.033 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:26.033 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:08:26.033 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T15:08:26.033 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:26.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.139 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.170 INFO:teuthology.orchestra.run.smithi181.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:08:26.171 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether f2:85:b0:19:46:c8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T15:08:26.171 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T15:08:26.171 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.171 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::f085:b0ff:fe19:46c8/64 scope link 2024-09-13T15:08:26.171 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.174 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T15:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:08:26.252 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.253 INFO:teuthology.orchestra.run.smithi181.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:08:26.253 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether f2:85:b0:19:46:c8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T15:08:26.253 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T15:08:26.253 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.253 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::f085:b0ff:fe19:46c8/64 scope link 2024-09-13T15:08:26.253 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:08:26.255 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T15:08:26.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T15:08:26.256 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:26.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.442 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:08:26.442 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:08:26.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.1 up 2024-09-13T15:08:26.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T15:08:26.442 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:08:26.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:26.509 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T15:08:26.523 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T15:08:26.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:08:26.523 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T15:08:26.581 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-13T15:08:26.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.581 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:26.709 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:26.709 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:26.734 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:08:26.734 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:08:26.735 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:08:26.735 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 3@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:08:26.735 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:08:26.741 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:08:26.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.741 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T15:08:26.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.768 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:26.838 INFO:teuthology.orchestra.run.smithi181.stdout:client4834 2024-09-13T15:08:26.839 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:26.839 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:26.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.896 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:26.965 INFO:teuthology.orchestra.run.smithi181.stdout:client4834 2024-09-13T15:08:26.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:26.966 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:08:27.033 INFO:teuthology.orchestra.run.smithi181.stdout:client4834 2024-09-13T15:08:27.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:27.034 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73923987-4656-4194-a4fe-9d4ec875d2d3.client4834/status') 2024-09-13T15:08:27.117 INFO:teuthology.orchestra.run.smithi181.stdout:instance: client.4834 (3)192.168.0.2:0/1842217299 2024-09-13T15:08:27.117 INFO:teuthology.orchestra.run.smithi181.stdout:blocklisted: false 2024-09-13T15:08:27.117 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records in 2024-09-13T15:08:27.117 INFO:teuthology.orchestra.run.smithi181.stderr:0+1 records out 2024-09-13T15:08:27.117 INFO:teuthology.orchestra.run.smithi181.stderr:69 bytes copied, 0.000143352 s, 481 kB/s 2024-09-13T15:08:27.120 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T15:08:27.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 Processor -- start 2024-09-13T15:08:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 -- start start 2024-09-13T15:08:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0e4c0b57c0 0x7f0e4c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e4c0b5ba0 0x7f0e4c13f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c06ae60 con 0x7f0e4c140050 2024-09-13T15:08:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c0cf7a0 con 0x7f0e4c0b5ba0 2024-09-13T15:08:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e52e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c13d9e0 con 0x7f0e4c0b57c0 2024-09-13T15:08:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e4b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e4c140050 0x7f0e4c13d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48092/0 (socket says 172.21.15.50:48092) 2024-09-13T15:08:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e4b400700 1 -- 172.21.15.50:0/4276582326 learned_addr learned my addr 172.21.15.50:0/4276582326 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e50e00700 1 --2- 172.21.15.50:0/4276582326 >> v2:172.21.15.50:3300/0 conn(0x7f0e4c0b5ba0 0x7f0e4c13f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.313+0000 7f0e4be00700 1 --2- 172.21.15.50:0/4276582326 >> v2:172.21.15.181:3300/0 conn(0x7f0e4c0b57c0 0x7f0e4c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e4aa00700 1 -- 172.21.15.50:0/4276582326 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936988617 0 0) 0x7f0e4c06ae60 con 0x7f0e4c140050 2024-09-13T15:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e4aa00700 1 -- 172.21.15.50:0/4276582326 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e300079e0 con 0x7f0e4c140050 2024-09-13T15:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e50e00700 1 -- 172.21.15.50:0/4276582326 >> v2:172.21.15.181:3300/0 conn(0x7f0e4c0b57c0 msgr2=0x7f0e4c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e50e00700 1 --2- 172.21.15.50:0/4276582326 >> v2:172.21.15.181:3300/0 conn(0x7f0e4c0b57c0 0x7f0e4c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e50e00700 1 -- 172.21.15.50:0/4276582326 >> v1:172.21.15.50:6789/0 conn(0x7f0e4c140050 legacy=0x7f0e4c13d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e50e00700 1 -- 172.21.15.50:0/4276582326 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c06a530 con 0x7f0e4c0b5ba0 2024-09-13T15:08:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e50e00700 1 --2- 172.21.15.50:0/4276582326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13f360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0721c0 tx=0x7f0e4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa17c9aff7192f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e4aa00700 1 -- 172.21.15.50:0/4276582326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400bd20 con 0x7f0e4c0b5ba0 2024-09-13T15:08:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e4aa00700 1 -- 172.21.15.50:0/4276582326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400be80 con 0x7f0e4c0b5ba0 2024-09-13T15:08:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e4aa00700 1 -- 172.21.15.50:0/4276582326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44014b10 con 0x7f0e4c0b5ba0 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 -- 172.21.15.50:0/4276582326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 msgr2=0x7f0e4c13f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 --2- 172.21.15.50:0/4276582326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13f360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0721c0 tx=0x7f0e4400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 -- 172.21.15.50:0/4276582326 shutdown_connections 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 --2- 172.21.15.50:0/4276582326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13f360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 --2- 172.21.15.50:0/4276582326 >> v2:172.21.15.181:3300/0 conn(0x7f0e4c0b57c0 0x7f0e4c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 -- 172.21.15.50:0/4276582326 >> 172.21.15.50:0/4276582326 conn(0x7f0e4c0b19d0 msgr2=0x7f0e4c0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 -- 172.21.15.50:0/4276582326 shutdown_connections 2024-09-13T15:08:27.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.317+0000 7f0e52e00700 1 -- 172.21.15.50:0/4276582326 wait complete. 2024-09-13T15:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 Processor -- start 2024-09-13T15:08:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 -- start start 2024-09-13T15:08:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e4c0b57c0 0x7f0e4c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e4c140050 0x7f0e4c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15b6d0 con 0x7f0e4c0b5ba0 2024-09-13T15:08:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15ce30 con 0x7f0e4c140050 2024-09-13T15:08:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e52e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15c070 con 0x7f0e4c0b57c0 2024-09-13T15:08:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e4b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e4b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53910/0 (socket says 172.21.15.50:53910) 2024-09-13T15:08:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e4b400700 1 -- 172.21.15.50:0/662269655 learned_addr learned my addr 172.21.15.50:0/662269655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e4c140050 0x7f0e4c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e4be00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e4c0b57c0 0x7f0e4c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 -- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e4c0b57c0 msgr2=0x7f0e4c14f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e4c0b57c0 0x7f0e4c14f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 -- 172.21.15.50:0/662269655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 msgr2=0x7f0e4c13c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 -- 172.21.15.50:0/662269655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44009a70 con 0x7f0e4c140050 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.321+0000 7f0e50e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e4c140050 0x7f0e4c150fa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e4401e000 tx=0x7f0e44004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:27.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44015ea0 con 0x7f0e4c140050 2024-09-13T15:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44004260 con 0x7f0e4c140050 2024-09-13T15:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004610 con 0x7f0e4c140050 2024-09-13T15:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c15c350 con 0x7f0e4c140050 2024-09-13T15:08:27.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c15c910 con 0x7f0e4c140050 2024-09-13T15:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c15c1b0 con 0x7f0e4c140050 2024-09-13T15:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.325+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e44004770 con 0x7f0e4c140050 2024-09-13T15:08:27.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.329+0000 7f0e43e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e2c066730 0x7f0e2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.329+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e4408e7d0 con 0x7f0e4c140050 2024-09-13T15:08:27.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.329+0000 7f0e4be00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e2c066730 0x7f0e2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.329+0000 7f0e4be00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e2c066730 0x7f0e2c068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00bc90 tx=0x7f0e3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.341+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e4c15c1b0 con 0x7f0e4c140050 2024-09-13T15:08:27.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.533+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e4c15c1b0 con 0x7f0e4c140050 2024-09-13T15:08:27.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.537+0000 7f0e43e00700 1 -- 172.21.15.50:0/662269655 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f0e4c15c1b0 con 0x7f0e4c140050 2024-09-13T15:08:27.540 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:27.540 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e2c066730 msgr2=0x7f0e2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e2c066730 0x7f0e2c068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00bc90 tx=0x7f0e3c008040 comp rx=0 tx=0).stop 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e4c140050 msgr2=0x7f0e4c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e4c140050 0x7f0e4c150fa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e4401e000 tx=0x7f0e44004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 shutdown_connections 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0e2c066730 0x7f0e2c068bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e4c140050 0x7f0e4c150fa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4c0b5ba0 0x7f0e4c13c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 --2- 172.21.15.50:0/662269655 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0e4c0b57c0 0x7f0e4c14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 >> 172.21.15.50:0/662269655 conn(0x7f0e4c0b19d0 msgr2=0x7f0e4c13f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 shutdown_connections 2024-09-13T15:08:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.541+0000 7f0e52e00700 1 -- 172.21.15.50:0/662269655 wait complete. 2024-09-13T15:08:27.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:27.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.745+0000 7fac61400700 1 Processor -- start 2024-09-13T15:08:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.745+0000 7fac61400700 1 -- start start 2024-09-13T15:08:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac61400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c1464c0 0x7fac5c071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac61400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c070da0 con 0x7fac5c0b1980 2024-09-13T15:08:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac61400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0b2440 con 0x7fac5c06d070 2024-09-13T15:08:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac61400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0b2720 con 0x7fac5c1464c0 2024-09-13T15:08:27.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c1464c0 0x7fac5c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fac5c0b1980 0x7fac5c06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48100/0 (socket says 172.21.15.50:48100) 2024-09-13T15:08:27.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5b400700 1 -- 172.21.15.50:0/1794001083 learned_addr learned my addr 172.21.15.50:0/1794001083 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5be00700 1 -- 172.21.15.50:0/1794001083 >> v1:172.21.15.181:6789/0 conn(0x7fac5c06d070 legacy=0x7fac5c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5be00700 1 -- 172.21.15.50:0/1794001083 >> v1:172.21.15.50:6789/0 conn(0x7fac5c0b1980 legacy=0x7fac5c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5be00700 1 -- 172.21.15.50:0/1794001083 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c071060 con 0x7fac5c1464c0 2024-09-13T15:08:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5aa00700 1 -- 172.21.15.50:0/1794001083 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064528834 0 0) 0x7fac5c070da0 con 0x7fac5c0b1980 2024-09-13T15:08:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.749+0000 7fac5be00700 1 --2- 172.21.15.50:0/1794001083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c1464c0 0x7fac5c071860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009880 tx=0x7fac4c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a66147b9e2c062 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac5aa00700 1 -- 172.21.15.50:0/1794001083 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011830 con 0x7fac5c1464c0 2024-09-13T15:08:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac5aa00700 1 -- 172.21.15.50:0/1794001083 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c011990 con 0x7fac5c1464c0 2024-09-13T15:08:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac5aa00700 1 -- 172.21.15.50:0/1794001083 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011d20 con 0x7fac5c1464c0 2024-09-13T15:08:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 -- 172.21.15.50:0/1794001083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c1464c0 msgr2=0x7fac5c071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 --2- 172.21.15.50:0/1794001083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c1464c0 0x7fac5c071860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009880 tx=0x7fac4c009b90 comp rx=0 tx=0).stop 2024-09-13T15:08:27.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 -- 172.21.15.50:0/1794001083 shutdown_connections 2024-09-13T15:08:27.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 --2- 172.21.15.50:0/1794001083 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c1464c0 0x7fac5c071860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 -- 172.21.15.50:0/1794001083 >> 172.21.15.50:0/1794001083 conn(0x7fac5c06a390 msgr2=0x7fac5c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:27.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 -- 172.21.15.50:0/1794001083 shutdown_connections 2024-09-13T15:08:27.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.753+0000 7fac61400700 1 -- 172.21.15.50:0/1794001083 wait complete. 2024-09-13T15:08:27.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 Processor -- start 2024-09-13T15:08:27.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 -- start start 2024-09-13T15:08:27.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c06d070 0x7fac5c13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac5c0b1980 0x7fac5c13d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 0x7fac5c0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c140690 con 0x7fac5c1464c0 2024-09-13T15:08:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c13fa10 con 0x7fac5c0b1980 2024-09-13T15:08:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac61400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c13fcf0 con 0x7fac5c06d070 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 0x7fac5c0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 0x7fac5c0cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53926/0 (socket says 172.21.15.50:53926) 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 -- 172.21.15.50:0/1776490612 learned_addr learned my addr 172.21.15.50:0/1776490612 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac5b400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac5c0b1980 0x7fac5c13d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac5be00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c06d070 0x7fac5c13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 -- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c06d070 msgr2=0x7fac5c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c06d070 0x7fac5c13e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 -- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac5c0b1980 msgr2=0x7fac5c13d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac5c0b1980 0x7fac5c13d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.757+0000 7fac60a00700 1 -- 172.21.15.50:0/1776490612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0094b0 con 0x7fac5c1464c0 2024-09-13T15:08:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac60a00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 0x7fac5c0cc7c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac5400cbc0 tx=0x7fac5400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54003c20 con 0x7fac5c1464c0 2024-09-13T15:08:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54003d80 con 0x7fac5c1464c0 2024-09-13T15:08:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c13ffd0 con 0x7fac5c1464c0 2024-09-13T15:08:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400aa20 con 0x7fac5c1464c0 2024-09-13T15:08:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c13e8e0 con 0x7fac5c1464c0 2024-09-13T15:08:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.761+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c071860 con 0x7fac5c1464c0 2024-09-13T15:08:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.765+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac5400ab80 con 0x7fac5c1464c0 2024-09-13T15:08:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.765+0000 7fac53e00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac3c066730 0x7fac3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.765+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac54084440 con 0x7fac5c1464c0 2024-09-13T15:08:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.765+0000 7fac5be00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac3c066730 0x7fac3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.769+0000 7fac5be00700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac3c066730 0x7fac3c068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0097d0 tx=0x7fac4c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:27.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.773+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac54051350 con 0x7fac5c1464c0 2024-09-13T15:08:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.953+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac5c0b1e60 con 0x7fac5c1464c0 2024-09-13T15:08:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac53e00700 1 -- 172.21.15.50:0/1776490612 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac54054970 con 0x7fac5c1464c0 2024-09-13T15:08:27.959 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac3c066730 msgr2=0x7fac3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac3c066730 0x7fac3c068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0097d0 tx=0x7fac4c008030 comp rx=0 tx=0).stop 2024-09-13T15:08:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 msgr2=0x7fac5c0cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 0x7fac5c0cc7c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac5400cbc0 tx=0x7fac5400ced0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 shutdown_connections 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac3c066730 0x7fac3c068bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac5c1464c0 0x7fac5c0cc7c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac5c0b1980 0x7fac5c13d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 --2- 172.21.15.50:0/1776490612 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac5c06d070 0x7fac5c13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 >> 172.21.15.50:0/1776490612 conn(0x7fac5c06a390 msgr2=0x7fac5c0cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:27.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 shutdown_connections 2024-09-13T15:08:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:27.957+0000 7fac61400700 1 -- 172.21.15.50:0/1776490612 wait complete. 2024-09-13T15:08:27.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.161+0000 7fe3d3e00700 1 Processor -- start 2024-09-13T15:08:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.161+0000 7fe3d3e00700 1 -- start start 2024-09-13T15:08:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3d406b3a0 0x7fe3d40cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d4072200 0x7fe3d415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d4071160 con 0x7fe3d4070ca0 2024-09-13T15:08:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d4071440 con 0x7fe3d406b3a0 2024-09-13T15:08:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4071720 con 0x7fe3d4072200 2024-09-13T15:08:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d4072200 0x7fe3d415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d2a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3d406b3a0 0x7fe3d40cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d4072200 0x7fe3d415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35942/0 (socket says 172.21.15.50:35942) 2024-09-13T15:08:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d3400700 1 -- 172.21.15.50:0/3946111166 learned_addr learned my addr 172.21.15.50:0/3946111166 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d2a00700 1 -- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d4072200 msgr2=0x7fe3d415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d2a00700 1 --2- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d4072200 0x7fe3d415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d2a00700 1 -- 172.21.15.50:0/3946111166 >> v1:172.21.15.181:6789/0 conn(0x7fe3d4070ca0 legacy=0x7fe3d406b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d2a00700 1 -- 172.21.15.50:0/3946111166 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4071a00 con 0x7fe3d406b3a0 2024-09-13T15:08:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.165+0000 7fe3d1600700 1 -- 172.21.15.50:0/3946111166 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753949132 0 0) 0x7fe3d4071160 con 0x7fe3d4070ca0 2024-09-13T15:08:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d2a00700 1 --2- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d406b3a0 0x7fe3d40cd4c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009850 tx=0x7fe3c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba49509edd75773c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:28.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d1600700 1 -- 172.21.15.50:0/3946111166 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4011830 con 0x7fe3d406b3a0 2024-09-13T15:08:28.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d1600700 1 -- 172.21.15.50:0/3946111166 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c4011990 con 0x7fe3d406b3a0 2024-09-13T15:08:28.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d1600700 1 -- 172.21.15.50:0/3946111166 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4011d40 con 0x7fe3d406b3a0 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 -- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d406b3a0 msgr2=0x7fe3d40cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d406b3a0 0x7fe3d40cd4c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009850 tx=0x7fe3c4009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 -- 172.21.15.50:0/3946111166 shutdown_connections 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d4072200 0x7fe3d415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/3946111166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d406b3a0 0x7fe3d40cd4c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 -- 172.21.15.50:0/3946111166 >> 172.21.15.50:0/3946111166 conn(0x7fe3d406c9b0 msgr2=0x7fe3d406cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 -- 172.21.15.50:0/3946111166 shutdown_connections 2024-09-13T15:08:28.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.169+0000 7fe3d3e00700 1 -- 172.21.15.50:0/3946111166 wait complete. 2024-09-13T15:08:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 Processor -- start 2024-09-13T15:08:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 -- start start 2024-09-13T15:08:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 0x7fe3d413c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d4070ca0 0x7fe3d413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d4072200 0x7fe3d40c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4143ad0 con 0x7fe3d4072200 2024-09-13T15:08:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4142ec0 con 0x7fe3d4070ca0 2024-09-13T15:08:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.173+0000 7fe3d3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41431a0 con 0x7fe3d406b3a0 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d3400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d4072200 0x7fe3d40c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 0x7fe3d413c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 0x7fe3d413c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35952/0 (socket says 172.21.15.50:35952) 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 -- 172.21.15.50:0/2057301513 learned_addr learned my addr 172.21.15.50:0/2057301513 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2000700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d4070ca0 0x7fe3d413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 -- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d4070ca0 msgr2=0x7fe3d413dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d4070ca0 0x7fe3d413dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 -- 172.21.15.50:0/2057301513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d4072200 msgr2=0x7fe3d40c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d4072200 0x7fe3d40c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 -- 172.21.15.50:0/2057301513 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40094b0 con 0x7fe3d406b3a0 2024-09-13T15:08:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d3400700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d4072200 0x7fe3d40c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d2a00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 0x7fe3d413c2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4000c00 tx=0x7fe3c4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c401a990 con 0x7fe3d406b3a0 2024-09-13T15:08:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c401f070 con 0x7fe3d406b3a0 2024-09-13T15:08:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c401ad30 con 0x7fe3d406b3a0 2024-09-13T15:08:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d4143480 con 0x7fe3d406b3a0 2024-09-13T15:08:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.177+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d413c820 con 0x7fe3d406b3a0 2024-09-13T15:08:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.181+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d4072a10 con 0x7fe3d406b3a0 2024-09-13T15:08:28.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.181+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3c401b430 con 0x7fe3d406b3a0 2024-09-13T15:08:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.181+0000 7fe3caa00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3b4066730 0x7fe3b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.181+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3c4085ed0 con 0x7fe3d406b3a0 2024-09-13T15:08:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.185+0000 7fe3d2000700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3b4066730 0x7fe3b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.185+0000 7fe3d2000700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3b4066730 0x7fe3b4068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3d406d300 tx=0x7fe3c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:28.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.189+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3c4052ef0 con 0x7fe3d406b3a0 2024-09-13T15:08:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.373+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3d41432e0 con 0x7fe3d406b3a0 2024-09-13T15:08:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3caa00700 1 -- 172.21.15.50:0/2057301513 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3d41432e0 con 0x7fe3d406b3a0 2024-09-13T15:08:28.378 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3b4066730 msgr2=0x7fe3b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3b4066730 0x7fe3b4068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3d406d300 tx=0x7fe3c0009040 comp rx=0 tx=0).stop 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 msgr2=0x7fe3d413c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 0x7fe3d413c2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4000c00 tx=0x7fe3c4004770 comp rx=0 tx=0).stop 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 shutdown_connections 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3b4066730 0x7fe3b4068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3d4072200 0x7fe3d40c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d4070ca0 0x7fe3d413dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 --2- 172.21.15.50:0/2057301513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3d406b3a0 0x7fe3d413c2e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 >> 172.21.15.50:0/2057301513 conn(0x7fe3d406c9b0 msgr2=0x7fe3d40adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 shutdown_connections 2024-09-13T15:08:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.377+0000 7fe3d3e00700 1 -- 172.21.15.50:0/2057301513 wait complete. 2024-09-13T15:08:28.402 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.573+0000 7fa441400700 1 Processor -- start 2024-09-13T15:08:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.577+0000 7fa441400700 1 -- start start 2024-09-13T15:08:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.577+0000 7fa441400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.577+0000 7fa441400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa43c15abc0 0x7fa43c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.577+0000 7fa441400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c06b940 con 0x7fa43c15a7e0 2024-09-13T15:08:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.577+0000 7fa441400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c15e6b0 con 0x7fa43c15abc0 2024-09-13T15:08:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.577+0000 7fa441400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c15e990 con 0x7fa43c0b1f50 2024-09-13T15:08:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa43c15a7e0 0x7fa43c0b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48104/0 (socket says 172.21.15.50:48104) 2024-09-13T15:08:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43be00700 1 -- 172.21.15.50:0/2187448133 learned_addr learned my addr 172.21.15.50:0/2187448133 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43b400700 1 --2- 172.21.15.50:0/2187448133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa440a00700 1 --2- 172.21.15.50:0/2187448133 >> v2:172.21.15.181:3300/0 conn(0x7fa43c15abc0 0x7fa43c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43aa00700 1 -- 172.21.15.50:0/2187448133 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012122138 0 0) 0x7fa43c06b940 con 0x7fa43c15a7e0 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43aa00700 1 -- 172.21.15.50:0/2187448133 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4200035d0 con 0x7fa43c15a7e0 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43b400700 1 -- 172.21.15.50:0/2187448133 >> v2:172.21.15.181:3300/0 conn(0x7fa43c15abc0 msgr2=0x7fa43c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43b400700 1 --2- 172.21.15.50:0/2187448133 >> v2:172.21.15.181:3300/0 conn(0x7fa43c15abc0 0x7fa43c0ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43b400700 1 -- 172.21.15.50:0/2187448133 >> v1:172.21.15.50:6789/0 conn(0x7fa43c15a7e0 legacy=0x7fa43c0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43aa00700 1 -- 172.21.15.50:0/2187448133 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 642920317 0 0) 0x7fa4200035d0 con 0x7fa43c15a7e0 2024-09-13T15:08:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43b400700 1 -- 172.21.15.50:0/2187448133 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c15ec70 con 0x7fa43c0b1f50 2024-09-13T15:08:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43b400700 1 --2- 172.21.15.50:0/2187448133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c0cdb80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa428009850 tx=0x7fa428009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0c910b7fdb8fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43aa00700 1 -- 172.21.15.50:0/2187448133 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c001690 con 0x7fa43c0b1f50 2024-09-13T15:08:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43aa00700 1 -- 172.21.15.50:0/2187448133 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428004030 con 0x7fa43c0b1f50 2024-09-13T15:08:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa43aa00700 1 -- 172.21.15.50:0/2187448133 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4280043e0 con 0x7fa43c0b1f50 2024-09-13T15:08:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa441400700 1 -- 172.21.15.50:0/2187448133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 msgr2=0x7fa43c0cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.581+0000 7fa441400700 1 --2- 172.21.15.50:0/2187448133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c0cdb80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa428009850 tx=0x7fa428009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 -- 172.21.15.50:0/2187448133 shutdown_connections 2024-09-13T15:08:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 --2- 172.21.15.50:0/2187448133 >> v2:172.21.15.181:3300/0 conn(0x7fa43c15abc0 0x7fa43c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 --2- 172.21.15.50:0/2187448133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c0cdb80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 -- 172.21.15.50:0/2187448133 >> 172.21.15.50:0/2187448133 conn(0x7fa43c06cb90 msgr2=0x7fa43c06cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 -- 172.21.15.50:0/2187448133 shutdown_connections 2024-09-13T15:08:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 -- 172.21.15.50:0/2187448133 wait complete. 2024-09-13T15:08:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 Processor -- start 2024-09-13T15:08:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.585+0000 7fa441400700 1 -- start start 2024-09-13T15:08:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa43c15a7e0 0x7fa43c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 0x7fa43c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c14e8d0 con 0x7fa43c15abc0 2024-09-13T15:08:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c14d830 con 0x7fa43c15a7e0 2024-09-13T15:08:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c15c520 con 0x7fa43c0b1f50 2024-09-13T15:08:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 0x7fa43c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 0x7fa43c155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53944/0 (socket says 172.21.15.50:53944) 2024-09-13T15:08:28.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 -- 172.21.15.50:0/2678888315 learned_addr learned my addr 172.21.15.50:0/2678888315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:28.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa43b400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa43c15a7e0 0x7fa43c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa43be00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 -- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 msgr2=0x7fa43c14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 -- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa43c15a7e0 msgr2=0x7fa43c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa43c15a7e0 0x7fa43c15d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 -- 172.21.15.50:0/2678888315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4280094b0 con 0x7fa43c15abc0 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa43b400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa43c15a7e0 0x7fa43c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa440a00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 0x7fa43c155390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa43400efc0 tx=0x7fa43400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400cad0 con 0x7fa43c15abc0 2024-09-13T15:08:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400f040 con 0x7fa43c15abc0 2024-09-13T15:08:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400ce70 con 0x7fa43c15abc0 2024-09-13T15:08:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c15c800 con 0x7fa43c15abc0 2024-09-13T15:08:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.589+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c15cdc0 con 0x7fa43c15abc0 2024-09-13T15:08:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.593+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c14ea40 con 0x7fa43c15abc0 2024-09-13T15:08:28.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.593+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa434014480 con 0x7fa43c15abc0 2024-09-13T15:08:28.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.597+0000 7fa433e00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa41c066730 0x7fa41c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.597+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa434084d70 con 0x7fa43c15abc0 2024-09-13T15:08:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.597+0000 7fa43be00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa41c066730 0x7fa41c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.597+0000 7fa43be00700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa41c066730 0x7fa41c068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa42c001200 tx=0x7fa42c001730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:28.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.605+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa434051d30 con 0x7fa43c15abc0 2024-09-13T15:08:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.785+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa43c0672a0 con 0x7fa43c15abc0 2024-09-13T15:08:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.785+0000 7fa433e00700 1 -- 172.21.15.50:0/2678888315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa434018020 con 0x7fa43c15abc0 2024-09-13T15:08:28.789 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa41c066730 msgr2=0x7fa41c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa41c066730 0x7fa41c068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa42c001200 tx=0x7fa42c001730 comp rx=0 tx=0).stop 2024-09-13T15:08:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 msgr2=0x7fa43c155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 0x7fa43c155390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa43400efc0 tx=0x7fa43400c0c0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 shutdown_connections 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa41c066730 0x7fa41c068bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa43c15abc0 0x7fa43c155390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa43c15a7e0 0x7fa43c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 --2- 172.21.15.50:0/2678888315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa43c0b1f50 0x7fa43c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 >> 172.21.15.50:0/2678888315 conn(0x7fa43c06cb90 msgr2=0x7fa43c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 shutdown_connections 2024-09-13T15:08:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.789+0000 7fa441400700 1 -- 172.21.15.50:0/2678888315 wait complete. 2024-09-13T15:08:28.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 Processor -- start 2024-09-13T15:08:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 -- start start 2024-09-13T15:08:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c06dfb0 0x7f8b6c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b6c072000 0x7f8b6c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c0b1c20 con 0x7f8b6c070a40 2024-09-13T15:08:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b3c90 con 0x7f8b6c072000 2024-09-13T15:08:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b2030 con 0x7f8b6c06dfb0 2024-09-13T15:08:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6a800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b6c072000 0x7f8b6c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b69e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c06dfb0 0x7f8b6c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:28.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6a800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b6c072000 0x7f8b6c159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48540/0 (socket says 172.21.15.50:48540) 2024-09-13T15:08:28.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b6a800700 1 -- 172.21.15.50:0/1750387789 learned_addr learned my addr 172.21.15.50:0/1750387789 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:28.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.993+0000 7f8b69e00700 1 --2- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c06dfb0 0x7f8b6c15db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:35994/0 (socket says 172.21.15.50:35994) 2024-09-13T15:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6a800700 1 -- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c06dfb0 msgr2=0x7f8b6c15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6a800700 1 --2- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c06dfb0 0x7f8b6c15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6a800700 1 -- 172.21.15.50:0/1750387789 >> v1:172.21.15.181:6789/0 conn(0x7f8b6c070a40 legacy=0x7f8b6c0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6a800700 1 -- 172.21.15.50:0/1750387789 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0b2800 con 0x7f8b6c072000 2024-09-13T15:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b69400700 1 -- 172.21.15.50:0/1750387789 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270539467 0 0) 0x7f8b6c0b1c20 con 0x7f8b6c070a40 2024-09-13T15:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6a800700 1 --2- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c072000 0x7f8b6c159ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009e50 tx=0x7f8b6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa3fea2feb75ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b69400700 1 -- 172.21.15.50:0/1750387789 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400e070 con 0x7f8b6c072000 2024-09-13T15:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b69400700 1 -- 172.21.15.50:0/1750387789 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6400b910 con 0x7f8b6c072000 2024-09-13T15:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b69400700 1 -- 172.21.15.50:0/1750387789 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400bcc0 con 0x7f8b6c072000 2024-09-13T15:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 -- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c072000 msgr2=0x7f8b6c159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c072000 0x7f8b6c159ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009e50 tx=0x7f8b6400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 -- 172.21.15.50:0/1750387789 shutdown_connections 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c072000 0x7f8b6c159ca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1750387789 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c06dfb0 0x7f8b6c15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 -- 172.21.15.50:0/1750387789 >> 172.21.15.50:0/1750387789 conn(0x7f8b6c0b4770 msgr2=0x7f8b6c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 -- 172.21.15.50:0/1750387789 shutdown_connections 2024-09-13T15:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:28.997+0000 7f8b6b200700 1 -- 172.21.15.50:0/1750387789 wait complete. 2024-09-13T15:08:29.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.001+0000 7f8b6b200700 1 Processor -- start 2024-09-13T15:08:29.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.001+0000 7f8b6b200700 1 -- start start 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 0x7f8b6c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c070a40 0x7f8b6c14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c072000 0x7f8b6c1e8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c156980 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c157500 con 0x7f8b6c070a40 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c153260 con 0x7f8b6c072000 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 0x7f8b6c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 0x7f8b6c0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53948/0 (socket says 172.21.15.50:53948) 2024-09-13T15:08:29.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 -- 172.21.15.50:0/1589062546 learned_addr learned my addr 172.21.15.50:0/1589062546 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b61400700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c070a40 0x7f8b6c14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6a800700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c072000 0x7f8b6c1e8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 -- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c072000 msgr2=0x7f8b6c1e8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c072000 0x7f8b6c1e8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 -- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c070a40 msgr2=0x7f8b6c14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c070a40 0x7f8b6c14fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 -- 172.21.15.50:0/1589062546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64009b30 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6a800700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c072000 0x7f8b6c1e8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b69e00700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 0x7f8b6c0b0d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00ea00 tx=0x7f8b5c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c009720 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00c850 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00cbc0 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c0b1250 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.005+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c156e40 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.009+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c0b43a0 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.009+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b5c00cd20 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.013+0000 7f8b62a00700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b48066730 0x7f8b48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.013+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b5c0846b0 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.013+0000 7f8b61400700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b48066730 0x7f8b48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.017+0000 7f8b61400700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b48066730 0x7f8b48068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c159e90 tx=0x7f8b54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.017+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b5c0515d0 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.197+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8b6c0b1a00 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.201+0000 7f8b62a00700 1 -- 172.21.15.50:0/1589062546 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b5c054bf0 con 0x7f8b6c06dfb0 2024-09-13T15:08:29.203 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.201+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b48066730 msgr2=0x7f8b48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.201+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b48066730 0x7f8b48068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c159e90 tx=0x7f8b54009040 comp rx=0 tx=0).stop 2024-09-13T15:08:29.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.201+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 msgr2=0x7f8b6c0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.201+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 0x7f8b6c0b0d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00ea00 tx=0x7f8b5c00edc0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 shutdown_connections 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b48066730 0x7f8b48068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b6c072000 0x7f8b6c1e8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b6c070a40 0x7f8b6c14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 --2- 172.21.15.50:0/1589062546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b6c06dfb0 0x7f8b6c0b0d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 >> 172.21.15.50:0/1589062546 conn(0x7f8b6c0b4770 msgr2=0x7f8b6c0ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 shutdown_connections 2024-09-13T15:08:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.205+0000 7f8b6b200700 1 -- 172.21.15.50:0/1589062546 wait complete. 2024-09-13T15:08:29.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.405+0000 7fb1ef200700 1 Processor -- start 2024-09-13T15:08:29.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.405+0000 7fb1ef200700 1 -- start start 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ef200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb1f006aaa0 0x7fb1f015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ef200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1f015e9f0 0x7fb1f015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ef200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f015e560 con 0x7fb1f00b3980 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ef200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00adf90 con 0x7fb1f015e9f0 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ef200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f015d920 con 0x7fb1f006aaa0 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ee800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1f015e9f0 0x7fb1f015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ee800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1f015e9f0 0x7fb1f015ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53958/0 (socket says 172.21.15.50:53958) 2024-09-13T15:08:29.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ee800700 1 -- 172.21.15.50:0/3689278257 learned_addr learned my addr 172.21.15.50:0/3689278257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:29.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ede00700 1 --2- 172.21.15.50:0/3689278257 >> v2:172.21.15.181:3300/0 conn(0x7fb1f006aaa0 0x7fb1f015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ee800700 1 -- 172.21.15.50:0/3689278257 >> v2:172.21.15.181:3300/0 conn(0x7fb1f006aaa0 msgr2=0x7fb1f015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:29.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.409+0000 7fb1ee800700 1 --2- 172.21.15.50:0/3689278257 >> v2:172.21.15.181:3300/0 conn(0x7fb1f006aaa0 0x7fb1f015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ee800700 1 -- 172.21.15.50:0/3689278257 >> v1:172.21.15.181:6789/0 conn(0x7fb1f00b3980 legacy=0x7fb1f006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:29.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ee800700 1 -- 172.21.15.50:0/3689278257 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f015dc00 con 0x7fb1f015e9f0 2024-09-13T15:08:29.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ee800700 1 --2- 172.21.15.50:0/3689278257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f015ee80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00ad490 tx=0x7fb1e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd91d2858ae48e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ed400700 1 -- 172.21.15.50:0/3689278257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800e070 con 0x7fb1f015e9f0 2024-09-13T15:08:29.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ed400700 1 -- 172.21.15.50:0/3689278257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8003a40 con 0x7fb1f015e9f0 2024-09-13T15:08:29.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ed400700 1 -- 172.21.15.50:0/3689278257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8003df0 con 0x7fb1f015e9f0 2024-09-13T15:08:29.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 -- 172.21.15.50:0/3689278257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 msgr2=0x7fb1f015ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 --2- 172.21.15.50:0/3689278257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f015ee80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00ad490 tx=0x7fb1e800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:29.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 -- 172.21.15.50:0/3689278257 shutdown_connections 2024-09-13T15:08:29.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 --2- 172.21.15.50:0/3689278257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f015ee80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 --2- 172.21.15.50:0/3689278257 >> v2:172.21.15.181:3300/0 conn(0x7fb1f006aaa0 0x7fb1f015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 -- 172.21.15.50:0/3689278257 >> 172.21.15.50:0/3689278257 conn(0x7fb1f00b0c40 msgr2=0x7fb1f006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:29.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 -- 172.21.15.50:0/3689278257 shutdown_connections 2024-09-13T15:08:29.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.413+0000 7fb1ef200700 1 -- 172.21.15.50:0/3689278257 wait complete. 2024-09-13T15:08:29.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 Processor -- start 2024-09-13T15:08:29.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 -- start start 2024-09-13T15:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1f006aaa0 0x7fb1f01e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1f00b3980 0x7fb1f015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f01f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01e8c90 con 0x7fb1f015e9f0 2024-09-13T15:08:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01e86d0 con 0x7fb1f006aaa0 2024-09-13T15:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ef200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01e89b0 con 0x7fb1f00b3980 2024-09-13T15:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f01f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f01f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53968/0 (socket says 172.21.15.50:53968) 2024-09-13T15:08:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 -- 172.21.15.50:0/4204623616 learned_addr learned my addr 172.21.15.50:0/4204623616 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ede00700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1f006aaa0 0x7fb1f01e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1e5400700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1f00b3980 0x7fb1f015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 -- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1f00b3980 msgr2=0x7fb1f015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1f00b3980 0x7fb1f015c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 -- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1f006aaa0 msgr2=0x7fb1f01e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1f006aaa0 0x7fb1f01e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.417+0000 7fb1ee800700 1 -- 172.21.15.50:0/4204623616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8009b30 con 0x7fb1f015e9f0 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1ee800700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f01f6090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b370 tx=0x7fb1e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8004240 con 0x7fb1f015e9f0 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80043a0 con 0x7fb1f015e9f0 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f0143910 con 0x7fb1f015e9f0 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8004750 con 0x7fb1f015e9f0 2024-09-13T15:08:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f015cc20 con 0x7fb1f015e9f0 2024-09-13T15:08:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.421+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f00b3da0 con 0x7fb1f015e9f0 2024-09-13T15:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.425+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1e8019070 con 0x7fb1f015e9f0 2024-09-13T15:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.425+0000 7fb1e6a00700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1cc066730 0x7fb1cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.425+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb1e8085480 con 0x7fb1f015e9f0 2024-09-13T15:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.425+0000 7fb1ede00700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1cc066730 0x7fb1cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.425+0000 7fb1ede00700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1cc066730 0x7fb1cc068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009950 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.429+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1f00b3da0 con 0x7fb1f015e9f0 2024-09-13T15:08:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.633+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1f0143e30 con 0x7fb1f015e9f0 2024-09-13T15:08:29.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.637+0000 7fb1e6a00700 1 -- 172.21.15.50:0/4204623616 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fb1f0143e30 con 0x7fb1f015e9f0 2024-09-13T15:08:29.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:29.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1cc066730 msgr2=0x7fb1cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1cc066730 0x7fb1cc068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009950 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2024-09-13T15:08:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 msgr2=0x7fb1f01f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f01f6090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b370 tx=0x7fb1e8004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 shutdown_connections 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1cc066730 0x7fb1cc068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015e9f0 0x7fb1f01f6090 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1f00b3980 0x7fb1f015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 --2- 172.21.15.50:0/4204623616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1f006aaa0 0x7fb1f01e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 >> 172.21.15.50:0/4204623616 conn(0x7fb1f00b0c40 msgr2=0x7fb1f006d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 shutdown_connections 2024-09-13T15:08:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.641+0000 7fb1ef200700 1 -- 172.21.15.50:0/4204623616 wait complete. 2024-09-13T15:08:29.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:29.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:29.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.857+0000 7f276fe00700 1 Processor -- start 2024-09-13T15:08:29.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.857+0000 7f276fe00700 1 -- start start 2024-09-13T15:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27700b5320 0x7f277015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f277006b3a0 0x7f277006b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276fe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27700b3330 con 0x7f2770159740 2024-09-13T15:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276fe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277006bd90 con 0x7f27700b5320 2024-09-13T15:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276fe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277015e280 con 0x7f277006b3a0 2024-09-13T15:08:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276ea00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2770159740 0x7f27700b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48110/0 (socket says 172.21.15.50:48110) 2024-09-13T15:08:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276e000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27700b5320 0x7f277015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276ea00700 1 -- 172.21.15.50:0/1890096369 learned_addr learned my addr 172.21.15.50:0/1890096369 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276f400700 1 --2- 172.21.15.50:0/1890096369 >> v2:172.21.15.181:3300/0 conn(0x7f277006b3a0 0x7f277006b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276d600700 1 -- 172.21.15.50:0/1890096369 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794561709 0 0) 0x7f27700b3330 con 0x7f2770159740 2024-09-13T15:08:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276d600700 1 -- 172.21.15.50:0/1890096369 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27540035d0 con 0x7f2770159740 2024-09-13T15:08:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276e000700 1 -- 172.21.15.50:0/1890096369 >> v2:172.21.15.181:3300/0 conn(0x7f277006b3a0 msgr2=0x7f277006b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276e000700 1 --2- 172.21.15.50:0/1890096369 >> v2:172.21.15.181:3300/0 conn(0x7f277006b3a0 0x7f277006b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276e000700 1 -- 172.21.15.50:0/1890096369 >> v1:172.21.15.50:6789/0 conn(0x7f2770159740 legacy=0x7f27700b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276e000700 1 -- 172.21.15.50:0/1890096369 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700b3610 con 0x7f27700b5320 2024-09-13T15:08:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276f400700 1 --2- 172.21.15.50:0/1890096369 >> v2:172.21.15.181:3300/0 conn(0x7f277006b3a0 0x7f277006b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276e000700 1 --2- 172.21.15.50:0/1890096369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27700b5320 0x7f277015dd40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27700cd470 tx=0x7f275c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f5b4d9f2c6c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.861+0000 7f276d600700 1 -- 172.21.15.50:0/1890096369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011830 con 0x7f27700b5320 2024-09-13T15:08:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276d600700 1 -- 172.21.15.50:0/1890096369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c011990 con 0x7f27700b5320 2024-09-13T15:08:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276d600700 1 -- 172.21.15.50:0/1890096369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011d20 con 0x7f27700b5320 2024-09-13T15:08:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 -- 172.21.15.50:0/1890096369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27700b5320 msgr2=0x7f277015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 --2- 172.21.15.50:0/1890096369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27700b5320 0x7f277015dd40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27700cd470 tx=0x7f275c009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 -- 172.21.15.50:0/1890096369 shutdown_connections 2024-09-13T15:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 --2- 172.21.15.50:0/1890096369 >> v2:172.21.15.181:3300/0 conn(0x7f277006b3a0 0x7f277006b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 --2- 172.21.15.50:0/1890096369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27700b5320 0x7f277015dd40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 -- 172.21.15.50:0/1890096369 >> 172.21.15.50:0/1890096369 conn(0x7f277006c9b0 msgr2=0x7f277006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 -- 172.21.15.50:0/1890096369 shutdown_connections 2024-09-13T15:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.865+0000 7f276fe00700 1 -- 172.21.15.50:0/1890096369 wait complete. 2024-09-13T15:08:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 Processor -- start 2024-09-13T15:08:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 -- start start 2024-09-13T15:08:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f277006b3a0 0x7f2770148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27700b5320 0x7f2770150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 0x7f27700cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277013af50 con 0x7f2770159740 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27701501f0 con 0x7f277006b3a0 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276fe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277014f900 con 0x7f27700b5320 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 0x7f27700cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 0x7f27700cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53978/0 (socket says 172.21.15.50:53978) 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 -- 172.21.15.50:0/787475315 learned_addr learned my addr 172.21.15.50:0/787475315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276ea00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f277006b3a0 0x7f2770148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276e000700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27700b5320 0x7f2770150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 -- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27700b5320 msgr2=0x7f2770150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27700b5320 0x7f2770150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 -- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f277006b3a0 msgr2=0x7f2770148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f277006b3a0 0x7f2770148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 -- 172.21.15.50:0/787475315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768009a70 con 0x7f2770159740 2024-09-13T15:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.869+0000 7f276f400700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 0x7f27700cdc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f276800efc0 tx=0x7f276800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768009d70 con 0x7f2770159740 2024-09-13T15:08:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c0094b0 con 0x7f2770159740 2024-09-13T15:08:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800f040 con 0x7f2770159740 2024-09-13T15:08:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800ce00 con 0x7f2770159740 2024-09-13T15:08:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277014fba0 con 0x7f2770159740 2024-09-13T15:08:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27700672a0 con 0x7f2770159740 2024-09-13T15:08:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.873+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2768014480 con 0x7f2770159740 2024-09-13T15:08:29.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.877+0000 7f2766a00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2750066730 0x7f2750068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:29.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.877+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2768084d50 con 0x7f2770159740 2024-09-13T15:08:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.877+0000 7f276ea00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2750066730 0x7f2750068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.877+0000 7f276ea00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2750066730 0x7f2750068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27600011e0 tx=0x7f2760009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:29.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:29.881+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2768051be0 con 0x7f2770159740 2024-09-13T15:08:30.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.061+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2770150360 con 0x7f2770159740 2024-09-13T15:08:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.061+0000 7f2766a00700 1 -- 172.21.15.50:0/787475315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2768055200 con 0x7f2770159740 2024-09-13T15:08:30.065 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:30.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2750066730 msgr2=0x7f2750068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2750066730 0x7f2750068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27600011e0 tx=0x7f2760009040 comp rx=0 tx=0).stop 2024-09-13T15:08:30.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 msgr2=0x7f27700cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 0x7f27700cdc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f276800efc0 tx=0x7f276800c3a0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 shutdown_connections 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2750066730 0x7f2750068bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2770159740 0x7f27700cdc10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f27700b5320 0x7f2770150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 --2- 172.21.15.50:0/787475315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f277006b3a0 0x7f2770148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 >> 172.21.15.50:0/787475315 conn(0x7f277006c9b0 msgr2=0x7f2770159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 shutdown_connections 2024-09-13T15:08:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.065+0000 7f276fe00700 1 -- 172.21.15.50:0/787475315 wait complete. 2024-09-13T15:08:30.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:30.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 Processor -- start 2024-09-13T15:08:30.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 -- start start 2024-09-13T15:08:30.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93e406c5a0 0x7f93e415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f93e406c980 0x7f93e40b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40b4680 con 0x7f93e40b2540 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40b4960 con 0x7f93e406c5a0 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e8a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40cf030 con 0x7f93e406c980 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93e406c5a0 0x7f93e415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93e406c5a0 0x7f93e415aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53982/0 (socket says 172.21.15.50:53982) 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 -- 172.21.15.50:0/2667929626 learned_addr learned my addr 172.21.15.50:0/2667929626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e2a00700 1 --2- 172.21.15.50:0/2667929626 >> v2:172.21.15.181:3300/0 conn(0x7f93e406c980 0x7f93e40b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 -- 172.21.15.50:0/2667929626 >> v2:172.21.15.181:3300/0 conn(0x7f93e406c980 msgr2=0x7f93e40b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 --2- 172.21.15.50:0/2667929626 >> v2:172.21.15.181:3300/0 conn(0x7f93e406c980 0x7f93e40b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 -- 172.21.15.50:0/2667929626 >> v1:172.21.15.181:6789/0 conn(0x7f93e40b2540 legacy=0x7f93e40b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e3400700 1 -- 172.21.15.50:0/2667929626 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40cf310 con 0x7f93e406c5a0 2024-09-13T15:08:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.273+0000 7f93e2a00700 1 --2- 172.21.15.50:0/2667929626 >> v2:172.21.15.181:3300/0 conn(0x7f93e406c980 0x7f93e40b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e3400700 1 --2- 172.21.15.50:0/2667929626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c5a0 0x7f93e415aa90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93e4072b00 tx=0x7f93d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1c33871887043f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e2000700 1 -- 172.21.15.50:0/2667929626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4004230 con 0x7f93e406c5a0 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e2000700 1 -- 172.21.15.50:0/2667929626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4004390 con 0x7f93e406c5a0 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e2000700 1 -- 172.21.15.50:0/2667929626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40036c0 con 0x7f93e406c5a0 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 -- 172.21.15.50:0/2667929626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c5a0 msgr2=0x7f93e415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2667929626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c5a0 0x7f93e415aa90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93e4072b00 tx=0x7f93d4009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 -- 172.21.15.50:0/2667929626 shutdown_connections 2024-09-13T15:08:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2667929626 >> v2:172.21.15.181:3300/0 conn(0x7f93e406c980 0x7f93e40b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2667929626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c5a0 0x7f93e415aa90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 -- 172.21.15.50:0/2667929626 >> 172.21.15.50:0/2667929626 conn(0x7f93e4071d20 msgr2=0x7f93e4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 -- 172.21.15.50:0/2667929626 shutdown_connections 2024-09-13T15:08:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 -- 172.21.15.50:0/2667929626 wait complete. 2024-09-13T15:08:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.277+0000 7f93e8a00700 1 Processor -- start 2024-09-13T15:08:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 -- start start 2024-09-13T15:08:30.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93e406c5a0 0x7f93e414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 0x7f93e415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93e40b2540 0x7f93e415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e414d050 con 0x7f93e406c980 2024-09-13T15:08:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415bba0 con 0x7f93e40b2540 2024-09-13T15:08:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415be80 con 0x7f93e406c5a0 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 0x7f93e415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 0x7f93e415b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53990/0 (socket says 172.21.15.50:53990) 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 -- 172.21.15.50:0/2391808378 learned_addr learned my addr 172.21.15.50:0/2391808378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e3400700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93e406c5a0 0x7f93e414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e3e00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93e40b2540 0x7f93e415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 -- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93e406c5a0 msgr2=0x7f93e414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93e406c5a0 0x7f93e414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 -- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93e40b2540 msgr2=0x7f93e415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93e40b2540 0x7f93e415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 -- 172.21.15.50:0/2391808378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4009570 con 0x7f93e406c980 2024-09-13T15:08:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93e2a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 0x7f93e415b030 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c770 tx=0x7f93d000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.281+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0011800 con 0x7f93e406c980 2024-09-13T15:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.285+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0011960 con 0x7f93e406c980 2024-09-13T15:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.285+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0011d10 con 0x7f93e406c980 2024-09-13T15:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.285+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e415c160 con 0x7f93e406c980 2024-09-13T15:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.285+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e415c720 con 0x7f93e406c980 2024-09-13T15:08:30.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.285+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e415c940 con 0x7f93e406c980 2024-09-13T15:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.285+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93d0018360 con 0x7f93e406c980 2024-09-13T15:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.289+0000 7f93db400700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93c4066730 0x7f93c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.289+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f93d00844c0 con 0x7f93e406c980 2024-09-13T15:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.289+0000 7f93e3400700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93c4066730 0x7f93c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.289+0000 7f93e3400700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93c4066730 0x7f93c4068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f93e4072b00 tx=0x7f93d4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:30.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.293+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93d00513d0 con 0x7f93e406c980 2024-09-13T15:08:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.492+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93e415aa90 con 0x7f93e406c980 2024-09-13T15:08:30.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.492+0000 7f93db400700 1 -- 172.21.15.50:0/2391808378 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93d00549f0 con 0x7f93e406c980 2024-09-13T15:08:30.498 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93c4066730 msgr2=0x7f93c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93c4066730 0x7f93c4068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f93e4072b00 tx=0x7f93d4008030 comp rx=0 tx=0).stop 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 msgr2=0x7f93e415b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 0x7f93e415b030 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c770 tx=0x7f93d000ca80 comp rx=0 tx=0).stop 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 shutdown_connections 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93c4066730 0x7f93c4068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93e40b2540 0x7f93e415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93e406c980 0x7f93e415b030 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 --2- 172.21.15.50:0/2391808378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f93e406c5a0 0x7f93e414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 >> 172.21.15.50:0/2391808378 conn(0x7f93e4071d20 msgr2=0x7f93e40b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:30.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 shutdown_connections 2024-09-13T15:08:30.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.500+0000 7f93e8a00700 1 -- 172.21.15.50:0/2391808378 wait complete. 2024-09-13T15:08:30.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.692+0000 7f8e3b200700 1 Processor -- start 2024-09-13T15:08:30.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.692+0000 7f8e3b200700 1 -- start start 2024-09-13T15:08:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e3b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e3b200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0b0020 con 0x7f8e3c06d150 2024-09-13T15:08:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e3b200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0d1770 con 0x7f8e3c06b340 2024-09-13T15:08:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e3b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0d03f0 con 0x7f8e3c160d30 2024-09-13T15:08:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e39400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8e3c06d150 0x7f8e3c06ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48122/0 (socket says 172.21.15.50:48122) 2024-09-13T15:08:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e39400700 1 -- 172.21.15.50:0/1417745623 learned_addr learned my addr 172.21.15.50:0/1417745623 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:30.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e39e00700 1 --2- 172.21.15.50:0/1417745623 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e39e00700 1 -- 172.21.15.50:0/1417745623 >> v1:172.21.15.181:6789/0 conn(0x7f8e3c06b340 legacy=0x7f8e3c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e39e00700 1 -- 172.21.15.50:0/1417745623 >> v1:172.21.15.50:6789/0 conn(0x7f8e3c06d150 legacy=0x7f8e3c06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e38a00700 1 -- 172.21.15.50:0/1417745623 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982603935 0 0) 0x7f8e3c0b0020 con 0x7f8e3c06d150 2024-09-13T15:08:30.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.696+0000 7f8e39e00700 1 -- 172.21.15.50:0/1417745623 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0d06d0 con 0x7f8e3c160d30 2024-09-13T15:08:30.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.704+0000 7f8e39e00700 1 --2- 172.21.15.50:0/1417745623 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c06cc10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009880 tx=0x7f8e2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2416f3822d725ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:30.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.704+0000 7f8e38a00700 1 -- 172.21.15.50:0/1417745623 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c004230 con 0x7f8e3c160d30 2024-09-13T15:08:30.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.704+0000 7f8e38a00700 1 -- 172.21.15.50:0/1417745623 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c004390 con 0x7f8e3c160d30 2024-09-13T15:08:30.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.704+0000 7f8e38a00700 1 -- 172.21.15.50:0/1417745623 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0036c0 con 0x7f8e3c160d30 2024-09-13T15:08:30.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 -- 172.21.15.50:0/1417745623 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 msgr2=0x7f8e3c06cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 --2- 172.21.15.50:0/1417745623 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c06cc10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009880 tx=0x7f8e2c009b90 comp rx=0 tx=0).stop 2024-09-13T15:08:30.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 -- 172.21.15.50:0/1417745623 shutdown_connections 2024-09-13T15:08:30.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 --2- 172.21.15.50:0/1417745623 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c06cc10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 -- 172.21.15.50:0/1417745623 >> 172.21.15.50:0/1417745623 conn(0x7f8e3c071d20 msgr2=0x7f8e3c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:30.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 -- 172.21.15.50:0/1417745623 shutdown_connections 2024-09-13T15:08:30.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.708+0000 7f8e3b200700 1 -- 172.21.15.50:0/1417745623 wait complete. 2024-09-13T15:08:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 Processor -- start 2024-09-13T15:08:30.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 -- start start 2024-09-13T15:08:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 0x7f8e3c159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c06d150 0x7f8e3c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c156e60 con 0x7f8e3c06d150 2024-09-13T15:08:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c147720 con 0x7f8e3c06b340 2024-09-13T15:08:30.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c147a50 con 0x7f8e3c160d30 2024-09-13T15:08:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e39400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c06d150 0x7f8e3c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e39e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 0x7f8e3c159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e3a800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e39e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 0x7f8e3c159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2024-09-13T15:08:30.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.712+0000 7f8e39e00700 1 -- 172.21.15.50:0/3702006649 learned_addr learned my addr 172.21.15.50:0/3702006649 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3a800700 1 -- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 msgr2=0x7f8e3c159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3a800700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 0x7f8e3c159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3a800700 1 -- 172.21.15.50:0/3702006649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c06d150 msgr2=0x7f8e3c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3a800700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c06d150 0x7f8e3c156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3a800700 1 -- 172.21.15.50:0/3702006649 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c0094b0 con 0x7f8e3c160d30 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e39e00700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 0x7f8e3c159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3a800700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c0a8480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0b32b0 tx=0x7f8e34009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400cb30 con 0x7f8e3c160d30 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400cc90 con 0x7f8e3c160d30 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c147cc0 con 0x7f8e3c160d30 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34014440 con 0x7f8e3c160d30 2024-09-13T15:08:30.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c148280 con 0x7f8e3c160d30 2024-09-13T15:08:30.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c161110 con 0x7f8e3c160d30 2024-09-13T15:08:30.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.716+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e3401d3b0 con 0x7f8e3c160d30 2024-09-13T15:08:30.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.720+0000 7f8e32000700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e1c066730 0x7f8e1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:30.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.720+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8e340842e0 con 0x7f8e3c160d30 2024-09-13T15:08:30.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.720+0000 7f8e39e00700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e1c066730 0x7f8e1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:30.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.720+0000 7f8e39e00700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e1c066730 0x7f8e1c068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097d0 tx=0x7f8e2c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:30.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.728+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e340511f0 con 0x7f8e3c160d30 2024-09-13T15:08:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.912+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e3c1602b0 con 0x7f8e3c160d30 2024-09-13T15:08:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.912+0000 7f8e32000700 1 -- 172.21.15.50:0/3702006649 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e34054810 con 0x7f8e3c160d30 2024-09-13T15:08:30.917 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e1c066730 msgr2=0x7f8e1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e1c066730 0x7f8e1c068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097d0 tx=0x7f8e2c01c040 comp rx=0 tx=0).stop 2024-09-13T15:08:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 msgr2=0x7f8e3c0a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c0a8480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0b32b0 tx=0x7f8e34009ed0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 shutdown_connections 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e1c066730 0x7f8e1c068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e3c160d30 0x7f8e3c0a8480 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c06d150 0x7f8e3c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 --2- 172.21.15.50:0/3702006649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3c06b340 0x7f8e3c159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 >> 172.21.15.50:0/3702006649 conn(0x7f8e3c071d20 msgr2=0x7f8e3c161320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 shutdown_connections 2024-09-13T15:08:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:30.916+0000 7f8e3b200700 1 -- 172.21.15.50:0/3702006649 wait complete. 2024-09-13T15:08:30.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:31.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 Processor -- start 2024-09-13T15:08:31.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 -- start start 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f58941601b0 0x7f58940b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f58940cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940ce1f0 con 0x7f5894160840 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58940d0710 con 0x7f58941601b0 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f5899200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5894160590 con 0x7f58941613c0 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f588be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5894160840 0x7f5894160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48132/0 (socket says 172.21.15.50:48132) 2024-09-13T15:08:31.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.136+0000 7f588be00700 1 -- 172.21.15.50:0/3539321973 learned_addr learned my addr 172.21.15.50:0/3539321973 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893400700 1 --2- 172.21.15.50:0/3539321973 >> v2:172.21.15.181:3300/0 conn(0x7f58941601b0 0x7f58940b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893e00700 1 --2- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f58940cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5892a00700 1 -- 172.21.15.50:0/3539321973 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235586600 0 0) 0x7f58940ce1f0 con 0x7f5894160840 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5892a00700 1 -- 172.21.15.50:0/3539321973 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58780035d0 con 0x7f5894160840 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893400700 1 -- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 msgr2=0x7f58940cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893400700 1 --2- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f58940cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893400700 1 -- 172.21.15.50:0/3539321973 >> v1:172.21.15.50:6789/0 conn(0x7f5894160840 legacy=0x7f5894160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893400700 1 -- 172.21.15.50:0/3539321973 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940b3cb0 con 0x7f58941601b0 2024-09-13T15:08:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5893400700 1 --2- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f58940b36d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5884009850 tx=0x7f5884009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f4c0e1ff736d701 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5892a00700 1 -- 172.21.15.50:0/3539321973 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884011830 con 0x7f58941601b0 2024-09-13T15:08:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5892a00700 1 -- 172.21.15.50:0/3539321973 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884011990 con 0x7f58941601b0 2024-09-13T15:08:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5892a00700 1 -- 172.21.15.50:0/3539321973 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884011d00 con 0x7f58941601b0 2024-09-13T15:08:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 -- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 msgr2=0x7f58940b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 --2- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f58940b36d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5884009850 tx=0x7f5884009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 -- 172.21.15.50:0/3539321973 shutdown_connections 2024-09-13T15:08:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 --2- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f58940cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 --2- 172.21.15.50:0/3539321973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f58940b36d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 -- 172.21.15.50:0/3539321973 >> 172.21.15.50:0/3539321973 conn(0x7f58940d2b40 msgr2=0x7f58940d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 -- 172.21.15.50:0/3539321973 shutdown_connections 2024-09-13T15:08:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.140+0000 7f5899200700 1 -- 172.21.15.50:0/3539321973 wait complete. 2024-09-13T15:08:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 Processor -- start 2024-09-13T15:08:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 -- start start 2024-09-13T15:08:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f589406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 0x7f589414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f589414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b7030 con 0x7f5894160840 2024-09-13T15:08:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940c7870 con 0x7f58941601b0 2024-09-13T15:08:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.144+0000 7f5899200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940c7b30 con 0x7f58941613c0 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 0x7f589414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f5893400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f589406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 0x7f589414db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54008/0 (socket says 172.21.15.50:54008) 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f5893e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f589414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 -- 172.21.15.50:0/3732765543 learned_addr learned my addr 172.21.15.50:0/3732765543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 -- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 msgr2=0x7f589414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f589414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 -- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 msgr2=0x7f589406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f589406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 -- 172.21.15.50:0/3732765543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840094b0 con 0x7f5894160840 2024-09-13T15:08:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588be00700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 0x7f589414db60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f587c00c4d0 tx=0x7f587c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c005d90 con 0x7f5894160840 2024-09-13T15:08:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c00ce80 con 0x7f5894160840 2024-09-13T15:08:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58940b72d0 con 0x7f5894160840 2024-09-13T15:08:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0072d0 con 0x7f5894160840 2024-09-13T15:08:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.148+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58941580e0 con 0x7f5894160840 2024-09-13T15:08:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.152+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58940c7d50 con 0x7f5894160840 2024-09-13T15:08:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.152+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f587c007430 con 0x7f5894160840 2024-09-13T15:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.156+0000 7f588b400700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5870066730 0x7f5870068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.156+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f587c083880 con 0x7f5894160840 2024-09-13T15:08:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.156+0000 7f5893400700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5870066730 0x7f5870068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.156+0000 7f5893400700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5870066730 0x7f5870068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58840090b0 tx=0x7f588401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.160+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f58940c7d50 con 0x7f5894160840 2024-09-13T15:08:31.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.340+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f58940b77f0 con 0x7f5894160840 2024-09-13T15:08:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.344+0000 7f588b400700 1 -- 172.21.15.50:0/3732765543 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f58940b77f0 con 0x7f5894160840 2024-09-13T15:08:31.349 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:31.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5870066730 msgr2=0x7f5870068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5870066730 0x7f5870068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58840090b0 tx=0x7f588401c040 comp rx=0 tx=0).stop 2024-09-13T15:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 msgr2=0x7f589414db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 0x7f589414db60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f587c00c4d0 tx=0x7f587c00c7e0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 shutdown_connections 2024-09-13T15:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5870066730 0x7f5870068bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f58941613c0 0x7f589414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5894160840 0x7f589414db60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 --2- 172.21.15.50:0/3732765543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58941601b0 0x7f589406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 >> 172.21.15.50:0/3732765543 conn(0x7f58940d2b40 msgr2=0x7f58940cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 shutdown_connections 2024-09-13T15:08:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.348+0000 7f5899200700 1 -- 172.21.15.50:0/3732765543 wait complete. 2024-09-13T15:08:31.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 Processor -- start 2024-09-13T15:08:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 -- start start 2024-09-13T15:08:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2888146490 0x7f2888070210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806e660 0x7f288806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f288806efc0 0x7f2888160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2888070750 con 0x7f2888146490 2024-09-13T15:08:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880b5850 con 0x7f288806efc0 2024-09-13T15:08:31.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.540+0000 7f288d200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288806f470 con 0x7f288806e660 2024-09-13T15:08:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2888146490 0x7f2888070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2888146490 0x7f2888070210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54016/0 (socket says 172.21.15.50:54016) 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 -- 172.21.15.50:0/2801666009 learned_addr learned my addr 172.21.15.50:0/2801666009 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2886a00700 1 --2- 172.21.15.50:0/2801666009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806e660 0x7f288806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887e00700 1 --2- 172.21.15.50:0/2801666009 >> v2:172.21.15.181:3300/0 conn(0x7f288806efc0 0x7f2888160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 -- 172.21.15.50:0/2801666009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806e660 msgr2=0x7f288806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 --2- 172.21.15.50:0/2801666009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806e660 0x7f288806ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 -- 172.21.15.50:0/2801666009 >> v2:172.21.15.181:3300/0 conn(0x7f288806efc0 msgr2=0x7f2888160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 --2- 172.21.15.50:0/2801666009 >> v2:172.21.15.181:3300/0 conn(0x7f288806efc0 0x7f2888160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 -- 172.21.15.50:0/2801666009 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880b5ac0 con 0x7f2888146490 2024-09-13T15:08:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2887400700 1 --2- 172.21.15.50:0/2801666009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2888146490 0x7f2888070210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2888066cc0 tx=0x7f2878009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84c5b8ed8ef6e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2886000700 1 -- 172.21.15.50:0/2801666009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878011830 con 0x7f2888146490 2024-09-13T15:08:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2886000700 1 -- 172.21.15.50:0/2801666009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878011990 con 0x7f2888146490 2024-09-13T15:08:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f2886000700 1 -- 172.21.15.50:0/2801666009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878011d20 con 0x7f2888146490 2024-09-13T15:08:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 -- 172.21.15.50:0/2801666009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2888146490 msgr2=0x7f2888070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 --2- 172.21.15.50:0/2801666009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2888146490 0x7f2888070210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2888066cc0 tx=0x7f2878009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 -- 172.21.15.50:0/2801666009 shutdown_connections 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 --2- 172.21.15.50:0/2801666009 >> v2:172.21.15.181:3300/0 conn(0x7f288806efc0 0x7f2888160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 --2- 172.21.15.50:0/2801666009 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806e660 0x7f288806ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 --2- 172.21.15.50:0/2801666009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2888146490 0x7f2888070210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 -- 172.21.15.50:0/2801666009 >> 172.21.15.50:0/2801666009 conn(0x7f28880b2690 msgr2=0x7f28880b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 -- 172.21.15.50:0/2801666009 shutdown_connections 2024-09-13T15:08:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.544+0000 7f288d200700 1 -- 172.21.15.50:0/2801666009 wait complete. 2024-09-13T15:08:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.548+0000 7f288d200700 1 Processor -- start 2024-09-13T15:08:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.548+0000 7f288d200700 1 -- start start 2024-09-13T15:08:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 0x7f2888156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806efc0 0x7f28880d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888146490 0x7f28880cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cfb00 con 0x7f288806e660 2024-09-13T15:08:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cfde0 con 0x7f2888146490 2024-09-13T15:08:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880d00c0 con 0x7f288806efc0 2024-09-13T15:08:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 0x7f2888156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 0x7f2888156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54024/0 (socket says 172.21.15.50:54024) 2024-09-13T15:08:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 -- 172.21.15.50:0/218311736 learned_addr learned my addr 172.21.15.50:0/218311736 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2886a00700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806efc0 0x7f28880d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887e00700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888146490 0x7f28880cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 -- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806efc0 msgr2=0x7f28880d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806efc0 0x7f28880d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 -- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888146490 msgr2=0x7f28880cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888146490 0x7f28880cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 -- 172.21.15.50:0/218311736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878009570 con 0x7f288806e660 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887e00700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888146490 0x7f28880cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f2887400700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 0x7f2888156380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f28880b6080 tx=0x7f2878004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28780044d0 con 0x7f288806e660 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287801f070 con 0x7f288806e660 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880d03a0 con 0x7f288806e660 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878003900 con 0x7f288806e660 2024-09-13T15:08:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.552+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288813cae0 con 0x7f288806e660 2024-09-13T15:08:31.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.556+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28880d08c0 con 0x7f288806e660 2024-09-13T15:08:31.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.556+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2878003a60 con 0x7f288806e660 2024-09-13T15:08:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.556+0000 7f287f400700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2868066730 0x7f2868068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.556+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2878021070 con 0x7f288806e660 2024-09-13T15:08:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.556+0000 7f2886a00700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2868066730 0x7f2868068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.560+0000 7f2886a00700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2868066730 0x7f2868068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f288815fab0 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.564+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28880d08c0 con 0x7f288806e660 2024-09-13T15:08:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.756+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28880d08c0 con 0x7f288806e660 2024-09-13T15:08:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.760+0000 7f287f400700 1 -- 172.21.15.50:0/218311736 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f28880d08c0 con 0x7f288806e660 2024-09-13T15:08:31.764 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:31.764 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2868066730 msgr2=0x7f2868068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2868066730 0x7f2868068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f288815fab0 tx=0x7f2874008040 comp rx=0 tx=0).stop 2024-09-13T15:08:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 msgr2=0x7f2888156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 0x7f2888156380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f28880b6080 tx=0x7f2878004770 comp rx=0 tx=0).stop 2024-09-13T15:08:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 shutdown_connections 2024-09-13T15:08:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2868066730 0x7f2868068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888146490 0x7f28880cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f288806efc0 0x7f28880d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 --2- 172.21.15.50:0/218311736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f288806e660 0x7f2888156380 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 >> 172.21.15.50:0/218311736 conn(0x7f28880b2690 msgr2=0x7f288815d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 shutdown_connections 2024-09-13T15:08:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.764+0000 7f288d200700 1 -- 172.21.15.50:0/218311736 wait complete. 2024-09-13T15:08:31.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:31.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:31.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.984+0000 7f176d400700 1 Processor -- start 2024-09-13T15:08:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.984+0000 7f176d400700 1 -- start start 2024-09-13T15:08:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f176d400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f176815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f176d400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f176806c980 0x7f17680b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f176d400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680b4680 con 0x7f17680b2540 2024-09-13T15:08:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f176d400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17680b4960 con 0x7f176806c980 2024-09-13T15:08:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f176d400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680cf030 con 0x7f176806c5a0 2024-09-13T15:08:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f176815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f176815aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36092/0 (socket says 172.21.15.50:36092) 2024-09-13T15:08:31.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767e00700 1 -- 172.21.15.50:0/860506455 learned_addr learned my addr 172.21.15.50:0/860506455 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767400700 1 --2- 172.21.15.50:0/860506455 >> v2:172.21.15.181:3300/0 conn(0x7f176806c980 0x7f17680b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767e00700 1 -- 172.21.15.50:0/860506455 >> v2:172.21.15.181:3300/0 conn(0x7f176806c980 msgr2=0x7f17680b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767e00700 1 --2- 172.21.15.50:0/860506455 >> v2:172.21.15.181:3300/0 conn(0x7f176806c980 0x7f17680b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.988+0000 7f1767e00700 1 -- 172.21.15.50:0/860506455 >> v1:172.21.15.181:6789/0 conn(0x7f17680b2540 legacy=0x7f17680b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f1767e00700 1 -- 172.21.15.50:0/860506455 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680cf310 con 0x7f176806c5a0 2024-09-13T15:08:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f1767e00700 1 --2- 172.21.15.50:0/860506455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f176815aa90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1758009910 tx=0x7f1758009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97bc042b12b4bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f1766a00700 1 -- 172.21.15.50:0/860506455 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758011830 con 0x7f176806c5a0 2024-09-13T15:08:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f1766a00700 1 -- 172.21.15.50:0/860506455 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758011990 con 0x7f176806c5a0 2024-09-13T15:08:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f1766a00700 1 -- 172.21.15.50:0/860506455 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758011d40 con 0x7f176806c5a0 2024-09-13T15:08:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 -- 172.21.15.50:0/860506455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 msgr2=0x7f176815aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 --2- 172.21.15.50:0/860506455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f176815aa90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1758009910 tx=0x7f1758009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 -- 172.21.15.50:0/860506455 shutdown_connections 2024-09-13T15:08:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 --2- 172.21.15.50:0/860506455 >> v2:172.21.15.181:3300/0 conn(0x7f176806c980 0x7f17680b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 --2- 172.21.15.50:0/860506455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f176815aa90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 -- 172.21.15.50:0/860506455 >> 172.21.15.50:0/860506455 conn(0x7f1768071d20 msgr2=0x7f1768072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 -- 172.21.15.50:0/860506455 shutdown_connections 2024-09-13T15:08:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.992+0000 7f176d400700 1 -- 172.21.15.50:0/860506455 wait complete. 2024-09-13T15:08:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 Processor -- start 2024-09-13T15:08:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 -- start start 2024-09-13T15:08:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f1768148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176806c980 0x7f1768148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 0x7f1768156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176814a6b0 con 0x7f17680b2540 2024-09-13T15:08:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17681493e0 con 0x7f176806c980 2024-09-13T15:08:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176d400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176814a220 con 0x7f176806c5a0 2024-09-13T15:08:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 0x7f1768156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 0x7f1768156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54032/0 (socket says 172.21.15.50:54032) 2024-09-13T15:08:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f176ca00700 1 -- 172.21.15.50:0/1867284971 learned_addr learned my addr 172.21.15.50:0/1867284971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f1767400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176806c980 0x7f1768148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:31.996+0000 7f1767e00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f1768148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176ca00700 1 -- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 msgr2=0x7f1768148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176ca00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f1768148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176ca00700 1 -- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176806c980 msgr2=0x7f1768148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176ca00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176806c980 0x7f1768148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176ca00700 1 -- 172.21.15.50:0/1867284971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009570 con 0x7f17680b2540 2024-09-13T15:08:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176ca00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 0x7f1768156c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f176000cc50 tx=0x7f176000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760003c20 con 0x7f17680b2540 2024-09-13T15:08:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760003d80 con 0x7f17680b2540 2024-09-13T15:08:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000aab0 con 0x7f17680b2540 2024-09-13T15:08:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1768149610 con 0x7f17680b2540 2024-09-13T15:08:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1768149bd0 con 0x7f17680b2540 2024-09-13T15:08:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.000+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176814a3d0 con 0x7f17680b2540 2024-09-13T15:08:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.004+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f176000ac10 con 0x7f17680b2540 2024-09-13T15:08:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.004+0000 7f175fe00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1748066760 0x7f1748068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.004+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1760084500 con 0x7f17680b2540 2024-09-13T15:08:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.004+0000 7f1767e00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1748066760 0x7f1748068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.008+0000 7f1767e00700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1748066760 0x7f1748068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1758009c60 tx=0x7f1758008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.012+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f176814a3d0 con 0x7f17680b2540 2024-09-13T15:08:32.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.196+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f176814a390 con 0x7f17680b2540 2024-09-13T15:08:32.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.196+0000 7f175fe00700 1 -- 172.21.15.50:0/1867284971 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1760051410 con 0x7f17680b2540 2024-09-13T15:08:32.200 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1748066760 msgr2=0x7f1748068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1748066760 0x7f1748068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1758009c60 tx=0x7f1758008030 comp rx=0 tx=0).stop 2024-09-13T15:08:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 msgr2=0x7f1768156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 0x7f1768156c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f176000cc50 tx=0x7f176000cf60 comp rx=0 tx=0).stop 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 shutdown_connections 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1748066760 0x7f1748068c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17680b2540 0x7f1768156c10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176806c980 0x7f1768148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 --2- 172.21.15.50:0/1867284971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f176806c5a0 0x7f1768148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 >> 172.21.15.50:0/1867284971 conn(0x7f1768071d20 msgr2=0x7f17681592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 shutdown_connections 2024-09-13T15:08:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.200+0000 7f176d400700 1 -- 172.21.15.50:0/1867284971 wait complete. 2024-09-13T15:08:32.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.400+0000 7fefabe00700 1 Processor -- start 2024-09-13T15:08:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.400+0000 7fefabe00700 1 -- start start 2024-09-13T15:08:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefabe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefac06c5a0 0x7fefac15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefabe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0b4680 con 0x7fefac06c980 2024-09-13T15:08:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefabe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0b4960 con 0x7fefac0cf830 2024-09-13T15:08:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefabe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0b5dd0 con 0x7fefac06c5a0 2024-09-13T15:08:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefaa000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fefac06c980 0x7fefac0b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48134/0 (socket says 172.21.15.50:48134) 2024-09-13T15:08:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefaa000700 1 -- 172.21.15.50:0/455867536 learned_addr learned my addr 172.21.15.50:0/455867536 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefaaa00700 1 --2- 172.21.15.50:0/455867536 >> v2:172.21.15.181:3300/0 conn(0x7fefac06c5a0 0x7fefac15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefa9600700 1 -- 172.21.15.50:0/455867536 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5294302 0 0) 0x7fefac0b4680 con 0x7fefac06c980 2024-09-13T15:08:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefa9600700 1 -- 172.21.15.50:0/455867536 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef900035d0 con 0x7fefac06c980 2024-09-13T15:08:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefaaa00700 1 -- 172.21.15.50:0/455867536 >> v1:172.21.15.181:6789/0 conn(0x7fefac0cf830 legacy=0x7fefac0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefa9600700 1 -- 172.21.15.50:0/455867536 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846891824 0 0) 0x7fefac0b4960 con 0x7fefac0cf830 2024-09-13T15:08:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefaaa00700 1 -- 172.21.15.50:0/455867536 >> v1:172.21.15.50:6789/0 conn(0x7fefac06c980 legacy=0x7fefac0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.404+0000 7fefaaa00700 1 -- 172.21.15.50:0/455867536 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0cf030 con 0x7fefac06c5a0 2024-09-13T15:08:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefaaa00700 1 --2- 172.21.15.50:0/455867536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac15aa90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009850 tx=0x7fef9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c32ddefae475c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefa9600700 1 -- 172.21.15.50:0/455867536 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98001670 con 0x7fefac06c5a0 2024-09-13T15:08:32.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefa9600700 1 -- 172.21.15.50:0/455867536 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c010590 con 0x7fefac06c5a0 2024-09-13T15:08:32.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefa9600700 1 -- 172.21.15.50:0/455867536 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c010940 con 0x7fefac06c5a0 2024-09-13T15:08:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 -- 172.21.15.50:0/455867536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 msgr2=0x7fefac15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 --2- 172.21.15.50:0/455867536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac15aa90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009850 tx=0x7fef9c009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 -- 172.21.15.50:0/455867536 shutdown_connections 2024-09-13T15:08:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 --2- 172.21.15.50:0/455867536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac15aa90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 -- 172.21.15.50:0/455867536 >> 172.21.15.50:0/455867536 conn(0x7fefac071d20 msgr2=0x7fefac072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 -- 172.21.15.50:0/455867536 shutdown_connections 2024-09-13T15:08:32.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.408+0000 7fefabe00700 1 -- 172.21.15.50:0/455867536 wait complete. 2024-09-13T15:08:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 Processor -- start 2024-09-13T15:08:32.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 -- start start 2024-09-13T15:08:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac137b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 0x7fefac14b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0cf830 0x7fefac136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1493a0 con 0x7fefac06c980 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac148a90 con 0x7fefac06c5a0 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefabe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac138090 con 0x7fefac0cf830 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefaa000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 0x7fefac14b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefaa000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 0x7fefac14b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54040/0 (socket says 172.21.15.50:54040) 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefaa000700 1 -- 172.21.15.50:0/1946318695 learned_addr learned my addr 172.21.15.50:0/1946318695 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:32.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefaaa00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.412+0000 7fefab400700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0cf830 0x7fefac136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaa000700 1 -- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0cf830 msgr2=0x7fefac136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaa000700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0cf830 0x7fefac136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaa000700 1 -- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 msgr2=0x7fefac137b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaa000700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac137b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaa000700 1 -- 172.21.15.50:0/1946318695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0094b0 con 0x7fefac06c980 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaaa00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac137b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:32.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefaa000700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 0x7fefac14b6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef9800caf0 tx=0x7fef9800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98004a90 con 0x7fefac06c980 2024-09-13T15:08:32.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98004bf0 con 0x7fefac06c980 2024-09-13T15:08:32.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac14d5e0 con 0x7fefac06c980 2024-09-13T15:08:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980070d0 con 0x7fefac06c980 2024-09-13T15:08:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac148fc0 con 0x7fefac06c980 2024-09-13T15:08:32.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.416+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac1494e0 con 0x7fefac06c980 2024-09-13T15:08:32.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.420+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef98007230 con 0x7fefac06c980 2024-09-13T15:08:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.420+0000 7fefa2a00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef8c066730 0x7fef8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.420+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef980837a0 con 0x7fefac06c980 2024-09-13T15:08:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.420+0000 7fefaaa00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef8c066730 0x7fef8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.424+0000 7fefaaa00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef8c066730 0x7fef8c068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef9c013040 tx=0x7fef9c008000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.428+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fefac1494e0 con 0x7fefac06c980 2024-09-13T15:08:32.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.620+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefac1494e0 con 0x7fefac06c980 2024-09-13T15:08:32.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.620+0000 7fefa2a00700 1 -- 172.21.15.50:0/1946318695 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefac1494e0 con 0x7fefac06c980 2024-09-13T15:08:32.624 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef8c066730 msgr2=0x7fef8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef8c066730 0x7fef8c068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef9c013040 tx=0x7fef9c008000 comp rx=0 tx=0).stop 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 msgr2=0x7fefac14b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 0x7fefac14b6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef9800caf0 tx=0x7fef9800ceb0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 shutdown_connections 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef8c066730 0x7fef8c068bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0cf830 0x7fefac136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06c980 0x7fefac14b6d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 --2- 172.21.15.50:0/1946318695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac06c5a0 0x7fefac137b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 >> 172.21.15.50:0/1946318695 conn(0x7fefac071d20 msgr2=0x7fefac0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 shutdown_connections 2024-09-13T15:08:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.624+0000 7fefabe00700 1 -- 172.21.15.50:0/1946318695 wait complete. 2024-09-13T15:08:32.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ffb200700 1 Processor -- start 2024-09-13T15:08:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ffb200700 1 -- start start 2024-09-13T15:08:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ffb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4ffc165820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ffb200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc0b4680 con 0x7f4ffc06c5a0 2024-09-13T15:08:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ffb200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc0b4960 con 0x7f4ffc15aa90 2024-09-13T15:08:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ffb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc15aee0 con 0x7f4ffc163430 2024-09-13T15:08:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ff9e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ffc06c5a0 0x7f4ffc06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48144/0 (socket says 172.21.15.50:48144) 2024-09-13T15:08:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.852+0000 7f4ff9e00700 1 -- 172.21.15.50:0/2917564722 learned_addr learned my addr 172.21.15.50:0/2917564722 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ffa800700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4ffc165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511232751 0 0) 0x7f4ffc0b4680 con 0x7f4ffc06c5a0 2024-09-13T15:08:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe00035d0 con 0x7f4ffc06c5a0 2024-09-13T15:08:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632941609 0 0) 0x7f4fe00035d0 con 0x7f4ffc06c5a0 2024-09-13T15:08:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 msgr2=0x7f4ffc165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4ffc165820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 >> v1:172.21.15.181:6789/0 conn(0x7f4ffc15aa90 legacy=0x7f4ffc0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0cf030 con 0x7f4ffc06c5a0 2024-09-13T15:08:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f4fec001670 con 0x7f4ffc06c5a0 2024-09-13T15:08:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 >> v1:172.21.15.50:6789/0 conn(0x7f4ffc06c5a0 legacy=0x7f4ffc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fe0003a50 0x7f4fe0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4fe0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe0004db0 0x7f4fe0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000ba30 con 0x7f4fe0004db0 2024-09-13T15:08:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000bb70 con 0x7f4fe0003a50 2024-09-13T15:08:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000bd30 con 0x7f4ffc163430 2024-09-13T15:08:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fe0003a50 0x7f4fe0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ffa800700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe0004db0 0x7f4fe0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9400700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4fe0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 -- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 msgr2=0x7f4fe0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:32.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4fe0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 -- 172.21.15.50:0/2917564722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe0004db0 msgr2=0x7f4fe0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe0004db0 0x7f4fe0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 -- 172.21.15.50:0/2917564722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe00035d0 con 0x7f4fe0003a50 2024-09-13T15:08:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9400700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ffc163430 0x7f4fe0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.856+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fe0003a50 0x7f4fe0003e30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fec007f60 tx=0x7f4fe00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe184df3e31470f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00cd40 con 0x7f4fe0003a50 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec005980 con 0x7f4fe0003a50 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ff8a00700 1 -- 172.21.15.50:0/2917564722 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00cea0 con 0x7f4fe0003a50 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffb200700 1 -- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fe0003a50 msgr2=0x7f4fe0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffb200700 1 --2- 172.21.15.50:0/2917564722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fe0003a50 0x7f4fe0003e30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fec007f60 tx=0x7f4fe00058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffa800700 1 -- 172.21.15.50:0/2917564722 reap_dead start 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffb200700 1 -- 172.21.15.50:0/2917564722 shutdown_connections 2024-09-13T15:08:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffb200700 1 -- 172.21.15.50:0/2917564722 >> 172.21.15.50:0/2917564722 conn(0x7f4ffc071d20 msgr2=0x7f4ffc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffb200700 1 -- 172.21.15.50:0/2917564722 shutdown_connections 2024-09-13T15:08:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.860+0000 7f4ffb200700 1 -- 172.21.15.50:0/2917564722 wait complete. 2024-09-13T15:08:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 Processor -- start 2024-09-13T15:08:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 -- start start 2024-09-13T15:08:32.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fe0003a50 0x7f4ffc1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 0x7f4ffc150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ffc1405e0 0x7f4ffc0d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc14f490 con 0x7f4ffc141680 2024-09-13T15:08:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc150670 con 0x7f4ffc1405e0 2024-09-13T15:08:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc14fca0 con 0x7f4fe0003a50 2024-09-13T15:08:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 0x7f4ffc150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 0x7f4ffc150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54052/0 (socket says 172.21.15.50:54052) 2024-09-13T15:08:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 -- 172.21.15.50:0/1651954511 learned_addr learned my addr 172.21.15.50:0/1651954511 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffa800700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ffc1405e0 0x7f4ffc0d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fe0003a50 0x7f4ffc1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 -- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fe0003a50 msgr2=0x7f4ffc1517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fe0003a50 0x7f4ffc1517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 -- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ffc1405e0 msgr2=0x7f4ffc0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ffc1405e0 0x7f4ffc0d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 -- 172.21.15.50:0/1651954511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc141b00 con 0x7f4ffc141680 2024-09-13T15:08:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ffa800700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ffc1405e0 0x7f4ffc0d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.864+0000 7f4ff9400700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 0x7f4ffc150130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800e7d0 tx=0x7f4fe800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80052e0 con 0x7f4ffc141680 2024-09-13T15:08:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8005440 con 0x7f4ffc141680 2024-09-13T15:08:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc14eed0 con 0x7f4ffc141680 2024-09-13T15:08:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80038a0 con 0x7f4ffc141680 2024-09-13T15:08:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc14f930 con 0x7f4ffc141680 2024-09-13T15:08:32.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc14f790 con 0x7f4ffc141680 2024-09-13T15:08:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.868+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fe8003a00 con 0x7f4ffc141680 2024-09-13T15:08:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.872+0000 7f4ff2000700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fdc066760 0x7f4fdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.872+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4fe8083c50 con 0x7f4ffc141680 2024-09-13T15:08:32.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.872+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fdc066760 0x7f4fdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.872+0000 7f4ff9e00700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fdc066760 0x7f4fdc068c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc1f1a50 tx=0x7f4fec01e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:32.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:32.876+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ffc14f790 con 0x7f4ffc141680 2024-09-13T15:08:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.064+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ffc14f790 con 0x7f4ffc141680 2024-09-13T15:08:33.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.064+0000 7f4ff2000700 1 -- 172.21.15.50:0/1651954511 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ffc14f790 con 0x7f4ffc141680 2024-09-13T15:08:33.068 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:33.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fdc066760 msgr2=0x7f4fdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fdc066760 0x7f4fdc068c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc1f1a50 tx=0x7f4fec01e040 comp rx=0 tx=0).stop 2024-09-13T15:08:33.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 msgr2=0x7f4ffc150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 0x7f4ffc150130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800e7d0 tx=0x7f4fe800eae0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 shutdown_connections 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fdc066760 0x7f4fdc068c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ffc1405e0 0x7f4ffc0d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc141680 0x7f4ffc150130 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 --2- 172.21.15.50:0/1651954511 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fe0003a50 0x7f4ffc1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 >> 172.21.15.50:0/1651954511 conn(0x7f4ffc071d20 msgr2=0x7f4ffc14a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 shutdown_connections 2024-09-13T15:08:33.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.068+0000 7f4ffb200700 1 -- 172.21.15.50:0/1651954511 wait complete. 2024-09-13T15:08:33.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:33.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.292+0000 7f4c47200700 1 Processor -- start 2024-09-13T15:08:33.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.292+0000 7f4c47200700 1 -- start start 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c47200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c480b1f50 0x7f4c480cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c47200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4806b940 con 0x7f4c4815a7e0 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c47200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4815e6b0 con 0x7f4c4815abc0 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c47200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4815e990 con 0x7f4c480b1f50 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c480b1f50 0x7f4c480cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4c4815a7e0 0x7f4c480b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36648/0 (socket says 172.21.15.50:36648) 2024-09-13T15:08:33.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45e00700 1 -- 172.21.15.50:0/3319189969 learned_addr learned my addr 172.21.15.50:0/3319189969 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45400700 1 -- 172.21.15.50:0/3319189969 >> v1:172.21.15.181:6789/0 conn(0x7f4c4815abc0 legacy=0x7f4c480ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45400700 1 -- 172.21.15.50:0/3319189969 >> v1:172.21.15.50:6789/0 conn(0x7f4c4815a7e0 legacy=0x7f4c480b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45400700 1 -- 172.21.15.50:0/3319189969 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4815ec70 con 0x7f4c480b1f50 2024-09-13T15:08:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c44a00700 1 -- 172.21.15.50:0/3319189969 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865407015 0 0) 0x7f4c4806b940 con 0x7f4c4815a7e0 2024-09-13T15:08:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c45400700 1 --2- 172.21.15.50:0/3319189969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c480cdb80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009850 tx=0x7f4c34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e08922d11750c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c44a00700 1 -- 172.21.15.50:0/3319189969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011830 con 0x7f4c480b1f50 2024-09-13T15:08:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c44a00700 1 -- 172.21.15.50:0/3319189969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34011990 con 0x7f4c480b1f50 2024-09-13T15:08:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.296+0000 7f4c44a00700 1 -- 172.21.15.50:0/3319189969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011d20 con 0x7f4c480b1f50 2024-09-13T15:08:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 -- 172.21.15.50:0/3319189969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 msgr2=0x7f4c480cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 --2- 172.21.15.50:0/3319189969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c480cdb80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009850 tx=0x7f4c34009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 -- 172.21.15.50:0/3319189969 shutdown_connections 2024-09-13T15:08:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 --2- 172.21.15.50:0/3319189969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c480cdb80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 -- 172.21.15.50:0/3319189969 >> 172.21.15.50:0/3319189969 conn(0x7f4c4806cb90 msgr2=0x7f4c4806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 -- 172.21.15.50:0/3319189969 shutdown_connections 2024-09-13T15:08:33.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 -- 172.21.15.50:0/3319189969 wait complete. 2024-09-13T15:08:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.300+0000 7f4c47200700 1 Processor -- start 2024-09-13T15:08:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 -- start start 2024-09-13T15:08:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c48154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c4815a7e0 0x7f4c480adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c4815abc0 0x7f4c481f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481452a0 con 0x7f4c480b1f50 2024-09-13T15:08:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4814e5f0 con 0x7f4c4815abc0 2024-09-13T15:08:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c47200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481506c0 con 0x7f4c4815a7e0 2024-09-13T15:08:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c48154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c48154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51014/0 (socket says 172.21.15.50:51014) 2024-09-13T15:08:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 -- 172.21.15.50:0/794298338 learned_addr learned my addr 172.21.15.50:0/794298338 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c46800700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c4815abc0 0x7f4c481f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45400700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c4815a7e0 0x7f4c480adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 -- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c4815a7e0 msgr2=0x7f4c480adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c4815a7e0 0x7f4c480adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 -- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c4815abc0 msgr2=0x7f4c481f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c4815abc0 0x7f4c481f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 -- 172.21.15.50:0/794298338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340094b0 con 0x7f4c480b1f50 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.304+0000 7f4c45e00700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c48154df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c550 tx=0x7f4c3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38004ca0 con 0x7f4c480b1f50 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c38004e00 con 0x7f4c480b1f50 2024-09-13T15:08:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38007310 con 0x7f4c480b1f50 2024-09-13T15:08:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4814dd50 con 0x7f4c480b1f50 2024-09-13T15:08:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4814e310 con 0x7f4c480b1f50 2024-09-13T15:08:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c480cc280 con 0x7f4c480b1f50 2024-09-13T15:08:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.308+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c38007470 con 0x7f4c480b1f50 2024-09-13T15:08:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.312+0000 7f4c3e000700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4c28066730 0x7f4c28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.312+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c380841a0 con 0x7f4c480b1f50 2024-09-13T15:08:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.312+0000 7f4c45400700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4c28066730 0x7f4c28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.312+0000 7f4c45400700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4c28066730 0x7f4c28068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009850 tx=0x7f4c34008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:33.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.320+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c380510b0 con 0x7f4c480b1f50 2024-09-13T15:08:33.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.508+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4c4806a820 con 0x7f4c480b1f50 2024-09-13T15:08:33.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.508+0000 7f4c3e000700 1 -- 172.21.15.50:0/794298338 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4c38007720 con 0x7f4c480b1f50 2024-09-13T15:08:33.514 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4c28066730 msgr2=0x7f4c28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4c28066730 0x7f4c28068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009850 tx=0x7f4c34008030 comp rx=0 tx=0).stop 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 msgr2=0x7f4c48154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c48154df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c550 tx=0x7f4c3800c860 comp rx=0 tx=0).stop 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 shutdown_connections 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4c28066730 0x7f4c28068bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c4815abc0 0x7f4c481f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c4815a7e0 0x7f4c480adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 --2- 172.21.15.50:0/794298338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c480b1f50 0x7f4c48154df0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 >> 172.21.15.50:0/794298338 conn(0x7f4c4806cb90 msgr2=0x7f4c48071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 shutdown_connections 2024-09-13T15:08:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.512+0000 7f4c47200700 1 -- 172.21.15.50:0/794298338 wait complete. 2024-09-13T15:08:33.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.704+0000 7f03f5600700 1 Processor -- start 2024-09-13T15:08:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f5600700 1 -- start start 2024-09-13T15:08:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03f015d310 0x7f03f00b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f5600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015e9f0 0x7f03f015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f5600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f015e560 con 0x7f03f006aaa0 2024-09-13T15:08:33.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f5600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00b3ec0 con 0x7f03f015d310 2024-09-13T15:08:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f5600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00adf90 con 0x7f03f015e9f0 2024-09-13T15:08:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03efe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03f006aaa0 0x7f03f006ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36650/0 (socket says 172.21.15.50:36650) 2024-09-13T15:08:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03efe00700 1 -- 172.21.15.50:0/4273475934 learned_addr learned my addr 172.21.15.50:0/4273475934 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:33.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03ef400700 1 --2- 172.21.15.50:0/4273475934 >> v2:172.21.15.50:3300/0 conn(0x7f03f015d310 0x7f03f00b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03f4c00700 1 --2- 172.21.15.50:0/4273475934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015e9f0 0x7f03f015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03eea00700 1 -- 172.21.15.50:0/4273475934 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750515919 0 0) 0x7f03f015e560 con 0x7f03f006aaa0 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.708+0000 7f03eea00700 1 -- 172.21.15.50:0/4273475934 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d40035d0 con 0x7f03f006aaa0 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f4c00700 1 -- 172.21.15.50:0/4273475934 >> v2:172.21.15.50:3300/0 conn(0x7f03f015d310 msgr2=0x7f03f00b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f4c00700 1 --2- 172.21.15.50:0/4273475934 >> v2:172.21.15.50:3300/0 conn(0x7f03f015d310 0x7f03f00b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f4c00700 1 -- 172.21.15.50:0/4273475934 >> v1:172.21.15.50:6789/0 conn(0x7f03f006aaa0 legacy=0x7f03f006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03eea00700 1 -- 172.21.15.50:0/4273475934 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456617908 0 0) 0x7f03d40035d0 con 0x7f03f006aaa0 2024-09-13T15:08:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f4c00700 1 -- 172.21.15.50:0/4273475934 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f015d920 con 0x7f03f015e9f0 2024-09-13T15:08:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f4c00700 1 --2- 172.21.15.50:0/4273475934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015e9f0 0x7f03f015ee80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009850 tx=0x7f03e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5951ec7d3db3f6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03eea00700 1 -- 172.21.15.50:0/4273475934 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00019f0 con 0x7f03f015e9f0 2024-09-13T15:08:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03eea00700 1 -- 172.21.15.50:0/4273475934 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8004030 con 0x7f03f015e9f0 2024-09-13T15:08:33.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03eea00700 1 -- 172.21.15.50:0/4273475934 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80043a0 con 0x7f03f015e9f0 2024-09-13T15:08:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 -- 172.21.15.50:0/4273475934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015e9f0 msgr2=0x7f03f015ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 --2- 172.21.15.50:0/4273475934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015e9f0 0x7f03f015ee80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009850 tx=0x7f03e8009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 -- 172.21.15.50:0/4273475934 shutdown_connections 2024-09-13T15:08:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 --2- 172.21.15.50:0/4273475934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015e9f0 0x7f03f015ee80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 --2- 172.21.15.50:0/4273475934 >> v2:172.21.15.50:3300/0 conn(0x7f03f015d310 0x7f03f00b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 -- 172.21.15.50:0/4273475934 >> 172.21.15.50:0/4273475934 conn(0x7f03f00b0c40 msgr2=0x7f03f006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 -- 172.21.15.50:0/4273475934 shutdown_connections 2024-09-13T15:08:33.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.712+0000 7f03f5600700 1 -- 172.21.15.50:0/4273475934 wait complete. 2024-09-13T15:08:33.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.716+0000 7f03f5600700 1 Processor -- start 2024-09-13T15:08:33.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.716+0000 7f03f5600700 1 -- start start 2024-09-13T15:08:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.716+0000 7f03f5600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03f006aaa0 0x7f03f0144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.716+0000 7f03f5600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015d310 0x7f03f013a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f5600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 0x7f03f00cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f5600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0144fd0 con 0x7f03f015e9f0 2024-09-13T15:08:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f5600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0144600 con 0x7f03f006aaa0 2024-09-13T15:08:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f5600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01439f0 con 0x7f03f015d310 2024-09-13T15:08:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 0x7f03f00cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 0x7f03f00cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51026/0 (socket says 172.21.15.50:51026) 2024-09-13T15:08:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 -- 172.21.15.50:0/2949570199 learned_addr learned my addr 172.21.15.50:0/2949570199 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03ef400700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015d310 0x7f03f013a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03efe00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03f006aaa0 0x7f03f0144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 -- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015d310 msgr2=0x7f03f013a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015d310 0x7f03f013a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 -- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03f006aaa0 msgr2=0x7f03f0144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03f006aaa0 0x7f03f0144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 -- 172.21.15.50:0/2949570199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80094b0 con 0x7f03f015e9f0 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03ef400700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015d310 0x7f03f013a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f4c00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 0x7f03f00cd200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03f00b4000 tx=0x7f03e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8003ba0 con 0x7f03f015e9f0 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e801f070 con 0x7f03f015e9f0 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8011630 con 0x7f03f015e9f0 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f0143cd0 con 0x7f03f015e9f0 2024-09-13T15:08:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.720+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f0144290 con 0x7f03f015e9f0 2024-09-13T15:08:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.724+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f0144790 con 0x7f03f015e9f0 2024-09-13T15:08:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.724+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03e8021030 con 0x7f03f015e9f0 2024-09-13T15:08:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.728+0000 7f03e7e00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03d0066730 0x7f03d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.728+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f03e8085830 con 0x7f03f015e9f0 2024-09-13T15:08:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.728+0000 7f03efe00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03d0066730 0x7f03d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.728+0000 7f03efe00700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03d0066730 0x7f03d0068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f03e0002200 tx=0x7f03e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:33.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.732+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03e80527d0 con 0x7f03f015e9f0 2024-09-13T15:08:33.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.920+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03f00b3980 con 0x7f03f015e9f0 2024-09-13T15:08:33.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.924+0000 7f03e7e00700 1 -- 172.21.15.50:0/2949570199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f03e8006ce0 con 0x7f03f015e9f0 2024-09-13T15:08:33.929 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:33.929 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03d0066730 msgr2=0x7f03d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03d0066730 0x7f03d0068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f03e0002200 tx=0x7f03e0009040 comp rx=0 tx=0).stop 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 msgr2=0x7f03f00cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 0x7f03f00cd200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03f00b4000 tx=0x7f03e8004770 comp rx=0 tx=0).stop 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 shutdown_connections 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03d0066730 0x7f03d0068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03f015e9f0 0x7f03f00cd200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03f015d310 0x7f03f013a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 --2- 172.21.15.50:0/2949570199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03f006aaa0 0x7f03f0144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 >> 172.21.15.50:0/2949570199 conn(0x7f03f00b0c40 msgr2=0x7f03f006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 shutdown_connections 2024-09-13T15:08:33.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:33.928+0000 7f03f5600700 1 -- 172.21.15.50:0/2949570199 wait complete. 2024-09-13T15:08:33.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:33.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:34.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.128+0000 7f6be3400700 1 Processor -- start 2024-09-13T15:08:34.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.128+0000 7f6be3400700 1 -- start start 2024-09-13T15:08:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6bdc0b2f00 0x7f6bdc0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be3400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc160f90 con 0x7f6bdc066090 2024-09-13T15:08:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be3400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc160960 con 0x7f6bdc0b2f00 2024-09-13T15:08:34.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be3400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0b4400 con 0x7f6bdc15cd40 2024-09-13T15:08:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be1400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6bdc066090 0x7f6bdc06ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36656/0 (socket says 172.21.15.50:36656) 2024-09-13T15:08:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be1400700 1 -- 172.21.15.50:0/1322565829 learned_addr learned my addr 172.21.15.50:0/1322565829 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6bdbe00700 1 --2- 172.21.15.50:0/1322565829 >> v2:172.21.15.181:3300/0 conn(0x7f6bdc0b2f00 0x7f6bdc0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.132+0000 7f6be0a00700 1 --2- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdb400700 1 -- 172.21.15.50:0/1322565829 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276982132 0 0) 0x7f6bdc160f90 con 0x7f6bdc066090 2024-09-13T15:08:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdb400700 1 -- 172.21.15.50:0/1322565829 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc40035d0 con 0x7f6bdc066090 2024-09-13T15:08:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdbe00700 1 -- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 msgr2=0x7f6bdc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdbe00700 1 --2- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdbe00700 1 -- 172.21.15.50:0/1322565829 >> v1:172.21.15.50:6789/0 conn(0x7f6bdc066090 legacy=0x7f6bdc06ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdbe00700 1 -- 172.21.15.50:0/1322565829 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0b46e0 con 0x7f6bdc0b2f00 2024-09-13T15:08:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdbe00700 1 --2- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 0x7f6bdc0b3bd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009850 tx=0x7f6bc8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f868fb0986d23e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdb400700 1 -- 172.21.15.50:0/1322565829 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011830 con 0x7f6bdc0b2f00 2024-09-13T15:08:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdb400700 1 -- 172.21.15.50:0/1322565829 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8011990 con 0x7f6bdc0b2f00 2024-09-13T15:08:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6bdb400700 1 -- 172.21.15.50:0/1322565829 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011d40 con 0x7f6bdc0b2f00 2024-09-13T15:08:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 -- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 msgr2=0x7f6bdc0b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 --2- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 0x7f6bdc0b3bd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009850 tx=0x7f6bc8009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 -- 172.21.15.50:0/1322565829 shutdown_connections 2024-09-13T15:08:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 --2- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 0x7f6bdc0b3bd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 --2- 172.21.15.50:0/1322565829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 -- 172.21.15.50:0/1322565829 >> 172.21.15.50:0/1322565829 conn(0x7f6bdc06ce90 msgr2=0x7f6bdc06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 -- 172.21.15.50:0/1322565829 shutdown_connections 2024-09-13T15:08:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.136+0000 7f6be3400700 1 -- 172.21.15.50:0/1322565829 wait complete. 2024-09-13T15:08:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.140+0000 7f6be3400700 1 Processor -- start 2024-09-13T15:08:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.140+0000 7f6be3400700 1 -- start start 2024-09-13T15:08:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 0x7f6bdc152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 0x7f6bdc158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc15a700 con 0x7f6bdc066090 2024-09-13T15:08:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc15a9e0 con 0x7f6bdc0b2f00 2024-09-13T15:08:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc15acc0 con 0x7f6bdc15cd40 2024-09-13T15:08:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 0x7f6bdc152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 0x7f6bdc152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51038/0 (socket says 172.21.15.50:51038) 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 -- 172.21.15.50:0/3795058253 learned_addr learned my addr 172.21.15.50:0/3795058253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 -- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 msgr2=0x7f6bdc14e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 -- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 msgr2=0x7f6bdc158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 0x7f6bdc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 -- 172.21.15.50:0/3795058253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80094b0 con 0x7f6bdc066090 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be0a00700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 0x7f6bdc152540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000e840 tx=0x7f6bd000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000c690 con 0x7f6bdc066090 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000c7f0 con 0x7f6bdc066090 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc15afa0 con 0x7f6bdc066090 2024-09-13T15:08:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000cb60 con 0x7f6bdc066090 2024-09-13T15:08:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.144+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc152a80 con 0x7f6bdc066090 2024-09-13T15:08:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.148+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc15b4c0 con 0x7f6bdc066090 2024-09-13T15:08:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.148+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6bd000ccc0 con 0x7f6bdc066090 2024-09-13T15:08:34.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.148+0000 7f6bd8c00700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6bbc066730 0x7f6bbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.148+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6bd00845f0 con 0x7f6bdc066090 2024-09-13T15:08:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.148+0000 7f6bdbe00700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6bbc066730 0x7f6bbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.152+0000 7f6bdbe00700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6bbc066730 0x7f6bbc068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc1fa480 tx=0x7f6bc8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.156+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6bdc15b4c0 con 0x7f6bdc066090 2024-09-13T15:08:34.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.332+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bdc15b4c0 con 0x7f6bdc066090 2024-09-13T15:08:34.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.332+0000 7f6bd8c00700 1 -- 172.21.15.50:0/3795058253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bdc15b4c0 con 0x7f6bdc066090 2024-09-13T15:08:34.337 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6bbc066730 msgr2=0x7f6bbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6bbc066730 0x7f6bbc068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc1fa480 tx=0x7f6bc8010000 comp rx=0 tx=0).stop 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 msgr2=0x7f6bdc152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 0x7f6bdc152540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000e840 tx=0x7f6bd000ec00 comp rx=0 tx=0).stop 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 shutdown_connections 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6bbc066730 0x7f6bbc068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6bdc15cd40 0x7f6bdc14e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6bdc0b2f00 0x7f6bdc158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 --2- 172.21.15.50:0/3795058253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bdc066090 0x7f6bdc152540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 >> 172.21.15.50:0/3795058253 conn(0x7f6bdc06ce90 msgr2=0x7f6bdc0aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:34.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 shutdown_connections 2024-09-13T15:08:34.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.336+0000 7f6be3400700 1 -- 172.21.15.50:0/3795058253 wait complete. 2024-09-13T15:08:34.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.532+0000 7fcbcb000700 1 Processor -- start 2024-09-13T15:08:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.532+0000 7fcbcb000700 1 -- start start 2024-09-13T15:08:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.532+0000 7fcbcb000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbc406c960 0x7fcbc4161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbcb000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc40b1980 0x7fcbc4162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbcb000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc4162340 con 0x7fcbc406cd40 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbcb000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc40b2280 con 0x7fcbc406c960 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbcb000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40b2560 con 0x7fcbc40b1980 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbc406c960 0x7fcbc4161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbca600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc40b1980 0x7fcbc4162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9200700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcbc406cd40 0x7fcbc40b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:54554/0 (socket says 172.21.15.50:54554) 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbc406c960 0x7fcbc4161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51042/0 (socket says 172.21.15.50:51042) 2024-09-13T15:08:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9200700 1 -- 172.21.15.50:0/1883325942 learned_addr learned my addr 172.21.15.50:0/1883325942 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 -- 172.21.15.50:0/1883325942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc40b1980 msgr2=0x7fcbc4162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 --2- 172.21.15.50:0/1883325942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc40b1980 0x7fcbc4162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 -- 172.21.15.50:0/1883325942 >> v1:172.21.15.181:6789/0 conn(0x7fcbc406cd40 legacy=0x7fcbc40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 -- 172.21.15.50:0/1883325942 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc40b2840 con 0x7fcbc406c960 2024-09-13T15:08:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc3e00700 1 -- 172.21.15.50:0/1883325942 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764959621 0 0) 0x7fcbc4162340 con 0x7fcbc406cd40 2024-09-13T15:08:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc9c00700 1 --2- 172.21.15.50:0/1883325942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406c960 0x7fcbc4161e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009850 tx=0x7fcbb8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a57ef4b9cf84c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc3e00700 1 -- 172.21.15.50:0/1883325942 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8011830 con 0x7fcbc406c960 2024-09-13T15:08:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc3e00700 1 -- 172.21.15.50:0/1883325942 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8011990 con 0x7fcbc406c960 2024-09-13T15:08:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbc3e00700 1 -- 172.21.15.50:0/1883325942 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8011d40 con 0x7fcbc406c960 2024-09-13T15:08:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.536+0000 7fcbcb000700 1 -- 172.21.15.50:0/1883325942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406c960 msgr2=0x7fcbc4161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 --2- 172.21.15.50:0/1883325942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406c960 0x7fcbc4161e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009850 tx=0x7fcbb8009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 -- 172.21.15.50:0/1883325942 shutdown_connections 2024-09-13T15:08:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 --2- 172.21.15.50:0/1883325942 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc40b1980 0x7fcbc4162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 --2- 172.21.15.50:0/1883325942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406c960 0x7fcbc4161e00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 -- 172.21.15.50:0/1883325942 >> 172.21.15.50:0/1883325942 conn(0x7fcbc406a390 msgr2=0x7fcbc406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:34.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 -- 172.21.15.50:0/1883325942 shutdown_connections 2024-09-13T15:08:34.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 -- 172.21.15.50:0/1883325942 wait complete. 2024-09-13T15:08:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 Processor -- start 2024-09-13T15:08:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.540+0000 7fcbcb000700 1 -- start start 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 0x7fcbc41f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbc40b1980 0x7fcbc4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc41551e0 0x7fcbc4158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4156420 con 0x7fcbc406cd40 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4155810 con 0x7fcbc40b1980 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4155af0 con 0x7fcbc41551e0 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 0x7fcbc41f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 0x7fcbc41f9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51058/0 (socket says 172.21.15.50:51058) 2024-09-13T15:08:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 -- 172.21.15.50:0/116149512 learned_addr learned my addr 172.21.15.50:0/116149512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbca600700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc41551e0 0x7fcbc4158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9200700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbc40b1980 0x7fcbc4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 -- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc41551e0 msgr2=0x7fcbc4158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc41551e0 0x7fcbc4158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 -- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbc40b1980 msgr2=0x7fcbc4154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbc40b1980 0x7fcbc4154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 -- 172.21.15.50:0/116149512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80094b0 con 0x7fcbc406cd40 2024-09-13T15:08:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9200700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbc40b1980 0x7fcbc4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbca600700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc41551e0 0x7fcbc4158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc9c00700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 0x7fcbc41f9a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8000c00 tx=0x7fcbb8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb801aa00 con 0x7fcbc406cd40 2024-09-13T15:08:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb801f070 con 0x7fcbc406cd40 2024-09-13T15:08:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb801ada0 con 0x7fcbc406cd40 2024-09-13T15:08:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc4155dd0 con 0x7fcbc406cd40 2024-09-13T15:08:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.544+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc415b250 con 0x7fcbc406cd40 2024-09-13T15:08:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.548+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4156590 con 0x7fcbc406cd40 2024-09-13T15:08:34.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.548+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbb802e450 con 0x7fcbc406cd40 2024-09-13T15:08:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.552+0000 7fcbc1600700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcba4066730 0x7fcba4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.552+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcbb8085610 con 0x7fcbc406cd40 2024-09-13T15:08:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.552+0000 7fcbc9200700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcba4066730 0x7fcba4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.552+0000 7fcbc9200700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcba4066730 0x7fcba4068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40af9a0 tx=0x7fcbb0007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.556+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbb80525b0 con 0x7fcbc406cd40 2024-09-13T15:08:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.732+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbc4161e00 con 0x7fcbc406cd40 2024-09-13T15:08:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbc1600700 1 -- 172.21.15.50:0/116149512 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbb8055bd0 con 0x7fcbc406cd40 2024-09-13T15:08:34.739 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcba4066730 msgr2=0x7fcba4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcba4066730 0x7fcba4068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40af9a0 tx=0x7fcbb0007d50 comp rx=0 tx=0).stop 2024-09-13T15:08:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 msgr2=0x7fcbc41f9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 0x7fcbc41f9a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8000c00 tx=0x7fcbb8004770 comp rx=0 tx=0).stop 2024-09-13T15:08:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 shutdown_connections 2024-09-13T15:08:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcba4066730 0x7fcba4068bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbc41551e0 0x7fcbc4158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbc40b1980 0x7fcbc4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 --2- 172.21.15.50:0/116149512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbc406cd40 0x7fcbc41f9a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.736+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 >> 172.21.15.50:0/116149512 conn(0x7fcbc406a390 msgr2=0x7fcbc40ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.740+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 shutdown_connections 2024-09-13T15:08:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.740+0000 7fcbcb000700 1 -- 172.21.15.50:0/116149512 wait complete. 2024-09-13T15:08:34.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 Processor -- start 2024-09-13T15:08:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 -- start start 2024-09-13T15:08:34.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa434161120 0x7fa4340b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4340aee00 0x7fa434066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43406bab0 con 0x7fa434160630 2024-09-13T15:08:34.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43415cee0 con 0x7fa434161120 2024-09-13T15:08:34.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.936+0000 7fa433200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43406b1a0 con 0x7fa4340aee00 2024-09-13T15:08:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa431400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa434160630 0x7fa4340ae6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:54558/0 (socket says 172.21.15.50:54558) 2024-09-13T15:08:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa432800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4340aee00 0x7fa434066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa431400700 1 -- 172.21.15.50:0/3471076550 learned_addr learned my addr 172.21.15.50:0/3471076550 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa431e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa434161120 0x7fa4340b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa432800700 1 -- 172.21.15.50:0/3471076550 >> v2:172.21.15.181:3300/0 conn(0x7fa434161120 msgr2=0x7fa4340b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa432800700 1 --2- 172.21.15.50:0/3471076550 >> v2:172.21.15.181:3300/0 conn(0x7fa434161120 0x7fa4340b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa432800700 1 -- 172.21.15.50:0/3471076550 >> v1:172.21.15.181:6789/0 conn(0x7fa434160630 legacy=0x7fa4340ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa432800700 1 -- 172.21.15.50:0/3471076550 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340725a0 con 0x7fa4340aee00 2024-09-13T15:08:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa431e00700 1 --2- 172.21.15.50:0/3471076550 >> v2:172.21.15.181:3300/0 conn(0x7fa434161120 0x7fa4340b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa432800700 1 --2- 172.21.15.50:0/3471076550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4340aee00 0x7fa434066090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009d90 tx=0x7fa42c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ea85382ff67e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa430a00700 1 -- 172.21.15.50:0/3471076550 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00e070 con 0x7fa4340aee00 2024-09-13T15:08:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa430a00700 1 -- 172.21.15.50:0/3471076550 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00bb20 con 0x7fa4340aee00 2024-09-13T15:08:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.940+0000 7fa430a00700 1 -- 172.21.15.50:0/3471076550 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c012430 con 0x7fa4340aee00 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 -- 172.21.15.50:0/3471076550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4340aee00 msgr2=0x7fa434066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 --2- 172.21.15.50:0/3471076550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4340aee00 0x7fa434066090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009d90 tx=0x7fa42c00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 -- 172.21.15.50:0/3471076550 shutdown_connections 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 --2- 172.21.15.50:0/3471076550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4340aee00 0x7fa434066090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 --2- 172.21.15.50:0/3471076550 >> v2:172.21.15.181:3300/0 conn(0x7fa434161120 0x7fa4340b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 -- 172.21.15.50:0/3471076550 >> 172.21.15.50:0/3471076550 conn(0x7fa43406cb90 msgr2=0x7fa43406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 -- 172.21.15.50:0/3471076550 shutdown_connections 2024-09-13T15:08:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.944+0000 7fa433200700 1 -- 172.21.15.50:0/3471076550 wait complete. 2024-09-13T15:08:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 Processor -- start 2024-09-13T15:08:34.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 -- start start 2024-09-13T15:08:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 0x7fa434158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa434160630 0x7fa4340c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa434161120 0x7fa4340c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340c6c20 con 0x7fa434161120 2024-09-13T15:08:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340c5920 con 0x7fa4340aee00 2024-09-13T15:08:34.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa433200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340c5c00 con 0x7fa434160630 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa432800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa434161120 0x7fa4340c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa434160630 0x7fa4340c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 0x7fa434158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 0x7fa434158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:58790/0 (socket says 172.21.15.50:58790) 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 -- 172.21.15.50:0/1271942815 learned_addr learned my addr 172.21.15.50:0/1271942815 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 -- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa434160630 msgr2=0x7fa4340c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa434160630 0x7fa4340c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 -- 172.21.15.50:0/1271942815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa434161120 msgr2=0x7fa4340c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa434161120 0x7fa4340c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.948+0000 7fa431e00700 1 -- 172.21.15.50:0/1271942815 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240094b0 con 0x7fa4340aee00 2024-09-13T15:08:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa431e00700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 0x7fa434158430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa42400ebe0 tx=0x7fa42400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424009770 con 0x7fa4340aee00 2024-09-13T15:08:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42400c850 con 0x7fa4340aee00 2024-09-13T15:08:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400cbe0 con 0x7fa4340aee00 2024-09-13T15:08:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c009a70 con 0x7fa4340aee00 2024-09-13T15:08:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4340c61c0 con 0x7fa4340aee00 2024-09-13T15:08:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.952+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4340b1840 con 0x7fa4340aee00 2024-09-13T15:08:34.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.956+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa42400cd40 con 0x7fa4340aee00 2024-09-13T15:08:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.956+0000 7fa42a000700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4140667b0 0x7fa414068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.956+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa424084540 con 0x7fa4340aee00 2024-09-13T15:08:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.956+0000 7fa431400700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4140667b0 0x7fa414068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:34.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.956+0000 7fa431400700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4140667b0 0x7fa414068c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa4340b3150 tx=0x7fa420009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:34.964+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4240514d0 con 0x7fa4340aee00 2024-09-13T15:08:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.148+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4340afe60 con 0x7fa4340aee00 2024-09-13T15:08:35.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa42a000700 1 -- 172.21.15.50:0/1271942815 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa424054af0 con 0x7fa4340aee00 2024-09-13T15:08:35.155 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4140667b0 msgr2=0x7fa414068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4140667b0 0x7fa414068c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa4340b3150 tx=0x7fa420009040 comp rx=0 tx=0).stop 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 msgr2=0x7fa434158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 0x7fa434158430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa42400ebe0 tx=0x7fa42400eef0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 shutdown_connections 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4140667b0 0x7fa414068c70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa434161120 0x7fa4340c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa434160630 0x7fa4340c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 --2- 172.21.15.50:0/1271942815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4340aee00 0x7fa434158430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 >> 172.21.15.50:0/1271942815 conn(0x7fa43406cb90 msgr2=0x7fa43415f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 shutdown_connections 2024-09-13T15:08:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.152+0000 7fa433200700 1 -- 172.21.15.50:0/1271942815 wait complete. 2024-09-13T15:08:35.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:35.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:35.333 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.352+0000 7f224e400700 1 Processor -- start 2024-09-13T15:08:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.352+0000 7f224e400700 1 -- start start 2024-09-13T15:08:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224e400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f224806c960 0x7f2248161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224e400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f224806cd40 0x7f22480b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224e400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2248162340 con 0x7f22480b1980 2024-09-13T15:08:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224e400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480b2280 con 0x7f224806c960 2024-09-13T15:08:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224e400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480b2560 con 0x7f224806cd40 2024-09-13T15:08:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224da00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f22480b1980 0x7f2248162560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36658/0 (socket says 172.21.15.50:36658) 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224da00700 1 -- 172.21.15.50:0/633030888 learned_addr learned my addr 172.21.15.50:0/633030888 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247e00700 1 --2- 172.21.15.50:0/633030888 >> v2:172.21.15.181:3300/0 conn(0x7f224806cd40 0x7f22480b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f224d000700 1 --2- 172.21.15.50:0/633030888 >> v2:172.21.15.50:3300/0 conn(0x7f224806c960 0x7f2248161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247400700 1 -- 172.21.15.50:0/633030888 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740764936 0 0) 0x7f2248162340 con 0x7f22480b1980 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247e00700 1 -- 172.21.15.50:0/633030888 >> v2:172.21.15.50:3300/0 conn(0x7f224806c960 msgr2=0x7f2248161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247e00700 1 --2- 172.21.15.50:0/633030888 >> v2:172.21.15.50:3300/0 conn(0x7f224806c960 0x7f2248161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247e00700 1 -- 172.21.15.50:0/633030888 >> v1:172.21.15.50:6789/0 conn(0x7f22480b1980 legacy=0x7f2248162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247e00700 1 -- 172.21.15.50:0/633030888 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480b2840 con 0x7f224806cd40 2024-09-13T15:08:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247e00700 1 --2- 172.21.15.50:0/633030888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f22480b3320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22480cb1d0 tx=0x7f2234009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605d1a3cff5877b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247400700 1 -- 172.21.15.50:0/633030888 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234011830 con 0x7f224806cd40 2024-09-13T15:08:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247400700 1 -- 172.21.15.50:0/633030888 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234011990 con 0x7f224806cd40 2024-09-13T15:08:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.356+0000 7f2247400700 1 -- 172.21.15.50:0/633030888 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234011d20 con 0x7f224806cd40 2024-09-13T15:08:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 -- 172.21.15.50:0/633030888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 msgr2=0x7f22480b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 --2- 172.21.15.50:0/633030888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f22480b3320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22480cb1d0 tx=0x7f2234009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 -- 172.21.15.50:0/633030888 shutdown_connections 2024-09-13T15:08:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 --2- 172.21.15.50:0/633030888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f22480b3320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 --2- 172.21.15.50:0/633030888 >> v2:172.21.15.50:3300/0 conn(0x7f224806c960 0x7f2248161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 -- 172.21.15.50:0/633030888 >> 172.21.15.50:0/633030888 conn(0x7f224806a390 msgr2=0x7f224806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 -- 172.21.15.50:0/633030888 shutdown_connections 2024-09-13T15:08:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 -- 172.21.15.50:0/633030888 wait complete. 2024-09-13T15:08:35.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 Processor -- start 2024-09-13T15:08:35.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.360+0000 7f224e400700 1 -- start start 2024-09-13T15:08:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f224806c960 0x7f2248155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f2248143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 0x7f2248157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481e9e10 con 0x7f22480b1980 2024-09-13T15:08:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248155950 con 0x7f224806cd40 2024-09-13T15:08:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22481e94e0 con 0x7f224806c960 2024-09-13T15:08:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 0x7f2248157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 0x7f2248157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51090/0 (socket says 172.21.15.50:51090) 2024-09-13T15:08:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 -- 172.21.15.50:0/3763611476 learned_addr learned my addr 172.21.15.50:0/3763611476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f2247e00700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f2248143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224d000700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f224806c960 0x7f2248155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 -- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f224806c960 msgr2=0x7f2248155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f224806c960 0x7f2248155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 -- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 msgr2=0x7f2248143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f2248143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 -- 172.21.15.50:0/3763611476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340094b0 con 0x7f22480b1980 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224da00700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 0x7f2248157070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f224000cc70 tx=0x7f224000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000ada0 con 0x7f22480b1980 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224000ce70 con 0x7f22480b1980 2024-09-13T15:08:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22481e97c0 con 0x7f22480b1980 2024-09-13T15:08:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400072f0 con 0x7f22480b1980 2024-09-13T15:08:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.364+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2248143e40 con 0x7f22480b1980 2024-09-13T15:08:35.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.368+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22481e9fc0 con 0x7f22480b1980 2024-09-13T15:08:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.368+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2240007450 con 0x7f22480b1980 2024-09-13T15:08:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.368+0000 7f2244c00700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2228066730 0x7f2228068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.368+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22400843a0 con 0x7f22480b1980 2024-09-13T15:08:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.368+0000 7f224d000700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2228066730 0x7f2228068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.372+0000 7f224d000700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2228066730 0x7f2228068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f223c009ae0 tx=0x7f223c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.376+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22481e9fc0 con 0x7f22480b1980 2024-09-13T15:08:35.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.556+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f22481e9fc0 con 0x7f22480b1980 2024-09-13T15:08:35.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.560+0000 7f2244c00700 1 -- 172.21.15.50:0/3763611476 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f22481e9fc0 con 0x7f22480b1980 2024-09-13T15:08:35.563 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.560+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2228066730 msgr2=0x7f2228068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.560+0000 7f224e400700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2228066730 0x7f2228068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f223c009ae0 tx=0x7f223c008040 comp rx=0 tx=0).stop 2024-09-13T15:08:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.560+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 msgr2=0x7f2248157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.560+0000 7f224e400700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 0x7f2248157070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f224000cc70 tx=0x7f224000a340 comp rx=0 tx=0).stop 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 shutdown_connections 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2228066730 0x7f2228068bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22480b1980 0x7f2248157070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f224806cd40 0x7f2248143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 --2- 172.21.15.50:0/3763611476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f224806c960 0x7f2248155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 >> 172.21.15.50:0/3763611476 conn(0x7f224806a390 msgr2=0x7f224806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 shutdown_connections 2024-09-13T15:08:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.564+0000 7f224e400700 1 -- 172.21.15.50:0/3763611476 wait complete. 2024-09-13T15:08:35.603 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2024-09-13T15:08:35.603 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T15:08:35.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.780+0000 7f9286000700 1 Processor -- start 2024-09-13T15:08:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.780+0000 7f9286000700 1 -- start start 2024-09-13T15:08:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9286000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f92800719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9286000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f928006aaa0 0x7f928006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9286000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800b3560 con 0x7f92800b2670 2024-09-13T15:08:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9286000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9280070b30 con 0x7f928006aaa0 2024-09-13T15:08:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9286000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928006b420 con 0x7f92801610b0 2024-09-13T15:08:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9277e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f928006aaa0 0x7f928006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9285600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92800b2670 0x7f92800cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36672/0 (socket says 172.21.15.50:36672) 2024-09-13T15:08:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9285600700 1 -- 172.21.15.50:0/4280037936 learned_addr learned my addr 172.21.15.50:0/4280037936 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9284c00700 1 --2- 172.21.15.50:0/4280037936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f92800719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f927fe00700 1 -- 172.21.15.50:0/4280037936 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75258947 0 0) 0x7f92800b3560 con 0x7f92800b2670 2024-09-13T15:08:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9277e00700 1 -- 172.21.15.50:0/4280037936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 msgr2=0x7f92800719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9277e00700 1 --2- 172.21.15.50:0/4280037936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f92800719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9277e00700 1 -- 172.21.15.50:0/4280037936 >> v1:172.21.15.50:6789/0 conn(0x7f92800b2670 legacy=0x7f92800cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.784+0000 7f9277e00700 1 -- 172.21.15.50:0/4280037936 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800b3280 con 0x7f928006aaa0 2024-09-13T15:08:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9277e00700 1 --2- 172.21.15.50:0/4280037936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928006aee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f9268009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4325d5b2454b26ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f927fe00700 1 -- 172.21.15.50:0/4280037936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268011830 con 0x7f928006aaa0 2024-09-13T15:08:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f927fe00700 1 -- 172.21.15.50:0/4280037936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268011990 con 0x7f928006aaa0 2024-09-13T15:08:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f927fe00700 1 -- 172.21.15.50:0/4280037936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268011d40 con 0x7f928006aaa0 2024-09-13T15:08:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 -- 172.21.15.50:0/4280037936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 msgr2=0x7f928006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 --2- 172.21.15.50:0/4280037936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928006aee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f9268009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 -- 172.21.15.50:0/4280037936 shutdown_connections 2024-09-13T15:08:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 --2- 172.21.15.50:0/4280037936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928006aee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 --2- 172.21.15.50:0/4280037936 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f92800719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 -- 172.21.15.50:0/4280037936 >> 172.21.15.50:0/4280037936 conn(0x7f92800b0c40 msgr2=0x7f928006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 -- 172.21.15.50:0/4280037936 shutdown_connections 2024-09-13T15:08:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.788+0000 7f9286000700 1 -- 172.21.15.50:0/4280037936 wait complete. 2024-09-13T15:08:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 Processor -- start 2024-09-13T15:08:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 -- start start 2024-09-13T15:08:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92800b2670 0x7f9280161780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f9280161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280162f00 con 0x7f928006aaa0 2024-09-13T15:08:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280148210 con 0x7f92800b2670 2024-09-13T15:08:35.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9286000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92801622f0 con 0x7f92801610b0 2024-09-13T15:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928014a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51106/0 (socket says 172.21.15.50:51106) 2024-09-13T15:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 -- 172.21.15.50:0/653189731 learned_addr learned my addr 172.21.15.50:0/653189731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9277e00700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92800b2670 0x7f9280161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9285600700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f9280161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 -- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 msgr2=0x7f9280161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f9280161cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 -- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92800b2670 msgr2=0x7f9280161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92800b2670 0x7f9280161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.792+0000 7f9284c00700 1 -- 172.21.15.50:0/653189731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680094b0 con 0x7f928006aaa0 2024-09-13T15:08:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f9284c00700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928014a250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f927000e9d0 tx=0x7f927000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270009720 con 0x7f928006aaa0 2024-09-13T15:08:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000ee70 con 0x7f928006aaa0 2024-09-13T15:08:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000ca50 con 0x7f928006aaa0 2024-09-13T15:08:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92801625d0 con 0x7f928006aaa0 2024-09-13T15:08:35.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9280162b90 con 0x7f928006aaa0 2024-09-13T15:08:35.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280161570 con 0x7f928006aaa0 2024-09-13T15:08:35.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.796+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f927000cbb0 con 0x7f928006aaa0 2024-09-13T15:08:35.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.800+0000 7f927d600700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:35.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.800+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9270084590 con 0x7f928006aaa0 2024-09-13T15:08:35.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.800+0000 7f9277e00700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:35.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.800+0000 7f9277e00700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f925c066730 0x7f925c068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f926801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:35.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.804+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92700514a0 con 0x7f928006aaa0 2024-09-13T15:08:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:35.996+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92800b22c0 con 0x7f928006aaa0 2024-09-13T15:08:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.000+0000 7f927d600700 1 -- 172.21.15.50:0/653189731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f927000ce60 con 0x7f928006aaa0 2024-09-13T15:08:36.003 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:36.003 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.000+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f925c066730 msgr2=0x7f925c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.000+0000 7f9286000700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f925c066730 0x7f925c068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f926801c040 comp rx=0 tx=0).stop 2024-09-13T15:08:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.000+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 msgr2=0x7f928014a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.000+0000 7f9286000700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928014a250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f927000e9d0 tx=0x7f927000ece0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.000+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 shutdown_connections 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92801610b0 0x7f9280161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92800b2670 0x7f9280161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 --2- 172.21.15.50:0/653189731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f928006aaa0 0x7f928014a250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 >> 172.21.15.50:0/653189731 conn(0x7f92800b0c40 msgr2=0x7f92800b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 shutdown_connections 2024-09-13T15:08:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.004+0000 7f9286000700 1 -- 172.21.15.50:0/653189731 wait complete. 2024-09-13T15:08:36.029 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:36.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:36.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.216+0000 7fefcb000700 1 Processor -- start 2024-09-13T15:08:36.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.216+0000 7fefcb000700 1 -- start start 2024-09-13T15:08:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefcb000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefc415e030 0x7fefc40ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefcb000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefc40cd140 0x7fefc40cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefcb000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc40b57e0 con 0x7fefc4157500 2024-09-13T15:08:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefcb000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc40cdb30 con 0x7fefc40cd140 2024-09-13T15:08:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefcb000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc40b3b80 con 0x7fefc415e030 2024-09-13T15:08:36.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefc40cd140 0x7fefc40cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefc415e030 0x7fefc40ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefc40cd140 0x7fefc40cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51116/0 (socket says 172.21.15.50:51116) 2024-09-13T15:08:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 -- 172.21.15.50:0/1418699981 learned_addr learned my addr 172.21.15.50:0/1418699981 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 -- 172.21.15.50:0/1418699981 >> v2:172.21.15.181:3300/0 conn(0x7fefc415e030 msgr2=0x7fefc40ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 --2- 172.21.15.50:0/1418699981 >> v2:172.21.15.181:3300/0 conn(0x7fefc415e030 0x7fefc40ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 -- 172.21.15.50:0/1418699981 >> v1:172.21.15.181:6789/0 conn(0x7fefc4157500 legacy=0x7fefc4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 -- 172.21.15.50:0/1418699981 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc40b5a80 con 0x7fefc40cd140 2024-09-13T15:08:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc9000700 1 --2- 172.21.15.50:0/1418699981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc40cd140 0x7fefc40cd5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009e50 tx=0x7fefbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d544f9a7f1c6814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc2a00700 1 -- 172.21.15.50:0/1418699981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00e070 con 0x7fefc40cd140 2024-09-13T15:08:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc2a00700 1 -- 172.21.15.50:0/1418699981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc00b8d0 con 0x7fefc40cd140 2024-09-13T15:08:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.220+0000 7fefc2a00700 1 -- 172.21.15.50:0/1418699981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00bc80 con 0x7fefc40cd140 2024-09-13T15:08:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 -- 172.21.15.50:0/1418699981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc40cd140 msgr2=0x7fefc40cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 --2- 172.21.15.50:0/1418699981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc40cd140 0x7fefc40cd5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009e50 tx=0x7fefbc00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 -- 172.21.15.50:0/1418699981 shutdown_connections 2024-09-13T15:08:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 --2- 172.21.15.50:0/1418699981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc40cd140 0x7fefc40cd5f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 --2- 172.21.15.50:0/1418699981 >> v2:172.21.15.181:3300/0 conn(0x7fefc415e030 0x7fefc40ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 -- 172.21.15.50:0/1418699981 >> 172.21.15.50:0/1418699981 conn(0x7fefc406e660 msgr2=0x7fefc406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 -- 172.21.15.50:0/1418699981 shutdown_connections 2024-09-13T15:08:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 -- 172.21.15.50:0/1418699981 wait complete. 2024-09-13T15:08:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 Processor -- start 2024-09-13T15:08:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.224+0000 7fefcb000700 1 -- start start 2024-09-13T15:08:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefc40cd140 0x7fefc4143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefc4157500 0x7fefc41f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 0x7fefc40cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc406aed0 con 0x7fefc415e030 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc41439c0 con 0x7fefc4157500 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc40ccb30 con 0x7fefc40cd140 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 0x7fefc40cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 0x7fefc40cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51124/0 (socket says 172.21.15.50:51124) 2024-09-13T15:08:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 -- 172.21.15.50:0/899201508 learned_addr learned my addr 172.21.15.50:0/899201508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc3e00700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefc40cd140 0x7fefc4143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc3400700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefc4157500 0x7fefc41f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 -- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefc40cd140 msgr2=0x7fefc4143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefc40cd140 0x7fefc4143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 -- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefc4157500 msgr2=0x7fefc41f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefc4157500 0x7fefc41f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 -- 172.21.15.50:0/899201508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc009b30 con 0x7fefc415e030 2024-09-13T15:08:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefc9000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 0x7fefc40cc5f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefc406f5c0 tx=0x7fefbc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc004960 con 0x7fefc415e030 2024-09-13T15:08:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc0092e0 con 0x7fefc415e030 2024-09-13T15:08:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc406a530 con 0x7fefc415e030 2024-09-13T15:08:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc01c680 con 0x7fefc415e030 2024-09-13T15:08:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.228+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc406aaf0 con 0x7fefc415e030 2024-09-13T15:08:36.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.232+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc406b010 con 0x7fefc415e030 2024-09-13T15:08:36.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.232+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefbc01c7e0 con 0x7fefc415e030 2024-09-13T15:08:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.232+0000 7fefbbe00700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefa4066730 0x7fefa4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.232+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fefbc0861d0 con 0x7fefc415e030 2024-09-13T15:08:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.236+0000 7fefc3e00700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefa4066730 0x7fefa4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.236+0000 7fefc3e00700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefa4066730 0x7fefa4068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ccf00 tx=0x7fefb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.240+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fefc406b010 con 0x7fefc415e030 2024-09-13T15:08:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.424+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefc406b010 con 0x7fefc415e030 2024-09-13T15:08:36.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefbbe00700 1 -- 172.21.15.50:0/899201508 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefc406b010 con 0x7fefc415e030 2024-09-13T15:08:36.431 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefa4066730 msgr2=0x7fefa4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefa4066730 0x7fefa4068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ccf00 tx=0x7fefb4009040 comp rx=0 tx=0).stop 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 msgr2=0x7fefc40cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 0x7fefc40cc5f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefc406f5c0 tx=0x7fefbc004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 shutdown_connections 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefa4066730 0x7fefa4068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc415e030 0x7fefc40cc5f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefc4157500 0x7fefc41f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 --2- 172.21.15.50:0/899201508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefc40cd140 0x7fefc4143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 >> 172.21.15.50:0/899201508 conn(0x7fefc406e660 msgr2=0x7fefc40d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:36.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 shutdown_connections 2024-09-13T15:08:36.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.428+0000 7fefcb000700 1 -- 172.21.15.50:0/899201508 wait complete. 2024-09-13T15:08:36.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.644+0000 7f99efe00700 1 Processor -- start 2024-09-13T15:08:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.644+0000 7f99efe00700 1 -- start start 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99efe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99f0145ac0 0x7f99f0145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99efe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00aed70 con 0x7f99f0146490 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99efe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f006a390 con 0x7f99f0066090 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99efe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f006bc00 con 0x7f99f0145ac0 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99e6000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99f0146490 0x7f99f006b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36682/0 (socket says 172.21.15.50:36682) 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99e6000700 1 -- 172.21.15.50:0/2215483896 learned_addr learned my addr 172.21.15.50:0/2215483896 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:36.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99eea00700 1 --2- 172.21.15.50:0/2215483896 >> v2:172.21.15.181:3300/0 conn(0x7f99f0145ac0 0x7f99f0145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230939723 0 0) 0x7f99d8001110 con 0x7f99f0146490 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d40035d0 con 0x7f99f0146490 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1392034585 0 0) 0x7f99d40035d0 con 0x7f99f0146490 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 >> v2:172.21.15.181:3300/0 conn(0x7f99f0145ac0 msgr2=0x7f99f0145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 --2- 172.21.15.50:0/2215483896 >> v2:172.21.15.181:3300/0 conn(0x7f99f0145ac0 0x7f99f0145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 >> v1:172.21.15.181:6789/0 conn(0x7f99f0066090 legacy=0x7f99f00ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f006a5e0 con 0x7f99f0146490 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f99d8001800 con 0x7f99f0146490 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 >> v1:172.21.15.50:6789/0 conn(0x7f99f0146490 legacy=0x7f99f006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99d4003a20 0x7f99d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99d40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99d4005190 0x7f99d400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f006bc00 con 0x7f99d4004420 2024-09-13T15:08:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d400c0d0 con 0x7f99d4005190 2024-09-13T15:08:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d400c290 con 0x7f99d4003a20 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99e6000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99d40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99ef400700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99d4005190 0x7f99d400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.648+0000 7f99eea00700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99d4003a20 0x7f99d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99e6000700 1 -- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99d4003a20 msgr2=0x7f99d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99e6000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99d4003a20 0x7f99d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99e6000700 1 -- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99d4005190 msgr2=0x7f99d400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99e6000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99d4005190 0x7f99d400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99e6000700 1 -- 172.21.15.50:0/2215483896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40035d0 con 0x7f99d4004420 2024-09-13T15:08:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99ef400700 1 -- 172.21.15.50:0/2215483896 reap_dead start 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99e6000700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99d40048f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c320 tx=0x7f99d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188c58a3e9ede63d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800ce60 con 0x7f99d4004420 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8005980 con 0x7f99d4004420 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99ee000700 1 -- 172.21.15.50:0/2215483896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8005d30 con 0x7f99d4004420 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 -- 172.21.15.50:0/2215483896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 msgr2=0x7f99d40048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99d40048f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c320 tx=0x7f99d40058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 -- 172.21.15.50:0/2215483896 shutdown_connections 2024-09-13T15:08:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 --2- 172.21.15.50:0/2215483896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99d40048f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 -- 172.21.15.50:0/2215483896 >> 172.21.15.50:0/2215483896 conn(0x7f99f0070d10 msgr2=0x7f99f00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 -- 172.21.15.50:0/2215483896 shutdown_connections 2024-09-13T15:08:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.652+0000 7f99efe00700 1 -- 172.21.15.50:0/2215483896 wait complete. 2024-09-13T15:08:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 Processor -- start 2024-09-13T15:08:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 -- start start 2024-09-13T15:08:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99f013da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99f01f37f0 0x7f99f01f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99f01f2b70 0x7f99f00ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f013ae10 con 0x7f99d4004420 2024-09-13T15:08:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f013b3b0 con 0x7f99f01f37f0 2024-09-13T15:08:36.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99efe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f01f3160 con 0x7f99f01f2b70 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.656+0000 7f99eea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99f013da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99f013da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51130/0 (socket says 172.21.15.50:51130) 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 -- 172.21.15.50:0/3315235525 learned_addr learned my addr 172.21.15.50:0/3315235525 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99e6000700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99f01f37f0 0x7f99f01f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99ef400700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99f01f2b70 0x7f99f00ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 -- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99f01f2b70 msgr2=0x7f99f00ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99f01f2b70 0x7f99f00ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 -- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99f01f37f0 msgr2=0x7f99f01f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99f01f37f0 0x7f99f01f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 -- 172.21.15.50:0/3315235525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f01f3440 con 0x7f99d4004420 2024-09-13T15:08:36.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99ef400700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99f01f2b70 0x7f99f00ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:36.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99eea00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99f013da70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99e0011600 tx=0x7f99e0011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:36.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0015870 con 0x7f99d4004420 2024-09-13T15:08:36.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00159d0 con 0x7f99d4004420 2024-09-13T15:08:36.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f013b040 con 0x7f99d4004420 2024-09-13T15:08:36.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0015d40 con 0x7f99d4004420 2024-09-13T15:08:36.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f0144ec0 con 0x7f99d4004420 2024-09-13T15:08:36.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.660+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f013b1d0 con 0x7f99d4004420 2024-09-13T15:08:36.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.664+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99e0013400 con 0x7f99d4004420 2024-09-13T15:08:36.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.664+0000 7f99e7400700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99cc066760 0x7f99cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:36.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.664+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99e0084800 con 0x7f99d4004420 2024-09-13T15:08:36.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.664+0000 7f99e6000700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99cc066760 0x7f99cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:36.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.668+0000 7f99e6000700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99cc066760 0x7f99cc068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f99d8001ac0 tx=0x7f99d8007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:36.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.672+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99e0051710 con 0x7f99d4004420 2024-09-13T15:08:36.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99f006b810 con 0x7f99d4004420 2024-09-13T15:08:36.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99e7400700 1 -- 172.21.15.50:0/3315235525 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99e0054d30 con 0x7f99d4004420 2024-09-13T15:08:36.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99cc066760 msgr2=0x7f99cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99cc066760 0x7f99cc068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f99d8001ac0 tx=0x7f99d8007000 comp rx=0 tx=0).stop 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 msgr2=0x7f99f013da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99f013da70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99e0011600 tx=0x7f99e0011910 comp rx=0 tx=0).stop 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 shutdown_connections 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99cc066760 0x7f99cc068c20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99f01f2b70 0x7f99f00ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99f01f37f0 0x7f99f01f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 --2- 172.21.15.50:0/3315235525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d4004420 0x7f99f013da70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:36.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 >> 172.21.15.50:0/3315235525 conn(0x7f99f0070d10 msgr2=0x7f99f00b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:36.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.856+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 shutdown_connections 2024-09-13T15:08:36.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:36.860+0000 7f99efe00700 1 -- 172.21.15.50:0/3315235525 wait complete. 2024-09-13T15:08:36.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.056+0000 7f86ef200700 1 Processor -- start 2024-09-13T15:08:37.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.056+0000 7f86ef200700 1 -- start start 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ef200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86f0160d30 0x7f86f006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ef200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f006d150 0x7f86f006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ef200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f00b0020 con 0x7f86f0161110 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ef200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f00d1770 con 0x7f86f0160d30 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ef200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00d03f0 con 0x7f86f006d150 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ee800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86f0161110 0x7f86f0164a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36690/0 (socket says 172.21.15.50:36690) 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ee800700 1 -- 172.21.15.50:0/1272662537 learned_addr learned my addr 172.21.15.50:0/1272662537 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ede00700 1 --2- 172.21.15.50:0/1272662537 >> v2:172.21.15.50:3300/0 conn(0x7f86f0160d30 0x7f86f006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ed400700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f006d150 0x7f86f006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86eca00700 1 -- 172.21.15.50:0/1272662537 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964200160 0 0) 0x7f86f00b0020 con 0x7f86f0161110 2024-09-13T15:08:37.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86eca00700 1 -- 172.21.15.50:0/1272662537 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d40035d0 con 0x7f86f0161110 2024-09-13T15:08:37.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ede00700 1 -- 172.21.15.50:0/1272662537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f006d150 msgr2=0x7f86f006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ede00700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f006d150 0x7f86f006ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ede00700 1 -- 172.21.15.50:0/1272662537 >> v1:172.21.15.50:6789/0 conn(0x7f86f0161110 legacy=0x7f86f0164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ede00700 1 -- 172.21.15.50:0/1272662537 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00d06d0 con 0x7f86f0160d30 2024-09-13T15:08:37.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.060+0000 7f86ed400700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f006d150 0x7f86f006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:37.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ede00700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0160d30 0x7f86f006cc10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009850 tx=0x7f86e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8e929fec3fa6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86eca00700 1 -- 172.21.15.50:0/1272662537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011830 con 0x7f86f0160d30 2024-09-13T15:08:37.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86eca00700 1 -- 172.21.15.50:0/1272662537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0011990 con 0x7f86f0160d30 2024-09-13T15:08:37.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86eca00700 1 -- 172.21.15.50:0/1272662537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011d40 con 0x7f86f0160d30 2024-09-13T15:08:37.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 -- 172.21.15.50:0/1272662537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0160d30 msgr2=0x7f86f006cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0160d30 0x7f86f006cc10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009850 tx=0x7f86e0009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:37.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 -- 172.21.15.50:0/1272662537 shutdown_connections 2024-09-13T15:08:37.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f006d150 0x7f86f006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 --2- 172.21.15.50:0/1272662537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f0160d30 0x7f86f006cc10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 -- 172.21.15.50:0/1272662537 >> 172.21.15.50:0/1272662537 conn(0x7f86f0071d20 msgr2=0x7f86f0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:37.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 -- 172.21.15.50:0/1272662537 shutdown_connections 2024-09-13T15:08:37.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.064+0000 7f86ef200700 1 -- 172.21.15.50:0/1272662537 wait complete. 2024-09-13T15:08:37.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.068+0000 7f86ef200700 1 Processor -- start 2024-09-13T15:08:37.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.068+0000 7f86ef200700 1 -- start start 2024-09-13T15:08:37.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 0x7f86f015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f0160d30 0x7f86f01f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f0161110 0x7f86f0159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f015f3d0 con 0x7f86f006d150 2024-09-13T15:08:37.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f015b6f0 con 0x7f86f0161110 2024-09-13T15:08:37.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01f73e0 con 0x7f86f0160d30 2024-09-13T15:08:37.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 0x7f86f015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 0x7f86f015f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51134/0 (socket says 172.21.15.50:51134) 2024-09-13T15:08:37.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 -- 172.21.15.50:0/1678905870 learned_addr learned my addr 172.21.15.50:0/1678905870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:37.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ed400700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f0160d30 0x7f86f01f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ee800700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f0161110 0x7f86f0159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 -- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f0160d30 msgr2=0x7f86f01f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f0160d30 0x7f86f01f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 -- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f0161110 msgr2=0x7f86f0159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f0161110 0x7f86f0159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 -- 172.21.15.50:0/1678905870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094b0 con 0x7f86f006d150 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ee800700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f0161110 0x7f86f0159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ede00700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 0x7f86f015f7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86f00d1a40 tx=0x7f86e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0004380 con 0x7f86f006d150 2024-09-13T15:08:37.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e001f070 con 0x7f86f006d150 2024-09-13T15:08:37.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00094b0 con 0x7f86f006d150 2024-09-13T15:08:37.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00036c0 con 0x7f86f006d150 2024-09-13T15:08:37.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.072+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f015ea30 con 0x7f86f006d150 2024-09-13T15:08:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.076+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f006cc10 con 0x7f86f006d150 2024-09-13T15:08:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.076+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86e0021030 con 0x7f86f006d150 2024-09-13T15:08:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.076+0000 7f86e6000700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86d0066730 0x7f86d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.076+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f86e0085830 con 0x7f86f006d150 2024-09-13T15:08:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.080+0000 7f86ed400700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86d0066730 0x7f86d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.080+0000 7f86ed400700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86d0066730 0x7f86d0068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86f01580d0 tx=0x7f86dc009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.084+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f86e00527d0 con 0x7f86f006d150 2024-09-13T15:08:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.264+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86f00afe20 con 0x7f86f006d150 2024-09-13T15:08:37.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.268+0000 7f86e6000700 1 -- 172.21.15.50:0/1678905870 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86e0006ce0 con 0x7f86f006d150 2024-09-13T15:08:37.270 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:37.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86d0066730 msgr2=0x7f86d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86d0066730 0x7f86d0068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86f01580d0 tx=0x7f86dc009240 comp rx=0 tx=0).stop 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 msgr2=0x7f86f015f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 0x7f86f015f7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86f00d1a40 tx=0x7f86e0004770 comp rx=0 tx=0).stop 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 shutdown_connections 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f86d0066730 0x7f86d0068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86f0161110 0x7f86f0159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86f0160d30 0x7f86f01f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 --2- 172.21.15.50:0/1678905870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f006d150 0x7f86f015f7f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 >> 172.21.15.50:0/1678905870 conn(0x7f86f0071d20 msgr2=0x7f86f01617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 shutdown_connections 2024-09-13T15:08:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.272+0000 7f86ef200700 1 -- 172.21.15.50:0/1678905870 wait complete. 2024-09-13T15:08:37.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:37.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 Processor -- start 2024-09-13T15:08:37.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 -- start start 2024-09-13T15:08:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9ac1464c0 0x7fb9ac071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9ac0b1980 0x7fb9ac0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac06c960 0x7fb9ac06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac06d330 con 0x7fb9ac1464c0 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac070da0 con 0x7fb9ac0b1980 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.472+0000 7fb9b0e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0b2440 con 0x7fb9ac06c960 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9ab400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9ac1464c0 0x7fb9ac071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9ac0b1980 0x7fb9ac0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9ac0b1980 0x7fb9ac0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:58890/0 (socket says 172.21.15.50:58890) 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 -- 172.21.15.50:0/116388574 learned_addr learned my addr 172.21.15.50:0/116388574 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9abe00700 1 --2- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac06c960 0x7fb9ac06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 -- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac06c960 msgr2=0x7fb9ac06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 --2- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac06c960 0x7fb9ac06cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 -- 172.21.15.50:0/116388574 >> v2:172.21.15.50:3300/0 conn(0x7fb9ac1464c0 msgr2=0x7fb9ac071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 --2- 172.21.15.50:0/116388574 >> v2:172.21.15.50:3300/0 conn(0x7fb9ac1464c0 0x7fb9ac071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 -- 172.21.15.50:0/116388574 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0b2720 con 0x7fb9ac0b1980 2024-09-13T15:08:37.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aaa00700 1 --2- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac0b1df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac06dae0 tx=0x7fb998009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe6622d54d90b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aa000700 1 -- 172.21.15.50:0/116388574 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998011830 con 0x7fb9ac0b1980 2024-09-13T15:08:37.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aa000700 1 -- 172.21.15.50:0/116388574 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998011990 con 0x7fb9ac0b1980 2024-09-13T15:08:37.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9aa000700 1 -- 172.21.15.50:0/116388574 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998011d20 con 0x7fb9ac0b1980 2024-09-13T15:08:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 -- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0b1980 msgr2=0x7fb9ac0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac0b1df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac06dae0 tx=0x7fb998009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 -- 172.21.15.50:0/116388574 shutdown_connections 2024-09-13T15:08:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac06c960 0x7fb9ac06cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/116388574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac0b1df0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/116388574 >> v2:172.21.15.50:3300/0 conn(0x7fb9ac1464c0 0x7fb9ac071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 -- 172.21.15.50:0/116388574 >> 172.21.15.50:0/116388574 conn(0x7fb9ac06a390 msgr2=0x7fb9ac06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 -- 172.21.15.50:0/116388574 shutdown_connections 2024-09-13T15:08:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.476+0000 7fb9b0e00700 1 -- 172.21.15.50:0/116388574 wait complete. 2024-09-13T15:08:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 Processor -- start 2024-09-13T15:08:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 -- start start 2024-09-13T15:08:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac06c960 0x7fb9ac0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac1464c0 0x7fb9ac13b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0ce250 con 0x7fb9ac0b1980 2024-09-13T15:08:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac15f570 con 0x7fb9ac06c960 2024-09-13T15:08:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.480+0000 7fb9b0e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0cdc40 con 0x7fb9ac1464c0 2024-09-13T15:08:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9aaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9aaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac15c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51140/0 (socket says 172.21.15.50:51140) 2024-09-13T15:08:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9aaa00700 1 -- 172.21.15.50:0/432686059 learned_addr learned my addr 172.21.15.50:0/432686059 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac06c960 0x7fb9ac0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9abe00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac1464c0 0x7fb9ac13b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 -- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac1464c0 msgr2=0x7fb9ac13b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac1464c0 0x7fb9ac13b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 -- 172.21.15.50:0/432686059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 msgr2=0x7fb9ac15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac15c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 -- 172.21.15.50:0/432686059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998009570 con 0x7fb9ac06c960 2024-09-13T15:08:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9aaa00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9ab400700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac06c960 0x7fb9ac0cb4e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e900 tx=0x7fb99c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c013680 con 0x7fb9ac06c960 2024-09-13T15:08:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c0137e0 con 0x7fb9ac06c960 2024-09-13T15:08:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac15f290 con 0x7fb9ac06c960 2024-09-13T15:08:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c013b50 con 0x7fb9ac06c960 2024-09-13T15:08:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac0cba20 con 0x7fb9ac06c960 2024-09-13T15:08:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.484+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac06cdf0 con 0x7fb9ac06c960 2024-09-13T15:08:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.488+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb99c013cb0 con 0x7fb9ac06c960 2024-09-13T15:08:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.488+0000 7fb9a3400700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb98c066760 0x7fb98c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.488+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb99c0844c0 con 0x7fb9ac06c960 2024-09-13T15:08:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.488+0000 7fb9aaa00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb98c066760 0x7fb98c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.492+0000 7fb9aaa00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb98c066760 0x7fb98c068c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac15cec0 tx=0x7fb998008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.500+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb99c051460 con 0x7fb9ac06c960 2024-09-13T15:08:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.696+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb9ac143870 con 0x7fb9ac06c960 2024-09-13T15:08:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.696+0000 7fb9a3400700 1 -- 172.21.15.50:0/432686059 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb99c054a80 con 0x7fb9ac06c960 2024-09-13T15:08:37.701 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb98c066760 msgr2=0x7fb98c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb98c066760 0x7fb98c068c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac15cec0 tx=0x7fb998008030 comp rx=0 tx=0).stop 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac06c960 msgr2=0x7fb9ac0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac06c960 0x7fb9ac0cb4e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e900 tx=0x7fb99c00ec10 comp rx=0 tx=0).stop 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 shutdown_connections 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb98c066760 0x7fb98c068c20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9ac1464c0 0x7fb9ac13b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9ac0b1980 0x7fb9ac15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 --2- 172.21.15.50:0/432686059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9ac06c960 0x7fb9ac0cb4e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 >> 172.21.15.50:0/432686059 conn(0x7fb9ac06a390 msgr2=0x7fb9ac0ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 shutdown_connections 2024-09-13T15:08:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.704+0000 7fb9b0e00700 1 -- 172.21.15.50:0/432686059 wait complete. 2024-09-13T15:08:37.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-13T15:08:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.892+0000 7fe316200700 1 Processor -- start 2024-09-13T15:08:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.892+0000 7fe316200700 1 -- start start 2024-09-13T15:08:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe316200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 0x7fe3100717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe316200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe310073660 0x7fe3100adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe316200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3100ae4c0 con 0x7fe31015cf50 2024-09-13T15:08:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe316200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100ae6f0 con 0x7fe310073660 2024-09-13T15:08:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe316200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100b4150 con 0x7fe31006dc80 2024-09-13T15:08:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe314e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe31015cf50 0x7fe31006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36700/0 (socket says 172.21.15.50:36700) 2024-09-13T15:08:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.896+0000 7fe314e00700 1 -- 172.21.15.50:0/3024713007 learned_addr learned my addr 172.21.15.50:0/3024713007 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140044118 0 0) 0x7fe3100ae4c0 con 0x7fe31015cf50 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe315800700 1 --2- 172.21.15.50:0/3024713007 >> v2:172.21.15.181:3300/0 conn(0x7fe310073660 0x7fe3100adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f80035d0 con 0x7fe31015cf50 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 0x7fe3100717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461572906 0 0) 0x7fe2f80035d0 con 0x7fe31015cf50 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 msgr2=0x7fe3100717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 0x7fe3100717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 >> v2:172.21.15.181:3300/0 conn(0x7fe310073660 msgr2=0x7fe3100adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 --2- 172.21.15.50:0/3024713007 >> v2:172.21.15.181:3300/0 conn(0x7fe310073660 0x7fe3100adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100709f0 con 0x7fe31015cf50 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fe304001670 con 0x7fe31015cf50 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 >> v1:172.21.15.50:6789/0 conn(0x7fe31015cf50 legacy=0x7fe31006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 0x7fe2f8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe2f8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2f8004db0 0x7fe2f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100ae6f0 con 0x7fe2f8004010 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100b4150 con 0x7fe2f8004db0 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f800ba60 con 0x7fe31006dc80 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe2f8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe314e00700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 0x7fe2f8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 -- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 msgr2=0x7fe2f8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe31006dc80 0x7fe2f8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 -- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2f8004db0 msgr2=0x7fe2f8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe315800700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2f8004db0 0x7fe2f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2f8004db0 0x7fe2f8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 -- 172.21.15.50:0/3024713007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80035d0 con 0x7fe2f8004010 2024-09-13T15:08:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe315800700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2f8004db0 0x7fe2f8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30fe00700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe2f8004870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009b70 tx=0x7fe2f80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9575cc287b88220f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00e6c0 con 0x7fe2f8004010 2024-09-13T15:08:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00e820 con 0x7fe2f8004010 2024-09-13T15:08:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.900+0000 7fe30f400700 1 -- 172.21.15.50:0/3024713007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00eb90 con 0x7fe2f8004010 2024-09-13T15:08:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 -- 172.21.15.50:0/3024713007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 msgr2=0x7fe2f8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 --2- 172.21.15.50:0/3024713007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe2f8004870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009b70 tx=0x7fe2f80058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe315800700 1 -- 172.21.15.50:0/3024713007 reap_dead start 2024-09-13T15:08:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 -- 172.21.15.50:0/3024713007 shutdown_connections 2024-09-13T15:08:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 -- 172.21.15.50:0/3024713007 >> 172.21.15.50:0/3024713007 conn(0x7fe3100b0c30 msgr2=0x7fe3100b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 -- 172.21.15.50:0/3024713007 shutdown_connections 2024-09-13T15:08:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 -- 172.21.15.50:0/3024713007 wait complete. 2024-09-13T15:08:37.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 Processor -- start 2024-09-13T15:08:37.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.904+0000 7fe316200700 1 -- start start 2024-09-13T15:08:37.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe316200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe3101e2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe316200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31014adc0 0x7fe3100cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe316200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3100ccab0 0x7fe3100ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe316200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31009cd80 con 0x7fe2f8004010 2024-09-13T15:08:37.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe316200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31009a620 con 0x7fe31014adc0 2024-09-13T15:08:37.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe316200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31009a900 con 0x7fe3100ccab0 2024-09-13T15:08:37.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe3101e2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe3101e2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51154/0 (socket says 172.21.15.50:51154) 2024-09-13T15:08:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 -- 172.21.15.50:0/1911441376 learned_addr learned my addr 172.21.15.50:0/1911441376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe315800700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3100ccab0 0x7fe3100ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe30fe00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31014adc0 0x7fe3100cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 -- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3100ccab0 msgr2=0x7fe3100ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3100ccab0 0x7fe3100ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 -- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31014adc0 msgr2=0x7fe3100cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31014adc0 0x7fe3100cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 -- 172.21.15.50:0/1911441376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31009abe0 con 0x7fe2f8004010 2024-09-13T15:08:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe315800700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3100ccab0 0x7fe3100ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.908+0000 7fe314e00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe3101e2300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe304000c00 tx=0x7fe30400ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304010510 con 0x7fe2f8004010 2024-09-13T15:08:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304010670 con 0x7fe2f8004010 2024-09-13T15:08:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31009aec0 con 0x7fe2f8004010 2024-09-13T15:08:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304010a20 con 0x7fe2f8004010 2024-09-13T15:08:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31014b560 con 0x7fe2f8004010 2024-09-13T15:08:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31009b3e0 con 0x7fe2f8004010 2024-09-13T15:08:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.912+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe304010b80 con 0x7fe2f8004010 2024-09-13T15:08:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.916+0000 7fe30cc00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2f0066760 0x7fe2f0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.916+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe304083d20 con 0x7fe2f8004010 2024-09-13T15:08:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.916+0000 7fe30fe00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2f0066760 0x7fe2f0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.916+0000 7fe30fe00700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2f0066760 0x7fe2f0068c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0090b0 tx=0x7fe2fc01f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:37.920+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe31009b3e0 con 0x7fe2f8004010 2024-09-13T15:08:38.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.184+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7fe31009b3e0 con 0x7fe2f8004010 2024-09-13T15:08:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.392+0000 7fe30cc00700 1 -- 172.21.15.50:0/1911441376 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v78) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe31009b3e0 con 0x7fe2f8004010 2024-09-13T15:08:38.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2f0066760 msgr2=0x7fe2f0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2f0066760 0x7fe2f0068c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0090b0 tx=0x7fe2fc01f040 comp rx=0 tx=0).stop 2024-09-13T15:08:38.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 msgr2=0x7fe3101e2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe3101e2300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe304000c00 tx=0x7fe30400ea60 comp rx=0 tx=0).stop 2024-09-13T15:08:38.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 shutdown_connections 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2f0066760 0x7fe2f0068c20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3100ccab0 0x7fe3100ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31014adc0 0x7fe3100cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 --2- 172.21.15.50:0/1911441376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f8004010 0x7fe3101e2300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 >> 172.21.15.50:0/1911441376 conn(0x7fe3100b0c30 msgr2=0x7fe31006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 shutdown_connections 2024-09-13T15:08:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.396+0000 7fe316200700 1 -- 172.21.15.50:0/1911441376 wait complete. 2024-09-13T15:08:38.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T15:08:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.604+0000 7f89eec00700 1 Processor -- start 2024-09-13T15:08:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.604+0000 7f89eec00700 1 -- start start 2024-09-13T15:08:38.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89eec00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89e80b28b0 0x7f89e8159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:38.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89eec00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e8071be0 con 0x7f89e815a080 2024-09-13T15:08:38.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89eec00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e80712b0 con 0x7f89e8159760 2024-09-13T15:08:38.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89eec00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e8071590 con 0x7f89e80b28b0 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89ecc00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89e815a080 0x7f89e8162d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36710/0 (socket says 172.21.15.50:36710) 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89ecc00700 1 -- 172.21.15.50:0/1021845811 learned_addr learned my addr 172.21.15.50:0/1021845811 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89df400700 1 --2- 172.21.15.50:0/1021845811 >> v2:172.21.15.50:3300/0 conn(0x7f89e80b28b0 0x7f89e8159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89e7400700 1 -- 172.21.15.50:0/1021845811 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642775784 0 0) 0x7f89e8071be0 con 0x7f89e815a080 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89e7400700 1 -- 172.21.15.50:0/1021845811 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89cc0035d0 con 0x7f89e815a080 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89df400700 1 -- 172.21.15.50:0/1021845811 >> v1:172.21.15.181:6789/0 conn(0x7f89e8159760 legacy=0x7f89e80cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89df400700 1 -- 172.21.15.50:0/1021845811 >> v1:172.21.15.50:6789/0 conn(0x7f89e815a080 legacy=0x7f89e8162d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89df400700 1 -- 172.21.15.50:0/1021845811 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8071870 con 0x7f89e80b28b0 2024-09-13T15:08:38.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.608+0000 7f89df400700 1 --2- 172.21.15.50:0/1021845811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e80b28b0 0x7f89e8159b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89d000a9f0 tx=0x7f89d000ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40df72bc184ea77c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:38.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89e7400700 1 -- 172.21.15.50:0/1021845811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000cb70 con 0x7f89e80b28b0 2024-09-13T15:08:38.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89e7400700 1 -- 172.21.15.50:0/1021845811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d000ae90 con 0x7f89e80b28b0 2024-09-13T15:08:38.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89e7400700 1 -- 172.21.15.50:0/1021845811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0018400 con 0x7f89e80b28b0 2024-09-13T15:08:38.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 -- 172.21.15.50:0/1021845811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e80b28b0 msgr2=0x7f89e8159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 --2- 172.21.15.50:0/1021845811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e80b28b0 0x7f89e8159b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89d000a9f0 tx=0x7f89d000ad00 comp rx=0 tx=0).stop 2024-09-13T15:08:38.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 -- 172.21.15.50:0/1021845811 shutdown_connections 2024-09-13T15:08:38.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 --2- 172.21.15.50:0/1021845811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e80b28b0 0x7f89e8159b40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 -- 172.21.15.50:0/1021845811 >> 172.21.15.50:0/1021845811 conn(0x7f89e806a570 msgr2=0x7f89e806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:38.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 -- 172.21.15.50:0/1021845811 shutdown_connections 2024-09-13T15:08:38.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.612+0000 7f89eec00700 1 -- 172.21.15.50:0/1021845811 wait complete. 2024-09-13T15:08:38.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 Processor -- start 2024-09-13T15:08:38.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 -- start start 2024-09-13T15:08:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89e80b28b0 0x7f89e8137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89e8159760 0x7f89e814cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 0x7f89e8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e814dc00 con 0x7f89e815a080 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8138150 con 0x7f89e80b28b0 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89eec00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e814d640 con 0x7f89e8159760 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89ecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 0x7f89e8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89e7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89e80b28b0 0x7f89e8137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89ecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 0x7f89e8156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51184/0 (socket says 172.21.15.50:51184) 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89e7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89e80b28b0 0x7f89e8137c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:58922/0 (socket says 172.21.15.50:58922) 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89ecc00700 1 -- 172.21.15.50:0/3646957248 learned_addr learned my addr 172.21.15.50:0/3646957248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.616+0000 7f89df400700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89e8159760 0x7f89e814cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89ecc00700 1 -- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89e8159760 msgr2=0x7f89e814cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89ecc00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89e8159760 0x7f89e814cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89ecc00700 1 -- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89e80b28b0 msgr2=0x7f89e8137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89ecc00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89e80b28b0 0x7f89e8137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89ecc00700 1 -- 172.21.15.50:0/3646957248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d000a650 con 0x7f89e815a080 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89ecc00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 0x7f89e8156df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89e000caa0 tx=0x7f89e000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0007480 con 0x7f89e815a080 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e00075e0 con 0x7f89e815a080 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0007970 con 0x7f89e815a080 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e814d920 con 0x7f89e815a080 2024-09-13T15:08:38.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e8138870 con 0x7f89e815a080 2024-09-13T15:08:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.620+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e8072050 con 0x7f89e815a080 2024-09-13T15:08:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.624+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89e001b3b0 con 0x7f89e815a080 2024-09-13T15:08:38.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.624+0000 7f89e4c00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89c4066760 0x7f89c4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:38.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.624+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89e0083df0 con 0x7f89e815a080 2024-09-13T15:08:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.624+0000 7f89e7e00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89c4066760 0x7f89c4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:38.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.628+0000 7f89e7e00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89c4066760 0x7f89c4068c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89d80018a0 tx=0x7f89d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.632+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89e8072050 con 0x7f89e815a080 2024-09-13T15:08:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.816+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f89e8072050 con 0x7f89e815a080 2024-09-13T15:08:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.824+0000 7f89e4c00700 1 -- 172.21.15.50:0/3646957248 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f89e8072050 con 0x7f89e815a080 2024-09-13T15:08:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89c4066760 msgr2=0x7f89c4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89c4066760 0x7f89c4068c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89d80018a0 tx=0x7f89d8009040 comp rx=0 tx=0).stop 2024-09-13T15:08:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 msgr2=0x7f89e8156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 0x7f89e8156df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89e000caa0 tx=0x7f89e000cad0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 shutdown_connections 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89c4066760 0x7f89c4068c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e815a080 0x7f89e8156df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89e8159760 0x7f89e814cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 --2- 172.21.15.50:0/3646957248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89e80b28b0 0x7f89e8137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 >> 172.21.15.50:0/3646957248 conn(0x7f89e806a570 msgr2=0x7f89e80cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 shutdown_connections 2024-09-13T15:08:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:38.828+0000 7f89eec00700 1 -- 172.21.15.50:0/3646957248 wait complete. 2024-09-13T15:08:38.856 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:08:38.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:08:38.895 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:08:38.936 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:08:38.936 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:38.936 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:38.961 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:38.961 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:39.019 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:39.020 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:39.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:39.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.308+0000 7f8416000700 1 Processor -- start 2024-09-13T15:08:39.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.308+0000 7f8416000700 1 -- start start 2024-09-13T15:08:39.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f8416000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f841015cb30 0x7f841006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f8416000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f841006c040 0x7f841006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f8416000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841006b140 con 0x7f841006cf90 2024-09-13T15:08:39.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f8416000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100cd7a0 con 0x7f841006c040 2024-09-13T15:08:39.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f8416000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841006d420 con 0x7f841015cb30 2024-09-13T15:08:39.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f841006c040 0x7f841006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f8414c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f841015cb30 0x7f841006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f841006c040 0x7f841006ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51198/0 (socket says 172.21.15.50:51198) 2024-09-13T15:08:39.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 -- 172.21.15.50:0/2479970617 learned_addr learned my addr 172.21.15.50:0/2479970617 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:39.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 -- 172.21.15.50:0/2479970617 >> v2:172.21.15.181:3300/0 conn(0x7f841015cb30 msgr2=0x7f841006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:39.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 --2- 172.21.15.50:0/2479970617 >> v2:172.21.15.181:3300/0 conn(0x7f841015cb30 0x7f841006bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 -- 172.21.15.50:0/2479970617 >> v1:172.21.15.181:6789/0 conn(0x7f841006cf90 legacy=0x7f84100b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.312+0000 7f840fe00700 1 -- 172.21.15.50:0/2479970617 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841006a530 con 0x7f841006c040 2024-09-13T15:08:39.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f840fe00700 1 --2- 172.21.15.50:0/2479970617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006c040 0x7f841006ca50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84100d0a70 tx=0x7f83fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af35589e71c77a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f840f400700 1 -- 172.21.15.50:0/2479970617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc011830 con 0x7f841006c040 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f840f400700 1 -- 172.21.15.50:0/2479970617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc011990 con 0x7f841006c040 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f840f400700 1 -- 172.21.15.50:0/2479970617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc011d20 con 0x7f841006c040 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 -- 172.21.15.50:0/2479970617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006c040 msgr2=0x7f841006ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 --2- 172.21.15.50:0/2479970617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006c040 0x7f841006ca50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84100d0a70 tx=0x7f83fc009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 -- 172.21.15.50:0/2479970617 shutdown_connections 2024-09-13T15:08:39.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 --2- 172.21.15.50:0/2479970617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006c040 0x7f841006ca50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 --2- 172.21.15.50:0/2479970617 >> v2:172.21.15.181:3300/0 conn(0x7f841015cb30 0x7f841006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 -- 172.21.15.50:0/2479970617 >> 172.21.15.50:0/2479970617 conn(0x7f8410071f00 msgr2=0x7f84100722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:39.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 -- 172.21.15.50:0/2479970617 shutdown_connections 2024-09-13T15:08:39.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 -- 172.21.15.50:0/2479970617 wait complete. 2024-09-13T15:08:39.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.316+0000 7f8416000700 1 Processor -- start 2024-09-13T15:08:39.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 -- start start 2024-09-13T15:08:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f841006c040 0x7f841015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 0x7f84100b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f841015cb30 0x7f84100b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841015fad0 con 0x7f841006cf90 2024-09-13T15:08:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100b0a20 con 0x7f841015cb30 2024-09-13T15:08:39.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100b0c50 con 0x7f841006c040 2024-09-13T15:08:39.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 0x7f84100b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 0x7f84100b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51202/0 (socket says 172.21.15.50:51202) 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 -- 172.21.15.50:0/3776179313 learned_addr learned my addr 172.21.15.50:0/3776179313 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8415600700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f841015cb30 0x7f84100b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8414c00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f841006c040 0x7f841015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 -- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f841006c040 msgr2=0x7f841015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f841006c040 0x7f841015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 -- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f841015cb30 msgr2=0x7f84100b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f841015cb30 0x7f84100b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 -- 172.21.15.50:0/3776179313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc009570 con 0x7f841006cf90 2024-09-13T15:08:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8414c00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f841006c040 0x7f841015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:39.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840fe00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 0x7f84100b04e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009f40 tx=0x7f83fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:39.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc004550 con 0x7f841006cf90 2024-09-13T15:08:39.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc01f070 con 0x7f841006cf90 2024-09-13T15:08:39.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc003900 con 0x7f841006cf90 2024-09-13T15:08:39.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.320+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100b0f30 con 0x7f841006cf90 2024-09-13T15:08:39.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.324+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84100b17d0 con 0x7f841006cf90 2024-09-13T15:08:39.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.324+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84100b1990 con 0x7f841006cf90 2024-09-13T15:08:39.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.324+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83fc003a60 con 0x7f841006cf90 2024-09-13T15:08:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.328+0000 7f840cc00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83f0066730 0x7f83f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.328+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83fc021070 con 0x7f841006cf90 2024-09-13T15:08:39.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.328+0000 7f8414c00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83f0066730 0x7f83f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.328+0000 7f8414c00700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83f0066730 0x7f83f0068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8404009ba0 tx=0x7f8404008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:39.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.332+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83fc052960 con 0x7f841006cf90 2024-09-13T15:08:39.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.536+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84100cc040 con 0x7f841006cf90 2024-09-13T15:08:39.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.540+0000 7f840cc00700 1 -- 172.21.15.50:0/3776179313 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f83fc055f80 con 0x7f841006cf90 2024-09-13T15:08:39.544 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:39.545 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:39.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83f0066730 msgr2=0x7f83f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83f0066730 0x7f83f0068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8404009ba0 tx=0x7f8404008040 comp rx=0 tx=0).stop 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 msgr2=0x7f84100b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 0x7f84100b04e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009f40 tx=0x7f83fc004770 comp rx=0 tx=0).stop 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 shutdown_connections 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f83f0066730 0x7f83f0068bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f841015cb30 0x7f84100b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f841006cf90 0x7f84100b04e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 --2- 172.21.15.50:0/3776179313 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f841006c040 0x7f841015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 >> 172.21.15.50:0/3776179313 conn(0x7f8410071f00 msgr2=0x7f84100cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 shutdown_connections 2024-09-13T15:08:39.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.544+0000 7f8416000700 1 -- 172.21.15.50:0/3776179313 wait complete. 2024-09-13T15:08:39.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:39.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.752+0000 7f98dae00700 1 Processor -- start 2024-09-13T15:08:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98dae00700 1 -- start start 2024-09-13T15:08:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98dae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d4144330 0x7f98d40cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98dae00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98d4144710 0x7f98d40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98dae00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d406bcf0 con 0x7f98d406d760 2024-09-13T15:08:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98dae00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d40cce10 con 0x7f98d4144710 2024-09-13T15:08:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98dae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d406cb50 con 0x7f98d4144330 2024-09-13T15:08:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98d3400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f98d406d760 0x7f98d40b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:54624/0 (socket says 172.21.15.50:54624) 2024-09-13T15:08:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98d3400700 1 -- 172.21.15.50:0/2852788277 learned_addr learned my addr 172.21.15.50:0/2852788277 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98d3e00700 1 --2- 172.21.15.50:0/2852788277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d4144330 0x7f98d40cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98d8e00700 1 --2- 172.21.15.50:0/2852788277 >> v2:172.21.15.181:3300/0 conn(0x7f98d4144710 0x7f98d40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98d2a00700 1 -- 172.21.15.50:0/2852788277 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552635753 0 0) 0x7f98d406bcf0 con 0x7f98d406d760 2024-09-13T15:08:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.756+0000 7f98d2a00700 1 -- 172.21.15.50:0/2852788277 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b80035d0 con 0x7f98d406d760 2024-09-13T15:08:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d3e00700 1 -- 172.21.15.50:0/2852788277 >> v2:172.21.15.181:3300/0 conn(0x7f98d4144710 msgr2=0x7f98d40b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d3e00700 1 --2- 172.21.15.50:0/2852788277 >> v2:172.21.15.181:3300/0 conn(0x7f98d4144710 0x7f98d40b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d3e00700 1 -- 172.21.15.50:0/2852788277 >> v1:172.21.15.181:6789/0 conn(0x7f98d406d760 legacy=0x7f98d40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d3e00700 1 -- 172.21.15.50:0/2852788277 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40cf4b0 con 0x7f98d4144330 2024-09-13T15:08:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d8e00700 1 --2- 172.21.15.50:0/2852788277 >> v2:172.21.15.181:3300/0 conn(0x7f98d4144710 0x7f98d40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d3e00700 1 --2- 172.21.15.50:0/2852788277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d4144330 0x7f98d40cef70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009850 tx=0x7f98c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9dd6a19e775f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d2a00700 1 -- 172.21.15.50:0/2852788277 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011830 con 0x7f98d4144330 2024-09-13T15:08:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d2a00700 1 -- 172.21.15.50:0/2852788277 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4011990 con 0x7f98d4144330 2024-09-13T15:08:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98d2a00700 1 -- 172.21.15.50:0/2852788277 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011d40 con 0x7f98d4144330 2024-09-13T15:08:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 -- 172.21.15.50:0/2852788277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d4144330 msgr2=0x7f98d40cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 --2- 172.21.15.50:0/2852788277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d4144330 0x7f98d40cef70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009850 tx=0x7f98c4009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:39.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 -- 172.21.15.50:0/2852788277 shutdown_connections 2024-09-13T15:08:39.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 --2- 172.21.15.50:0/2852788277 >> v2:172.21.15.181:3300/0 conn(0x7f98d4144710 0x7f98d40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 --2- 172.21.15.50:0/2852788277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d4144330 0x7f98d40cef70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 -- 172.21.15.50:0/2852788277 >> 172.21.15.50:0/2852788277 conn(0x7f98d406a570 msgr2=0x7f98d406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:39.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 -- 172.21.15.50:0/2852788277 shutdown_connections 2024-09-13T15:08:39.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.760+0000 7f98dae00700 1 -- 172.21.15.50:0/2852788277 wait complete. 2024-09-13T15:08:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 Processor -- start 2024-09-13T15:08:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 -- start start 2024-09-13T15:08:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d406d760 0x7f98d41359d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d4144330 0x7f98d4070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d41360e0 0x7f98d4159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4152490 con 0x7f98d4144330 2024-09-13T15:08:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4071ae0 con 0x7f98d41360e0 2024-09-13T15:08:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98dae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4135f10 con 0x7f98d406d760 2024-09-13T15:08:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98d3400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d4144330 0x7f98d4070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98d3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d406d760 0x7f98d41359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98d3400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d4144330 0x7f98d4070930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51204/0 (socket says 172.21.15.50:51204) 2024-09-13T15:08:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98d3400700 1 -- 172.21.15.50:0/2425657587 learned_addr learned my addr 172.21.15.50:0/2425657587 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.764+0000 7f98d8e00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d41360e0 0x7f98d4159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98d3e00700 1 -- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d41360e0 msgr2=0x7f98d4159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98d3e00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d41360e0 0x7f98d4159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98d3e00700 1 -- 172.21.15.50:0/2425657587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d4144330 msgr2=0x7f98d4070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98d3e00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d4144330 0x7f98d4070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98d3e00700 1 -- 172.21.15.50:0/2425657587 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc009a70 con 0x7f98d406d760 2024-09-13T15:08:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98d3e00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d406d760 0x7f98d41359d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98c4016000 tx=0x7f98c4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4004590 con 0x7f98d406d760 2024-09-13T15:08:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c40036c0 con 0x7f98d406d760 2024-09-13T15:08:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c40094b0 con 0x7f98d406d760 2024-09-13T15:08:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4003a70 con 0x7f98d406d760 2024-09-13T15:08:39.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d415aac0 con 0x7f98d406d760 2024-09-13T15:08:39.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.768+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d40b3d40 con 0x7f98d406d760 2024-09-13T15:08:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.772+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98c4003bd0 con 0x7f98d406d760 2024-09-13T15:08:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.772+0000 7f98cbe00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98b4066760 0x7f98b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.772+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f98c4021030 con 0x7f98d406d760 2024-09-13T15:08:39.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.772+0000 7f98d3400700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98b4066760 0x7f98b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:39.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.776+0000 7f98d3400700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98b4066760 0x7f98b4068c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98d406aca0 tx=0x7f98c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.780+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98c4052a50 con 0x7f98d406d760 2024-09-13T15:08:39.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.960+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98d4071d30 con 0x7f98d406d760 2024-09-13T15:08:39.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.960+0000 7f98cbe00700 1 -- 172.21.15.50:0/2425657587 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98c40150a0 con 0x7f98d406d760 2024-09-13T15:08:39.964 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98b4066760 msgr2=0x7f98b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98b4066760 0x7f98b4068c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98d406aca0 tx=0x7f98c0009040 comp rx=0 tx=0).stop 2024-09-13T15:08:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d406d760 msgr2=0x7f98d41359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d406d760 0x7f98d41359d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98c4016000 tx=0x7f98c4004770 comp rx=0 tx=0).stop 2024-09-13T15:08:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 shutdown_connections 2024-09-13T15:08:39.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98b4066760 0x7f98b4068c20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98d41360e0 0x7f98d4159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d4144330 0x7f98d4070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 --2- 172.21.15.50:0/2425657587 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98d406d760 0x7f98d41359d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 >> 172.21.15.50:0/2425657587 conn(0x7f98d406a570 msgr2=0x7f98d40b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 shutdown_connections 2024-09-13T15:08:39.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:39.964+0000 7f98dae00700 1 -- 172.21.15.50:0/2425657587 wait complete. 2024-09-13T15:08:39.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 Processor -- start 2024-09-13T15:08:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 -- start start 2024-09-13T15:08:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4438143b70 0x7f44380cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f443806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44380b1980 con 0x7f443806cea0 2024-09-13T15:08:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380b2500 con 0x7f4438143b70 2024-09-13T15:08:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.172+0000 7f443d600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443806d2f0 con 0x7f443806d620 2024-09-13T15:08:40.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f443806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4438143b70 0x7f44380cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f443806c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:42756/0 (socket says 172.21.15.50:42756) 2024-09-13T15:08:40.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 -- 172.21.15.50:0/2043689888 learned_addr learned my addr 172.21.15.50:0/2043689888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:40.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 -- 172.21.15.50:0/2043689888 >> v2:172.21.15.181:3300/0 conn(0x7f4438143b70 msgr2=0x7f44380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:40.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 --2- 172.21.15.50:0/2043689888 >> v2:172.21.15.181:3300/0 conn(0x7f4438143b70 0x7f44380cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 -- 172.21.15.50:0/2043689888 >> v1:172.21.15.181:6789/0 conn(0x7f443806cea0 legacy=0x7f443815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 -- 172.21.15.50:0/2043689888 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44380b1bd0 con 0x7f443806d620 2024-09-13T15:08:40.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4436a00700 1 -- 172.21.15.50:0/2043689888 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079124100 0 0) 0x7f44380b1980 con 0x7f443806cea0 2024-09-13T15:08:40.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4437400700 1 --2- 172.21.15.50:0/2043689888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f443806c960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4424009910 tx=0x7f4424009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fcc70d9ef13179 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:40.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4436a00700 1 -- 172.21.15.50:0/2043689888 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424011830 con 0x7f443806d620 2024-09-13T15:08:40.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4436a00700 1 -- 172.21.15.50:0/2043689888 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424011990 con 0x7f443806d620 2024-09-13T15:08:40.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f4436a00700 1 -- 172.21.15.50:0/2043689888 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424011d40 con 0x7f443806d620 2024-09-13T15:08:40.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f443d600700 1 -- 172.21.15.50:0/2043689888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 msgr2=0x7f443806c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.176+0000 7f443d600700 1 --2- 172.21.15.50:0/2043689888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f443806c960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4424009910 tx=0x7f4424009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.180+0000 7f443d600700 1 -- 172.21.15.50:0/2043689888 shutdown_connections 2024-09-13T15:08:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.180+0000 7f443d600700 1 --2- 172.21.15.50:0/2043689888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f443806c960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.180+0000 7f443d600700 1 --2- 172.21.15.50:0/2043689888 >> v2:172.21.15.181:3300/0 conn(0x7f4438143b70 0x7f44380cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.180+0000 7f443d600700 1 -- 172.21.15.50:0/2043689888 >> 172.21.15.50:0/2043689888 conn(0x7f443806a390 msgr2=0x7f443806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.180+0000 7f443d600700 1 -- 172.21.15.50:0/2043689888 shutdown_connections 2024-09-13T15:08:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.180+0000 7f443d600700 1 -- 172.21.15.50:0/2043689888 wait complete. 2024-09-13T15:08:40.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 Processor -- start 2024-09-13T15:08:40.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 -- start start 2024-09-13T15:08:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 0x7f443813eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f44380ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4438143b70 0x7f44380ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380aac00 con 0x7f443806cea0 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380aa010 con 0x7f4438143b70 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443d600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380aa260 con 0x7f443806d620 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 0x7f443813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 0x7f443813eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51210/0 (socket says 172.21.15.50:51210) 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 -- 172.21.15.50:0/3673264049 learned_addr learned my addr 172.21.15.50:0/3673264049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437400700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f44380ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f443cc00700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4438143b70 0x7f44380ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 -- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 msgr2=0x7f44380ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f44380ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 -- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4438143b70 msgr2=0x7f44380ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4438143b70 0x7f44380ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 -- 172.21.15.50:0/3673264049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424009570 con 0x7f443806cea0 2024-09-13T15:08:40.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437400700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f44380ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.184+0000 7f4437e00700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 0x7f443813eaf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f442800e840 tx=0x7f442800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280095a0 con 0x7f443806cea0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800c690 con 0x7f443806cea0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800ca00 con 0x7f443806cea0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44380aa540 con 0x7f443806cea0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443813f030 con 0x7f443806cea0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4438071cb0 con 0x7f443806cea0 2024-09-13T15:08:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.188+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f442800cb60 con 0x7f443806cea0 2024-09-13T15:08:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.192+0000 7f442fe00700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4418066730 0x7f4418068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.192+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4428084580 con 0x7f443806cea0 2024-09-13T15:08:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.192+0000 7f4437400700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4418066730 0x7f4418068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.192+0000 7f4437400700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4418066730 0x7f4418068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f443806cdd0 tx=0x7f4424008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:40.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.200+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4428051520 con 0x7f443806cea0 2024-09-13T15:08:40.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.384+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4438143f50 con 0x7f443806cea0 2024-09-13T15:08:40.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.384+0000 7f442fe00700 1 -- 172.21.15.50:0/3673264049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4428054b40 con 0x7f443806cea0 2024-09-13T15:08:40.388 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4418066730 msgr2=0x7f4418068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4418066730 0x7f4418068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f443806cdd0 tx=0x7f4424008030 comp rx=0 tx=0).stop 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 msgr2=0x7f443813eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 0x7f443813eaf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f442800e840 tx=0x7f442800ec00 comp rx=0 tx=0).stop 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 shutdown_connections 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4418066730 0x7f4418068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4438143b70 0x7f44380ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f443806d620 0x7f44380ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 --2- 172.21.15.50:0/3673264049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f443806cea0 0x7f443813eaf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 >> 172.21.15.50:0/3673264049 conn(0x7f443806a390 msgr2=0x7f44380b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:40.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 shutdown_connections 2024-09-13T15:08:40.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.388+0000 7f443d600700 1 -- 172.21.15.50:0/3673264049 wait complete. 2024-09-13T15:08:40.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:40.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.592+0000 7f3f7a800700 1 Processor -- start 2024-09-13T15:08:40.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.592+0000 7f3f7a800700 1 -- start start 2024-09-13T15:08:40.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f7a800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f740ade30 0x7f3f74165970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f7a800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f74073660 con 0x7f3f74070a40 2024-09-13T15:08:40.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f7a800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740738b0 con 0x7f3f7415ac40 2024-09-13T15:08:40.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f7a800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f74073b90 con 0x7f3f740ade30 2024-09-13T15:08:40.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f78a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f74070a40 0x7f3f740ad720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36726/0 (socket says 172.21.15.50:36726) 2024-09-13T15:08:40.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f78a00700 1 -- 172.21.15.50:0/2525785781 learned_addr learned my addr 172.21.15.50:0/2525785781 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:40.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f79e00700 1 --2- 172.21.15.50:0/2525785781 >> v2:172.21.15.50:3300/0 conn(0x7f3f740ade30 0x7f3f74165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f79e00700 1 -- 172.21.15.50:0/2525785781 >> v1:172.21.15.181:6789/0 conn(0x7f3f7415ac40 legacy=0x7f3f740b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f73e00700 1 -- 172.21.15.50:0/2525785781 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231149184 0 0) 0x7f3f740738b0 con 0x7f3f7415ac40 2024-09-13T15:08:40.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f79e00700 1 -- 172.21.15.50:0/2525785781 >> v1:172.21.15.50:6789/0 conn(0x7f3f74070a40 legacy=0x7f3f740ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.596+0000 7f3f79e00700 1 -- 172.21.15.50:0/2525785781 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f74072300 con 0x7f3f740ade30 2024-09-13T15:08:40.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f79e00700 1 --2- 172.21.15.50:0/2525785781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f740ade30 0x7f3f74165970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009d90 tx=0x7f3f6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda60b6c09da81d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:40.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f73e00700 1 -- 172.21.15.50:0/2525785781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00e070 con 0x7f3f740ade30 2024-09-13T15:08:40.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f73e00700 1 -- 172.21.15.50:0/2525785781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00bbd0 con 0x7f3f740ade30 2024-09-13T15:08:40.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f73e00700 1 -- 172.21.15.50:0/2525785781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c012430 con 0x7f3f740ade30 2024-09-13T15:08:40.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 -- 172.21.15.50:0/2525785781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f740ade30 msgr2=0x7f3f74165970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 --2- 172.21.15.50:0/2525785781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f740ade30 0x7f3f74165970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009d90 tx=0x7f3f6c00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 -- 172.21.15.50:0/2525785781 shutdown_connections 2024-09-13T15:08:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 --2- 172.21.15.50:0/2525785781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f740ade30 0x7f3f74165970 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 -- 172.21.15.50:0/2525785781 >> 172.21.15.50:0/2525785781 conn(0x7f3f740b4770 msgr2=0x7f3f740b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 -- 172.21.15.50:0/2525785781 shutdown_connections 2024-09-13T15:08:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 -- 172.21.15.50:0/2525785781 wait complete. 2024-09-13T15:08:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 Processor -- start 2024-09-13T15:08:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.600+0000 7f3f7a800700 1 -- start start 2024-09-13T15:08:40.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 0x7f3f74154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3f740ade30 0x7f3f7414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f7414ccd0 0x7f3f74159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7414c300 con 0x7f3f74070a40 2024-09-13T15:08:40.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74154a80 con 0x7f3f7414ccd0 2024-09-13T15:08:40.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74153080 con 0x7f3f740ade30 2024-09-13T15:08:40.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 0x7f3f74154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 0x7f3f74154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51222/0 (socket says 172.21.15.50:51222) 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 -- 172.21.15.50:0/1818488506 learned_addr learned my addr 172.21.15.50:0/1818488506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79e00700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f7414ccd0 0x7f3f74159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f78a00700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3f740ade30 0x7f3f7414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 -- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3f740ade30 msgr2=0x7f3f7414c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3f740ade30 0x7f3f7414c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 -- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f7414ccd0 msgr2=0x7f3f74159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f7414ccd0 0x7f3f74159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 -- 172.21.15.50:0/1818488506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009a70 con 0x7f3f74070a40 2024-09-13T15:08:40.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f79400700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 0x7f3f74154540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c520 tx=0x7f3f6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:40.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680054e0 con 0x7f3f74070a40 2024-09-13T15:08:40.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f680036a0 con 0x7f3f74070a40 2024-09-13T15:08:40.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7414b9d0 con 0x7f3f74070a40 2024-09-13T15:08:40.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68003a50 con 0x7f3f74070a40 2024-09-13T15:08:40.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.604+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7414bf90 con 0x7f3f74070a40 2024-09-13T15:08:40.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.608+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7414c120 con 0x7f3f74070a40 2024-09-13T15:08:40.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.608+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f68003bb0 con 0x7f3f74070a40 2024-09-13T15:08:40.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.608+0000 7f3f71600700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3f54066730 0x7f3f54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:40.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.612+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f68083a00 con 0x7f3f74070a40 2024-09-13T15:08:40.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.612+0000 7f3f78a00700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3f54066730 0x7f3f54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:40.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.612+0000 7f3f78a00700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3f54066730 0x7f3f54068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f740d0020 tx=0x7f3f60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:40.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.620+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f68050880 con 0x7f3f74070a40 2024-09-13T15:08:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.800+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f740ad720 con 0x7f3f74070a40 2024-09-13T15:08:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.800+0000 7f3f71600700 1 -- 172.21.15.50:0/1818488506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f68017020 con 0x7f3f74070a40 2024-09-13T15:08:40.804 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3f54066730 msgr2=0x7f3f54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3f54066730 0x7f3f54068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f740d0020 tx=0x7f3f60009040 comp rx=0 tx=0).stop 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 msgr2=0x7f3f74154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 0x7f3f74154540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c520 tx=0x7f3f6800c830 comp rx=0 tx=0).stop 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 shutdown_connections 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3f54066730 0x7f3f54068bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f7414ccd0 0x7f3f74159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3f740ade30 0x7f3f7414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 --2- 172.21.15.50:0/1818488506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f74070a40 0x7f3f74154540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 >> 172.21.15.50:0/1818488506 conn(0x7f3f740b4770 msgr2=0x7f3f74155740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 shutdown_connections 2024-09-13T15:08:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:40.804+0000 7f3f7a800700 1 -- 172.21.15.50:0/1818488506 wait complete. 2024-09-13T15:08:40.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:41.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849a00700 1 Processor -- start 2024-09-13T15:08:41.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849a00700 1 -- start start 2024-09-13T15:08:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8440b1f30 0x7fb8440d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440b2760 con 0x7fb8440cfc30 2024-09-13T15:08:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440d15a0 con 0x7fb84415cd40 2024-09-13T15:08:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440d1880 con 0x7fb8440b1f30 2024-09-13T15:08:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb843400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb8440cfc30 0x7fb8440b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36736/0 (socket says 172.21.15.50:36736) 2024-09-13T15:08:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb843400700 1 -- 172.21.15.50:0/2970469875 learned_addr learned my addr 172.21.15.50:0/2970469875 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.008+0000 7fb849000700 1 --2- 172.21.15.50:0/2970469875 >> v2:172.21.15.50:3300/0 conn(0x7fb8440b1f30 0x7fb8440d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb842a00700 1 -- 172.21.15.50:0/2970469875 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696579638 0 0) 0x7fb8440b2760 con 0x7fb8440cfc30 2024-09-13T15:08:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb842a00700 1 -- 172.21.15.50:0/2970469875 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8280035d0 con 0x7fb8440cfc30 2024-09-13T15:08:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb842a00700 1 -- 172.21.15.50:0/2970469875 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729219570 0 0) 0x7fb8440d15a0 con 0x7fb84415cd40 2024-09-13T15:08:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849000700 1 -- 172.21.15.50:0/2970469875 >> v1:172.21.15.181:6789/0 conn(0x7fb84415cd40 legacy=0x7fb8440cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849000700 1 -- 172.21.15.50:0/2970469875 >> v1:172.21.15.50:6789/0 conn(0x7fb8440cfc30 legacy=0x7fb8440b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849000700 1 -- 172.21.15.50:0/2970469875 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440d1b60 con 0x7fb8440b1f30 2024-09-13T15:08:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849000700 1 --2- 172.21.15.50:0/2970469875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb8440d3770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009d90 tx=0x7fb83c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd232b5e2b67ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb842a00700 1 -- 172.21.15.50:0/2970469875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00e070 con 0x7fb8440b1f30 2024-09-13T15:08:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb842a00700 1 -- 172.21.15.50:0/2970469875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00bb20 con 0x7fb8440b1f30 2024-09-13T15:08:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb842a00700 1 -- 172.21.15.50:0/2970469875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00be90 con 0x7fb8440b1f30 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 -- 172.21.15.50:0/2970469875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 msgr2=0x7fb8440d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 --2- 172.21.15.50:0/2970469875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb8440d3770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009d90 tx=0x7fb83c00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 -- 172.21.15.50:0/2970469875 shutdown_connections 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 --2- 172.21.15.50:0/2970469875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb8440d3770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 -- 172.21.15.50:0/2970469875 >> 172.21.15.50:0/2970469875 conn(0x7fb8440d2c50 msgr2=0x7fb8440d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 -- 172.21.15.50:0/2970469875 shutdown_connections 2024-09-13T15:08:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.012+0000 7fb849a00700 1 -- 172.21.15.50:0/2970469875 wait complete. 2024-09-13T15:08:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 Processor -- start 2024-09-13T15:08:41.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 -- start start 2024-09-13T15:08:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb84415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8440cfc30 0x7fb84415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb84415cd40 0x7fb8440c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415d520 con 0x7fb8440b1f30 2024-09-13T15:08:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c8830 con 0x7fb84415cd40 2024-09-13T15:08:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c8b10 con 0x7fb8440cfc30 2024-09-13T15:08:41.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb843e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb84415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb843e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb84415afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51238/0 (socket says 172.21.15.50:51238) 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb843e00700 1 -- 172.21.15.50:0/116580775 learned_addr learned my addr 172.21.15.50:0/116580775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb849000700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb84415cd40 0x7fb8440c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.016+0000 7fb843400700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8440cfc30 0x7fb84415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843e00700 1 -- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8440cfc30 msgr2=0x7fb84415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843e00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8440cfc30 0x7fb84415fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843e00700 1 -- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb84415cd40 msgr2=0x7fb8440c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843e00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb84415cd40 0x7fb8440c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843e00700 1 -- 172.21.15.50:0/116580775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009a70 con 0x7fb8440b1f30 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843400700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8440cfc30 0x7fb84415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb843e00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb84415afb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb83400c520 tx=0x7fb83400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340054e0 con 0x7fb8440b1f30 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8340036a0 con 0x7fb8440b1f30 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8440c8df0 con 0x7fb8440b1f30 2024-09-13T15:08:41.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834003a50 con 0x7fb8440b1f30 2024-09-13T15:08:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8440c90d0 con 0x7fb8440b1f30 2024-09-13T15:08:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.020+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8440677c0 con 0x7fb8440b1f30 2024-09-13T15:08:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.024+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb834003bb0 con 0x7fb8440b1f30 2024-09-13T15:08:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.024+0000 7fb83be00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb824066730 0x7fb824068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.024+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb8340839a0 con 0x7fb8440b1f30 2024-09-13T15:08:41.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.024+0000 7fb843400700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb824066730 0x7fb824068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.024+0000 7fb843400700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb824066730 0x7fb824068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8441f5440 tx=0x7fb830009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.032+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb834050950 con 0x7fb8440b1f30 2024-09-13T15:08:41.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.212+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb8440d3770 con 0x7fb8440b1f30 2024-09-13T15:08:41.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb83be00700 1 -- 172.21.15.50:0/116580775 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb8340170a0 con 0x7fb8440b1f30 2024-09-13T15:08:41.219 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:41.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb824066730 msgr2=0x7fb824068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb824066730 0x7fb824068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8441f5440 tx=0x7fb830009040 comp rx=0 tx=0).stop 2024-09-13T15:08:41.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 msgr2=0x7fb84415afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb84415afb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb83400c520 tx=0x7fb83400c830 comp rx=0 tx=0).stop 2024-09-13T15:08:41.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 shutdown_connections 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb824066730 0x7fb824068bf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb84415cd40 0x7fb8440c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8440cfc30 0x7fb84415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 --2- 172.21.15.50:0/116580775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8440b1f30 0x7fb84415afb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 >> 172.21.15.50:0/116580775 conn(0x7fb8440d2c50 msgr2=0x7fb8440d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 shutdown_connections 2024-09-13T15:08:41.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.216+0000 7fb849a00700 1 -- 172.21.15.50:0/116580775 wait complete. 2024-09-13T15:08:41.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:08:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f059cc00700 1 Processor -- start 2024-09-13T15:08:41.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f059cc00700 1 -- start start 2024-09-13T15:08:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f059cc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f059806aaa0 0x7f059806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f059cc00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980ccb40 con 0x7f05980cb020 2024-09-13T15:08:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f059cc00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059806b430 con 0x7f05980cc6f0 2024-09-13T15:08:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f059cc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b2ad0 con 0x7f059806aaa0 2024-09-13T15:08:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f0597400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f05980cb020 0x7f059815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36740/0 (socket says 172.21.15.50:36740) 2024-09-13T15:08:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f0597400700 1 -- 172.21.15.50:0/238954408 learned_addr learned my addr 172.21.15.50:0/238954408 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.416+0000 7f0597e00700 1 --2- 172.21.15.50:0/238954408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f059806aaa0 0x7f059806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104441817 0 0) 0x7f0580001110 con 0x7f05980cc6f0 2024-09-13T15:08:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057c0035d0 con 0x7f05980cc6f0 2024-09-13T15:08:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244608439 0 0) 0x7f05980ccb40 con 0x7f05980cb020 2024-09-13T15:08:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0580001110 con 0x7f05980cb020 2024-09-13T15:08:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0597e00700 1 -- 172.21.15.50:0/238954408 >> v1:172.21.15.181:6789/0 conn(0x7f05980cc6f0 legacy=0x7f059815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0597e00700 1 -- 172.21.15.50:0/238954408 >> v1:172.21.15.50:6789/0 conn(0x7f05980cb020 legacy=0x7f059815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0597e00700 1 -- 172.21.15.50:0/238954408 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059815b960 con 0x7f059806aaa0 2024-09-13T15:08:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0597e00700 1 --2- 172.21.15.50:0/238954408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f059806aaa0 0x7f059806aef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0590009dc0 tx=0x7f059000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e29c9781a30de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000e070 con 0x7f059806aaa0 2024-09-13T15:08:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000bb20 con 0x7f059806aaa0 2024-09-13T15:08:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f0596a00700 1 -- 172.21.15.50:0/238954408 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590012430 con 0x7f059806aaa0 2024-09-13T15:08:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 -- 172.21.15.50:0/238954408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f059806aaa0 msgr2=0x7f059806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 --2- 172.21.15.50:0/238954408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f059806aaa0 0x7f059806aef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0590009dc0 tx=0x7f059000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 -- 172.21.15.50:0/238954408 shutdown_connections 2024-09-13T15:08:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 --2- 172.21.15.50:0/238954408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f059806aaa0 0x7f059806aef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 -- 172.21.15.50:0/238954408 >> 172.21.15.50:0/238954408 conn(0x7f05980b0c40 msgr2=0x7f059806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 -- 172.21.15.50:0/238954408 shutdown_connections 2024-09-13T15:08:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.420+0000 7f059cc00700 1 -- 172.21.15.50:0/238954408 wait complete. 2024-09-13T15:08:41.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 Processor -- start 2024-09-13T15:08:41.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 -- start start 2024-09-13T15:08:41.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 0x7f059813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f05980cb020 0x7f059813d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05980cc6f0 0x7f05981541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598142720 con 0x7f059806aaa0 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598141b10 con 0x7f05980cc6f0 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f059cc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0598141df0 con 0x7f05980cb020 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f0597400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 0x7f059813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f0597400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 0x7f059813e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51240/0 (socket says 172.21.15.50:51240) 2024-09-13T15:08:41.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f0597400700 1 -- 172.21.15.50:0/3583585024 learned_addr learned my addr 172.21.15.50:0/3583585024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:41.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.424+0000 7f058fe00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f05980cb020 0x7f059813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597e00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05980cc6f0 0x7f05981541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597400700 1 -- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f05980cb020 msgr2=0x7f059813d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597400700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f05980cb020 0x7f059813d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597400700 1 -- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05980cc6f0 msgr2=0x7f05981541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597400700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05980cc6f0 0x7f05981541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597400700 1 -- 172.21.15.50:0/3583585024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009a70 con 0x7f059806aaa0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f0597400700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 0x7f059813e9e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f058800c700 tx=0x7f058800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005d90 con 0x7f059806aaa0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05880070d0 con 0x7f059806aaa0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05981420d0 con 0x7f059806aaa0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588007480 con 0x7f059806aaa0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0598141750 con 0x7f059806aaa0 2024-09-13T15:08:41.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.428+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05981418e0 con 0x7f059806aaa0 2024-09-13T15:08:41.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.432+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05880075e0 con 0x7f059806aaa0 2024-09-13T15:08:41.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.432+0000 7f058f400700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0574066730 0x7f0574068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:41.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.432+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0588083bb0 con 0x7f059806aaa0 2024-09-13T15:08:41.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.432+0000 7f058fe00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0574066730 0x7f0574068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:41.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.436+0000 7f058fe00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0574066730 0x7f0574068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f059813c470 tx=0x7f0580009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:41.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.436+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0588050ad0 con 0x7f059806aaa0 2024-09-13T15:08:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.640+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f059806aef0 con 0x7f059806aaa0 2024-09-13T15:08:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.640+0000 7f058f400700 1 -- 172.21.15.50:0/3583585024 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05880540f0 con 0x7f059806aaa0 2024-09-13T15:08:41.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0574066730 msgr2=0x7f0574068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0574066730 0x7f0574068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f059813c470 tx=0x7f0580009040 comp rx=0 tx=0).stop 2024-09-13T15:08:41.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 msgr2=0x7f059813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:41.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 0x7f059813e9e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f058800c700 tx=0x7f058800cac0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 shutdown_connections 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0574066730 0x7f0574068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05980cc6f0 0x7f05981541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f05980cb020 0x7f059813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 --2- 172.21.15.50:0/3583585024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f059806aaa0 0x7f059813e9e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 >> 172.21.15.50:0/3583585024 conn(0x7f05980b0c40 msgr2=0x7f059806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 shutdown_connections 2024-09-13T15:08:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:41.644+0000 7f059cc00700 1 -- 172.21.15.50:0/3583585024 wait complete. 2024-09-13T15:08:41.649 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:08:41.669 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:08:41.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:41.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T15:08:41.738 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:08:41.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:41.739 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:08:41.757 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:41.757 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:41.773 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:41.773 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:41.836 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:41.836 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:41.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:42.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.072+0000 7f2f9d000700 1 Processor -- start 2024-09-13T15:08:42.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.072+0000 7f2f9d000700 1 -- start start 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f9d000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f98161e20 0x7f2f98164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f9d000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f98070100 con 0x7f2f98071670 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f9d000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9806bee0 con 0x7f2f98159080 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f9d000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9806bcd0 con 0x7f2f98161e20 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f8d400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2f98071670 0x7f2f98071ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36748/0 (socket says 172.21.15.50:36748) 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f8d400700 1 -- 172.21.15.50:0/1906695999 learned_addr learned my addr 172.21.15.50:0/1906695999 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:42.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f96800700 1 --2- 172.21.15.50:0/1906695999 >> v2:172.21.15.181:3300/0 conn(0x7f2f98161e20 0x7f2f98164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542159324 0 0) 0x7f2f98070100 con 0x7f2f98071670 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f7c0035d0 con 0x7f2f98071670 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4265247700 0 0) 0x7f2f7c0035d0 con 0x7f2f98071670 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 >> v2:172.21.15.181:3300/0 conn(0x7f2f98161e20 msgr2=0x7f2f98164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 --2- 172.21.15.50:0/1906695999 >> v2:172.21.15.181:3300/0 conn(0x7f2f98161e20 0x7f2f98164210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 >> v1:172.21.15.181:6789/0 conn(0x7f2f98159080 legacy=0x7f2f980cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9806c1c0 con 0x7f2f98071670 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f2f80001670 con 0x7f2f98071670 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 >> v1:172.21.15.50:6789/0 conn(0x7f2f98071670 legacy=0x7f2f98071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f7c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f7c0043a0 0x7f2f7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c004fb0 0x7f2f7c010040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9806bcd0 con 0x7f2f7c003a20 2024-09-13T15:08:42.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c010580 con 0x7f2f7c004fb0 2024-09-13T15:08:42.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0106c0 con 0x7f2f7c0043a0 2024-09-13T15:08:42.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.076+0000 7f2f95e00700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f7c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f96800700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c004fb0 0x7f2f7c010040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f8d400700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f7c0043a0 0x7f2f7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95e00700 1 -- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f7c0043a0 msgr2=0x7f2f7c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95e00700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f7c0043a0 0x7f2f7c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95e00700 1 -- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c004fb0 msgr2=0x7f2f7c010040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95e00700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f7c004fb0 0x7f2f7c010040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95e00700 1 -- 172.21.15.50:0/1906695999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0035d0 con 0x7f2f7c003a20 2024-09-13T15:08:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f96800700 1 -- 172.21.15.50:0/1906695999 reap_dead start 2024-09-13T15:08:42.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95e00700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f7c003e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2f880017e0 tx=0x7f2f7c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15ed6cead5875e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880052d0 con 0x7f2f7c003a20 2024-09-13T15:08:42.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88005450 con 0x7f2f7c003a20 2024-09-13T15:08:42.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f95400700 1 -- 172.21.15.50:0/1906695999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880038e0 con 0x7f2f7c003a20 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 -- 172.21.15.50:0/1906695999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 msgr2=0x7f2f7c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f7c003e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2f880017e0 tx=0x7f2f7c0058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 -- 172.21.15.50:0/1906695999 shutdown_connections 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 --2- 172.21.15.50:0/1906695999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f7c003e60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 -- 172.21.15.50:0/1906695999 >> 172.21.15.50:0/1906695999 conn(0x7f2f980b08d0 msgr2=0x7f2f980b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 -- 172.21.15.50:0/1906695999 shutdown_connections 2024-09-13T15:08:42.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.080+0000 7f2f9d000700 1 -- 172.21.15.50:0/1906695999 wait complete. 2024-09-13T15:08:42.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 Processor -- start 2024-09-13T15:08:42.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 -- start start 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f981597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f9814c7c0 0x7f2f9813a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f980cd8c0 0x7f2f980cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ce280 con 0x7f2f7c003a20 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9815aa90 con 0x7f2f9814c7c0 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.084+0000 7f2f9d000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9813a840 con 0x7f2f980cd8c0 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f981597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f981597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51248/0 (socket says 172.21.15.50:51248) 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 -- 172.21.15.50:0/2306185360 learned_addr learned my addr 172.21.15.50:0/2306185360 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f8d400700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f9814c7c0 0x7f2f9813a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 -- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f980cd8c0 msgr2=0x7f2f980cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f980cd8c0 0x7f2f980cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 -- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f9814c7c0 msgr2=0x7f2f9813a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f9814c7c0 0x7f2f9813a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 -- 172.21.15.50:0/2306185360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98159e80 con 0x7f2f7c003a20 2024-09-13T15:08:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f95e00700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f981597c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f88005040 tx=0x7f2f88001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88001290 con 0x7f2f7c003a20 2024-09-13T15:08:42.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88007040 con 0x7f2f7c003a20 2024-09-13T15:08:42.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9815a160 con 0x7f2f7c003a20 2024-09-13T15:08:42.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880073d0 con 0x7f2f7c003a20 2024-09-13T15:08:42.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9815a720 con 0x7f2f7c003a20 2024-09-13T15:08:42.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.088+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f98070f70 con 0x7f2f7c003a20 2024-09-13T15:08:42.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.092+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f88007530 con 0x7f2f7c003a20 2024-09-13T15:08:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.092+0000 7f2f8ea00700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f74066730 0x7f2f74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.092+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f88084eb0 con 0x7f2f7c003a20 2024-09-13T15:08:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.092+0000 7f2f8d400700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f74066730 0x7f2f74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.092+0000 7f2f8d400700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f74066730 0x7f2f74068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001050 tx=0x7f2f80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.100+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f88051e50 con 0x7f2f7c003a20 2024-09-13T15:08:42.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.296+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9806cca0 con 0x7f2f7c003a20 2024-09-13T15:08:42.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.296+0000 7f2f8ea00700 1 -- 172.21.15.50:0/2306185360 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f2f8802b090 con 0x7f2f7c003a20 2024-09-13T15:08:42.302 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:42.302 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f74066730 msgr2=0x7f2f74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f74066730 0x7f2f74068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001050 tx=0x7f2f80009040 comp rx=0 tx=0).stop 2024-09-13T15:08:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 msgr2=0x7f2f981597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f981597c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f88005040 tx=0x7f2f88001120 comp rx=0 tx=0).stop 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 shutdown_connections 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f74066730 0x7f2f74068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f980cd8c0 0x7f2f980cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f9814c7c0 0x7f2f9813a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 --2- 172.21.15.50:0/2306185360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f7c003a20 0x7f2f981597c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 >> 172.21.15.50:0/2306185360 conn(0x7f2f980b08d0 msgr2=0x7f2f9815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 shutdown_connections 2024-09-13T15:08:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.300+0000 7f2f9d000700 1 -- 172.21.15.50:0/2306185360 wait complete. 2024-09-13T15:08:42.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:42.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.516+0000 7f5af6000700 1 Processor -- start 2024-09-13T15:08:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.516+0000 7f5af6000700 1 -- start start 2024-09-13T15:08:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af6000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5af00cbf00 0x7f5af00b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af6000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af015e5c0 con 0x7f5af0073b10 2024-09-13T15:08:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af6000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af00cc3b0 con 0x7f5af00cbf00 2024-09-13T15:08:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af6000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00b3410 con 0x7f5af015e1e0 2024-09-13T15:08:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5af00cbf00 0x7f5af00b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af4c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5af00cbf00 0x7f5af00b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51264/0 (socket says 172.21.15.50:51264) 2024-09-13T15:08:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af4c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:42830/0 (socket says 172.21.15.50:42830) 2024-09-13T15:08:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.520+0000 7f5af5600700 1 -- 172.21.15.50:0/692350081 learned_addr learned my addr 172.21.15.50:0/692350081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af4c00700 1 -- 172.21.15.50:0/692350081 >> v2:172.21.15.50:3300/0 conn(0x7f5af00cbf00 msgr2=0x7f5af00b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af4c00700 1 --2- 172.21.15.50:0/692350081 >> v2:172.21.15.50:3300/0 conn(0x7f5af00cbf00 0x7f5af00b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af4c00700 1 -- 172.21.15.50:0/692350081 >> v1:172.21.15.181:6789/0 conn(0x7f5af0073b10 legacy=0x7f5af0070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af4c00700 1 -- 172.21.15.50:0/692350081 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af00cd9f0 con 0x7f5af015e1e0 2024-09-13T15:08:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af4c00700 1 --2- 172.21.15.50:0/692350081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00cb9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009850 tx=0x7f5ae4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd5c000610b1815 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5aef400700 1 -- 172.21.15.50:0/692350081 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5af015e1e0 2024-09-13T15:08:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5aef400700 1 -- 172.21.15.50:0/692350081 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011990 con 0x7f5af015e1e0 2024-09-13T15:08:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5aef400700 1 -- 172.21.15.50:0/692350081 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011d40 con 0x7f5af015e1e0 2024-09-13T15:08:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 -- 172.21.15.50:0/692350081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 msgr2=0x7f5af00cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 --2- 172.21.15.50:0/692350081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00cb9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009850 tx=0x7f5ae4009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 -- 172.21.15.50:0/692350081 shutdown_connections 2024-09-13T15:08:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 --2- 172.21.15.50:0/692350081 >> v2:172.21.15.50:3300/0 conn(0x7f5af00cbf00 0x7f5af00b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 --2- 172.21.15.50:0/692350081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00cb9c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 -- 172.21.15.50:0/692350081 >> 172.21.15.50:0/692350081 conn(0x7f5af00b0bc0 msgr2=0x7f5af00b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 -- 172.21.15.50:0/692350081 shutdown_connections 2024-09-13T15:08:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.524+0000 7f5af6000700 1 -- 172.21.15.50:0/692350081 wait complete. 2024-09-13T15:08:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 Processor -- start 2024-09-13T15:08:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 -- start start 2024-09-13T15:08:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 0x7f5af0153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af00cbf00 0x7f5af00ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af009c7a0 con 0x7f5af0073b10 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0158fa0 con 0x7f5af00cbf00 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af6000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0153570 con 0x7f5af015e1e0 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 0x7f5af0153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 0x7f5af0153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51268/0 (socket says 172.21.15.50:51268) 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 -- 172.21.15.50:0/3822216321 learned_addr learned my addr 172.21.15.50:0/3822216321 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af5600700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5aefe00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af00cbf00 0x7f5af00ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 -- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 msgr2=0x7f5af00aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 -- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af00cbf00 msgr2=0x7f5af00ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af00cbf00 0x7f5af00ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 -- 172.21.15.50:0/3822216321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40094b0 con 0x7f5af0073b10 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.528+0000 7f5af4c00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 0x7f5af0153030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40090b0 tx=0x7f5ae4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40036c0 con 0x7f5af0073b10 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae401e070 con 0x7f5af0073b10 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4003a80 con 0x7f5af0073b10 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af00ae130 con 0x7f5af0073b10 2024-09-13T15:08:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af01584c0 con 0x7f5af0073b10 2024-09-13T15:08:42.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af0072710 con 0x7f5af0073b10 2024-09-13T15:08:42.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.532+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ae4003be0 con 0x7f5af0073b10 2024-09-13T15:08:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.536+0000 7f5aecc00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ad0066730 0x7f5ad0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.536+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ae4020070 con 0x7f5af0073b10 2024-09-13T15:08:42.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.536+0000 7f5aefe00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ad0066730 0x7f5ad0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.536+0000 7f5aefe00700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ad0066730 0x7f5ad0068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5af01580d0 tx=0x7f5adc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.540+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ae40529f0 con 0x7f5af0073b10 2024-09-13T15:08:42.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.724+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5af00cb9c0 con 0x7f5af0073b10 2024-09-13T15:08:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.724+0000 7f5aecc00700 1 -- 172.21.15.50:0/3822216321 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ae40150a0 con 0x7f5af0073b10 2024-09-13T15:08:42.728 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ad0066730 msgr2=0x7f5ad0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ad0066730 0x7f5ad0068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5af01580d0 tx=0x7f5adc009040 comp rx=0 tx=0).stop 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 msgr2=0x7f5af0153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 0x7f5af0153030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40090b0 tx=0x7f5ae4004770 comp rx=0 tx=0).stop 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 shutdown_connections 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ad0066730 0x7f5ad0068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5af015e1e0 0x7f5af00aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af00cbf00 0x7f5af00ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 --2- 172.21.15.50:0/3822216321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5af0073b10 0x7f5af0153030 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 >> 172.21.15.50:0/3822216321 conn(0x7f5af00b0bc0 msgr2=0x7f5af00c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 shutdown_connections 2024-09-13T15:08:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.728+0000 7f5af6000700 1 -- 172.21.15.50:0/3822216321 wait complete. 2024-09-13T15:08:42.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:42.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.932+0000 7fc384600700 1 Processor -- start 2024-09-13T15:08:42.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.932+0000 7fc384600700 1 -- start start 2024-09-13T15:08:42.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc384600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc37c159900 0x7fc37c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc384600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0cdfe0 con 0x7fc37c0714d0 2024-09-13T15:08:42.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc384600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0ce210 con 0x7fc37c0b3580 2024-09-13T15:08:42.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc384600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0ce4f0 con 0x7fc37c159900 2024-09-13T15:08:42.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc382600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc37c0714d0 0x7fc37c159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36754/0 (socket says 172.21.15.50:36754) 2024-09-13T15:08:42.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc382600700 1 -- 172.21.15.50:0/1303695252 learned_addr learned my addr 172.21.15.50:0/1303695252 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:42.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc381c00700 1 --2- 172.21.15.50:0/1303695252 >> v2:172.21.15.181:3300/0 conn(0x7fc37c159900 0x7fc37c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409831817 0 0) 0x7fc37c0cdfe0 con 0x7fc37c0714d0 2024-09-13T15:08:42.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3640057e0 con 0x7fc37c0714d0 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648873823 0 0) 0x7fc3640057e0 con 0x7fc37c0714d0 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 >> v2:172.21.15.181:3300/0 conn(0x7fc37c159900 msgr2=0x7fc37c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 --2- 172.21.15.50:0/1303695252 >> v2:172.21.15.181:3300/0 conn(0x7fc37c159900 0x7fc37c0cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 >> v1:172.21.15.181:6789/0 conn(0x7fc37c0b3580 legacy=0x7fc37c070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0ce7d0 con 0x7fc37c0714d0 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fc3740019f0 con 0x7fc37c0714d0 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc381c00700 1 --2- 172.21.15.50:0/1303695252 >> v2:172.21.15.181:3300/0 conn(0x7fc37c159900 0x7fc37c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 >> v1:172.21.15.50:6789/0 conn(0x7fc37c0714d0 legacy=0x7fc37c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364005c30 0x7fc364006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc364006630 0x7fc364006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3640073a0 0x7fc36400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0ce4f0 con 0x7fc364006630 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36400e2e0 con 0x7fc3640073a0 2024-09-13T15:08:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36400e4a0 con 0x7fc364005c30 2024-09-13T15:08:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc381200700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc364006630 0x7fc364006b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.936+0000 7fc381c00700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364005c30 0x7fc364006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc382600700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3640073a0 0x7fc36400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc381200700 1 -- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364005c30 msgr2=0x7fc364006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc381200700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364005c30 0x7fc364006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc381200700 1 -- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3640073a0 msgr2=0x7fc36400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc381200700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3640073a0 0x7fc36400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc381200700 1 -- 172.21.15.50:0/1303695252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640057e0 con 0x7fc364006630 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc382600700 1 -- 172.21.15.50:0/1303695252 reap_dead start 2024-09-13T15:08:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc381200700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc364006630 0x7fc364006b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3680018f0 tx=0x7fc364007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3beb173a9f0bf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368001390 con 0x7fc364006630 2024-09-13T15:08:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3680052f0 con 0x7fc364006630 2024-09-13T15:08:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc37be00700 1 -- 172.21.15.50:0/1303695252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3680036a0 con 0x7fc364006630 2024-09-13T15:08:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 -- 172.21.15.50:0/1303695252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc364006630 msgr2=0x7fc364006b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc364006630 0x7fc364006b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3680018f0 tx=0x7fc364007ab0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 -- 172.21.15.50:0/1303695252 shutdown_connections 2024-09-13T15:08:42.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 --2- 172.21.15.50:0/1303695252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc364006630 0x7fc364006b00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 -- 172.21.15.50:0/1303695252 >> 172.21.15.50:0/1303695252 conn(0x7fc37c0b18c0 msgr2=0x7fc37c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:42.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 -- 172.21.15.50:0/1303695252 shutdown_connections 2024-09-13T15:08:42.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.940+0000 7fc384600700 1 -- 172.21.15.50:0/1303695252 wait complete. 2024-09-13T15:08:42.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.944+0000 7fc384600700 1 Processor -- start 2024-09-13T15:08:42.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.944+0000 7fc384600700 1 -- start start 2024-09-13T15:08:42.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364006630 0x7fc37c1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 0x7fc37c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc37c1f15d0 0x7fc37c1f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c151830 con 0x7fc37c0cc550 2024-09-13T15:08:42.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c14efc0 con 0x7fc37c1f15d0 2024-09-13T15:08:42.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c1f1f90 con 0x7fc364006630 2024-09-13T15:08:42.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 0x7fc37c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc382600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc37c1f15d0 0x7fc37c1f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 0x7fc37c0c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51280/0 (socket says 172.21.15.50:51280) 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 -- 172.21.15.50:0/3050252257 learned_addr learned my addr 172.21.15.50:0/3050252257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc382600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc37c1f15d0 0x7fc37c1f1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59058/0 (socket says 172.21.15.50:59058) 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381c00700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364006630 0x7fc37c1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 -- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364006630 msgr2=0x7fc37c1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364006630 0x7fc37c1512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 -- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc37c1f15d0 msgr2=0x7fc37c1f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc37c1f15d0 0x7fc37c1f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 -- 172.21.15.50:0/3050252257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c1522c0 con 0x7fc37c0cc550 2024-09-13T15:08:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc381200700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 0x7fc37c0c5520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c0e0 tx=0x7fc368001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800c490 con 0x7fc37c0cc550 2024-09-13T15:08:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36800c5f0 con 0x7fc37c0cc550 2024-09-13T15:08:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800c9a0 con 0x7fc37c0cc550 2024-09-13T15:08:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c0c5a60 con 0x7fc37c0cc550 2024-09-13T15:08:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.948+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c151d00 con 0x7fc37c0cc550 2024-09-13T15:08:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.952+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c0b3d80 con 0x7fc37c0cc550 2024-09-13T15:08:42.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.952+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc36800cd10 con 0x7fc37c0cc550 2024-09-13T15:08:42.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.952+0000 7fc379600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc35c066760 0x7fc35c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:42.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.952+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc368085690 con 0x7fc37c0cc550 2024-09-13T15:08:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.952+0000 7fc381c00700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc35c066760 0x7fc35c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.956+0000 7fc381c00700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc35c066760 0x7fc35c068c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc37c067950 tx=0x7fc370008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:42.960+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3680526d0 con 0x7fc37c0cc550 2024-09-13T15:08:43.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.144+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc37c0b49f0 con 0x7fc37c0cc550 2024-09-13T15:08:43.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc379600700 1 -- 172.21.15.50:0/3050252257 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc368055cf0 con 0x7fc37c0cc550 2024-09-13T15:08:43.150 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:43.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc35c066760 msgr2=0x7fc35c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc35c066760 0x7fc35c068c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc37c067950 tx=0x7fc370008040 comp rx=0 tx=0).stop 2024-09-13T15:08:43.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 msgr2=0x7fc37c0c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 0x7fc37c0c5520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c0e0 tx=0x7fc368001230 comp rx=0 tx=0).stop 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 shutdown_connections 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc35c066760 0x7fc35c068c20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc37c1f15d0 0x7fc37c1f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c0cc550 0x7fc37c0c5520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 --2- 172.21.15.50:0/3050252257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc364006630 0x7fc37c1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 >> 172.21.15.50:0/3050252257 conn(0x7fc37c0b18c0 msgr2=0x7fc37c1560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 shutdown_connections 2024-09-13T15:08:43.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.148+0000 7fc384600700 1 -- 172.21.15.50:0/3050252257 wait complete. 2024-09-13T15:08:43.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:43.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.352+0000 7f0b3f800700 1 Processor -- start 2024-09-13T15:08:43.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.352+0000 7f0b3f800700 1 -- start start 2024-09-13T15:08:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3f800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0b3806be10 0x7f0b380ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3f800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b380cf0b0 0x7f0b381618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3f800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3806d000 con 0x7f0b38160fc0 2024-09-13T15:08:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3f800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380cf520 con 0x7f0b3806be10 2024-09-13T15:08:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3f800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3806c3f0 con 0x7f0b380cf0b0 2024-09-13T15:08:43.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3ce00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b38160fc0 0x7f0b380b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48126/0 (socket says 172.21.15.50:48126) 2024-09-13T15:08:43.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3ce00700 1 -- 172.21.15.50:0/3093582610 learned_addr learned my addr 172.21.15.50:0/3093582610 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:43.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37e00700 1 --2- 172.21.15.50:0/3093582610 >> v2:172.21.15.181:3300/0 conn(0x7f0b3806be10 0x7f0b380ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b3d800700 1 --2- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b380cf0b0 0x7f0b381618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37400700 1 -- 172.21.15.50:0/3093582610 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194923488 0 0) 0x7f0b3806d000 con 0x7f0b38160fc0 2024-09-13T15:08:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37400700 1 -- 172.21.15.50:0/3093582610 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b200035d0 con 0x7f0b38160fc0 2024-09-13T15:08:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37e00700 1 -- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b380cf0b0 msgr2=0x7f0b381618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37e00700 1 --2- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b380cf0b0 0x7f0b381618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37e00700 1 -- 172.21.15.50:0/3093582610 >> v1:172.21.15.50:6789/0 conn(0x7f0b38160fc0 legacy=0x7f0b380b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37e00700 1 -- 172.21.15.50:0/3093582610 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3806c6d0 con 0x7f0b3806be10 2024-09-13T15:08:43.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.356+0000 7f0b37e00700 1 --2- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3806be10 0x7f0b380ceb70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009850 tx=0x7f0b24009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c0a158de3f318e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:43.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b37400700 1 -- 172.21.15.50:0/3093582610 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24011830 con 0x7f0b3806be10 2024-09-13T15:08:43.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b37400700 1 -- 172.21.15.50:0/3093582610 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24011990 con 0x7f0b3806be10 2024-09-13T15:08:43.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b37400700 1 -- 172.21.15.50:0/3093582610 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24011d40 con 0x7f0b3806be10 2024-09-13T15:08:43.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 -- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3806be10 msgr2=0x7f0b380ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 --2- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3806be10 0x7f0b380ceb70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009850 tx=0x7f0b24009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 -- 172.21.15.50:0/3093582610 shutdown_connections 2024-09-13T15:08:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 --2- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b380cf0b0 0x7f0b381618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 --2- 172.21.15.50:0/3093582610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3806be10 0x7f0b380ceb70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 -- 172.21.15.50:0/3093582610 >> 172.21.15.50:0/3093582610 conn(0x7f0b3806a570 msgr2=0x7f0b3806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 -- 172.21.15.50:0/3093582610 shutdown_connections 2024-09-13T15:08:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.360+0000 7f0b3f800700 1 -- 172.21.15.50:0/3093582610 wait complete. 2024-09-13T15:08:43.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 Processor -- start 2024-09-13T15:08:43.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 -- start start 2024-09-13T15:08:43.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b3806be10 0x7f0b380aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b380cf0b0 0x7f0b381586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 0x7f0b380ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38158dc0 con 0x7f0b38160fc0 2024-09-13T15:08:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38158bf0 con 0x7f0b380cf0b0 2024-09-13T15:08:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.364+0000 7f0b3f800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380aaa70 con 0x7f0b3806be10 2024-09-13T15:08:43.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 0x7f0b380ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 0x7f0b380ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37804/0 (socket says 172.21.15.50:37804) 2024-09-13T15:08:43.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 -- 172.21.15.50:0/2095060339 learned_addr learned my addr 172.21.15.50:0/2095060339 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:43.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3ce00700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b3806be10 0x7f0b380aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b37e00700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b380cf0b0 0x7f0b381586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 -- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b3806be10 msgr2=0x7f0b380aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b3806be10 0x7f0b380aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 -- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b380cf0b0 msgr2=0x7f0b381586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b380cf0b0 0x7f0b381586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 -- 172.21.15.50:0/2095060339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240094b0 con 0x7f0b38160fc0 2024-09-13T15:08:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3d800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 0x7f0b380ac940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009d20 tx=0x7f0b3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000cc90 con 0x7f0b38160fc0 2024-09-13T15:08:43.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3000f040 con 0x7f0b38160fc0 2024-09-13T15:08:43.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b380aad50 con 0x7f0b38160fc0 2024-09-13T15:08:43.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30009b10 con 0x7f0b38160fc0 2024-09-13T15:08:43.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b380ab310 con 0x7f0b38160fc0 2024-09-13T15:08:43.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.368+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b38158f70 con 0x7f0b38160fc0 2024-09-13T15:08:43.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.372+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b30014480 con 0x7f0b38160fc0 2024-09-13T15:08:43.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.372+0000 7f0b34c00700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0b18066730 0x7f0b18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.372+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0b30084ce0 con 0x7f0b38160fc0 2024-09-13T15:08:43.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.372+0000 7f0b3ce00700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0b18066730 0x7f0b18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.376+0000 7f0b3ce00700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0b18066730 0x7f0b18068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c007fd0 tx=0x7f0b2c007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.380+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b38158f70 con 0x7f0b38160fc0 2024-09-13T15:08:43.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.572+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b38158f70 con 0x7f0b38160fc0 2024-09-13T15:08:43.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.572+0000 7f0b34c00700 1 -- 172.21.15.50:0/2095060339 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b38158f70 con 0x7f0b38160fc0 2024-09-13T15:08:43.577 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:43.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0b18066730 msgr2=0x7f0b18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0b18066730 0x7f0b18068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c007fd0 tx=0x7f0b2c007de0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 msgr2=0x7f0b380ac940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 0x7f0b380ac940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009d20 tx=0x7f0b3000c3a0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 shutdown_connections 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0b18066730 0x7f0b18068bf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b38160fc0 0x7f0b380ac940 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b380cf0b0 0x7f0b381586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 --2- 172.21.15.50:0/2095060339 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0b3806be10 0x7f0b380aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.576+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 >> 172.21.15.50:0/2095060339 conn(0x7f0b3806a570 msgr2=0x7f0b380b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.580+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 shutdown_connections 2024-09-13T15:08:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.580+0000 7f0b3f800700 1 -- 172.21.15.50:0/2095060339 wait complete. 2024-09-13T15:08:43.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.788+0000 7f08c6a00700 1 Processor -- start 2024-09-13T15:08:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.788+0000 7f08c6a00700 1 -- start start 2024-09-13T15:08:43.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08c6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c006ff00 0x7f08c0070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08c6a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c0070880 con 0x7f08c006ab90 2024-09-13T15:08:43.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08c6a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00b3c20 con 0x7f08c01612c0 2024-09-13T15:08:43.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08c6a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00d0810 con 0x7f08c006ff00 2024-09-13T15:08:43.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bfe00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f08c01612c0 0x7f08c00d0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:54928/0 (socket says 172.21.15.50:54928) 2024-09-13T15:08:43.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bfe00700 1 -- 172.21.15.50:0/3095016806 learned_addr learned my addr 172.21.15.50:0/3095016806 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:43.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bf400700 1 --2- 172.21.15.50:0/3095016806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c006ff00 0x7f08c0070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08c4a00700 1 --1- 172.21.15.50:0/3095016806 >> v1:172.21.15.50:6789/0 conn(0x7f08c006ab90 0x7f08c006b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48136/0 (socket says 172.21.15.50:48136) 2024-09-13T15:08:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bea00700 1 -- 172.21.15.50:0/3095016806 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576976667 0 0) 0x7f08c00b3c20 con 0x7f08c01612c0 2024-09-13T15:08:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bea00700 1 -- 172.21.15.50:0/3095016806 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a40035d0 con 0x7f08c01612c0 2024-09-13T15:08:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bea00700 1 -- 172.21.15.50:0/3095016806 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294867097 0 0) 0x7f08c0070880 con 0x7f08c006ab90 2024-09-13T15:08:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bf400700 1 -- 172.21.15.50:0/3095016806 >> v1:172.21.15.181:6789/0 conn(0x7f08c01612c0 legacy=0x7f08c00d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bf400700 1 -- 172.21.15.50:0/3095016806 >> v1:172.21.15.50:6789/0 conn(0x7f08c006ab90 legacy=0x7f08c006b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bf400700 1 -- 172.21.15.50:0/3095016806 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00b3f00 con 0x7f08c006ff00 2024-09-13T15:08:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.792+0000 7f08bf400700 1 --2- 172.21.15.50:0/3095016806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c006ff00 0x7f08c0070340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009880 tx=0x7f08ac009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b30ae310d35a1ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08bea00700 1 -- 172.21.15.50:0/3095016806 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac011830 con 0x7f08c006ff00 2024-09-13T15:08:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08bea00700 1 -- 172.21.15.50:0/3095016806 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac011990 con 0x7f08c006ff00 2024-09-13T15:08:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08bea00700 1 -- 172.21.15.50:0/3095016806 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac011d20 con 0x7f08c006ff00 2024-09-13T15:08:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 -- 172.21.15.50:0/3095016806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c006ff00 msgr2=0x7f08c0070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3095016806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c006ff00 0x7f08c0070340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009880 tx=0x7f08ac009b90 comp rx=0 tx=0).stop 2024-09-13T15:08:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 -- 172.21.15.50:0/3095016806 shutdown_connections 2024-09-13T15:08:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3095016806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c006ff00 0x7f08c0070340 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 -- 172.21.15.50:0/3095016806 >> 172.21.15.50:0/3095016806 conn(0x7f08c006e660 msgr2=0x7f08c006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 -- 172.21.15.50:0/3095016806 shutdown_connections 2024-09-13T15:08:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 -- 172.21.15.50:0/3095016806 wait complete. 2024-09-13T15:08:43.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 Processor -- start 2024-09-13T15:08:43.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.796+0000 7f08c6a00700 1 -- start start 2024-09-13T15:08:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 0x7f08c0150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08c006ff00 0x7f08c01525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c01612c0 0x7f08c0154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01546b0 con 0x7f08c006ab90 2024-09-13T15:08:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0150ba0 con 0x7f08c006ff00 2024-09-13T15:08:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0152b00 con 0x7f08c01612c0 2024-09-13T15:08:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 0x7f08c0150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 0x7f08c0150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37812/0 (socket says 172.21.15.50:37812) 2024-09-13T15:08:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 -- 172.21.15.50:0/3403791879 learned_addr learned my addr 172.21.15.50:0/3403791879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bf400700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08c006ff00 0x7f08c01525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c4a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c01612c0 0x7f08c0154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 -- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c01612c0 msgr2=0x7f08c0154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c01612c0 0x7f08c0154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 -- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08c006ff00 msgr2=0x7f08c01525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08c006ff00 0x7f08c01525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 -- 172.21.15.50:0/3403791879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0094b0 con 0x7f08c006ab90 2024-09-13T15:08:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08bfe00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 0x7f08c0150660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f08b000c500 tx=0x7f08b000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0005d90 con 0x7f08c006ab90 2024-09-13T15:08:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00070d0 con 0x7f08c006ab90 2024-09-13T15:08:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c01543d0 con 0x7f08c006ab90 2024-09-13T15:08:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0007480 con 0x7f08c006ab90 2024-09-13T15:08:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.800+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c0161bc0 con 0x7f08c006ab90 2024-09-13T15:08:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.804+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c0161740 con 0x7f08c006ab90 2024-09-13T15:08:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.804+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08b00075e0 con 0x7f08c006ab90 2024-09-13T15:08:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.808+0000 7f08b7e00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f08a0066730 0x7f08a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.808+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08b00839e0 con 0x7f08c006ab90 2024-09-13T15:08:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.808+0000 7f08bf400700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f08a0066730 0x7f08a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:43.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.808+0000 7f08bf400700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f08a0066730 0x7f08a0068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009880 tx=0x7f08ac01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:43.812+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08c0161740 con 0x7f08c006ab90 2024-09-13T15:08:44.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.000+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08c0161740 con 0x7f08c006ab90 2024-09-13T15:08:44.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.000+0000 7f08b7e00700 1 -- 172.21.15.50:0/3403791879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08c0161740 con 0x7f08c006ab90 2024-09-13T15:08:44.005 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f08a0066730 msgr2=0x7f08a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f08a0066730 0x7f08a0068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009880 tx=0x7f08ac01c040 comp rx=0 tx=0).stop 2024-09-13T15:08:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 msgr2=0x7f08c0150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 0x7f08c0150660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f08b000c500 tx=0x7f08b000c810 comp rx=0 tx=0).stop 2024-09-13T15:08:44.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 shutdown_connections 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f08a0066730 0x7f08a0068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f08c01612c0 0x7f08c0154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08c006ff00 0x7f08c01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 --2- 172.21.15.50:0/3403791879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c006ab90 0x7f08c0150660 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 >> 172.21.15.50:0/3403791879 conn(0x7f08c006e660 msgr2=0x7f08c006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 shutdown_connections 2024-09-13T15:08:44.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.004+0000 7f08c6a00700 1 -- 172.21.15.50:0/3403791879 wait complete. 2024-09-13T15:08:44.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:08:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.212+0000 7f1c1b200700 1 Processor -- start 2024-09-13T15:08:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.212+0000 7f1c1b200700 1 -- start start 2024-09-13T15:08:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1b200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c1c06d180 0x7f1c1c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1c1c15cf10 0x7f1c1c0d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1b200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0b0190 con 0x7f1c1c15cb30 2024-09-13T15:08:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1b200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0d0770 con 0x7f1c1c06d180 2024-09-13T15:08:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c06a530 con 0x7f1c1c15cf10 2024-09-13T15:08:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c19400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c1c06d180 0x7f1c1c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c19e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1c1c15cb30 0x7f1c1c06ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48146/0 (socket says 172.21.15.50:48146) 2024-09-13T15:08:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c19e00700 1 -- 172.21.15.50:0/1478895365 learned_addr learned my addr 172.21.15.50:0/1478895365 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1a800700 1 --2- 172.21.15.50:0/1478895365 >> v2:172.21.15.181:3300/0 conn(0x7f1c1c15cf10 0x7f1c1c0d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c18a00700 1 -- 172.21.15.50:0/1478895365 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542544996 0 0) 0x7f1c1c0b0190 con 0x7f1c1c15cb30 2024-09-13T15:08:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c18a00700 1 -- 172.21.15.50:0/1478895365 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c000035d0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1a800700 1 -- 172.21.15.50:0/1478895365 >> v2:172.21.15.50:3300/0 conn(0x7f1c1c06d180 msgr2=0x7f1c1c0cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1a800700 1 --2- 172.21.15.50:0/1478895365 >> v2:172.21.15.50:3300/0 conn(0x7f1c1c06d180 0x7f1c1c0cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1a800700 1 -- 172.21.15.50:0/1478895365 >> v1:172.21.15.50:6789/0 conn(0x7f1c1c15cb30 legacy=0x7f1c1c06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1a800700 1 -- 172.21.15.50:0/1478895365 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c06a810 con 0x7f1c1c15cf10 2024-09-13T15:08:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c19400700 1 --2- 172.21.15.50:0/1478895365 >> v2:172.21.15.50:3300/0 conn(0x7f1c1c06d180 0x7f1c1c0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c1a800700 1 --2- 172.21.15.50:0/1478895365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0d0230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0d1af0 tx=0x7f1c1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1db1399045db8da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c18a00700 1 -- 172.21.15.50:0/1478895365 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400e070 con 0x7f1c1c15cf10 2024-09-13T15:08:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c18a00700 1 -- 172.21.15.50:0/1478895365 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400bb20 con 0x7f1c1c15cf10 2024-09-13T15:08:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.216+0000 7f1c18a00700 1 -- 172.21.15.50:0/1478895365 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14012430 con 0x7f1c1c15cf10 2024-09-13T15:08:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 -- 172.21.15.50:0/1478895365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 msgr2=0x7f1c1c0d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 --2- 172.21.15.50:0/1478895365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0d0230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0d1af0 tx=0x7f1c1400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 -- 172.21.15.50:0/1478895365 shutdown_connections 2024-09-13T15:08:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 --2- 172.21.15.50:0/1478895365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0d0230 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 --2- 172.21.15.50:0/1478895365 >> v2:172.21.15.50:3300/0 conn(0x7f1c1c06d180 0x7f1c1c0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 -- 172.21.15.50:0/1478895365 >> 172.21.15.50:0/1478895365 conn(0x7f1c1c071f00 msgr2=0x7f1c1c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 -- 172.21.15.50:0/1478895365 shutdown_connections 2024-09-13T15:08:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.220+0000 7f1c1b200700 1 -- 172.21.15.50:0/1478895365 wait complete. 2024-09-13T15:08:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 Processor -- start 2024-09-13T15:08:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 -- start start 2024-09-13T15:08:44.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c1c06d180 0x7f1c1c0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 0x7f1c1c0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0ae8a0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0adc20 con 0x7f1c1c15cf10 2024-09-13T15:08:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0adf00 con 0x7f1c1c06d180 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 0x7f1c1c0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 0x7f1c1c0aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37822/0 (socket says 172.21.15.50:37822) 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 -- 172.21.15.50:0/2593114526 learned_addr learned my addr 172.21.15.50:0/2593114526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c1a800700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19e00700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c1c06d180 0x7f1c1c0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 -- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c1c06d180 msgr2=0x7f1c1c0ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c1c06d180 0x7f1c1c0ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 -- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 msgr2=0x7f1c1c0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19400700 1 -- 172.21.15.50:0/2593114526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c080094b0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.224+0000 7f1c19e00700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c1c06d180 0x7f1c1c0ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c19400700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 0x7f1c1c0aecc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800ebe0 tx=0x7f1c0800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800c850 con 0x7f1c1c15cb30 2024-09-13T15:08:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0800c9b0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c14009a70 con 0x7f1c1c15cb30 2024-09-13T15:08:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800cd40 con 0x7f1c1c15cb30 2024-09-13T15:08:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0ae4c0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.228+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c0ae9e0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.232+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c08013470 con 0x7f1c1c15cb30 2024-09-13T15:08:44.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.232+0000 7f1c12000700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1bfc066730 0x7f1bfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.232+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c08084a10 con 0x7f1c1c15cb30 2024-09-13T15:08:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.232+0000 7f1c19e00700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1bfc066730 0x7f1bfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.236+0000 7f1c19e00700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1bfc066730 0x7f1bfc068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0011e0 tx=0x7f1c0c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.240+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c1c0ae9e0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c1c0ae9e0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c12000700 1 -- 172.21.15.50:0/2593114526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1c1c0ae9e0 con 0x7f1c1c15cb30 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1bfc066730 msgr2=0x7f1bfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1bfc066730 0x7f1bfc068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0011e0 tx=0x7f1c0c009040 comp rx=0 tx=0).stop 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 msgr2=0x7f1c1c0aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 0x7f1c1c0aecc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800ebe0 tx=0x7f1c0800eef0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 shutdown_connections 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1bfc066730 0x7f1bfc068bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c1c15cf10 0x7f1c1c0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c15cb30 0x7f1c1c0aecc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 --2- 172.21.15.50:0/2593114526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c1c06d180 0x7f1c1c0ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 >> 172.21.15.50:0/2593114526 conn(0x7f1c1c071f00 msgr2=0x7f1c1c15fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 shutdown_connections 2024-09-13T15:08:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.436+0000 7f1c1b200700 1 -- 172.21.15.50:0/2593114526 wait complete. 2024-09-13T15:08:44.444 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:08:44.465 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:08:44.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:44.466 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T15:08:44.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:08:44.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:44.523 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:08:44.555 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:44.555 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:44.573 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:44.573 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:44.632 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:08:44.632 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:44.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:44.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.908+0000 7f4fd9400700 1 Processor -- start 2024-09-13T15:08:44.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.908+0000 7f4fd9400700 1 -- start start 2024-09-13T15:08:44.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd9400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fd40d0cc0 0x7f4fd40d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd9400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd40b2e40 con 0x7f4fd40d1950 2024-09-13T15:08:44.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd9400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd40cee50 con 0x7f4fd40d0cc0 2024-09-13T15:08:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd9400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40d1e00 con 0x7f4fd415cfd0 2024-09-13T15:08:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd3200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fd40d1950 0x7f4fd40cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48158/0 (socket says 172.21.15.50:48158) 2024-09-13T15:08:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd3200700 1 -- 172.21.15.50:0/1174393703 learned_addr learned my addr 172.21.15.50:0/1174393703 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd2800700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1e00700 1 --2- 172.21.15.50:0/1174393703 >> v2:172.21.15.50:3300/0 conn(0x7f4fd40d0cc0 0x7f4fd40d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691156520 0 0) 0x7f4fd40b2e40 con 0x7f4fd40d1950 2024-09-13T15:08:44.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb80035d0 con 0x7f4fd40d1950 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1288467518 0 0) 0x7f4fb80035d0 con 0x7f4fd40d1950 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 msgr2=0x7f4fd40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd40ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 >> v2:172.21.15.50:3300/0 conn(0x7f4fd40d0cc0 msgr2=0x7f4fd40d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 --2- 172.21.15.50:0/1174393703 >> v2:172.21.15.50:3300/0 conn(0x7f4fd40d0cc0 0x7f4fd40d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40ceb70 con 0x7f4fd40d1950 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f4fcc0019f0 con 0x7f4fd40d1950 2024-09-13T15:08:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 >> v1:172.21.15.50:6789/0 conn(0x7f4fd40d1950 legacy=0x7f4fd40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb8003a20 0x7f4fb8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fb8004870 0x7f4fb8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fb8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40cee50 con 0x7f4fb8003a20 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40d1e00 con 0x7f4fb8004870 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.912+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb800ba30 con 0x7f4fd415cfd0 2024-09-13T15:08:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fb8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd2800700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb8003a20 0x7f4fb8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd1e00700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fb8004870 0x7f4fb8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 -- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fb8004870 msgr2=0x7f4fb8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fb8004870 0x7f4fb8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 -- 172.21.15.50:0/1174393703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb8003a20 msgr2=0x7f4fb8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb8003a20 0x7f4fb8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 -- 172.21.15.50:0/1174393703 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80035d0 con 0x7f4fd415cfd0 2024-09-13T15:08:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fb8005230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00a890 tx=0x7f4fb80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7b5c1edfcca989c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0072d0 con 0x7f4fd415cfd0 2024-09-13T15:08:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc007450 con 0x7f4fd415cfd0 2024-09-13T15:08:44.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd1400700 1 -- 172.21.15.50:0/1174393703 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc007800 con 0x7f4fd415cfd0 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd9400700 1 -- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 msgr2=0x7f4fb8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1174393703 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fb8005230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00a890 tx=0x7f4fb80058a0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd3200700 1 -- 172.21.15.50:0/1174393703 reap_dead start 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd9400700 1 -- 172.21.15.50:0/1174393703 shutdown_connections 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd9400700 1 -- 172.21.15.50:0/1174393703 >> 172.21.15.50:0/1174393703 conn(0x7f4fd409c0e0 msgr2=0x7f4fd40d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd9400700 1 -- 172.21.15.50:0/1174393703 shutdown_connections 2024-09-13T15:08:44.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.916+0000 7f4fd9400700 1 -- 172.21.15.50:0/1174393703 wait complete. 2024-09-13T15:08:44.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.920+0000 7f4fd9400700 1 Processor -- start 2024-09-13T15:08:44.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.920+0000 7f4fd9400700 1 -- start start 2024-09-13T15:08:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fd4159300 0x7f4fd40cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 0x7f4fd40cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4158ee0 con 0x7f4fd40ccc60 2024-09-13T15:08:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4157f80 con 0x7f4fd4159300 2024-09-13T15:08:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4158260 con 0x7f4fd415cfd0 2024-09-13T15:08:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 0x7f4fd40cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 0x7f4fd40cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37860/0 (socket says 172.21.15.50:37860) 2024-09-13T15:08:44.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 -- 172.21.15.50:0/1777950064 learned_addr learned my addr 172.21.15.50:0/1777950064 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd2800700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd1e00700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fd4159300 0x7f4fd40cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 -- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 msgr2=0x7f4fd4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd4154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 -- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fd4159300 msgr2=0x7f4fd40cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fd4159300 0x7f4fd40cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 -- 172.21.15.50:0/1777950064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40d1260 con 0x7f4fd40ccc60 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd2800700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:44.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd3200700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 0x7f4fd40cb930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc016040 tx=0x7f4fcc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc025070 con 0x7f4fd40ccc60 2024-09-13T15:08:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0019c0 con 0x7f4fd40ccc60 2024-09-13T15:08:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc012600 con 0x7f4fd40ccc60 2024-09-13T15:08:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd4158540 con 0x7f4fd40ccc60 2024-09-13T15:08:44.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.924+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4158b00 con 0x7f4fd40ccc60 2024-09-13T15:08:44.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.928+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd4159020 con 0x7f4fd40ccc60 2024-09-13T15:08:44.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.928+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fcc01a070 con 0x7f4fd40ccc60 2024-09-13T15:08:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.928+0000 7f4fcaa00700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fb4066760 0x7f4fb4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:44.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.928+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4fcc085a00 con 0x7f4fd40ccc60 2024-09-13T15:08:44.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.928+0000 7f4fd2800700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fb4066760 0x7f4fb4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:44.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.932+0000 7f4fd2800700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fb4066760 0x7f4fb4068c20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009bf0 tx=0x7f4fc4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:44.936+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4fd4159020 con 0x7f4fd40ccc60 2024-09-13T15:08:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.132+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fd4159020 con 0x7f4fd40ccc60 2024-09-13T15:08:45.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.132+0000 7f4fcaa00700 1 -- 172.21.15.50:0/1777950064 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f4fd4159020 con 0x7f4fd40ccc60 2024-09-13T15:08:45.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:45.138 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fb4066760 msgr2=0x7f4fb4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fb4066760 0x7f4fb4068c20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009bf0 tx=0x7f4fc4008040 comp rx=0 tx=0).stop 2024-09-13T15:08:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 msgr2=0x7f4fd40cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 0x7f4fd40cb930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc016040 tx=0x7f4fcc001d80 comp rx=0 tx=0).stop 2024-09-13T15:08:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 shutdown_connections 2024-09-13T15:08:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4fb4066760 0x7f4fb4068c20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fd40ccc60 0x7f4fd40cb930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fd4159300 0x7f4fd40cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 --2- 172.21.15.50:0/1777950064 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4fd415cfd0 0x7f4fd4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 >> 172.21.15.50:0/1777950064 conn(0x7f4fd409c0e0 msgr2=0x7f4fd40b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 shutdown_connections 2024-09-13T15:08:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.136+0000 7f4fd9400700 1 -- 172.21.15.50:0/1777950064 wait complete. 2024-09-13T15:08:45.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:45.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:45.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.328+0000 7f61e5c00700 1 Processor -- start 2024-09-13T15:08:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.328+0000 7f61e5c00700 1 -- start start 2024-09-13T15:08:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.332+0000 7f61e5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.332+0000 7f61e5c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61e006c980 0x7f61e00b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.332+0000 7f61e5c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00b4680 con 0x7f61e00b2540 2024-09-13T15:08:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.332+0000 7f61e5c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e00b4960 con 0x7f61e006c980 2024-09-13T15:08:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.332+0000 7f61e5c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00cf030 con 0x7f61e006c5a0 2024-09-13T15:08:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61df400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61e006c980 0x7f61e00b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e015aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:59048/0 (socket says 172.21.15.50:59048) 2024-09-13T15:08:45.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 -- 172.21.15.50:0/1697090005 learned_addr learned my addr 172.21.15.50:0/1697090005 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 -- 172.21.15.50:0/1697090005 >> v2:172.21.15.181:3300/0 conn(0x7f61e006c980 msgr2=0x7f61e00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 --2- 172.21.15.50:0/1697090005 >> v2:172.21.15.181:3300/0 conn(0x7f61e006c980 0x7f61e00b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 -- 172.21.15.50:0/1697090005 >> v1:172.21.15.181:6789/0 conn(0x7f61e00b2540 legacy=0x7f61e00b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 -- 172.21.15.50:0/1697090005 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00cf310 con 0x7f61e006c5a0 2024-09-13T15:08:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61df400700 1 --2- 172.21.15.50:0/1697090005 >> v2:172.21.15.181:3300/0 conn(0x7f61e006c980 0x7f61e00b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dfe00700 1 --2- 172.21.15.50:0/1697090005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e015aa90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009910 tx=0x7f61d0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ff158ea3c5e7f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dea00700 1 -- 172.21.15.50:0/1697090005 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011830 con 0x7f61e006c5a0 2024-09-13T15:08:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dea00700 1 -- 172.21.15.50:0/1697090005 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0011990 con 0x7f61e006c5a0 2024-09-13T15:08:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61dea00700 1 -- 172.21.15.50:0/1697090005 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011d40 con 0x7f61e006c5a0 2024-09-13T15:08:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 -- 172.21.15.50:0/1697090005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 msgr2=0x7f61e015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 --2- 172.21.15.50:0/1697090005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e015aa90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009910 tx=0x7f61d0009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 -- 172.21.15.50:0/1697090005 shutdown_connections 2024-09-13T15:08:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 --2- 172.21.15.50:0/1697090005 >> v2:172.21.15.181:3300/0 conn(0x7f61e006c980 0x7f61e00b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 --2- 172.21.15.50:0/1697090005 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e015aa90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 -- 172.21.15.50:0/1697090005 >> 172.21.15.50:0/1697090005 conn(0x7f61e0071d20 msgr2=0x7f61e0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 -- 172.21.15.50:0/1697090005 shutdown_connections 2024-09-13T15:08:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.336+0000 7f61e5c00700 1 -- 172.21.15.50:0/1697090005 wait complete. 2024-09-13T15:08:45.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.340+0000 7f61e5c00700 1 Processor -- start 2024-09-13T15:08:45.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.340+0000 7f61e5c00700 1 -- start start 2024-09-13T15:08:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 0x7f61e01ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e00b2540 0x7f61e01493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e014d060 con 0x7f61e006c980 2024-09-13T15:08:45.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01eef00 con 0x7f61e00b2540 2024-09-13T15:08:45.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e014a6b0 con 0x7f61e006c5a0 2024-09-13T15:08:45.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 0x7f61e01ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 0x7f61e01ee9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37862/0 (socket says 172.21.15.50:37862) 2024-09-13T15:08:45.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 -- 172.21.15.50:0/3769219457 learned_addr learned my addr 172.21.15.50:0/3769219457 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:45.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61dfe00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5200700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e00b2540 0x7f61e01493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 -- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 msgr2=0x7f61e014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 -- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e00b2540 msgr2=0x7f61e01493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e00b2540 0x7f61e01493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 -- 172.21.15.50:0/3769219457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc00d950 con 0x7f61e006c980 2024-09-13T15:08:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5200700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e00b2540 0x7f61e01493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61df400700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 0x7f61e01ee9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61cc012d80 tx=0x7f61cc0103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:45.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc010bb0 con 0x7f61e006c980 2024-09-13T15:08:45.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0009570 con 0x7f61e006c980 2024-09-13T15:08:45.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc013040 con 0x7f61e006c980 2024-09-13T15:08:45.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc012ed0 con 0x7f61e006c980 2024-09-13T15:08:45.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.344+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e014ac70 con 0x7f61e006c980 2024-09-13T15:08:45.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.348+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e006cda0 con 0x7f61e006c980 2024-09-13T15:08:45.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.348+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61cc018480 con 0x7f61e006c980 2024-09-13T15:08:45.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.352+0000 7f61d7e00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61c0066730 0x7f61c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.352+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f61cc0885d0 con 0x7f61e006c980 2024-09-13T15:08:45.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.352+0000 7f61dfe00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61c0066730 0x7f61c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.352+0000 7f61dfe00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61c0066730 0x7f61c0068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009c60 tx=0x7f61d0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:45.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.356+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61cc055570 con 0x7f61e006c980 2024-09-13T15:08:45.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.540+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61e0072480 con 0x7f61e006c980 2024-09-13T15:08:45.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.540+0000 7f61d7e00700 1 -- 172.21.15.50:0/3769219457 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61cc058b90 con 0x7f61e006c980 2024-09-13T15:08:45.545 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:45.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61c0066730 msgr2=0x7f61c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61c0066730 0x7f61c0068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009c60 tx=0x7f61d0008030 comp rx=0 tx=0).stop 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 msgr2=0x7f61e01ee9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 0x7f61e01ee9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61cc012d80 tx=0x7f61cc0103a0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 shutdown_connections 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61c0066730 0x7f61c0068bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e00b2540 0x7f61e01493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e006c980 0x7f61e01ee9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 --2- 172.21.15.50:0/3769219457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61e006c5a0 0x7f61e014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 >> 172.21.15.50:0/3769219457 conn(0x7f61e0071d20 msgr2=0x7f61e00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 shutdown_connections 2024-09-13T15:08:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.544+0000 7f61e5c00700 1 -- 172.21.15.50:0/3769219457 wait complete. 2024-09-13T15:08:45.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:45.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 Processor -- start 2024-09-13T15:08:45.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 -- start start 2024-09-13T15:08:45.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5fa8066090 0x7f5fa8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fa8071770 0x7f5fa8071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa80b32d0 con 0x7f5fa8162340 2024-09-13T15:08:45.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa80669b0 con 0x7f5fa8071770 2024-09-13T15:08:45.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.744+0000 7f5fad200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa80b3530 con 0x7f5fa8066090 2024-09-13T15:08:45.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fa8162340 0x7f5fa80b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48166/0 (socket says 172.21.15.50:48166) 2024-09-13T15:08:45.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5fa8066090 0x7f5fa8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5400700 1 -- 172.21.15.50:0/3553354621 learned_addr learned my addr 172.21.15.50:0/3553354621 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:45.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa6800700 1 --2- 172.21.15.50:0/3553354621 >> v2:172.21.15.50:3300/0 conn(0x7f5fa8071770 0x7f5fa8071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5e00700 1 -- 172.21.15.50:0/3553354621 >> v2:172.21.15.50:3300/0 conn(0x7f5fa8071770 msgr2=0x7f5fa8071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5e00700 1 --2- 172.21.15.50:0/3553354621 >> v2:172.21.15.50:3300/0 conn(0x7f5fa8071770 0x7f5fa8071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa4a00700 1 -- 172.21.15.50:0/3553354621 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50107673 0 0) 0x7f5fa80b32d0 con 0x7f5fa8162340 2024-09-13T15:08:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5e00700 1 -- 172.21.15.50:0/3553354621 >> v1:172.21.15.50:6789/0 conn(0x7f5fa8162340 legacy=0x7f5fa80b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5e00700 1 -- 172.21.15.50:0/3553354621 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa80b3810 con 0x7f5fa8066090 2024-09-13T15:08:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa5e00700 1 --2- 172.21.15.50:0/3553354621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa8066470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8072ea0 tx=0x7f5f98009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b0ae0742207e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa4a00700 1 -- 172.21.15.50:0/3553354621 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98011830 con 0x7f5fa8066090 2024-09-13T15:08:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa4a00700 1 -- 172.21.15.50:0/3553354621 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f98011990 con 0x7f5fa8066090 2024-09-13T15:08:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fa4a00700 1 -- 172.21.15.50:0/3553354621 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98011d20 con 0x7f5fa8066090 2024-09-13T15:08:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fad200700 1 -- 172.21.15.50:0/3553354621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 msgr2=0x7f5fa8066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.748+0000 7f5fad200700 1 --2- 172.21.15.50:0/3553354621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa8066470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8072ea0 tx=0x7f5f98009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 -- 172.21.15.50:0/3553354621 shutdown_connections 2024-09-13T15:08:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 --2- 172.21.15.50:0/3553354621 >> v2:172.21.15.50:3300/0 conn(0x7f5fa8071770 0x7f5fa8071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 --2- 172.21.15.50:0/3553354621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa8066470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 -- 172.21.15.50:0/3553354621 >> 172.21.15.50:0/3553354621 conn(0x7f5fa806f5a0 msgr2=0x7f5fa806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 -- 172.21.15.50:0/3553354621 shutdown_connections 2024-09-13T15:08:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 -- 172.21.15.50:0/3553354621 wait complete. 2024-09-13T15:08:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 Processor -- start 2024-09-13T15:08:45.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.752+0000 7f5fad200700 1 -- start start 2024-09-13T15:08:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fa8071770 0x7f5fa8145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 0x7f5fa81562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa815c710 con 0x7f5fa8162340 2024-09-13T15:08:45.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8162060 con 0x7f5fa8066090 2024-09-13T15:08:45.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa815bde0 con 0x7f5fa8071770 2024-09-13T15:08:45.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 0x7f5fa81562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 0x7f5fa81562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37884/0 (socket says 172.21.15.50:37884) 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 -- 172.21.15.50:0/2114579745 learned_addr learned my addr 172.21.15.50:0/2114579745 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa5e00700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa5400700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fa8071770 0x7f5fa8145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 -- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fa8071770 msgr2=0x7f5fa8145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fa8071770 0x7f5fa8145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 -- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 msgr2=0x7f5fa815f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa815f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 -- 172.21.15.50:0/2114579745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980094b0 con 0x7f5fa8162340 2024-09-13T15:08:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fa6800700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 0x7f5fa81562e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000efc0 tx=0x7f5fa000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000cad0 con 0x7f5fa8162340 2024-09-13T15:08:45.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa000f040 con 0x7f5fa8162340 2024-09-13T15:08:45.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa815c0c0 con 0x7f5fa8162340 2024-09-13T15:08:45.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000ce70 con 0x7f5fa8162340 2024-09-13T15:08:45.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.756+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa8145e60 con 0x7f5fa8162340 2024-09-13T15:08:45.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.760+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8066470 con 0x7f5fa8162340 2024-09-13T15:08:45.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.760+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5fa0014480 con 0x7f5fa8162340 2024-09-13T15:08:45.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.764+0000 7f5f9e000700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f88066760 0x7f5f88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.764+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5fa0084ce0 con 0x7f5fa8162340 2024-09-13T15:08:45.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.764+0000 7f5fa5e00700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f88066760 0x7f5f88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:45.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.764+0000 7f5fa5e00700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f88066760 0x7f5f88068c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009fd0 tx=0x7f5f98008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:45.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.768+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5fa0051cb0 con 0x7f5fa8162340 2024-09-13T15:08:45.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.948+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fa80cdfd0 con 0x7f5fa8162340 2024-09-13T15:08:45.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.948+0000 7f5f9e000700 1 -- 172.21.15.50:0/2114579745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fa0018020 con 0x7f5fa8162340 2024-09-13T15:08:45.954 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f88066760 msgr2=0x7f5f88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f88066760 0x7f5f88068c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009fd0 tx=0x7f5f98008030 comp rx=0 tx=0).stop 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 msgr2=0x7f5fa81562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 0x7f5fa81562e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000efc0 tx=0x7f5fa000c0c0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 shutdown_connections 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5f88066760 0x7f5f88068c20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa8162340 0x7f5fa81562e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5fa8071770 0x7f5fa8145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 --2- 172.21.15.50:0/2114579745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa8066090 0x7f5fa815f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 >> 172.21.15.50:0/2114579745 conn(0x7f5fa806f5a0 msgr2=0x7f5fa8163120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 shutdown_connections 2024-09-13T15:08:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:45.952+0000 7f5fad200700 1 -- 172.21.15.50:0/2114579745 wait complete. 2024-09-13T15:08:45.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:46.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.156+0000 7f8c8d400700 1 Processor -- start 2024-09-13T15:08:46.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.156+0000 7f8c8d400700 1 -- start start 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c8d400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c88070a40 0x7f8c880ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c8d400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880adc60 0x7f8c8815b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c8d400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c88073660 con 0x7f8c8815ac40 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c8d400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880ae0d0 con 0x7f8c88070a40 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c8d400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880738b0 con 0x7f8c880adc60 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c8815ac40 0x7f8c880b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48180/0 (socket says 172.21.15.50:48180) 2024-09-13T15:08:46.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87e00700 1 -- 172.21.15.50:0/3589075356 learned_addr learned my addr 172.21.15.50:0/3589075356 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:46.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87400700 1 --2- 172.21.15.50:0/3589075356 >> v2:172.21.15.181:3300/0 conn(0x7f8c88070a40 0x7f8c880ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c8ca00700 1 --2- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880adc60 0x7f8c8815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c86a00700 1 -- 172.21.15.50:0/3589075356 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268877518 0 0) 0x7f8c88073660 con 0x7f8c8815ac40 2024-09-13T15:08:46.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c86a00700 1 -- 172.21.15.50:0/3589075356 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6c0035d0 con 0x7f8c8815ac40 2024-09-13T15:08:46.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87400700 1 -- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880adc60 msgr2=0x7f8c8815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:46.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87400700 1 --2- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880adc60 0x7f8c8815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87400700 1 -- 172.21.15.50:0/3589075356 >> v1:172.21.15.50:6789/0 conn(0x7f8c8815ac40 legacy=0x7f8c880b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87400700 1 -- 172.21.15.50:0/3589075356 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88073b90 con 0x7f8c88070a40 2024-09-13T15:08:46.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c87400700 1 --2- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c88070a40 0x7f8c880ad720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009850 tx=0x7f8c74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706b454f637b730a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:46.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c86a00700 1 -- 172.21.15.50:0/3589075356 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011830 con 0x7f8c88070a40 2024-09-13T15:08:46.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c86a00700 1 -- 172.21.15.50:0/3589075356 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74011990 con 0x7f8c88070a40 2024-09-13T15:08:46.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.160+0000 7f8c86a00700 1 -- 172.21.15.50:0/3589075356 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011d40 con 0x7f8c88070a40 2024-09-13T15:08:46.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 -- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c88070a40 msgr2=0x7f8c880ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c88070a40 0x7f8c880ad720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009850 tx=0x7f8c74009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:46.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 -- 172.21.15.50:0/3589075356 shutdown_connections 2024-09-13T15:08:46.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880adc60 0x7f8c8815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3589075356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c88070a40 0x7f8c880ad720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 -- 172.21.15.50:0/3589075356 >> 172.21.15.50:0/3589075356 conn(0x7f8c880b4770 msgr2=0x7f8c880b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:46.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 -- 172.21.15.50:0/3589075356 shutdown_connections 2024-09-13T15:08:46.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.164+0000 7f8c8d400700 1 -- 172.21.15.50:0/3589075356 wait complete. 2024-09-13T15:08:46.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 Processor -- start 2024-09-13T15:08:46.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 -- start start 2024-09-13T15:08:46.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 0x7f8c88098840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c880adc60 0x7f8c88150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880b0200 0x7f8c880b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880b0bd0 con 0x7f8c88070a40 2024-09-13T15:08:46.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8814ed60 con 0x7f8c880adc60 2024-09-13T15:08:46.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8d400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8814de70 con 0x7f8c880b0200 2024-09-13T15:08:46.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 0x7f8c88098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 0x7f8c88098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37890/0 (socket says 172.21.15.50:37890) 2024-09-13T15:08:46.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 -- 172.21.15.50:0/3094470331 learned_addr learned my addr 172.21.15.50:0/3094470331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c8ca00700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880b0200 0x7f8c880b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c880adc60 0x7f8c88150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 -- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880b0200 msgr2=0x7f8c880b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880b0200 0x7f8c880b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 -- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c880adc60 msgr2=0x7f8c88150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c880adc60 0x7f8c88150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 -- 172.21.15.50:0/3094470331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740094b0 con 0x7f8c88070a40 2024-09-13T15:08:46.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c87e00700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 0x7f8c88098840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c500 tx=0x7f8c7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78005d90 con 0x7f8c88070a40 2024-09-13T15:08:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.168+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780070d0 con 0x7f8c88070a40 2024-09-13T15:08:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.172+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8814e150 con 0x7f8c88070a40 2024-09-13T15:08:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.172+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78007480 con 0x7f8c88070a40 2024-09-13T15:08:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.172+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8814e710 con 0x7f8c88070a40 2024-09-13T15:08:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.172+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880ad720 con 0x7f8c88070a40 2024-09-13T15:08:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.176+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c780075e0 con 0x7f8c88070a40 2024-09-13T15:08:46.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.176+0000 7f8c7fe00700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c68066730 0x7f8c68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.176+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8c78083aa0 con 0x7f8c88070a40 2024-09-13T15:08:46.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.176+0000 7f8c87400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c68066730 0x7f8c68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.180+0000 7f8c87400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c68066730 0x7f8c68068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8c88070e70 tx=0x7f8c74008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:46.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.184+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c78050a50 con 0x7f8c88070a40 2024-09-13T15:08:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.384+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c880b4480 con 0x7f8c88070a40 2024-09-13T15:08:46.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.384+0000 7f8c7fe00700 1 -- 172.21.15.50:0/3094470331 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c780170a0 con 0x7f8c88070a40 2024-09-13T15:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.384+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c68066730 msgr2=0x7f8c68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.384+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c68066730 0x7f8c68068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8c88070e70 tx=0x7f8c74008030 comp rx=0 tx=0).stop 2024-09-13T15:08:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.384+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 msgr2=0x7f8c88098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.384+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 0x7f8c88098840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c500 tx=0x7f8c7800c8c0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 shutdown_connections 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c68066730 0x7f8c68068bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c880b0200 0x7f8c880b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c880adc60 0x7f8c88150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 --2- 172.21.15.50:0/3094470331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c88070a40 0x7f8c88098840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 >> 172.21.15.50:0/3094470331 conn(0x7f8c880b4770 msgr2=0x7f8c88154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 shutdown_connections 2024-09-13T15:08:46.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.388+0000 7f8c8d400700 1 -- 172.21.15.50:0/3094470331 wait complete. 2024-09-13T15:08:46.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 Processor -- start 2024-09-13T15:08:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 -- start start 2024-09-13T15:08:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9064159740 0x7f90640b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f90640b3de0 0x7f906406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90640b5b20 con 0x7f90640b3290 2024-09-13T15:08:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640cf680 con 0x7f9064159740 2024-09-13T15:08:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.592+0000 7f9063200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640cf1f0 con 0x7f90640b3de0 2024-09-13T15:08:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90640b3290 0x7f90640b36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48184/0 (socket says 172.21.15.50:48184) 2024-09-13T15:08:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061400700 1 -- 172.21.15.50:0/3426941008 learned_addr learned my addr 172.21.15.50:0/3426941008 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061e00700 1 --2- 172.21.15.50:0/3426941008 >> v2:172.21.15.50:3300/0 conn(0x7f9064159740 0x7f90640b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9062800700 1 --2- 172.21.15.50:0/3426941008 >> v2:172.21.15.181:3300/0 conn(0x7f90640b3de0 0x7f906406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9060a00700 1 -- 172.21.15.50:0/3426941008 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449742850 0 0) 0x7f90640b5b20 con 0x7f90640b3290 2024-09-13T15:08:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9060a00700 1 -- 172.21.15.50:0/3426941008 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90480035d0 con 0x7f90640b3290 2024-09-13T15:08:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061e00700 1 -- 172.21.15.50:0/3426941008 >> v2:172.21.15.181:3300/0 conn(0x7f90640b3de0 msgr2=0x7f906406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061e00700 1 --2- 172.21.15.50:0/3426941008 >> v2:172.21.15.181:3300/0 conn(0x7f90640b3de0 0x7f906406a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061e00700 1 -- 172.21.15.50:0/3426941008 >> v1:172.21.15.50:6789/0 conn(0x7f90640b3290 legacy=0x7f90640b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061e00700 1 -- 172.21.15.50:0/3426941008 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640ce8c0 con 0x7f9064159740 2024-09-13T15:08:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9061e00700 1 --2- 172.21.15.50:0/3426941008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f90640b5420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f90640b3030 tx=0x7f9054009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99db530134e22c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9060a00700 1 -- 172.21.15.50:0/3426941008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054011830 con 0x7f9064159740 2024-09-13T15:08:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9060a00700 1 -- 172.21.15.50:0/3426941008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9054011990 con 0x7f9064159740 2024-09-13T15:08:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9060a00700 1 -- 172.21.15.50:0/3426941008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054011d00 con 0x7f9064159740 2024-09-13T15:08:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9063200700 1 -- 172.21.15.50:0/3426941008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 msgr2=0x7f90640b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.596+0000 7f9063200700 1 --2- 172.21.15.50:0/3426941008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f90640b5420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f90640b3030 tx=0x7f9054009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 -- 172.21.15.50:0/3426941008 shutdown_connections 2024-09-13T15:08:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 --2- 172.21.15.50:0/3426941008 >> v2:172.21.15.181:3300/0 conn(0x7f90640b3de0 0x7f906406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 --2- 172.21.15.50:0/3426941008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f90640b5420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 -- 172.21.15.50:0/3426941008 >> 172.21.15.50:0/3426941008 conn(0x7f9064070d10 msgr2=0x7f90640710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 -- 172.21.15.50:0/3426941008 shutdown_connections 2024-09-13T15:08:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 -- 172.21.15.50:0/3426941008 wait complete. 2024-09-13T15:08:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 Processor -- start 2024-09-13T15:08:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.600+0000 7f9063200700 1 -- start start 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90640b3290 0x7f906414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90640b3de0 0x7f9064152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f9064156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906414aae0 con 0x7f9064159740 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9064153e00 con 0x7f90640b3de0 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906414e830 con 0x7f90640b3290 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f9064156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f9064156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37910/0 (socket says 172.21.15.50:37910) 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 -- 172.21.15.50:0/2060682379 learned_addr learned my addr 172.21.15.50:0/2060682379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9061400700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90640b3de0 0x7f9064152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9061e00700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90640b3290 0x7f906414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 -- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90640b3290 msgr2=0x7f906414a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90640b3290 0x7f906414a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 -- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90640b3de0 msgr2=0x7f9064152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90640b3de0 0x7f9064152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 -- 172.21.15.50:0/2060682379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90540094b0 con 0x7f9064159740 2024-09-13T15:08:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9062800700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f9064156150 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f905c009e30 tx=0x7f905c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c009ca0 con 0x7f9064159740 2024-09-13T15:08:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00f040 con 0x7f9064159740 2024-09-13T15:08:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9064153560 con 0x7f9064159740 2024-09-13T15:08:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c014480 con 0x7f9064159740 2024-09-13T15:08:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.604+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9064153b20 con 0x7f9064159740 2024-09-13T15:08:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.608+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906414e690 con 0x7f9064159740 2024-09-13T15:08:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.608+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f905c0145e0 con 0x7f9064159740 2024-09-13T15:08:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.608+0000 7f905a000700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9044066730 0x7f9044068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.608+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f905c0851e0 con 0x7f9064159740 2024-09-13T15:08:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.612+0000 7f9061e00700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9044066730 0x7f9044068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.612+0000 7f9061e00700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9044066730 0x7f9044068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9054000c00 tx=0x7f9054008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:46.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.616+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f906414e690 con 0x7f9064159740 2024-09-13T15:08:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.800+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f906414e690 con 0x7f9064159740 2024-09-13T15:08:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.800+0000 7f905a000700 1 -- 172.21.15.50:0/2060682379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f906414e690 con 0x7f9064159740 2024-09-13T15:08:46.805 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9044066730 msgr2=0x7f9044068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9044066730 0x7f9044068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9054000c00 tx=0x7f9054008030 comp rx=0 tx=0).stop 2024-09-13T15:08:46.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 msgr2=0x7f9064156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f9064156150 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f905c009e30 tx=0x7f905c00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 shutdown_connections 2024-09-13T15:08:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9044066730 0x7f9044068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064159740 0x7f9064156150 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90640b3de0 0x7f9064152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 --2- 172.21.15.50:0/2060682379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90640b3290 0x7f906414a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 >> 172.21.15.50:0/2060682379 conn(0x7f9064070d10 msgr2=0x7f90640afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 shutdown_connections 2024-09-13T15:08:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:46.804+0000 7f9063200700 1 -- 172.21.15.50:0/2060682379 wait complete. 2024-09-13T15:08:46.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:08:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 Processor -- start 2024-09-13T15:08:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 -- start start 2024-09-13T15:08:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa518159420 0x7fa5180aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa5180acc90 0x7fa5180ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa518072710 con 0x7fa5180cb4f0 2024-09-13T15:08:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5180b05d0 con 0x7fa5180acc90 2024-09-13T15:08:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa51ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180ac800 con 0x7fa518159420 2024-09-13T15:08:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa50f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5180cb4f0 0x7fa5180af0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48190/0 (socket says 172.21.15.50:48190) 2024-09-13T15:08:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.012+0000 7fa50f400700 1 -- 172.21.15.50:0/1866684971 learned_addr learned my addr 172.21.15.50:0/1866684971 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517e00700 1 --2- 172.21.15.50:0/1866684971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa518159420 0x7fa5180aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ca00700 1 --2- 172.21.15.50:0/1866684971 >> v2:172.21.15.181:3300/0 conn(0x7fa5180acc90 0x7fa5180ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517e00700 1 -- 172.21.15.50:0/1866684971 >> v2:172.21.15.181:3300/0 conn(0x7fa5180acc90 msgr2=0x7fa5180ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517e00700 1 --2- 172.21.15.50:0/1866684971 >> v2:172.21.15.181:3300/0 conn(0x7fa5180acc90 0x7fa5180ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517e00700 1 -- 172.21.15.50:0/1866684971 >> v1:172.21.15.50:6789/0 conn(0x7fa5180cb4f0 legacy=0x7fa5180af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517400700 1 -- 172.21.15.50:0/1866684971 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031224468 0 0) 0x7fa518072710 con 0x7fa5180cb4f0 2024-09-13T15:08:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517e00700 1 -- 172.21.15.50:0/1866684971 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa518159800 con 0x7fa518159420 2024-09-13T15:08:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517e00700 1 --2- 172.21.15.50:0/1866684971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa518159420 0x7fa5180aebb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa508009d90 tx=0x7fa50800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf8bb965de5a1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517400700 1 -- 172.21.15.50:0/1866684971 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50800e070 con 0x7fa518159420 2024-09-13T15:08:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517400700 1 -- 172.21.15.50:0/1866684971 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50800bb20 con 0x7fa518159420 2024-09-13T15:08:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa517400700 1 -- 172.21.15.50:0/1866684971 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508012430 con 0x7fa518159420 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 -- 172.21.15.50:0/1866684971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa518159420 msgr2=0x7fa5180aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 --2- 172.21.15.50:0/1866684971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa518159420 0x7fa5180aebb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa508009d90 tx=0x7fa50800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 -- 172.21.15.50:0/1866684971 shutdown_connections 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 --2- 172.21.15.50:0/1866684971 >> v2:172.21.15.181:3300/0 conn(0x7fa5180acc90 0x7fa5180ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 --2- 172.21.15.50:0/1866684971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa518159420 0x7fa5180aebb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 -- 172.21.15.50:0/1866684971 >> 172.21.15.50:0/1866684971 conn(0x7fa518071960 msgr2=0x7fa518071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 -- 172.21.15.50:0/1866684971 shutdown_connections 2024-09-13T15:08:47.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.016+0000 7fa51ea00700 1 -- 172.21.15.50:0/1866684971 wait complete. 2024-09-13T15:08:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.020+0000 7fa51ea00700 1 Processor -- start 2024-09-13T15:08:47.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.020+0000 7fa51ea00700 1 -- start start 2024-09-13T15:08:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5180acc90 0x7fa51814c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 0x7fa51814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa518159420 0x7fa51815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51814d200 con 0x7fa5180cb4f0 2024-09-13T15:08:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51814c9e0 con 0x7fa518159420 2024-09-13T15:08:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa518159b30 con 0x7fa5180acc90 2024-09-13T15:08:47.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 0x7fa51814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 0x7fa51814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37918/0 (socket says 172.21.15.50:37918) 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 -- 172.21.15.50:0/2701632374 learned_addr learned my addr 172.21.15.50:0/2701632374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa517e00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5180acc90 0x7fa51814c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ca00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa518159420 0x7fa51815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 -- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5180acc90 msgr2=0x7fa51814c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5180acc90 0x7fa51814c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 -- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa518159420 msgr2=0x7fa51815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa518159420 0x7fa51815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 -- 172.21.15.50:0/2701632374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508009a70 con 0x7fa5180cb4f0 2024-09-13T15:08:47.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ca00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa518159420 0x7fa51815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa50f400700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 0x7fa51814f580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa5000011e0 tx=0x7fa50000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500004ca0 con 0x7fa5180cb4f0 2024-09-13T15:08:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500004e00 con 0x7fa5180cb4f0 2024-09-13T15:08:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51814cc40 con 0x7fa5180cb4f0 2024-09-13T15:08:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5000072d0 con 0x7fa5180cb4f0 2024-09-13T15:08:47.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.024+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa518159dd0 con 0x7fa5180cb4f0 2024-09-13T15:08:47.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.028+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa518159990 con 0x7fa5180cb4f0 2024-09-13T15:08:47.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.028+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa500007430 con 0x7fa5180cb4f0 2024-09-13T15:08:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.028+0000 7fa514c00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4f4066730 0x7fa4f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.028+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa500084170 con 0x7fa5180cb4f0 2024-09-13T15:08:47.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.028+0000 7fa517e00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4f4066730 0x7fa4f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.032+0000 7fa517e00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4f4066730 0x7fa4f4068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa508014040 tx=0x7fa508011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:47.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.036+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa518159990 con 0x7fa5180cb4f0 2024-09-13T15:08:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.232+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa518159990 con 0x7fa5180cb4f0 2024-09-13T15:08:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.232+0000 7fa514c00700 1 -- 172.21.15.50:0/2701632374 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa518159990 con 0x7fa5180cb4f0 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4f4066730 msgr2=0x7fa4f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4f4066730 0x7fa4f4068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa508014040 tx=0x7fa508011000 comp rx=0 tx=0).stop 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 msgr2=0x7fa51814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 0x7fa51814f580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa5000011e0 tx=0x7fa50000ca30 comp rx=0 tx=0).stop 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 shutdown_connections 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa4f4066730 0x7fa4f4068bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa518159420 0x7fa51815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5180cb4f0 0x7fa51814f580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 --2- 172.21.15.50:0/2701632374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5180acc90 0x7fa51814c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 >> 172.21.15.50:0/2701632374 conn(0x7fa518071960 msgr2=0x7fa51806d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 shutdown_connections 2024-09-13T15:08:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.236+0000 7fa51ea00700 1 -- 172.21.15.50:0/2701632374 wait complete. 2024-09-13T15:08:47.242 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:08:47.262 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T15:08:47.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:47.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T15:08:47.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:08:47.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:47.301 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T15:08:47.362 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:47.362 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:47.382 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:47.382 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:47.442 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:08:47.442 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:08:47.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 Processor -- start 2024-09-13T15:08:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 -- start start 2024-09-13T15:08:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa53806aaa0 0x7fa53815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5380b3980 0x7fa53806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 0x7fa53806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380adf90 con 0x7fa53806aaa0 2024-09-13T15:08:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53815e560 con 0x7fa53806cbb0 2024-09-13T15:08:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.676+0000 7fa53d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53806b3c0 con 0x7fa5380b3980 2024-09-13T15:08:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa53806aaa0 0x7fa53815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa53ce00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 0x7fa53806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa53ce00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 0x7fa53806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:50438/0 (socket says 172.21.15.50:50438) 2024-09-13T15:08:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa53ce00700 1 -- 172.21.15.50:0/2906276529 learned_addr learned my addr 172.21.15.50:0/2906276529 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 --2- 172.21.15.50:0/2906276529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5380b3980 0x7fa53806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 -- 172.21.15.50:0/2906276529 >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 msgr2=0x7fa53806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 --2- 172.21.15.50:0/2906276529 >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 0x7fa53806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 -- 172.21.15.50:0/2906276529 >> v2:172.21.15.50:3300/0 conn(0x7fa53806aaa0 msgr2=0x7fa53815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 --2- 172.21.15.50:0/2906276529 >> v2:172.21.15.50:3300/0 conn(0x7fa53806aaa0 0x7fa53815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 -- 172.21.15.50:0/2906276529 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53815d920 con 0x7fa5380b3980 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa53ce00700 1 --2- 172.21.15.50:0/2906276529 >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 0x7fa53806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537e00700 1 --2- 172.21.15.50:0/2906276529 >> v2:172.21.15.50:3300/0 conn(0x7fa53806aaa0 0x7fa53815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa537400700 1 --2- 172.21.15.50:0/2906276529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5380b3980 0x7fa53806ae80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa53806fb90 tx=0x7fa524009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3348f51128a9503 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa536a00700 1 -- 172.21.15.50:0/2906276529 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524011830 con 0x7fa5380b3980 2024-09-13T15:08:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa536a00700 1 -- 172.21.15.50:0/2906276529 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa524011990 con 0x7fa5380b3980 2024-09-13T15:08:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa536a00700 1 -- 172.21.15.50:0/2906276529 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524011d20 con 0x7fa5380b3980 2024-09-13T15:08:47.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa53d800700 1 -- 172.21.15.50:0/2906276529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5380b3980 msgr2=0x7fa53806ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.680+0000 7fa53d800700 1 --2- 172.21.15.50:0/2906276529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5380b3980 0x7fa53806ae80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa53806fb90 tx=0x7fa524009b30 comp rx=0 tx=0).stop 2024-09-13T15:08:47.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 -- 172.21.15.50:0/2906276529 shutdown_connections 2024-09-13T15:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 --2- 172.21.15.50:0/2906276529 >> v2:172.21.15.181:3300/0 conn(0x7fa53806cbb0 0x7fa53806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 --2- 172.21.15.50:0/2906276529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5380b3980 0x7fa53806ae80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 --2- 172.21.15.50:0/2906276529 >> v2:172.21.15.50:3300/0 conn(0x7fa53806aaa0 0x7fa53815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 -- 172.21.15.50:0/2906276529 >> 172.21.15.50:0/2906276529 conn(0x7fa5380b0c40 msgr2=0x7fa53806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 -- 172.21.15.50:0/2906276529 shutdown_connections 2024-09-13T15:08:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 -- 172.21.15.50:0/2906276529 wait complete. 2024-09-13T15:08:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 Processor -- start 2024-09-13T15:08:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.684+0000 7fa53d800700 1 -- start start 2024-09-13T15:08:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa53806aaa0 0x7fa5380cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa53806cbb0 0x7fa538145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 0x7fa538146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381448e0 con 0x7fa5380b3980 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53813ac70 con 0x7fa53806cbb0 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa538143fd0 con 0x7fa53806aaa0 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 0x7fa538146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 0x7fa538146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37940/0 (socket says 172.21.15.50:37940) 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 -- 172.21.15.50:0/3375194008 learned_addr learned my addr 172.21.15.50:0/3375194008 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa537e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa53806aaa0 0x7fa5380cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa537400700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa53806cbb0 0x7fa538145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 -- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa53806aaa0 msgr2=0x7fa5380cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa53806aaa0 0x7fa5380cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 -- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa53806cbb0 msgr2=0x7fa538145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa53806cbb0 0x7fa538145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 -- 172.21.15.50:0/3375194008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5280094b0 con 0x7fa5380b3980 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53ce00700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 0x7fa538146430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa53000efc0 tx=0x7fa53000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530018070 con 0x7fa5380b3980 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000f040 con 0x7fa5380b3980 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530003c40 con 0x7fa5380b3980 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.688+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa530009b30 con 0x7fa5380b3980 2024-09-13T15:08:47.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.692+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5240094b0 con 0x7fa5380b3980 2024-09-13T15:08:47.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.692+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa538146970 con 0x7fa5380b3980 2024-09-13T15:08:47.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.692+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa53000c880 con 0x7fa5380b3980 2024-09-13T15:08:47.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.696+0000 7fa52fe00700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa518066730 0x7fa518068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:47.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.696+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5300846b0 con 0x7fa5380b3980 2024-09-13T15:08:47.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.696+0000 7fa537e00700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa518066730 0x7fa518068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:47.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.696+0000 7fa537e00700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa518066730 0x7fa518068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa528009480 tx=0x7fa528009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:47.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.704+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa530051650 con 0x7fa5380b3980 2024-09-13T15:08:47.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.896+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5380cadb0 con 0x7fa5380b3980 2024-09-13T15:08:47.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa52fe00700 1 -- 172.21.15.50:0/3375194008 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fa530054c70 con 0x7fa5380b3980 2024-09-13T15:08:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:47.903 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa518066730 msgr2=0x7fa518068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa518066730 0x7fa518068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa528009480 tx=0x7fa528009240 comp rx=0 tx=0).stop 2024-09-13T15:08:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 msgr2=0x7fa538146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 0x7fa538146430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa53000efc0 tx=0x7fa53000c3a0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 shutdown_connections 2024-09-13T15:08:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa518066730 0x7fa518068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5380b3980 0x7fa538146430 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa53806cbb0 0x7fa538145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 --2- 172.21.15.50:0/3375194008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa53806aaa0 0x7fa5380cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 >> 172.21.15.50:0/3375194008 conn(0x7fa5380b0c40 msgr2=0x7fa53806fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:47.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.900+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 shutdown_connections 2024-09-13T15:08:47.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:47.904+0000 7fa53d800700 1 -- 172.21.15.50:0/3375194008 wait complete. 2024-09-13T15:08:47.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:47.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.100+0000 7fa2bbe00700 1 Processor -- start 2024-09-13T15:08:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.100+0000 7fa2bbe00700 1 -- start start 2024-09-13T15:08:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2bbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc160d30 0x7fa2bc06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2bbe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc0b0020 con 0x7fa2bc06d150 2024-09-13T15:08:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2bbe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc0d1770 con 0x7fa2bc06b340 2024-09-13T15:08:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2bbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0d03f0 con 0x7fa2bc160d30 2024-09-13T15:08:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2ba000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa2bc06d150 0x7fa2bc06ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48198/0 (socket says 172.21.15.50:48198) 2024-09-13T15:08:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2ba000700 1 -- 172.21.15.50:0/424888704 learned_addr learned my addr 172.21.15.50:0/424888704 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2baa00700 1 --2- 172.21.15.50:0/424888704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc160d30 0x7fa2bc06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633247077 0 0) 0x7fa2bc0b0020 con 0x7fa2bc06d150 2024-09-13T15:08:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a00035d0 con 0x7fa2bc06d150 2024-09-13T15:08:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792407632 0 0) 0x7fa2bc0d1770 con 0x7fa2bc06b340 2024-09-13T15:08:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc0b0020 con 0x7fa2bc06b340 2024-09-13T15:08:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2baa00700 1 -- 172.21.15.50:0/424888704 >> v1:172.21.15.181:6789/0 conn(0x7fa2bc06b340 legacy=0x7fa2bc0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2baa00700 1 -- 172.21.15.50:0/424888704 >> v1:172.21.15.50:6789/0 conn(0x7fa2bc06d150 legacy=0x7fa2bc06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.104+0000 7fa2baa00700 1 -- 172.21.15.50:0/424888704 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc0d06d0 con 0x7fa2bc160d30 2024-09-13T15:08:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2baa00700 1 --2- 172.21.15.50:0/424888704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc160d30 0x7fa2bc06cc10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009880 tx=0x7fa2ac009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3390fe741a57892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011830 con 0x7fa2bc160d30 2024-09-13T15:08:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac011990 con 0x7fa2bc160d30 2024-09-13T15:08:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2b9600700 1 -- 172.21.15.50:0/424888704 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011d20 con 0x7fa2bc160d30 2024-09-13T15:08:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 -- 172.21.15.50:0/424888704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc160d30 msgr2=0x7fa2bc06cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/424888704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc160d30 0x7fa2bc06cc10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009880 tx=0x7fa2ac009b90 comp rx=0 tx=0).stop 2024-09-13T15:08:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 -- 172.21.15.50:0/424888704 shutdown_connections 2024-09-13T15:08:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/424888704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc160d30 0x7fa2bc06cc10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 -- 172.21.15.50:0/424888704 >> 172.21.15.50:0/424888704 conn(0x7fa2bc071d20 msgr2=0x7fa2bc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 -- 172.21.15.50:0/424888704 shutdown_connections 2024-09-13T15:08:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 -- 172.21.15.50:0/424888704 wait complete. 2024-09-13T15:08:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 Processor -- start 2024-09-13T15:08:48.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.108+0000 7fa2bbe00700 1 -- start start 2024-09-13T15:08:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc06b340 0x7fa2bc15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 0x7fa2bc154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2bc160d30 0x7fa2bc1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc155140 con 0x7fa2bc06d150 2024-09-13T15:08:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc159a20 con 0x7fa2bc160d30 2024-09-13T15:08:48.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc158440 con 0x7fa2bc06b340 2024-09-13T15:08:48.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 0x7fa2bc154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 0x7fa2bc154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37950/0 (socket says 172.21.15.50:37950) 2024-09-13T15:08:48.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 -- 172.21.15.50:0/1083353087 learned_addr learned my addr 172.21.15.50:0/1083353087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2baa00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc06b340 0x7fa2bc15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bb400700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2bc160d30 0x7fa2bc1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 -- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc06b340 msgr2=0x7fa2bc15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc06b340 0x7fa2bc15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 -- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2bc160d30 msgr2=0x7fa2bc1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2bc160d30 0x7fa2bc1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 -- 172.21.15.50:0/1083353087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0094b0 con 0x7fa2bc06d150 2024-09-13T15:08:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2ba000700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 0x7fa2bc154c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c4d0 tx=0x7fa2a800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8005d90 con 0x7fa2bc06d150 2024-09-13T15:08:48.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a80070d0 con 0x7fa2bc06d150 2024-09-13T15:08:48.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8007480 con 0x7fa2bc06d150 2024-09-13T15:08:48.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc158720 con 0x7fa2bc06d150 2024-09-13T15:08:48.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.112+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc158ce0 con 0x7fa2bc06d150 2024-09-13T15:08:48.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.116+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc161110 con 0x7fa2bc06d150 2024-09-13T15:08:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.116+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2a80075e0 con 0x7fa2bc06d150 2024-09-13T15:08:48.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.116+0000 7fa2b3400700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa29c066730 0x7fa29c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.116+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa2a80839e0 con 0x7fa2bc06d150 2024-09-13T15:08:48.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.120+0000 7fa2baa00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa29c066730 0x7fa29c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.120+0000 7fa2baa00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa29c066730 0x7fa29c068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0090b0 tx=0x7fa2ac01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.124+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2a80508f0 con 0x7fa2bc06d150 2024-09-13T15:08:48.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.308+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2bc1633a0 con 0x7fa2bc06d150 2024-09-13T15:08:48.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.312+0000 7fa2b3400700 1 -- 172.21.15.50:0/1083353087 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a8053f10 con 0x7fa2bc06d150 2024-09-13T15:08:48.315 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa29c066730 msgr2=0x7fa29c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa29c066730 0x7fa29c068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0090b0 tx=0x7fa2ac01c040 comp rx=0 tx=0).stop 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 msgr2=0x7fa2bc154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 0x7fa2bc154c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c4d0 tx=0x7fa2a800c7e0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 shutdown_connections 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa29c066730 0x7fa29c068bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2bc160d30 0x7fa2bc1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2bc06d150 0x7fa2bc154c00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 --2- 172.21.15.50:0/1083353087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa2bc06b340 0x7fa2bc15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 >> 172.21.15.50:0/1083353087 conn(0x7fa2bc071d20 msgr2=0x7fa2bc1615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 shutdown_connections 2024-09-13T15:08:48.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.316+0000 7fa2bbe00700 1 -- 172.21.15.50:0/1083353087 wait complete. 2024-09-13T15:08:48.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:48.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.512+0000 7f2d98a00700 1 Processor -- start 2024-09-13T15:08:48.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.512+0000 7f2d98a00700 1 -- start start 2024-09-13T15:08:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d98a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d9415e030 0x7f2d940ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d98a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d940cd140 0x7f2d940cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d98a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d940b57e0 con 0x7f2d94157500 2024-09-13T15:08:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d98a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940cdb30 con 0x7f2d940cd140 2024-09-13T15:08:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d98a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940b3b80 con 0x7f2d9415e030 2024-09-13T15:08:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2d94157500 0x7f2d94070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48208/0 (socket says 172.21.15.50:48208) 2024-09-13T15:08:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91e00700 1 -- 172.21.15.50:0/2249256371 learned_addr learned my addr 172.21.15.50:0/2249256371 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d92800700 1 --2- 172.21.15.50:0/2249256371 >> v2:172.21.15.50:3300/0 conn(0x7f2d940cd140 0x7f2d940cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91400700 1 --2- 172.21.15.50:0/2249256371 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d9415e030 0x7f2d940ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91400700 1 -- 172.21.15.50:0/2249256371 >> v2:172.21.15.50:3300/0 conn(0x7f2d940cd140 msgr2=0x7f2d940cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91400700 1 --2- 172.21.15.50:0/2249256371 >> v2:172.21.15.50:3300/0 conn(0x7f2d940cd140 0x7f2d940cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91400700 1 -- 172.21.15.50:0/2249256371 >> v1:172.21.15.50:6789/0 conn(0x7f2d94157500 legacy=0x7f2d94070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91400700 1 -- 172.21.15.50:0/2249256371 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940b5a80 con 0x7f2d9415e030 2024-09-13T15:08:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d90a00700 1 -- 172.21.15.50:0/2249256371 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108312789 0 0) 0x7f2d940b57e0 con 0x7f2d94157500 2024-09-13T15:08:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d91400700 1 --2- 172.21.15.50:0/2249256371 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d9415e030 0x7f2d940ce700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009850 tx=0x7f2d80009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e61c95f726c376 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d90a00700 1 -- 172.21.15.50:0/2249256371 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80011830 con 0x7f2d9415e030 2024-09-13T15:08:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d90a00700 1 -- 172.21.15.50:0/2249256371 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80011990 con 0x7f2d9415e030 2024-09-13T15:08:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.516+0000 7f2d90a00700 1 -- 172.21.15.50:0/2249256371 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80011d40 con 0x7f2d9415e030 2024-09-13T15:08:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 -- 172.21.15.50:0/2249256371 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d9415e030 msgr2=0x7f2d940ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2249256371 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d9415e030 0x7f2d940ce700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009850 tx=0x7f2d80009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 -- 172.21.15.50:0/2249256371 shutdown_connections 2024-09-13T15:08:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2249256371 >> v2:172.21.15.50:3300/0 conn(0x7f2d940cd140 0x7f2d940cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2249256371 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d9415e030 0x7f2d940ce700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 -- 172.21.15.50:0/2249256371 >> 172.21.15.50:0/2249256371 conn(0x7f2d9406e660 msgr2=0x7f2d9406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 -- 172.21.15.50:0/2249256371 shutdown_connections 2024-09-13T15:08:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 -- 172.21.15.50:0/2249256371 wait complete. 2024-09-13T15:08:48.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 Processor -- start 2024-09-13T15:08:48.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.520+0000 7f2d98a00700 1 -- start start 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 0x7f2d941f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d94157500 0x7f2d940cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d9415e030 0x7f2d941f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940cc490 con 0x7f2d940cd140 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d941f34b0 con 0x7f2d9415e030 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d941f3790 con 0x7f2d94157500 2024-09-13T15:08:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 0x7f2d941f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 0x7f2d941f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37980/0 (socket says 172.21.15.50:37980) 2024-09-13T15:08:48.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 -- 172.21.15.50:0/2185886264 learned_addr learned my addr 172.21.15.50:0/2185886264 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d92800700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d9415e030 0x7f2d941f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91400700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d94157500 0x7f2d940cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 -- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d94157500 msgr2=0x7f2d940cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d94157500 0x7f2d940cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 -- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d9415e030 msgr2=0x7f2d941f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d9415e030 0x7f2d941f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 -- 172.21.15.50:0/2185886264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800094b0 con 0x7f2d940cd140 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d92800700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d9415e030 0x7f2d941f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91400700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d94157500 0x7f2d940cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d91e00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 0x7f2d941f2df0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c580 tx=0x7f2d8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84004ca0 con 0x7f2d940cd140 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84004e20 con 0x7f2d940cd140 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84007310 con 0x7f2d940cd140 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d941f3a70 con 0x7f2d940cd140 2024-09-13T15:08:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.524+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9406a430 con 0x7f2d940cd140 2024-09-13T15:08:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.528+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9406a620 con 0x7f2d940cd140 2024-09-13T15:08:48.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.528+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d84007470 con 0x7f2d940cd140 2024-09-13T15:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.528+0000 7f2d8a000700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2d74066730 0x7f2d74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.528+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2d840843b0 con 0x7f2d940cd140 2024-09-13T15:08:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.528+0000 7f2d91400700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2d74066730 0x7f2d74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.532+0000 7f2d91400700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2d74066730 0x7f2d74068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d940d09e0 tx=0x7f2d80008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.536+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d840512c0 con 0x7f2d940cd140 2024-09-13T15:08:48.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.720+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d940cd5f0 con 0x7f2d940cd140 2024-09-13T15:08:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.720+0000 7f2d8a000700 1 -- 172.21.15.50:0/2185886264 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d84007720 con 0x7f2d940cd140 2024-09-13T15:08:48.724 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:48.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2d74066730 msgr2=0x7f2d74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2d74066730 0x7f2d74068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d940d09e0 tx=0x7f2d80008030 comp rx=0 tx=0).stop 2024-09-13T15:08:48.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 msgr2=0x7f2d941f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 0x7f2d941f2df0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c580 tx=0x7f2d8400c940 comp rx=0 tx=0).stop 2024-09-13T15:08:48.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 shutdown_connections 2024-09-13T15:08:48.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2d74066730 0x7f2d74068bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d9415e030 0x7f2d941f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2d94157500 0x7f2d940cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 --2- 172.21.15.50:0/2185886264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940cd140 0x7f2d941f2df0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 >> 172.21.15.50:0/2185886264 conn(0x7f2d9406e660 msgr2=0x7f2d940b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 shutdown_connections 2024-09-13T15:08:48.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.724+0000 7f2d98a00700 1 -- 172.21.15.50:0/2185886264 wait complete. 2024-09-13T15:08:48.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:48.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.924+0000 7f42ff200700 1 Processor -- start 2024-09-13T15:08:48.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.924+0000 7f42ff200700 1 -- start start 2024-09-13T15:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42ff200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f80ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42ff200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42f80c5410 0x7f42f80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42ff200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f80c9ff0 con 0x7f42f80cb440 2024-09-13T15:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42ff200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f80cabe0 con 0x7f42f80c5410 2024-09-13T15:08:48.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42ff200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f806e180 con 0x7f42f806dda0 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42f80c5410 0x7f42f80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42f80c5410 0x7f42f80cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37990/0 (socket says 172.21.15.50:37990) 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 -- 172.21.15.50:0/2165947950 learned_addr learned my addr 172.21.15.50:0/2165947950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fd400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42f80cb440 0x7f42f815cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48218/0 (socket says 172.21.15.50:48218) 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fde00700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f80ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 -- 172.21.15.50:0/2165947950 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 msgr2=0x7f42f80ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f80ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 -- 172.21.15.50:0/2165947950 >> v1:172.21.15.50:6789/0 conn(0x7f42f80cb440 legacy=0x7f42f815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 -- 172.21.15.50:0/2165947950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80ca240 con 0x7f42f80c5410 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fde00700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f80ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fe800700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80c5410 0x7f42f80cd2b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f42f400d150 tx=0x7f42f400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c3b44f39db829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fca00700 1 -- 172.21.15.50:0/2165947950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4010070 con 0x7f42f80c5410 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fca00700 1 -- 172.21.15.50:0/2165947950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f400dbb0 con 0x7f42f80c5410 2024-09-13T15:08:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.928+0000 7f42fca00700 1 -- 172.21.15.50:0/2165947950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4016400 con 0x7f42f80c5410 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 -- 172.21.15.50:0/2165947950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80c5410 msgr2=0x7f42f80cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80c5410 0x7f42f80cd2b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f42f400d150 tx=0x7f42f400d460 comp rx=0 tx=0).stop 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 -- 172.21.15.50:0/2165947950 shutdown_connections 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80c5410 0x7f42f80cd2b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 --2- 172.21.15.50:0/2165947950 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f80ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 -- 172.21.15.50:0/2165947950 >> 172.21.15.50:0/2165947950 conn(0x7f42f80cef90 msgr2=0x7f42f80cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 -- 172.21.15.50:0/2165947950 shutdown_connections 2024-09-13T15:08:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.932+0000 7f42ff200700 1 -- 172.21.15.50:0/2165947950 wait complete. 2024-09-13T15:08:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 Processor -- start 2024-09-13T15:08:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 -- start start 2024-09-13T15:08:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f8151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42f80c5410 0x7f42f80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 0x7f42f80cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c6d10 con 0x7f42f80cb440 2024-09-13T15:08:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c6100 con 0x7f42f80c5410 2024-09-13T15:08:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c63e0 con 0x7f42f806dda0 2024-09-13T15:08:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 0x7f42f80cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 0x7f42f80cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37998/0 (socket says 172.21.15.50:37998) 2024-09-13T15:08:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 -- 172.21.15.50:0/2375570194 learned_addr learned my addr 172.21.15.50:0/2375570194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fde00700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f8151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fd400700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42f80c5410 0x7f42f80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 -- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 msgr2=0x7f42f8151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f8151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 -- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42f80c5410 msgr2=0x7f42f80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42f80c5410 0x7f42f80cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 -- 172.21.15.50:0/2375570194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f400bd40 con 0x7f42f80cb440 2024-09-13T15:08:48.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42fe800700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 0x7f42f80cbef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42f4019040 tx=0x7f42f4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4016400 con 0x7f42f80cb440 2024-09-13T15:08:48.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f4016ac0 con 0x7f42f80cb440 2024-09-13T15:08:48.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4016e70 con 0x7f42f80cb440 2024-09-13T15:08:48.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f80c66c0 con 0x7f42f80cb440 2024-09-13T15:08:48.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.936+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f81521b0 con 0x7f42f80cb440 2024-09-13T15:08:48.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.940+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f80c6e80 con 0x7f42f80cb440 2024-09-13T15:08:48.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.940+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42f4004040 con 0x7f42f80cb440 2024-09-13T15:08:48.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.944+0000 7f42f2000700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f42dc066730 0x7f42dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:48.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.944+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f42f4085960 con 0x7f42f80cb440 2024-09-13T15:08:48.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.944+0000 7f42fde00700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f42dc066730 0x7f42dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:48.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.944+0000 7f42fde00700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f42dc066730 0x7f42dc068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c920 tx=0x7f42ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:48.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:48.952+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42f4052900 con 0x7f42f80cb440 2024-09-13T15:08:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.148+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42f80caef0 con 0x7f42f80cb440 2024-09-13T15:08:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.148+0000 7f42f2000700 1 -- 172.21.15.50:0/2375570194 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42f401a0a0 con 0x7f42f80cb440 2024-09-13T15:08:49.152 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:49.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f42dc066730 msgr2=0x7f42dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f42dc066730 0x7f42dc068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c920 tx=0x7f42ec008040 comp rx=0 tx=0).stop 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 msgr2=0x7f42f80cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 0x7f42f80cbef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42f4019040 tx=0x7f42f4004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 shutdown_connections 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f42dc066730 0x7f42dc068bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f80cb440 0x7f42f80cbef0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42f80c5410 0x7f42f80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 --2- 172.21.15.50:0/2375570194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42f806dda0 0x7f42f8151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 >> 172.21.15.50:0/2375570194 conn(0x7f42f80cef90 msgr2=0x7f42f8157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 shutdown_connections 2024-09-13T15:08:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.152+0000 7f42ff200700 1 -- 172.21.15.50:0/2375570194 wait complete. 2024-09-13T15:08:49.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:49.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.360+0000 7f2a2b000700 1 Processor -- start 2024-09-13T15:08:49.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.360+0000 7f2a2b000700 1 -- start start 2024-09-13T15:08:49.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2b000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2a24162110 0x7f2a24161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2b000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 0x7f2a240b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2b000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a24161670 con 0x7f2a24160c60 2024-09-13T15:08:49.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2b000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2406bb50 con 0x7f2a24162110 2024-09-13T15:08:49.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2b000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2406b870 con 0x7f2a240b4ad0 2024-09-13T15:08:49.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 0x7f2a240b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a29200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2a24162110 0x7f2a24161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 0x7f2a240b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:59186/0 (socket says 172.21.15.50:59186) 2024-09-13T15:08:49.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 -- 172.21.15.50:0/3038909761 learned_addr learned my addr 172.21.15.50:0/3038909761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:49.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 -- 172.21.15.50:0/3038909761 >> v2:172.21.15.181:3300/0 conn(0x7f2a24162110 msgr2=0x7f2a24161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:49.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 --2- 172.21.15.50:0/3038909761 >> v2:172.21.15.181:3300/0 conn(0x7f2a24162110 0x7f2a24161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 -- 172.21.15.50:0/3038909761 >> v1:172.21.15.181:6789/0 conn(0x7f2a24160c60 legacy=0x7f2a2406b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.364+0000 7f2a2a600700 1 -- 172.21.15.50:0/3038909761 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24161910 con 0x7f2a240b4ad0 2024-09-13T15:08:49.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2a600700 1 --2- 172.21.15.50:0/3038909761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 0x7f2a240b1840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009e50 tx=0x7f2a1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907c098f3cc15015 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:49.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a23e00700 1 -- 172.21.15.50:0/3038909761 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00e070 con 0x7f2a240b4ad0 2024-09-13T15:08:49.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a23e00700 1 -- 172.21.15.50:0/3038909761 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00b910 con 0x7f2a240b4ad0 2024-09-13T15:08:49.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a23e00700 1 -- 172.21.15.50:0/3038909761 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00bcc0 con 0x7f2a240b4ad0 2024-09-13T15:08:49.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 -- 172.21.15.50:0/3038909761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 msgr2=0x7f2a240b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 --2- 172.21.15.50:0/3038909761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 0x7f2a240b1840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009e50 tx=0x7f2a1c00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:49.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 -- 172.21.15.50:0/3038909761 shutdown_connections 2024-09-13T15:08:49.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 --2- 172.21.15.50:0/3038909761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a240b4ad0 0x7f2a240b1840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 --2- 172.21.15.50:0/3038909761 >> v2:172.21.15.181:3300/0 conn(0x7f2a24162110 0x7f2a24161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 -- 172.21.15.50:0/3038909761 >> 172.21.15.50:0/3038909761 conn(0x7f2a2406cb90 msgr2=0x7f2a2406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:49.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 -- 172.21.15.50:0/3038909761 shutdown_connections 2024-09-13T15:08:49.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.368+0000 7f2a2b000700 1 -- 172.21.15.50:0/3038909761 wait complete. 2024-09-13T15:08:49.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.372+0000 7f2a2b000700 1 Processor -- start 2024-09-13T15:08:49.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.372+0000 7f2a2b000700 1 -- start start 2024-09-13T15:08:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 0x7f2a24158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a24160c60 0x7f2a2415af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a24162110 0x7f2a240cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24159070 con 0x7f2a240b4ad0 2024-09-13T15:08:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2415cbb0 con 0x7f2a24162110 2024-09-13T15:08:49.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2415ce90 con 0x7f2a24160c60 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 0x7f2a24158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 0x7f2a24158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38008/0 (socket says 172.21.15.50:38008) 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 -- 172.21.15.50:0/542037366 learned_addr learned my addr 172.21.15.50:0/542037366 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29200700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a24160c60 0x7f2a2415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2a600700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a24162110 0x7f2a240cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 -- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a24160c60 msgr2=0x7f2a2415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a24160c60 0x7f2a2415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 -- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a24162110 msgr2=0x7f2a240cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a24162110 0x7f2a240cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 -- 172.21.15.50:0/542037366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009b30 con 0x7f2a240b4ad0 2024-09-13T15:08:49.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a29c00700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 0x7f2a24158b30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c500 tx=0x7f2a1800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a180052d0 con 0x7f2a240b4ad0 2024-09-13T15:08:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18005430 con 0x7f2a240b4ad0 2024-09-13T15:08:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2415d170 con 0x7f2a240b4ad0 2024-09-13T15:08:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a180055a0 con 0x7f2a240b4ad0 2024-09-13T15:08:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.376+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2415ebe0 con 0x7f2a240b4ad0 2024-09-13T15:08:49.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.380+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2415d690 con 0x7f2a240b4ad0 2024-09-13T15:08:49.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.380+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a180038e0 con 0x7f2a240b4ad0 2024-09-13T15:08:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.380+0000 7f2a21600700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a04066730 0x7f2a04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.380+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a18083870 con 0x7f2a240b4ad0 2024-09-13T15:08:49.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.384+0000 7f2a29200700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a04066730 0x7f2a04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.384+0000 7f2a29200700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a04066730 0x7f2a04068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a240d0410 tx=0x7f2a10009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:49.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.388+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a2415d690 con 0x7f2a240b4ad0 2024-09-13T15:08:49.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.584+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2a2415d690 con 0x7f2a240b4ad0 2024-09-13T15:08:49.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.584+0000 7f2a21600700 1 -- 172.21.15.50:0/542037366 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2a2415d690 con 0x7f2a240b4ad0 2024-09-13T15:08:49.588 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a04066730 msgr2=0x7f2a04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a04066730 0x7f2a04068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a240d0410 tx=0x7f2a10009240 comp rx=0 tx=0).stop 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 msgr2=0x7f2a24158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 0x7f2a24158b30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c500 tx=0x7f2a1800c810 comp rx=0 tx=0).stop 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 shutdown_connections 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a04066730 0x7f2a04068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a24162110 0x7f2a240cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a24160c60 0x7f2a2415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 --2- 172.21.15.50:0/542037366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a240b4ad0 0x7f2a24158b30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 >> 172.21.15.50:0/542037366 conn(0x7f2a2406cb90 msgr2=0x7f2a2415ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 shutdown_connections 2024-09-13T15:08:49.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.588+0000 7f2a2b000700 1 -- 172.21.15.50:0/542037366 wait complete. 2024-09-13T15:08:49.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:08:49.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.788+0000 7f7d35a00700 1 Processor -- start 2024-09-13T15:08:49.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.788+0000 7f7d35a00700 1 -- start start 2024-09-13T15:08:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7d30066090 0x7f7d30066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d300ad7b0 0x7f7d300adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300ad030 con 0x7f7d30146440 2024-09-13T15:08:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3006b680 con 0x7f7d30066090 2024-09-13T15:08:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30066a40 con 0x7f7d300ad7b0 2024-09-13T15:08:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d300ad7b0 0x7f7d300adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d2fe00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d30146440 0x7f7d3006a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:54956/0 (socket says 172.21.15.50:54956) 2024-09-13T15:08:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d2fe00700 1 -- 172.21.15.50:0/3300294574 learned_addr learned my addr 172.21.15.50:0/3300294574 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d27400700 1 --2- 172.21.15.50:0/3300294574 >> v2:172.21.15.181:3300/0 conn(0x7f7d30066090 0x7f7d30066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d2f400700 1 -- 172.21.15.50:0/3300294574 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100085777 0 0) 0x7f7d300ad030 con 0x7f7d30146440 2024-09-13T15:08:49.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35000700 1 -- 172.21.15.50:0/3300294574 >> v2:172.21.15.181:3300/0 conn(0x7f7d30066090 msgr2=0x7f7d30066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:49.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35000700 1 --2- 172.21.15.50:0/3300294574 >> v2:172.21.15.181:3300/0 conn(0x7f7d30066090 0x7f7d30066500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35000700 1 -- 172.21.15.50:0/3300294574 >> v1:172.21.15.181:6789/0 conn(0x7f7d30146440 legacy=0x7f7d3006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35000700 1 -- 172.21.15.50:0/3300294574 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300ad2d0 con 0x7f7d300ad7b0 2024-09-13T15:08:49.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.792+0000 7f7d35000700 1 --2- 172.21.15.50:0/3300294574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d300ad7b0 0x7f7d300adc20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009850 tx=0x7f7d28009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c69b6b4d70d9091d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:49.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d2f400700 1 -- 172.21.15.50:0/3300294574 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28011830 con 0x7f7d300ad7b0 2024-09-13T15:08:49.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d2f400700 1 -- 172.21.15.50:0/3300294574 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28011990 con 0x7f7d300ad7b0 2024-09-13T15:08:49.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d2f400700 1 -- 172.21.15.50:0/3300294574 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28011d40 con 0x7f7d300ad7b0 2024-09-13T15:08:49.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 -- 172.21.15.50:0/3300294574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d300ad7b0 msgr2=0x7f7d300adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3300294574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d300ad7b0 0x7f7d300adc20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009850 tx=0x7f7d28009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 -- 172.21.15.50:0/3300294574 shutdown_connections 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3300294574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d300ad7b0 0x7f7d300adc20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3300294574 >> v2:172.21.15.181:3300/0 conn(0x7f7d30066090 0x7f7d30066500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 -- 172.21.15.50:0/3300294574 >> 172.21.15.50:0/3300294574 conn(0x7f7d3006e660 msgr2=0x7f7d3006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 -- 172.21.15.50:0/3300294574 shutdown_connections 2024-09-13T15:08:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.796+0000 7f7d35a00700 1 -- 172.21.15.50:0/3300294574 wait complete. 2024-09-13T15:08:49.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 Processor -- start 2024-09-13T15:08:49.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 -- start start 2024-09-13T15:08:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d30066090 0x7f7d30143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 0x7f7d3015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d30146440 0x7f7d3013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30144310 con 0x7f7d300ad7b0 2024-09-13T15:08:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30141560 con 0x7f7d30066090 2024-09-13T15:08:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30141840 con 0x7f7d30146440 2024-09-13T15:08:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 0x7f7d3015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 0x7f7d3015ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38022/0 (socket says 172.21.15.50:38022) 2024-09-13T15:08:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d27400700 1 -- 172.21.15.50:0/3466320769 learned_addr learned my addr 172.21.15.50:0/3466320769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d35000700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d30146440 0x7f7d3013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.800+0000 7f7d2fe00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d30066090 0x7f7d30143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d27400700 1 -- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d30146440 msgr2=0x7f7d3013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d27400700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d30146440 0x7f7d3013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d27400700 1 -- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d30066090 msgr2=0x7f7d30143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d27400700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d30066090 0x7f7d30143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d27400700 1 -- 172.21.15.50:0/3466320769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280094b0 con 0x7f7d300ad7b0 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d2fe00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d30066090 0x7f7d30143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d27400700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 0x7f7d3015ebe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800e9d0 tx=0x7f7d1800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:49.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18009720 con 0x7f7d300ad7b0 2024-09-13T15:08:49.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1800c850 con 0x7f7d300ad7b0 2024-09-13T15:08:49.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d30141b20 con 0x7f7d300ad7b0 2024-09-13T15:08:49.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800cbc0 con 0x7f7d300ad7b0 2024-09-13T15:08:49.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d30143f50 con 0x7f7d300ad7b0 2024-09-13T15:08:49.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.804+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d30141d60 con 0x7f7d300ad7b0 2024-09-13T15:08:49.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.808+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d1800cd20 con 0x7f7d300ad7b0 2024-09-13T15:08:49.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.808+0000 7f7d2cc00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d0c066730 0x7f7d0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:49.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.808+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d18084760 con 0x7f7d300ad7b0 2024-09-13T15:08:49.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.808+0000 7f7d2fe00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d0c066730 0x7f7d0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:49.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.812+0000 7f7d2fe00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d0c066730 0x7f7d0c068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d200012e0 tx=0x7f7d20001980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:49.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:49.812+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d30141d60 con 0x7f7d300ad7b0 2024-09-13T15:08:50.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.004+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d30141d60 con 0x7f7d300ad7b0 2024-09-13T15:08:50.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.008+0000 7f7d2cc00700 1 -- 172.21.15.50:0/3466320769 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7d30141d60 con 0x7f7d300ad7b0 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d0c066730 msgr2=0x7f7d0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d0c066730 0x7f7d0c068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d200012e0 tx=0x7f7d20001980 comp rx=0 tx=0).stop 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 msgr2=0x7f7d3015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 0x7f7d3015ebe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800e9d0 tx=0x7f7d1800ece0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 shutdown_connections 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d0c066730 0x7f7d0c068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d30146440 0x7f7d3013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d300ad7b0 0x7f7d3015ebe0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 --2- 172.21.15.50:0/3466320769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d30066090 0x7f7d30143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 >> 172.21.15.50:0/3466320769 conn(0x7f7d3006e660 msgr2=0x7f7d300b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 shutdown_connections 2024-09-13T15:08:50.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.012+0000 7f7d35a00700 1 -- 172.21.15.50:0/3466320769 wait complete. 2024-09-13T15:08:50.019 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:08:50.045 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T15:08:50.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:50.046 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T15:08:50.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:08:50.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:08:50.087 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T15:08:50.146 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T15:08:50.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 Processor -- start 2024-09-13T15:08:50.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 -- start start 2024-09-13T15:08:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce40cb020 0x7fbce40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbce415c2a0 0x7fbce415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40b2ad0 con 0x7fbce406aaa0 2024-09-13T15:08:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce415b960 con 0x7fbce415c2a0 2024-09-13T15:08:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce415bc40 con 0x7fbce40cb020 2024-09-13T15:08:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbce415c2a0 0x7fbce415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbce415c2a0 0x7fbce415b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38028/0 (socket says 172.21.15.50:38028) 2024-09-13T15:08:50.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce1400700 1 -- 172.21.15.50:0/2270889666 learned_addr learned my addr 172.21.15.50:0/2270889666 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:50.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.312+0000 7fbce1e00700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce40cb020 0x7fbce40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce1400700 1 -- 172.21.15.50:0/2270889666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce40cb020 msgr2=0x7fbce40cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce1400700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce40cb020 0x7fbce40cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce1400700 1 -- 172.21.15.50:0/2270889666 >> v1:172.21.15.50:6789/0 conn(0x7fbce406aaa0 legacy=0x7fbce40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce0a00700 1 -- 172.21.15.50:0/2270889666 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751229075 0 0) 0x7fbce40b2ad0 con 0x7fbce406aaa0 2024-09-13T15:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce1400700 1 -- 172.21.15.50:0/2270889666 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce415bf20 con 0x7fbce415c2a0 2024-09-13T15:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce1e00700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce40cb020 0x7fbce40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce1400700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce415b0e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009910 tx=0x7fbcd0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f511f3750a8af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce0a00700 1 -- 172.21.15.50:0/2270889666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0011830 con 0x7fbce415c2a0 2024-09-13T15:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce0a00700 1 -- 172.21.15.50:0/2270889666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd0011990 con 0x7fbce415c2a0 2024-09-13T15:08:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce0a00700 1 -- 172.21.15.50:0/2270889666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0011d40 con 0x7fbce415c2a0 2024-09-13T15:08:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 -- 172.21.15.50:0/2270889666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 msgr2=0x7fbce415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce415b0e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009910 tx=0x7fbcd0009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 -- 172.21.15.50:0/2270889666 shutdown_connections 2024-09-13T15:08:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce415b0e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 --2- 172.21.15.50:0/2270889666 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce40cb020 0x7fbce40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 -- 172.21.15.50:0/2270889666 >> 172.21.15.50:0/2270889666 conn(0x7fbce40b0c40 msgr2=0x7fbce406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 -- 172.21.15.50:0/2270889666 shutdown_connections 2024-09-13T15:08:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.316+0000 7fbce3200700 1 -- 172.21.15.50:0/2270889666 wait complete. 2024-09-13T15:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 Processor -- start 2024-09-13T15:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 -- start start 2024-09-13T15:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce406aaa0 0x7fbce41575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce40cb020 0x7fbce413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4139ef0 con 0x7fbce415c2a0 2024-09-13T15:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4157fb0 con 0x7fbce40cb020 2024-09-13T15:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce413a140 con 0x7fbce406aaa0 2024-09-13T15:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.320+0000 7fbce2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce413ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38032/0 (socket says 172.21.15.50:38032) 2024-09-13T15:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 -- 172.21.15.50:0/4213844080 learned_addr learned my addr 172.21.15.50:0/4213844080 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce1e00700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce406aaa0 0x7fbce41575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce1400700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce40cb020 0x7fbce413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 -- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce406aaa0 msgr2=0x7fbce41575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce406aaa0 0x7fbce41575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 -- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce40cb020 msgr2=0x7fbce413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce40cb020 0x7fbce413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 -- 172.21.15.50:0/4213844080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40094b0 con 0x7fbce415c2a0 2024-09-13T15:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce1400700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce40cb020 0x7fbce413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce2800700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce413ce20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00cc20 tx=0x7fbcdc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:50.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc003e50 con 0x7fbce415c2a0 2024-09-13T15:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00a740 con 0x7fbce415c2a0 2024-09-13T15:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00aaf0 con 0x7fbce415c2a0 2024-09-13T15:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd0009570 con 0x7fbce415c2a0 2024-09-13T15:08:50.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce413a700 con 0x7fbce415c2a0 2024-09-13T15:08:50.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.324+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce413a8f0 con 0x7fbce415c2a0 2024-09-13T15:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.328+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbcdc00ac50 con 0x7fbce415c2a0 2024-09-13T15:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.328+0000 7fbcda000700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc4066730 0x7fbcc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.328+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbcdc0845c0 con 0x7fbce415c2a0 2024-09-13T15:08:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.328+0000 7fbce1e00700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc4066730 0x7fbcc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.332+0000 7fbce1e00700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc4066730 0x7fbcc4068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009d80 tx=0x7fbcd4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.336+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcdc051560 con 0x7fbce415c2a0 2024-09-13T15:08:50.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.628+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbce40cc6f0 con 0x7fbce415c2a0 2024-09-13T15:08:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.632+0000 7fbcda000700 1 -- 172.21.15.50:0/4213844080 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7fbcdc054b80 con 0x7fbce415c2a0 2024-09-13T15:08:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:50.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc4066730 msgr2=0x7fbcc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc4066730 0x7fbcc4068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009d80 tx=0x7fbcd4009240 comp rx=0 tx=0).stop 2024-09-13T15:08:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 msgr2=0x7fbce413ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce413ce20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00cc20 tx=0x7fbcdc00cf30 comp rx=0 tx=0).stop 2024-09-13T15:08:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 shutdown_connections 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc4066730 0x7fbcc4068bf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce415c2a0 0x7fbce413ce20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce40cb020 0x7fbce413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 --2- 172.21.15.50:0/4213844080 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce406aaa0 0x7fbce41575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 >> 172.21.15.50:0/4213844080 conn(0x7fbce40b0c40 msgr2=0x7fbce40b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 shutdown_connections 2024-09-13T15:08:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.636+0000 7fbce3200700 1 -- 172.21.15.50:0/4213844080 wait complete. 2024-09-13T15:08:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:50.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.828+0000 7f9ecea00700 1 Processor -- start 2024-09-13T15:08:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.828+0000 7f9ecea00700 1 -- start start 2024-09-13T15:08:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ec815d640 0x7f9ec815da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9ec8073a90 0x7f9ec806d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec815df60 0x7f9ec806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecea00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80b2760 con 0x7f9ec815d640 2024-09-13T15:08:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecea00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80b2480 con 0x7f9ec8073a90 2024-09-13T15:08:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80b3e40 con 0x7f9ec815df60 2024-09-13T15:08:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ec815d640 0x7f9ec815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ec815d640 0x7f9ec815da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38036/0 (socket says 172.21.15.50:38036) 2024-09-13T15:08:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 -- 172.21.15.50:0/1372437160 learned_addr learned my addr 172.21.15.50:0/1372437160 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ecca00700 1 --2- 172.21.15.50:0/1372437160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec815df60 0x7f9ec806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7400700 1 --2- 172.21.15.50:0/1372437160 >> v2:172.21.15.181:3300/0 conn(0x7f9ec8073a90 0x7f9ec806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 -- 172.21.15.50:0/1372437160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec815df60 msgr2=0x7f9ec806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 --2- 172.21.15.50:0/1372437160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec815df60 0x7f9ec806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 -- 172.21.15.50:0/1372437160 >> v2:172.21.15.181:3300/0 conn(0x7f9ec8073a90 msgr2=0x7f9ec806d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 --2- 172.21.15.50:0/1372437160 >> v2:172.21.15.181:3300/0 conn(0x7f9ec8073a90 0x7f9ec806d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.832+0000 7f9ec7e00700 1 -- 172.21.15.50:0/1372437160 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80b4120 con 0x7f9ec815d640 2024-09-13T15:08:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ec7e00700 1 --2- 172.21.15.50:0/1372437160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec815da20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9ec806bdb0 tx=0x7f9eb8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ee069eb231dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ec6a00700 1 -- 172.21.15.50:0/1372437160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011830 con 0x7f9ec815d640 2024-09-13T15:08:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ec6a00700 1 -- 172.21.15.50:0/1372437160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8011990 con 0x7f9ec815d640 2024-09-13T15:08:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ec6a00700 1 -- 172.21.15.50:0/1372437160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011d20 con 0x7f9ec815d640 2024-09-13T15:08:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 -- 172.21.15.50:0/1372437160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 msgr2=0x7f9ec815da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 --2- 172.21.15.50:0/1372437160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec815da20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9ec806bdb0 tx=0x7f9eb8009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 -- 172.21.15.50:0/1372437160 shutdown_connections 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 --2- 172.21.15.50:0/1372437160 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec815df60 0x7f9ec806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 --2- 172.21.15.50:0/1372437160 >> v2:172.21.15.181:3300/0 conn(0x7f9ec8073a90 0x7f9ec806d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 --2- 172.21.15.50:0/1372437160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec815da20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 -- 172.21.15.50:0/1372437160 >> 172.21.15.50:0/1372437160 conn(0x7f9ec8071960 msgr2=0x7f9ec8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 -- 172.21.15.50:0/1372437160 shutdown_connections 2024-09-13T15:08:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.836+0000 7f9ecea00700 1 -- 172.21.15.50:0/1372437160 wait complete. 2024-09-13T15:08:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 Processor -- start 2024-09-13T15:08:50.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 -- start start 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec8073a90 0x7f9ec81f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ec815df60 0x7f9ec8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81f7330 con 0x7f9ec815d640 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80b0fd0 con 0x7f9ec815df60 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80c8b80 con 0x7f9ec8073a90 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec80aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38052/0 (socket says 172.21.15.50:38052) 2024-09-13T15:08:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 -- 172.21.15.50:0/4215565652 learned_addr learned my addr 172.21.15.50:0/4215565652 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:50.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7e00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec8073a90 0x7f9ec81f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecca00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ec815df60 0x7f9ec8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 -- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec8073a90 msgr2=0x7f9ec81f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec8073a90 0x7f9ec81f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 -- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ec815df60 msgr2=0x7f9ec8154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ec815df60 0x7f9ec8154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ec7400700 1 -- 172.21.15.50:0/4215565652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009570 con 0x7f9ec815d640 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.840+0000 7f9ecca00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ec815df60 0x7f9ec8154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:50.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ec7400700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec80aed10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400e840 tx=0x7f9eb400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40095a0 con 0x7f9ec815d640 2024-09-13T15:08:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4013680 con 0x7f9ec815d640 2024-09-13T15:08:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4013a30 con 0x7f9ec815d640 2024-09-13T15:08:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80b1500 con 0x7f9ec815d640 2024-09-13T15:08:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec80af250 con 0x7f9ec815d640 2024-09-13T15:08:50.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.844+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec80c8cc0 con 0x7f9ec815d640 2024-09-13T15:08:50.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.848+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9eb4013b90 con 0x7f9ec815d640 2024-09-13T15:08:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.848+0000 7f9ebfe00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9ea8066730 0x7f9ea8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.848+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9eb4084410 con 0x7f9ec815d640 2024-09-13T15:08:50.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.848+0000 7f9ec7e00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9ea8066730 0x7f9ea8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:50.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.852+0000 7f9ec7e00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9ea8066730 0x7f9ea8068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8000c00 tx=0x7f9eb8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:50.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:50.856+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9eb4051320 con 0x7f9ec815d640 2024-09-13T15:08:51.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.044+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec81606c0 con 0x7f9ec815d640 2024-09-13T15:08:51.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.048+0000 7f9ebfe00700 1 -- 172.21.15.50:0/4215565652 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f9eb4054940 con 0x7f9ec815d640 2024-09-13T15:08:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:51.054 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9ea8066730 msgr2=0x7f9ea8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9ea8066730 0x7f9ea8068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8000c00 tx=0x7f9eb8008030 comp rx=0 tx=0).stop 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 msgr2=0x7f9ec80aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec80aed10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400e840 tx=0x7f9eb400eb50 comp rx=0 tx=0).stop 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 shutdown_connections 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9ea8066730 0x7f9ea8068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ec815df60 0x7f9ec8154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec815d640 0x7f9ec80aed10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 --2- 172.21.15.50:0/4215565652 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9ec8073a90 0x7f9ec81f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 >> 172.21.15.50:0/4215565652 conn(0x7f9ec8071960 msgr2=0x7f9ec815af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 shutdown_connections 2024-09-13T15:08:51.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.052+0000 7f9ecea00700 1 -- 172.21.15.50:0/4215565652 wait complete. 2024-09-13T15:08:51.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:07:35.445625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:07:36.454534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:07:39.541856+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:08:51.082 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:08:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 Processor -- start 2024-09-13T15:08:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 -- start start 2024-09-13T15:08:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf1c146720 0x7fbf1c15e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c070670 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c070950 con 0x7fbf1c146720 2024-09-13T15:08:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.256+0000 7fbf21e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c070c30 con 0x7fbf1c0cf280 2024-09-13T15:08:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1aa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf1c146720 0x7fbf1c15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1b400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1aa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf1c146720 0x7fbf1c15e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:50548/0 (socket says 172.21.15.50:50548) 2024-09-13T15:08:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1aa00700 1 -- 172.21.15.50:0/4161619505 learned_addr learned my addr 172.21.15.50:0/4161619505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1b400700 1 -- 172.21.15.50:0/4161619505 >> v2:172.21.15.181:3300/0 conn(0x7fbf1c146720 msgr2=0x7fbf1c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1b400700 1 --2- 172.21.15.50:0/4161619505 >> v2:172.21.15.181:3300/0 conn(0x7fbf1c146720 0x7fbf1c15e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1b400700 1 -- 172.21.15.50:0/4161619505 >> v1:172.21.15.181:6789/0 conn(0x7fbf1c06c4c0 legacy=0x7fbf1c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1b400700 1 -- 172.21.15.50:0/4161619505 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c070f10 con 0x7fbf1c0cf280 2024-09-13T15:08:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf1b400700 1 --2- 172.21.15.50:0/4161619505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c071710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009d90 tx=0x7fbf1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4334f816084443e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf19600700 1 -- 172.21.15.50:0/4161619505 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400e070 con 0x7fbf1c0cf280 2024-09-13T15:08:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf19600700 1 -- 172.21.15.50:0/4161619505 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1400bb20 con 0x7fbf1c0cf280 2024-09-13T15:08:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.260+0000 7fbf19600700 1 -- 172.21.15.50:0/4161619505 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14012430 con 0x7fbf1c0cf280 2024-09-13T15:08:51.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 -- 172.21.15.50:0/4161619505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 msgr2=0x7fbf1c071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 --2- 172.21.15.50:0/4161619505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c071710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009d90 tx=0x7fbf1400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 -- 172.21.15.50:0/4161619505 shutdown_connections 2024-09-13T15:08:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 --2- 172.21.15.50:0/4161619505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c071710 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 --2- 172.21.15.50:0/4161619505 >> v2:172.21.15.181:3300/0 conn(0x7fbf1c146720 0x7fbf1c15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 -- 172.21.15.50:0/4161619505 >> 172.21.15.50:0/4161619505 conn(0x7fbf1c06a570 msgr2=0x7fbf1c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 -- 172.21.15.50:0/4161619505 shutdown_connections 2024-09-13T15:08:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 -- 172.21.15.50:0/4161619505 wait complete. 2024-09-13T15:08:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 Processor -- start 2024-09-13T15:08:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.264+0000 7fbf21e00700 1 -- start start 2024-09-13T15:08:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 0x7fbf1c0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf1c146720 0x7fbf1c1f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0c4800 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c158870 con 0x7fbf1c146720 2024-09-13T15:08:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0c4240 con 0x7fbf1c0cf280 2024-09-13T15:08:51.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 0x7fbf1c0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 0x7fbf1c0c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38062/0 (socket says 172.21.15.50:38062) 2024-09-13T15:08:51.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 -- 172.21.15.50:0/1897982812 learned_addr learned my addr 172.21.15.50:0/1897982812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:51.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1a000700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1b400700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf1c146720 0x7fbf1c1f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 -- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 msgr2=0x7fbf1c142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 -- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf1c146720 msgr2=0x7fbf1c1f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf1c146720 0x7fbf1c1f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 -- 172.21.15.50:0/1897982812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009a70 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf1aa00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 0x7fbf1c0c3960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e890 tx=0x7fbf0c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c009620 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c013680 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c0c4520 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c013a30 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.268+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c158d60 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.272+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c06c8c0 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.272+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf0c013b90 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.272+0000 7fbf13400700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbefc066760 0x7fbefc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.276+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf0c0843b0 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.276+0000 7fbf1a000700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbefc066760 0x7fbefc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.276+0000 7fbf1a000700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbefc066760 0x7fbefc068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c06b060 tx=0x7fbf08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.284+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf0c0512d0 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.468+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf1c06c170 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.468+0000 7fbf13400700 1 -- 172.21.15.50:0/1897982812 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf0c0548f0 con 0x7fbf1c06c4c0 2024-09-13T15:08:51.472 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:08:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbefc066760 msgr2=0x7fbefc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbefc066760 0x7fbefc068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c06b060 tx=0x7fbf08009040 comp rx=0 tx=0).stop 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 msgr2=0x7fbf1c0c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 0x7fbf1c0c3960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e890 tx=0x7fbf0c00eba0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 shutdown_connections 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbefc066760 0x7fbefc068c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf1c146720 0x7fbf1c1f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf1c0cf280 0x7fbf1c142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 --2- 172.21.15.50:0/1897982812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf1c06c4c0 0x7fbf1c0c3960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 >> 172.21.15.50:0/1897982812 conn(0x7fbf1c06a570 msgr2=0x7fbf1c143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 shutdown_connections 2024-09-13T15:08:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.472+0000 7fbf21e00700 1 -- 172.21.15.50:0/1897982812 wait complete. 2024-09-13T15:08:51.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:08:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.680+0000 7fddb5a00700 1 Processor -- start 2024-09-13T15:08:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.680+0000 7fddb5a00700 1 -- start start 2024-09-13T15:08:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddb5a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fddb0144710 0x7fddb0165760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddb5a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb006bcf0 con 0x7fddb006d760 2024-09-13T15:08:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddb5a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb006cb50 con 0x7fddb0144330 2024-09-13T15:08:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddb5a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb00cce10 con 0x7fddb0144710 2024-09-13T15:08:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fdda6000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddb006d760 0x7fddb00b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48238/0 (socket says 172.21.15.50:48238) 2024-09-13T15:08:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fdda6000700 1 -- 172.21.15.50:0/3336068136 learned_addr learned my addr 172.21.15.50:0/3336068136 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddaf400700 1 --2- 172.21.15.50:0/3336068136 >> v2:172.21.15.181:3300/0 conn(0x7fddb0144710 0x7fddb0165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddae000700 1 -- 172.21.15.50:0/3336068136 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601100650 0 0) 0x7fddb006bcf0 con 0x7fddb006d760 2024-09-13T15:08:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddae000700 1 -- 172.21.15.50:0/3336068136 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd940035d0 con 0x7fddb006d760 2024-09-13T15:08:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddaf400700 1 -- 172.21.15.50:0/3336068136 >> v1:172.21.15.181:6789/0 conn(0x7fddb0144330 legacy=0x7fddb00cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddaf400700 1 -- 172.21.15.50:0/3336068136 >> v1:172.21.15.50:6789/0 conn(0x7fddb006d760 legacy=0x7fddb00b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.684+0000 7fddaf400700 1 -- 172.21.15.50:0/3336068136 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb006bf40 con 0x7fddb0144710 2024-09-13T15:08:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddaf400700 1 --2- 172.21.15.50:0/3336068136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb0144710 0x7fddb0165760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009d90 tx=0x7fdda800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1fc3bca05a6857 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddae000700 1 -- 172.21.15.50:0/3336068136 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800e070 con 0x7fddb0144710 2024-09-13T15:08:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddae000700 1 -- 172.21.15.50:0/3336068136 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800bb20 con 0x7fddb0144710 2024-09-13T15:08:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddae000700 1 -- 172.21.15.50:0/3336068136 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8012430 con 0x7fddb0144710 2024-09-13T15:08:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 -- 172.21.15.50:0/3336068136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb0144710 msgr2=0x7fddb0165760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3336068136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb0144710 0x7fddb0165760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009d90 tx=0x7fdda800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 -- 172.21.15.50:0/3336068136 shutdown_connections 2024-09-13T15:08:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3336068136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb0144710 0x7fddb0165760 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 -- 172.21.15.50:0/3336068136 >> 172.21.15.50:0/3336068136 conn(0x7fddb006a570 msgr2=0x7fddb006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 -- 172.21.15.50:0/3336068136 shutdown_connections 2024-09-13T15:08:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.688+0000 7fddb5a00700 1 -- 172.21.15.50:0/3336068136 wait complete. 2024-09-13T15:08:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 Processor -- start 2024-09-13T15:08:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 -- start start 2024-09-13T15:08:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006d760 0x7fddb01f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0144330 0x7fddb01387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fddb00ce280 0x7fddb0138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb013ddd0 con 0x7fddb0144330 2024-09-13T15:08:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00b0f60 con 0x7fddb006d760 2024-09-13T15:08:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddb5a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb01f2210 con 0x7fddb00ce280 2024-09-13T15:08:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fdda6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0144330 0x7fddb01387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006d760 0x7fddb01f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaf400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fddb00ce280 0x7fddb0138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fdda6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0144330 0x7fddb01387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38068/0 (socket says 172.21.15.50:38068) 2024-09-13T15:08:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fdda6000700 1 -- 172.21.15.50:0/3125029769 learned_addr learned my addr 172.21.15.50:0/3125029769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaea00700 1 -- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fddb00ce280 msgr2=0x7fddb0138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaea00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fddb00ce280 0x7fddb0138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaea00700 1 -- 172.21.15.50:0/3125029769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0144330 msgr2=0x7fddb01387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaea00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0144330 0x7fddb01387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.692+0000 7fddaea00700 1 -- 172.21.15.50:0/3125029769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009a70 con 0x7fddb006d760 2024-09-13T15:08:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fddaea00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006d760 0x7fddb01f1cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c4b0 tx=0x7fdda000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00052d0 con 0x7fddb006d760 2024-09-13T15:08:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0005430 con 0x7fddb006d760 2024-09-13T15:08:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00055a0 con 0x7fddb006d760 2024-09-13T15:08:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb00ae7e0 con 0x7fddb006d760 2024-09-13T15:08:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00aed60 con 0x7fddb006d760 2024-09-13T15:08:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.696+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb00b0d50 con 0x7fddb006d760 2024-09-13T15:08:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.700+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdda00038e0 con 0x7fddb006d760 2024-09-13T15:08:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.700+0000 7fdda7400700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdd8c066730 0x7fdd8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.700+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdda00838e0 con 0x7fddb006d760 2024-09-13T15:08:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.700+0000 7fdda6000700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdd8c066730 0x7fdd8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:51.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.704+0000 7fdda6000700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdd8c066730 0x7fdd8c068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fddb0143450 tx=0x7fdd98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.708+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdda00507f0 con 0x7fddb006d760 2024-09-13T15:08:51.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.896+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fddb006c4c0 con 0x7fddb006d760 2024-09-13T15:08:51.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.896+0000 7fdda7400700 1 -- 172.21.15.50:0/3125029769 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdda0053e10 con 0x7fddb006d760 2024-09-13T15:08:51.901 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdd8c066730 msgr2=0x7fdd8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdd8c066730 0x7fdd8c068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fddb0143450 tx=0x7fdd98009040 comp rx=0 tx=0).stop 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006d760 msgr2=0x7fddb01f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006d760 0x7fddb01f1cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c4b0 tx=0x7fdda000c7c0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 shutdown_connections 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdd8c066730 0x7fdd8c068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fddb00ce280 0x7fddb0138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0144330 0x7fddb01387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 --2- 172.21.15.50:0/3125029769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006d760 0x7fddb01f1cd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:51.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 >> 172.21.15.50:0/3125029769 conn(0x7fddb006a570 msgr2=0x7fddb00b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:51.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 shutdown_connections 2024-09-13T15:08:51.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:51.900+0000 7fddb5a00700 1 -- 172.21.15.50:0/3125029769 wait complete. 2024-09-13T15:08:51.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:08:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 Processor -- start 2024-09-13T15:08:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 -- start start 2024-09-13T15:08:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8a0c06c5a0 0x7f8a0c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c0b4680 con 0x7f8a0c0b2540 2024-09-13T15:08:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0b4960 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cf030 con 0x7f8a0c06c980 2024-09-13T15:08:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0aa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8a0c06c5a0 0x7f8a0c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.100+0000 7f8a0b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a0c0b2540 0x7f8a0c0b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48244/0 (socket says 172.21.15.50:48244) 2024-09-13T15:08:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0b400700 1 -- 172.21.15.50:0/3765886167 learned_addr learned my addr 172.21.15.50:0/3765886167 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0aa00700 1 -- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 msgr2=0x7f8a0c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0aa00700 1 --2- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0aa00700 1 -- 172.21.15.50:0/3765886167 >> v1:172.21.15.50:6789/0 conn(0x7f8a0c0b2540 legacy=0x7f8a0c0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0aa00700 1 -- 172.21.15.50:0/3765886167 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0cf310 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a09600700 1 -- 172.21.15.50:0/3765886167 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167787062 0 0) 0x7f8a0c0b4680 con 0x7f8a0c0b2540 2024-09-13T15:08:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0a000700 1 --2- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0aa00700 1 --2- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c15aa90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009850 tx=0x7f89fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=204015a51d9a5513 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a09600700 1 -- 172.21.15.50:0/3765886167 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc011830 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a09600700 1 -- 172.21.15.50:0/3765886167 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc011990 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a09600700 1 -- 172.21.15.50:0/3765886167 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc011d40 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 -- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c06c5a0 msgr2=0x7f8a0c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 --2- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c15aa90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009850 tx=0x7f89fc009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 -- 172.21.15.50:0/3765886167 shutdown_connections 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 --2- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 --2- 172.21.15.50:0/3765886167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c15aa90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 -- 172.21.15.50:0/3765886167 >> 172.21.15.50:0/3765886167 conn(0x7f8a0c071d20 msgr2=0x7f8a0c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 -- 172.21.15.50:0/3765886167 shutdown_connections 2024-09-13T15:08:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.104+0000 7f8a0be00700 1 -- 172.21.15.50:0/3765886167 wait complete. 2024-09-13T15:08:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.108+0000 7f8a0be00700 1 Processor -- start 2024-09-13T15:08:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.108+0000 7f8a0be00700 1 -- start start 2024-09-13T15:08:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.108+0000 7f8a0be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.108+0000 7f8a0be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c13e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.108+0000 7f8a0be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c0b2540 0x7f8a0c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.108+0000 7f8a0be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c13ebc0 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c1507e0 con 0x7f8a0c0b2540 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c150a60 con 0x7f8a0c06c980 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c1502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38084/0 (socket says 172.21.15.50:38084) 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 -- 172.21.15.50:0/642178662 learned_addr learned my addr 172.21.15.50:0/642178662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0a000700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c13e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0b400700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c0b2540 0x7f8a0c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 -- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 msgr2=0x7f8a0c13e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c13e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 -- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c0b2540 msgr2=0x7f8a0c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c0b2540 0x7f8a0c15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 -- 172.21.15.50:0/642178662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80094b0 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0a000700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c13e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0aa00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c1502a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc01a990 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc01f070 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc0094b0 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc01ad30 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.112+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c151020 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.116+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c13ed30 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.116+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89fc01b430 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.116+0000 7f8a02a00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89ec066730 0x7f89ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.120+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89fc085500 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.120+0000 7f8a0a000700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89ec066730 0x7f89ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.120+0000 7f8a0a000700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89ec066730 0x7f89ec068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0b24c0 tx=0x7f89f8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.124+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a0c13ed30 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.304+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a0c06cda0 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a02a00700 1 -- 172.21.15.50:0/642178662 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89fc021020 con 0x7f8a0c06c5a0 2024-09-13T15:08:52.310 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:08:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89ec066730 msgr2=0x7f89ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89ec066730 0x7f89ec068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0b24c0 tx=0x7f89f8009240 comp rx=0 tx=0).stop 2024-09-13T15:08:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 msgr2=0x7f8a0c1502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c1502a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc004770 comp rx=0 tx=0).stop 2024-09-13T15:08:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 shutdown_connections 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f89ec066730 0x7f89ec068bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a0c0b2540 0x7f8a0c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8a0c06c980 0x7f8a0c13e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 --2- 172.21.15.50:0/642178662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0c06c5a0 0x7f8a0c1502a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 >> 172.21.15.50:0/642178662 conn(0x7f8a0c071d20 msgr2=0x7f8a0c0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 shutdown_connections 2024-09-13T15:08:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.308+0000 7f8a0be00700 1 -- 172.21.15.50:0/642178662 wait complete. 2024-09-13T15:08:52.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:08:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd7200700 1 Processor -- start 2024-09-13T15:08:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd7200700 1 -- start start 2024-09-13T15:08:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd7200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6fd806d070 0x7f6fd80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd7200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd8071f70 con 0x7f6fd81464c0 2024-09-13T15:08:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd7200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd8070da0 con 0x7f6fd80b1980 2024-09-13T15:08:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd7200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80b2440 con 0x7f6fd806d070 2024-09-13T15:08:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd5e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fd81464c0 0x7f6fd8071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48260/0 (socket says 172.21.15.50:48260) 2024-09-13T15:08:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd5e00700 1 -- 172.21.15.50:0/1708027919 learned_addr learned my addr 172.21.15.50:0/1708027919 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.508+0000 7f6fd6800700 1 --2- 172.21.15.50:0/1708027919 >> v2:172.21.15.181:3300/0 conn(0x7f6fd806d070 0x7f6fd80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626814695 0 0) 0x7f6fd8071f70 con 0x7f6fd81464c0 2024-09-13T15:08:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fbc0035d0 con 0x7f6fd81464c0 2024-09-13T15:08:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410551186 0 0) 0x7f6fd8070da0 con 0x7f6fd80b1980 2024-09-13T15:08:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd8071f70 con 0x7f6fd80b1980 2024-09-13T15:08:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755539336 0 0) 0x7f6fbc0035d0 con 0x7f6fd81464c0 2024-09-13T15:08:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd6800700 1 -- 172.21.15.50:0/1708027919 >> v1:172.21.15.181:6789/0 conn(0x7f6fd80b1980 legacy=0x7f6fd806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd6800700 1 -- 172.21.15.50:0/1708027919 >> v1:172.21.15.50:6789/0 conn(0x7f6fd81464c0 legacy=0x7f6fd8071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd6800700 1 -- 172.21.15.50:0/1708027919 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80b2720 con 0x7f6fd806d070 2024-09-13T15:08:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd6800700 1 --2- 172.21.15.50:0/1708027919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806d070 0x7f6fd80b1df0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009850 tx=0x7f6fd0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941411da12f21a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80019f0 con 0x7f6fd806d070 2024-09-13T15:08:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0004030 con 0x7f6fd806d070 2024-09-13T15:08:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd4a00700 1 -- 172.21.15.50:0/1708027919 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00043c0 con 0x7f6fd806d070 2024-09-13T15:08:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 -- 172.21.15.50:0/1708027919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806d070 msgr2=0x7f6fd80b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1708027919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806d070 0x7f6fd80b1df0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009850 tx=0x7f6fd0009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 -- 172.21.15.50:0/1708027919 shutdown_connections 2024-09-13T15:08:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1708027919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806d070 0x7f6fd80b1df0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 -- 172.21.15.50:0/1708027919 >> 172.21.15.50:0/1708027919 conn(0x7f6fd806a390 msgr2=0x7f6fd806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 -- 172.21.15.50:0/1708027919 shutdown_connections 2024-09-13T15:08:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.512+0000 7f6fd7200700 1 -- 172.21.15.50:0/1708027919 wait complete. 2024-09-13T15:08:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 Processor -- start 2024-09-13T15:08:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 -- start start 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd806d070 0x7f6fd80cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd80b1980 0x7f6fd80cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 0x7f6fd80c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd813f980 con 0x7f6fd81464c0 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cd5b0 con 0x7f6fd80b1980 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.516+0000 7f6fd7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80c50a0 con 0x7f6fd806d070 2024-09-13T15:08:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 0x7f6fd80c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 0x7f6fd80c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38090/0 (socket says 172.21.15.50:38090) 2024-09-13T15:08:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 -- 172.21.15.50:0/1638426662 learned_addr learned my addr 172.21.15.50:0/1638426662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd5e00700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd806d070 0x7f6fd80cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd5400700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd80b1980 0x7f6fd80cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 -- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd806d070 msgr2=0x7f6fd80cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd806d070 0x7f6fd80cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 -- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd80b1980 msgr2=0x7f6fd80cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd80b1980 0x7f6fd80cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 -- 172.21.15.50:0/1638426662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd00094b0 con 0x7f6fd81464c0 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd6800700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 0x7f6fd80c4b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fd81604f0 tx=0x7f6fd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0003d60 con 0x7f6fd81464c0 2024-09-13T15:08:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd001f070 con 0x7f6fd81464c0 2024-09-13T15:08:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011870 con 0x7f6fd81464c0 2024-09-13T15:08:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd80cc9a0 con 0x7f6fd81464c0 2024-09-13T15:08:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80ccf60 con 0x7f6fd81464c0 2024-09-13T15:08:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.520+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd80cdf80 con 0x7f6fd81464c0 2024-09-13T15:08:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.524+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fd00119d0 con 0x7f6fd81464c0 2024-09-13T15:08:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.524+0000 7f6fce000700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066760 0x7f6fb8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.524+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fd0021070 con 0x7f6fd81464c0 2024-09-13T15:08:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.524+0000 7f6fd5e00700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066760 0x7f6fb8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.528+0000 7f6fd5e00700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066760 0x7f6fb8068c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8007160 tx=0x7f6fc8001870 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.532+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fd0052e40 con 0x7f6fd81464c0 2024-09-13T15:08:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.720+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6fd80cd720 con 0x7f6fd81464c0 2024-09-13T15:08:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.720+0000 7f6fce000700 1 -- 172.21.15.50:0/1638426662 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6fd002b0a0 con 0x7f6fd81464c0 2024-09-13T15:08:52.724 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:08:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066760 msgr2=0x7f6fb8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066760 0x7f6fb8068c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8007160 tx=0x7f6fc8001870 comp rx=0 tx=0).stop 2024-09-13T15:08:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 msgr2=0x7f6fd80c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 0x7f6fd80c4b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fd81604f0 tx=0x7f6fd0004770 comp rx=0 tx=0).stop 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 shutdown_connections 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066760 0x7f6fb8068c20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd81464c0 0x7f6fd80c4b60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd80b1980 0x7f6fd80cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 --2- 172.21.15.50:0/1638426662 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd806d070 0x7f6fd80cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 >> 172.21.15.50:0/1638426662 conn(0x7f6fd806a390 msgr2=0x7f6fd80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 shutdown_connections 2024-09-13T15:08:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.724+0000 7f6fd7200700 1 -- 172.21.15.50:0/1638426662 wait complete. 2024-09-13T15:08:52.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:52.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 Processor -- start 2024-09-13T15:08:52.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 -- start start 2024-09-13T15:08:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f09300cb020 0x7f09300cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f093006aaa0 0x7f093006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093006b430 con 0x7f093015c2a0 2024-09-13T15:08:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300b2ad0 con 0x7f093006aaa0 2024-09-13T15:08:52.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092fe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093015b960 con 0x7f09300cb020 2024-09-13T15:08:52.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f093006aaa0 0x7f093006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f093006aaa0 0x7f093006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38104/0 (socket says 172.21.15.50:38104) 2024-09-13T15:08:52.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 -- 172.21.15.50:0/309249556 learned_addr learned my addr 172.21.15.50:0/309249556 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:52.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092ea00700 1 --2- 172.21.15.50:0/309249556 >> v2:172.21.15.181:3300/0 conn(0x7f09300cb020 0x7f09300cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 -- 172.21.15.50:0/309249556 >> v2:172.21.15.181:3300/0 conn(0x7f09300cb020 msgr2=0x7f09300cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:52.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 --2- 172.21.15.50:0/309249556 >> v2:172.21.15.181:3300/0 conn(0x7f09300cb020 0x7f09300cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 -- 172.21.15.50:0/309249556 >> v1:172.21.15.181:6789/0 conn(0x7f093015c2a0 legacy=0x7f093015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.924+0000 7f092f400700 1 -- 172.21.15.50:0/309249556 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093015bc40 con 0x7f093006aaa0 2024-09-13T15:08:52.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092f400700 1 --2- 172.21.15.50:0/309249556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093006aaa0 0x7f093006aef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f093006b660 tx=0x7f092800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2933610d3481bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092d600700 1 -- 172.21.15.50:0/309249556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800e070 con 0x7f093006aaa0 2024-09-13T15:08:52.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092d600700 1 -- 172.21.15.50:0/309249556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092800b910 con 0x7f093006aaa0 2024-09-13T15:08:52.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092d600700 1 -- 172.21.15.50:0/309249556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800bcc0 con 0x7f093006aaa0 2024-09-13T15:08:52.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 -- 172.21.15.50:0/309249556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093006aaa0 msgr2=0x7f093006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 --2- 172.21.15.50:0/309249556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093006aaa0 0x7f093006aef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f093006b660 tx=0x7f092800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:52.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 -- 172.21.15.50:0/309249556 shutdown_connections 2024-09-13T15:08:52.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 --2- 172.21.15.50:0/309249556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f093006aaa0 0x7f093006aef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 --2- 172.21.15.50:0/309249556 >> v2:172.21.15.181:3300/0 conn(0x7f09300cb020 0x7f09300cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 -- 172.21.15.50:0/309249556 >> 172.21.15.50:0/309249556 conn(0x7f09300b0c40 msgr2=0x7f093006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:52.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 -- 172.21.15.50:0/309249556 shutdown_connections 2024-09-13T15:08:52.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.928+0000 7f092fe00700 1 -- 172.21.15.50:0/309249556 wait complete. 2024-09-13T15:08:52.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 Processor -- start 2024-09-13T15:08:52.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 -- start start 2024-09-13T15:08:52.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f093006aaa0 0x7f0930142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 0x7f0930141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f093015c2a0 0x7f0930070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0930150590 con 0x7f09300cb020 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0930142270 con 0x7f093015c2a0 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092fe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0930153170 con 0x7f093006aaa0 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 0x7f0930141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 0x7f0930141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38120/0 (socket says 172.21.15.50:38120) 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092e000700 1 -- 172.21.15.50:0/1908770071 learned_addr learned my addr 172.21.15.50:0/1908770071 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092f400700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f093015c2a0 0x7f0930070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.932+0000 7f092ea00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f093006aaa0 0x7f0930142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092e000700 1 -- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f093006aaa0 msgr2=0x7f0930142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092e000700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f093006aaa0 0x7f0930142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092e000700 1 -- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f093015c2a0 msgr2=0x7f0930070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092e000700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f093015c2a0 0x7f0930070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092e000700 1 -- 172.21.15.50:0/1908770071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0928009b30 con 0x7f09300cb020 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092e000700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 0x7f0930141d30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c500 tx=0x7f091c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0052d0 con 0x7f09300cb020 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c005430 con 0x7f09300cb020 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0055a0 con 0x7f09300cb020 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0930152e90 con 0x7f09300cb020 2024-09-13T15:08:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09301501b0 con 0x7f09300cb020 2024-09-13T15:08:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.936+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093006aef0 con 0x7f09300cb020 2024-09-13T15:08:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.940+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f091c0038e0 con 0x7f09300cb020 2024-09-13T15:08:52.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.940+0000 7f0926a00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0910066730 0x7f0910068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:52.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.940+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f091c083720 con 0x7f09300cb020 2024-09-13T15:08:52.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.940+0000 7f092ea00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0910066730 0x7f0910068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.944+0000 7f092ea00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0910066730 0x7f0910068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0920009bf0 tx=0x7f0920009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:52.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:52.948+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f091c050630 con 0x7f09300cb020 2024-09-13T15:08:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.176+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f093006b430 con 0x7f09300cb020 2024-09-13T15:08:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.176+0000 7f0926a00700 1 -- 172.21.15.50:0/1908770071 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f093006b430 con 0x7f09300cb020 2024-09-13T15:08:53.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:53.182 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:53.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0910066730 msgr2=0x7f0910068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0910066730 0x7f0910068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0920009bf0 tx=0x7f0920009240 comp rx=0 tx=0).stop 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 msgr2=0x7f0930141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 0x7f0930141d30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c500 tx=0x7f091c00c810 comp rx=0 tx=0).stop 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 shutdown_connections 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0910066730 0x7f0910068bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f093015c2a0 0x7f0930070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09300cb020 0x7f0930141d30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 --2- 172.21.15.50:0/1908770071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f093006aaa0 0x7f0930142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 >> 172.21.15.50:0/1908770071 conn(0x7f09300b0c40 msgr2=0x7f093015d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:53.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 shutdown_connections 2024-09-13T15:08:53.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.180+0000 7f092fe00700 1 -- 172.21.15.50:0/1908770071 wait complete. 2024-09-13T15:08:53.188 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:53.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:53.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.372+0000 7f90f0a00700 1 Processor -- start 2024-09-13T15:08:53.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.372+0000 7f90f0a00700 1 -- start start 2024-09-13T15:08:53.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90f0a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f90ec0d0400 0x7f90ec0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90f0a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0b0190 con 0x7f90ec15cb30 2024-09-13T15:08:53.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90f0a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec06a530 con 0x7f90ec06d180 2024-09-13T15:08:53.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90f0a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec06a810 con 0x7f90ec0d0400 2024-09-13T15:08:53.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90eb400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90ec15cb30 0x7f90ec06ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52264/0 (socket says 172.21.15.50:52264) 2024-09-13T15:08:53.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90eb400700 1 -- 172.21.15.50:0/445023472 learned_addr learned my addr 172.21.15.50:0/445023472 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:53.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ebe00700 1 --2- 172.21.15.50:0/445023472 >> v2:172.21.15.181:3300/0 conn(0x7f90ec0d0400 0x7f90ec0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511534364 0 0) 0x7f90ec0b0190 con 0x7f90ec15cb30 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d00035d0 con 0x7f90ec15cb30 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154699718 0 0) 0x7f90ec06a530 con 0x7f90ec06d180 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90ec0b0190 con 0x7f90ec06d180 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ebe00700 1 -- 172.21.15.50:0/445023472 >> v1:172.21.15.181:6789/0 conn(0x7f90ec06d180 legacy=0x7f90ec0cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ebe00700 1 -- 172.21.15.50:0/445023472 >> v1:172.21.15.50:6789/0 conn(0x7f90ec15cb30 legacy=0x7f90ec06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071744810 0 0) 0x7f90d00035d0 con 0x7f90ec15cb30 2024-09-13T15:08:53.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ebe00700 1 -- 172.21.15.50:0/445023472 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec06aaf0 con 0x7f90ec0d0400 2024-09-13T15:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.376+0000 7f90ebe00700 1 --2- 172.21.15.50:0/445023472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec0d0400 0x7f90ec0cb070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009d90 tx=0x7f90e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a843c617d1f80314 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e400e070 con 0x7f90ec0d0400 2024-09-13T15:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4003a40 con 0x7f90ec0d0400 2024-09-13T15:08:53.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90ea000700 1 -- 172.21.15.50:0/445023472 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc001670 con 0x7f90ec0d0400 2024-09-13T15:08:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 -- 172.21.15.50:0/445023472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec0d0400 msgr2=0x7f90ec0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 --2- 172.21.15.50:0/445023472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec0d0400 0x7f90ec0cb070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009d90 tx=0x7f90e400b330 comp rx=0 tx=0).stop 2024-09-13T15:08:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 -- 172.21.15.50:0/445023472 shutdown_connections 2024-09-13T15:08:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 --2- 172.21.15.50:0/445023472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec0d0400 0x7f90ec0cb070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 -- 172.21.15.50:0/445023472 >> 172.21.15.50:0/445023472 conn(0x7f90ec071f00 msgr2=0x7f90ec0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 -- 172.21.15.50:0/445023472 shutdown_connections 2024-09-13T15:08:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 -- 172.21.15.50:0/445023472 wait complete. 2024-09-13T15:08:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.380+0000 7f90f0a00700 1 Processor -- start 2024-09-13T15:08:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 -- start start 2024-09-13T15:08:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec06d180 0x7f90ec1f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90ec0d0400 0x7f90ec0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 0x7f90ec0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15e8a0 con 0x7f90ec15cb30 2024-09-13T15:08:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15eaf0 con 0x7f90ec06d180 2024-09-13T15:08:53.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15edd0 con 0x7f90ec0d0400 2024-09-13T15:08:53.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 0x7f90ec0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 0x7f90ec0b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55784/0 (socket says 172.21.15.50:55784) 2024-09-13T15:08:53.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 -- 172.21.15.50:0/3940713579 learned_addr learned my addr 172.21.15.50:0/3940713579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:53.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90eb400700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec06d180 0x7f90ec1f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90eaa00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90ec0d0400 0x7f90ec0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 -- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90ec0d0400 msgr2=0x7f90ec0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90ec0d0400 0x7f90ec0ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 -- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec06d180 msgr2=0x7f90ec1f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec06d180 0x7f90ec1f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 -- 172.21.15.50:0/3940713579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4009a70 con 0x7f90ec15cb30 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90ebe00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 0x7f90ec0b3ac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f90ec06c570 tx=0x7f90e4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40044c0 con 0x7f90ec15cb30 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4004620 con 0x7f90ec15cb30 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4004990 con 0x7f90ec15cb30 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.384+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec15f0b0 con 0x7f90ec15cb30 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.388+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0caa10 con 0x7f90ec15cb30 2024-09-13T15:08:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.388+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec0cac90 con 0x7f90ec15cb30 2024-09-13T15:08:53.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.388+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90e401d470 con 0x7f90ec15cb30 2024-09-13T15:08:53.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.392+0000 7f90e3400700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f90cc066730 0x7f90cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.392+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f90e4085d00 con 0x7f90ec15cb30 2024-09-13T15:08:53.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.392+0000 7f90eb400700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f90cc066730 0x7f90cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.392+0000 7f90eb400700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f90cc066730 0x7f90cc068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90dc007fd0 tx=0x7f90dc007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:53.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.396+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90ec0cac90 con 0x7f90ec15cb30 2024-09-13T15:08:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.596+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90ec0cac90 con 0x7f90ec15cb30 2024-09-13T15:08:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.596+0000 7f90e3400700 1 -- 172.21.15.50:0/3940713579 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f90ec0cac90 con 0x7f90ec15cb30 2024-09-13T15:08:53.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:53.602 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f90cc066730 msgr2=0x7f90cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f90cc066730 0x7f90cc068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90dc007fd0 tx=0x7f90dc007c20 comp rx=0 tx=0).stop 2024-09-13T15:08:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 msgr2=0x7f90ec0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 0x7f90ec0b3ac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f90ec06c570 tx=0x7f90e4004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 shutdown_connections 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f90cc066730 0x7f90cc068bf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90ec15cb30 0x7f90ec0b3ac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f90ec0d0400 0x7f90ec0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 --2- 172.21.15.50:0/3940713579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec06d180 0x7f90ec1f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 >> 172.21.15.50:0/3940713579 conn(0x7f90ec071f00 msgr2=0x7f90ec0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 shutdown_connections 2024-09-13T15:08:53.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.604+0000 7f90f0a00700 1 -- 172.21.15.50:0/3940713579 wait complete. 2024-09-13T15:08:53.633 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:08:53.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:53.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 Processor -- start 2024-09-13T15:08:53.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 -- start start 2024-09-13T15:08:53.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ea006aaa0 0x7f1ea015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ea00b3980 0x7f1ea006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea015e560 con 0x7f1ea006cbb0 2024-09-13T15:08:53.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea00adf90 con 0x7f1ea006aaa0 2024-09-13T15:08:53.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.804+0000 7f1ea5800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea006b3c0 con 0x7f1ea00b3980 2024-09-13T15:08:53.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ea006aaa0 0x7f1ea015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ea006aaa0 0x7f1ea015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55790/0 (socket says 172.21.15.50:55790) 2024-09-13T15:08:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 -- 172.21.15.50:0/563920553 learned_addr learned my addr 172.21.15.50:0/563920553 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e97400700 1 --2- 172.21.15.50:0/563920553 >> v2:172.21.15.181:3300/0 conn(0x7f1ea00b3980 0x7f1ea006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 -- 172.21.15.50:0/563920553 >> v2:172.21.15.181:3300/0 conn(0x7f1ea00b3980 msgr2=0x7f1ea006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:53.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 --2- 172.21.15.50:0/563920553 >> v2:172.21.15.181:3300/0 conn(0x7f1ea00b3980 0x7f1ea006ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 -- 172.21.15.50:0/563920553 >> v1:172.21.15.181:6789/0 conn(0x7f1ea006cbb0 legacy=0x7f1ea006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:53.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 -- 172.21.15.50:0/563920553 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea015d920 con 0x7f1ea006aaa0 2024-09-13T15:08:53.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9fe00700 1 --2- 172.21.15.50:0/563920553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006aaa0 0x7f1ea015d310 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00cb010 tx=0x7f1e90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6782ffb9f54b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:53.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9f400700 1 -- 172.21.15.50:0/563920553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90004230 con 0x7f1ea006aaa0 2024-09-13T15:08:53.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9f400700 1 -- 172.21.15.50:0/563920553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90004390 con 0x7f1ea006aaa0 2024-09-13T15:08:53.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1e9f400700 1 -- 172.21.15.50:0/563920553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900036c0 con 0x7f1ea006aaa0 2024-09-13T15:08:53.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 -- 172.21.15.50:0/563920553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006aaa0 msgr2=0x7f1ea015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 --2- 172.21.15.50:0/563920553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006aaa0 0x7f1ea015d310 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00cb010 tx=0x7f1e90009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 -- 172.21.15.50:0/563920553 shutdown_connections 2024-09-13T15:08:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 --2- 172.21.15.50:0/563920553 >> v2:172.21.15.181:3300/0 conn(0x7f1ea00b3980 0x7f1ea006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 --2- 172.21.15.50:0/563920553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006aaa0 0x7f1ea015d310 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 -- 172.21.15.50:0/563920553 >> 172.21.15.50:0/563920553 conn(0x7f1ea00b0c40 msgr2=0x7f1ea006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 -- 172.21.15.50:0/563920553 shutdown_connections 2024-09-13T15:08:53.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.808+0000 7f1ea5800700 1 -- 172.21.15.50:0/563920553 wait complete. 2024-09-13T15:08:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.812+0000 7f1ea5800700 1 Processor -- start 2024-09-13T15:08:53.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 -- start start 2024-09-13T15:08:53.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ea006aaa0 0x7f1ea01347a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 0x7f1ea00c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea00b3980 0x7f1ea0145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0134ce0 con 0x7f1ea006cbb0 2024-09-13T15:08:53.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea00cb040 con 0x7f1ea00b3980 2024-09-13T15:08:53.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea00cb2e0 con 0x7f1ea006aaa0 2024-09-13T15:08:53.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 0x7f1ea00c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 0x7f1ea00c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55798/0 (socket says 172.21.15.50:55798) 2024-09-13T15:08:53.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 -- 172.21.15.50:0/1210089434 learned_addr learned my addr 172.21.15.50:0/1210089434 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e9fe00700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ea006aaa0 0x7f1ea01347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea4e00700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea00b3980 0x7f1ea0145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 -- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ea006aaa0 msgr2=0x7f1ea01347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ea006aaa0 0x7f1ea01347a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 -- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea00b3980 msgr2=0x7f1ea0145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea00b3980 0x7f1ea0145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 -- 172.21.15.50:0/1210089434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009570 con 0x7f1ea006cbb0 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea4e00700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea00b3980 0x7f1ea0145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:08:53.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e97400700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 0x7f1ea00c5060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800e810 tx=0x7f1e8800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:53.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88013610 con 0x7f1ea006cbb0 2024-09-13T15:08:53.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88013770 con 0x7f1ea006cbb0 2024-09-13T15:08:53.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea00cb5c0 con 0x7f1ea006cbb0 2024-09-13T15:08:53.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88013b20 con 0x7f1ea006cbb0 2024-09-13T15:08:53.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.816+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea00cbb80 con 0x7f1ea006cbb0 2024-09-13T15:08:53.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.820+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea01446c0 con 0x7f1ea006cbb0 2024-09-13T15:08:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.820+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e88013c80 con 0x7f1ea006cbb0 2024-09-13T15:08:53.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.824+0000 7f1e9cc00700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1e7c066730 0x7f1e7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:53.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.824+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e88084700 con 0x7f1ea006cbb0 2024-09-13T15:08:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.824+0000 7f1e9fe00700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1e7c066730 0x7f1e7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.824+0000 7f1e9fe00700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1e7c066730 0x7f1e7c068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00cb010 tx=0x7f1e90008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:53.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:53.828+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e88051740 con 0x7f1ea006cbb0 2024-09-13T15:08:54.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.056+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea00ad1f0 con 0x7f1ea006cbb0 2024-09-13T15:08:54.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.060+0000 7f1e9cc00700 1 -- 172.21.15.50:0/1210089434 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f1e88054d60 con 0x7f1ea006cbb0 2024-09-13T15:08:54.063 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:54.063 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:54.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.060+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1e7c066730 msgr2=0x7f1e7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.060+0000 7f1ea5800700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1e7c066730 0x7f1e7c068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00cb010 tx=0x7f1e90008030 comp rx=0 tx=0).stop 2024-09-13T15:08:54.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.060+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 msgr2=0x7f1ea00c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.060+0000 7f1ea5800700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 0x7f1ea00c5060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800e810 tx=0x7f1e8800ebd0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 shutdown_connections 2024-09-13T15:08:54.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1e7c066730 0x7f1e7c068bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ea00b3980 0x7f1ea0145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea006cbb0 0x7f1ea00c5060 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 --2- 172.21.15.50:0/1210089434 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ea006aaa0 0x7f1ea01347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 >> 172.21.15.50:0/1210089434 conn(0x7f1ea00b0c40 msgr2=0x7f1ea0140dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 shutdown_connections 2024-09-13T15:08:54.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.064+0000 7f1ea5800700 1 -- 172.21.15.50:0/1210089434 wait complete. 2024-09-13T15:08:54.069 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:54.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:08:54.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.264+0000 7f92f9600700 1 Processor -- start 2024-09-13T15:08:54.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.264+0000 7f92f9600700 1 -- start start 2024-09-13T15:08:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.264+0000 7f92f9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.264+0000 7f92f9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92f40703d0 0x7f92f406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.264+0000 7f92f9600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f413fcc0 con 0x7f92f413ebc0 2024-09-13T15:08:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f413f0f0 con 0x7f92f40703d0 2024-09-13T15:08:54.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f413f390 con 0x7f92f406ace0 2024-09-13T15:08:54.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92f40703d0 0x7f92f406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92f40703d0 0x7f92f406bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55814/0 (socket says 172.21.15.50:55814) 2024-09-13T15:08:54.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f2a00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f92f413ebc0 0x7f92f406a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:49888/0 (socket says 172.21.15.50:49888) 2024-09-13T15:08:54.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 -- 172.21.15.50:0/1477939315 learned_addr learned my addr 172.21.15.50:0/1477939315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:54.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f2000700 1 --2- 172.21.15.50:0/1477939315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 -- 172.21.15.50:0/1477939315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 msgr2=0x7f92f406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 --2- 172.21.15.50:0/1477939315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 -- 172.21.15.50:0/1477939315 >> v1:172.21.15.181:6789/0 conn(0x7f92f413ebc0 legacy=0x7f92f406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 -- 172.21.15.50:0/1477939315 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f413f670 con 0x7f92f40703d0 2024-09-13T15:08:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f1600700 1 -- 172.21.15.50:0/1477939315 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193128779 0 0) 0x7f92f413fcc0 con 0x7f92f413ebc0 2024-09-13T15:08:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f3400700 1 --2- 172.21.15.50:0/1477939315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f406bcd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e50 tx=0x7f92ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718b1450fd9b0f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:54.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f1600700 1 -- 172.21.15.50:0/1477939315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00bbc0 con 0x7f92f40703d0 2024-09-13T15:08:54.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f1600700 1 -- 172.21.15.50:0/1477939315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec00bd20 con 0x7f92f40703d0 2024-09-13T15:08:54.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f1600700 1 -- 172.21.15.50:0/1477939315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0116a0 con 0x7f92f40703d0 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- 172.21.15.50:0/1477939315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 msgr2=0x7f92f406bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 --2- 172.21.15.50:0/1477939315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f406bcd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e50 tx=0x7f92ec00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- 172.21.15.50:0/1477939315 shutdown_connections 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 --2- 172.21.15.50:0/1477939315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f406bcd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 --2- 172.21.15.50:0/1477939315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- 172.21.15.50:0/1477939315 >> 172.21.15.50:0/1477939315 conn(0x7f92f40b08d0 msgr2=0x7f92f40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- 172.21.15.50:0/1477939315 shutdown_connections 2024-09-13T15:08:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.268+0000 7f92f9600700 1 -- 172.21.15.50:0/1477939315 wait complete. 2024-09-13T15:08:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 Processor -- start 2024-09-13T15:08:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 -- start start 2024-09-13T15:08:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f4153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f4151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92f413ebc0 0x7f92f414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40b2f30 con 0x7f92f40703d0 2024-09-13T15:08:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f41522a0 con 0x7f92f413ebc0 2024-09-13T15:08:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.272+0000 7f92f9600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f4151690 con 0x7f92f406ace0 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f4151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f4151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55828/0 (socket says 172.21.15.50:55828) 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 -- 172.21.15.50:0/3734964732 learned_addr learned my addr 172.21.15.50:0/3734964732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2a00700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f4153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f3400700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92f413ebc0 0x7f92f414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 -- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 msgr2=0x7f92f4153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f4153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 -- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92f413ebc0 msgr2=0x7f92f414faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92f413ebc0 0x7f92f414faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 -- 172.21.15.50:0/3734964732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec009b30 con 0x7f92f40703d0 2024-09-13T15:08:54.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f2000700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f4151000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f92e000e810 tx=0x7f92e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:54.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000c070 con 0x7f92f40703d0 2024-09-13T15:08:54.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0013630 con 0x7f92f40703d0 2024-09-13T15:08:54.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00139e0 con 0x7f92f40703d0 2024-09-13T15:08:54.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f4151970 con 0x7f92f40703d0 2024-09-13T15:08:54.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.276+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f4151f30 con 0x7f92f40703d0 2024-09-13T15:08:54.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.280+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f406fe90 con 0x7f92f40703d0 2024-09-13T15:08:54.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.280+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92e0013b40 con 0x7f92f40703d0 2024-09-13T15:08:54.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.280+0000 7f92eaa00700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f92d4066760 0x7f92d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.280+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f92e0084220 con 0x7f92f40703d0 2024-09-13T15:08:54.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.280+0000 7f92f2a00700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f92d4066760 0x7f92d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.284+0000 7f92f2a00700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f92d4066760 0x7f92d4068c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f92e4000f60 tx=0x7f92e4007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:54.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.284+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92e00511c0 con 0x7f92f40703d0 2024-09-13T15:08:54.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.516+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92f4150db0 con 0x7f92f40703d0 2024-09-13T15:08:54.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.516+0000 7f92eaa00700 1 -- 172.21.15.50:0/3734964732 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f92e00547e0 con 0x7f92f40703d0 2024-09-13T15:08:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:54.522 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/899740685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":899740685},{"type":"v1","addr":"172.21.15.181:6837","nonce":899740685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1999257229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1999257229},{"type":"v1","addr":"172.21.15.50:6833","nonce":1999257229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/991257452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":991257452},{"type":"v1","addr":"172.21.15.50:6835","nonce":991257452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:07:37.462088+0000","modified":"2024-09-13T15:08:04.144510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.181:6835/472992043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":472992043},{"type":"v1","addr":"172.21.15.181:6835","nonce":472992043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:08:54.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f92d4066760 msgr2=0x7f92d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f92d4066760 0x7f92d4068c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f92e4000f60 tx=0x7f92e4007e90 comp rx=0 tx=0).stop 2024-09-13T15:08:54.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 msgr2=0x7f92f4151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f4151000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f92e000e810 tx=0x7f92e000eb20 comp rx=0 tx=0).stop 2024-09-13T15:08:54.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 shutdown_connections 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f92d4066760 0x7f92d4068c20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92f413ebc0 0x7f92f414faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f40703d0 0x7f92f4151000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 --2- 172.21.15.50:0/3734964732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f92f406ace0 0x7f92f4153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 >> 172.21.15.50:0/3734964732 conn(0x7f92f40b08d0 msgr2=0x7f92f4158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 shutdown_connections 2024-09-13T15:08:54.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.520+0000 7f92f9600700 1 -- 172.21.15.50:0/3734964732 wait complete. 2024-09-13T15:08:54.527 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-13T15:08:54.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:08:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.712+0000 7f98ffa00700 1 Processor -- start 2024-09-13T15:08:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.712+0000 7f98ffa00700 1 -- start start 2024-09-13T15:08:54.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98ffa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98f8071d20 0x7f98f80b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98ffa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f80cd610 0x7f98f806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98ffa00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f80ce140 con 0x7f98f806a5d0 2024-09-13T15:08:54.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98ffa00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f80cde60 con 0x7f98f8071d20 2024-09-13T15:08:54.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98ffa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f806c3b0 con 0x7f98f80cd610 2024-09-13T15:08:54.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fd000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98f806a5d0 0x7f98f806a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52266/0 (socket says 172.21.15.50:52266) 2024-09-13T15:08:54.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fd000700 1 -- 172.21.15.50:0/3580701086 learned_addr learned my addr 172.21.15.50:0/3580701086 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:54.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98f7e00700 1 --2- 172.21.15.50:0/3580701086 >> v2:172.21.15.181:3300/0 conn(0x7f98f8071d20 0x7f98f80b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fda00700 1 --2- 172.21.15.50:0/3580701086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f80cd610 0x7f98f806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98f7400700 1 -- 172.21.15.50:0/3580701086 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060997024 0 0) 0x7f98f80ce140 con 0x7f98f806a5d0 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98f7400700 1 -- 172.21.15.50:0/3580701086 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e00035d0 con 0x7f98f806a5d0 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fda00700 1 -- 172.21.15.50:0/3580701086 >> v2:172.21.15.181:3300/0 conn(0x7f98f8071d20 msgr2=0x7f98f80b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fda00700 1 --2- 172.21.15.50:0/3580701086 >> v2:172.21.15.181:3300/0 conn(0x7f98f8071d20 0x7f98f80b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fda00700 1 -- 172.21.15.50:0/3580701086 >> v1:172.21.15.50:6789/0 conn(0x7f98f806a5d0 legacy=0x7f98f806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.716+0000 7f98fda00700 1 -- 172.21.15.50:0/3580701086 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f806c690 con 0x7f98f80cd610 2024-09-13T15:08:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98fda00700 1 --2- 172.21.15.50:0/3580701086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f80cd610 0x7f98f806ce90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009d90 tx=0x7f98f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4207c2d3106fad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98f7400700 1 -- 172.21.15.50:0/3580701086 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000e070 con 0x7f98f80cd610 2024-09-13T15:08:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98f7400700 1 -- 172.21.15.50:0/3580701086 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f000bb20 con 0x7f98f80cd610 2024-09-13T15:08:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98f7400700 1 -- 172.21.15.50:0/3580701086 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0012430 con 0x7f98f80cd610 2024-09-13T15:08:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 -- 172.21.15.50:0/3580701086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f80cd610 msgr2=0x7f98f806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3580701086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f80cd610 0x7f98f806ce90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009d90 tx=0x7f98f000b330 comp rx=0 tx=0).stop 2024-09-13T15:08:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 -- 172.21.15.50:0/3580701086 shutdown_connections 2024-09-13T15:08:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3580701086 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f80cd610 0x7f98f806ce90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3580701086 >> v2:172.21.15.181:3300/0 conn(0x7f98f8071d20 0x7f98f80b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 -- 172.21.15.50:0/3580701086 >> 172.21.15.50:0/3580701086 conn(0x7f98f80b08d0 msgr2=0x7f98f80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 -- 172.21.15.50:0/3580701086 shutdown_connections 2024-09-13T15:08:54.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.720+0000 7f98ffa00700 1 -- 172.21.15.50:0/3580701086 wait complete. 2024-09-13T15:08:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 Processor -- start 2024-09-13T15:08:54.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 -- start start 2024-09-13T15:08:54.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f806a5d0 0x7f98f8162860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f8071d20 0x7f98f813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 0x7f98f8151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8162da0 con 0x7f98f80cd610 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8162fd0 con 0x7f98f806a5d0 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.724+0000 7f98ffa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81632b0 con 0x7f98f8071d20 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 0x7f98f8151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 0x7f98f8151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55844/0 (socket says 172.21.15.50:55844) 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 -- 172.21.15.50:0/3086053300 learned_addr learned my addr 172.21.15.50:0/3086053300 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fd000700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f806a5d0 0x7f98f8162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98f7e00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f8071d20 0x7f98f813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 -- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f8071d20 msgr2=0x7f98f813fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f8071d20 0x7f98f813fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 -- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f806a5d0 msgr2=0x7f98f8162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f806a5d0 0x7f98f8162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 -- 172.21.15.50:0/3086053300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0009a70 con 0x7f98f80cd610 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98fda00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 0x7f98f8151870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98f0014040 tx=0x7f98f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0004780 con 0x7f98f80cd610 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f0020070 con 0x7f98f80cd610 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f8163590 con 0x7f98f80cd610 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00276c0 con 0x7f98f80cd610 2024-09-13T15:08:54.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.728+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f8163b50 con 0x7f98f80cd610 2024-09-13T15:08:54.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.732+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8067480 con 0x7f98f80cd610 2024-09-13T15:08:54.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.732+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98f0012430 con 0x7f98f80cd610 2024-09-13T15:08:54.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.732+0000 7f98f4c00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98d8066730 0x7f98d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:54.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.732+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f98f0022070 con 0x7f98f80cd610 2024-09-13T15:08:54.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.736+0000 7f98fd000700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98d8066730 0x7f98d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:54.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.736+0000 7f98fd000700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98d8066730 0x7f98d8068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98ec007fd0 tx=0x7f98ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:54.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.744+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98f0053010 con 0x7f98f80cd610 2024-09-13T15:08:54.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.936+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98f80b19f0 con 0x7f98f80cd610 2024-09-13T15:08:54.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.940+0000 7f98f4c00700 1 -- 172.21.15.50:0/3086053300 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f98f002c020 con 0x7f98f80cd610 2024-09-13T15:08:54.943 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:08:54.944 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:08:21.269305+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:07:35.445625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:07:36.454534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:07:39.541856+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98d8066730 msgr2=0x7f98d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98d8066730 0x7f98d8068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98ec007fd0 tx=0x7f98ec009040 comp rx=0 tx=0).stop 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 msgr2=0x7f98f8151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 0x7f98f8151870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98f0014040 tx=0x7f98f0004af0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 shutdown_connections 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f98d8066730 0x7f98d8068bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f80cd610 0x7f98f8151870 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98f8071d20 0x7f98f813fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 --2- 172.21.15.50:0/3086053300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f806a5d0 0x7f98f8162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:54.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 >> 172.21.15.50:0/3086053300 conn(0x7f98f80b08d0 msgr2=0x7f98f8148cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:54.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 shutdown_connections 2024-09-13T15:08:54.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:54.944+0000 7f98ffa00700 1 -- 172.21.15.50:0/3086053300 wait complete. 2024-09-13T15:08:54.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:08:55.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 Processor -- start 2024-09-13T15:08:55.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 -- start start 2024-09-13T15:08:55.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36b00724c0 0x7f36b0071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b0066090 0x7f36b0066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b0071950 con 0x7f36b015cc50 2024-09-13T15:08:55.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b0072a60 con 0x7f36b00724c0 2024-09-13T15:08:55.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.156+0000 7f36b7600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0066a60 con 0x7f36b0066090 2024-09-13T15:08:55.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b4c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36b015cc50 0x7f36b00b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52268/0 (socket says 172.21.15.50:52268) 2024-09-13T15:08:55.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36afe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36b00724c0 0x7f36b0071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b4c00700 1 -- 172.21.15.50:0/3817022571 learned_addr learned my addr 172.21.15.50:0/3817022571 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:55.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b5600700 1 --2- 172.21.15.50:0/3817022571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b0066090 0x7f36b0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36afe00700 1 -- 172.21.15.50:0/3817022571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b0066090 msgr2=0x7f36b0066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:55.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36afe00700 1 --2- 172.21.15.50:0/3817022571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b0066090 0x7f36b0066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36afe00700 1 -- 172.21.15.50:0/3817022571 >> v1:172.21.15.50:6789/0 conn(0x7f36b015cc50 legacy=0x7f36b00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36afe00700 1 -- 172.21.15.50:0/3817022571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00af120 con 0x7f36b00724c0 2024-09-13T15:08:55.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36af400700 1 -- 172.21.15.50:0/3817022571 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940923299 0 0) 0x7f36b0071950 con 0x7f36b015cc50 2024-09-13T15:08:55.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36afe00700 1 --2- 172.21.15.50:0/3817022571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00724c0 0x7f36b0071de0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f369c009850 tx=0x7f369c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a60bddfa121e60e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:55.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36af400700 1 -- 172.21.15.50:0/3817022571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011830 con 0x7f36b00724c0 2024-09-13T15:08:55.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36af400700 1 -- 172.21.15.50:0/3817022571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c011990 con 0x7f36b00724c0 2024-09-13T15:08:55.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36af400700 1 -- 172.21.15.50:0/3817022571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011d40 con 0x7f36b00724c0 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 -- 172.21.15.50:0/3817022571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00724c0 msgr2=0x7f36b0071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 --2- 172.21.15.50:0/3817022571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00724c0 0x7f36b0071de0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f369c009850 tx=0x7f369c009b60 comp rx=0 tx=0).stop 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 -- 172.21.15.50:0/3817022571 shutdown_connections 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 --2- 172.21.15.50:0/3817022571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b0066090 0x7f36b0066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 --2- 172.21.15.50:0/3817022571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00724c0 0x7f36b0071de0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 -- 172.21.15.50:0/3817022571 >> 172.21.15.50:0/3817022571 conn(0x7f36b00b1e00 msgr2=0x7f36b00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 -- 172.21.15.50:0/3817022571 shutdown_connections 2024-09-13T15:08:55.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.160+0000 7f36b7600700 1 -- 172.21.15.50:0/3817022571 wait complete. 2024-09-13T15:08:55.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.164+0000 7f36b7600700 1 Processor -- start 2024-09-13T15:08:55.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.164+0000 7f36b7600700 1 -- start start 2024-09-13T15:08:55.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 0x7f36b015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b00724c0 0x7f36b0155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b015cc50 0x7f36b015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b015fa40 con 0x7f36b0066090 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b015eb90 con 0x7f36b015cc50 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b015ee30 con 0x7f36b00724c0 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 0x7f36b015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 0x7f36b015fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55864/0 (socket says 172.21.15.50:55864) 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 -- 172.21.15.50:0/344663827 learned_addr learned my addr 172.21.15.50:0/344663827 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36afe00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b00724c0 0x7f36b0155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b5600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b015cc50 0x7f36b015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 -- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b00724c0 msgr2=0x7f36b0155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b00724c0 0x7f36b0155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 -- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b015cc50 msgr2=0x7f36b015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b015cc50 0x7f36b015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 -- 172.21.15.50:0/344663827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0094b0 con 0x7f36b0066090 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b4c00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 0x7f36b015fed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cc20 tx=0x7f36a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400ac20 con 0x7f36b0066090 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400ad80 con 0x7f36b0066090 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b015f110 con 0x7f36b0066090 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4007310 con 0x7f36b0066090 2024-09-13T15:08:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.168+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b015f6d0 con 0x7f36b0066090 2024-09-13T15:08:55.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.172+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b0066520 con 0x7f36b0066090 2024-09-13T15:08:55.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.172+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36a4007470 con 0x7f36b0066090 2024-09-13T15:08:55.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.176+0000 7f36acc00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3690066730 0x7f3690068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.176+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36a4084540 con 0x7f36b0066090 2024-09-13T15:08:55.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.176+0000 7f36afe00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3690066730 0x7f3690068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.176+0000 7f36afe00700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3690066730 0x7f3690068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f369c0090b0 tx=0x7f369c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:55.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.180+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36a40513c0 con 0x7f36b0066090 2024-09-13T15:08:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.400+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f36b0067730 con 0x7f36b0066090 2024-09-13T15:08:55.405 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:08:55.400+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:08:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.416+0000 7f36acc00700 1 -- 172.21.15.50:0/344663827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f36a4018090 con 0x7f36b0066090 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3690066730 msgr2=0x7f3690068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3690066730 0x7f3690068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f369c0090b0 tx=0x7f369c008030 comp rx=0 tx=0).stop 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 msgr2=0x7f36b015fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 0x7f36b015fed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cc20 tx=0x7f36a400a060 comp rx=0 tx=0).stop 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 shutdown_connections 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3690066730 0x7f3690068bf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b015cc50 0x7f36b015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b00724c0 0x7f36b0155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 --2- 172.21.15.50:0/344663827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b0066090 0x7f36b015fed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 >> 172.21.15.50:0/344663827 conn(0x7f36b00b1e00 msgr2=0x7f36b006c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 shutdown_connections 2024-09-13T15:08:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.420+0000 7f36b7600700 1 -- 172.21.15.50:0/344663827 wait complete. 2024-09-13T15:08:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:08:55.433 INFO:tasks.ceph.mds.b.smithi181.stderr: -5607> 2024-09-13T15:07:38.571+0000 7f7b77c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:08:55.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:08:55.492 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:08:55.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.616+0000 7fbd97200700 1 Processor -- start 2024-09-13T15:08:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.616+0000 7fbd97200700 1 -- start start 2024-09-13T15:08:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd97200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c5a0 0x7fbd9015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd97200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbd9006c980 0x7fbd900b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd97200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd900b2540 0x7fbd900b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd97200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900b4680 con 0x7fbd900b2540 2024-09-13T15:08:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd97200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900b4960 con 0x7fbd9006c980 2024-09-13T15:08:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd97200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900cf030 con 0x7fbd9006c5a0 2024-09-13T15:08:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd900b2540 0x7fbd900b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd95400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbd9006c980 0x7fbd900b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd900b2540 0x7fbd900b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55868/0 (socket says 172.21.15.50:55868) 2024-09-13T15:08:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 -- 172.21.15.50:0/471398992 learned_addr learned my addr 172.21.15.50:0/471398992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd95e00700 1 --2- 172.21.15.50:0/471398992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c5a0 0x7fbd9015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 -- 172.21.15.50:0/471398992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c5a0 msgr2=0x7fbd9015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 --2- 172.21.15.50:0/471398992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c5a0 0x7fbd9015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 -- 172.21.15.50:0/471398992 >> v2:172.21.15.181:3300/0 conn(0x7fbd9006c980 msgr2=0x7fbd900b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 --2- 172.21.15.50:0/471398992 >> v2:172.21.15.181:3300/0 conn(0x7fbd9006c980 0x7fbd900b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 -- 172.21.15.50:0/471398992 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900cf310 con 0x7fbd900b2540 2024-09-13T15:08:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.620+0000 7fbd96800700 1 --2- 172.21.15.50:0/471398992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd900b2540 0x7fbd900b2990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbd900b64d0 tx=0x7fbd8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22e0e6552b181ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd94a00700 1 -- 172.21.15.50:0/471398992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00e070 con 0x7fbd900b2540 2024-09-13T15:08:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd94a00700 1 -- 172.21.15.50:0/471398992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00b910 con 0x7fbd900b2540 2024-09-13T15:08:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd94a00700 1 -- 172.21.15.50:0/471398992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00bcc0 con 0x7fbd900b2540 2024-09-13T15:08:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 -- 172.21.15.50:0/471398992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd900b2540 msgr2=0x7fbd900b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 --2- 172.21.15.50:0/471398992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd900b2540 0x7fbd900b2990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbd900b64d0 tx=0x7fbd8c00b330 comp rx=0 tx=0).stop 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 -- 172.21.15.50:0/471398992 shutdown_connections 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 --2- 172.21.15.50:0/471398992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd900b2540 0x7fbd900b2990 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 --2- 172.21.15.50:0/471398992 >> v2:172.21.15.181:3300/0 conn(0x7fbd9006c980 0x7fbd900b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 --2- 172.21.15.50:0/471398992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c5a0 0x7fbd9015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 -- 172.21.15.50:0/471398992 >> 172.21.15.50:0/471398992 conn(0x7fbd90071d20 msgr2=0x7fbd90072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 -- 172.21.15.50:0/471398992 shutdown_connections 2024-09-13T15:08:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.624+0000 7fbd97200700 1 -- 172.21.15.50:0/471398992 wait complete. 2024-09-13T15:08:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 Processor -- start 2024-09-13T15:08:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 -- start start 2024-09-13T15:08:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 0x7fbd90145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c980 0x7fbd9015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd900b2540 0x7fbd9015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd901458a0 con 0x7fbd9006c5a0 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015b9a0 con 0x7fbd900b2540 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd97200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9015bc80 con 0x7fbd9006c980 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd95e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 0x7fbd90145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd95e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 0x7fbd90145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55880/0 (socket says 172.21.15.50:55880) 2024-09-13T15:08:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd95e00700 1 -- 172.21.15.50:0/2073949355 learned_addr learned my addr 172.21.15.50:0/2073949355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.628+0000 7fbd95400700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c980 0x7fbd9015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd96800700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd900b2540 0x7fbd9015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95e00700 1 -- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c980 msgr2=0x7fbd9015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95e00700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c980 0x7fbd9015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95e00700 1 -- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd900b2540 msgr2=0x7fbd9015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95e00700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd900b2540 0x7fbd9015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95e00700 1 -- 172.21.15.50:0/2073949355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009b30 con 0x7fbd9006c5a0 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd96800700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd900b2540 0x7fbd9015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95400700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c980 0x7fbd9015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd95e00700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 0x7fbd90145360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400e940 tx=0x7fbd8400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840096a0 con 0x7fbd9006c5a0 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400c850 con 0x7fbd9006c5a0 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9015bf60 con 0x7fbd9006c5a0 2024-09-13T15:08:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400cbe0 con 0x7fbd9006c5a0 2024-09-13T15:08:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9015c520 con 0x7fbd9006c5a0 2024-09-13T15:08:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.632+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd900b3060 con 0x7fbd9006c5a0 2024-09-13T15:08:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.636+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd8400cd40 con 0x7fbd9006c5a0 2024-09-13T15:08:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.636+0000 7fbd8a000700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbd74066730 0x7fbd74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.636+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fbd84084650 con 0x7fbd9006c5a0 2024-09-13T15:08:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.636+0000 7fbd95400700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbd74066730 0x7fbd74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.640+0000 7fbd95400700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbd74066730 0x7fbd74068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd90152dd0 tx=0x7fbd80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.644+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd84051510 con 0x7fbd9006c5a0 2024-09-13T15:08:55.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:55.864+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbd9006cda0 con 0x7fbd9006c5a0 2024-09-13T15:08:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.420+0000 7fbd8a000700 1 -- 172.21.15.50:0/2073949355 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd84054b30 con 0x7fbd9006c5a0 2024-09-13T15:08:56.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbd74066730 msgr2=0x7fbd74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:56.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbd74066730 0x7fbd74068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd90152dd0 tx=0x7fbd80008040 comp rx=0 tx=0).stop 2024-09-13T15:08:56.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 msgr2=0x7fbd90145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:56.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 0x7fbd90145360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400e940 tx=0x7fbd8400ed00 comp rx=0 tx=0).stop 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 shutdown_connections 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbd74066730 0x7fbd74068bf0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd90152dd0 tx=0x7fbd80008040 comp rx=0 tx=0).stop 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd900b2540 0x7fbd9015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbd9006c980 0x7fbd9015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 --2- 172.21.15.50:0/2073949355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd9006c5a0 0x7fbd90145360 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 >> 172.21.15.50:0/2073949355 conn(0x7fbd90071d20 msgr2=0x7fbd900b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 shutdown_connections 2024-09-13T15:08:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.424+0000 7fbd97200700 1 -- 172.21.15.50:0/2073949355 wait complete. 2024-09-13T15:08:56.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:08:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.640+0000 7f7f22400700 1 Processor -- start 2024-09-13T15:08:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.644+0000 7f7f22400700 1 -- start start 2024-09-13T15:08:56.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.644+0000 7f7f22400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7f1c15a9d0 0x7f7f1c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:56.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.644+0000 7f7f22400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 0x7f7f1c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.644+0000 7f7f22400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c15adb0 con 0x7f7f1c0ce1d0 2024-09-13T15:08:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.644+0000 7f7f22400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c0cd280 con 0x7f7f1c15a9d0 2024-09-13T15:08:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.644+0000 7f7f22400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c0ce850 con 0x7f7f1c0b0000 2024-09-13T15:08:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 0x7f7f1c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 0x7f7f1c0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:49602/0 (socket says 172.21.15.50:49602) 2024-09-13T15:08:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 -- 172.21.15.50:0/852670637 learned_addr learned my addr 172.21.15.50:0/852670637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f21000700 1 --2- 172.21.15.50:0/852670637 >> v2:172.21.15.181:3300/0 conn(0x7f7f1c15a9d0 0x7f7f1c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 -- 172.21.15.50:0/852670637 >> v2:172.21.15.181:3300/0 conn(0x7f7f1c15a9d0 msgr2=0x7f7f1c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 --2- 172.21.15.50:0/852670637 >> v2:172.21.15.181:3300/0 conn(0x7f7f1c15a9d0 0x7f7f1c0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 -- 172.21.15.50:0/852670637 >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0ce1d0 legacy=0x7f7f1c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1b400700 1 -- 172.21.15.50:0/852670637 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063563091 0 0) 0x7f7f1c15adb0 con 0x7f7f1c0ce1d0 2024-09-13T15:08:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 -- 172.21.15.50:0/852670637 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0ceb30 con 0x7f7f1c0b0000 2024-09-13T15:08:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1be00700 1 --2- 172.21.15.50:0/852670637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 0x7f7f1c0cdc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009910 tx=0x7f7f08009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a54afe6b294991 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1b400700 1 -- 172.21.15.50:0/852670637 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08011830 con 0x7f7f1c0b0000 2024-09-13T15:08:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1b400700 1 -- 172.21.15.50:0/852670637 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08011990 con 0x7f7f1c0b0000 2024-09-13T15:08:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.648+0000 7f7f1b400700 1 -- 172.21.15.50:0/852670637 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08011d40 con 0x7f7f1c0b0000 2024-09-13T15:08:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 -- 172.21.15.50:0/852670637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 msgr2=0x7f7f1c0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 --2- 172.21.15.50:0/852670637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 0x7f7f1c0cdc90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009910 tx=0x7f7f08009c20 comp rx=0 tx=0).stop 2024-09-13T15:08:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 -- 172.21.15.50:0/852670637 shutdown_connections 2024-09-13T15:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 --2- 172.21.15.50:0/852670637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c0b0000 0x7f7f1c0cdc90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 --2- 172.21.15.50:0/852670637 >> v2:172.21.15.181:3300/0 conn(0x7f7f1c15a9d0 0x7f7f1c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 -- 172.21.15.50:0/852670637 >> 172.21.15.50:0/852670637 conn(0x7f7f1c066270 msgr2=0x7f7f1c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 -- 172.21.15.50:0/852670637 shutdown_connections 2024-09-13T15:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 -- 172.21.15.50:0/852670637 wait complete. 2024-09-13T15:08:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 Processor -- start 2024-09-13T15:08:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.652+0000 7f7f22400700 1 -- start start 2024-09-13T15:08:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f22400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 0x7f7f1c06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f22400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f1c0ce1d0 0x7f7f1c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f22400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c15a9d0 0x7f7f1c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f22400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06a6a0 con 0x7f7f1c0b0000 2024-09-13T15:08:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f22400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06aa60 con 0x7f7f1c0ce1d0 2024-09-13T15:08:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f22400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06acb0 con 0x7f7f1c15a9d0 2024-09-13T15:08:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 0x7f7f1c06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 0x7f7f1c06bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55892/0 (socket says 172.21.15.50:55892) 2024-09-13T15:08:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f1be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f1c0ce1d0 0x7f7f1c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 -- 172.21.15.50:0/1805123220 learned_addr learned my addr 172.21.15.50:0/1805123220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21a00700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c15a9d0 0x7f7f1c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 -- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c15a9d0 msgr2=0x7f7f1c14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c15a9d0 0x7f7f1c14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 -- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f1c0ce1d0 msgr2=0x7f7f1c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f1c0ce1d0 0x7f7f1c15b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 -- 172.21.15.50:0/1805123220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009570 con 0x7f7f1c0b0000 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f1be00700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f1c0ce1d0 0x7f7f1c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21a00700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c15a9d0 0x7f7f1c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.656+0000 7f7f21000700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 0x7f7f1c06bd50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000e9d0 tx=0x7f7f1000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.660+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10009720 con 0x7f7f1c0b0000 2024-09-13T15:08:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.660+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000ee70 con 0x7f7f1c0b0000 2024-09-13T15:08:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.660+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000c9f0 con 0x7f7f1c0b0000 2024-09-13T15:08:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.660+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c06af90 con 0x7f7f1c0b0000 2024-09-13T15:08:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.660+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c06b550 con 0x7f7f1c0b0000 2024-09-13T15:08:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.660+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c0cdc90 con 0x7f7f1c0b0000 2024-09-13T15:08:56.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.664+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f1000cb50 con 0x7f7f1c0b0000 2024-09-13T15:08:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.664+0000 7f7f18c00700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7efc066730 0x7f7efc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.664+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f7f100845f0 con 0x7f7f1c0b0000 2024-09-13T15:08:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.664+0000 7f7f1be00700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7efc066730 0x7f7efc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.668+0000 7f7f1be00700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7efc066730 0x7f7efc068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009910 tx=0x7f7f08008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:56.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.672+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f100514b0 con 0x7f7f1c0b0000 2024-09-13T15:08:56.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:56.856+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f1c0b5e10 con 0x7f7f1c0b0000 2024-09-13T15:08:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.524+0000 7f7f18c00700 1 -- 172.21.15.50:0/1805123220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7f10054ad0 con 0x7f7f1c0b0000 2024-09-13T15:08:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7efc066730 msgr2=0x7f7efc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7efc066730 0x7f7efc068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009910 tx=0x7f7f08008030 comp rx=0 tx=0).stop 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 msgr2=0x7f7f1c06bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 0x7f7f1c06bd50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000e9d0 tx=0x7f7f1000ece0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 shutdown_connections 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7efc066730 0x7f7efc068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f1c15a9d0 0x7f7f1c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f1c0ce1d0 0x7f7f1c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 --2- 172.21.15.50:0/1805123220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f1c0b0000 0x7f7f1c06bd50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 >> 172.21.15.50:0/1805123220 conn(0x7f7f1c066270 msgr2=0x7f7f1c158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:57.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 shutdown_connections 2024-09-13T15:08:57.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.532+0000 7f7f22400700 1 -- 172.21.15.50:0/1805123220 wait complete. 2024-09-13T15:08:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:08:57.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:08:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 Processor -- start 2024-09-13T15:08:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 -- start start 2024-09-13T15:08:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56a415cda0 0x7f56a415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 0x7f56a40d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a415e340 0x7f56a40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40b4830 con 0x7f56a415e340 2024-09-13T15:08:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a415e120 con 0x7f56a415cda0 2024-09-13T15:08:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.744+0000 7f56aa800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415db60 con 0x7f56a415d6c0 2024-09-13T15:08:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 0x7f56a40d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56a415cda0 0x7f56a415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 0x7f56a40d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:49612/0 (socket says 172.21.15.50:49612) 2024-09-13T15:08:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 -- 172.21.15.50:0/1836454675 learned_addr learned my addr 172.21.15.50:0/1836454675 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a3e00700 1 --2- 172.21.15.50:0/1836454675 >> v2:172.21.15.50:3300/0 conn(0x7f56a415e340 0x7f56a40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 -- 172.21.15.50:0/1836454675 >> v2:172.21.15.181:3300/0 conn(0x7f56a415cda0 msgr2=0x7f56a415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 --2- 172.21.15.50:0/1836454675 >> v2:172.21.15.181:3300/0 conn(0x7f56a415cda0 0x7f56a415d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 -- 172.21.15.50:0/1836454675 >> v2:172.21.15.50:3300/0 conn(0x7f56a415e340 msgr2=0x7f56a40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 --2- 172.21.15.50:0/1836454675 >> v2:172.21.15.50:3300/0 conn(0x7f56a415e340 0x7f56a40d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 -- 172.21.15.50:0/1836454675 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a415de40 con 0x7f56a415d6c0 2024-09-13T15:08:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2a00700 1 --2- 172.21.15.50:0/1836454675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 0x7f56a40d0a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56a4072b20 tx=0x7f5690009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90cb04c8be249d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2000700 1 -- 172.21.15.50:0/1836454675 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690011830 con 0x7f56a415d6c0 2024-09-13T15:08:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2000700 1 -- 172.21.15.50:0/1836454675 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690011990 con 0x7f56a415d6c0 2024-09-13T15:08:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.748+0000 7f56a2000700 1 -- 172.21.15.50:0/1836454675 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690011d20 con 0x7f56a415d6c0 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 -- 172.21.15.50:0/1836454675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 msgr2=0x7f56a40d0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 --2- 172.21.15.50:0/1836454675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 0x7f56a40d0a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56a4072b20 tx=0x7f5690009bf0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 -- 172.21.15.50:0/1836454675 shutdown_connections 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 --2- 172.21.15.50:0/1836454675 >> v2:172.21.15.50:3300/0 conn(0x7f56a415e340 0x7f56a40d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 --2- 172.21.15.50:0/1836454675 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415d6c0 0x7f56a40d0a70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 --2- 172.21.15.50:0/1836454675 >> v2:172.21.15.181:3300/0 conn(0x7f56a415cda0 0x7f56a415d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 -- 172.21.15.50:0/1836454675 >> 172.21.15.50:0/1836454675 conn(0x7f56a406e660 msgr2=0x7f56a406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 -- 172.21.15.50:0/1836454675 shutdown_connections 2024-09-13T15:08:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 -- 172.21.15.50:0/1836454675 wait complete. 2024-09-13T15:08:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 Processor -- start 2024-09-13T15:08:57.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.752+0000 7f56aa800700 1 -- start start 2024-09-13T15:08:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56aa800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56a415cda0 0x7f56a406c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56aa800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 0x7f56a414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56aa800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415e340 0x7f56a40cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56aa800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a414a9b0 con 0x7f56a415d6c0 2024-09-13T15:08:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56aa800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40cb2a0 con 0x7f56a415cda0 2024-09-13T15:08:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56aa800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40caa40 con 0x7f56a415e340 2024-09-13T15:08:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 0x7f56a414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 0x7f56a414a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55908/0 (socket says 172.21.15.50:55908) 2024-09-13T15:08:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 -- 172.21.15.50:0/3959738258 learned_addr learned my addr 172.21.15.50:0/3959738258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a3400700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56a415cda0 0x7f56a406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a3e00700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415e340 0x7f56a40cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 -- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415e340 msgr2=0x7f56a40cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415e340 0x7f56a40cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 -- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56a415cda0 msgr2=0x7f56a406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56a415cda0 0x7f56a406c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 -- 172.21.15.50:0/3959738258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009570 con 0x7f56a415d6c0 2024-09-13T15:08:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.756+0000 7f56a2a00700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 0x7f56a414a160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f56a415dca0 tx=0x7f5690004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.760+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004240 con 0x7f56a415d6c0 2024-09-13T15:08:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.760+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569001f070 con 0x7f56a415d6c0 2024-09-13T15:08:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.760+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004600 con 0x7f56a415d6c0 2024-09-13T15:08:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.760+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a40cace0 con 0x7f56a415d6c0 2024-09-13T15:08:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.760+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a414a6a0 con 0x7f56a415d6c0 2024-09-13T15:08:57.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.760+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a4067a20 con 0x7f56a415d6c0 2024-09-13T15:08:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.764+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5690021030 con 0x7f56a415d6c0 2024-09-13T15:08:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.764+0000 7f569b400700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5684066730 0x7f5684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.764+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f56900852e0 con 0x7f56a415d6c0 2024-09-13T15:08:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.764+0000 7f56a3400700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5684066730 0x7f5684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.768+0000 7f56a3400700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5684066730 0x7f5684068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5694009bf0 tx=0x7f5694009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:57.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.772+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56900524a0 con 0x7f56a415d6c0 2024-09-13T15:08:57.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:57.952+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56a415d180 con 0x7f56a415d6c0 2024-09-13T15:08:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.540+0000 7f569b400700 1 -- 172.21.15.50:0/3959738258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5690055ac0 con 0x7f56a415d6c0 2024-09-13T15:08:58.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5684066730 msgr2=0x7f5684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:58.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5684066730 0x7f5684068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5694009bf0 tx=0x7f5694009240 comp rx=0 tx=0).stop 2024-09-13T15:08:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 msgr2=0x7f56a414a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 0x7f56a414a160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f56a415dca0 tx=0x7f5690004770 comp rx=0 tx=0).stop 2024-09-13T15:08:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 shutdown_connections 2024-09-13T15:08:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5684066730 0x7f5684068bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56a415e340 0x7f56a40cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a415d6c0 0x7f56a414a160 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 --2- 172.21.15.50:0/3959738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56a415cda0 0x7f56a406c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 >> 172.21.15.50:0/3959738258 conn(0x7f56a406e660 msgr2=0x7f56a415b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 shutdown_connections 2024-09-13T15:08:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.548+0000 7f56aa800700 1 -- 172.21.15.50:0/3959738258 wait complete. 2024-09-13T15:08:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:08:58.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T15:08:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.756+0000 7f8e05200700 1 Processor -- start 2024-09-13T15:08:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.756+0000 7f8e05200700 1 -- start start 2024-09-13T15:08:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8e05200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8e0015e340 0x7f8e000d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8e05200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 0x7f8e000b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8e05200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000b4830 con 0x7f8e0015cda0 2024-09-13T15:08:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8e05200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e000d1440 con 0x7f8e0015e340 2024-09-13T15:08:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8e05200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0015e120 con 0x7f8e000d0fb0 2024-09-13T15:08:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 0x7f8e000b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfd400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8e0015e340 0x7f8e000d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 0x7f8e000b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:49640/0 (socket says 172.21.15.50:49640) 2024-09-13T15:08:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 -- 172.21.15.50:0/1276440773 learned_addr learned my addr 172.21.15.50:0/1276440773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 -- 172.21.15.50:0/1276440773 >> v2:172.21.15.181:3300/0 conn(0x7f8e0015e340 msgr2=0x7f8e000d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 --2- 172.21.15.50:0/1276440773 >> v2:172.21.15.181:3300/0 conn(0x7f8e0015e340 0x7f8e000d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 -- 172.21.15.50:0/1276440773 >> v1:172.21.15.181:6789/0 conn(0x7f8e0015cda0 legacy=0x7f8e0015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfca00700 1 -- 172.21.15.50:0/1276440773 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721928503 0 0) 0x7f8e000b4830 con 0x7f8e0015cda0 2024-09-13T15:08:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 -- 172.21.15.50:0/1276440773 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0015d890 con 0x7f8e000d0fb0 2024-09-13T15:08:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.760+0000 7f8dfe800700 1 --2- 172.21.15.50:0/1276440773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 0x7f8e000b4cc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009e50 tx=0x7f8df800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bf4e1630452c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8dfca00700 1 -- 172.21.15.50:0/1276440773 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800e070 con 0x7f8e000d0fb0 2024-09-13T15:08:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8dfca00700 1 -- 172.21.15.50:0/1276440773 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800b910 con 0x7f8e000d0fb0 2024-09-13T15:08:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8dfca00700 1 -- 172.21.15.50:0/1276440773 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800bcc0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 -- 172.21.15.50:0/1276440773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 msgr2=0x7f8e000b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 --2- 172.21.15.50:0/1276440773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 0x7f8e000b4cc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009e50 tx=0x7f8df800b330 comp rx=0 tx=0).stop 2024-09-13T15:08:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 -- 172.21.15.50:0/1276440773 shutdown_connections 2024-09-13T15:08:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 --2- 172.21.15.50:0/1276440773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e000d0fb0 0x7f8e000b4cc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 --2- 172.21.15.50:0/1276440773 >> v2:172.21.15.181:3300/0 conn(0x7f8e0015e340 0x7f8e000d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 -- 172.21.15.50:0/1276440773 >> 172.21.15.50:0/1276440773 conn(0x7f8e0006e660 msgr2=0x7f8e0006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 -- 172.21.15.50:0/1276440773 shutdown_connections 2024-09-13T15:08:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.764+0000 7f8e05200700 1 -- 172.21.15.50:0/1276440773 wait complete. 2024-09-13T15:08:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 Processor -- start 2024-09-13T15:08:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 -- start start 2024-09-13T15:08:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 0x7f8e000b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0015cda0 0x7f8e000b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e0015e340 0x7f8e00147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001576e0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00157f60 con 0x7f8e0015e340 2024-09-13T15:08:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8e05200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b2b40 con 0x7f8e0015cda0 2024-09-13T15:08:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 0x7f8e000b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 0x7f8e000b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55918/0 (socket says 172.21.15.50:55918) 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 -- 172.21.15.50:0/2601595783 learned_addr learned my addr 172.21.15.50:0/2601595783 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfe800700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e0015e340 0x7f8e00147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfd400700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0015cda0 0x7f8e000b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 -- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0015cda0 msgr2=0x7f8e000b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0015cda0 0x7f8e000b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 -- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e0015e340 msgr2=0x7f8e00147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e0015e340 0x7f8e00147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.768+0000 7f8dfde00700 1 -- 172.21.15.50:0/2601595783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8009b30 con 0x7f8e000d0fb0 2024-09-13T15:08:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8dfde00700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 0x7f8e000b20c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c750 tx=0x7f8df000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00054e0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df00036a0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0003a50 con 0x7f8e000d0fb0 2024-09-13T15:08:58.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e00144ed0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e000b2db0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.772+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e00067a20 con 0x7f8e000d0fb0 2024-09-13T15:08:58.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.776+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8df0003bb0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.776+0000 7f8df6000700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de0066730 0x7f8de0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:58.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.776+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f8df00836b0 con 0x7f8e000d0fb0 2024-09-13T15:08:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.776+0000 7f8dfd400700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de0066730 0x7f8de0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.780+0000 7f8dfd400700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de0066730 0x7f8de0068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e0015a2f0 tx=0x7f8dec009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.784+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8df0050930 con 0x7f8e000d0fb0 2024-09-13T15:08:58.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:58.964+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e000d0a70 con 0x7f8e000d0fb0 2024-09-13T15:08:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.548+0000 7f8df6000700 1 -- 172.21.15.50:0/2601595783 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f8df0003e60 con 0x7f8e000d0fb0 2024-09-13T15:08:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de0066730 msgr2=0x7f8de0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de0066730 0x7f8de0068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e0015a2f0 tx=0x7f8dec009240 comp rx=0 tx=0).stop 2024-09-13T15:08:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 msgr2=0x7f8e000b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 0x7f8e000b20c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c750 tx=0x7f8df000ca60 comp rx=0 tx=0).stop 2024-09-13T15:08:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 shutdown_connections 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de0066730 0x7f8de0068bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e0015e340 0x7f8e00147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0015cda0 0x7f8e000b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 --2- 172.21.15.50:0/2601595783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e000d0fb0 0x7f8e000b20c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 >> 172.21.15.50:0/2601595783 conn(0x7f8e0006e660 msgr2=0x7f8e0006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 shutdown_connections 2024-09-13T15:08:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.556+0000 7f8e05200700 1 -- 172.21.15.50:0/2601595783 wait complete. 2024-09-13T15:08:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2024-09-13T15:08:59.585 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:08:59.585 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T15:08:59.585 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:08:59.585 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:08:59.586 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:08:59.586 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T15:08:59.586 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:08:59.586 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:08:59.586 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:08:59.586 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T15:08:59.586 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:08:59.586 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:08:59.587 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:08:59.587 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T15:08:59.587 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:08:59.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:08:59.611 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:08:59.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:08:59.613 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:08:59.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:08:59.614 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:08:59.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:08:59.615 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:08:59.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:08:59.659 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:08:59.660 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:59.661 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:08:59.661 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:59.662 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:08:59.662 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:59.665 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:08:59.665 DEBUG:teuthology.parallel:result is None 2024-09-13T15:08:59.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T15:08:59.771 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:08:59.773 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:08:59.774 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:08:59.777 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:08:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 Processor -- start 2024-09-13T15:08:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 -- start start 2024-09-13T15:08:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f02f406c460 0x7f02f406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f40cdd90 con 0x7f02f406a5d0 2024-09-13T15:08:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f406ce10 con 0x7f02f406c460 2024-09-13T15:08:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.840+0000 7f02fae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f415c020 con 0x7f02f415b700 2024-09-13T15:08:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f02f406c460 0x7f02f406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f8e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f02f406a5d0 0x7f02f40b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:49942/0 (socket says 172.21.15.50:49942) 2024-09-13T15:08:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f8e00700 1 -- 172.21.15.50:0/271736077 learned_addr learned my addr 172.21.15.50:0/271736077 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:08:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3400700 1 -- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 msgr2=0x7f02f415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:08:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3400700 1 --2- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3400700 1 -- 172.21.15.50:0/271736077 >> v1:172.21.15.181:6789/0 conn(0x7f02f406a5d0 legacy=0x7f02f40b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3400700 1 -- 172.21.15.50:0/271736077 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f406d7e0 con 0x7f02f406c460 2024-09-13T15:08:59.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3e00700 1 --2- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:08:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f3400700 1 --2- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406c460 0x7f02f406d2a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02e000dc70 tx=0x7f02e000df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0996a35edb4c5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f2a00700 1 -- 172.21.15.50:0/271736077 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0012070 con 0x7f02f406c460 2024-09-13T15:08:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f2a00700 1 -- 172.21.15.50:0/271736077 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000d2e0 con 0x7f02f406c460 2024-09-13T15:08:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02f2a00700 1 -- 172.21.15.50:0/271736077 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000f8e0 con 0x7f02f406c460 2024-09-13T15:08:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 -- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406c460 msgr2=0x7f02f406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 --2- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406c460 0x7f02f406d2a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02e000dc70 tx=0x7f02e000df80 comp rx=0 tx=0).stop 2024-09-13T15:08:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 -- 172.21.15.50:0/271736077 shutdown_connections 2024-09-13T15:08:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 --2- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406c460 0x7f02f406d2a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 --2- 172.21.15.50:0/271736077 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 -- 172.21.15.50:0/271736077 >> 172.21.15.50:0/271736077 conn(0x7f02f40b08d0 msgr2=0x7f02f40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:08:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 -- 172.21.15.50:0/271736077 shutdown_connections 2024-09-13T15:08:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.844+0000 7f02fae00700 1 -- 172.21.15.50:0/271736077 wait complete. 2024-09-13T15:08:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.848+0000 7f02fae00700 1 Processor -- start 2024-09-13T15:08:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.848+0000 7f02fae00700 1 -- start start 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406a5d0 0x7f02f4145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 0x7f02f414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f4151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41f80b0 con 0x7f02f406c460 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41f7710 con 0x7f02f406a5d0 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41f79f0 con 0x7f02f415b700 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 0x7f02f414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 0x7f02f414a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55980/0 (socket says 172.21.15.50:55980) 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 -- 172.21.15.50:0/3081907144 learned_addr learned my addr 172.21.15.50:0/3081907144 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:08:59.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f8e00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f4151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:59.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3e00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406a5d0 0x7f02f4145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 -- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 msgr2=0x7f02f4151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f4151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 -- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406a5d0 msgr2=0x7f02f4145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406a5d0 0x7f02f4145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 -- 172.21.15.50:0/3081907144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e40094b0 con 0x7f02f406c460 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02f3400700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 0x7f02f414a8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f02f40721e0 tx=0x7f02e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000b070 con 0x7f02f406c460 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000d7d0 con 0x7f02f406c460 2024-09-13T15:08:59.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0003900 con 0x7f02f406c460 2024-09-13T15:08:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e000d950 con 0x7f02f406c460 2024-09-13T15:08:59.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.852+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f41f84d0 con 0x7f02f406c460 2024-09-13T15:08:59.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.856+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f41f81f0 con 0x7f02f406c460 2024-09-13T15:08:59.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.856+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02e0003a60 con 0x7f02f406c460 2024-09-13T15:08:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.860+0000 7f02ebe00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f02d4066730 0x7f02d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:08:59.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.860+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f02e0084720 con 0x7f02f406c460 2024-09-13T15:08:59.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.860+0000 7f02f3e00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f02d4066730 0x7f02d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:08:59.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.860+0000 7f02f3e00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f02d4066730 0x7f02d4068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02f4073100 tx=0x7f02e4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:08:59.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:08:59.864+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02f41f81f0 con 0x7f02f406c460 2024-09-13T15:09:00.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.060+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02f41f81f0 con 0x7f02f406c460 2024-09-13T15:09:00.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.816+0000 7f02ebe00700 1 -- 172.21.15.50:0/3081907144 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02f41f81f0 con 0x7f02f406c460 2024-09-13T15:09:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f02d4066730 msgr2=0x7f02d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f02d4066730 0x7f02d4068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02f4073100 tx=0x7f02e4009240 comp rx=0 tx=0).stop 2024-09-13T15:09:00.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 msgr2=0x7f02f414a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 0x7f02f414a8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f02f40721e0 tx=0x7f02e0004770 comp rx=0 tx=0).stop 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 shutdown_connections 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f02d4066730 0x7f02d4068bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02f415b700 0x7f02f4151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f406c460 0x7f02f414a8b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 --2- 172.21.15.50:0/3081907144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02f406a5d0 0x7f02f4145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 >> 172.21.15.50:0/3081907144 conn(0x7f02f40b08d0 msgr2=0x7f02f415d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 shutdown_connections 2024-09-13T15:09:00.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:00.820+0000 7f02fae00700 1 -- 172.21.15.50:0/3081907144 wait complete. 2024-09-13T15:09:00.826 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-13T15:09:00.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T15:09:01.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.020+0000 7f629ce00700 1 Processor -- start 2024-09-13T15:09:01.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.020+0000 7f629ce00700 1 -- start start 2024-09-13T15:09:01.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f629ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62980b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f629ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62980ceaf0 0x7f6298163540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f629ce00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6298159fa0 con 0x7f62980b34b0 2024-09-13T15:09:01.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f629ce00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980cef80 con 0x7f62980ceaf0 2024-09-13T15:09:01.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f629ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62980cf240 con 0x7f62980b3fa0 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6295e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f62980b34b0 0x7f62980b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52298/0 (socket says 172.21.15.50:52298) 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6295e00700 1 -- 172.21.15.50:0/2293098888 learned_addr learned my addr 172.21.15.50:0/2293098888 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6296800700 1 --2- 172.21.15.50:0/2293098888 >> v2:172.21.15.50:3300/0 conn(0x7f62980ceaf0 0x7f6298163540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6295400700 1 --2- 172.21.15.50:0/2293098888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62980b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6296800700 1 -- 172.21.15.50:0/2293098888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 msgr2=0x7f62980b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6296800700 1 --2- 172.21.15.50:0/2293098888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62980b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6296800700 1 -- 172.21.15.50:0/2293098888 >> v1:172.21.15.50:6789/0 conn(0x7f62980b34b0 legacy=0x7f62980b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6296800700 1 -- 172.21.15.50:0/2293098888 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980cf520 con 0x7f62980ceaf0 2024-09-13T15:09:01.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.024+0000 7f6296800700 1 --2- 172.21.15.50:0/2293098888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980ceaf0 0x7f6298163540 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6290009d90 tx=0x7f629000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8e12a2809c4004 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f6294a00700 1 -- 172.21.15.50:0/2293098888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000bdd0 con 0x7f62980ceaf0 2024-09-13T15:09:01.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f6294a00700 1 -- 172.21.15.50:0/2293098888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6290011460 con 0x7f62980ceaf0 2024-09-13T15:09:01.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f6294a00700 1 -- 172.21.15.50:0/2293098888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011810 con 0x7f62980ceaf0 2024-09-13T15:09:01.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 -- 172.21.15.50:0/2293098888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980ceaf0 msgr2=0x7f6298163540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 --2- 172.21.15.50:0/2293098888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980ceaf0 0x7f6298163540 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6290009d90 tx=0x7f629000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 -- 172.21.15.50:0/2293098888 shutdown_connections 2024-09-13T15:09:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 --2- 172.21.15.50:0/2293098888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980ceaf0 0x7f6298163540 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 --2- 172.21.15.50:0/2293098888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62980b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 -- 172.21.15.50:0/2293098888 >> 172.21.15.50:0/2293098888 conn(0x7f629806e660 msgr2=0x7f629806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 -- 172.21.15.50:0/2293098888 shutdown_connections 2024-09-13T15:09:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.028+0000 7f629ce00700 1 -- 172.21.15.50:0/2293098888 wait complete. 2024-09-13T15:09:01.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 Processor -- start 2024-09-13T15:09:01.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 -- start start 2024-09-13T15:09:01.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 0x7f629815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62981f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62980ceaf0 0x7f6298139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629815c8d0 con 0x7f62980b34b0 2024-09-13T15:09:01.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629815a9d0 con 0x7f62980ceaf0 2024-09-13T15:09:01.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f629ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629814d290 con 0x7f62980b3fa0 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.032+0000 7f6295e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 0x7f629815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 0x7f629815a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55996/0 (socket says 172.21.15.50:55996) 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 -- 172.21.15.50:0/3872074426 learned_addr learned my addr 172.21.15.50:0/3872074426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295400700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62981f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6296800700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62980ceaf0 0x7f6298139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 -- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 msgr2=0x7f62981f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62981f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 -- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62980ceaf0 msgr2=0x7f6298139130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62980ceaf0 0x7f6298139130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 -- 172.21.15.50:0/3872074426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009a70 con 0x7f62980b34b0 2024-09-13T15:09:01.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6296800700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62980ceaf0 0x7f6298139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:01.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f6295e00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 0x7f629815a130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6288001eb0 tx=0x7f628800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288005d90 con 0x7f62980b34b0 2024-09-13T15:09:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62880070d0 con 0x7f62980b34b0 2024-09-13T15:09:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288007440 con 0x7f62980b34b0 2024-09-13T15:09:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629815cae0 con 0x7f62980b34b0 2024-09-13T15:09:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629815d0a0 con 0x7f62980b34b0 2024-09-13T15:09:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.036+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629814d3d0 con 0x7f62980b34b0 2024-09-13T15:09:01.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.040+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62880075a0 con 0x7f62980b34b0 2024-09-13T15:09:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.040+0000 7f628e000700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6278066780 0x7f6278068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.040+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f62880831c0 con 0x7f62980b34b0 2024-09-13T15:09:01.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.040+0000 7f6295400700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6278066780 0x7f6278068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.040+0000 7f6295400700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6278066780 0x7f6278068c40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6298142f60 tx=0x7f6284008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.048+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6288050860 con 0x7f62980b34b0 2024-09-13T15:09:01.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.300+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f62980b3a30 con 0x7f62980b34b0 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.300+0000 7f628e000700 1 -- 172.21.15.50:0/3872074426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6288053e80 con 0x7f62980b34b0 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-13T15:09:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w==", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ==", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw==", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ==", 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-13T15:09:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw==", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw==", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g==", 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-13T15:09:01.309 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg==", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg==", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.310 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw==", 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA==", 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g==", 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.312 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg==", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:01.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A==", 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.314 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw==", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g==", 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.315 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORmfQGsHhAAoWi5rerqSyo7H67168RTZw==", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:01.316 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAhVeRm6EYgGxAA0/KSd62V3VwC6EfFSkE/Wg==", 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAhVeRmg1cgGxAAZr3hjEh2CgLd4NuQHlPgoA==", 2024-09-13T15:09:01.317 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAhVeRmfWMgGxAAvmQ7CwJQt20+IHHjJhm7yA==", 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.318 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAhVeRmXG8gGxAAjRkCe9Bsdy+WPQQ6AkkSmA==", 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAhVeRmPHsgGxAA15y0HGULiha1D4A6fl59Ng==", 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.319 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAhVeRm/IcgGxAANwHbI3rOwobuuYIo7D/Lqw==", 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg==", 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w==", 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:09:01.321 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:09:01.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6278066780 msgr2=0x7f6278068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6278066780 0x7f6278068c40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6298142f60 tx=0x7f6284008040 comp rx=0 tx=0).stop 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 msgr2=0x7f629815a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 0x7f629815a130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6288001eb0 tx=0x7f628800c7b0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 shutdown_connections 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6278066780 0x7f6278068c40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62980ceaf0 0x7f6298139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62980b3fa0 0x7f62981f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 --2- 172.21.15.50:0/3872074426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62980b34b0 0x7f629815a130 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 >> 172.21.15.50:0/3872074426 conn(0x7f629806e660 msgr2=0x7f62980b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 shutdown_connections 2024-09-13T15:09:01.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.304+0000 7f629ce00700 1 -- 172.21.15.50:0/3872074426 wait complete. 2024-09-13T15:09:01.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T15:09:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 Processor -- start 2024-09-13T15:09:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 -- start start 2024-09-13T15:09:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f51401610b0 0x7f51400719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514006aaa0 0x7f514006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51400b3560 con 0x7f51400b2670 2024-09-13T15:09:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5140070b30 con 0x7f51401610b0 2024-09-13T15:09:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.508+0000 7f5145400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514006b420 con 0x7f514006aaa0 2024-09-13T15:09:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f5137e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514006aaa0 0x7f514006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f51401610b0 0x7f51400719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f5144a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f51400b2670 0x7f51400cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52314/0 (socket says 172.21.15.50:52314) 2024-09-13T15:09:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f5144a00700 1 -- 172.21.15.50:0/1102578364 learned_addr learned my addr 172.21.15.50:0/1102578364 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513fe00700 1 -- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514006aaa0 msgr2=0x7f514006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513fe00700 1 --2- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514006aaa0 0x7f514006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513fe00700 1 -- 172.21.15.50:0/1102578364 >> v1:172.21.15.50:6789/0 conn(0x7f51400b2670 legacy=0x7f51400cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513fe00700 1 -- 172.21.15.50:0/1102578364 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400b3280 con 0x7f51401610b0 2024-09-13T15:09:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513f400700 1 -- 172.21.15.50:0/1102578364 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022149527 0 0) 0x7f51400b3560 con 0x7f51400b2670 2024-09-13T15:09:01.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513fe00700 1 --2- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51401610b0 0x7f51400719c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5130009850 tx=0x7f5130009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d58a385774d46e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513f400700 1 -- 172.21.15.50:0/1102578364 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130011830 con 0x7f51401610b0 2024-09-13T15:09:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513f400700 1 -- 172.21.15.50:0/1102578364 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5130011990 con 0x7f51401610b0 2024-09-13T15:09:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.512+0000 7f513f400700 1 -- 172.21.15.50:0/1102578364 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130011d40 con 0x7f51401610b0 2024-09-13T15:09:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 -- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51401610b0 msgr2=0x7f51400719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 --2- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51401610b0 0x7f51400719c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5130009850 tx=0x7f5130009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 -- 172.21.15.50:0/1102578364 shutdown_connections 2024-09-13T15:09:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 --2- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f514006aaa0 0x7f514006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 --2- 172.21.15.50:0/1102578364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51401610b0 0x7f51400719c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 -- 172.21.15.50:0/1102578364 >> 172.21.15.50:0/1102578364 conn(0x7f51400b0c40 msgr2=0x7f514006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 -- 172.21.15.50:0/1102578364 shutdown_connections 2024-09-13T15:09:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 -- 172.21.15.50:0/1102578364 wait complete. 2024-09-13T15:09:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 Processor -- start 2024-09-13T15:09:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.516+0000 7f5145400700 1 -- start start 2024-09-13T15:09:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514006aaa0 0x7f51401626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 0x7f5140157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51401610b0 0x7f5140164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51401f6910 con 0x7f51400b2670 2024-09-13T15:09:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51401f6bf0 con 0x7f514006aaa0 2024-09-13T15:09:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51401f6ed0 con 0x7f51401610b0 2024-09-13T15:09:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 0x7f5140157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 0x7f5140157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56012/0 (socket says 172.21.15.50:56012) 2024-09-13T15:09:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 -- 172.21.15.50:0/2487364866 learned_addr learned my addr 172.21.15.50:0/2487364866 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f513fe00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514006aaa0 0x7f51401626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5144a00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51401610b0 0x7f5140164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 -- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51401610b0 msgr2=0x7f5140164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51401610b0 0x7f5140164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 -- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514006aaa0 msgr2=0x7f51401626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514006aaa0 0x7f51401626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 -- 172.21.15.50:0/2487364866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300094b0 con 0x7f51400b2670 2024-09-13T15:09:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5137e00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 0x7f5140157a60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f512800e9d0 tx=0x7f512800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128009720 con 0x7f51400b2670 2024-09-13T15:09:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800ee70 con 0x7f51400b2670 2024-09-13T15:09:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51401f71b0 con 0x7f51400b2670 2024-09-13T15:09:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800ca50 con 0x7f51400b2670 2024-09-13T15:09:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.520+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51401f7770 con 0x7f51400b2670 2024-09-13T15:09:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.524+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5140161490 con 0x7f51400b2670 2024-09-13T15:09:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.524+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f512800cbb0 con 0x7f51400b2670 2024-09-13T15:09:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.528+0000 7f513cc00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f511c066730 0x7f511c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.528+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5128083f60 con 0x7f51400b2670 2024-09-13T15:09:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.528+0000 7f513fe00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f511c066730 0x7f511c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.528+0000 7f513fe00700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f511c066730 0x7f511c068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f51300090b0 tx=0x7f513001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.532+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51280514d0 con 0x7f51400b2670 2024-09-13T15:09:01.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.776+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f51400cd0d0 con 0x7f51400b2670 2024-09-13T15:09:01.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.784+0000 7f513cc00700 1 -- 172.21.15.50:0/2487364866 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f512800ce60 con 0x7f51400b2670 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f511c066730 msgr2=0x7f511c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f511c066730 0x7f511c068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f51300090b0 tx=0x7f513001c040 comp rx=0 tx=0).stop 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 msgr2=0x7f5140157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 0x7f5140157a60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f512800e9d0 tx=0x7f512800ece0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 shutdown_connections 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f511c066730 0x7f511c068bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51401610b0 0x7f5140164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51400b2670 0x7f5140157a60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 --2- 172.21.15.50:0/2487364866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f514006aaa0 0x7f51401626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 >> 172.21.15.50:0/2487364866 conn(0x7f51400b0c40 msgr2=0x7f514015f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:01.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 shutdown_connections 2024-09-13T15:09:01.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.788+0000 7f5145400700 1 -- 172.21.15.50:0/2487364866 wait complete. 2024-09-13T15:09:01.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T15:09:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 Processor -- start 2024-09-13T15:09:01.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 -- start start 2024-09-13T15:09:01.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feb2c15cd90 0x7feb2c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb2c15d170 0x7feb2c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0d1390 con 0x7feb2c0cde10 2024-09-13T15:09:01.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0b2530 con 0x7feb2c15d170 2024-09-13T15:09:01.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.984+0000 7feb33000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0d05f0 con 0x7feb2c15cd90 2024-09-13T15:09:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb2c15d170 0x7feb2c0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb32600700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feb2c0cde10 0x7feb2c0ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:49946/0 (socket says 172.21.15.50:49946) 2024-09-13T15:09:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb32600700 1 -- 172.21.15.50:0/1478291091 learned_addr learned my addr 172.21.15.50:0/1478291091 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31c00700 1 --2- 172.21.15.50:0/1478291091 >> v2:172.21.15.181:3300/0 conn(0x7feb2c15cd90 0x7feb2c0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31200700 1 -- 172.21.15.50:0/1478291091 >> v2:172.21.15.181:3300/0 conn(0x7feb2c15cd90 msgr2=0x7feb2c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:01.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31200700 1 --2- 172.21.15.50:0/1478291091 >> v2:172.21.15.181:3300/0 conn(0x7feb2c15cd90 0x7feb2c0b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31200700 1 -- 172.21.15.50:0/1478291091 >> v1:172.21.15.181:6789/0 conn(0x7feb2c0cde10 legacy=0x7feb2c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31200700 1 -- 172.21.15.50:0/1478291091 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0d1670 con 0x7feb2c15d170 2024-09-13T15:09:01.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb31200700 1 --2- 172.21.15.50:0/1478291091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c0cd8d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb2c073750 tx=0x7feb18009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836f83d20eb2e311 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:01.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb2be00700 1 -- 172.21.15.50:0/1478291091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18011830 con 0x7feb2c15d170 2024-09-13T15:09:01.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb2be00700 1 -- 172.21.15.50:0/1478291091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18011990 con 0x7feb2c15d170 2024-09-13T15:09:01.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb2be00700 1 -- 172.21.15.50:0/1478291091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18011d20 con 0x7feb2c15d170 2024-09-13T15:09:01.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 -- 172.21.15.50:0/1478291091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 msgr2=0x7feb2c0cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:01.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 --2- 172.21.15.50:0/1478291091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c0cd8d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb2c073750 tx=0x7feb18009b30 comp rx=0 tx=0).stop 2024-09-13T15:09:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 -- 172.21.15.50:0/1478291091 shutdown_connections 2024-09-13T15:09:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 --2- 172.21.15.50:0/1478291091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c0cd8d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 --2- 172.21.15.50:0/1478291091 >> v2:172.21.15.181:3300/0 conn(0x7feb2c15cd90 0x7feb2c0b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 -- 172.21.15.50:0/1478291091 >> 172.21.15.50:0/1478291091 conn(0x7feb2c0d2c10 msgr2=0x7feb2c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 -- 172.21.15.50:0/1478291091 shutdown_connections 2024-09-13T15:09:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.988+0000 7feb33000700 1 -- 172.21.15.50:0/1478291091 wait complete. 2024-09-13T15:09:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 Processor -- start 2024-09-13T15:09:01.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 -- start start 2024-09-13T15:09:01.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb2c0cde10 0x7feb2c0b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb2c15cd90 0x7feb2c0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cadf0 con 0x7feb2c15d170 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cc9c0 con 0x7feb2c0cde10 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb33000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0ca730 con 0x7feb2c15cd90 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb32600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb32600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56036/0 (socket says 172.21.15.50:56036) 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb32600700 1 -- 172.21.15.50:0/2867052964 learned_addr learned my addr 172.21.15.50:0/2867052964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb31200700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb2c15cd90 0x7feb2c0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.992+0000 7feb31c00700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb2c0cde10 0x7feb2c0b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb31200700 1 -- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb2c0cde10 msgr2=0x7feb2c0b8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb31200700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb2c0cde10 0x7feb2c0b8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb31200700 1 -- 172.21.15.50:0/2867052964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 msgr2=0x7feb2c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb31200700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb31200700 1 -- 172.21.15.50:0/2867052964 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180094b0 con 0x7feb2c15cd90 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb31200700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb2c15cd90 0x7feb2c0b36c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feb18016000 tx=0x7feb18004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18004610 con 0x7feb2c15cd90 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1801e070 con 0x7feb2c15cd90 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18003900 con 0x7feb2c15cd90 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c0caa10 con 0x7feb2c15cd90 2024-09-13T15:09:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c1597a0 con 0x7feb2c15cd90 2024-09-13T15:09:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:01.996+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c159930 con 0x7feb2c15cd90 2024-09-13T15:09:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.000+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb18003a60 con 0x7feb2c15cd90 2024-09-13T15:09:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.000+0000 7feb29600700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb0c0667b0 0x7feb0c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.000+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7feb18084c50 con 0x7feb2c15cd90 2024-09-13T15:09:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.000+0000 7feb31c00700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb0c0667b0 0x7feb0c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.004+0000 7feb31c00700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb0c0667b0 0x7feb0c068c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feb20009bf0 tx=0x7feb20009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.008+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb18052240 con 0x7feb2c15cd90 2024-09-13T15:09:02.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.272+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7feb2c0caf30 con 0x7feb2c15cd90 2024-09-13T15:09:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.284+0000 7feb29600700 1 -- 172.21.15.50:0/2867052964 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7feb2c0caf30 con 0x7feb2c15cd90 2024-09-13T15:09:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb0c0667b0 msgr2=0x7feb0c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb0c0667b0 0x7feb0c068c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feb20009bf0 tx=0x7feb20009240 comp rx=0 tx=0).stop 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb2c15cd90 msgr2=0x7feb2c0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb2c15cd90 0x7feb2c0b36c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feb18016000 tx=0x7feb18004770 comp rx=0 tx=0).stop 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 shutdown_connections 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb0c0667b0 0x7feb0c068c70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb2c15d170 0x7feb2c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb2c15cd90 0x7feb2c0b36c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 --2- 172.21.15.50:0/2867052964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb2c0cde10 0x7feb2c0b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 >> 172.21.15.50:0/2867052964 conn(0x7feb2c0d2c10 msgr2=0x7feb2c0af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 shutdown_connections 2024-09-13T15:09:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.288+0000 7feb33000700 1 -- 172.21.15.50:0/2867052964 wait complete. 2024-09-13T15:09:02.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T15:09:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 Processor -- start 2024-09-13T15:09:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 -- start start 2024-09-13T15:09:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c15e070 0x7faf4c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faf4c0b2c50 0x7faf4c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0cd970 con 0x7faf4c0d10f0 2024-09-13T15:09:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c15e450 con 0x7faf4c0b2c50 2024-09-13T15:09:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf51600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0d0050 con 0x7faf4c15e070 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf4b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faf4c0d10f0 0x7faf4c0b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52318/0 (socket says 172.21.15.50:52318) 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf4b400700 1 -- 172.21.15.50:0/2577951878 learned_addr learned my addr 172.21.15.50:0/2577951878 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf50c00700 1 --2- 172.21.15.50:0/2577951878 >> v2:172.21.15.181:3300/0 conn(0x7faf4c0b2c50 0x7faf4c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf4be00700 1 --2- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c15e070 0x7faf4c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf4aa00700 1 -- 172.21.15.50:0/2577951878 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956140729 0 0) 0x7faf38001110 con 0x7faf4c0d10f0 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf4aa00700 1 -- 172.21.15.50:0/2577951878 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf300035d0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf50c00700 1 -- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c15e070 msgr2=0x7faf4c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.500+0000 7faf50c00700 1 --2- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c15e070 0x7faf4c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf50c00700 1 -- 172.21.15.50:0/2577951878 >> v1:172.21.15.50:6789/0 conn(0x7faf4c0d10f0 legacy=0x7faf4c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf50c00700 1 -- 172.21.15.50:0/2577951878 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0d0330 con 0x7faf4c0b2c50 2024-09-13T15:09:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf50c00700 1 --2- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c0b2c50 0x7faf4c0b38b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf44009d90 tx=0x7faf4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46b17e30c2e29aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf4aa00700 1 -- 172.21.15.50:0/2577951878 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4400e070 con 0x7faf4c0b2c50 2024-09-13T15:09:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf4aa00700 1 -- 172.21.15.50:0/2577951878 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4400bb20 con 0x7faf4c0b2c50 2024-09-13T15:09:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf4aa00700 1 -- 172.21.15.50:0/2577951878 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44012430 con 0x7faf4c0b2c50 2024-09-13T15:09:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 -- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c0b2c50 msgr2=0x7faf4c0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 --2- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c0b2c50 0x7faf4c0b38b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf44009d90 tx=0x7faf4400b330 comp rx=0 tx=0).stop 2024-09-13T15:09:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 -- 172.21.15.50:0/2577951878 shutdown_connections 2024-09-13T15:09:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 --2- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c0b2c50 0x7faf4c0b38b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 --2- 172.21.15.50:0/2577951878 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c15e070 0x7faf4c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 -- 172.21.15.50:0/2577951878 >> 172.21.15.50:0/2577951878 conn(0x7faf4c071f00 msgr2=0x7faf4c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 -- 172.21.15.50:0/2577951878 shutdown_connections 2024-09-13T15:09:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.504+0000 7faf51600700 1 -- 172.21.15.50:0/2577951878 wait complete. 2024-09-13T15:09:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 Processor -- start 2024-09-13T15:09:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 -- start start 2024-09-13T15:09:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c0b2c50 0x7faf4c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 0x7faf4c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c15e070 0x7faf4c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c9fc0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c5da0 con 0x7faf4c15e070 2024-09-13T15:09:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf51600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c9340 con 0x7faf4c0b2c50 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 0x7faf4c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 0x7faf4c0ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56038/0 (socket says 172.21.15.50:56038) 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 -- 172.21.15.50:0/1642464607 learned_addr learned my addr 172.21.15.50:0/1642464607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf50c00700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c15e070 0x7faf4c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4be00700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c0b2c50 0x7faf4c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 -- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c0b2c50 msgr2=0x7faf4c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c0b2c50 0x7faf4c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 -- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c15e070 msgr2=0x7faf4c152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c15e070 0x7faf4c152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.508+0000 7faf4b400700 1 -- 172.21.15.50:0/1642464607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44009a70 con 0x7faf4c0d10f0 2024-09-13T15:09:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf4b400700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 0x7faf4c0ca3e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faf38001270 tx=0x7faf3800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38005d90 con 0x7faf4c0d10f0 2024-09-13T15:09:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf380070d0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c0c9620 con 0x7faf4c0d10f0 2024-09-13T15:09:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38007480 con 0x7faf4c0d10f0 2024-09-13T15:09:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c0c9be0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.512+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c0afdc0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.516+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf380075e0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.516+0000 7faf43e00700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf2c066730 0x7faf2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.516+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7faf38083250 con 0x7faf4c0d10f0 2024-09-13T15:09:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.516+0000 7faf4be00700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf2c066730 0x7faf2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.516+0000 7faf4be00700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf2c066730 0x7faf2c068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009b50 tx=0x7faf3c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.520+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf38050730 con 0x7faf4c0d10f0 2024-09-13T15:09:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.768+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7faf4c0c9da0 con 0x7faf4c0d10f0 2024-09-13T15:09:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.776+0000 7faf43e00700 1 -- 172.21.15.50:0/1642464607 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7faf38053d50 con 0x7faf4c0d10f0 2024-09-13T15:09:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf2c066730 msgr2=0x7faf2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf2c066730 0x7faf2c068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009b50 tx=0x7faf3c009240 comp rx=0 tx=0).stop 2024-09-13T15:09:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 msgr2=0x7faf4c0ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 0x7faf4c0ca3e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faf38001270 tx=0x7faf3800c7d0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 shutdown_connections 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf2c066730 0x7faf2c068bf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf4c15e070 0x7faf4c152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf4c0d10f0 0x7faf4c0ca3e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 --2- 172.21.15.50:0/1642464607 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf4c0b2c50 0x7faf4c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 >> 172.21.15.50:0/1642464607 conn(0x7faf4c071f00 msgr2=0x7faf4c0b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 shutdown_connections 2024-09-13T15:09:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.780+0000 7faf51600700 1 -- 172.21.15.50:0/1642464607 wait complete. 2024-09-13T15:09:02.807 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T15:09:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 Processor -- start 2024-09-13T15:09:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 -- start start 2024-09-13T15:09:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8f01446c0 0x7ff8f00b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff8f00cc650 0x7ff8f00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f00b4d10 con 0x7ff8f01446c0 2024-09-13T15:09:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f0144aa0 con 0x7ff8f00cc650 2024-09-13T15:09:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8f5000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00b4100 con 0x7ff8f00cfcf0 2024-09-13T15:09:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.988+0000 7ff8ede00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8f01446c0 0x7ff8f00b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8f01446c0 0x7ff8f00b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56050/0 (socket says 172.21.15.50:56050) 2024-09-13T15:09:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 -- 172.21.15.50:0/3684959551 learned_addr learned my addr 172.21.15.50:0/3684959551 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ee800700 1 --2- 172.21.15.50:0/3684959551 >> v2:172.21.15.181:3300/0 conn(0x7ff8f00cc650 0x7ff8f00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ed400700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 -- 172.21.15.50:0/3684959551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 msgr2=0x7ff8f00cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 -- 172.21.15.50:0/3684959551 >> v2:172.21.15.181:3300/0 conn(0x7ff8f00cc650 msgr2=0x7ff8f00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 --2- 172.21.15.50:0/3684959551 >> v2:172.21.15.181:3300/0 conn(0x7ff8f00cc650 0x7ff8f00d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 -- 172.21.15.50:0/3684959551 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00b43e0 con 0x7ff8f01446c0 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ee800700 1 --2- 172.21.15.50:0/3684959551 >> v2:172.21.15.181:3300/0 conn(0x7ff8f00cc650 0x7ff8f00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ed400700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8ede00700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f00b3a70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006f510 tx=0x7ff8e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcc2724690bc2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8eca00700 1 -- 172.21.15.50:0/3684959551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0011830 con 0x7ff8f01446c0 2024-09-13T15:09:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8eca00700 1 -- 172.21.15.50:0/3684959551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0011990 con 0x7ff8f01446c0 2024-09-13T15:09:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8eca00700 1 -- 172.21.15.50:0/3684959551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0011d20 con 0x7ff8f01446c0 2024-09-13T15:09:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 -- 172.21.15.50:0/3684959551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 msgr2=0x7ff8f00b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f00b3a70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006f510 tx=0x7ff8e0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 -- 172.21.15.50:0/3684959551 shutdown_connections 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3684959551 >> v2:172.21.15.181:3300/0 conn(0x7ff8f00cc650 0x7ff8f00d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3684959551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f00b3a70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 -- 172.21.15.50:0/3684959551 >> 172.21.15.50:0/3684959551 conn(0x7ff8f00726d0 msgr2=0x7ff8f006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 -- 172.21.15.50:0/3684959551 shutdown_connections 2024-09-13T15:09:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.992+0000 7ff8f5000700 1 -- 172.21.15.50:0/3684959551 wait complete. 2024-09-13T15:09:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.996+0000 7ff8f5000700 1 Processor -- start 2024-09-13T15:09:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:02.996+0000 7ff8f5000700 1 -- start start 2024-09-13T15:09:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8f00cc650 0x7ff8f00afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f01f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f015d490 con 0x7ff8f01446c0 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01e9bd0 con 0x7ff8f00cc650 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0140210 con 0x7ff8f00cfcf0 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f01f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f01f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56060/0 (socket says 172.21.15.50:56060) 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 -- 172.21.15.50:0/3311857897 learned_addr learned my addr 172.21.15.50:0/3311857897 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ede00700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8f00cc650 0x7ff8f00afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ed400700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 -- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 msgr2=0x7ff8f00b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 -- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8f00cc650 msgr2=0x7ff8f00afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8f00cc650 0x7ff8f00afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 -- 172.21.15.50:0/3311857897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8009a70 con 0x7ff8f01446c0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8ee800700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f01f2ff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800eed0 tx=0x7ff8e800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8010040 con 0x7ff8f01446c0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800bb30 con 0x7ff8f01446c0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e0009570 con 0x7ff8f01446c0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8003a40 con 0x7ff8f01446c0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.000+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f013f970 con 0x7ff8f01446c0 2024-09-13T15:09:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.004+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f01408e0 con 0x7ff8f01446c0 2024-09-13T15:09:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.004+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8e801d460 con 0x7ff8f01446c0 2024-09-13T15:09:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.004+0000 7ff8e6000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8d0066760 0x7ff8d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.004+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff8e8084140 con 0x7ff8f01446c0 2024-09-13T15:09:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.008+0000 7ff8ede00700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8d0066760 0x7ff8d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.008+0000 7ff8ede00700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8d0066760 0x7ff8d0068c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0000c00 tx=0x7ff8e0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.012+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8f01408e0 con 0x7ff8f01446c0 2024-09-13T15:09:03.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.256+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff8f01408e0 con 0x7ff8f01446c0 2024-09-13T15:09:03.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.260+0000 7ff8e6000700 1 -- 172.21.15.50:0/3311857897 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff8f01408e0 con 0x7ff8f01446c0 2024-09-13T15:09:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8d0066760 msgr2=0x7ff8d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8d0066760 0x7ff8d0068c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0000c00 tx=0x7ff8e0008030 comp rx=0 tx=0).stop 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 msgr2=0x7ff8f01f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f01f2ff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800eed0 tx=0x7ff8e800b390 comp rx=0 tx=0).stop 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 shutdown_connections 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8d0066760 0x7ff8d0068c20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f01446c0 0x7ff8f01f2ff0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8f00cfcf0 0x7ff8f00b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 --2- 172.21.15.50:0/3311857897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8f00cc650 0x7ff8f00afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 >> 172.21.15.50:0/3311857897 conn(0x7ff8f00726d0 msgr2=0x7ff8f006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 shutdown_connections 2024-09-13T15:09:03.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.264+0000 7ff8f5000700 1 -- 172.21.15.50:0/3311857897 wait complete. 2024-09-13T15:09:03.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T15:09:03.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 Processor -- start 2024-09-13T15:09:03.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 -- start start 2024-09-13T15:09:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 0x7fad2806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad2806a390 0x7fad280b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2806a890 con 0x7fad28072610 2024-09-13T15:09:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2806ab70 con 0x7fad2806a390 2024-09-13T15:09:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.468+0000 7fad2e000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2806ae50 con 0x7fad281599f0 2024-09-13T15:09:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad2806a390 0x7fad280b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad27400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 0x7fad2806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad27400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 0x7fad2806b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49942/0 (socket says 172.21.15.50:49942) 2024-09-13T15:09:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad27400700 1 -- 172.21.15.50:0/554261297 learned_addr learned my addr 172.21.15.50:0/554261297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad27e00700 1 --1- 172.21.15.50:0/554261297 >> v1:172.21.15.181:6789/0 conn(0x7fad28072610 0x7fad2815d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:55612/0 (socket says 172.21.15.50:55612) 2024-09-13T15:09:03.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26000700 1 -- 172.21.15.50:0/554261297 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502536139 0 0) 0x7fad2806a890 con 0x7fad28072610 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26000700 1 -- 172.21.15.50:0/554261297 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0c0035d0 con 0x7fad28072610 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26a00700 1 -- 172.21.15.50:0/554261297 >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 msgr2=0x7fad2806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26a00700 1 --2- 172.21.15.50:0/554261297 >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 0x7fad2806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26a00700 1 -- 172.21.15.50:0/554261297 >> v1:172.21.15.181:6789/0 conn(0x7fad28072610 legacy=0x7fad2815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26a00700 1 -- 172.21.15.50:0/554261297 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2806b130 con 0x7fad2806a390 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad27400700 1 --2- 172.21.15.50:0/554261297 >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 0x7fad2806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26a00700 1 --2- 172.21.15.50:0/554261297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad2806a390 0x7fad280b3820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fad2806bf60 tx=0x7fad14009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb5c8fb46662289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26000700 1 -- 172.21.15.50:0/554261297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14011830 con 0x7fad2806a390 2024-09-13T15:09:03.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26000700 1 -- 172.21.15.50:0/554261297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14011990 con 0x7fad2806a390 2024-09-13T15:09:03.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.472+0000 7fad26000700 1 -- 172.21.15.50:0/554261297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14011d00 con 0x7fad2806a390 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 -- 172.21.15.50:0/554261297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad2806a390 msgr2=0x7fad280b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 --2- 172.21.15.50:0/554261297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad2806a390 0x7fad280b3820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fad2806bf60 tx=0x7fad14009b30 comp rx=0 tx=0).stop 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 -- 172.21.15.50:0/554261297 shutdown_connections 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 --2- 172.21.15.50:0/554261297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad2806a390 0x7fad280b3820 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 --2- 172.21.15.50:0/554261297 >> v2:172.21.15.181:3300/0 conn(0x7fad281599f0 0x7fad2806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 -- 172.21.15.50:0/554261297 >> 172.21.15.50:0/554261297 conn(0x7fad280b1e00 msgr2=0x7fad280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 -- 172.21.15.50:0/554261297 shutdown_connections 2024-09-13T15:09:03.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.476+0000 7fad2e000700 1 -- 172.21.15.50:0/554261297 wait complete. 2024-09-13T15:09:03.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 Processor -- start 2024-09-13T15:09:03.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 -- start start 2024-09-13T15:09:03.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad2806a390 0x7fad2814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 0x7fad281e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad281599f0 0x7fad2813d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2813d9c0 con 0x7fad28072610 2024-09-13T15:09:03.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2814dbd0 con 0x7fad281599f0 2024-09-13T15:09:03.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad2e000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2814deb0 con 0x7fad2806a390 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 0x7fad281e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 0x7fad281e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47584/0 (socket says 172.21.15.50:47584) 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 -- 172.21.15.50:0/834751290 learned_addr learned my addr 172.21.15.50:0/834751290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad27400700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad2806a390 0x7fad2814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad27e00700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad281599f0 0x7fad2813d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 -- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad2806a390 msgr2=0x7fad2814d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad2806a390 0x7fad2814d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 -- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad281599f0 msgr2=0x7fad2813d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad281599f0 0x7fad2813d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 -- 172.21.15.50:0/834751290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009570 con 0x7fad28072610 2024-09-13T15:09:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad27e00700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad281599f0 0x7fad2813d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:03.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.480+0000 7fad26a00700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 0x7fad281e1fa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad14009b70 tx=0x7fad14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad140045d0 con 0x7fad28072610 2024-09-13T15:09:03.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1401f070 con 0x7fad28072610 2024-09-13T15:09:03.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad140038c0 con 0x7fad28072610 2024-09-13T15:09:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad140094b0 con 0x7fad28072610 2024-09-13T15:09:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2814e470 con 0x7fad28072610 2024-09-13T15:09:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2806b930 con 0x7fad28072610 2024-09-13T15:09:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.484+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad14003a20 con 0x7fad28072610 2024-09-13T15:09:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.488+0000 7fad1f400700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fad08066730 0x7fad08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.488+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fad14021070 con 0x7fad28072610 2024-09-13T15:09:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.488+0000 7fad27400700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fad08066730 0x7fad08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.488+0000 7fad27400700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fad08066730 0x7fad08068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad2813dcb0 tx=0x7fad18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.492+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad14052e30 con 0x7fad28072610 2024-09-13T15:09:03.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.740+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fad28067730 con 0x7fad28072610 2024-09-13T15:09:03.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.748+0000 7fad1f400700 1 -- 172.21.15.50:0/834751290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fad140150a0 con 0x7fad28072610 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fad08066730 msgr2=0x7fad08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fad08066730 0x7fad08068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad2813dcb0 tx=0x7fad18008040 comp rx=0 tx=0).stop 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 msgr2=0x7fad281e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 0x7fad281e1fa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad14009b70 tx=0x7fad14004770 comp rx=0 tx=0).stop 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 shutdown_connections 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fad08066730 0x7fad08068bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad281599f0 0x7fad2813d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad28072610 0x7fad281e1fa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 --2- 172.21.15.50:0/834751290 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fad2806a390 0x7fad2814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 >> 172.21.15.50:0/834751290 conn(0x7fad280b1e00 msgr2=0x7fad280b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 shutdown_connections 2024-09-13T15:09:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.752+0000 7fad2e000700 1 -- 172.21.15.50:0/834751290 wait complete. 2024-09-13T15:09:03.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T15:09:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.956+0000 7f3682a00700 1 Processor -- start 2024-09-13T15:09:03.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.956+0000 7f3682a00700 1 -- start start 2024-09-13T15:09:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 0x7f367c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 0x7f367c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c070d80 con 0x7f367c15ba90 2024-09-13T15:09:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c0cf550 con 0x7f367c0667a0 2024-09-13T15:09:03.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c070fd0 con 0x7f367c0aedd0 2024-09-13T15:09:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 0x7f367c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 0x7f367c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 0x7f367c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:49962/0 (socket says 172.21.15.50:49962) 2024-09-13T15:09:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682000700 1 -- 172.21.15.50:0/3166547090 learned_addr learned my addr 172.21.15.50:0/3166547090 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 0x7f367c0cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58798/0 (socket says 172.21.15.50:58798) 2024-09-13T15:09:03.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3680c00700 1 --1- 172.21.15.50:0/3166547090 >> v1:172.21.15.181:6789/0 conn(0x7f367c15ba90 0x7f367c066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:55624/0 (socket says 172.21.15.50:55624) 2024-09-13T15:09:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 -- 172.21.15.50:0/3166547090 >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 msgr2=0x7f367c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 --2- 172.21.15.50:0/3166547090 >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 0x7f367c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 -- 172.21.15.50:0/3166547090 >> v1:172.21.15.181:6789/0 conn(0x7f367c15ba90 legacy=0x7f367c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 -- 172.21.15.50:0/3166547090 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0712b0 con 0x7f367c0aedd0 2024-09-13T15:09:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3682000700 1 --2- 172.21.15.50:0/3166547090 >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 0x7f367c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:03.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.960+0000 7f3681600700 1 --2- 172.21.15.50:0/3166547090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 0x7f367c0cf010 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3670009d90 tx=0x7f367000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941eb90c89954697 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f367be00700 1 -- 172.21.15.50:0/3166547090 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000e070 con 0x7f367c0aedd0 2024-09-13T15:09:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f367be00700 1 -- 172.21.15.50:0/3166547090 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000bb20 con 0x7f367c0aedd0 2024-09-13T15:09:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f367be00700 1 -- 172.21.15.50:0/3166547090 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670012430 con 0x7f367c0aedd0 2024-09-13T15:09:03.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 -- 172.21.15.50:0/3166547090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 msgr2=0x7f367c0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 --2- 172.21.15.50:0/3166547090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 0x7f367c0cf010 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3670009d90 tx=0x7f367000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 -- 172.21.15.50:0/3166547090 shutdown_connections 2024-09-13T15:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 --2- 172.21.15.50:0/3166547090 >> v2:172.21.15.181:3300/0 conn(0x7f367c0667a0 0x7f367c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 --2- 172.21.15.50:0/3166547090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c0aedd0 0x7f367c0cf010 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 -- 172.21.15.50:0/3166547090 >> 172.21.15.50:0/3166547090 conn(0x7f367c06ca10 msgr2=0x7f367c06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 -- 172.21.15.50:0/3166547090 shutdown_connections 2024-09-13T15:09:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.964+0000 7f3682a00700 1 -- 172.21.15.50:0/3166547090 wait complete. 2024-09-13T15:09:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 Processor -- start 2024-09-13T15:09:03.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 -- start start 2024-09-13T15:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c0667a0 0x7f367c1edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 0x7f367c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c15ba90 0x7f367c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c1ee250 con 0x7f367c0aedd0 2024-09-13T15:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c15c4e0 con 0x7f367c0667a0 2024-09-13T15:09:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c15c7c0 con 0x7f367c15ba90 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3680c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 0x7f367c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3680c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 0x7f367c153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47598/0 (socket says 172.21.15.50:47598) 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3682000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c15ba90 0x7f367c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3680c00700 1 -- 172.21.15.50:0/2755940964 learned_addr learned my addr 172.21.15.50:0/2755940964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.968+0000 7f3681600700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c0667a0 0x7f367c1edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3680c00700 1 -- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c15ba90 msgr2=0x7f367c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3680c00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c15ba90 0x7f367c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3680c00700 1 -- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c0667a0 msgr2=0x7f367c1edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3680c00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c0667a0 0x7f367c1edd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3680c00700 1 -- 172.21.15.50:0/2755940964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674009570 con 0x7f367c0aedd0 2024-09-13T15:09:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3680c00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 0x7f367c153f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f366800c460 tx=0x7f366800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668005cd0 con 0x7f367c0aedd0 2024-09-13T15:09:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668005e30 con 0x7f367c0aedd0 2024-09-13T15:09:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3670009a70 con 0x7f367c0aedd0 2024-09-13T15:09:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680072d0 con 0x7f367c0aedd0 2024-09-13T15:09:03.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c15cd80 con 0x7f367c0aedd0 2024-09-13T15:09:03.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.972+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c06aa50 con 0x7f367c0aedd0 2024-09-13T15:09:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.976+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3668007430 con 0x7f367c0aedd0 2024-09-13T15:09:03.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.976+0000 7f3679600700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f365c066730 0x7f365c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.976+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f36680831e0 con 0x7f367c0aedd0 2024-09-13T15:09:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.976+0000 7f3681600700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f365c066730 0x7f365c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.980+0000 7f3681600700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f365c066730 0x7f365c068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f367000b370 tx=0x7f3670011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:03.984+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3668050770 con 0x7f367c0aedd0 2024-09-13T15:09:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.228+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f367c0cdc20 con 0x7f367c0aedd0 2024-09-13T15:09:04.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.236+0000 7f3679600700 1 -- 172.21.15.50:0/2755940964 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3668053d90 con 0x7f367c0aedd0 2024-09-13T15:09:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f365c066730 msgr2=0x7f365c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f365c066730 0x7f365c068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f367000b370 tx=0x7f3670011000 comp rx=0 tx=0).stop 2024-09-13T15:09:04.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 msgr2=0x7f367c153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 0x7f367c153f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f366800c460 tx=0x7f366800c770 comp rx=0 tx=0).stop 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 shutdown_connections 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f365c066730 0x7f365c068bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f367c15ba90 0x7f367c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f367c0aedd0 0x7f367c153f20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 --2- 172.21.15.50:0/2755940964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c0667a0 0x7f367c1edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 >> 172.21.15.50:0/2755940964 conn(0x7f367c06ca10 msgr2=0x7f367c0cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 shutdown_connections 2024-09-13T15:09:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.240+0000 7f3682a00700 1 -- 172.21.15.50:0/2755940964 wait complete. 2024-09-13T15:09:04.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 Processor -- start 2024-09-13T15:09:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 -- start start 2024-09-13T15:09:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc15e070 0x7fd4bc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4bc0d10f0 0x7fd4bc0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd4bc0d1510 0x7fd4bc0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0cd970 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc15e450 con 0x7fd4bc0d1510 2024-09-13T15:09:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0d0050 con 0x7fd4bc15e070 2024-09-13T15:09:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4bc0d10f0 0x7fd4bc0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc15e070 0x7fd4bc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4bc0d10f0 0x7fd4bc0b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47604/0 (socket says 172.21.15.50:47604) 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 -- 172.21.15.50:0/1605738318 learned_addr learned my addr 172.21.15.50:0/1605738318 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c2800700 1 --2- 172.21.15.50:0/1605738318 >> v2:172.21.15.181:3300/0 conn(0x7fd4bc0d1510 0x7fd4bc0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 -- 172.21.15.50:0/1605738318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc15e070 msgr2=0x7fd4bc0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 --2- 172.21.15.50:0/1605738318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc15e070 0x7fd4bc0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 -- 172.21.15.50:0/1605738318 >> v2:172.21.15.181:3300/0 conn(0x7fd4bc0d1510 msgr2=0x7fd4bc0b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 --2- 172.21.15.50:0/1605738318 >> v2:172.21.15.181:3300/0 conn(0x7fd4bc0d1510 0x7fd4bc0b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.436+0000 7fd4c1400700 1 -- 172.21.15.50:0/1605738318 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0d0330 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c1400700 1 --2- 172.21.15.50:0/1605738318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b2540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc072ab0 tx=0x7fd4ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f34060c6423efd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c0a00700 1 -- 172.21.15.50:0/1605738318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac011830 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c0a00700 1 -- 172.21.15.50:0/1605738318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac011990 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c0a00700 1 -- 172.21.15.50:0/1605738318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac011d20 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 -- 172.21.15.50:0/1605738318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 msgr2=0x7fd4bc0b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1605738318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b2540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc072ab0 tx=0x7fd4ac009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 -- 172.21.15.50:0/1605738318 shutdown_connections 2024-09-13T15:09:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1605738318 >> v2:172.21.15.181:3300/0 conn(0x7fd4bc0d1510 0x7fd4bc0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1605738318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b2540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1605738318 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc15e070 0x7fd4bc0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 -- 172.21.15.50:0/1605738318 >> 172.21.15.50:0/1605738318 conn(0x7fd4bc071f00 msgr2=0x7fd4bc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:04.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 -- 172.21.15.50:0/1605738318 shutdown_connections 2024-09-13T15:09:04.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.440+0000 7fd4c3200700 1 -- 172.21.15.50:0/1605738318 wait complete. 2024-09-13T15:09:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 Processor -- start 2024-09-13T15:09:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 -- start start 2024-09-13T15:09:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc0d1510 0x7fd4bc145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4bc15e070 0x7fd4bc0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0b62b0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0af9a0 con 0x7fd4bc15e070 2024-09-13T15:09:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0af420 con 0x7fd4bc0d1510 2024-09-13T15:09:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47614/0 (socket says 172.21.15.50:47614) 2024-09-13T15:09:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 -- 172.21.15.50:0/1812612503 learned_addr learned my addr 172.21.15.50:0/1812612503 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1400700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc0d1510 0x7fd4bc145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c2800700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4bc15e070 0x7fd4bc0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 -- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc0d1510 msgr2=0x7fd4bc145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc0d1510 0x7fd4bc145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 -- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4bc15e070 msgr2=0x7fd4bc0c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4bc15e070 0x7fd4bc0c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 -- 172.21.15.50:0/1812612503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac009570 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c2800700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4bc15e070 0x7fd4bc0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.444+0000 7fd4c1e00700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b5d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000ebe0 tx=0x7fd4b000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.448+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0009740 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.448+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b000c850 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.448+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000cbe0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.448+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc1f2740 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.448+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0accf0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.448+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc0cd5d0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.452+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4b000cd40 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.452+0000 7fd4b6000700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd4a0066730 0x7fd4a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.452+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd4b00840c0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.452+0000 7fd4c1400700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd4a0066730 0x7fd4a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.452+0000 7fd4c1400700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd4a0066730 0x7fd4a0068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000c00 tx=0x7fd4ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.460+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4b00515a0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.640+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4bc0c57f0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.644+0000 7fd4b6000700 1 -- 172.21.15.50:0/1812612503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13050 (secure 0 0 0) 0x7fd4b0054bc0 con 0x7fd4bc0d10f0 2024-09-13T15:09:04.647 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:04.648 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:00.805354+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd4a0066730 msgr2=0x7fd4a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd4a0066730 0x7fd4a0068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000c00 tx=0x7fd4ac008030 comp rx=0 tx=0).stop 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 msgr2=0x7fd4bc0b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b5d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000ebe0 tx=0x7fd4b000eef0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 shutdown_connections 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd4a0066730 0x7fd4a0068bf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4bc15e070 0x7fd4bc0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd4bc0d1510 0x7fd4bc145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 --2- 172.21.15.50:0/1812612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4bc0d10f0 0x7fd4bc0b5d70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 >> 172.21.15.50:0/1812612503 conn(0x7fd4bc071f00 msgr2=0x7fd4bc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:04.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 shutdown_connections 2024-09-13T15:09:04.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.648+0000 7fd4c3200700 1 -- 172.21.15.50:0/1812612503 wait complete. 2024-09-13T15:09:04.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:04.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.848+0000 7f7d9da00700 1 Processor -- start 2024-09-13T15:09:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.848+0000 7f7d9da00700 1 -- start start 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.848+0000 7f7d9da00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d980cd850 0x7f7d980ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.848+0000 7f7d9da00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980b57e0 con 0x7f7d9815e030 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.848+0000 7f7d9da00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980b3b80 con 0x7f7d98157500 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.848+0000 7f7d9da00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980b5a80 con 0x7f7d980cd850 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d980cd850 0x7f7d980ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d980cd850 0x7f7d980ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47624/0 (socket says 172.21.15.50:47624) 2024-09-13T15:09:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 -- 172.21.15.50:0/773525237 learned_addr learned my addr 172.21.15.50:0/773525237 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 -- 172.21.15.50:0/773525237 >> v1:172.21.15.181:6789/0 conn(0x7f7d98157500 legacy=0x7f7d98070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 -- 172.21.15.50:0/773525237 >> v1:172.21.15.50:6789/0 conn(0x7f7d9815e030 legacy=0x7f7d980cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d95600700 1 -- 172.21.15.50:0/773525237 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185861345 0 0) 0x7f7d980b57e0 con 0x7f7d9815e030 2024-09-13T15:09:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 -- 172.21.15.50:0/773525237 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980b5d60 con 0x7f7d980cd850 2024-09-13T15:09:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d97400700 1 --2- 172.21.15.50:0/773525237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980cd850 0x7f7d980ce700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009e80 tx=0x7f7d9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca0618b584a079f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d95600700 1 -- 172.21.15.50:0/773525237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000e070 con 0x7f7d980cd850 2024-09-13T15:09:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d95600700 1 -- 172.21.15.50:0/773525237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9000b980 con 0x7f7d980cd850 2024-09-13T15:09:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d95600700 1 -- 172.21.15.50:0/773525237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000bd30 con 0x7f7d980cd850 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 -- 172.21.15.50:0/773525237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980cd850 msgr2=0x7f7d980ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 --2- 172.21.15.50:0/773525237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980cd850 0x7f7d980ce700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009e80 tx=0x7f7d9000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 -- 172.21.15.50:0/773525237 shutdown_connections 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 --2- 172.21.15.50:0/773525237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d980cd850 0x7f7d980ce700 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 -- 172.21.15.50:0/773525237 >> 172.21.15.50:0/773525237 conn(0x7f7d9806e660 msgr2=0x7f7d9806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 -- 172.21.15.50:0/773525237 shutdown_connections 2024-09-13T15:09:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.852+0000 7f7d9da00700 1 -- 172.21.15.50:0/773525237 wait complete. 2024-09-13T15:09:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 Processor -- start 2024-09-13T15:09:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 -- start start 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d980cd850 0x7f7d98152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 0x7f7d981f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d9815e030 0x7f7d9815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98151a80 con 0x7f7d98157500 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98151d60 con 0x7f7d9815e030 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d9da00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98152040 con 0x7f7d980cd850 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 0x7f7d981f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 0x7f7d981f24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47640/0 (socket says 172.21.15.50:47640) 2024-09-13T15:09:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 -- 172.21.15.50:0/2949184867 learned_addr learned my addr 172.21.15.50:0/2949184867 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d97400700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d9815e030 0x7f7d9815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96a00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d980cd850 0x7f7d98152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 -- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d980cd850 msgr2=0x7f7d98152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d980cd850 0x7f7d98152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 -- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d9815e030 msgr2=0x7f7d9815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d9815e030 0x7f7d9815e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96000700 1 -- 172.21.15.50:0/2949184867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009b30 con 0x7f7d98157500 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.856+0000 7f7d96a00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d980cd850 0x7f7d98152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d96000700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 0x7f7d981f24f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d84007fd0 tx=0x7f7d8400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840054e0 con 0x7f7d98157500 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840036a0 con 0x7f7d98157500 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d98152320 con 0x7f7d98157500 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84003a50 con 0x7f7d98157500 2024-09-13T15:09:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9806af50 con 0x7f7d98157500 2024-09-13T15:09:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d980ce700 con 0x7f7d98157500 2024-09-13T15:09:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.860+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d84003bb0 con 0x7f7d98157500 2024-09-13T15:09:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.864+0000 7f7d8ea00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d78066730 0x7f7d78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.864+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7d84083440 con 0x7f7d98157500 2024-09-13T15:09:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.864+0000 7f7d96a00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d78066730 0x7f7d78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.864+0000 7f7d96a00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d78066730 0x7f7d78068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f60 tx=0x7f7d88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:04.868+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d84050920 con 0x7f7d98157500 2024-09-13T15:09:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.052+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d980cd1e0 con 0x7f7d98157500 2024-09-13T15:09:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.052+0000 7f7d8ea00700 1 -- 172.21.15.50:0/2949184867 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d84017020 con 0x7f7d98157500 2024-09-13T15:09:05.056 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d78066730 msgr2=0x7f7d78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d78066730 0x7f7d78068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f60 tx=0x7f7d88009040 comp rx=0 tx=0).stop 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 msgr2=0x7f7d981f24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 0x7f7d981f24f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d84007fd0 tx=0x7f7d8400c7e0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 shutdown_connections 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7d78066730 0x7f7d78068bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d9815e030 0x7f7d9815e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d98157500 0x7f7d981f24f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 --2- 172.21.15.50:0/2949184867 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d980cd850 0x7f7d98152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 >> 172.21.15.50:0/2949184867 conn(0x7f7d9806e660 msgr2=0x7f7d98070380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 shutdown_connections 2024-09-13T15:09:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.056+0000 7f7d9da00700 1 -- 172.21.15.50:0/2949184867 wait complete. 2024-09-13T15:09:05.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:09:05.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.248+0000 7f135ee00700 1 Processor -- start 2024-09-13T15:09:05.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.248+0000 7f135ee00700 1 -- start start 2024-09-13T15:09:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f135815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135ee00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f135815e9f0 0x7f135815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135ee00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135815e560 con 0x7f13580b3980 2024-09-13T15:09:05.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135ee00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13580adf90 con 0x7f135815e9f0 2024-09-13T15:09:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135815d920 con 0x7f135806aaa0 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f135815e9f0 0x7f135815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f135815e9f0 0x7f135815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47654/0 (socket says 172.21.15.50:47654) 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 -- 172.21.15.50:0/2686137291 learned_addr learned my addr 172.21.15.50:0/2686137291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135da00700 1 --2- 172.21.15.50:0/2686137291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f135815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 -- 172.21.15.50:0/2686137291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 msgr2=0x7f135815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 --2- 172.21.15.50:0/2686137291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f135815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 -- 172.21.15.50:0/2686137291 >> v1:172.21.15.181:6789/0 conn(0x7f13580b3980 legacy=0x7f135806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 -- 172.21.15.50:0/2686137291 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135815dc00 con 0x7f135815e9f0 2024-09-13T15:09:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.252+0000 7f135e400700 1 --2- 172.21.15.50:0/2686137291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815eea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1350009e80 tx=0x7f135000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a745aeab0288b733 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f1357e00700 1 -- 172.21.15.50:0/2686137291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000e070 con 0x7f135815e9f0 2024-09-13T15:09:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f1357e00700 1 -- 172.21.15.50:0/2686137291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135000b980 con 0x7f135815e9f0 2024-09-13T15:09:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f1357e00700 1 -- 172.21.15.50:0/2686137291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000bd30 con 0x7f135815e9f0 2024-09-13T15:09:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 -- 172.21.15.50:0/2686137291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 msgr2=0x7f135815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 --2- 172.21.15.50:0/2686137291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815eea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1350009e80 tx=0x7f135000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 -- 172.21.15.50:0/2686137291 shutdown_connections 2024-09-13T15:09:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 --2- 172.21.15.50:0/2686137291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815eea0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 --2- 172.21.15.50:0/2686137291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f135815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 -- 172.21.15.50:0/2686137291 >> 172.21.15.50:0/2686137291 conn(0x7f13580b0c40 msgr2=0x7f135806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 -- 172.21.15.50:0/2686137291 shutdown_connections 2024-09-13T15:09:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.256+0000 7f135ee00700 1 -- 172.21.15.50:0/2686137291 wait complete. 2024-09-13T15:09:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 Processor -- start 2024-09-13T15:09:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 -- start start 2024-09-13T15:09:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f1358145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13580b3980 0x7f135815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135815cc50 con 0x7f135815e9f0 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580cd0a0 con 0x7f13580b3980 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13580cc090 con 0x7f135806aaa0 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47662/0 (socket says 172.21.15.50:47662) 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135e400700 1 -- 172.21.15.50:0/3538353441 learned_addr learned my addr 172.21.15.50:0/3538353441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135da00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f1358145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.260+0000 7f135d000700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13580b3980 0x7f135815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135e400700 1 -- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 msgr2=0x7f1358145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135e400700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f1358145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135e400700 1 -- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13580b3980 msgr2=0x7f135815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135e400700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13580b3980 0x7f135815c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135e400700 1 -- 172.21.15.50:0/3538353441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350009b30 con 0x7f135815e9f0 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135d000700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13580b3980 0x7f135815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135e400700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815c710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f13580b1690 tx=0x7f1350004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13500048b0 con 0x7f135815e9f0 2024-09-13T15:09:05.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13500092e0 con 0x7f135815e9f0 2024-09-13T15:09:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13580cc2e0 con 0x7f135815e9f0 2024-09-13T15:09:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135001c680 con 0x7f135815e9f0 2024-09-13T15:09:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13580cc8a0 con 0x7f135815e9f0 2024-09-13T15:09:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.264+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13580b2a50 con 0x7f135815e9f0 2024-09-13T15:09:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.268+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f135001c7e0 con 0x7f135815e9f0 2024-09-13T15:09:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.268+0000 7f1355600700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1338066730 0x7f1338068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.268+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1350085730 con 0x7f135815e9f0 2024-09-13T15:09:05.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.268+0000 7f135da00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1338066730 0x7f1338068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.272+0000 7f135da00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1338066730 0x7f1338068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f13580cad20 tx=0x7f134c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:05.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.276+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1350052ca0 con 0x7f135815e9f0 2024-09-13T15:09:05.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:05.412 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.464+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f13580ad4c0 con 0x7f135815e9f0 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.464+0000 7f1355600700 1 -- 172.21.15.50:0/3538353441 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f13500562c0 con 0x7f135815e9f0 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:05.470 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:09:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1338066730 msgr2=0x7f1338068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1338066730 0x7f1338068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f13580cad20 tx=0x7f134c008040 comp rx=0 tx=0).stop 2024-09-13T15:09:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 msgr2=0x7f135815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815c710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f13580b1690 tx=0x7f1350004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 shutdown_connections 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1338066730 0x7f1338068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135815e9f0 0x7f135815c710 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13580b3980 0x7f135815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 --2- 172.21.15.50:0/3538353441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f135806aaa0 0x7f1358145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 >> 172.21.15.50:0/3538353441 conn(0x7f13580b0c40 msgr2=0x7f13580afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 shutdown_connections 2024-09-13T15:09:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.472+0000 7f135ee00700 1 -- 172.21.15.50:0/3538353441 wait complete. 2024-09-13T15:09:05.497 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:09:05.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:09:05.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 Processor -- start 2024-09-13T15:09:05.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 -- start start 2024-09-13T15:09:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c15e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4b1c06c4c0 0x7f4b1c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c070670 con 0x7f4b1c06c8c0 2024-09-13T15:09:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c070950 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.724+0000 7f4b21a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c070c30 con 0x7f4b1c146720 2024-09-13T15:09:05.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4b1c06c8c0 0x7f4b1c071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46368/0 (socket says 172.21.15.50:46368) 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1b400700 1 -- 172.21.15.50:0/3513394389 learned_addr learned my addr 172.21.15.50:0/3513394389 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1a000700 1 --2- 172.21.15.50:0/3513394389 >> v2:172.21.15.181:3300/0 conn(0x7f4b1c06c4c0 0x7f4b1c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1aa00700 1 --2- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1a000700 1 -- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 msgr2=0x7f4b1c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1a000700 1 --2- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c15e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1a000700 1 -- 172.21.15.50:0/3513394389 >> v1:172.21.15.50:6789/0 conn(0x7f4b1c06c8c0 legacy=0x7f4b1c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1a000700 1 -- 172.21.15.50:0/3513394389 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c070f10 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b1a000700 1 --2- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0ceb70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009850 tx=0x7f4b08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22eb4f7a01b10e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:05.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b19600700 1 -- 172.21.15.50:0/3513394389 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08011830 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b19600700 1 -- 172.21.15.50:0/3513394389 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08011990 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b19600700 1 -- 172.21.15.50:0/3513394389 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08011d40 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b21a00700 1 -- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c4c0 msgr2=0x7f4b1c0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.728+0000 7f4b21a00700 1 --2- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0ceb70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009850 tx=0x7f4b08009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 -- 172.21.15.50:0/3513394389 shutdown_connections 2024-09-13T15:09:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 --2- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0ceb70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 --2- 172.21.15.50:0/3513394389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 -- 172.21.15.50:0/3513394389 >> 172.21.15.50:0/3513394389 conn(0x7f4b1c06a570 msgr2=0x7f4b1c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 -- 172.21.15.50:0/3513394389 shutdown_connections 2024-09-13T15:09:05.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 -- 172.21.15.50:0/3513394389 wait complete. 2024-09-13T15:09:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 Processor -- start 2024-09-13T15:09:05.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.732+0000 7f4b21a00700 1 -- start start 2024-09-13T15:09:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c8c0 0x7f4b1c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b03b0 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b0690 con 0x7f4b1c06c8c0 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b0970 con 0x7f4b1c146720 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47668/0 (socket says 172.21.15.50:47668) 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 -- 172.21.15.50:0/4218703863 learned_addr learned my addr 172.21.15.50:0/4218703863 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1b400700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1a000700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c8c0 0x7f4b1c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 -- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 msgr2=0x7f4b1c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 -- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c8c0 msgr2=0x7f4b1c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c8c0 0x7f4b1c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:05.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 -- 172.21.15.50:0/4218703863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b080094b0 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b1aa00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0afd40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00e840 tx=0x7f4b0c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0095a0 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00c690 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00ca00 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c0b0c50 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.736+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c15a930 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.740+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c15e320 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.740+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b0c00cb60 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.740+0000 7f4b12a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4afc066760 0x7f4afc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.740+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4b0c083ec0 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.744+0000 7f4b1a000700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4afc066760 0x7f4afc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:05.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.744+0000 7f4b1a000700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4afc066760 0x7f4afc068c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009850 tx=0x7f4b08008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:05.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.748+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b0c051450 con 0x7f4b1c06c4c0 2024-09-13T15:09:05.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:05.936+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4b1c160130 con 0x7f4b1c06c4c0 2024-09-13T15:09:06.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.588+0000 7f4b12a00700 1 -- 172.21.15.50:0/4218703863 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4b0c059e60 con 0x7f4b1c06c4c0 2024-09-13T15:09:06.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4afc066760 msgr2=0x7f4afc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4afc066760 0x7f4afc068c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009850 tx=0x7f4b08008030 comp rx=0 tx=0).stop 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 msgr2=0x7f4b1c0afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0afd40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00e840 tx=0x7f4b0c00ec00 comp rx=0 tx=0).stop 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 shutdown_connections 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4afc066760 0x7f4afc068c20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b1c146720 0x7f4b1c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b1c06c8c0 0x7f4b1c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 --2- 172.21.15.50:0/4218703863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b1c06c4c0 0x7f4b1c0afd40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 >> 172.21.15.50:0/4218703863 conn(0x7f4b1c06a570 msgr2=0x7f4b1c15cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.596+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 shutdown_connections 2024-09-13T15:09:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.600+0000 7f4b21a00700 1 -- 172.21.15.50:0/4218703863 wait complete. 2024-09-13T15:09:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:09:06.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:09:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.816+0000 7f43a0e00700 1 Processor -- start 2024-09-13T15:09:06.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.816+0000 7f43a0e00700 1 -- start start 2024-09-13T15:09:06.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f43a0e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f439c06b400 0x7f439c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:06.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f43a0e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c15a750 0x7f439c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:06.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f43a0e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c15daa0 con 0x7f439c15a370 2024-09-13T15:09:06.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f43a0e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c15dfc0 con 0x7f439c06b400 2024-09-13T15:09:06.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f43a0e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c15dce0 con 0x7f439c15a750 2024-09-13T15:09:06.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f439c06b400 0x7f439c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:06.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f439c06b400 0x7f439c15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47676/0 (socket says 172.21.15.50:47676) 2024-09-13T15:09:06.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 -- 172.21.15.50:0/1681402044 learned_addr learned my addr 172.21.15.50:0/1681402044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439be00700 1 --2- 172.21.15.50:0/1681402044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c15a750 0x7f439c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 -- 172.21.15.50:0/1681402044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c15a750 msgr2=0x7f439c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 --2- 172.21.15.50:0/1681402044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c15a750 0x7f439c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 -- 172.21.15.50:0/1681402044 >> v1:172.21.15.181:6789/0 conn(0x7f439c15a370 legacy=0x7f439c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439aa00700 1 -- 172.21.15.50:0/1681402044 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c0b43a0 con 0x7f439c06b400 2024-09-13T15:09:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.820+0000 7f439a000700 1 -- 172.21.15.50:0/1681402044 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840773437 0 0) 0x7f438c001110 con 0x7f439c15a370 2024-09-13T15:09:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f439aa00700 1 --2- 172.21.15.50:0/1681402044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c06b400 0x7f439c15d020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4388009910 tx=0x7f4388009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9c5983b102e9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f439a000700 1 -- 172.21.15.50:0/1681402044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011830 con 0x7f439c06b400 2024-09-13T15:09:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f439a000700 1 -- 172.21.15.50:0/1681402044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388011990 con 0x7f439c06b400 2024-09-13T15:09:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f439a000700 1 -- 172.21.15.50:0/1681402044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011d40 con 0x7f439c06b400 2024-09-13T15:09:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 -- 172.21.15.50:0/1681402044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c06b400 msgr2=0x7f439c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 --2- 172.21.15.50:0/1681402044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c06b400 0x7f439c15d020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4388009910 tx=0x7f4388009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 -- 172.21.15.50:0/1681402044 shutdown_connections 2024-09-13T15:09:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 --2- 172.21.15.50:0/1681402044 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c15a750 0x7f439c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 --2- 172.21.15.50:0/1681402044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c06b400 0x7f439c15d020 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 -- 172.21.15.50:0/1681402044 >> 172.21.15.50:0/1681402044 conn(0x7f439c066270 msgr2=0x7f439c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 -- 172.21.15.50:0/1681402044 shutdown_connections 2024-09-13T15:09:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.824+0000 7f43a0e00700 1 -- 172.21.15.50:0/1681402044 wait complete. 2024-09-13T15:09:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 Processor -- start 2024-09-13T15:09:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 -- start start 2024-09-13T15:09:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c06b400 0x7f439c151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 0x7f439c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c15a750 0x7f439c147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c155070 con 0x7f439c15a370 2024-09-13T15:09:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c1612d0 con 0x7f439c15a750 2024-09-13T15:09:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f43a0e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c155330 con 0x7f439c06b400 2024-09-13T15:09:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 0x7f439c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 0x7f439c155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47690/0 (socket says 172.21.15.50:47690) 2024-09-13T15:09:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 -- 172.21.15.50:0/3998459081 learned_addr learned my addr 172.21.15.50:0/3998459081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439be00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c15a750 0x7f439c147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439b400700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c06b400 0x7f439c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 -- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c06b400 msgr2=0x7f439c151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c06b400 0x7f439c151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 -- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c15a750 msgr2=0x7f439c147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c15a750 0x7f439c147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 -- 172.21.15.50:0/3998459081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388009570 con 0x7f439c15a370 2024-09-13T15:09:06.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.828+0000 7f439aa00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 0x7f439c155e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f439c0b3440 tx=0x7f4388004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.832+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438801a900 con 0x7f439c15a370 2024-09-13T15:09:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.832+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438801f070 con 0x7f439c15a370 2024-09-13T15:09:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.832+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438801acc0 con 0x7f439c15a370 2024-09-13T15:09:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.832+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c155610 con 0x7f439c15a370 2024-09-13T15:09:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.832+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c1478d0 con 0x7f439c15a370 2024-09-13T15:09:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.832+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c147a60 con 0x7f439c15a370 2024-09-13T15:09:06.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.836+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f438801b430 con 0x7f439c15a370 2024-09-13T15:09:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.836+0000 7f4393400700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f437c066760 0x7f437c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.836+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f4388021070 con 0x7f439c15a370 2024-09-13T15:09:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.836+0000 7f439b400700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f437c066760 0x7f437c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.836+0000 7f439b400700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f437c066760 0x7f437c068c20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f438c000f60 tx=0x7f438c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:06.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:06.844+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4388052d20 con 0x7f439c15a370 2024-09-13T15:09:07.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.028+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f439c06acf0 con 0x7f439c15a370 2024-09-13T15:09:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.600+0000 7f4393400700 1 -- 172.21.15.50:0/3998459081 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f43880150d0 con 0x7f439c15a370 2024-09-13T15:09:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.616+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f437c066760 msgr2=0x7f437c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.616+0000 7f43a0e00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f437c066760 0x7f437c068c20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f438c000f60 tx=0x7f438c009040 comp rx=0 tx=0).stop 2024-09-13T15:09:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.616+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 msgr2=0x7f439c155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.616+0000 7f43a0e00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 0x7f439c155e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f439c0b3440 tx=0x7f4388004770 comp rx=0 tx=0).stop 2024-09-13T15:09:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 shutdown_connections 2024-09-13T15:09:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f437c066760 0x7f437c068c20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c15a750 0x7f439c147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f439c15a370 0x7f439c155e10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 --2- 172.21.15.50:0/3998459081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f439c06b400 0x7f439c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 >> 172.21.15.50:0/3998459081 conn(0x7f439c066270 msgr2=0x7f439c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 shutdown_connections 2024-09-13T15:09:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.620+0000 7f43a0e00700 1 -- 172.21.15.50:0/3998459081 wait complete. 2024-09-13T15:09:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:09:07.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:09:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.828+0000 7f401b000700 1 Processor -- start 2024-09-13T15:09:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.828+0000 7f401b000700 1 -- start start 2024-09-13T15:09:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401b000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f40140ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401b000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4014066090 0x7f4014066540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401b000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401406a6c0 con 0x7f401415a650 2024-09-13T15:09:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401b000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4014066a80 con 0x7f4014066090 2024-09-13T15:09:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401b000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401406a390 con 0x7f401406b870 2024-09-13T15:09:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4014066090 0x7f4014066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4014066090 0x7f4014066540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47704/0 (socket says 172.21.15.50:47704) 2024-09-13T15:09:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 -- 172.21.15.50:0/1161957893 learned_addr learned my addr 172.21.15.50:0/1161957893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f4019200700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f40140ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 -- 172.21.15.50:0/1161957893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 msgr2=0x7f40140ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f40140ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 -- 172.21.15.50:0/1161957893 >> v1:172.21.15.181:6789/0 conn(0x7f401415a650 legacy=0x7f401415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 -- 172.21.15.50:0/1161957893 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401415aa30 con 0x7f4014066090 2024-09-13T15:09:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f4019200700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f40140ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.832+0000 7f401a600700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014066540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f400c009e50 tx=0x7f400c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcd33673ea256d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f4013e00700 1 -- 172.21.15.50:0/1161957893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00e070 con 0x7f4014066090 2024-09-13T15:09:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f4013e00700 1 -- 172.21.15.50:0/1161957893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c00b9c0 con 0x7f4014066090 2024-09-13T15:09:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f4013e00700 1 -- 172.21.15.50:0/1161957893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00bd70 con 0x7f4014066090 2024-09-13T15:09:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 -- 172.21.15.50:0/1161957893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 msgr2=0x7f4014066540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014066540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f400c009e50 tx=0x7f400c00b330 comp rx=0 tx=0).stop 2024-09-13T15:09:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 -- 172.21.15.50:0/1161957893 shutdown_connections 2024-09-13T15:09:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014066540 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 --2- 172.21.15.50:0/1161957893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f40140ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 -- 172.21.15.50:0/1161957893 >> 172.21.15.50:0/1161957893 conn(0x7f4014070d10 msgr2=0x7f40140710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 -- 172.21.15.50:0/1161957893 shutdown_connections 2024-09-13T15:09:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.836+0000 7f401b000700 1 -- 172.21.15.50:0/1161957893 wait complete. 2024-09-13T15:09:07.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 Processor -- start 2024-09-13T15:09:07.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 -- start start 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f4014152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401415a650 0x7f40141f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140af650 con 0x7f4014066090 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140afc10 con 0x7f401415a650 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f401b000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40141541c0 con 0x7f401406b870 2024-09-13T15:09:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.840+0000 7f4019c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47718/0 (socket says 172.21.15.50:47718) 2024-09-13T15:09:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 -- 172.21.15.50:0/680492571 learned_addr learned my addr 172.21.15.50:0/680492571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019200700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f4014152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f401a600700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401415a650 0x7f40141f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 -- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 msgr2=0x7f4014152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f4014152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 -- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401415a650 msgr2=0x7f40141f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401415a650 0x7f40141f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 -- 172.21.15.50:0/680492571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c009b30 con 0x7f4014066090 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f401a600700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401415a650 0x7f40141f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4019c00700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014152790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f400800c530 tx=0x7f400800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080052d0 con 0x7f4014066090 2024-09-13T15:09:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4008005430 con 0x7f4014066090 2024-09-13T15:09:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080055a0 con 0x7f4014066090 2024-09-13T15:09:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40141544a0 con 0x7f4014066090 2024-09-13T15:09:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4014154a60 con 0x7f4014066090 2024-09-13T15:09:07.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.844+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40141546e0 con 0x7f4014066090 2024-09-13T15:09:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.848+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40080038e0 con 0x7f4014066090 2024-09-13T15:09:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.852+0000 7f4011600700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066730 0x7f3ff4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.852+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f40080838f0 con 0x7f4014066090 2024-09-13T15:09:07.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.852+0000 7f4019200700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066730 0x7f3ff4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.852+0000 7f4019200700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066730 0x7f3ff4068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f40140cf480 tx=0x7f4000008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:07.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:07.856+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4008050bf0 con 0x7f4014066090 2024-09-13T15:09:08.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.076+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f40140afd50 con 0x7f4014066090 2024-09-13T15:09:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.088+0000 7f4011600700 1 -- 172.21.15.50:0/680492571 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f40140afd50 con 0x7f4014066090 2024-09-13T15:09:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.092+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066730 msgr2=0x7f3ff4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.092+0000 7f401b000700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066730 0x7f3ff4068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f40140cf480 tx=0x7f4000008040 comp rx=0 tx=0).stop 2024-09-13T15:09:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.092+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 msgr2=0x7f4014152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.092+0000 7f401b000700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014152790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f400800c530 tx=0x7f400800c840 comp rx=0 tx=0).stop 2024-09-13T15:09:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 shutdown_connections 2024-09-13T15:09:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066730 0x7f3ff4068bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401415a650 0x7f40141f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f401406b870 0x7f4014152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 --2- 172.21.15.50:0/680492571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4014066090 0x7f4014152790 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 >> 172.21.15.50:0/680492571 conn(0x7f4014070d10 msgr2=0x7f401415ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 shutdown_connections 2024-09-13T15:09:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.096+0000 7f401b000700 1 -- 172.21.15.50:0/680492571 wait complete. 2024-09-13T15:09:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 5 and data pool 6 2024-09-13T15:09:08.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.308+0000 7f3718c00700 1 Processor -- start 2024-09-13T15:09:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.308+0000 7f3718c00700 1 -- start start 2024-09-13T15:09:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3718c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371406aaa0 0x7f371406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3718c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f37140b2670 0x7f37140b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3718c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140b3560 con 0x7f37141610b0 2024-09-13T15:09:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3718c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3714070b30 con 0x7f371406aaa0 2024-09-13T15:09:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3718c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371406b450 con 0x7f37140b2670 2024-09-13T15:09:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371406aaa0 0x7f371406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371406aaa0 0x7f371406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47724/0 (socket says 172.21.15.50:47724) 2024-09-13T15:09:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 -- 172.21.15.50:0/770517560 learned_addr learned my addr 172.21.15.50:0/770517560 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3713e00700 1 --2- 172.21.15.50:0/770517560 >> v2:172.21.15.181:3300/0 conn(0x7f37140b2670 0x7f37140b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 -- 172.21.15.50:0/770517560 >> v2:172.21.15.181:3300/0 conn(0x7f37140b2670 msgr2=0x7f37140b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 --2- 172.21.15.50:0/770517560 >> v2:172.21.15.181:3300/0 conn(0x7f37140b2670 0x7f37140b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 -- 172.21.15.50:0/770517560 >> v1:172.21.15.181:6789/0 conn(0x7f37141610b0 legacy=0x7f37140719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 -- 172.21.15.50:0/770517560 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140b3000 con 0x7f371406aaa0 2024-09-13T15:09:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3713e00700 1 --2- 172.21.15.50:0/770517560 >> v2:172.21.15.181:3300/0 conn(0x7f37140b2670 0x7f37140b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f370be00700 1 --2- 172.21.15.50:0/770517560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371406aaa0 0x7f371406af10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009940 tx=0x7f36fc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce3e526d82694ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3712a00700 1 -- 172.21.15.50:0/770517560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00b9e0 con 0x7f371406aaa0 2024-09-13T15:09:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3712a00700 1 -- 172.21.15.50:0/770517560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc009e90 con 0x7f371406aaa0 2024-09-13T15:09:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.312+0000 7f3712a00700 1 -- 172.21.15.50:0/770517560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00bd60 con 0x7f371406aaa0 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 -- 172.21.15.50:0/770517560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371406aaa0 msgr2=0x7f371406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 --2- 172.21.15.50:0/770517560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371406aaa0 0x7f371406af10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009940 tx=0x7f36fc009c50 comp rx=0 tx=0).stop 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 -- 172.21.15.50:0/770517560 shutdown_connections 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 --2- 172.21.15.50:0/770517560 >> v2:172.21.15.181:3300/0 conn(0x7f37140b2670 0x7f37140b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 --2- 172.21.15.50:0/770517560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371406aaa0 0x7f371406af10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 -- 172.21.15.50:0/770517560 >> 172.21.15.50:0/770517560 conn(0x7f37140b0c40 msgr2=0x7f371406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 -- 172.21.15.50:0/770517560 shutdown_connections 2024-09-13T15:09:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 -- 172.21.15.50:0/770517560 wait complete. 2024-09-13T15:09:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.316+0000 7f3718c00700 1 Processor -- start 2024-09-13T15:09:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 -- start start 2024-09-13T15:09:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f371406aaa0 0x7f37140a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37140b2670 0x7f37140a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 0x7f3714150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140c3c30 con 0x7f37141610b0 2024-09-13T15:09:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371414e5c0 con 0x7f37140b2670 2024-09-13T15:09:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371414eb80 con 0x7f371406aaa0 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 0x7f3714150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 0x7f3714150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47730/0 (socket says 172.21.15.50:47730) 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 -- 172.21.15.50:0/1962617274 learned_addr learned my addr 172.21.15.50:0/1962617274 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f370be00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37140b2670 0x7f37140a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713400700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f371406aaa0 0x7f37140a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 -- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f371406aaa0 msgr2=0x7f37140a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f371406aaa0 0x7f37140a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 -- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37140b2670 msgr2=0x7f37140a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37140b2670 0x7f37140a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 -- 172.21.15.50:0/1962617274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009570 con 0x7f37141610b0 2024-09-13T15:09:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713400700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f371406aaa0 0x7f37140a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3713e00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 0x7f3714150620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f370c009fd0 tx=0x7f370c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c003a40 con 0x7f37141610b0 2024-09-13T15:09:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c00f040 con 0x7f37141610b0 2024-09-13T15:09:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c003e00 con 0x7f37141610b0 2024-09-13T15:09:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.320+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140a9aa0 con 0x7f37141610b0 2024-09-13T15:09:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.324+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371414e810 con 0x7f37141610b0 2024-09-13T15:09:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.324+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3714161490 con 0x7f37141610b0 2024-09-13T15:09:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.324+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f370c004030 con 0x7f37141610b0 2024-09-13T15:09:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.328+0000 7f370b400700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f0066730 0x7f36f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.328+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f370c084520 con 0x7f37141610b0 2024-09-13T15:09:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.328+0000 7f3713400700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f0066730 0x7f36f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.328+0000 7f3713400700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f0066730 0x7f36f0068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3704000f60 tx=0x7f3704009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:08.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.336+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f370c0516b0 con 0x7f37141610b0 2024-09-13T15:09:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.532+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37140afbe0 con 0x7f37141610b0 2024-09-13T15:09:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.536+0000 7f370b400700 1 -- 172.21.15.50:0/1962617274 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f370c054cd0 con 0x7f37141610b0 2024-09-13T15:09:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:08.542 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:08.079517+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f0066730 msgr2=0x7f36f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f0066730 0x7f36f0068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3704000f60 tx=0x7f3704009040 comp rx=0 tx=0).stop 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 msgr2=0x7f3714150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 0x7f3714150620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f370c009fd0 tx=0x7f370c00d460 comp rx=0 tx=0).stop 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 shutdown_connections 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f0066730 0x7f36f0068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37141610b0 0x7f3714150620 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37140b2670 0x7f37140a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 --2- 172.21.15.50:0/1962617274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f371406aaa0 0x7f37140a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 >> 172.21.15.50:0/1962617274 conn(0x7f37140b0c40 msgr2=0x7f371415f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 shutdown_connections 2024-09-13T15:09:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.540+0000 7f3718c00700 1 -- 172.21.15.50:0/1962617274 wait complete. 2024-09-13T15:09:08.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 Processor -- start 2024-09-13T15:09:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 -- start start 2024-09-13T15:09:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10081610b0 0x7f10080719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100806aaa0 0x7f100806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080b3560 con 0x7f10080b2670 2024-09-13T15:09:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1008070b30 con 0x7f10081610b0 2024-09-13T15:09:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.740+0000 7f1007200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100806b420 con 0x7f100806aaa0 2024-09-13T15:09:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10081610b0 0x7f10080719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100806aaa0 0x7f100806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10081610b0 0x7f10080719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47732/0 (socket says 172.21.15.50:47732) 2024-09-13T15:09:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 -- 172.21.15.50:0/4151359297 learned_addr learned my addr 172.21.15.50:0/4151359297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:08.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 -- 172.21.15.50:0/4151359297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100806aaa0 msgr2=0x7f100806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 --2- 172.21.15.50:0/4151359297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100806aaa0 0x7f100806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 -- 172.21.15.50:0/4151359297 >> v1:172.21.15.50:6789/0 conn(0x7f10080b2670 legacy=0x7f10080cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 -- 172.21.15.50:0/4151359297 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080b3280 con 0x7f10081610b0 2024-09-13T15:09:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1004a00700 1 -- 172.21.15.50:0/4151359297 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639827414 0 0) 0x7f10080b3560 con 0x7f10080b2670 2024-09-13T15:09:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1005e00700 1 --2- 172.21.15.50:0/4151359297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10081610b0 0x7f10080719c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009910 tx=0x7f0ff8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26b68abc99fae0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:08.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1004a00700 1 -- 172.21.15.50:0/4151359297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8011830 con 0x7f10081610b0 2024-09-13T15:09:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1004a00700 1 -- 172.21.15.50:0/4151359297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8011990 con 0x7f10081610b0 2024-09-13T15:09:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1004a00700 1 -- 172.21.15.50:0/4151359297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8011d40 con 0x7f10081610b0 2024-09-13T15:09:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 -- 172.21.15.50:0/4151359297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10081610b0 msgr2=0x7f10080719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 --2- 172.21.15.50:0/4151359297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10081610b0 0x7f10080719c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009910 tx=0x7f0ff8009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 -- 172.21.15.50:0/4151359297 shutdown_connections 2024-09-13T15:09:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 --2- 172.21.15.50:0/4151359297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100806aaa0 0x7f100806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 --2- 172.21.15.50:0/4151359297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10081610b0 0x7f10080719c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 -- 172.21.15.50:0/4151359297 >> 172.21.15.50:0/4151359297 conn(0x7f10080b0c40 msgr2=0x7f100806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 -- 172.21.15.50:0/4151359297 shutdown_connections 2024-09-13T15:09:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.744+0000 7f1007200700 1 -- 172.21.15.50:0/4151359297 wait complete. 2024-09-13T15:09:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.748+0000 7f1007200700 1 Processor -- start 2024-09-13T15:09:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.748+0000 7f1007200700 1 -- start start 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 0x7f10081626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10080b2670 0x7f1008157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f10081610b0 0x7f1008164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10081f6910 con 0x7f100806aaa0 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10081f6bf0 con 0x7f10080b2670 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10081f6ed0 con 0x7f10081610b0 2024-09-13T15:09:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 0x7f10081626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 0x7f10081626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47742/0 (socket says 172.21.15.50:47742) 2024-09-13T15:09:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 -- 172.21.15.50:0/144625466 learned_addr learned my addr 172.21.15.50:0/144625466 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1006800700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f10081610b0 0x7f1008164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005400700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10080b2670 0x7f1008157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 -- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f10081610b0 msgr2=0x7f1008164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f10081610b0 0x7f1008164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 -- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10080b2670 msgr2=0x7f1008157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10080b2670 0x7f1008157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 -- 172.21.15.50:0/144625466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8009570 con 0x7f100806aaa0 2024-09-13T15:09:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1006800700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f10081610b0 0x7f1008164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1005e00700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 0x7f10081626f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000c00 tx=0x7f0ff8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800ba70 con 0x7f100806aaa0 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff801e070 con 0x7f100806aaa0 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800be50 con 0x7f100806aaa0 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.752+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10081f71b0 con 0x7f100806aaa0 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.756+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10081f7770 con 0x7f100806aaa0 2024-09-13T15:09:08.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.756+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1008161490 con 0x7f100806aaa0 2024-09-13T15:09:08.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.756+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ff802d450 con 0x7f100806aaa0 2024-09-13T15:09:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.760+0000 7f0ffe000700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe8066730 0x7f0fe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.760+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ff8085300 con 0x7f100806aaa0 2024-09-13T15:09:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.760+0000 7f1005400700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe8066730 0x7f0fe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.760+0000 7f1005400700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe8066730 0x7f0fe8068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10080ad960 tx=0x7f0ff4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:08.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.764+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ff8052520 con 0x7f100806aaa0 2024-09-13T15:09:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.960+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10080cd0d0 con 0x7f100806aaa0 2024-09-13T15:09:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f0ffe000700 1 -- 172.21.15.50:0/144625466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f0ff8055b40 con 0x7f100806aaa0 2024-09-13T15:09:08.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:08.967 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:08.079517+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe8066730 msgr2=0x7f0fe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe8066730 0x7f0fe8068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10080ad960 tx=0x7f0ff4008040 comp rx=0 tx=0).stop 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 msgr2=0x7f10081626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 0x7f10081626f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000c00 tx=0x7f0ff8004770 comp rx=0 tx=0).stop 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 shutdown_connections 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe8066730 0x7f0fe8068bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f10081610b0 0x7f1008164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10080b2670 0x7f1008157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 --2- 172.21.15.50:0/144625466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f100806aaa0 0x7f10081626f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 >> 172.21.15.50:0/144625466 conn(0x7f10080b0c40 msgr2=0x7f100815f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 shutdown_connections 2024-09-13T15:09:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:08.964+0000 7f1007200700 1 -- 172.21.15.50:0/144625466 wait complete. 2024-09-13T15:09:08.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.156+0000 7f1206600700 1 Processor -- start 2024-09-13T15:09:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.156+0000 7f1206600700 1 -- start start 2024-09-13T15:09:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f1206600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1200144330 0x7f12000cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f1206600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1200144710 0x7f12000b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f1206600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120006bcf0 con 0x7f120006d760 2024-09-13T15:09:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f1206600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000cce10 con 0x7f1200144710 2024-09-13T15:09:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f1206600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120006cb50 con 0x7f1200144330 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f11ffe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1200144710 0x7f12000b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f11ffe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1200144710 0x7f12000b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47758/0 (socket says 172.21.15.50:47758) 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f11ffe00700 1 -- 172.21.15.50:0/2929976517 learned_addr learned my addr 172.21.15.50:0/2929976517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.160+0000 7f11ff400700 1 --2- 172.21.15.50:0/2929976517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1200144330 0x7f12000cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11ffe00700 1 -- 172.21.15.50:0/2929976517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1200144330 msgr2=0x7f12000cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11ffe00700 1 --2- 172.21.15.50:0/2929976517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1200144330 0x7f12000cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11ffe00700 1 -- 172.21.15.50:0/2929976517 >> v1:172.21.15.181:6789/0 conn(0x7f120006d760 legacy=0x7f12000b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11ffe00700 1 -- 172.21.15.50:0/2929976517 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000cf4b0 con 0x7f1200144710 2024-09-13T15:09:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11ffe00700 1 --2- 172.21.15.50:0/2929976517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1200144710 0x7f12000b1b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009e50 tx=0x7f11f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daf5535ed4a792 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:09.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11fe000700 1 -- 172.21.15.50:0/2929976517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800e070 con 0x7f1200144710 2024-09-13T15:09:09.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11fe000700 1 -- 172.21.15.50:0/2929976517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800b910 con 0x7f1200144710 2024-09-13T15:09:09.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f11fe000700 1 -- 172.21.15.50:0/2929976517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bcc0 con 0x7f1200144710 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 -- 172.21.15.50:0/2929976517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1200144710 msgr2=0x7f12000b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 --2- 172.21.15.50:0/2929976517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1200144710 0x7f12000b1b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009e50 tx=0x7f11f800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 -- 172.21.15.50:0/2929976517 shutdown_connections 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 --2- 172.21.15.50:0/2929976517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1200144710 0x7f12000b1b60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 --2- 172.21.15.50:0/2929976517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1200144330 0x7f12000cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 -- 172.21.15.50:0/2929976517 >> 172.21.15.50:0/2929976517 conn(0x7f120006a570 msgr2=0x7f120006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 -- 172.21.15.50:0/2929976517 shutdown_connections 2024-09-13T15:09:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.164+0000 7f1206600700 1 -- 172.21.15.50:0/2929976517 wait complete. 2024-09-13T15:09:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.168+0000 7f1206600700 1 Processor -- start 2024-09-13T15:09:09.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.168+0000 7f1206600700 1 -- start start 2024-09-13T15:09:09.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f120006d760 0x7f12001356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1200144330 0x7f1200140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 0x7f1200140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000ae790 con 0x7f120015dfb0 2024-09-13T15:09:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200143830 con 0x7f1200144330 2024-09-13T15:09:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1200154bc0 con 0x7f120006d760 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 0x7f1200140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 0x7f1200140b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47772/0 (socket says 172.21.15.50:47772) 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 -- 172.21.15.50:0/229402098 learned_addr learned my addr 172.21.15.50:0/229402098 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11fea00700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1200144330 0x7f1200140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ff400700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f120006d760 0x7f12001356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 -- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f120006d760 msgr2=0x7f12001356f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f120006d760 0x7f12001356f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 -- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1200144330 msgr2=0x7f1200140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1200144330 0x7f1200140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 -- 172.21.15.50:0/229402098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009b30 con 0x7f120015dfb0 2024-09-13T15:09:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11ffe00700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 0x7f1200140b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f120006b360 tx=0x7f11f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004800 con 0x7f120015dfb0 2024-09-13T15:09:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f80099b0 con 0x7f120015dfb0 2024-09-13T15:09:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f801b670 con 0x7f120015dfb0 2024-09-13T15:09:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1200154e60 con 0x7f120015dfb0 2024-09-13T15:09:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.172+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1200143550 con 0x7f120015dfb0 2024-09-13T15:09:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.176+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12000ae8d0 con 0x7f120015dfb0 2024-09-13T15:09:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.176+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11f801b7d0 con 0x7f120015dfb0 2024-09-13T15:09:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.180+0000 7f11f7400700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f11e0066730 0x7f11e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.180+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f11f8085a30 con 0x7f120015dfb0 2024-09-13T15:09:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.180+0000 7f11ff400700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f11e0066730 0x7f11e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.180+0000 7f11ff400700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f11e0066730 0x7f11e0068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f12001f39a0 tx=0x7f11f0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.184+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12000ae8d0 con 0x7f120015dfb0 2024-09-13T15:09:09.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:09.400+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12000ae8d0 con 0x7f120015dfb0 2024-09-13T15:09:10.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.092+0000 7f11f7400700 1 -- 172.21.15.50:0/229402098 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f12000ae8d0 con 0x7f120015dfb0 2024-09-13T15:09:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f11e0066730 msgr2=0x7f11e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f11e0066730 0x7f11e0068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f12001f39a0 tx=0x7f11f0009240 comp rx=0 tx=0).stop 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 msgr2=0x7f1200140b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 0x7f1200140b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f120006b360 tx=0x7f11f8004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 shutdown_connections 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f11e0066730 0x7f11e0068bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f120015dfb0 0x7f1200140b80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1200144330 0x7f1200140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 --2- 172.21.15.50:0/229402098 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f120006d760 0x7f12001356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 >> 172.21.15.50:0/229402098 conn(0x7f120006a570 msgr2=0x7f120015d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 shutdown_connections 2024-09-13T15:09:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.096+0000 7f1206600700 1 -- 172.21.15.50:0/229402098 wait complete. 2024-09-13T15:09:10.125 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:09:10.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:09:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.304+0000 7f3e1ea00700 1 Processor -- start 2024-09-13T15:09:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.304+0000 7f3e1ea00700 1 -- start start 2024-09-13T15:09:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 0x7f3e18161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e181637b0 0x7f3e180664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1ea00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e18164820 con 0x7f3e18066090 2024-09-13T15:09:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1ea00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e18066a10 con 0x7f3e181637b0 2024-09-13T15:09:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181623f0 con 0x7f3e18164440 2024-09-13T15:09:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1e000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e181637b0 0x7f3e180664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 0x7f3e18161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 0x7f3e18161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58946/0 (socket says 172.21.15.50:58946) 2024-09-13T15:09:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 -- 172.21.15.50:0/977205066 learned_addr learned my addr 172.21.15.50:0/977205066 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:10.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 -- 172.21.15.50:0/977205066 >> v2:172.21.15.50:3300/0 conn(0x7f3e181637b0 msgr2=0x7f3e180664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 --2- 172.21.15.50:0/977205066 >> v2:172.21.15.50:3300/0 conn(0x7f3e181637b0 0x7f3e180664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 -- 172.21.15.50:0/977205066 >> v1:172.21.15.181:6789/0 conn(0x7f3e18066090 legacy=0x7f3e18164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.308+0000 7f3e1d600700 1 -- 172.21.15.50:0/977205066 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18071040 con 0x7f3e18164440 2024-09-13T15:09:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1d600700 1 --2- 172.21.15.50:0/977205066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 0x7f3e18161eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009910 tx=0x7f3e0c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c50f43b7c74126 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e17e00700 1 -- 172.21.15.50:0/977205066 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c011830 con 0x7f3e18164440 2024-09-13T15:09:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e17e00700 1 -- 172.21.15.50:0/977205066 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c011990 con 0x7f3e18164440 2024-09-13T15:09:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e17e00700 1 -- 172.21.15.50:0/977205066 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c011d40 con 0x7f3e18164440 2024-09-13T15:09:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 -- 172.21.15.50:0/977205066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 msgr2=0x7f3e18161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:10.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/977205066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 0x7f3e18161eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009910 tx=0x7f3e0c009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:10.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 -- 172.21.15.50:0/977205066 shutdown_connections 2024-09-13T15:09:10.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/977205066 >> v2:172.21.15.50:3300/0 conn(0x7f3e181637b0 0x7f3e180664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/977205066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18164440 0x7f3e18161eb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 -- 172.21.15.50:0/977205066 >> 172.21.15.50:0/977205066 conn(0x7f3e1806d580 msgr2=0x7f3e1806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:10.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 -- 172.21.15.50:0/977205066 shutdown_connections 2024-09-13T15:09:10.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.312+0000 7f3e1ea00700 1 -- 172.21.15.50:0/977205066 wait complete. 2024-09-13T15:09:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 Processor -- start 2024-09-13T15:09:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 -- start start 2024-09-13T15:09:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18066090 0x7f3e18153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e181637b0 0x7f3e1814f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 0x7f3e18159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1814f200 con 0x7f3e18164440 2024-09-13T15:09:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1814e5f0 con 0x7f3e181637b0 2024-09-13T15:09:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1814e8d0 con 0x7f3e18066090 2024-09-13T15:09:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 0x7f3e18159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 0x7f3e18159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47792/0 (socket says 172.21.15.50:47792) 2024-09-13T15:09:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 -- 172.21.15.50:0/503237168 learned_addr learned my addr 172.21.15.50:0/503237168 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1d600700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18066090 0x7f3e18153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1cc00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e181637b0 0x7f3e1814f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 -- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18066090 msgr2=0x7f3e18153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18066090 0x7f3e18153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 -- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e181637b0 msgr2=0x7f3e1814f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e181637b0 0x7f3e1814f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 -- 172.21.15.50:0/503237168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009570 con 0x7f3e18164440 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.316+0000 7f3e1e000700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 0x7f3e18159230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000efc0 tx=0x7f3e1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000cb30 con 0x7f3e18164440 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1000f040 con 0x7f3e18164440 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1814ebb0 con 0x7f3e18164440 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10014480 con 0x7f3e18164440 2024-09-13T15:09:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18153850 con 0x7f3e18164440 2024-09-13T15:09:10.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1814f3b0 con 0x7f3e18164440 2024-09-13T15:09:10.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.320+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e100147f0 con 0x7f3e18164440 2024-09-13T15:09:10.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.324+0000 7f3e15600700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3df8066760 0x7f3df8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.324+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3e10085130 con 0x7f3e18164440 2024-09-13T15:09:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.324+0000 7f3e1d600700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3df8066760 0x7f3df8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.324+0000 7f3e1d600700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3df8066760 0x7f3df8068c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009c60 tx=0x7f3e0c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.328+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e1814f3b0 con 0x7f3e18164440 2024-09-13T15:09:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:10.552+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3e180b4b90 con 0x7f3e18164440 2024-09-13T15:09:10.572 INFO:tasks.ceph.mds.b.smithi181.stderr:2024-09-13T15:09:10.569+0000 7fc0ff200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:09:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.100+0000 7f3e15600700 1 -- 172.21.15.50:0/503237168 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e100522c0 con 0x7f3e18164440 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3df8066760 msgr2=0x7f3df8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3df8066760 0x7f3df8068c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009c60 tx=0x7f3e0c008030 comp rx=0 tx=0).stop 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 msgr2=0x7f3e18159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 0x7f3e18159230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000efc0 tx=0x7f3e1000c3a0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 shutdown_connections 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3df8066760 0x7f3df8068c20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e18164440 0x7f3e18159230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e181637b0 0x7f3e1814f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 --2- 172.21.15.50:0/503237168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e18066090 0x7f3e18153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 >> 172.21.15.50:0/503237168 conn(0x7f3e1806d580 msgr2=0x7f3e181572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 shutdown_connections 2024-09-13T15:09:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.104+0000 7f3e1ea00700 1 -- 172.21.15.50:0/503237168 wait complete. 2024-09-13T15:09:11.129 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:09:11.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:11.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.296+0000 7f8c22a00700 1 Processor -- start 2024-09-13T15:09:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.296+0000 7f8c22a00700 1 -- start start 2024-09-13T15:09:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c22a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c22a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c1c06aaa0 0x7f8c1c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c22a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c0b2ad0 con 0x7f8c1c15c2a0 2024-09-13T15:09:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c22a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c06b450 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c22a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c15b960 con 0x7f8c1c0cb020 2024-09-13T15:09:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58958/0 (socket says 172.21.15.50:58958) 2024-09-13T15:09:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 -- 172.21.15.50:0/2233636722 learned_addr learned my addr 172.21.15.50:0/2233636722 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c22000700 1 --2- 172.21.15.50:0/2233636722 >> v2:172.21.15.181:3300/0 conn(0x7f8c1c06aaa0 0x7f8c1c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 -- 172.21.15.50:0/2233636722 >> v2:172.21.15.181:3300/0 conn(0x7f8c1c06aaa0 msgr2=0x7f8c1c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 --2- 172.21.15.50:0/2233636722 >> v2:172.21.15.181:3300/0 conn(0x7f8c1c06aaa0 0x7f8c1c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 -- 172.21.15.50:0/2233636722 >> v1:172.21.15.181:6789/0 conn(0x7f8c1c15c2a0 legacy=0x7f8c1c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 -- 172.21.15.50:0/2233636722 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c15bc40 con 0x7f8c1c0cb020 2024-09-13T15:09:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c21600700 1 --2- 172.21.15.50:0/2233636722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c0cc6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009910 tx=0x7f8c10009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=255df84063332c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.300+0000 7f8c1be00700 1 -- 172.21.15.50:0/2233636722 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000ba60 con 0x7f8c1c0cb020 2024-09-13T15:09:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c1be00700 1 -- 172.21.15.50:0/2233636722 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000bbc0 con 0x7f8c1c0cb020 2024-09-13T15:09:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c1be00700 1 -- 172.21.15.50:0/2233636722 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10009e60 con 0x7f8c1c0cb020 2024-09-13T15:09:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 -- 172.21.15.50:0/2233636722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 msgr2=0x7f8c1c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 --2- 172.21.15.50:0/2233636722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c0cc6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009910 tx=0x7f8c10009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 -- 172.21.15.50:0/2233636722 shutdown_connections 2024-09-13T15:09:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 --2- 172.21.15.50:0/2233636722 >> v2:172.21.15.181:3300/0 conn(0x7f8c1c06aaa0 0x7f8c1c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 --2- 172.21.15.50:0/2233636722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c0cc6f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 -- 172.21.15.50:0/2233636722 >> 172.21.15.50:0/2233636722 conn(0x7f8c1c0b0c40 msgr2=0x7f8c1c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 -- 172.21.15.50:0/2233636722 shutdown_connections 2024-09-13T15:09:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.304+0000 7f8c22a00700 1 -- 172.21.15.50:0/2233636722 wait complete. 2024-09-13T15:09:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 Processor -- start 2024-09-13T15:09:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 -- start start 2024-09-13T15:09:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 0x7f8c1c141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c1c15c2a0 0x7f8c1c0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c1f2960 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0ca090 con 0x7f8c1c15c2a0 2024-09-13T15:09:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0ca370 con 0x7f8c1c0cb020 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 0x7f8c1c141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 0x7f8c1c141240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47804/0 (socket says 172.21.15.50:47804) 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 -- 172.21.15.50:0/3707956721 learned_addr learned my addr 172.21.15.50:0/3707956721 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22000700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c1c15c2a0 0x7f8c1c0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c20c00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 -- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 msgr2=0x7f8c1c1f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c1f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 -- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c1c15c2a0 msgr2=0x7f8c1c0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c1c15c2a0 0x7f8c1c0c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c21600700 1 -- 172.21.15.50:0/3707956721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009570 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.308+0000 7f8c22000700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c1c15c2a0 0x7f8c1c0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c21600700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 0x7f8c1c141240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c15baa0 tx=0x7f8c10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10004510 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1001f070 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c0ca650 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10003900 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c141780 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c1f2d90 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.312+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c10003a60 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.316+0000 7f8c19600700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bfc066730 0x7f8bfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.316+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c10021070 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.316+0000 7f8c20c00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bfc066730 0x7f8bfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.316+0000 7f8c20c00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bfc066730 0x7f8bfc068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c137f80 tx=0x7f8c08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.320+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c1c1f2d90 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.548+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c1c1f2d90 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.552+0000 7f8c19600700 1 -- 172.21.15.50:0/3707956721 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f8c1c1f2d90 con 0x7f8c1c06aaa0 2024-09-13T15:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bfc066730 msgr2=0x7f8bfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bfc066730 0x7f8bfc068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c137f80 tx=0x7f8c08009040 comp rx=0 tx=0).stop 2024-09-13T15:09:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 msgr2=0x7f8c1c141240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 0x7f8c1c141240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c15baa0 tx=0x7f8c10004770 comp rx=0 tx=0).stop 2024-09-13T15:09:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 shutdown_connections 2024-09-13T15:09:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bfc066730 0x7f8bfc068bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c1c15c2a0 0x7f8c1c0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1c0cb020 0x7f8c1c1f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 --2- 172.21.15.50:0/3707956721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1c06aaa0 0x7f8c1c141240 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 >> 172.21.15.50:0/3707956721 conn(0x7f8c1c0b0c40 msgr2=0x7f8c1c15dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 shutdown_connections 2024-09-13T15:09:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.556+0000 7f8c22a00700 1 -- 172.21.15.50:0/3707956721 wait complete. 2024-09-13T15:09:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:11.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.752+0000 7fb8b1000700 1 Processor -- start 2024-09-13T15:09:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.752+0000 7fb8b1000700 1 -- start start 2024-09-13T15:09:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8b1000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb8ac1610b0 0x7fb8ac0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8b1000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8ac0b2d80 0x7fb8ac06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8b1000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac0b3560 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8b1000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac070b30 con 0x7fb8ac0b2d80 2024-09-13T15:09:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8b1000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac06b450 con 0x7fb8ac1610b0 2024-09-13T15:09:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8ab400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb8ac1610b0 0x7fb8ac0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8abe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8ac0b2d80 0x7fb8ac06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8a3e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb8ac06aaa0 0x7fb8ac0b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:55702/0 (socket says 172.21.15.50:55702) 2024-09-13T15:09:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8a3e00700 1 -- 172.21.15.50:0/4101994546 learned_addr learned my addr 172.21.15.50:0/4101994546 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8ab400700 1 -- 172.21.15.50:0/4101994546 >> v2:172.21.15.50:3300/0 conn(0x7fb8ac0b2d80 msgr2=0x7fb8ac06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8ab400700 1 --2- 172.21.15.50:0/4101994546 >> v2:172.21.15.50:3300/0 conn(0x7fb8ac0b2d80 0x7fb8ac06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8ab400700 1 -- 172.21.15.50:0/4101994546 >> v1:172.21.15.181:6789/0 conn(0x7fb8ac06aaa0 legacy=0x7fb8ac0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8aaa00700 1 -- 172.21.15.50:0/4101994546 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233612939 0 0) 0x7fb8ac0b3560 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8ab400700 1 -- 172.21.15.50:0/4101994546 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0b3280 con 0x7fb8ac1610b0 2024-09-13T15:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8ab400700 1 --2- 172.21.15.50:0/4101994546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac1610b0 0x7fb8ac0719c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009850 tx=0x7fb89c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9476d1dbb7bea16d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:11.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8aaa00700 1 -- 172.21.15.50:0/4101994546 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011830 con 0x7fb8ac1610b0 2024-09-13T15:09:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8aaa00700 1 -- 172.21.15.50:0/4101994546 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c011990 con 0x7fb8ac1610b0 2024-09-13T15:09:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.756+0000 7fb8aaa00700 1 -- 172.21.15.50:0/4101994546 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011d20 con 0x7fb8ac1610b0 2024-09-13T15:09:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 -- 172.21.15.50:0/4101994546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac1610b0 msgr2=0x7fb8ac0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 --2- 172.21.15.50:0/4101994546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac1610b0 0x7fb8ac0719c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009850 tx=0x7fb89c009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 -- 172.21.15.50:0/4101994546 shutdown_connections 2024-09-13T15:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 --2- 172.21.15.50:0/4101994546 >> v2:172.21.15.50:3300/0 conn(0x7fb8ac0b2d80 0x7fb8ac06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 --2- 172.21.15.50:0/4101994546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac1610b0 0x7fb8ac0719c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 -- 172.21.15.50:0/4101994546 >> 172.21.15.50:0/4101994546 conn(0x7fb8ac0b0c40 msgr2=0x7fb8ac06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 -- 172.21.15.50:0/4101994546 shutdown_connections 2024-09-13T15:09:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 -- 172.21.15.50:0/4101994546 wait complete. 2024-09-13T15:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 Processor -- start 2024-09-13T15:09:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.760+0000 7fb8b1000700 1 -- start start 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 0x7fb8ac1f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac0b2d80 0x7fb8ac15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8ac1610b0 0x7fb8ac158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac1621e0 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac1f7130 con 0x7fb8ac0b2d80 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac164130 con 0x7fb8ac1610b0 2024-09-13T15:09:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 0x7fb8ac1f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 0x7fb8ac1f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47820/0 (socket says 172.21.15.50:47820) 2024-09-13T15:09:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 -- 172.21.15.50:0/35531896 learned_addr learned my addr 172.21.15.50:0/35531896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8abe00700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8ac1610b0 0x7fb8ac158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8a3e00700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac0b2d80 0x7fb8ac15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 -- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8ac1610b0 msgr2=0x7fb8ac158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8ac1610b0 0x7fb8ac158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 -- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac0b2d80 msgr2=0x7fb8ac15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac0b2d80 0x7fb8ac15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 -- 172.21.15.50:0/35531896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0094b0 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8a3e00700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac0b2d80 0x7fb8ac15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8abe00700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8ac1610b0 0x7fb8ac158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8ab400700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 0x7fb8ac1f6bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb89c014040 tx=0x7fb89c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c019b60 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c01e070 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac161840 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c01a420 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.764+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac161e00 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.768+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac161490 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.768+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb89c01a580 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.768+0000 7fb8a3400700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb888066730 0x7fb888068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.772+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb89c085310 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.772+0000 7fb8a3e00700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb888066730 0x7fb888068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.772+0000 7fb8a3e00700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb888066730 0x7fb888068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0cb3d0 tx=0x7fb894009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.776+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb89c052530 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.975+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8ac15d970 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.975+0000 7fb8a3400700 1 -- 172.21.15.50:0/35531896 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fb89c055b50 con 0x7fb8ac06aaa0 2024-09-13T15:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:09.084298+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb888066730 msgr2=0x7fb888068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb888066730 0x7fb888068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0cb3d0 tx=0x7fb894009040 comp rx=0 tx=0).stop 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 msgr2=0x7fb8ac1f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 0x7fb8ac1f6bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb89c014040 tx=0x7fb89c004770 comp rx=0 tx=0).stop 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 shutdown_connections 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb888066730 0x7fb888068bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb8ac1610b0 0x7fb8ac158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8ac0b2d80 0x7fb8ac15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 --2- 172.21.15.50:0/35531896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8ac06aaa0 0x7fb8ac1f6bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:11.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 >> 172.21.15.50:0/35531896 conn(0x7fb8ac0b0c40 msgr2=0x7fb8ac0af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:11.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 shutdown_connections 2024-09-13T15:09:11.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:11.979+0000 7fb8b1000700 1 -- 172.21.15.50:0/35531896 wait complete. 2024-09-13T15:09:12.009 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:09:12.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:09:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.179+0000 7f2ba4e00700 1 Processor -- start 2024-09-13T15:09:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.179+0000 7f2ba4e00700 1 -- start start 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2ba4e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ba01610b0 0x7f2ba00719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2ba4e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ba006aaa0 0x7f2ba006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2ba4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba00b2670 0x7f2ba00b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2ba4e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba0070b30 con 0x7f2ba006aaa0 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2ba4e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba006b450 con 0x7f2ba01610b0 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2ba4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00b3040 con 0x7f2ba00b2670 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ba006aaa0 0x7f2ba006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ba006aaa0 0x7f2ba006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47830/0 (socket says 172.21.15.50:47830) 2024-09-13T15:09:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 -- 172.21.15.50:0/1565285636 learned_addr learned my addr 172.21.15.50:0/1565285636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b9f400700 1 --2- 172.21.15.50:0/1565285636 >> v2:172.21.15.181:3300/0 conn(0x7f2ba01610b0 0x7f2ba00719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b9fe00700 1 --2- 172.21.15.50:0/1565285636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba00b2670 0x7f2ba00b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 -- 172.21.15.50:0/1565285636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba00b2670 msgr2=0x7f2ba00b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 --2- 172.21.15.50:0/1565285636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba00b2670 0x7f2ba00b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 -- 172.21.15.50:0/1565285636 >> v2:172.21.15.181:3300/0 conn(0x7f2ba01610b0 msgr2=0x7f2ba00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 --2- 172.21.15.50:0/1565285636 >> v2:172.21.15.181:3300/0 conn(0x7f2ba01610b0 0x7f2ba00719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 -- 172.21.15.50:0/1565285636 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00b3560 con 0x7f2ba006aaa0 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b96a00700 1 --2- 172.21.15.50:0/1565285636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba006aaa0 0x7f2ba006af10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009940 tx=0x7f2b88009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d69304ed422d0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:12.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.183+0000 7f2b9ea00700 1 -- 172.21.15.50:0/1565285636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800b9e0 con 0x7f2ba006aaa0 2024-09-13T15:09:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2b9ea00700 1 -- 172.21.15.50:0/1565285636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88009e90 con 0x7f2ba006aaa0 2024-09-13T15:09:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2b9ea00700 1 -- 172.21.15.50:0/1565285636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800bd60 con 0x7f2ba006aaa0 2024-09-13T15:09:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1565285636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba006aaa0 msgr2=0x7f2ba006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1565285636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba006aaa0 0x7f2ba006af10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009940 tx=0x7f2b88009c50 comp rx=0 tx=0).stop 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1565285636 shutdown_connections 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1565285636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba00b2670 0x7f2ba00b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1565285636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba006aaa0 0x7f2ba006af10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1565285636 >> v2:172.21.15.181:3300/0 conn(0x7f2ba01610b0 0x7f2ba00719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1565285636 >> 172.21.15.50:0/1565285636 conn(0x7f2ba00b0c40 msgr2=0x7f2ba006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1565285636 shutdown_connections 2024-09-13T15:09:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.187+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1565285636 wait complete. 2024-09-13T15:09:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 Processor -- start 2024-09-13T15:09:12.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 -- start start 2024-09-13T15:09:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba006aaa0 0x7f2ba01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 0x7f2ba0156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba01610b0 0x7f2ba01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0163c20 con 0x7f2ba00b2670 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01464b0 con 0x7f2ba01610b0 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2ba4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0162fa0 con 0x7f2ba006aaa0 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2b96a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 0x7f2ba0156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2b96a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 0x7f2ba0156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47840/0 (socket says 172.21.15.50:47840) 2024-09-13T15:09:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2b96a00700 1 -- 172.21.15.50:0/1205666430 learned_addr learned my addr 172.21.15.50:0/1205666430 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.191+0000 7f2b9f400700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba006aaa0 0x7f2ba01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b9fe00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba01610b0 0x7f2ba01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b96a00700 1 -- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba006aaa0 msgr2=0x7f2ba01624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b96a00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba006aaa0 0x7f2ba01624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b96a00700 1 -- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba01610b0 msgr2=0x7f2ba01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b96a00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba01610b0 0x7f2ba01568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b96a00700 1 -- 172.21.15.50:0/1205666430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009570 con 0x7f2ba00b2670 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b96a00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 0x7f2ba0156380 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009910 tx=0x7f2b88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800be70 con 0x7f2ba00b2670 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8801e070 con 0x7f2ba00b2670 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba0163280 con 0x7f2ba00b2670 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88003900 con 0x7f2ba00b2670 2024-09-13T15:09:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba0163840 con 0x7f2ba00b2670 2024-09-13T15:09:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.195+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba0163d60 con 0x7f2ba00b2670 2024-09-13T15:09:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.199+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b88003a60 con 0x7f2ba00b2670 2024-09-13T15:09:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.199+0000 7f2b97e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b7c066730 0x7f2b7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.199+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b88020070 con 0x7f2ba00b2670 2024-09-13T15:09:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.199+0000 7f2b9f400700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b7c066730 0x7f2b7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.203+0000 7f2b9f400700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b7c066730 0x7f2b7c068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b900098d0 tx=0x7f2b90008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.203+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b880529b0 con 0x7f2ba00b2670 2024-09-13T15:09:12.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.399+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ba00711c0 con 0x7f2b7c066730 2024-09-13T15:09:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.415+0000 7f2b97e00700 1 -- 172.21.15.50:0/1205666430 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286040 (secure 0 0 0) 0x7f2b90009560 con 0x7f2b7c066730 2024-09-13T15:09:12.424 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b7c066730 msgr2=0x7f2b7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b7c066730 0x7f2b7c068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b900098d0 tx=0x7f2b90008040 comp rx=0 tx=0).stop 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 msgr2=0x7f2ba0156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 0x7f2ba0156380 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009910 tx=0x7f2b88004770 comp rx=0 tx=0).stop 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 shutdown_connections 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b7c066730 0x7f2b7c068bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba01610b0 0x7f2ba01568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba00b2670 0x7f2ba0156380 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 --2- 172.21.15.50:0/1205666430 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba006aaa0 0x7f2ba01624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 >> 172.21.15.50:0/1205666430 conn(0x7f2ba00b0c40 msgr2=0x7f2ba00b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 shutdown_connections 2024-09-13T15:09:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.423+0000 7f2ba4e00700 1 -- 172.21.15.50:0/1205666430 wait complete. 2024-09-13T15:09:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:09:12.453 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-13T15:09:12.043565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237332,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737388,"statfs":{"total":773094113280,"available":772851085312,"internally_reserved":0,"allocated":4845568,"data_stored":2735259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.453947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092940+0000","last_change":"2024-09-13T15:09:08.108752+0000","last_active":"2024-09-13T15:09:09.092940+0000","last_peered":"2024-09-13T15:09:09.092940+0000","last_clean":"2024-09-13T15:09:09.092940+0000","last_became_active":"2024-09-13T15:09:08.108504+0000","last_became_peered":"2024-09-13T15:09:08.108504+0000","last_unstale":"2024-09-13T15:09:09.092940+0000","last_undegraded":"2024-09-13T15:09:09.092940+0000","last_fullsized":"2024-09-13T15:09:09.092940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:38.743237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092708+0000","last_change":"2024-09-13T15:09:08.116469+0000","last_active":"2024-09-13T15:09:09.092708+0000","last_peered":"2024-09-13T15:09:09.092708+0000","last_clean":"2024-09-13T15:09:09.092708+0000","last_became_active":"2024-09-13T15:09:08.115732+0000","last_became_peered":"2024-09-13T15:09:08.115732+0000","last_unstale":"2024-09-13T15:09:09.092708+0000","last_undegraded":"2024-09-13T15:09:09.092708+0000","last_fullsized":"2024-09-13T15:09:09.092708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:39.337602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521250+0000","last_change":"2024-09-13T15:09:08.108000+0000","last_active":"2024-09-13T15:09:09.521250+0000","last_peered":"2024-09-13T15:09:09.521250+0000","last_clean":"2024-09-13T15:09:09.521250+0000","last_became_active":"2024-09-13T15:09:08.107732+0000","last_became_peered":"2024-09-13T15:09:08.107732+0000","last_unstale":"2024-09-13T15:09:09.521250+0000","last_undegraded":"2024-09-13T15:09:09.521250+0000","last_fullsized":"2024-09-13T15:09:09.521250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:45.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521976+0000","last_change":"2024-09-13T15:09:08.125616+0000","last_active":"2024-09-13T15:09:09.521976+0000","last_peered":"2024-09-13T15:09:09.521976+0000","last_clean":"2024-09-13T15:09:09.521976+0000","last_became_active":"2024-09-13T15:09:08.125352+0000","last_became_peered":"2024-09-13T15:09:08.125352+0000","last_unstale":"2024-09-13T15:09:09.521976+0000","last_undegraded":"2024-09-13T15:09:09.521976+0000","last_fullsized":"2024-09-13T15:09:09.521976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:01.530890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521265+0000","last_change":"2024-09-13T15:09:08.115714+0000","last_active":"2024-09-13T15:09:09.521265+0000","last_peered":"2024-09-13T15:09:09.521265+0000","last_clean":"2024-09-13T15:09:09.521265+0000","last_became_active":"2024-09-13T15:09:08.115470+0000","last_became_peered":"2024-09-13T15:09:08.115470+0000","last_unstale":"2024-09-13T15:09:09.521265+0000","last_undegraded":"2024-09-13T15:09:09.521265+0000","last_fullsized":"2024-09-13T15:09:09.521265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:59.049097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520222+0000","last_change":"2024-09-13T15:09:08.118121+0000","last_active":"2024-09-13T15:09:09.520222+0000","last_peered":"2024-09-13T15:09:09.520222+0000","last_clean":"2024-09-13T15:09:09.520222+0000","last_became_active":"2024-09-13T15:09:08.117862+0000","last_became_peered":"2024-09-13T15:09:08.117862+0000","last_unstale":"2024-09-13T15:09:09.520222+0000","last_undegraded":"2024-09-13T15:09:09.520222+0000","last_fullsized":"2024-09-13T15:09:09.520222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:49.933549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517523+0000","last_change":"2024-09-13T15:09:08.118048+0000","last_active":"2024-09-13T15:09:09.517523+0000","last_peered":"2024-09-13T15:09:09.517523+0000","last_clean":"2024-09-13T15:09:09.517523+0000","last_became_active":"2024-09-13T15:09:08.117730+0000","last_became_peered":"2024-09-13T15:09:08.117730+0000","last_unstale":"2024-09-13T15:09:09.517523+0000","last_undegraded":"2024-09-13T15:09:09.517523+0000","last_fullsized":"2024-09-13T15:09:09.517523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:45.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092106+0000","last_change":"2024-09-13T15:09:08.121117+0000","last_active":"2024-09-13T15:09:09.092106+0000","last_peered":"2024-09-13T15:09:09.092106+0000","last_clean":"2024-09-13T15:09:09.092106+0000","last_became_active":"2024-09-13T15:09:08.120860+0000","last_became_peered":"2024-09-13T15:09:08.120860+0000","last_unstale":"2024-09-13T15:09:09.092106+0000","last_undegraded":"2024-09-13T15:09:09.092106+0000","last_fullsized":"2024-09-13T15:09:09.092106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:06.263823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522072+0000","last_change":"2024-09-13T15:09:08.123287+0000","last_active":"2024-09-13T15:09:09.522072+0000","last_peered":"2024-09-13T15:09:09.522072+0000","last_clean":"2024-09-13T15:09:09.522072+0000","last_became_active":"2024-09-13T15:09:08.122978+0000","last_became_peered":"2024-09-13T15:09:08.122978+0000","last_unstale":"2024-09-13T15:09:09.522072+0000","last_undegraded":"2024-09-13T15:09:09.522072+0000","last_fullsized":"2024-09-13T15:09:09.522072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:11.590698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518280+0000","last_change":"2024-09-13T15:09:08.104805+0000","last_active":"2024-09-13T15:09:09.518280+0000","last_peered":"2024-09-13T15:09:09.518280+0000","last_clean":"2024-09-13T15:09:09.518280+0000","last_became_active":"2024-09-13T15:09:08.104559+0000","last_became_peered":"2024-09-13T15:09:08.104559+0000","last_unstale":"2024-09-13T15:09:09.518280+0000","last_undegraded":"2024-09-13T15:09:09.518280+0000","last_fullsized":"2024-09-13T15:09:09.518280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:58.604274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518495+0000","last_change":"2024-09-13T15:09:08.121891+0000","last_active":"2024-09-13T15:09:09.518495+0000","last_peered":"2024-09-13T15:09:09.518495+0000","last_clean":"2024-09-13T15:09:09.518495+0000","last_became_active":"2024-09-13T15:09:08.121563+0000","last_became_peered":"2024-09-13T15:09:08.121563+0000","last_unstale":"2024-09-13T15:09:09.518495+0000","last_undegraded":"2024-09-13T15:09:09.518495+0000","last_fullsized":"2024-09-13T15:09:09.518495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:49.933549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521597+0000","last_change":"2024-09-13T15:09:08.100907+0000","last_active":"2024-09-13T15:09:09.521597+0000","last_peered":"2024-09-13T15:09:09.521597+0000","last_clean":"2024-09-13T15:09:09.521597+0000","last_became_active":"2024-09-13T15:09:08.100622+0000","last_became_peered":"2024-09-13T15:09:08.100622+0000","last_unstale":"2024-09-13T15:09:09.521597+0000","last_undegraded":"2024-09-13T15:09:09.521597+0000","last_fullsized":"2024-09-13T15:09:09.521597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.982745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517884+0000","last_change":"2024-09-13T15:09:08.105022+0000","last_active":"2024-09-13T15:09:09.517884+0000","last_peered":"2024-09-13T15:09:09.517884+0000","last_clean":"2024-09-13T15:09:09.517884+0000","last_became_active":"2024-09-13T15:09:08.104235+0000","last_became_peered":"2024-09-13T15:09:08.104235+0000","last_unstale":"2024-09-13T15:09:09.517884+0000","last_undegraded":"2024-09-13T15:09:09.517884+0000","last_fullsized":"2024-09-13T15:09:09.517884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:11.590698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093317+0000","last_change":"2024-09-13T15:09:08.126147+0000","last_active":"2024-09-13T15:09:09.093317+0000","last_peered":"2024-09-13T15:09:09.093317+0000","last_clean":"2024-09-13T15:09:09.093317+0000","last_became_active":"2024-09-13T15:09:08.125743+0000","last_became_peered":"2024-09-13T15:09:08.125743+0000","last_unstale":"2024-09-13T15:09:09.093317+0000","last_undegraded":"2024-09-13T15:09:09.093317+0000","last_fullsized":"2024-09-13T15:09:09.093317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:06.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517672+0000","last_change":"2024-09-13T15:09:08.109364+0000","last_active":"2024-09-13T15:09:09.517672+0000","last_peered":"2024-09-13T15:09:09.517672+0000","last_clean":"2024-09-13T15:09:09.517672+0000","last_became_active":"2024-09-13T15:09:08.106994+0000","last_became_peered":"2024-09-13T15:09:08.106994+0000","last_unstale":"2024-09-13T15:09:09.517672+0000","last_undegraded":"2024-09-13T15:09:09.517672+0000","last_fullsized":"2024-09-13T15:09:09.517672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.982745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517750+0000","last_change":"2024-09-13T15:09:08.114336+0000","last_active":"2024-09-13T15:09:09.517750+0000","last_peered":"2024-09-13T15:09:09.517750+0000","last_clean":"2024-09-13T15:09:09.517750+0000","last_became_active":"2024-09-13T15:09:08.113918+0000","last_became_peered":"2024-09-13T15:09:08.113918+0000","last_unstale":"2024-09-13T15:09:09.517750+0000","last_undegraded":"2024-09-13T15:09:09.517750+0000","last_fullsized":"2024-09-13T15:09:09.517750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:07.829895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519194+0000","last_change":"2024-09-13T15:09:08.121684+0000","last_active":"2024-09-13T15:09:09.519194+0000","last_peered":"2024-09-13T15:09:09.519194+0000","last_clean":"2024-09-13T15:09:09.519194+0000","last_became_active":"2024-09-13T15:09:08.121393+0000","last_became_peered":"2024-09-13T15:09:08.121393+0000","last_unstale":"2024-09-13T15:09:09.519194+0000","last_undegraded":"2024-09-13T15:09:09.519194+0000","last_fullsized":"2024-09-13T15:09:09.519194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093165+0000","last_change":"2024-09-13T15:09:08.123854+0000","last_active":"2024-09-13T15:09:09.093165+0000","last_peered":"2024-09-13T15:09:09.093165+0000","last_clean":"2024-09-13T15:09:09.093165+0000","last_became_active":"2024-09-13T15:09:08.123521+0000","last_became_peered":"2024-09-13T15:09:08.123521+0000","last_unstale":"2024-09-13T15:09:09.093165+0000","last_undegraded":"2024-09-13T15:09:09.093165+0000","last_fullsized":"2024-09-13T15:09:09.093165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:01.530890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520373+0000","last_change":"2024-09-13T15:09:08.112057+0000","last_active":"2024-09-13T15:09:09.520373+0000","last_peered":"2024-09-13T15:09:09.520373+0000","last_clean":"2024-09-13T15:09:09.520373+0000","last_became_active":"2024-09-13T15:09:08.111811+0000","last_became_peered":"2024-09-13T15:09:08.111811+0000","last_unstale":"2024-09-13T15:09:09.520373+0000","last_undegraded":"2024-09-13T15:09:09.520373+0000","last_fullsized":"2024-09-13T15:09:09.520373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:14.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093839+0000","last_change":"2024-09-13T15:09:08.121799+0000","last_active":"2024-09-13T15:09:09.093839+0000","last_peered":"2024-09-13T15:09:09.093839+0000","last_clean":"2024-09-13T15:09:09.093839+0000","last_became_active":"2024-09-13T15:09:08.121543+0000","last_became_peered":"2024-09-13T15:09:08.121543+0000","last_unstale":"2024-09-13T15:09:09.093839+0000","last_undegraded":"2024-09-13T15:09:09.093839+0000","last_fullsized":"2024-09-13T15:09:09.093839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:59.049097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517604+0000","last_change":"2024-09-13T15:09:08.109478+0000","last_active":"2024-09-13T15:09:09.517604+0000","last_peered":"2024-09-13T15:09:09.517604+0000","last_clean":"2024-09-13T15:09:09.517604+0000","last_became_active":"2024-09-13T15:09:08.109198+0000","last_became_peered":"2024-09-13T15:09:08.109198+0000","last_unstale":"2024-09-13T15:09:09.517604+0000","last_undegraded":"2024-09-13T15:09:09.517604+0000","last_fullsized":"2024-09-13T15:09:09.517604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:42.324479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093779+0000","last_change":"2024-09-13T15:09:08.125980+0000","last_active":"2024-09-13T15:09:09.093779+0000","last_peered":"2024-09-13T15:09:09.093779+0000","last_clean":"2024-09-13T15:09:09.093779+0000","last_became_active":"2024-09-13T15:09:08.124710+0000","last_became_peered":"2024-09-13T15:09:08.124710+0000","last_unstale":"2024-09-13T15:09:09.093779+0000","last_undegraded":"2024-09-13T15:09:09.093779+0000","last_fullsized":"2024-09-13T15:09:09.093779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:58.604274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517573+0000","last_change":"2024-09-13T15:09:08.107932+0000","last_active":"2024-09-13T15:09:09.517573+0000","last_peered":"2024-09-13T15:09:09.517573+0000","last_clean":"2024-09-13T15:09:09.517573+0000","last_became_active":"2024-09-13T15:09:08.107400+0000","last_became_peered":"2024-09-13T15:09:08.107400+0000","last_unstale":"2024-09-13T15:09:09.517573+0000","last_undegraded":"2024-09-13T15:09:09.517573+0000","last_fullsized":"2024-09-13T15:09:09.517573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:26.647126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520374+0000","last_change":"2024-09-13T15:09:08.107951+0000","last_active":"2024-09-13T15:09:09.520374+0000","last_peered":"2024-09-13T15:09:09.520374+0000","last_clean":"2024-09-13T15:09:09.520374+0000","last_became_active":"2024-09-13T15:09:08.107696+0000","last_became_peered":"2024-09-13T15:09:08.107696+0000","last_unstale":"2024-09-13T15:09:09.520374+0000","last_undegraded":"2024-09-13T15:09:09.520374+0000","last_fullsized":"2024-09-13T15:09:09.520374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:40.663208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092949+0000","last_change":"2024-09-13T15:09:08.116062+0000","last_active":"2024-09-13T15:09:09.092949+0000","last_peered":"2024-09-13T15:09:09.092949+0000","last_clean":"2024-09-13T15:09:09.092949+0000","last_became_active":"2024-09-13T15:09:08.115720+0000","last_became_peered":"2024-09-13T15:09:08.115720+0000","last_unstale":"2024-09-13T15:09:09.092949+0000","last_undegraded":"2024-09-13T15:09:09.092949+0000","last_fullsized":"2024-09-13T15:09:09.092949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:40.663208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521265+0000","last_change":"2024-09-13T15:09:08.116450+0000","last_active":"2024-09-13T15:09:09.521265+0000","last_peered":"2024-09-13T15:09:09.521265+0000","last_clean":"2024-09-13T15:09:09.521265+0000","last_became_active":"2024-09-13T15:09:08.116126+0000","last_became_peered":"2024-09-13T15:09:08.116126+0000","last_unstale":"2024-09-13T15:09:09.521265+0000","last_undegraded":"2024-09-13T15:09:09.521265+0000","last_fullsized":"2024-09-13T15:09:09.521265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:25.131000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092988+0000","last_change":"2024-09-13T15:09:08.118510+0000","last_active":"2024-09-13T15:09:09.092988+0000","last_peered":"2024-09-13T15:09:09.092988+0000","last_clean":"2024-09-13T15:09:09.092988+0000","last_became_active":"2024-09-13T15:09:08.118329+0000","last_became_peered":"2024-09-13T15:09:08.118329+0000","last_unstale":"2024-09-13T15:09:09.092988+0000","last_undegraded":"2024-09-13T15:09:09.092988+0000","last_fullsized":"2024-09-13T15:09:09.092988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:43.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518104+0000","last_change":"2024-09-13T15:09:08.117138+0000","last_active":"2024-09-13T15:09:09.518104+0000","last_peered":"2024-09-13T15:09:09.518104+0000","last_clean":"2024-09-13T15:09:09.518104+0000","last_became_active":"2024-09-13T15:09:08.116911+0000","last_became_peered":"2024-09-13T15:09:08.116911+0000","last_unstale":"2024-09-13T15:09:09.518104+0000","last_undegraded":"2024-09-13T15:09:09.518104+0000","last_fullsized":"2024-09-13T15:09:09.518104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092445+0000","last_change":"2024-09-13T15:09:08.110727+0000","last_active":"2024-09-13T15:09:09.092445+0000","last_peered":"2024-09-13T15:09:09.092445+0000","last_clean":"2024-09-13T15:09:09.092445+0000","last_became_active":"2024-09-13T15:09:08.110377+0000","last_became_peered":"2024-09-13T15:09:08.110377+0000","last_unstale":"2024-09-13T15:09:09.092445+0000","last_undegraded":"2024-09-13T15:09:09.092445+0000","last_fullsized":"2024-09-13T15:09:09.092445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:25.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092404+0000","last_change":"2024-09-13T15:09:08.117668+0000","last_active":"2024-09-13T15:09:09.092404+0000","last_peered":"2024-09-13T15:09:09.092404+0000","last_clean":"2024-09-13T15:09:09.092404+0000","last_became_active":"2024-09-13T15:09:08.117414+0000","last_became_peered":"2024-09-13T15:09:08.117414+0000","last_unstale":"2024-09-13T15:09:09.092404+0000","last_undegraded":"2024-09-13T15:09:09.092404+0000","last_fullsized":"2024-09-13T15:09:09.092404+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:14.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518595+0000","last_change":"2024-09-13T15:09:08.107911+0000","last_active":"2024-09-13T15:09:09.518595+0000","last_peered":"2024-09-13T15:09:09.518595+0000","last_clean":"2024-09-13T15:09:09.518595+0000","last_became_active":"2024-09-13T15:09:08.107602+0000","last_became_peered":"2024-09-13T15:09:08.107602+0000","last_unstale":"2024-09-13T15:09:09.518595+0000","last_undegraded":"2024-09-13T15:09:09.518595+0000","last_fullsized":"2024-09-13T15:09:09.518595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:34.381135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520246+0000","last_change":"2024-09-13T15:09:08.107764+0000","last_active":"2024-09-13T15:09:09.520246+0000","last_peered":"2024-09-13T15:09:09.520246+0000","last_clean":"2024-09-13T15:09:09.520246+0000","last_became_active":"2024-09-13T15:09:08.107499+0000","last_became_peered":"2024-09-13T15:09:08.107499+0000","last_unstale":"2024-09-13T15:09:09.520246+0000","last_undegraded":"2024-09-13T15:09:09.520246+0000","last_fullsized":"2024-09-13T15:09:09.520246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:49.766695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519145+0000","last_change":"2024-09-13T15:09:08.117910+0000","last_active":"2024-09-13T15:09:09.519145+0000","last_peered":"2024-09-13T15:09:09.519145+0000","last_clean":"2024-09-13T15:09:09.519145+0000","last_became_active":"2024-09-13T15:09:08.117639+0000","last_became_peered":"2024-09-13T15:09:08.117639+0000","last_unstale":"2024-09-13T15:09:09.519145+0000","last_undegraded":"2024-09-13T15:09:09.519145+0000","last_fullsized":"2024-09-13T15:09:09.519145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:42.324479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093080+0000","last_change":"2024-09-13T15:09:07.623627+0000","last_active":"2024-09-13T15:09:09.093080+0000","last_peered":"2024-09-13T15:09:09.093080+0000","last_clean":"2024-09-13T15:09:09.093080+0000","last_became_active":"2024-09-13T15:09:07.623375+0000","last_became_peered":"2024-09-13T15:09:07.623375+0000","last_unstale":"2024-09-13T15:09:09.093080+0000","last_undegraded":"2024-09-13T15:09:09.093080+0000","last_fullsized":"2024-09-13T15:09:09.093080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:49.185972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521899+0000","last_change":"2024-09-13T15:09:08.125041+0000","last_active":"2024-09-13T15:09:09.521899+0000","last_peered":"2024-09-13T15:09:09.521899+0000","last_clean":"2024-09-13T15:09:09.521899+0000","last_became_active":"2024-09-13T15:09:08.124474+0000","last_became_peered":"2024-09-13T15:09:08.124474+0000","last_unstale":"2024-09-13T15:09:09.521899+0000","last_undegraded":"2024-09-13T15:09:09.521899+0000","last_fullsized":"2024-09-13T15:09:09.521899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:07.829895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522141+0000","last_change":"2024-09-13T15:09:07.627565+0000","last_active":"2024-09-13T15:09:09.522141+0000","last_peered":"2024-09-13T15:09:09.522141+0000","last_clean":"2024-09-13T15:09:09.522141+0000","last_became_active":"2024-09-13T15:09:07.627307+0000","last_became_peered":"2024-09-13T15:09:07.627307+0000","last_unstale":"2024-09-13T15:09:09.522141+0000","last_undegraded":"2024-09-13T15:09:09.522141+0000","last_fullsized":"2024-09-13T15:09:09.522141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:40.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.094119+0000","last_change":"2024-09-13T15:09:08.124435+0000","last_active":"2024-09-13T15:09:09.094119+0000","last_peered":"2024-09-13T15:09:09.094119+0000","last_clean":"2024-09-13T15:09:09.094119+0000","last_became_active":"2024-09-13T15:09:08.124134+0000","last_became_peered":"2024-09-13T15:09:08.124134+0000","last_unstale":"2024-09-13T15:09:09.094119+0000","last_undegraded":"2024-09-13T15:09:09.094119+0000","last_fullsized":"2024-09-13T15:09:09.094119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:59.463810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522532+0000","last_change":"2024-09-13T15:09:07.622714+0000","last_active":"2024-09-13T15:09:09.522532+0000","last_peered":"2024-09-13T15:09:09.522532+0000","last_clean":"2024-09-13T15:09:09.522532+0000","last_became_active":"2024-09-13T15:09:07.622472+0000","last_became_peered":"2024-09-13T15:09:07.622472+0000","last_unstale":"2024-09-13T15:09:09.522532+0000","last_undegraded":"2024-09-13T15:09:09.522532+0000","last_fullsized":"2024-09-13T15:09:09.522532+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092821+0000","last_change":"2024-09-13T15:09:08.124015+0000","last_active":"2024-09-13T15:09:09.092821+0000","last_peered":"2024-09-13T15:09:09.092821+0000","last_clean":"2024-09-13T15:09:09.092821+0000","last_became_active":"2024-09-13T15:09:08.123687+0000","last_became_peered":"2024-09-13T15:09:08.123687+0000","last_unstale":"2024-09-13T15:09:09.092821+0000","last_undegraded":"2024-09-13T15:09:09.092821+0000","last_fullsized":"2024-09-13T15:09:09.092821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:33.190037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093661+0000","last_change":"2024-09-13T15:09:07.619809+0000","last_active":"2024-09-13T15:09:09.093661+0000","last_peered":"2024-09-13T15:09:09.093661+0000","last_clean":"2024-09-13T15:09:09.093661+0000","last_became_active":"2024-09-13T15:09:07.619550+0000","last_became_peered":"2024-09-13T15:09:07.619550+0000","last_unstale":"2024-09-13T15:09:09.093661+0000","last_undegraded":"2024-09-13T15:09:09.093661+0000","last_fullsized":"2024-09-13T15:09:09.093661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:24.119550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519658+0000","last_change":"2024-09-13T15:09:08.106307+0000","last_active":"2024-09-13T15:09:09.519658+0000","last_peered":"2024-09-13T15:09:09.519658+0000","last_clean":"2024-09-13T15:09:09.519658+0000","last_became_active":"2024-09-13T15:09:08.106010+0000","last_became_peered":"2024-09-13T15:09:08.106010+0000","last_unstale":"2024-09-13T15:09:09.519658+0000","last_undegraded":"2024-09-13T15:09:09.519658+0000","last_fullsized":"2024-09-13T15:09:09.519658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:19.327798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517973+0000","last_change":"2024-09-13T15:09:07.617688+0000","last_active":"2024-09-13T15:09:09.517973+0000","last_peered":"2024-09-13T15:09:09.517973+0000","last_clean":"2024-09-13T15:09:09.517973+0000","last_became_active":"2024-09-13T15:09:07.617454+0000","last_became_peered":"2024-09-13T15:09:07.617454+0000","last_unstale":"2024-09-13T15:09:09.517973+0000","last_undegraded":"2024-09-13T15:09:09.517973+0000","last_fullsized":"2024-09-13T15:09:09.517973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:34.691952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517799+0000","last_change":"2024-09-13T15:09:08.108726+0000","last_active":"2024-09-13T15:09:09.517799+0000","last_peered":"2024-09-13T15:09:09.517799+0000","last_clean":"2024-09-13T15:09:09.517799+0000","last_became_active":"2024-09-13T15:09:08.106631+0000","last_became_peered":"2024-09-13T15:09:08.106631+0000","last_unstale":"2024-09-13T15:09:09.517799+0000","last_undegraded":"2024-09-13T15:09:09.517799+0000","last_fullsized":"2024-09-13T15:09:09.517799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:03.891708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518659+0000","last_change":"2024-09-13T15:09:07.629671+0000","last_active":"2024-09-13T15:09:09.518659+0000","last_peered":"2024-09-13T15:09:09.518659+0000","last_clean":"2024-09-13T15:09:09.518659+0000","last_became_active":"2024-09-13T15:09:07.629392+0000","last_became_peered":"2024-09-13T15:09:07.629392+0000","last_unstale":"2024-09-13T15:09:09.518659+0000","last_undegraded":"2024-09-13T15:09:09.518659+0000","last_fullsized":"2024-09-13T15:09:09.518659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:55.440562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093919+0000","last_change":"2024-09-13T15:09:08.127683+0000","last_active":"2024-09-13T15:09:09.093919+0000","last_peered":"2024-09-13T15:09:09.093919+0000","last_clean":"2024-09-13T15:09:09.093919+0000","last_became_active":"2024-09-13T15:09:08.122557+0000","last_became_peered":"2024-09-13T15:09:08.122557+0000","last_unstale":"2024-09-13T15:09:09.093919+0000","last_undegraded":"2024-09-13T15:09:09.093919+0000","last_fullsized":"2024-09-13T15:09:09.093919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520999+0000","last_change":"2024-09-13T15:09:07.625514+0000","last_active":"2024-09-13T15:09:09.520999+0000","last_peered":"2024-09-13T15:09:09.520999+0000","last_clean":"2024-09-13T15:09:09.520999+0000","last_became_active":"2024-09-13T15:09:07.623919+0000","last_became_peered":"2024-09-13T15:09:07.623919+0000","last_unstale":"2024-09-13T15:09:09.520999+0000","last_undegraded":"2024-09-13T15:09:09.520999+0000","last_fullsized":"2024-09-13T15:09:09.520999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:24.886304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092010+0000","last_change":"2024-09-13T15:09:08.103548+0000","last_active":"2024-09-13T15:09:09.092010+0000","last_peered":"2024-09-13T15:09:09.092010+0000","last_clean":"2024-09-13T15:09:09.092010+0000","last_became_active":"2024-09-13T15:09:08.103131+0000","last_became_peered":"2024-09-13T15:09:08.103131+0000","last_unstale":"2024-09-13T15:09:09.092010+0000","last_undegraded":"2024-09-13T15:09:09.092010+0000","last_fullsized":"2024-09-13T15:09:09.092010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:24.649685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093245+0000","last_change":"2024-09-13T15:09:07.616187+0000","last_active":"2024-09-13T15:09:09.093245+0000","last_peered":"2024-09-13T15:09:09.093245+0000","last_clean":"2024-09-13T15:09:09.093245+0000","last_became_active":"2024-09-13T15:09:07.615901+0000","last_became_peered":"2024-09-13T15:09:07.615901+0000","last_unstale":"2024-09-13T15:09:09.093245+0000","last_undegraded":"2024-09-13T15:09:09.093245+0000","last_fullsized":"2024-09-13T15:09:09.093245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:25.635676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522515+0000","last_change":"2024-09-13T15:09:08.125098+0000","last_active":"2024-09-13T15:09:09.522515+0000","last_peered":"2024-09-13T15:09:09.522515+0000","last_clean":"2024-09-13T15:09:09.522515+0000","last_became_active":"2024-09-13T15:09:08.124862+0000","last_became_peered":"2024-09-13T15:09:08.124862+0000","last_unstale":"2024-09-13T15:09:09.522515+0000","last_undegraded":"2024-09-13T15:09:09.522515+0000","last_fullsized":"2024-09-13T15:09:09.522515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:43.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092911+0000","last_change":"2024-09-13T15:09:07.624655+0000","last_active":"2024-09-13T15:09:09.092911+0000","last_peered":"2024-09-13T15:09:09.092911+0000","last_clean":"2024-09-13T15:09:09.092911+0000","last_became_active":"2024-09-13T15:09:07.624451+0000","last_became_peered":"2024-09-13T15:09:07.624451+0000","last_unstale":"2024-09-13T15:09:09.092911+0000","last_undegraded":"2024-09-13T15:09:09.092911+0000","last_fullsized":"2024-09-13T15:09:09.092911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:48.922099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519237+0000","last_change":"2024-09-13T15:09:08.119850+0000","last_active":"2024-09-13T15:09:09.519237+0000","last_peered":"2024-09-13T15:09:09.519237+0000","last_clean":"2024-09-13T15:09:09.519237+0000","last_became_active":"2024-09-13T15:09:08.119401+0000","last_became_peered":"2024-09-13T15:09:08.119401+0000","last_unstale":"2024-09-13T15:09:09.519237+0000","last_undegraded":"2024-09-13T15:09:09.519237+0000","last_fullsized":"2024-09-13T15:09:09.519237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:19.327798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518399+0000","last_change":"2024-09-13T15:09:07.627442+0000","last_active":"2024-09-13T15:09:09.518399+0000","last_peered":"2024-09-13T15:09:09.518399+0000","last_clean":"2024-09-13T15:09:09.518399+0000","last_became_active":"2024-09-13T15:09:07.627147+0000","last_became_peered":"2024-09-13T15:09:07.627147+0000","last_unstale":"2024-09-13T15:09:09.518399+0000","last_undegraded":"2024-09-13T15:09:09.518399+0000","last_fullsized":"2024-09-13T15:09:09.518399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.093764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521919+0000","last_change":"2024-09-13T15:09:08.103782+0000","last_active":"2024-09-13T15:09:09.521919+0000","last_peered":"2024-09-13T15:09:09.521919+0000","last_clean":"2024-09-13T15:09:09.521919+0000","last_became_active":"2024-09-13T15:09:08.103041+0000","last_became_peered":"2024-09-13T15:09:08.103041+0000","last_unstale":"2024-09-13T15:09:09.521919+0000","last_undegraded":"2024-09-13T15:09:09.521919+0000","last_fullsized":"2024-09-13T15:09:09.521919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:58.604274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518646+0000","last_change":"2024-09-13T15:09:07.619938+0000","last_active":"2024-09-13T15:09:09.518646+0000","last_peered":"2024-09-13T15:09:09.518646+0000","last_clean":"2024-09-13T15:09:09.518646+0000","last_became_active":"2024-09-13T15:09:07.619708+0000","last_became_peered":"2024-09-13T15:09:07.619708+0000","last_unstale":"2024-09-13T15:09:09.518646+0000","last_undegraded":"2024-09-13T15:09:09.518646+0000","last_fullsized":"2024-09-13T15:09:09.518646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.094278+0000","last_change":"2024-09-13T15:09:08.122902+0000","last_active":"2024-09-13T15:09:09.094278+0000","last_peered":"2024-09-13T15:09:09.094278+0000","last_clean":"2024-09-13T15:09:09.094278+0000","last_became_active":"2024-09-13T15:09:08.122528+0000","last_became_peered":"2024-09-13T15:09:08.122528+0000","last_unstale":"2024-09-13T15:09:09.094278+0000","last_undegraded":"2024-09-13T15:09:09.094278+0000","last_fullsized":"2024-09-13T15:09:09.094278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:14.881753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092554+0000","last_change":"2024-09-13T15:09:07.628001+0000","last_active":"2024-09-13T15:09:09.092554+0000","last_peered":"2024-09-13T15:09:09.092554+0000","last_clean":"2024-09-13T15:09:09.092554+0000","last_became_active":"2024-09-13T15:09:07.627160+0000","last_became_peered":"2024-09-13T15:09:07.627160+0000","last_unstale":"2024-09-13T15:09:09.092554+0000","last_undegraded":"2024-09-13T15:09:09.092554+0000","last_fullsized":"2024-09-13T15:09:09.092554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:25.635676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519891+0000","last_change":"2024-09-13T15:09:08.111454+0000","last_active":"2024-09-13T15:09:09.519891+0000","last_peered":"2024-09-13T15:09:09.519891+0000","last_clean":"2024-09-13T15:09:09.519891+0000","last_became_active":"2024-09-13T15:09:08.111181+0000","last_became_peered":"2024-09-13T15:09:08.111181+0000","last_unstale":"2024-09-13T15:09:09.519891+0000","last_undegraded":"2024-09-13T15:09:09.519891+0000","last_fullsized":"2024-09-13T15:09:09.519891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:03.891708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092476+0000","last_change":"2024-09-13T15:09:07.626363+0000","last_active":"2024-09-13T15:09:09.092476+0000","last_peered":"2024-09-13T15:09:09.092476+0000","last_clean":"2024-09-13T15:09:09.092476+0000","last_became_active":"2024-09-13T15:09:07.626100+0000","last_became_peered":"2024-09-13T15:09:07.626100+0000","last_unstale":"2024-09-13T15:09:09.092476+0000","last_undegraded":"2024-09-13T15:09:09.092476+0000","last_fullsized":"2024-09-13T15:09:09.092476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:48.755245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092136+0000","last_change":"2024-09-13T15:09:08.102028+0000","last_active":"2024-09-13T15:09:09.092136+0000","last_peered":"2024-09-13T15:09:09.092136+0000","last_clean":"2024-09-13T15:09:09.092136+0000","last_became_active":"2024-09-13T15:09:08.101832+0000","last_became_peered":"2024-09-13T15:09:08.101832+0000","last_unstale":"2024-09-13T15:09:09.092136+0000","last_undegraded":"2024-09-13T15:09:09.092136+0000","last_fullsized":"2024-09-13T15:09:09.092136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:03.227472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520432+0000","last_change":"2024-09-13T15:09:07.623639+0000","last_active":"2024-09-13T15:09:09.520432+0000","last_peered":"2024-09-13T15:09:09.520432+0000","last_clean":"2024-09-13T15:09:09.520432+0000","last_became_active":"2024-09-13T15:09:07.623358+0000","last_became_peered":"2024-09-13T15:09:07.623358+0000","last_unstale":"2024-09-13T15:09:09.520432+0000","last_undegraded":"2024-09-13T15:09:09.520432+0000","last_fullsized":"2024-09-13T15:09:09.520432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:39.651758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518702+0000","last_change":"2024-09-13T15:09:08.109974+0000","last_active":"2024-09-13T15:09:09.518702+0000","last_peered":"2024-09-13T15:09:09.518702+0000","last_clean":"2024-09-13T15:09:09.518702+0000","last_became_active":"2024-09-13T15:09:08.108575+0000","last_became_peered":"2024-09-13T15:09:08.108575+0000","last_unstale":"2024-09-13T15:09:09.518702+0000","last_undegraded":"2024-09-13T15:09:09.518702+0000","last_fullsized":"2024-09-13T15:09:09.518702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:49.933549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092333+0000","last_change":"2024-09-13T15:09:07.620537+0000","last_active":"2024-09-13T15:09:09.092333+0000","last_peered":"2024-09-13T15:09:09.092333+0000","last_clean":"2024-09-13T15:09:09.092333+0000","last_became_active":"2024-09-13T15:09:07.620246+0000","last_became_peered":"2024-09-13T15:09:07.620246+0000","last_unstale":"2024-09-13T15:09:09.092333+0000","last_undegraded":"2024-09-13T15:09:09.092333+0000","last_fullsized":"2024-09-13T15:09:09.092333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:10.949944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092258+0000","last_change":"2024-09-13T15:09:08.100840+0000","last_active":"2024-09-13T15:09:09.092258+0000","last_peered":"2024-09-13T15:09:09.092258+0000","last_clean":"2024-09-13T15:09:09.092258+0000","last_became_active":"2024-09-13T15:09:08.100560+0000","last_became_peered":"2024-09-13T15:09:08.100560+0000","last_unstale":"2024-09-13T15:09:09.092258+0000","last_undegraded":"2024-09-13T15:09:09.092258+0000","last_fullsized":"2024-09-13T15:09:09.092258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:14.881753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517940+0000","last_change":"2024-09-13T15:09:07.629632+0000","last_active":"2024-09-13T15:09:09.517940+0000","last_peered":"2024-09-13T15:09:09.517940+0000","last_clean":"2024-09-13T15:09:09.517940+0000","last_became_active":"2024-09-13T15:09:07.629366+0000","last_became_peered":"2024-09-13T15:09:07.629366+0000","last_unstale":"2024-09-13T15:09:09.517940+0000","last_undegraded":"2024-09-13T15:09:09.517940+0000","last_fullsized":"2024-09-13T15:09:09.517940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:34.691952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092520+0000","last_change":"2024-09-13T15:09:08.118338+0000","last_active":"2024-09-13T15:09:09.092520+0000","last_peered":"2024-09-13T15:09:09.092520+0000","last_clean":"2024-09-13T15:09:09.092520+0000","last_became_active":"2024-09-13T15:09:08.117835+0000","last_became_peered":"2024-09-13T15:09:08.117835+0000","last_unstale":"2024-09-13T15:09:09.092520+0000","last_undegraded":"2024-09-13T15:09:09.092520+0000","last_fullsized":"2024-09-13T15:09:09.092520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:11.590698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518274+0000","last_change":"2024-09-13T15:09:07.620473+0000","last_active":"2024-09-13T15:09:09.518274+0000","last_peered":"2024-09-13T15:09:09.518274+0000","last_clean":"2024-09-13T15:09:09.518274+0000","last_became_active":"2024-09-13T15:09:07.620222+0000","last_became_peered":"2024-09-13T15:09:07.620222+0000","last_unstale":"2024-09-13T15:09:09.518274+0000","last_undegraded":"2024-09-13T15:09:09.518274+0000","last_fullsized":"2024-09-13T15:09:09.518274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:03.272663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518651+0000","last_change":"2024-09-13T15:09:08.108380+0000","last_active":"2024-09-13T15:09:09.518651+0000","last_peered":"2024-09-13T15:09:09.518651+0000","last_clean":"2024-09-13T15:09:09.518651+0000","last_became_active":"2024-09-13T15:09:08.107906+0000","last_became_peered":"2024-09-13T15:09:08.107906+0000","last_unstale":"2024-09-13T15:09:09.518651+0000","last_undegraded":"2024-09-13T15:09:09.518651+0000","last_fullsized":"2024-09-13T15:09:09.518651+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:19.327798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.094172+0000","last_change":"2024-09-13T15:09:07.616813+0000","last_active":"2024-09-13T15:09:09.094172+0000","last_peered":"2024-09-13T15:09:09.094172+0000","last_clean":"2024-09-13T15:09:09.094172+0000","last_became_active":"2024-09-13T15:09:07.616548+0000","last_became_peered":"2024-09-13T15:09:07.616548+0000","last_unstale":"2024-09-13T15:09:09.094172+0000","last_undegraded":"2024-09-13T15:09:09.094172+0000","last_fullsized":"2024-09-13T15:09:09.094172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:48.755245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093992+0000","last_change":"2024-09-13T15:09:08.117308+0000","last_active":"2024-09-13T15:09:09.093992+0000","last_peered":"2024-09-13T15:09:09.093992+0000","last_clean":"2024-09-13T15:09:09.093992+0000","last_became_active":"2024-09-13T15:09:08.116877+0000","last_became_peered":"2024-09-13T15:09:08.116877+0000","last_unstale":"2024-09-13T15:09:09.093992+0000","last_undegraded":"2024-09-13T15:09:09.093992+0000","last_fullsized":"2024-09-13T15:09:09.093992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:03.227472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520471+0000","last_change":"2024-09-13T15:09:07.627592+0000","last_active":"2024-09-13T15:09:09.520471+0000","last_peered":"2024-09-13T15:09:09.520471+0000","last_clean":"2024-09-13T15:09:09.520471+0000","last_became_active":"2024-09-13T15:09:07.626760+0000","last_became_peered":"2024-09-13T15:09:07.626760+0000","last_unstale":"2024-09-13T15:09:09.520471+0000","last_undegraded":"2024-09-13T15:09:09.520471+0000","last_fullsized":"2024-09-13T15:09:09.520471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:23.771499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522072+0000","last_change":"2024-09-13T15:09:08.110391+0000","last_active":"2024-09-13T15:09:09.522072+0000","last_peered":"2024-09-13T15:09:09.522072+0000","last_clean":"2024-09-13T15:09:09.522072+0000","last_became_active":"2024-09-13T15:09:08.109887+0000","last_became_peered":"2024-09-13T15:09:08.109887+0000","last_unstale":"2024-09-13T15:09:09.522072+0000","last_undegraded":"2024-09-13T15:09:09.522072+0000","last_fullsized":"2024-09-13T15:09:09.522072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:25.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521475+0000","last_change":"2024-09-13T15:09:07.621178+0000","last_active":"2024-09-13T15:09:09.521475+0000","last_peered":"2024-09-13T15:09:09.521475+0000","last_clean":"2024-09-13T15:09:09.521475+0000","last_became_active":"2024-09-13T15:09:07.620898+0000","last_became_peered":"2024-09-13T15:09:07.620898+0000","last_unstale":"2024-09-13T15:09:09.521475+0000","last_undegraded":"2024-09-13T15:09:09.521475+0000","last_fullsized":"2024-09-13T15:09:09.521475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.093764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518129+0000","last_change":"2024-09-13T15:09:08.106160+0000","last_active":"2024-09-13T15:09:09.518129+0000","last_peered":"2024-09-13T15:09:09.518129+0000","last_clean":"2024-09-13T15:09:09.518129+0000","last_became_active":"2024-09-13T15:09:08.105901+0000","last_became_peered":"2024-09-13T15:09:08.105901+0000","last_unstale":"2024-09-13T15:09:09.518129+0000","last_undegraded":"2024-09-13T15:09:09.518129+0000","last_fullsized":"2024-09-13T15:09:09.518129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:09.765356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521478+0000","last_change":"2024-09-13T15:09:07.621852+0000","last_active":"2024-09-13T15:09:09.521478+0000","last_peered":"2024-09-13T15:09:09.521478+0000","last_clean":"2024-09-13T15:09:09.521478+0000","last_became_active":"2024-09-13T15:09:07.621610+0000","last_became_peered":"2024-09-13T15:09:07.621610+0000","last_unstale":"2024-09-13T15:09:09.521478+0000","last_undegraded":"2024-09-13T15:09:09.521478+0000","last_fullsized":"2024-09-13T15:09:09.521478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.622419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520779+0000","last_change":"2024-09-13T15:09:08.106501+0000","last_active":"2024-09-13T15:09:09.520779+0000","last_peered":"2024-09-13T15:09:09.520779+0000","last_clean":"2024-09-13T15:09:09.520779+0000","last_became_active":"2024-09-13T15:09:08.106174+0000","last_became_peered":"2024-09-13T15:09:08.106174+0000","last_unstale":"2024-09-13T15:09:09.520779+0000","last_undegraded":"2024-09-13T15:09:09.520779+0000","last_fullsized":"2024-09-13T15:09:09.520779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520118+0000","last_change":"2024-09-13T15:09:07.618760+0000","last_active":"2024-09-13T15:09:09.520118+0000","last_peered":"2024-09-13T15:09:09.520118+0000","last_clean":"2024-09-13T15:09:09.520118+0000","last_became_active":"2024-09-13T15:09:07.618464+0000","last_became_peered":"2024-09-13T15:09:07.618464+0000","last_unstale":"2024-09-13T15:09:09.520118+0000","last_undegraded":"2024-09-13T15:09:09.520118+0000","last_fullsized":"2024-09-13T15:09:09.520118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:51.141908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517836+0000","last_change":"2024-09-13T15:09:08.120992+0000","last_active":"2024-09-13T15:09:09.517836+0000","last_peered":"2024-09-13T15:09:09.517836+0000","last_clean":"2024-09-13T15:09:09.517836+0000","last_became_active":"2024-09-13T15:09:08.120731+0000","last_became_peered":"2024-09-13T15:09:08.120731+0000","last_unstale":"2024-09-13T15:09:09.517836+0000","last_undegraded":"2024-09-13T15:09:09.517836+0000","last_fullsized":"2024-09-13T15:09:09.517836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:07.829895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518597+0000","last_change":"2024-09-13T15:09:07.626228+0000","last_active":"2024-09-13T15:09:09.518597+0000","last_peered":"2024-09-13T15:09:09.518597+0000","last_clean":"2024-09-13T15:09:09.518597+0000","last_became_active":"2024-09-13T15:09:07.625990+0000","last_became_peered":"2024-09-13T15:09:07.625990+0000","last_unstale":"2024-09-13T15:09:09.518597+0000","last_undegraded":"2024-09-13T15:09:09.518597+0000","last_fullsized":"2024-09-13T15:09:09.518597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:03.272663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092507+0000","last_change":"2024-09-13T15:09:08.103395+0000","last_active":"2024-09-13T15:09:09.092507+0000","last_peered":"2024-09-13T15:09:09.092507+0000","last_clean":"2024-09-13T15:09:09.092507+0000","last_became_active":"2024-09-13T15:09:08.102833+0000","last_became_peered":"2024-09-13T15:09:08.102833+0000","last_unstale":"2024-09-13T15:09:09.092507+0000","last_undegraded":"2024-09-13T15:09:09.092507+0000","last_fullsized":"2024-09-13T15:09:09.092507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:32.684698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520568+0000","last_change":"2024-09-13T15:09:07.617905+0000","last_active":"2024-09-13T15:09:09.520568+0000","last_peered":"2024-09-13T15:09:09.520568+0000","last_clean":"2024-09-13T15:09:09.520568+0000","last_became_active":"2024-09-13T15:09:07.617600+0000","last_became_peered":"2024-09-13T15:09:07.617600+0000","last_unstale":"2024-09-13T15:09:09.520568+0000","last_undegraded":"2024-09-13T15:09:09.520568+0000","last_fullsized":"2024-09-13T15:09:09.520568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:10.949944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521270+0000","last_change":"2024-09-13T15:09:08.116550+0000","last_active":"2024-09-13T15:09:09.521270+0000","last_peered":"2024-09-13T15:09:09.521270+0000","last_clean":"2024-09-13T15:09:09.521270+0000","last_became_active":"2024-09-13T15:09:08.116279+0000","last_became_peered":"2024-09-13T15:09:08.116279+0000","last_unstale":"2024-09-13T15:09:09.521270+0000","last_undegraded":"2024-09-13T15:09:09.521270+0000","last_fullsized":"2024-09-13T15:09:09.521270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:26.647126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518980+0000","last_change":"2024-09-13T15:09:07.621616+0000","last_active":"2024-09-13T15:09:09.518980+0000","last_peered":"2024-09-13T15:09:09.518980+0000","last_clean":"2024-09-13T15:09:09.518980+0000","last_became_active":"2024-09-13T15:09:07.621360+0000","last_became_peered":"2024-09-13T15:09:07.621360+0000","last_unstale":"2024-09-13T15:09:09.518980+0000","last_undegraded":"2024-09-13T15:09:09.518980+0000","last_fullsized":"2024-09-13T15:09:09.518980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:33.992916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519217+0000","last_change":"2024-09-13T15:09:08.119686+0000","last_active":"2024-09-13T15:09:09.519217+0000","last_peered":"2024-09-13T15:09:09.519217+0000","last_clean":"2024-09-13T15:09:09.519217+0000","last_became_active":"2024-09-13T15:09:08.119078+0000","last_became_peered":"2024-09-13T15:09:08.119078+0000","last_unstale":"2024-09-13T15:09:09.519217+0000","last_undegraded":"2024-09-13T15:09:09.519217+0000","last_fullsized":"2024-09-13T15:09:09.519217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:25.131000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.793947+0000","last_change":"2024-09-13T15:09:07.615050+0000","last_active":"2024-09-13T15:09:09.793947+0000","last_peered":"2024-09-13T15:09:09.793947+0000","last_clean":"2024-09-13T15:09:09.793947+0000","last_became_active":"2024-09-13T15:09:07.614809+0000","last_became_peered":"2024-09-13T15:09:07.614809+0000","last_unstale":"2024-09-13T15:09:09.793947+0000","last_undegraded":"2024-09-13T15:09:09.793947+0000","last_fullsized":"2024-09-13T15:09:09.793947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:18.075903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092692+0000","last_change":"2024-09-13T15:09:08.124905+0000","last_active":"2024-09-13T15:09:09.092692+0000","last_peered":"2024-09-13T15:09:09.092692+0000","last_clean":"2024-09-13T15:09:09.092692+0000","last_became_active":"2024-09-13T15:09:08.124661+0000","last_became_peered":"2024-09-13T15:09:08.124661+0000","last_unstale":"2024-09-13T15:09:09.092692+0000","last_undegraded":"2024-09-13T15:09:09.092692+0000","last_fullsized":"2024-09-13T15:09:09.092692+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:59.463810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521579+0000","last_change":"2024-09-13T15:09:07.620500+0000","last_active":"2024-09-13T15:09:09.521579+0000","last_peered":"2024-09-13T15:09:09.521579+0000","last_clean":"2024-09-13T15:09:09.521579+0000","last_became_active":"2024-09-13T15:09:07.619788+0000","last_became_peered":"2024-09-13T15:09:07.619788+0000","last_unstale":"2024-09-13T15:09:09.521579+0000","last_undegraded":"2024-09-13T15:09:09.521579+0000","last_fullsized":"2024-09-13T15:09:09.521579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:00.419739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520114+0000","last_change":"2024-09-13T15:09:08.104073+0000","last_active":"2024-09-13T15:09:09.520114+0000","last_peered":"2024-09-13T15:09:09.520114+0000","last_clean":"2024-09-13T15:09:09.520114+0000","last_became_active":"2024-09-13T15:09:08.103844+0000","last_became_peered":"2024-09-13T15:09:08.103844+0000","last_unstale":"2024-09-13T15:09:09.520114+0000","last_undegraded":"2024-09-13T15:09:09.520114+0000","last_fullsized":"2024-09-13T15:09:09.520114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:06.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521378+0000","last_change":"2024-09-13T15:09:07.624987+0000","last_active":"2024-09-13T15:09:09.521378+0000","last_peered":"2024-09-13T15:09:09.521378+0000","last_clean":"2024-09-13T15:09:09.521378+0000","last_became_active":"2024-09-13T15:09:07.624734+0000","last_became_peered":"2024-09-13T15:09:07.624734+0000","last_unstale":"2024-09-13T15:09:09.521378+0000","last_undegraded":"2024-09-13T15:09:09.521378+0000","last_fullsized":"2024-09-13T15:09:09.521378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:33.369685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520788+0000","last_change":"2024-09-13T15:09:08.120601+0000","last_active":"2024-09-13T15:09:09.520788+0000","last_peered":"2024-09-13T15:09:09.520788+0000","last_clean":"2024-09-13T15:09:09.520788+0000","last_became_active":"2024-09-13T15:09:08.120255+0000","last_became_peered":"2024-09-13T15:09:08.120255+0000","last_unstale":"2024-09-13T15:09:09.520788+0000","last_undegraded":"2024-09-13T15:09:09.520788+0000","last_fullsized":"2024-09-13T15:09:09.520788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:09.765356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092606+0000","last_change":"2024-09-13T15:09:07.617846+0000","last_active":"2024-09-13T15:09:09.092606+0000","last_peered":"2024-09-13T15:09:09.092606+0000","last_clean":"2024-09-13T15:09:09.092606+0000","last_became_active":"2024-09-13T15:09:07.617571+0000","last_became_peered":"2024-09-13T15:09:07.617571+0000","last_unstale":"2024-09-13T15:09:09.092606+0000","last_undegraded":"2024-09-13T15:09:09.092606+0000","last_fullsized":"2024-09-13T15:09:09.092606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:51.141908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093495+0000","last_change":"2024-09-13T15:09:08.113413+0000","last_active":"2024-09-13T15:09:09.093495+0000","last_peered":"2024-09-13T15:09:09.093495+0000","last_clean":"2024-09-13T15:09:09.093495+0000","last_became_active":"2024-09-13T15:09:08.112905+0000","last_became_peered":"2024-09-13T15:09:08.112905+0000","last_unstale":"2024-09-13T15:09:09.093495+0000","last_undegraded":"2024-09-13T15:09:09.093495+0000","last_fullsized":"2024-09-13T15:09:09.093495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:47.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093930+0000","last_change":"2024-09-13T15:09:07.619683+0000","last_active":"2024-09-13T15:09:09.093930+0000","last_peered":"2024-09-13T15:09:09.093930+0000","last_clean":"2024-09-13T15:09:09.093930+0000","last_became_active":"2024-09-13T15:09:07.619329+0000","last_became_peered":"2024-09-13T15:09:07.619329+0000","last_unstale":"2024-09-13T15:09:09.093930+0000","last_undegraded":"2024-09-13T15:09:09.093930+0000","last_fullsized":"2024-09-13T15:09:09.093930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:48.922099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519029+0000","last_change":"2024-09-13T15:09:08.118486+0000","last_active":"2024-09-13T15:09:09.519029+0000","last_peered":"2024-09-13T15:09:09.519029+0000","last_clean":"2024-09-13T15:09:09.519029+0000","last_became_active":"2024-09-13T15:09:08.118214+0000","last_became_peered":"2024-09-13T15:09:08.118214+0000","last_unstale":"2024-09-13T15:09:09.519029+0000","last_undegraded":"2024-09-13T15:09:09.519029+0000","last_fullsized":"2024-09-13T15:09:09.519029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:49.766695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092226+0000","last_change":"2024-09-13T15:09:07.625226+0000","last_active":"2024-09-13T15:09:09.092226+0000","last_peered":"2024-09-13T15:09:09.092226+0000","last_clean":"2024-09-13T15:09:09.092226+0000","last_became_active":"2024-09-13T15:09:07.624996+0000","last_became_peered":"2024-09-13T15:09:07.624996+0000","last_unstale":"2024-09-13T15:09:09.092226+0000","last_undegraded":"2024-09-13T15:09:09.092226+0000","last_fullsized":"2024-09-13T15:09:09.092226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:08.753906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518223+0000","last_change":"2024-09-13T15:09:08.112050+0000","last_active":"2024-09-13T15:09:09.518223+0000","last_peered":"2024-09-13T15:09:09.518223+0000","last_clean":"2024-09-13T15:09:09.518223+0000","last_became_active":"2024-09-13T15:09:08.111785+0000","last_became_peered":"2024-09-13T15:09:08.111785+0000","last_unstale":"2024-09-13T15:09:09.518223+0000","last_undegraded":"2024-09-13T15:09:09.518223+0000","last_fullsized":"2024-09-13T15:09:09.518223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:25.131000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519321+0000","last_change":"2024-09-13T15:09:07.627606+0000","last_active":"2024-09-13T15:09:09.519321+0000","last_peered":"2024-09-13T15:09:09.519321+0000","last_clean":"2024-09-13T15:09:09.519321+0000","last_became_active":"2024-09-13T15:09:07.627099+0000","last_became_peered":"2024-09-13T15:09:07.627099+0000","last_unstale":"2024-09-13T15:09:09.519321+0000","last_undegraded":"2024-09-13T15:09:09.519321+0000","last_fullsized":"2024-09-13T15:09:09.519321+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:01.520110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T15:09:08.095898+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:09:08.095898+0000","last_peered":"2024-09-13T15:09:08.095898+0000","last_clean":"2024-09-13T15:09:08.095898+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:09:08.095898+0000","last_undegraded":"2024-09-13T15:09:08.095898+0000","last_fullsized":"2024-09-13T15:09:08.095898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":786109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.341},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.53}]},{"osd":1,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.034}]},{"osd":2,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.149}]},{"osd":3,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.22},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.3839999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.254},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88}]},{"osd":5,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.9169999999999998,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3120000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"min":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.411},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.4299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.206},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.3300000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.764}]},{"osd":2,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.5780000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":1.639}]},{"osd":4,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":1.423},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.609}]},{"osd":5,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.464},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.929}]},{"osd":7,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.7969999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.4390000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.393},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.161},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4610000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.194},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":1.165,"5min":1.165,"15min":1.165},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.504}]},{"osd":4,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":3.117,"5min":3.117,"15min":3.117},"last":1.248}]},{"osd":6,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.131},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.2729999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.84699999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.087}]},{"osd":2,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.417}]},{"osd":3,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.3620000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1899999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.032},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.135},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.3100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":462848,"data_stored":194686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.04}]},{"osd":1,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.385},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.996}]},{"osd":2,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.325},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.4299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":2.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":2.2200000000000002},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2989999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.3090000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":5.1900000000000004,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.5},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.476}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":454656,"data_stored":194177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.401},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.131},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":5.3940000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.907}]},{"osd":6,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.992},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.756}]},{"osd":7,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.829},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.502}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":454656,"data_stored":194197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.0489999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.288}]},{"osd":6,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":4.843,"5min":4.843,"15min":4.843},"last":1.2749999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":4.9489999999999998,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.452},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.385}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":1044480,"data_stored":783490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.5229999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.3170000000000002,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.998}]},{"osd":3,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.089},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.4239999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.5760000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.405},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.228}]},{"osd":6,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":2.9700000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.339}]},{"osd":7,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.365}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:09:12.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:09:12.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 Processor -- start 2024-09-13T15:09:12.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 -- start start 2024-09-13T15:09:12.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ac00cb020 0x7f3ac00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 0x7f3ac015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ac006aaa0 0x7f3ac006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac006b450 con 0x7f3ac006aaa0 2024-09-13T15:09:12.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac00b2ad0 con 0x7f3ac00cb020 2024-09-13T15:09:12.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abfe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac015b960 con 0x7f3ac015c2a0 2024-09-13T15:09:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abf400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ac006aaa0 0x7f3ac006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 0x7f3ac015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ac00cb020 0x7f3ac00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ac00cb020 0x7f3ac00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:50156/0 (socket says 172.21.15.50:50156) 2024-09-13T15:09:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 0x7f3ac015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58994/0 (socket says 172.21.15.50:58994) 2024-09-13T15:09:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abea00700 1 -- 172.21.15.50:0/429572476 learned_addr learned my addr 172.21.15.50:0/429572476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 -- 172.21.15.50:0/429572476 >> v2:172.21.15.181:3300/0 conn(0x7f3ac00cb020 msgr2=0x7f3ac00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 --2- 172.21.15.50:0/429572476 >> v2:172.21.15.181:3300/0 conn(0x7f3ac00cb020 0x7f3ac00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 -- 172.21.15.50:0/429572476 >> v2:172.21.15.50:3300/0 conn(0x7f3ac006aaa0 msgr2=0x7f3ac006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 --2- 172.21.15.50:0/429572476 >> v2:172.21.15.50:3300/0 conn(0x7f3ac006aaa0 0x7f3ac006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 -- 172.21.15.50:0/429572476 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac015bc40 con 0x7f3ac015c2a0 2024-09-13T15:09:12.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.671+0000 7f3abe000700 1 --2- 172.21.15.50:0/429572476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 0x7f3ac015b0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ac006b660 tx=0x7f3aac009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e270e780bb1d670d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:12.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abd600700 1 -- 172.21.15.50:0/429572476 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011830 con 0x7f3ac015c2a0 2024-09-13T15:09:12.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abd600700 1 -- 172.21.15.50:0/429572476 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac011990 con 0x7f3ac015c2a0 2024-09-13T15:09:12.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abd600700 1 -- 172.21.15.50:0/429572476 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011d20 con 0x7f3ac015c2a0 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 -- 172.21.15.50:0/429572476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 msgr2=0x7f3ac015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 --2- 172.21.15.50:0/429572476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 0x7f3ac015b0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ac006b660 tx=0x7f3aac009b30 comp rx=0 tx=0).stop 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 -- 172.21.15.50:0/429572476 shutdown_connections 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 --2- 172.21.15.50:0/429572476 >> v2:172.21.15.50:3300/0 conn(0x7f3ac006aaa0 0x7f3ac006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 --2- 172.21.15.50:0/429572476 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac015c2a0 0x7f3ac015b0e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 --2- 172.21.15.50:0/429572476 >> v2:172.21.15.181:3300/0 conn(0x7f3ac00cb020 0x7f3ac00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 -- 172.21.15.50:0/429572476 >> 172.21.15.50:0/429572476 conn(0x7f3ac00b0c40 msgr2=0x7f3ac006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 -- 172.21.15.50:0/429572476 shutdown_connections 2024-09-13T15:09:12.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.675+0000 7f3abfe00700 1 -- 172.21.15.50:0/429572476 wait complete. 2024-09-13T15:09:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 Processor -- start 2024-09-13T15:09:12.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 -- start start 2024-09-13T15:09:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 0x7f3ac0143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 0x7f3ac0157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac015c2a0 0x7f3ac00c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac01f2190 con 0x7f3ac00cb020 2024-09-13T15:09:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac0157c90 con 0x7f3ac015c2a0 2024-09-13T15:09:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.679+0000 7f3abfe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac01f2380 con 0x7f3ac006aaa0 2024-09-13T15:09:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 0x7f3ac0157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 0x7f3ac0143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 0x7f3ac0157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47858/0 (socket says 172.21.15.50:47858) 2024-09-13T15:09:12.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 -- 172.21.15.50:0/1814325022 learned_addr learned my addr 172.21.15.50:0/1814325022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:12.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abea00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 0x7f3ac0143420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:59000/0 (socket says 172.21.15.50:59000) 2024-09-13T15:09:12.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abf400700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac015c2a0 0x7f3ac00c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 -- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 msgr2=0x7f3ac0143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 0x7f3ac0143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 -- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac015c2a0 msgr2=0x7f3ac00c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac015c2a0 0x7f3ac00c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 -- 172.21.15.50:0/1814325022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0094b0 con 0x7f3ac00cb020 2024-09-13T15:09:12.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abea00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 0x7f3ac0143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abe000700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 0x7f3ac0157420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0090b0 tx=0x7f3aac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac004310 con 0x7f3ac00cb020 2024-09-13T15:09:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac01f070 con 0x7f3ac00cb020 2024-09-13T15:09:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac01f2660 con 0x7f3ac00cb020 2024-09-13T15:09:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0036c0 con 0x7f3ac00cb020 2024-09-13T15:09:12.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac0157f70 con 0x7f3ac00cb020 2024-09-13T15:09:12.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.683+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac01f2b80 con 0x7f3ac00cb020 2024-09-13T15:09:12.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.687+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3aac021030 con 0x7f3ac00cb020 2024-09-13T15:09:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.687+0000 7f3ab6a00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3aa0066730 0x7f3aa0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.687+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3aac085420 con 0x7f3ac00cb020 2024-09-13T15:09:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.691+0000 7f3abea00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3aa0066730 0x7f3aa0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.691+0000 7f3abea00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3aa0066730 0x7f3aa0068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00b0570 tx=0x7f3ab00092e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:12.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.695+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ac01f2b80 con 0x7f3ac00cb020 2024-09-13T15:09:12.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.883+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ac015b620 con 0x7f3aa0066730 2024-09-13T15:09:12.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.895+0000 7f3ab6a00700 1 -- 172.21.15.50:0/1814325022 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286040 (secure 0 0 0) 0x7f3ab0011c70 con 0x7f3aa0066730 2024-09-13T15:09:12.904 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3aa0066730 msgr2=0x7f3aa0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3aa0066730 0x7f3aa0068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00b0570 tx=0x7f3ab00092e0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 msgr2=0x7f3ac0157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 0x7f3ac0157420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0090b0 tx=0x7f3aac004770 comp rx=0 tx=0).stop 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 shutdown_connections 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3aa0066730 0x7f3aa0068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac015c2a0 0x7f3ac00c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac00cb020 0x7f3ac0157420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 --2- 172.21.15.50:0/1814325022 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ac006aaa0 0x7f3ac0143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 >> 172.21.15.50:0/1814325022 conn(0x7f3ac00b0c40 msgr2=0x7f3ac015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 shutdown_connections 2024-09-13T15:09:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:12.907+0000 7f3abfe00700 1 -- 172.21.15.50:0/1814325022 wait complete. 2024-09-13T15:09:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:09:12.935 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-13T15:09:12.043565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237332,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737388,"statfs":{"total":773094113280,"available":772851085312,"internally_reserved":0,"allocated":4845568,"data_stored":2735259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.453947"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092940+0000","last_change":"2024-09-13T15:09:08.108752+0000","last_active":"2024-09-13T15:09:09.092940+0000","last_peered":"2024-09-13T15:09:09.092940+0000","last_clean":"2024-09-13T15:09:09.092940+0000","last_became_active":"2024-09-13T15:09:08.108504+0000","last_became_peered":"2024-09-13T15:09:08.108504+0000","last_unstale":"2024-09-13T15:09:09.092940+0000","last_undegraded":"2024-09-13T15:09:09.092940+0000","last_fullsized":"2024-09-13T15:09:09.092940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:38.743237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092708+0000","last_change":"2024-09-13T15:09:08.116469+0000","last_active":"2024-09-13T15:09:09.092708+0000","last_peered":"2024-09-13T15:09:09.092708+0000","last_clean":"2024-09-13T15:09:09.092708+0000","last_became_active":"2024-09-13T15:09:08.115732+0000","last_became_peered":"2024-09-13T15:09:08.115732+0000","last_unstale":"2024-09-13T15:09:09.092708+0000","last_undegraded":"2024-09-13T15:09:09.092708+0000","last_fullsized":"2024-09-13T15:09:09.092708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:39.337602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521250+0000","last_change":"2024-09-13T15:09:08.108000+0000","last_active":"2024-09-13T15:09:09.521250+0000","last_peered":"2024-09-13T15:09:09.521250+0000","last_clean":"2024-09-13T15:09:09.521250+0000","last_became_active":"2024-09-13T15:09:08.107732+0000","last_became_peered":"2024-09-13T15:09:08.107732+0000","last_unstale":"2024-09-13T15:09:09.521250+0000","last_undegraded":"2024-09-13T15:09:09.521250+0000","last_fullsized":"2024-09-13T15:09:09.521250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:45.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521976+0000","last_change":"2024-09-13T15:09:08.125616+0000","last_active":"2024-09-13T15:09:09.521976+0000","last_peered":"2024-09-13T15:09:09.521976+0000","last_clean":"2024-09-13T15:09:09.521976+0000","last_became_active":"2024-09-13T15:09:08.125352+0000","last_became_peered":"2024-09-13T15:09:08.125352+0000","last_unstale":"2024-09-13T15:09:09.521976+0000","last_undegraded":"2024-09-13T15:09:09.521976+0000","last_fullsized":"2024-09-13T15:09:09.521976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:01.530890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521265+0000","last_change":"2024-09-13T15:09:08.115714+0000","last_active":"2024-09-13T15:09:09.521265+0000","last_peered":"2024-09-13T15:09:09.521265+0000","last_clean":"2024-09-13T15:09:09.521265+0000","last_became_active":"2024-09-13T15:09:08.115470+0000","last_became_peered":"2024-09-13T15:09:08.115470+0000","last_unstale":"2024-09-13T15:09:09.521265+0000","last_undegraded":"2024-09-13T15:09:09.521265+0000","last_fullsized":"2024-09-13T15:09:09.521265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:59.049097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520222+0000","last_change":"2024-09-13T15:09:08.118121+0000","last_active":"2024-09-13T15:09:09.520222+0000","last_peered":"2024-09-13T15:09:09.520222+0000","last_clean":"2024-09-13T15:09:09.520222+0000","last_became_active":"2024-09-13T15:09:08.117862+0000","last_became_peered":"2024-09-13T15:09:08.117862+0000","last_unstale":"2024-09-13T15:09:09.520222+0000","last_undegraded":"2024-09-13T15:09:09.520222+0000","last_fullsized":"2024-09-13T15:09:09.520222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:49.933549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517523+0000","last_change":"2024-09-13T15:09:08.118048+0000","last_active":"2024-09-13T15:09:09.517523+0000","last_peered":"2024-09-13T15:09:09.517523+0000","last_clean":"2024-09-13T15:09:09.517523+0000","last_became_active":"2024-09-13T15:09:08.117730+0000","last_became_peered":"2024-09-13T15:09:08.117730+0000","last_unstale":"2024-09-13T15:09:09.517523+0000","last_undegraded":"2024-09-13T15:09:09.517523+0000","last_fullsized":"2024-09-13T15:09:09.517523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:02:45.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092106+0000","last_change":"2024-09-13T15:09:08.121117+0000","last_active":"2024-09-13T15:09:09.092106+0000","last_peered":"2024-09-13T15:09:09.092106+0000","last_clean":"2024-09-13T15:09:09.092106+0000","last_became_active":"2024-09-13T15:09:08.120860+0000","last_became_peered":"2024-09-13T15:09:08.120860+0000","last_unstale":"2024-09-13T15:09:09.092106+0000","last_undegraded":"2024-09-13T15:09:09.092106+0000","last_fullsized":"2024-09-13T15:09:09.092106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:06.263823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522072+0000","last_change":"2024-09-13T15:09:08.123287+0000","last_active":"2024-09-13T15:09:09.522072+0000","last_peered":"2024-09-13T15:09:09.522072+0000","last_clean":"2024-09-13T15:09:09.522072+0000","last_became_active":"2024-09-13T15:09:08.122978+0000","last_became_peered":"2024-09-13T15:09:08.122978+0000","last_unstale":"2024-09-13T15:09:09.522072+0000","last_undegraded":"2024-09-13T15:09:09.522072+0000","last_fullsized":"2024-09-13T15:09:09.522072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:11.590698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518280+0000","last_change":"2024-09-13T15:09:08.104805+0000","last_active":"2024-09-13T15:09:09.518280+0000","last_peered":"2024-09-13T15:09:09.518280+0000","last_clean":"2024-09-13T15:09:09.518280+0000","last_became_active":"2024-09-13T15:09:08.104559+0000","last_became_peered":"2024-09-13T15:09:08.104559+0000","last_unstale":"2024-09-13T15:09:09.518280+0000","last_undegraded":"2024-09-13T15:09:09.518280+0000","last_fullsized":"2024-09-13T15:09:09.518280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:58.604274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518495+0000","last_change":"2024-09-13T15:09:08.121891+0000","last_active":"2024-09-13T15:09:09.518495+0000","last_peered":"2024-09-13T15:09:09.518495+0000","last_clean":"2024-09-13T15:09:09.518495+0000","last_became_active":"2024-09-13T15:09:08.121563+0000","last_became_peered":"2024-09-13T15:09:08.121563+0000","last_unstale":"2024-09-13T15:09:09.518495+0000","last_undegraded":"2024-09-13T15:09:09.518495+0000","last_fullsized":"2024-09-13T15:09:09.518495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:49.933549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521597+0000","last_change":"2024-09-13T15:09:08.100907+0000","last_active":"2024-09-13T15:09:09.521597+0000","last_peered":"2024-09-13T15:09:09.521597+0000","last_clean":"2024-09-13T15:09:09.521597+0000","last_became_active":"2024-09-13T15:09:08.100622+0000","last_became_peered":"2024-09-13T15:09:08.100622+0000","last_unstale":"2024-09-13T15:09:09.521597+0000","last_undegraded":"2024-09-13T15:09:09.521597+0000","last_fullsized":"2024-09-13T15:09:09.521597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.982745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517884+0000","last_change":"2024-09-13T15:09:08.105022+0000","last_active":"2024-09-13T15:09:09.517884+0000","last_peered":"2024-09-13T15:09:09.517884+0000","last_clean":"2024-09-13T15:09:09.517884+0000","last_became_active":"2024-09-13T15:09:08.104235+0000","last_became_peered":"2024-09-13T15:09:08.104235+0000","last_unstale":"2024-09-13T15:09:09.517884+0000","last_undegraded":"2024-09-13T15:09:09.517884+0000","last_fullsized":"2024-09-13T15:09:09.517884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:11.590698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093317+0000","last_change":"2024-09-13T15:09:08.126147+0000","last_active":"2024-09-13T15:09:09.093317+0000","last_peered":"2024-09-13T15:09:09.093317+0000","last_clean":"2024-09-13T15:09:09.093317+0000","last_became_active":"2024-09-13T15:09:08.125743+0000","last_became_peered":"2024-09-13T15:09:08.125743+0000","last_unstale":"2024-09-13T15:09:09.093317+0000","last_undegraded":"2024-09-13T15:09:09.093317+0000","last_fullsized":"2024-09-13T15:09:09.093317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:06.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517672+0000","last_change":"2024-09-13T15:09:08.109364+0000","last_active":"2024-09-13T15:09:09.517672+0000","last_peered":"2024-09-13T15:09:09.517672+0000","last_clean":"2024-09-13T15:09:09.517672+0000","last_became_active":"2024-09-13T15:09:08.106994+0000","last_became_peered":"2024-09-13T15:09:08.106994+0000","last_unstale":"2024-09-13T15:09:09.517672+0000","last_undegraded":"2024-09-13T15:09:09.517672+0000","last_fullsized":"2024-09-13T15:09:09.517672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.982745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517750+0000","last_change":"2024-09-13T15:09:08.114336+0000","last_active":"2024-09-13T15:09:09.517750+0000","last_peered":"2024-09-13T15:09:09.517750+0000","last_clean":"2024-09-13T15:09:09.517750+0000","last_became_active":"2024-09-13T15:09:08.113918+0000","last_became_peered":"2024-09-13T15:09:08.113918+0000","last_unstale":"2024-09-13T15:09:09.517750+0000","last_undegraded":"2024-09-13T15:09:09.517750+0000","last_fullsized":"2024-09-13T15:09:09.517750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:07.829895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519194+0000","last_change":"2024-09-13T15:09:08.121684+0000","last_active":"2024-09-13T15:09:09.519194+0000","last_peered":"2024-09-13T15:09:09.519194+0000","last_clean":"2024-09-13T15:09:09.519194+0000","last_became_active":"2024-09-13T15:09:08.121393+0000","last_became_peered":"2024-09-13T15:09:08.121393+0000","last_unstale":"2024-09-13T15:09:09.519194+0000","last_undegraded":"2024-09-13T15:09:09.519194+0000","last_fullsized":"2024-09-13T15:09:09.519194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093165+0000","last_change":"2024-09-13T15:09:08.123854+0000","last_active":"2024-09-13T15:09:09.093165+0000","last_peered":"2024-09-13T15:09:09.093165+0000","last_clean":"2024-09-13T15:09:09.093165+0000","last_became_active":"2024-09-13T15:09:08.123521+0000","last_became_peered":"2024-09-13T15:09:08.123521+0000","last_unstale":"2024-09-13T15:09:09.093165+0000","last_undegraded":"2024-09-13T15:09:09.093165+0000","last_fullsized":"2024-09-13T15:09:09.093165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:01.530890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520373+0000","last_change":"2024-09-13T15:09:08.112057+0000","last_active":"2024-09-13T15:09:09.520373+0000","last_peered":"2024-09-13T15:09:09.520373+0000","last_clean":"2024-09-13T15:09:09.520373+0000","last_became_active":"2024-09-13T15:09:08.111811+0000","last_became_peered":"2024-09-13T15:09:08.111811+0000","last_unstale":"2024-09-13T15:09:09.520373+0000","last_undegraded":"2024-09-13T15:09:09.520373+0000","last_fullsized":"2024-09-13T15:09:09.520373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:14.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093839+0000","last_change":"2024-09-13T15:09:08.121799+0000","last_active":"2024-09-13T15:09:09.093839+0000","last_peered":"2024-09-13T15:09:09.093839+0000","last_clean":"2024-09-13T15:09:09.093839+0000","last_became_active":"2024-09-13T15:09:08.121543+0000","last_became_peered":"2024-09-13T15:09:08.121543+0000","last_unstale":"2024-09-13T15:09:09.093839+0000","last_undegraded":"2024-09-13T15:09:09.093839+0000","last_fullsized":"2024-09-13T15:09:09.093839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:59.049097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517604+0000","last_change":"2024-09-13T15:09:08.109478+0000","last_active":"2024-09-13T15:09:09.517604+0000","last_peered":"2024-09-13T15:09:09.517604+0000","last_clean":"2024-09-13T15:09:09.517604+0000","last_became_active":"2024-09-13T15:09:08.109198+0000","last_became_peered":"2024-09-13T15:09:08.109198+0000","last_unstale":"2024-09-13T15:09:09.517604+0000","last_undegraded":"2024-09-13T15:09:09.517604+0000","last_fullsized":"2024-09-13T15:09:09.517604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:42.324479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093779+0000","last_change":"2024-09-13T15:09:08.125980+0000","last_active":"2024-09-13T15:09:09.093779+0000","last_peered":"2024-09-13T15:09:09.093779+0000","last_clean":"2024-09-13T15:09:09.093779+0000","last_became_active":"2024-09-13T15:09:08.124710+0000","last_became_peered":"2024-09-13T15:09:08.124710+0000","last_unstale":"2024-09-13T15:09:09.093779+0000","last_undegraded":"2024-09-13T15:09:09.093779+0000","last_fullsized":"2024-09-13T15:09:09.093779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:58.604274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517573+0000","last_change":"2024-09-13T15:09:08.107932+0000","last_active":"2024-09-13T15:09:09.517573+0000","last_peered":"2024-09-13T15:09:09.517573+0000","last_clean":"2024-09-13T15:09:09.517573+0000","last_became_active":"2024-09-13T15:09:08.107400+0000","last_became_peered":"2024-09-13T15:09:08.107400+0000","last_unstale":"2024-09-13T15:09:09.517573+0000","last_undegraded":"2024-09-13T15:09:09.517573+0000","last_fullsized":"2024-09-13T15:09:09.517573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:26.647126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520374+0000","last_change":"2024-09-13T15:09:08.107951+0000","last_active":"2024-09-13T15:09:09.520374+0000","last_peered":"2024-09-13T15:09:09.520374+0000","last_clean":"2024-09-13T15:09:09.520374+0000","last_became_active":"2024-09-13T15:09:08.107696+0000","last_became_peered":"2024-09-13T15:09:08.107696+0000","last_unstale":"2024-09-13T15:09:09.520374+0000","last_undegraded":"2024-09-13T15:09:09.520374+0000","last_fullsized":"2024-09-13T15:09:09.520374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:40.663208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092949+0000","last_change":"2024-09-13T15:09:08.116062+0000","last_active":"2024-09-13T15:09:09.092949+0000","last_peered":"2024-09-13T15:09:09.092949+0000","last_clean":"2024-09-13T15:09:09.092949+0000","last_became_active":"2024-09-13T15:09:08.115720+0000","last_became_peered":"2024-09-13T15:09:08.115720+0000","last_unstale":"2024-09-13T15:09:09.092949+0000","last_undegraded":"2024-09-13T15:09:09.092949+0000","last_fullsized":"2024-09-13T15:09:09.092949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:40.663208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521265+0000","last_change":"2024-09-13T15:09:08.116450+0000","last_active":"2024-09-13T15:09:09.521265+0000","last_peered":"2024-09-13T15:09:09.521265+0000","last_clean":"2024-09-13T15:09:09.521265+0000","last_became_active":"2024-09-13T15:09:08.116126+0000","last_became_peered":"2024-09-13T15:09:08.116126+0000","last_unstale":"2024-09-13T15:09:09.521265+0000","last_undegraded":"2024-09-13T15:09:09.521265+0000","last_fullsized":"2024-09-13T15:09:09.521265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:25.131000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092988+0000","last_change":"2024-09-13T15:09:08.118510+0000","last_active":"2024-09-13T15:09:09.092988+0000","last_peered":"2024-09-13T15:09:09.092988+0000","last_clean":"2024-09-13T15:09:09.092988+0000","last_became_active":"2024-09-13T15:09:08.118329+0000","last_became_peered":"2024-09-13T15:09:08.118329+0000","last_unstale":"2024-09-13T15:09:09.092988+0000","last_undegraded":"2024-09-13T15:09:09.092988+0000","last_fullsized":"2024-09-13T15:09:09.092988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:43.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518104+0000","last_change":"2024-09-13T15:09:08.117138+0000","last_active":"2024-09-13T15:09:09.518104+0000","last_peered":"2024-09-13T15:09:09.518104+0000","last_clean":"2024-09-13T15:09:09.518104+0000","last_became_active":"2024-09-13T15:09:08.116911+0000","last_became_peered":"2024-09-13T15:09:08.116911+0000","last_unstale":"2024-09-13T15:09:09.518104+0000","last_undegraded":"2024-09-13T15:09:09.518104+0000","last_fullsized":"2024-09-13T15:09:09.518104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092445+0000","last_change":"2024-09-13T15:09:08.110727+0000","last_active":"2024-09-13T15:09:09.092445+0000","last_peered":"2024-09-13T15:09:09.092445+0000","last_clean":"2024-09-13T15:09:09.092445+0000","last_became_active":"2024-09-13T15:09:08.110377+0000","last_became_peered":"2024-09-13T15:09:08.110377+0000","last_unstale":"2024-09-13T15:09:09.092445+0000","last_undegraded":"2024-09-13T15:09:09.092445+0000","last_fullsized":"2024-09-13T15:09:09.092445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:25.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092404+0000","last_change":"2024-09-13T15:09:08.117668+0000","last_active":"2024-09-13T15:09:09.092404+0000","last_peered":"2024-09-13T15:09:09.092404+0000","last_clean":"2024-09-13T15:09:09.092404+0000","last_became_active":"2024-09-13T15:09:08.117414+0000","last_became_peered":"2024-09-13T15:09:08.117414+0000","last_unstale":"2024-09-13T15:09:09.092404+0000","last_undegraded":"2024-09-13T15:09:09.092404+0000","last_fullsized":"2024-09-13T15:09:09.092404+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:14.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518595+0000","last_change":"2024-09-13T15:09:08.107911+0000","last_active":"2024-09-13T15:09:09.518595+0000","last_peered":"2024-09-13T15:09:09.518595+0000","last_clean":"2024-09-13T15:09:09.518595+0000","last_became_active":"2024-09-13T15:09:08.107602+0000","last_became_peered":"2024-09-13T15:09:08.107602+0000","last_unstale":"2024-09-13T15:09:09.518595+0000","last_undegraded":"2024-09-13T15:09:09.518595+0000","last_fullsized":"2024-09-13T15:09:09.518595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:34.381135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520246+0000","last_change":"2024-09-13T15:09:08.107764+0000","last_active":"2024-09-13T15:09:09.520246+0000","last_peered":"2024-09-13T15:09:09.520246+0000","last_clean":"2024-09-13T15:09:09.520246+0000","last_became_active":"2024-09-13T15:09:08.107499+0000","last_became_peered":"2024-09-13T15:09:08.107499+0000","last_unstale":"2024-09-13T15:09:09.520246+0000","last_undegraded":"2024-09-13T15:09:09.520246+0000","last_fullsized":"2024-09-13T15:09:09.520246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:49.766695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519145+0000","last_change":"2024-09-13T15:09:08.117910+0000","last_active":"2024-09-13T15:09:09.519145+0000","last_peered":"2024-09-13T15:09:09.519145+0000","last_clean":"2024-09-13T15:09:09.519145+0000","last_became_active":"2024-09-13T15:09:08.117639+0000","last_became_peered":"2024-09-13T15:09:08.117639+0000","last_unstale":"2024-09-13T15:09:09.519145+0000","last_undegraded":"2024-09-13T15:09:09.519145+0000","last_fullsized":"2024-09-13T15:09:09.519145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:42.324479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093080+0000","last_change":"2024-09-13T15:09:07.623627+0000","last_active":"2024-09-13T15:09:09.093080+0000","last_peered":"2024-09-13T15:09:09.093080+0000","last_clean":"2024-09-13T15:09:09.093080+0000","last_became_active":"2024-09-13T15:09:07.623375+0000","last_became_peered":"2024-09-13T15:09:07.623375+0000","last_unstale":"2024-09-13T15:09:09.093080+0000","last_undegraded":"2024-09-13T15:09:09.093080+0000","last_fullsized":"2024-09-13T15:09:09.093080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:49.185972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521899+0000","last_change":"2024-09-13T15:09:08.125041+0000","last_active":"2024-09-13T15:09:09.521899+0000","last_peered":"2024-09-13T15:09:09.521899+0000","last_clean":"2024-09-13T15:09:09.521899+0000","last_became_active":"2024-09-13T15:09:08.124474+0000","last_became_peered":"2024-09-13T15:09:08.124474+0000","last_unstale":"2024-09-13T15:09:09.521899+0000","last_undegraded":"2024-09-13T15:09:09.521899+0000","last_fullsized":"2024-09-13T15:09:09.521899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:07.829895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522141+0000","last_change":"2024-09-13T15:09:07.627565+0000","last_active":"2024-09-13T15:09:09.522141+0000","last_peered":"2024-09-13T15:09:09.522141+0000","last_clean":"2024-09-13T15:09:09.522141+0000","last_became_active":"2024-09-13T15:09:07.627307+0000","last_became_peered":"2024-09-13T15:09:07.627307+0000","last_unstale":"2024-09-13T15:09:09.522141+0000","last_undegraded":"2024-09-13T15:09:09.522141+0000","last_fullsized":"2024-09-13T15:09:09.522141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:40.756816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.094119+0000","last_change":"2024-09-13T15:09:08.124435+0000","last_active":"2024-09-13T15:09:09.094119+0000","last_peered":"2024-09-13T15:09:09.094119+0000","last_clean":"2024-09-13T15:09:09.094119+0000","last_became_active":"2024-09-13T15:09:08.124134+0000","last_became_peered":"2024-09-13T15:09:08.124134+0000","last_unstale":"2024-09-13T15:09:09.094119+0000","last_undegraded":"2024-09-13T15:09:09.094119+0000","last_fullsized":"2024-09-13T15:09:09.094119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:59.463810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522532+0000","last_change":"2024-09-13T15:09:07.622714+0000","last_active":"2024-09-13T15:09:09.522532+0000","last_peered":"2024-09-13T15:09:09.522532+0000","last_clean":"2024-09-13T15:09:09.522532+0000","last_became_active":"2024-09-13T15:09:07.622472+0000","last_became_peered":"2024-09-13T15:09:07.622472+0000","last_unstale":"2024-09-13T15:09:09.522532+0000","last_undegraded":"2024-09-13T15:09:09.522532+0000","last_fullsized":"2024-09-13T15:09:09.522532+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092821+0000","last_change":"2024-09-13T15:09:08.124015+0000","last_active":"2024-09-13T15:09:09.092821+0000","last_peered":"2024-09-13T15:09:09.092821+0000","last_clean":"2024-09-13T15:09:09.092821+0000","last_became_active":"2024-09-13T15:09:08.123687+0000","last_became_peered":"2024-09-13T15:09:08.123687+0000","last_unstale":"2024-09-13T15:09:09.092821+0000","last_undegraded":"2024-09-13T15:09:09.092821+0000","last_fullsized":"2024-09-13T15:09:09.092821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:33.190037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093661+0000","last_change":"2024-09-13T15:09:07.619809+0000","last_active":"2024-09-13T15:09:09.093661+0000","last_peered":"2024-09-13T15:09:09.093661+0000","last_clean":"2024-09-13T15:09:09.093661+0000","last_became_active":"2024-09-13T15:09:07.619550+0000","last_became_peered":"2024-09-13T15:09:07.619550+0000","last_unstale":"2024-09-13T15:09:09.093661+0000","last_undegraded":"2024-09-13T15:09:09.093661+0000","last_fullsized":"2024-09-13T15:09:09.093661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:24.119550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519658+0000","last_change":"2024-09-13T15:09:08.106307+0000","last_active":"2024-09-13T15:09:09.519658+0000","last_peered":"2024-09-13T15:09:09.519658+0000","last_clean":"2024-09-13T15:09:09.519658+0000","last_became_active":"2024-09-13T15:09:08.106010+0000","last_became_peered":"2024-09-13T15:09:08.106010+0000","last_unstale":"2024-09-13T15:09:09.519658+0000","last_undegraded":"2024-09-13T15:09:09.519658+0000","last_fullsized":"2024-09-13T15:09:09.519658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:19.327798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517973+0000","last_change":"2024-09-13T15:09:07.617688+0000","last_active":"2024-09-13T15:09:09.517973+0000","last_peered":"2024-09-13T15:09:09.517973+0000","last_clean":"2024-09-13T15:09:09.517973+0000","last_became_active":"2024-09-13T15:09:07.617454+0000","last_became_peered":"2024-09-13T15:09:07.617454+0000","last_unstale":"2024-09-13T15:09:09.517973+0000","last_undegraded":"2024-09-13T15:09:09.517973+0000","last_fullsized":"2024-09-13T15:09:09.517973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:34.691952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517799+0000","last_change":"2024-09-13T15:09:08.108726+0000","last_active":"2024-09-13T15:09:09.517799+0000","last_peered":"2024-09-13T15:09:09.517799+0000","last_clean":"2024-09-13T15:09:09.517799+0000","last_became_active":"2024-09-13T15:09:08.106631+0000","last_became_peered":"2024-09-13T15:09:08.106631+0000","last_unstale":"2024-09-13T15:09:09.517799+0000","last_undegraded":"2024-09-13T15:09:09.517799+0000","last_fullsized":"2024-09-13T15:09:09.517799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:03.891708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518659+0000","last_change":"2024-09-13T15:09:07.629671+0000","last_active":"2024-09-13T15:09:09.518659+0000","last_peered":"2024-09-13T15:09:09.518659+0000","last_clean":"2024-09-13T15:09:09.518659+0000","last_became_active":"2024-09-13T15:09:07.629392+0000","last_became_peered":"2024-09-13T15:09:07.629392+0000","last_unstale":"2024-09-13T15:09:09.518659+0000","last_undegraded":"2024-09-13T15:09:09.518659+0000","last_fullsized":"2024-09-13T15:09:09.518659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:55.440562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093919+0000","last_change":"2024-09-13T15:09:08.127683+0000","last_active":"2024-09-13T15:09:09.093919+0000","last_peered":"2024-09-13T15:09:09.093919+0000","last_clean":"2024-09-13T15:09:09.093919+0000","last_became_active":"2024-09-13T15:09:08.122557+0000","last_became_peered":"2024-09-13T15:09:08.122557+0000","last_unstale":"2024-09-13T15:09:09.093919+0000","last_undegraded":"2024-09-13T15:09:09.093919+0000","last_fullsized":"2024-09-13T15:09:09.093919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520999+0000","last_change":"2024-09-13T15:09:07.625514+0000","last_active":"2024-09-13T15:09:09.520999+0000","last_peered":"2024-09-13T15:09:09.520999+0000","last_clean":"2024-09-13T15:09:09.520999+0000","last_became_active":"2024-09-13T15:09:07.623919+0000","last_became_peered":"2024-09-13T15:09:07.623919+0000","last_unstale":"2024-09-13T15:09:09.520999+0000","last_undegraded":"2024-09-13T15:09:09.520999+0000","last_fullsized":"2024-09-13T15:09:09.520999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:24.886304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092010+0000","last_change":"2024-09-13T15:09:08.103548+0000","last_active":"2024-09-13T15:09:09.092010+0000","last_peered":"2024-09-13T15:09:09.092010+0000","last_clean":"2024-09-13T15:09:09.092010+0000","last_became_active":"2024-09-13T15:09:08.103131+0000","last_became_peered":"2024-09-13T15:09:08.103131+0000","last_unstale":"2024-09-13T15:09:09.092010+0000","last_undegraded":"2024-09-13T15:09:09.092010+0000","last_fullsized":"2024-09-13T15:09:09.092010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:24.649685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093245+0000","last_change":"2024-09-13T15:09:07.616187+0000","last_active":"2024-09-13T15:09:09.093245+0000","last_peered":"2024-09-13T15:09:09.093245+0000","last_clean":"2024-09-13T15:09:09.093245+0000","last_became_active":"2024-09-13T15:09:07.615901+0000","last_became_peered":"2024-09-13T15:09:07.615901+0000","last_unstale":"2024-09-13T15:09:09.093245+0000","last_undegraded":"2024-09-13T15:09:09.093245+0000","last_fullsized":"2024-09-13T15:09:09.093245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:25.635676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522515+0000","last_change":"2024-09-13T15:09:08.125098+0000","last_active":"2024-09-13T15:09:09.522515+0000","last_peered":"2024-09-13T15:09:09.522515+0000","last_clean":"2024-09-13T15:09:09.522515+0000","last_became_active":"2024-09-13T15:09:08.124862+0000","last_became_peered":"2024-09-13T15:09:08.124862+0000","last_unstale":"2024-09-13T15:09:09.522515+0000","last_undegraded":"2024-09-13T15:09:09.522515+0000","last_fullsized":"2024-09-13T15:09:09.522515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:43.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092911+0000","last_change":"2024-09-13T15:09:07.624655+0000","last_active":"2024-09-13T15:09:09.092911+0000","last_peered":"2024-09-13T15:09:09.092911+0000","last_clean":"2024-09-13T15:09:09.092911+0000","last_became_active":"2024-09-13T15:09:07.624451+0000","last_became_peered":"2024-09-13T15:09:07.624451+0000","last_unstale":"2024-09-13T15:09:09.092911+0000","last_undegraded":"2024-09-13T15:09:09.092911+0000","last_fullsized":"2024-09-13T15:09:09.092911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:48.922099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519237+0000","last_change":"2024-09-13T15:09:08.119850+0000","last_active":"2024-09-13T15:09:09.519237+0000","last_peered":"2024-09-13T15:09:09.519237+0000","last_clean":"2024-09-13T15:09:09.519237+0000","last_became_active":"2024-09-13T15:09:08.119401+0000","last_became_peered":"2024-09-13T15:09:08.119401+0000","last_unstale":"2024-09-13T15:09:09.519237+0000","last_undegraded":"2024-09-13T15:09:09.519237+0000","last_fullsized":"2024-09-13T15:09:09.519237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:19.327798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518399+0000","last_change":"2024-09-13T15:09:07.627442+0000","last_active":"2024-09-13T15:09:09.518399+0000","last_peered":"2024-09-13T15:09:09.518399+0000","last_clean":"2024-09-13T15:09:09.518399+0000","last_became_active":"2024-09-13T15:09:07.627147+0000","last_became_peered":"2024-09-13T15:09:07.627147+0000","last_unstale":"2024-09-13T15:09:09.518399+0000","last_undegraded":"2024-09-13T15:09:09.518399+0000","last_fullsized":"2024-09-13T15:09:09.518399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.093764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521919+0000","last_change":"2024-09-13T15:09:08.103782+0000","last_active":"2024-09-13T15:09:09.521919+0000","last_peered":"2024-09-13T15:09:09.521919+0000","last_clean":"2024-09-13T15:09:09.521919+0000","last_became_active":"2024-09-13T15:09:08.103041+0000","last_became_peered":"2024-09-13T15:09:08.103041+0000","last_unstale":"2024-09-13T15:09:09.521919+0000","last_undegraded":"2024-09-13T15:09:09.521919+0000","last_fullsized":"2024-09-13T15:09:09.521919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:58.604274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518646+0000","last_change":"2024-09-13T15:09:07.619938+0000","last_active":"2024-09-13T15:09:09.518646+0000","last_peered":"2024-09-13T15:09:09.518646+0000","last_clean":"2024-09-13T15:09:09.518646+0000","last_became_active":"2024-09-13T15:09:07.619708+0000","last_became_peered":"2024-09-13T15:09:07.619708+0000","last_unstale":"2024-09-13T15:09:09.518646+0000","last_undegraded":"2024-09-13T15:09:09.518646+0000","last_fullsized":"2024-09-13T15:09:09.518646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:13.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.094278+0000","last_change":"2024-09-13T15:09:08.122902+0000","last_active":"2024-09-13T15:09:09.094278+0000","last_peered":"2024-09-13T15:09:09.094278+0000","last_clean":"2024-09-13T15:09:09.094278+0000","last_became_active":"2024-09-13T15:09:08.122528+0000","last_became_peered":"2024-09-13T15:09:08.122528+0000","last_unstale":"2024-09-13T15:09:09.094278+0000","last_undegraded":"2024-09-13T15:09:09.094278+0000","last_fullsized":"2024-09-13T15:09:09.094278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:14.881753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092554+0000","last_change":"2024-09-13T15:09:07.628001+0000","last_active":"2024-09-13T15:09:09.092554+0000","last_peered":"2024-09-13T15:09:09.092554+0000","last_clean":"2024-09-13T15:09:09.092554+0000","last_became_active":"2024-09-13T15:09:07.627160+0000","last_became_peered":"2024-09-13T15:09:07.627160+0000","last_unstale":"2024-09-13T15:09:09.092554+0000","last_undegraded":"2024-09-13T15:09:09.092554+0000","last_fullsized":"2024-09-13T15:09:09.092554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:25.635676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519891+0000","last_change":"2024-09-13T15:09:08.111454+0000","last_active":"2024-09-13T15:09:09.519891+0000","last_peered":"2024-09-13T15:09:09.519891+0000","last_clean":"2024-09-13T15:09:09.519891+0000","last_became_active":"2024-09-13T15:09:08.111181+0000","last_became_peered":"2024-09-13T15:09:08.111181+0000","last_unstale":"2024-09-13T15:09:09.519891+0000","last_undegraded":"2024-09-13T15:09:09.519891+0000","last_fullsized":"2024-09-13T15:09:09.519891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:03.891708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092476+0000","last_change":"2024-09-13T15:09:07.626363+0000","last_active":"2024-09-13T15:09:09.092476+0000","last_peered":"2024-09-13T15:09:09.092476+0000","last_clean":"2024-09-13T15:09:09.092476+0000","last_became_active":"2024-09-13T15:09:07.626100+0000","last_became_peered":"2024-09-13T15:09:07.626100+0000","last_unstale":"2024-09-13T15:09:09.092476+0000","last_undegraded":"2024-09-13T15:09:09.092476+0000","last_fullsized":"2024-09-13T15:09:09.092476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:48.755245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092136+0000","last_change":"2024-09-13T15:09:08.102028+0000","last_active":"2024-09-13T15:09:09.092136+0000","last_peered":"2024-09-13T15:09:09.092136+0000","last_clean":"2024-09-13T15:09:09.092136+0000","last_became_active":"2024-09-13T15:09:08.101832+0000","last_became_peered":"2024-09-13T15:09:08.101832+0000","last_unstale":"2024-09-13T15:09:09.092136+0000","last_undegraded":"2024-09-13T15:09:09.092136+0000","last_fullsized":"2024-09-13T15:09:09.092136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:03.227472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520432+0000","last_change":"2024-09-13T15:09:07.623639+0000","last_active":"2024-09-13T15:09:09.520432+0000","last_peered":"2024-09-13T15:09:09.520432+0000","last_clean":"2024-09-13T15:09:09.520432+0000","last_became_active":"2024-09-13T15:09:07.623358+0000","last_became_peered":"2024-09-13T15:09:07.623358+0000","last_unstale":"2024-09-13T15:09:09.520432+0000","last_undegraded":"2024-09-13T15:09:09.520432+0000","last_fullsized":"2024-09-13T15:09:09.520432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:39.651758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518702+0000","last_change":"2024-09-13T15:09:08.109974+0000","last_active":"2024-09-13T15:09:09.518702+0000","last_peered":"2024-09-13T15:09:09.518702+0000","last_clean":"2024-09-13T15:09:09.518702+0000","last_became_active":"2024-09-13T15:09:08.108575+0000","last_became_peered":"2024-09-13T15:09:08.108575+0000","last_unstale":"2024-09-13T15:09:09.518702+0000","last_undegraded":"2024-09-13T15:09:09.518702+0000","last_fullsized":"2024-09-13T15:09:09.518702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:49.933549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092333+0000","last_change":"2024-09-13T15:09:07.620537+0000","last_active":"2024-09-13T15:09:09.092333+0000","last_peered":"2024-09-13T15:09:09.092333+0000","last_clean":"2024-09-13T15:09:09.092333+0000","last_became_active":"2024-09-13T15:09:07.620246+0000","last_became_peered":"2024-09-13T15:09:07.620246+0000","last_unstale":"2024-09-13T15:09:09.092333+0000","last_undegraded":"2024-09-13T15:09:09.092333+0000","last_fullsized":"2024-09-13T15:09:09.092333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:10.949944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092258+0000","last_change":"2024-09-13T15:09:08.100840+0000","last_active":"2024-09-13T15:09:09.092258+0000","last_peered":"2024-09-13T15:09:09.092258+0000","last_clean":"2024-09-13T15:09:09.092258+0000","last_became_active":"2024-09-13T15:09:08.100560+0000","last_became_peered":"2024-09-13T15:09:08.100560+0000","last_unstale":"2024-09-13T15:09:09.092258+0000","last_undegraded":"2024-09-13T15:09:09.092258+0000","last_fullsized":"2024-09-13T15:09:09.092258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:14.881753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517940+0000","last_change":"2024-09-13T15:09:07.629632+0000","last_active":"2024-09-13T15:09:09.517940+0000","last_peered":"2024-09-13T15:09:09.517940+0000","last_clean":"2024-09-13T15:09:09.517940+0000","last_became_active":"2024-09-13T15:09:07.629366+0000","last_became_peered":"2024-09-13T15:09:07.629366+0000","last_unstale":"2024-09-13T15:09:09.517940+0000","last_undegraded":"2024-09-13T15:09:09.517940+0000","last_fullsized":"2024-09-13T15:09:09.517940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:34.691952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092520+0000","last_change":"2024-09-13T15:09:08.118338+0000","last_active":"2024-09-13T15:09:09.092520+0000","last_peered":"2024-09-13T15:09:09.092520+0000","last_clean":"2024-09-13T15:09:09.092520+0000","last_became_active":"2024-09-13T15:09:08.117835+0000","last_became_peered":"2024-09-13T15:09:08.117835+0000","last_unstale":"2024-09-13T15:09:09.092520+0000","last_undegraded":"2024-09-13T15:09:09.092520+0000","last_fullsized":"2024-09-13T15:09:09.092520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:11.590698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518274+0000","last_change":"2024-09-13T15:09:07.620473+0000","last_active":"2024-09-13T15:09:09.518274+0000","last_peered":"2024-09-13T15:09:09.518274+0000","last_clean":"2024-09-13T15:09:09.518274+0000","last_became_active":"2024-09-13T15:09:07.620222+0000","last_became_peered":"2024-09-13T15:09:07.620222+0000","last_unstale":"2024-09-13T15:09:09.518274+0000","last_undegraded":"2024-09-13T15:09:09.518274+0000","last_fullsized":"2024-09-13T15:09:09.518274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:03.272663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518651+0000","last_change":"2024-09-13T15:09:08.108380+0000","last_active":"2024-09-13T15:09:09.518651+0000","last_peered":"2024-09-13T15:09:09.518651+0000","last_clean":"2024-09-13T15:09:09.518651+0000","last_became_active":"2024-09-13T15:09:08.107906+0000","last_became_peered":"2024-09-13T15:09:08.107906+0000","last_unstale":"2024-09-13T15:09:09.518651+0000","last_undegraded":"2024-09-13T15:09:09.518651+0000","last_fullsized":"2024-09-13T15:09:09.518651+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:19.327798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.094172+0000","last_change":"2024-09-13T15:09:07.616813+0000","last_active":"2024-09-13T15:09:09.094172+0000","last_peered":"2024-09-13T15:09:09.094172+0000","last_clean":"2024-09-13T15:09:09.094172+0000","last_became_active":"2024-09-13T15:09:07.616548+0000","last_became_peered":"2024-09-13T15:09:07.616548+0000","last_unstale":"2024-09-13T15:09:09.094172+0000","last_undegraded":"2024-09-13T15:09:09.094172+0000","last_fullsized":"2024-09-13T15:09:09.094172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:48.755245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093992+0000","last_change":"2024-09-13T15:09:08.117308+0000","last_active":"2024-09-13T15:09:09.093992+0000","last_peered":"2024-09-13T15:09:09.093992+0000","last_clean":"2024-09-13T15:09:09.093992+0000","last_became_active":"2024-09-13T15:09:08.116877+0000","last_became_peered":"2024-09-13T15:09:08.116877+0000","last_unstale":"2024-09-13T15:09:09.093992+0000","last_undegraded":"2024-09-13T15:09:09.093992+0000","last_fullsized":"2024-09-13T15:09:09.093992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:03.227472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520471+0000","last_change":"2024-09-13T15:09:07.627592+0000","last_active":"2024-09-13T15:09:09.520471+0000","last_peered":"2024-09-13T15:09:09.520471+0000","last_clean":"2024-09-13T15:09:09.520471+0000","last_became_active":"2024-09-13T15:09:07.626760+0000","last_became_peered":"2024-09-13T15:09:07.626760+0000","last_unstale":"2024-09-13T15:09:09.520471+0000","last_undegraded":"2024-09-13T15:09:09.520471+0000","last_fullsized":"2024-09-13T15:09:09.520471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:23.771499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.522072+0000","last_change":"2024-09-13T15:09:08.110391+0000","last_active":"2024-09-13T15:09:09.522072+0000","last_peered":"2024-09-13T15:09:09.522072+0000","last_clean":"2024-09-13T15:09:09.522072+0000","last_became_active":"2024-09-13T15:09:08.109887+0000","last_became_peered":"2024-09-13T15:09:08.109887+0000","last_unstale":"2024-09-13T15:09:09.522072+0000","last_undegraded":"2024-09-13T15:09:09.522072+0000","last_fullsized":"2024-09-13T15:09:09.522072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:25.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521475+0000","last_change":"2024-09-13T15:09:07.621178+0000","last_active":"2024-09-13T15:09:09.521475+0000","last_peered":"2024-09-13T15:09:09.521475+0000","last_clean":"2024-09-13T15:09:09.521475+0000","last_became_active":"2024-09-13T15:09:07.620898+0000","last_became_peered":"2024-09-13T15:09:07.620898+0000","last_unstale":"2024-09-13T15:09:09.521475+0000","last_undegraded":"2024-09-13T15:09:09.521475+0000","last_fullsized":"2024-09-13T15:09:09.521475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.093764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518129+0000","last_change":"2024-09-13T15:09:08.106160+0000","last_active":"2024-09-13T15:09:09.518129+0000","last_peered":"2024-09-13T15:09:09.518129+0000","last_clean":"2024-09-13T15:09:09.518129+0000","last_became_active":"2024-09-13T15:09:08.105901+0000","last_became_peered":"2024-09-13T15:09:08.105901+0000","last_unstale":"2024-09-13T15:09:09.518129+0000","last_undegraded":"2024-09-13T15:09:09.518129+0000","last_fullsized":"2024-09-13T15:09:09.518129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:09.765356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521478+0000","last_change":"2024-09-13T15:09:07.621852+0000","last_active":"2024-09-13T15:09:09.521478+0000","last_peered":"2024-09-13T15:09:09.521478+0000","last_clean":"2024-09-13T15:09:09.521478+0000","last_became_active":"2024-09-13T15:09:07.621610+0000","last_became_peered":"2024-09-13T15:09:07.621610+0000","last_unstale":"2024-09-13T15:09:09.521478+0000","last_undegraded":"2024-09-13T15:09:09.521478+0000","last_fullsized":"2024-09-13T15:09:09.521478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.622419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520779+0000","last_change":"2024-09-13T15:09:08.106501+0000","last_active":"2024-09-13T15:09:09.520779+0000","last_peered":"2024-09-13T15:09:09.520779+0000","last_clean":"2024-09-13T15:09:09.520779+0000","last_became_active":"2024-09-13T15:09:08.106174+0000","last_became_peered":"2024-09-13T15:09:08.106174+0000","last_unstale":"2024-09-13T15:09:09.520779+0000","last_undegraded":"2024-09-13T15:09:09.520779+0000","last_fullsized":"2024-09-13T15:09:09.520779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.349877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520118+0000","last_change":"2024-09-13T15:09:07.618760+0000","last_active":"2024-09-13T15:09:09.520118+0000","last_peered":"2024-09-13T15:09:09.520118+0000","last_clean":"2024-09-13T15:09:09.520118+0000","last_became_active":"2024-09-13T15:09:07.618464+0000","last_became_peered":"2024-09-13T15:09:07.618464+0000","last_unstale":"2024-09-13T15:09:09.520118+0000","last_undegraded":"2024-09-13T15:09:09.520118+0000","last_fullsized":"2024-09-13T15:09:09.520118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:51.141908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.517836+0000","last_change":"2024-09-13T15:09:08.120992+0000","last_active":"2024-09-13T15:09:09.517836+0000","last_peered":"2024-09-13T15:09:09.517836+0000","last_clean":"2024-09-13T15:09:09.517836+0000","last_became_active":"2024-09-13T15:09:08.120731+0000","last_became_peered":"2024-09-13T15:09:08.120731+0000","last_unstale":"2024-09-13T15:09:09.517836+0000","last_undegraded":"2024-09-13T15:09:09.517836+0000","last_fullsized":"2024-09-13T15:09:09.517836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:07.829895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518597+0000","last_change":"2024-09-13T15:09:07.626228+0000","last_active":"2024-09-13T15:09:09.518597+0000","last_peered":"2024-09-13T15:09:09.518597+0000","last_clean":"2024-09-13T15:09:09.518597+0000","last_became_active":"2024-09-13T15:09:07.625990+0000","last_became_peered":"2024-09-13T15:09:07.625990+0000","last_unstale":"2024-09-13T15:09:09.518597+0000","last_undegraded":"2024-09-13T15:09:09.518597+0000","last_fullsized":"2024-09-13T15:09:09.518597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:03.272663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092507+0000","last_change":"2024-09-13T15:09:08.103395+0000","last_active":"2024-09-13T15:09:09.092507+0000","last_peered":"2024-09-13T15:09:09.092507+0000","last_clean":"2024-09-13T15:09:09.092507+0000","last_became_active":"2024-09-13T15:09:08.102833+0000","last_became_peered":"2024-09-13T15:09:08.102833+0000","last_unstale":"2024-09-13T15:09:09.092507+0000","last_undegraded":"2024-09-13T15:09:09.092507+0000","last_fullsized":"2024-09-13T15:09:09.092507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:32.684698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520568+0000","last_change":"2024-09-13T15:09:07.617905+0000","last_active":"2024-09-13T15:09:09.520568+0000","last_peered":"2024-09-13T15:09:09.520568+0000","last_clean":"2024-09-13T15:09:09.520568+0000","last_became_active":"2024-09-13T15:09:07.617600+0000","last_became_peered":"2024-09-13T15:09:07.617600+0000","last_unstale":"2024-09-13T15:09:09.520568+0000","last_undegraded":"2024-09-13T15:09:09.520568+0000","last_fullsized":"2024-09-13T15:09:09.520568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:10.949944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521270+0000","last_change":"2024-09-13T15:09:08.116550+0000","last_active":"2024-09-13T15:09:09.521270+0000","last_peered":"2024-09-13T15:09:09.521270+0000","last_clean":"2024-09-13T15:09:09.521270+0000","last_became_active":"2024-09-13T15:09:08.116279+0000","last_became_peered":"2024-09-13T15:09:08.116279+0000","last_unstale":"2024-09-13T15:09:09.521270+0000","last_undegraded":"2024-09-13T15:09:09.521270+0000","last_fullsized":"2024-09-13T15:09:09.521270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:26.647126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518980+0000","last_change":"2024-09-13T15:09:07.621616+0000","last_active":"2024-09-13T15:09:09.518980+0000","last_peered":"2024-09-13T15:09:09.518980+0000","last_clean":"2024-09-13T15:09:09.518980+0000","last_became_active":"2024-09-13T15:09:07.621360+0000","last_became_peered":"2024-09-13T15:09:07.621360+0000","last_unstale":"2024-09-13T15:09:09.518980+0000","last_undegraded":"2024-09-13T15:09:09.518980+0000","last_fullsized":"2024-09-13T15:09:09.518980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:33.992916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519217+0000","last_change":"2024-09-13T15:09:08.119686+0000","last_active":"2024-09-13T15:09:09.519217+0000","last_peered":"2024-09-13T15:09:09.519217+0000","last_clean":"2024-09-13T15:09:09.519217+0000","last_became_active":"2024-09-13T15:09:08.119078+0000","last_became_peered":"2024-09-13T15:09:08.119078+0000","last_unstale":"2024-09-13T15:09:09.519217+0000","last_undegraded":"2024-09-13T15:09:09.519217+0000","last_fullsized":"2024-09-13T15:09:09.519217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:25.131000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.793947+0000","last_change":"2024-09-13T15:09:07.615050+0000","last_active":"2024-09-13T15:09:09.793947+0000","last_peered":"2024-09-13T15:09:09.793947+0000","last_clean":"2024-09-13T15:09:09.793947+0000","last_became_active":"2024-09-13T15:09:07.614809+0000","last_became_peered":"2024-09-13T15:09:07.614809+0000","last_unstale":"2024-09-13T15:09:09.793947+0000","last_undegraded":"2024-09-13T15:09:09.793947+0000","last_fullsized":"2024-09-13T15:09:09.793947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:18.075903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092692+0000","last_change":"2024-09-13T15:09:08.124905+0000","last_active":"2024-09-13T15:09:09.092692+0000","last_peered":"2024-09-13T15:09:09.092692+0000","last_clean":"2024-09-13T15:09:09.092692+0000","last_became_active":"2024-09-13T15:09:08.124661+0000","last_became_peered":"2024-09-13T15:09:08.124661+0000","last_unstale":"2024-09-13T15:09:09.092692+0000","last_undegraded":"2024-09-13T15:09:09.092692+0000","last_fullsized":"2024-09-13T15:09:09.092692+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:59.463810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521579+0000","last_change":"2024-09-13T15:09:07.620500+0000","last_active":"2024-09-13T15:09:09.521579+0000","last_peered":"2024-09-13T15:09:09.521579+0000","last_clean":"2024-09-13T15:09:09.521579+0000","last_became_active":"2024-09-13T15:09:07.619788+0000","last_became_peered":"2024-09-13T15:09:07.619788+0000","last_unstale":"2024-09-13T15:09:09.521579+0000","last_undegraded":"2024-09-13T15:09:09.521579+0000","last_fullsized":"2024-09-13T15:09:09.521579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:00.419739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520114+0000","last_change":"2024-09-13T15:09:08.104073+0000","last_active":"2024-09-13T15:09:09.520114+0000","last_peered":"2024-09-13T15:09:09.520114+0000","last_clean":"2024-09-13T15:09:09.520114+0000","last_became_active":"2024-09-13T15:09:08.103844+0000","last_became_peered":"2024-09-13T15:09:08.103844+0000","last_unstale":"2024-09-13T15:09:09.520114+0000","last_undegraded":"2024-09-13T15:09:09.520114+0000","last_fullsized":"2024-09-13T15:09:09.520114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:06.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.521378+0000","last_change":"2024-09-13T15:09:07.624987+0000","last_active":"2024-09-13T15:09:09.521378+0000","last_peered":"2024-09-13T15:09:09.521378+0000","last_clean":"2024-09-13T15:09:09.521378+0000","last_became_active":"2024-09-13T15:09:07.624734+0000","last_became_peered":"2024-09-13T15:09:07.624734+0000","last_unstale":"2024-09-13T15:09:09.521378+0000","last_undegraded":"2024-09-13T15:09:09.521378+0000","last_fullsized":"2024-09-13T15:09:09.521378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:33.369685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.520788+0000","last_change":"2024-09-13T15:09:08.120601+0000","last_active":"2024-09-13T15:09:09.520788+0000","last_peered":"2024-09-13T15:09:09.520788+0000","last_clean":"2024-09-13T15:09:09.520788+0000","last_became_active":"2024-09-13T15:09:08.120255+0000","last_became_peered":"2024-09-13T15:09:08.120255+0000","last_unstale":"2024-09-13T15:09:09.520788+0000","last_undegraded":"2024-09-13T15:09:09.520788+0000","last_fullsized":"2024-09-13T15:09:09.520788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:09.765356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092606+0000","last_change":"2024-09-13T15:09:07.617846+0000","last_active":"2024-09-13T15:09:09.092606+0000","last_peered":"2024-09-13T15:09:09.092606+0000","last_clean":"2024-09-13T15:09:09.092606+0000","last_became_active":"2024-09-13T15:09:07.617571+0000","last_became_peered":"2024-09-13T15:09:07.617571+0000","last_unstale":"2024-09-13T15:09:09.092606+0000","last_undegraded":"2024-09-13T15:09:09.092606+0000","last_fullsized":"2024-09-13T15:09:09.092606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:51.141908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093495+0000","last_change":"2024-09-13T15:09:08.113413+0000","last_active":"2024-09-13T15:09:09.093495+0000","last_peered":"2024-09-13T15:09:09.093495+0000","last_clean":"2024-09-13T15:09:09.093495+0000","last_became_active":"2024-09-13T15:09:08.112905+0000","last_became_peered":"2024-09-13T15:09:08.112905+0000","last_unstale":"2024-09-13T15:09:09.093495+0000","last_undegraded":"2024-09-13T15:09:09.093495+0000","last_fullsized":"2024-09-13T15:09:09.093495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:47.466816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.093930+0000","last_change":"2024-09-13T15:09:07.619683+0000","last_active":"2024-09-13T15:09:09.093930+0000","last_peered":"2024-09-13T15:09:09.093930+0000","last_clean":"2024-09-13T15:09:09.093930+0000","last_became_active":"2024-09-13T15:09:07.619329+0000","last_became_peered":"2024-09-13T15:09:07.619329+0000","last_unstale":"2024-09-13T15:09:09.093930+0000","last_undegraded":"2024-09-13T15:09:09.093930+0000","last_fullsized":"2024-09-13T15:09:09.093930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:51:48.922099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519029+0000","last_change":"2024-09-13T15:09:08.118486+0000","last_active":"2024-09-13T15:09:09.519029+0000","last_peered":"2024-09-13T15:09:09.519029+0000","last_clean":"2024-09-13T15:09:09.519029+0000","last_became_active":"2024-09-13T15:09:08.118214+0000","last_became_peered":"2024-09-13T15:09:08.118214+0000","last_unstale":"2024-09-13T15:09:09.519029+0000","last_undegraded":"2024-09-13T15:09:09.519029+0000","last_fullsized":"2024-09-13T15:09:09.519029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:49.766695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.092226+0000","last_change":"2024-09-13T15:09:07.625226+0000","last_active":"2024-09-13T15:09:09.092226+0000","last_peered":"2024-09-13T15:09:09.092226+0000","last_clean":"2024-09-13T15:09:09.092226+0000","last_became_active":"2024-09-13T15:09:07.624996+0000","last_became_peered":"2024-09-13T15:09:07.624996+0000","last_unstale":"2024-09-13T15:09:09.092226+0000","last_undegraded":"2024-09-13T15:09:09.092226+0000","last_fullsized":"2024-09-13T15:09:09.092226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:08.753906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.518223+0000","last_change":"2024-09-13T15:09:08.112050+0000","last_active":"2024-09-13T15:09:09.518223+0000","last_peered":"2024-09-13T15:09:09.518223+0000","last_clean":"2024-09-13T15:09:09.518223+0000","last_became_active":"2024-09-13T15:09:08.111785+0000","last_became_peered":"2024-09-13T15:09:08.111785+0000","last_unstale":"2024-09-13T15:09:09.518223+0000","last_undegraded":"2024-09-13T15:09:09.518223+0000","last_fullsized":"2024-09-13T15:09:09.518223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:07.589449+0000","last_clean_scrub_stamp":"2024-09-13T15:09:07.589449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:25.131000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T15:09:09.519321+0000","last_change":"2024-09-13T15:09:07.627606+0000","last_active":"2024-09-13T15:09:09.519321+0000","last_peered":"2024-09-13T15:09:09.519321+0000","last_clean":"2024-09-13T15:09:09.519321+0000","last_became_active":"2024-09-13T15:09:07.627099+0000","last_became_peered":"2024-09-13T15:09:07.627099+0000","last_unstale":"2024-09-13T15:09:09.519321+0000","last_undegraded":"2024-09-13T15:09:09.519321+0000","last_fullsized":"2024-09-13T15:09:09.519321+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:06.577999+0000","last_clean_scrub_stamp":"2024-09-13T15:09:06.577999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:01.520110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T15:09:08.095898+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:09:08.095898+0000","last_peered":"2024-09-13T15:09:08.095898+0000","last_clean":"2024-09-13T15:09:08.095898+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:09:08.095898+0000","last_undegraded":"2024-09-13T15:09:08.095898+0000","last_fullsized":"2024-09-13T15:09:08.095898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1060864,"data_stored":786109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.341},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.53}]},{"osd":1,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.034}]},{"osd":2,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.149}]},{"osd":3,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.22},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.3839999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.254},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.88}]},{"osd":5,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.9169999999999998,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3120000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"min":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.411},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.4299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.206},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.3300000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.764}]},{"osd":2,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.5780000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":1.639}]},{"osd":4,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":1.423},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.609}]},{"osd":5,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.464},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.929}]},{"osd":7,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.7969999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.4390000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.393},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.161},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4610000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.194},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":1.165,"5min":1.165,"15min":1.165},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.504}]},{"osd":4,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":3.117,"5min":3.117,"15min":3.117},"last":1.248}]},{"osd":6,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:08:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.131},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.2729999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.84699999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.087}]},{"osd":2,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.417}]},{"osd":3,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.3620000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1899999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.032},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.135},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.3100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":462848,"data_stored":194686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.04}]},{"osd":1,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.385},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.996}]},{"osd":2,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.325},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.4299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":2.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":2.2200000000000002},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2989999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.3090000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":5.1900000000000004,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.5},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.476}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":454656,"data_stored":194177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.401},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.131},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":5.3940000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.907}]},{"osd":6,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.992},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.756}]},{"osd":7,"last update":"Fri Sep 13 15:08:30 2024","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.829},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.502}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":454656,"data_stored":194197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.0489999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.288}]},{"osd":6,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":4.843,"5min":4.843,"15min":4.843},"last":1.2749999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:08:26 2024","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":4.9489999999999998,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.452},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.385}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":1044480,"data_stored":783490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.5229999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":8.0210000000000008,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.3170000000000002,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.998}]},{"osd":3,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.089},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.4239999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.5760000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.405},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.228}]},{"osd":6,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":2.9700000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.339}]},{"osd":7,"last update":"Fri Sep 13 15:08:27 2024","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.365}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:09:12.939 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:09:12.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T15:09:13.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 Processor -- start 2024-09-13T15:09:13.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 -- start start 2024-09-13T15:09:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 0x7f03ec0703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f03ec06db30 0x7f03ec06df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec0ced70 con 0x7f03ec1600c0 2024-09-13T15:09:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec06c460 con 0x7f03ec06db30 2024-09-13T15:09:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f1e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0cada0 con 0x7f03ec0ce3e0 2024-09-13T15:09:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.163+0000 7f03f0a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 0x7f03ec0703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f0a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 0x7f03ec0703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35944/0 (socket says 172.21.15.50:35944) 2024-09-13T15:09:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f0a00700 1 -- 172.21.15.50:0/1606959748 learned_addr learned my addr 172.21.15.50:0/1606959748 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 --2- 172.21.15.50:0/1606959748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03ebe00700 1 --2- 172.21.15.50:0/1606959748 >> v2:172.21.15.181:3300/0 conn(0x7f03ec06db30 0x7f03ec06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 -- 172.21.15.50:0/1606959748 >> v2:172.21.15.181:3300/0 conn(0x7f03ec06db30 msgr2=0x7f03ec06df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:13.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 --2- 172.21.15.50:0/1606959748 >> v2:172.21.15.181:3300/0 conn(0x7f03ec06db30 0x7f03ec06df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 -- 172.21.15.50:0/1606959748 >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 msgr2=0x7f03ec0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:13.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 --2- 172.21.15.50:0/1606959748 >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 0x7f03ec0703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 -- 172.21.15.50:0/1606959748 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec0cb080 con 0x7f03ec0ce3e0 2024-09-13T15:09:13.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f0a00700 1 --2- 172.21.15.50:0/1606959748 >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 0x7f03ec0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:13.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1400700 1 --2- 172.21.15.50:0/1606959748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec0ce830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03ec070340 tx=0x7f03e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494c374e30563854 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03eb400700 1 -- 172.21.15.50:0/1606959748 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400e070 con 0x7f03ec0ce3e0 2024-09-13T15:09:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03eb400700 1 -- 172.21.15.50:0/1606959748 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400bb20 con 0x7f03ec0ce3e0 2024-09-13T15:09:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03eb400700 1 -- 172.21.15.50:0/1606959748 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4012430 con 0x7f03ec0ce3e0 2024-09-13T15:09:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1e00700 1 -- 172.21.15.50:0/1606959748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 msgr2=0x7f03ec0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.167+0000 7f03f1e00700 1 --2- 172.21.15.50:0/1606959748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec0ce830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03ec070340 tx=0x7f03e400b330 comp rx=0 tx=0).stop 2024-09-13T15:09:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 -- 172.21.15.50:0/1606959748 shutdown_connections 2024-09-13T15:09:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 --2- 172.21.15.50:0/1606959748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec0ce830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 --2- 172.21.15.50:0/1606959748 >> v2:172.21.15.181:3300/0 conn(0x7f03ec06db30 0x7f03ec06df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 --2- 172.21.15.50:0/1606959748 >> v2:172.21.15.50:3300/0 conn(0x7f03ec1600c0 0x7f03ec0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 -- 172.21.15.50:0/1606959748 >> 172.21.15.50:0/1606959748 conn(0x7f03ec0b0b50 msgr2=0x7f03ec0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 -- 172.21.15.50:0/1606959748 shutdown_connections 2024-09-13T15:09:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 -- 172.21.15.50:0/1606959748 wait complete. 2024-09-13T15:09:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 Processor -- start 2024-09-13T15:09:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.171+0000 7f03f1e00700 1 -- start start 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03ec06db30 0x7f03ec0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 0x7f03ec0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec1f22b0 con 0x7f03ec1600c0 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec159a70 con 0x7f03ec06db30 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec1f2490 con 0x7f03ec0ce3e0 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 0x7f03ec0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 0x7f03ec0afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35960/0 (socket says 172.21.15.50:35960) 2024-09-13T15:09:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 -- 172.21.15.50:0/3930605589 learned_addr learned my addr 172.21.15.50:0/3930605589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f0a00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03ec06db30 0x7f03ec0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03ebe00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 -- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 msgr2=0x7f03ec159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 -- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03ec06db30 msgr2=0x7f03ec0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03ec06db30 0x7f03ec0b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 -- 172.21.15.50:0/3930605589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009570 con 0x7f03ec1600c0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1400700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 0x7f03ec0afd70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f03e4014040 tx=0x7f03e4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4004800 con 0x7f03ec1600c0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e4009a70 con 0x7f03ec1600c0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4020070 con 0x7f03ec1600c0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40276c0 con 0x7f03ec1600c0 2024-09-13T15:09:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.175+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1f2a50 con 0x7f03ec1600c0 2024-09-13T15:09:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.179+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec1604a0 con 0x7f03ec1600c0 2024-09-13T15:09:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.179+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03e4012430 con 0x7f03ec1600c0 2024-09-13T15:09:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.179+0000 7f03e8c00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03cc066730 0x7f03cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.179+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f03e4022070 con 0x7f03ec1600c0 2024-09-13T15:09:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.183+0000 7f03f0a00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03cc066730 0x7f03cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.183+0000 7f03f0a00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03cc066730 0x7f03cc068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03e0006d50 tx=0x7f03e00092e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:13.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.187+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03e4052ff0 con 0x7f03ec1600c0 2024-09-13T15:09:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.435+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f03ec070510 con 0x7f03ec1600c0 2024-09-13T15:09:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.447+0000 7f03e8c00700 1 -- 172.21.15.50:0/3930605589 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f03e402c0e0 con 0x7f03ec1600c0 2024-09-13T15:09:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.447+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03cc066730 msgr2=0x7f03cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03cc066730 0x7f03cc068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03e0006d50 tx=0x7f03e00092e0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 msgr2=0x7f03ec0afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 0x7f03ec0afd70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f03e4014040 tx=0x7f03e4004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 shutdown_connections 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f03cc066730 0x7f03cc068bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03ec1600c0 0x7f03ec0afd70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f03ec0ce3e0 0x7f03ec159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 --2- 172.21.15.50:0/3930605589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03ec06db30 0x7f03ec0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 >> 172.21.15.50:0/3930605589 conn(0x7f03ec0b0b50 msgr2=0x7f03ec071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 shutdown_connections 2024-09-13T15:09:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.451+0000 7f03f1e00700 1 -- 172.21.15.50:0/3930605589 wait complete. 2024-09-13T15:09:13.457 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-13T15:09:13.478 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 Processor -- start 2024-09-13T15:09:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 -- start start 2024-09-13T15:09:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc55c0cb020 0x7fc55c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc55c06aaa0 0x7fc55c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c06b430 con 0x7fc55c15c2a0 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c0b2ad0 con 0x7fc55c06aaa0 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c15b960 con 0x7fc55c0cb020 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55a000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc55c15c2a0 0x7fc55c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60858/0 (socket says 172.21.15.50:60858) 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.643+0000 7fc55a000700 1 -- 172.21.15.50:0/2479735153 learned_addr learned my addr 172.21.15.50:0/2479735153 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55aa00700 1 --2- 172.21.15.50:0/2479735153 >> v2:172.21.15.181:3300/0 conn(0x7fc55c0cb020 0x7fc55c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55b400700 1 --2- 172.21.15.50:0/2479735153 >> v2:172.21.15.50:3300/0 conn(0x7fc55c06aaa0 0x7fc55c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947427154 0 0) 0x7fc548001110 con 0x7fc55c15c2a0 2024-09-13T15:09:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5400035d0 con 0x7fc55c15c2a0 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258729942 0 0) 0x7fc5400035d0 con 0x7fc55c15c2a0 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 >> v2:172.21.15.181:3300/0 conn(0x7fc55c0cb020 msgr2=0x7fc55c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 --2- 172.21.15.50:0/2479735153 >> v2:172.21.15.181:3300/0 conn(0x7fc55c0cb020 0x7fc55c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 >> v2:172.21.15.50:3300/0 conn(0x7fc55c06aaa0 msgr2=0x7fc55c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 --2- 172.21.15.50:0/2479735153 >> v2:172.21.15.50:3300/0 conn(0x7fc55c06aaa0 0x7fc55c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c15bc40 con 0x7fc55c15c2a0 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fc548001800 con 0x7fc55c15c2a0 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 >> v1:172.21.15.50:6789/0 conn(0x7fc55c15c2a0 legacy=0x7fc55c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540003a90 0x7fc540003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540004870 0x7fc540004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540005230 0x7fc54000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0b2ad0 con 0x7fc540004870 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15b960 con 0x7fc540005230 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54000c050 con 0x7fc540003a90 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540004870 0x7fc540004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 -- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540003a90 msgr2=0x7fc540003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc540003a90 0x7fc540003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 -- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540005230 msgr2=0x7fc54000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55b400700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540005230 0x7fc54000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540005230 0x7fc54000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 -- 172.21.15.50:0/2479735153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400035d0 con 0x7fc540004870 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55b400700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540005230 0x7fc54000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55b400700 1 -- 172.21.15.50:0/2479735153 reap_dead start 2024-09-13T15:09:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc55a000700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540004870 0x7fc540004cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c2f0 tx=0x7fc5400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae814b469b0b3b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800ce30 con 0x7fc540004870 2024-09-13T15:09:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc548005980 con 0x7fc540004870 2024-09-13T15:09:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.647+0000 7fc559600700 1 -- 172.21.15.50:0/2479735153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548005d30 con 0x7fc540004870 2024-09-13T15:09:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 -- 172.21.15.50:0/2479735153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540004870 msgr2=0x7fc540004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540004870 0x7fc540004cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c2f0 tx=0x7fc5400058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 -- 172.21.15.50:0/2479735153 shutdown_connections 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 --2- 172.21.15.50:0/2479735153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540004870 0x7fc540004cf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 -- 172.21.15.50:0/2479735153 >> 172.21.15.50:0/2479735153 conn(0x7fc55c0b0c40 msgr2=0x7fc55c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 -- 172.21.15.50:0/2479735153 shutdown_connections 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 -- 172.21.15.50:0/2479735153 wait complete. 2024-09-13T15:09:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 Processor -- start 2024-09-13T15:09:13.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.651+0000 7fc55be00700 1 -- start start 2024-09-13T15:09:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540004870 0x7fc55c133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 0x7fc55c132130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc55c132670 0x7fc55c1e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c154b40 con 0x7fc55c1546c0 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c132b10 con 0x7fc540004870 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c132df0 con 0x7fc55c132670 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 0x7fc55c132130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 0x7fc55c132130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35994/0 (socket says 172.21.15.50:35994) 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 -- 172.21.15.50:0/4191196085 learned_addr learned my addr 172.21.15.50:0/4191196085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55aa00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540004870 0x7fc55c133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55b400700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc55c132670 0x7fc55c1e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 -- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc55c132670 msgr2=0x7fc55c1e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc55c132670 0x7fc55c1e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 -- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540004870 msgr2=0x7fc55c133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540004870 0x7fc55c133bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 -- 172.21.15.50:0/4191196085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c1330d0 con 0x7fc55c1546c0 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55a000700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 0x7fc55c132130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc54000bfa0 tx=0x7fc548001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548000ed0 con 0x7fc55c1546c0 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc548004890 con 0x7fc55c1546c0 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548004c40 con 0x7fc55c1546c0 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c1333b0 con 0x7fc55c1546c0 2024-09-13T15:09:13.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.655+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c134310 con 0x7fc55c1546c0 2024-09-13T15:09:13.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.659+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c1344a0 con 0x7fc55c1546c0 2024-09-13T15:09:13.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.659+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc548005040 con 0x7fc55c1546c0 2024-09-13T15:09:13.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.659+0000 7fc552a00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc53c066730 0x7fc53c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:13.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.659+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc548085180 con 0x7fc55c1546c0 2024-09-13T15:09:13.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.659+0000 7fc55aa00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc53c066730 0x7fc53c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:13.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.663+0000 7fc55aa00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc53c066730 0x7fc53c068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009b90 tx=0x7fc54c009550 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.667+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5480524c0 con 0x7fc55c1546c0 2024-09-13T15:09:13.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.899+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc55c06b430 con 0x7fc55c1546c0 2024-09-13T15:09:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.899+0000 7fc552a00700 1 -- 172.21.15.50:0/4191196085 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fc55c06b430 con 0x7fc55c1546c0 2024-09-13T15:09:13.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:13.907 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:13.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc53c066730 msgr2=0x7fc53c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc53c066730 0x7fc53c068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009b90 tx=0x7fc54c009550 comp rx=0 tx=0).stop 2024-09-13T15:09:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 msgr2=0x7fc55c132130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 0x7fc55c132130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc54000bfa0 tx=0x7fc548001b90 comp rx=0 tx=0).stop 2024-09-13T15:09:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 shutdown_connections 2024-09-13T15:09:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc53c066730 0x7fc53c068bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc55c132670 0x7fc55c1e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c1546c0 0x7fc55c132130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 --2- 172.21.15.50:0/4191196085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc540004870 0x7fc55c133bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 >> 172.21.15.50:0/4191196085 conn(0x7fc55c0b0c40 msgr2=0x7fc55c0cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 shutdown_connections 2024-09-13T15:09:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:13.907+0000 7fc55be00700 1 -- 172.21.15.50:0/4191196085 wait complete. 2024-09-13T15:09:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:14.336 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:09:08.080311+0000', 'modified': '2024-09-13T15:09:11.091926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5272': {'gid': 5272, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.181:6837/3742425350', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3742425350}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3742425350}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:09:14.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:09:14.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T15:09:14.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd17200700 1 Processor -- start 2024-09-13T15:09:14.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd17200700 1 -- start start 2024-09-13T15:09:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd17200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcd180cc6f0 0x7fcd1815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd17200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd180ccb40 con 0x7fcd180cb020 2024-09-13T15:09:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd17200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd180b2ad0 con 0x7fcd1806aaa0 2024-09-13T15:09:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd17200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1815b960 con 0x7fcd180cc6f0 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd15e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcd180cb020 0x7fcd1815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60860/0 (socket says 172.21.15.50:60860) 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.519+0000 7fcd15e00700 1 -- 172.21.15.50:0/2286284664 learned_addr learned my addr 172.21.15.50:0/2286284664 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd15400700 1 --2- 172.21.15.50:0/2286284664 >> v2:172.21.15.181:3300/0 conn(0x7fcd180cc6f0 0x7fcd1815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd14a00700 1 -- 172.21.15.50:0/2286284664 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919620721 0 0) 0x7fcd180ccb40 con 0x7fcd180cb020 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd14a00700 1 -- 172.21.15.50:0/2286284664 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccfc0035d0 con 0x7fcd180cb020 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd15400700 1 -- 172.21.15.50:0/2286284664 >> v1:172.21.15.181:6789/0 conn(0x7fcd1806aaa0 legacy=0x7fcd180b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd15400700 1 -- 172.21.15.50:0/2286284664 >> v1:172.21.15.50:6789/0 conn(0x7fcd180cb020 legacy=0x7fcd1815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd15400700 1 -- 172.21.15.50:0/2286284664 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1815bc40 con 0x7fcd180cc6f0 2024-09-13T15:09:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd15400700 1 --2- 172.21.15.50:0/2286284664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cc6f0 0x7fcd1815b0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009850 tx=0x7fcd04009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83abd64cfe57abdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd14a00700 1 -- 172.21.15.50:0/2286284664 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04011830 con 0x7fcd180cc6f0 2024-09-13T15:09:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd14a00700 1 -- 172.21.15.50:0/2286284664 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04011990 con 0x7fcd180cc6f0 2024-09-13T15:09:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd14a00700 1 -- 172.21.15.50:0/2286284664 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04011d40 con 0x7fcd180cc6f0 2024-09-13T15:09:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 -- 172.21.15.50:0/2286284664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cc6f0 msgr2=0x7fcd1815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 --2- 172.21.15.50:0/2286284664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cc6f0 0x7fcd1815b0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009850 tx=0x7fcd04009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 -- 172.21.15.50:0/2286284664 shutdown_connections 2024-09-13T15:09:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 --2- 172.21.15.50:0/2286284664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cc6f0 0x7fcd1815b0e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 -- 172.21.15.50:0/2286284664 >> 172.21.15.50:0/2286284664 conn(0x7fcd180b0c40 msgr2=0x7fcd1806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 -- 172.21.15.50:0/2286284664 shutdown_connections 2024-09-13T15:09:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.523+0000 7fcd17200700 1 -- 172.21.15.50:0/2286284664 wait complete. 2024-09-13T15:09:14.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 Processor -- start 2024-09-13T15:09:14.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 -- start start 2024-09-13T15:09:14.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcd1806aaa0 0x7fcd18146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cb020 0x7fcd181f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 0x7fcd180c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd181f3160 con 0x7fcd180cc6f0 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd181f3440 con 0x7fcd180cb020 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd17200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd181f3720 con 0x7fcd1806aaa0 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd16800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 0x7fcd180c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd16800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 0x7fcd180c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36002/0 (socket says 172.21.15.50:36002) 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd16800700 1 -- 172.21.15.50:0/1417495203 learned_addr learned my addr 172.21.15.50:0/1417495203 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd15400700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cb020 0x7fcd181f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.527+0000 7fcd15e00700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcd1806aaa0 0x7fcd18146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd16800700 1 -- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcd1806aaa0 msgr2=0x7fcd18146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd16800700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcd1806aaa0 0x7fcd18146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd16800700 1 -- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cb020 msgr2=0x7fcd181f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd16800700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cb020 0x7fcd181f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd16800700 1 -- 172.21.15.50:0/1417495203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd040094b0 con 0x7fcd180cc6f0 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd16800700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 0x7fcd180c7c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000cc50 tx=0x7fcd1000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd0e000700 1 -- 172.21.15.50:0/1417495203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003c20 con 0x7fcd180cc6f0 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd0e000700 1 -- 172.21.15.50:0/1417495203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10003d80 con 0x7fcd180cc6f0 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd181f3a00 con 0x7fcd180cc6f0 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd0e000700 1 -- 172.21.15.50:0/1417495203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000aab0 con 0x7fcd180cc6f0 2024-09-13T15:09:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.531+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd180c81d0 con 0x7fcd180cc6f0 2024-09-13T15:09:14.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.535+0000 7fcd0e000700 1 -- 172.21.15.50:0/1417495203 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd1000ac10 con 0x7fcd180cc6f0 2024-09-13T15:09:14.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.535+0000 7fcd0e000700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fccf8066730 0x7fccf8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd0e000700 1 -- 172.21.15.50:0/1417495203 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcd10084350 con 0x7fcd180cc6f0 2024-09-13T15:09:14.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd15e00700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fccf8066730 0x7fccf8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 Processor -- start 2024-09-13T15:09:14.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 -- start start 2024-09-13T15:09:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd15e00700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fccf8066730 0x7fccf8068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd08007fd0 tx=0x7fcd08007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28df3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dbb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df36c0 0x28dbbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d1ad80 con 0x28dd1d00 2024-09-13T15:09:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d18510 con 0x28df36c0 2024-09-13T15:09:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d13e00 con 0x28df2da0 2024-09-13T15:09:14.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd15400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dbb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd15400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dbb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36018/0 (socket says 172.21.15.50:36018) 2024-09-13T15:09:14.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd15400700 1 -- 172.21.15.50:0/433594470 learned_addr learned my addr 172.21.15.50:0/433594470 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd16800700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df36c0 0x28dbbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.539+0000 7fcd15e00700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28df3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15400700 1 -- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 msgr2=0x28df3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15400700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28df3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15400700 1 -- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df36c0 msgr2=0x28dbbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15400700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df36c0 0x28dbbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15400700 1 -- 172.21.15.50:0/433594470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28b86960 con 0x28dd1d00 2024-09-13T15:09:14.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd16800700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df36c0 0x28dbbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:14.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15e00700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28df3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:14.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd15400700 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dbb890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcd04014040 tx=0x7fcd04008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152cfb66a3a67680 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd02600700 1 -- 172.21.15.50:0/433594470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04011d00 con 0x28dd1d00 2024-09-13T15:09:14.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd02600700 1 -- 172.21.15.50:0/433594470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0401a420 con 0x28dd1d00 2024-09-13T15:09:14.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd02600700 1 -- 172.21.15.50:0/433594470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0401a790 con 0x28dd1d00 2024-09-13T15:09:14.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 -- 172.21.15.50:0/433594470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 msgr2=0x28dbb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dbb890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcd04014040 tx=0x7fcd04008030 comp rx=0 tx=0).stop 2024-09-13T15:09:14.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 -- 172.21.15.50:0/433594470 shutdown_connections 2024-09-13T15:09:14.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df36c0 0x28dbbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dbb890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/433594470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28df3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 -- 172.21.15.50:0/433594470 >> 172.21.15.50:0/433594470 conn(0x28b3b4d0 msgr2=0x28dd4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 -- 172.21.15.50:0/433594470 shutdown_connections 2024-09-13T15:09:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.543+0000 7fcd1fe97740 1 -- 172.21.15.50:0/433594470 wait complete. 2024-09-13T15:09:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 -- start start 2024-09-13T15:09:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 Processor -- start 2024-09-13T15:09:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28dae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dabbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28df9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cd1730 con 0x28df36c0 2024-09-13T15:09:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cd75b0 con 0x28dd1d00 2024-09-13T15:09:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x28bbfaa0 con 0x28df2da0 2024-09-13T15:09:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 10 client.0 _ll_register_callbacks cb 0x28d0d610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:09:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28df9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28df9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36024/0 (socket says 172.21.15.50:36024) 2024-09-13T15:09:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 -- 172.21.15.50:0/3640251128 learned_addr learned my addr 172.21.15.50:0/3640251128 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28dae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd15400700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dabbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 -- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 msgr2=0x28dabbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dabbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 -- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 msgr2=0x28dae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28dae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 -- 172.21.15.50:0/3640251128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1815bc40 con 0x28df36c0 2024-09-13T15:09:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd16800700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28df9290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcd10055130 tx=0x7fcd100559d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bfb150bf281ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fccf6a00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:09:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fccf6a00700 1 -- 172.21.15.50:0/3640251128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1006c070 con 0x28df36c0 2024-09-13T15:09:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fccf6a00700 1 -- 172.21.15.50:0/3640251128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcd1005d590 con 0x28df36c0 2024-09-13T15:09:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.547+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28b481e0 con 0x28df36c0 2024-09-13T15:09:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fccf6a00700 1 -- 172.21.15.50:0/3640251128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd1005b0c0 con 0x28df36c0 2024-09-13T15:09:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 10 client.5406 fetch_fsmap learned FSMap version 15 2024-09-13T15:09:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x28cda220 con 0x28df36c0 2024-09-13T15:09:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fccf6a00700 1 -- 172.21.15.50:0/3640251128 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x28b481e0 con 0x28df36c0 2024-09-13T15:09:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fccf6a00700 1 -- 172.21.15.50:0/3640251128 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcd10082170 con 0x28df36c0 2024-09-13T15:09:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 10 client.5406 fetch_fsmap finished waiting for FSMap version 15 2024-09-13T15:09:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 10 client.5406 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:09:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 20 client.5406 populate_metadata read hostname 'smithi050' 2024-09-13T15:09:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df97d0 0x28daad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 4 client.5406 mds_command: new command op to 5272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:09:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 --> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28b92460 con 0x28df97d0 2024-09-13T15:09:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df97d0 0x28daad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fccf6a00700 10 client.5406 ms_handle_connect on v2:172.21.15.181:6836/3742425350 2024-09-13T15:09:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.551+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df97d0 0x28daad60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2316e5f35c4a7888 server_cookie=f772f909dcafead9 in_seq=0 out_seq=0 2024-09-13T15:09:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fccf6a00700 1 -- 172.21.15.50:0/3640251128 <== mds.0 v2:172.21.15.181:6836/3742425350 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x28b92460 con 0x28df97d0 2024-09-13T15:09:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fccf6a00700 10 client.5406 handle_command_reply: tid=0 2024-09-13T15:09:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 client.5406 shutdown 2024-09-13T15:09:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 msgr2=0x28df9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28df9290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcd10055130 tx=0x7fcd100559d0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 shutdown_connections 2024-09-13T15:09:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28df9290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dabbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df97d0 0x28daad60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3640251128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28dae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 >> 172.21.15.50:0/3640251128 conn(0x28b3b4d0 msgr2=0x28dce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fccf6a00700 0 client.5406 ms_handle_reset on v2:172.21.15.181:6836/3742425350 2024-09-13T15:09:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 shutdown_connections 2024-09-13T15:09:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3640251128 wait complete. 2024-09-13T15:09:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.555+0000 7fcd1fe97740 20 client.5406 trim_cache size 0 max 16384 2024-09-13T15:09:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.575+0000 7fcd1fe97740 1 Processor -- start 2024-09-13T15:09:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 -- start start 2024-09-13T15:09:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dd0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df2da0 0x28dd12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df36c0 0x28e01bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cba950 con 0x28dd1d00 2024-09-13T15:09:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d0bb00 con 0x28df2da0 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x28da3320 con 0x28df36c0 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dd0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dd0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36028/0 (socket says 172.21.15.50:36028) 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 -- 172.21.15.50:0/1953439633 learned_addr learned my addr 172.21.15.50:0/1953439633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd16800700 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df36c0 0x28e01bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15400700 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df2da0 0x28dd12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 -- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df36c0 msgr2=0x28e01bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df36c0 0x28e01bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 -- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df2da0 msgr2=0x28dd12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df2da0 0x28dd12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 -- 172.21.15.50:0/1953439633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28cc0450 con 0x28dd1d00 2024-09-13T15:09:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd15e00700 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dd0da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcd080015a0 tx=0x7fcd08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e3e84bebc06e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd03000700 1 -- 172.21.15.50:0/1953439633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0802b030 con 0x28dd1d00 2024-09-13T15:09:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd03000700 1 -- 172.21.15.50:0/1953439633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08001cf0 con 0x28dd1d00 2024-09-13T15:09:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.579+0000 7fcd03000700 1 -- 172.21.15.50:0/1953439633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08027ea0 con 0x28dd1d00 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 -- 172.21.15.50:0/1953439633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 msgr2=0x28dd0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dd0da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcd080015a0 tx=0x7fcd08012000 comp rx=0 tx=0).stop 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 -- 172.21.15.50:0/1953439633 shutdown_connections 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df36c0 0x28e01bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28df2da0 0x28dd12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/1953439633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28dd1d00 0x28dd0da0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 -- 172.21.15.50:0/1953439633 >> 172.21.15.50:0/1953439633 conn(0x28b3b4d0 msgr2=0x28dd0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 -- 172.21.15.50:0/1953439633 shutdown_connections 2024-09-13T15:09:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 -- 172.21.15.50:0/1953439633 wait complete. 2024-09-13T15:09:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 -- start start 2024-09-13T15:09:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.583+0000 7fcd1fe97740 1 Processor -- start 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28e5c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dd0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28dd13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e199f0 con 0x28df36c0 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x28df7e50 con 0x28dd1d00 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x28df7bb0 con 0x28df2da0 2024-09-13T15:09:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 10 client.0 _ll_register_callbacks cb 0x28d6a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:09:14.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28dd13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28dd13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36036/0 (socket says 172.21.15.50:36036) 2024-09-13T15:09:14.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 -- 172.21.15.50:0/3657246162 learned_addr learned my addr 172.21.15.50:0/3657246162 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd15400700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dd0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28e5c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 -- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 msgr2=0x28dd0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dd0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 -- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 msgr2=0x28e5c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28e5c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 -- 172.21.15.50:0/3657246162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd08019040 con 0x28df36c0 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28e5c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd16800700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28dd13f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd10054ea0 tx=0x7fcd10082570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a319bdd751ac9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fccf6a00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:09:14.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fccf6a00700 1 -- 172.21.15.50:0/3657246162 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1006c040 con 0x28df36c0 2024-09-13T15:09:14.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fccf6a00700 1 -- 172.21.15.50:0/3657246162 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcd1005d590 con 0x28df36c0 2024-09-13T15:09:14.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd0401a420 con 0x28df36c0 2024-09-13T15:09:14.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fccf6a00700 1 -- 172.21.15.50:0/3657246162 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd100514e0 con 0x28df36c0 2024-09-13T15:09:14.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 10 client.5412 fetch_fsmap learned FSMap version 15 2024-09-13T15:09:14.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x28cb4720 con 0x28df36c0 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fccf6a00700 1 -- 172.21.15.50:0/3657246162 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0401a420 con 0x28df36c0 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fccf6a00700 1 -- 172.21.15.50:0/3657246162 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcd10055400 con 0x28df36c0 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 10 client.5412 fetch_fsmap finished waiting for FSMap version 15 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 10 client.5412 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 20 client.5412 populate_metadata read hostname 'smithi050' 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.587+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df6b00 0x28df6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 4 client.5412 mds_command: new command op to 5272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:09:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 --> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] -- command(tid 0: {"prefix": "status"}) v1 -- 0x28bb71e0 con 0x28df6b00 2024-09-13T15:09:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df6b00 0x28df6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd15e00700 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df6b00 0x28df6ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=328e5eaa779953f1 server_cookie=14d95775be950126 in_seq=0 out_seq=0 2024-09-13T15:09:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fccf6a00700 10 client.5412 ms_handle_connect on v2:172.21.15.181:6836/3742425350 2024-09-13T15:09:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fccf6a00700 1 -- 172.21.15.50:0/3657246162 <== mds.0 v2:172.21.15.181:6836/3742425350 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x28bb71e0 con 0x28df6b00 2024-09-13T15:09:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fccf6a00700 10 client.5412 handle_command_reply: tid=0 2024-09-13T15:09:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 client.5412 shutdown 2024-09-13T15:09:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 msgr2=0x28dd13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28dd13f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd10054ea0 tx=0x7fcd10082570 comp rx=0 tx=0).stop 2024-09-13T15:09:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 shutdown_connections 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x28df36c0 0x28dd13f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x28df2da0 0x28dd0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:6836/3742425350,v1:172.21.15.181:6837/3742425350] conn(0x28df6b00 0x28df6ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 --2- 172.21.15.50:0/3657246162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x28dd1d00 0x28e5c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 >> 172.21.15.50:0/3657246162 conn(0x28b3b4d0 msgr2=0x28da9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fccf6a00700 0 client.5412 ms_handle_reset on v2:172.21.15.181:6836/3742425350 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 shutdown_connections 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 1 -- 172.21.15.50:0/3657246162 wait complete. 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.591+0000 7fcd1fe97740 20 client.5412 trim_cache size 0 max 16384 2024-09-13T15:09:14.598 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5272, 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.5086908220000002, 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 15, 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 39, 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 39, 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.817656036000001 2024-09-13T15:09:14.599 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:09:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fccf8066730 msgr2=0x7fccf8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fccf8066730 0x7fccf8068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd08007fd0 tx=0x7fcd08007de0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 msgr2=0x7fcd180c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 0x7fcd180c7c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000cc50 tx=0x7fcd1000cf60 comp rx=0 tx=0).stop 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 shutdown_connections 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fccf8066730 0x7fccf8068bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd180cc6f0 0x7fcd180c7c90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd180cb020 0x7fcd181f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 --2- 172.21.15.50:0/1417495203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcd1806aaa0 0x7fcd18146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 >> 172.21.15.50:0/1417495203 conn(0x7fcd180b0c40 msgr2=0x7fcd1815a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 shutdown_connections 2024-09-13T15:09:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.595+0000 7fcd17200700 1 -- 172.21.15.50:0/1417495203 wait complete. 2024-09-13T15:09:14.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:09:14.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 Processor -- start 2024-09-13T15:09:14.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 -- start start 2024-09-13T15:09:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a5006f880 0x7f7a5006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a500cb4e0 0x7f7a500cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500d0a80 0x7f7a500d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a501629d0 con 0x7f7a500cb4e0 2024-09-13T15:09:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a50147670 con 0x7f7a5006f880 2024-09-13T15:09:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a55000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50147a90 con 0x7f7a500d0a80 2024-09-13T15:09:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a4d400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a500cb4e0 0x7f7a500cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a4d400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a500cb4e0 0x7f7a500cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36042/0 (socket says 172.21.15.50:36042) 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.787+0000 7f7a4d400700 1 -- 172.21.15.50:0/4255892051 learned_addr learned my addr 172.21.15.50:0/4255892051 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4de00700 1 --2- 172.21.15.50:0/4255892051 >> v2:172.21.15.181:3300/0 conn(0x7f7a5006f880 0x7f7a5006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4e800700 1 --2- 172.21.15.50:0/4255892051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500d0a80 0x7f7a500d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4d400700 1 -- 172.21.15.50:0/4255892051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500d0a80 msgr2=0x7f7a500d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4d400700 1 --2- 172.21.15.50:0/4255892051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500d0a80 0x7f7a500d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4d400700 1 -- 172.21.15.50:0/4255892051 >> v2:172.21.15.181:3300/0 conn(0x7f7a5006f880 msgr2=0x7f7a5006fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4d400700 1 --2- 172.21.15.50:0/4255892051 >> v2:172.21.15.181:3300/0 conn(0x7f7a5006f880 0x7f7a5006fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4d400700 1 -- 172.21.15.50:0/4255892051 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a500cbe70 con 0x7f7a500cb4e0 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4d400700 1 --2- 172.21.15.50:0/4255892051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500cb4e0 0x7f7a500cb930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a500b3800 tx=0x7f7a3c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380ffde5e38cd34a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4ca00700 1 -- 172.21.15.50:0/4255892051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c011830 con 0x7f7a500cb4e0 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4ca00700 1 -- 172.21.15.50:0/4255892051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c011990 con 0x7f7a500cb4e0 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a4ca00700 1 -- 172.21.15.50:0/4255892051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c011d20 con 0x7f7a500cb4e0 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 -- 172.21.15.50:0/4255892051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500cb4e0 msgr2=0x7f7a500cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 --2- 172.21.15.50:0/4255892051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500cb4e0 0x7f7a500cb930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a500b3800 tx=0x7f7a3c009c50 comp rx=0 tx=0).stop 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 -- 172.21.15.50:0/4255892051 shutdown_connections 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 --2- 172.21.15.50:0/4255892051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500d0a80 0x7f7a500d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 --2- 172.21.15.50:0/4255892051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500cb4e0 0x7f7a500cb930 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 --2- 172.21.15.50:0/4255892051 >> v2:172.21.15.181:3300/0 conn(0x7f7a5006f880 0x7f7a5006fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 -- 172.21.15.50:0/4255892051 >> 172.21.15.50:0/4255892051 conn(0x7f7a500726d0 msgr2=0x7f7a5006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 -- 172.21.15.50:0/4255892051 shutdown_connections 2024-09-13T15:09:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.791+0000 7f7a55000700 1 -- 172.21.15.50:0/4255892051 wait complete. 2024-09-13T15:09:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 Processor -- start 2024-09-13T15:09:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 -- start start 2024-09-13T15:09:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a5006f880 0x7f7a5006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500cb4e0 0x7f7a5015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 0x7f7a5015c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5006c1a0 con 0x7f7a500d0a80 2024-09-13T15:09:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5015bcd0 con 0x7f7a5006f880 2024-09-13T15:09:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a55000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5006c440 con 0x7f7a500cb4e0 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a4e800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 0x7f7a5015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a4e800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 0x7f7a5015c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36050/0 (socket says 172.21.15.50:36050) 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a4e800700 1 -- 172.21.15.50:0/2435028548 learned_addr learned my addr 172.21.15.50:0/2435028548 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a4d400700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500cb4e0 0x7f7a5015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.795+0000 7f7a4de00700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a5006f880 0x7f7a5006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4e800700 1 -- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500cb4e0 msgr2=0x7f7a5015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4e800700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500cb4e0 0x7f7a5015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4e800700 1 -- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a5006f880 msgr2=0x7f7a5006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4e800700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a5006f880 0x7f7a5006bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4e800700 1 -- 172.21.15.50:0/2435028548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009570 con 0x7f7a500d0a80 2024-09-13T15:09:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4de00700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a5006f880 0x7f7a5006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a4e800700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 0x7f7a5015c300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7a48007e60 tx=0x7f7a4800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800ede0 con 0x7f7a500d0a80 2024-09-13T15:09:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48014420 con 0x7f7a500d0a80 2024-09-13T15:09:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480147d0 con 0x7f7a500d0a80 2024-09-13T15:09:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5006c720 con 0x7f7a500d0a80 2024-09-13T15:09:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5006cce0 con 0x7f7a500d0a80 2024-09-13T15:09:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.799+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a50147290 con 0x7f7a500d0a80 2024-09-13T15:09:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.803+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a48014930 con 0x7f7a500d0a80 2024-09-13T15:09:14.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.803+0000 7f7a46000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a30066730 0x7f7a30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:14.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.803+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a48084a00 con 0x7f7a500d0a80 2024-09-13T15:09:14.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.803+0000 7f7a4de00700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a30066730 0x7f7a30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.803+0000 7f7a4de00700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a30066730 0x7f7a30068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009bc0 tx=0x7f7a40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:14.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:14.811+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a48051b90 con 0x7f7a500d0a80 2024-09-13T15:09:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.047+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7a50067730 con 0x7f7a500d0a80 2024-09-13T15:09:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.047+0000 7f7a46000700 1 -- 172.21.15.50:0/2435028548 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7a48084020 con 0x7f7a500d0a80 2024-09-13T15:09:15.053 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:09:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a30066730 msgr2=0x7f7a30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a30066730 0x7f7a30068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009bc0 tx=0x7f7a40008040 comp rx=0 tx=0).stop 2024-09-13T15:09:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 msgr2=0x7f7a5015c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 0x7f7a5015c300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7a48007e60 tx=0x7f7a4800e3c0 comp rx=0 tx=0).stop 2024-09-13T15:09:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 shutdown_connections 2024-09-13T15:09:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7a30066730 0x7f7a30068bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a500d0a80 0x7f7a5015c300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a500cb4e0 0x7f7a5015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 --2- 172.21.15.50:0/2435028548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a5006f880 0x7f7a5006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.051+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 >> 172.21.15.50:0/2435028548 conn(0x7f7a500726d0 msgr2=0x7f7a50145830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:15.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.055+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 shutdown_connections 2024-09-13T15:09:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:15.055+0000 7f7a55000700 1 -- 172.21.15.50:0/2435028548 wait complete. 2024-09-13T15:09:15.082 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:09:15.083 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:15.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.083 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:09:15.101 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:09:15.101 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:15.102 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42352sec preferred_lft 42352sec 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.103 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:09:15.104 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:15.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.106 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:09:15.184 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:09:15.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.187 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:09:15.252 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:09:15.252 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:09:15.252 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:09:15.252 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:09:15.252 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:09:15.252 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:09:15.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.253 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:09:15.253 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:09:15.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:09:15.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:09:15.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:09:15.253 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:09:15.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.387 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:09:15.403 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:09:15.403 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:09:15.404 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:15.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:09:15.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:15.479 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:15.544 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:15.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:15.544 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:15.601 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:09:15.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:15.742 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:15.742 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:15.777 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:15.777 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:15.777 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:09:15.777 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:09:15.777 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:09:15.783 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:09:15.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:15.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:15.815 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:09:15.900 INFO:teuthology.orchestra.run.smithi050.stdout:client5117 2024-09-13T15:09:15.900 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:15.900 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:15.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:09:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.191+0000 7f1008a00700 1 Processor -- start 2024-09-13T15:09:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.191+0000 7f1008a00700 1 -- start start 2024-09-13T15:09:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1008a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f100406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1008a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10040b3560 con 0x7f10040b2670 2024-09-13T15:09:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1008a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100406b420 con 0x7f10041610b0 2024-09-13T15:09:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1008a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1004070b30 con 0x7f100406aaa0 2024-09-13T15:09:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10040b2670 0x7f10040cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60862/0 (socket says 172.21.15.50:60862) 2024-09-13T15:09:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003e00700 1 -- 172.21.15.50:0/2144209066 learned_addr learned my addr 172.21.15.50:0/2144209066 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f0ffaa00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f100406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391463798 0 0) 0x7f10040b3560 con 0x7f10040b2670 2024-09-13T15:09:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe80035d0 con 0x7f10040b2670 2024-09-13T15:09:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2150020715 0 0) 0x7f0fe80035d0 con 0x7f10040b2670 2024-09-13T15:09:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 msgr2=0x7f100406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f100406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 >> v1:172.21.15.181:6789/0 conn(0x7f10041610b0 legacy=0x7f10040719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040b3280 con 0x7f10040b2670 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f0ffc001670 con 0x7f10040b2670 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 >> v1:172.21.15.50:6789/0 conn(0x7f10040b2670 legacy=0x7f10040cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f0fe8003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe8004040 0x7f0fe8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe8004db0 0x7f0fe8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1004070b30 con 0x7f0fe8004040 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe800bc20 con 0x7f0fe8004db0 2024-09-13T15:09:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe800bde0 con 0x7f100406aaa0 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003400700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f0fe8003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f0ffaa00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe8004040 0x7f0fe8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003e00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe8004db0 0x7f0fe8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003400700 1 -- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe8004db0 msgr2=0x7f0fe8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003400700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe8004db0 0x7f0fe8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003400700 1 -- 172.21.15.50:0/2144209066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe8004040 msgr2=0x7f0fe8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003400700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe8004040 0x7f0fe8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.195+0000 7f1003400700 1 -- 172.21.15.50:0/2144209066 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80035d0 con 0x7f100406aaa0 2024-09-13T15:09:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f0ffaa00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe8004040 0x7f0fe8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1003400700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f0fe8003ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c190 tx=0x7f0fe80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e370c24672090b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4001db0 con 0x7f100406aaa0 2024-09-13T15:09:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff400ccd0 con 0x7f100406aaa0 2024-09-13T15:09:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1002a00700 1 -- 172.21.15.50:0/2144209066 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4003c60 con 0x7f100406aaa0 2024-09-13T15:09:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1008a00700 1 -- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 msgr2=0x7f0fe8003ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1008a00700 1 --2- 172.21.15.50:0/2144209066 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100406aaa0 0x7f0fe8003ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c190 tx=0x7f0fe80058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1003e00700 1 -- 172.21.15.50:0/2144209066 reap_dead start 2024-09-13T15:09:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1008a00700 1 -- 172.21.15.50:0/2144209066 shutdown_connections 2024-09-13T15:09:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1008a00700 1 -- 172.21.15.50:0/2144209066 >> 172.21.15.50:0/2144209066 conn(0x7f10040b0c40 msgr2=0x7f100406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:16.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1008a00700 1 -- 172.21.15.50:0/2144209066 shutdown_connections 2024-09-13T15:09:16.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.199+0000 7f1008a00700 1 -- 172.21.15.50:0/2144209066 wait complete. 2024-09-13T15:09:16.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 Processor -- start 2024-09-13T15:09:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 -- start start 2024-09-13T15:09:16.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100406aaa0 0x7f1004153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 0x7f100414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100415a3d0 0x7f100415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100415adc0 con 0x7f1004164020 2024-09-13T15:09:16.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10041644a0 con 0x7f100406aaa0 2024-09-13T15:09:16.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f1008a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10041591f0 con 0x7f100415a3d0 2024-09-13T15:09:16.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f0ffaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 0x7f100414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f0ffaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 0x7f100414aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36064/0 (socket says 172.21.15.50:36064) 2024-09-13T15:09:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.203+0000 7f0ffaa00700 1 -- 172.21.15.50:0/1839926894 learned_addr learned my addr 172.21.15.50:0/1839926894 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f1003e00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100415a3d0 0x7f100415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f1003400700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100406aaa0 0x7f1004153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffaa00700 1 -- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100415a3d0 msgr2=0x7f100415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffaa00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100415a3d0 0x7f100415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffaa00700 1 -- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100406aaa0 msgr2=0x7f1004153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffaa00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100406aaa0 0x7f1004153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffaa00700 1 -- 172.21.15.50:0/1839926894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10041646b0 con 0x7f1004164020 2024-09-13T15:09:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f1003400700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100406aaa0 0x7f1004153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffaa00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 0x7f100414aa70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0fec011ca0 tx=0x7f0fec00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00fb30 con 0x7f1004164020 2024-09-13T15:09:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00fc90 con 0x7f1004164020 2024-09-13T15:09:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec004020 con 0x7f1004164020 2024-09-13T15:09:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1004159440 con 0x7f1004164020 2024-09-13T15:09:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1004159a00 con 0x7f1004164020 2024-09-13T15:09:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.207+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1004071460 con 0x7f1004164020 2024-09-13T15:09:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.211+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0fec004180 con 0x7f1004164020 2024-09-13T15:09:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.211+0000 7f0ffbe00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe0066730 0x7f0fe0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.211+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fec084690 con 0x7f1004164020 2024-09-13T15:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.211+0000 7f1003400700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe0066730 0x7f0fe0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:16.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.215+0000 7f1003400700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe0066730 0x7f0fe0068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4005040 tx=0x7f0ff4009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:16.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.215+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0fec0518b0 con 0x7f1004164020 2024-09-13T15:09:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.451+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f100406ce60 con 0x7f1004164020 2024-09-13T15:09:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.455+0000 7f0ffbe00700 1 -- 172.21.15.50:0/1839926894 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fec054ed0 con 0x7f1004164020 2024-09-13T15:09:16.460 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe0066730 msgr2=0x7f0fe0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe0066730 0x7f0fe0068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4005040 tx=0x7f0ff4009030 comp rx=0 tx=0).stop 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 msgr2=0x7f100414aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 0x7f100414aa70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0fec011ca0 tx=0x7f0fec00f520 comp rx=0 tx=0).stop 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 shutdown_connections 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fe0066730 0x7f0fe0068bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f100415a3d0 0x7f100415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1004164020 0x7f100414aa70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 --2- 172.21.15.50:0/1839926894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100406aaa0 0x7f1004153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 >> 172.21.15.50:0/1839926894 conn(0x7f10040b0c40 msgr2=0x7f100415ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 shutdown_connections 2024-09-13T15:09:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:16.459+0000 7f1008a00700 1 -- 172.21.15.50:0/1839926894 wait complete. 2024-09-13T15:09:16.484 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:09:16.485 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:09:16.485 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:09:16.485 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:09:16.485 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:16.485 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:09:16.486 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:09:16.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:09:16.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:09:16.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.486 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:09:16.507 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:09:16.507 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:09:16.507 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:09:16.507 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.508 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:09:16.508 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.508 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:16.508 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:16.508 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:09:16.509 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:16.509 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:16.509 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:09:16.509 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:16.509 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:16.509 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:09:16.510 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:16.510 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:09:16.510 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42340sec preferred_lft 42340sec 2024-09-13T15:09:16.510 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:09:16.510 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.511 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:09:16.511 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:16.511 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:09:16.511 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.512 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:09:16.512 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:16.512 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:09:16.512 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.512 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:09:16.513 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.513 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:16.513 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:09:16.513 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:09:16.513 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.513 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:16.514 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:09:16.514 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:09:16.514 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:16.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.515 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:09:16.581 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:09:16.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.585 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:09:16.646 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:09:16.646 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:09:16.646 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:09:16.646 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:09:16.646 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:09:16.647 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:09:16.647 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:09:16.647 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:09:16.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.647 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:09:16.647 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:09:16.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:09:16.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:09:16.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:09:16.647 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:09:16.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.772 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:09:16.789 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:09:16.789 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:09:16.790 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:09:16.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:09:16.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:16.867 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:16.924 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:09:16.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:16.925 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:16.985 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:09:16.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:16.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:17.123 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:17.123 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:17.147 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:17.147 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:17.147 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:09:17.147 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:09:17.148 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:09:17.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:09:17.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:17.155 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:17.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:17.183 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:09:17.254 INFO:teuthology.orchestra.run.smithi181.stdout:client5126 2024-09-13T15:09:17.255 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:17.255 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:17.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-13T15:09:17.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.487+0000 7f30f8400700 1 Processor -- start 2024-09-13T15:09:17.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f8400700 1 -- start start 2024-09-13T15:09:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f8400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f30f0157500 0x7f30f00ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f8400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30f00cd140 0x7f30f00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f8400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f00b57e0 con 0x7f30f015e030 2024-09-13T15:09:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f8400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00cdb30 con 0x7f30f00cd140 2024-09-13T15:09:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f8400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00b3b80 con 0x7f30f0157500 2024-09-13T15:09:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30f015e030 0x7f30f0070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60872/0 (socket says 172.21.15.50:60872) 2024-09-13T15:09:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5000700 1 -- 172.21.15.50:0/656927811 learned_addr learned my addr 172.21.15.50:0/656927811 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5a00700 1 --2- 172.21.15.50:0/656927811 >> v2:172.21.15.181:3300/0 conn(0x7f30f0157500 0x7f30f00ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f6400700 1 --2- 172.21.15.50:0/656927811 >> v2:172.21.15.50:3300/0 conn(0x7f30f00cd140 0x7f30f00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30efe00700 1 -- 172.21.15.50:0/656927811 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37494587 0 0) 0x7f30f00b57e0 con 0x7f30f015e030 2024-09-13T15:09:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30efe00700 1 -- 172.21.15.50:0/656927811 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d80035d0 con 0x7f30f015e030 2024-09-13T15:09:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5a00700 1 -- 172.21.15.50:0/656927811 >> v2:172.21.15.50:3300/0 conn(0x7f30f00cd140 msgr2=0x7f30f00cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5a00700 1 --2- 172.21.15.50:0/656927811 >> v2:172.21.15.50:3300/0 conn(0x7f30f00cd140 0x7f30f00cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5a00700 1 -- 172.21.15.50:0/656927811 >> v1:172.21.15.50:6789/0 conn(0x7f30f015e030 legacy=0x7f30f0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5a00700 1 -- 172.21.15.50:0/656927811 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00b5a80 con 0x7f30f0157500 2024-09-13T15:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.491+0000 7f30f5a00700 1 --2- 172.21.15.50:0/656927811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f0157500 0x7f30f00ce700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009850 tx=0x7f30e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22eba5502db6603e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30efe00700 1 -- 172.21.15.50:0/656927811 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4011830 con 0x7f30f0157500 2024-09-13T15:09:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30efe00700 1 -- 172.21.15.50:0/656927811 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4011990 con 0x7f30f0157500 2024-09-13T15:09:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30efe00700 1 -- 172.21.15.50:0/656927811 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4011d20 con 0x7f30f0157500 2024-09-13T15:09:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 -- 172.21.15.50:0/656927811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f0157500 msgr2=0x7f30f00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 --2- 172.21.15.50:0/656927811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f0157500 0x7f30f00ce700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009850 tx=0x7f30e4009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 -- 172.21.15.50:0/656927811 shutdown_connections 2024-09-13T15:09:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 --2- 172.21.15.50:0/656927811 >> v2:172.21.15.50:3300/0 conn(0x7f30f00cd140 0x7f30f00cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 --2- 172.21.15.50:0/656927811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f0157500 0x7f30f00ce700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 -- 172.21.15.50:0/656927811 >> 172.21.15.50:0/656927811 conn(0x7f30f006e660 msgr2=0x7f30f006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 -- 172.21.15.50:0/656927811 shutdown_connections 2024-09-13T15:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.495+0000 7f30f8400700 1 -- 172.21.15.50:0/656927811 wait complete. 2024-09-13T15:09:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.499+0000 7f30f8400700 1 Processor -- start 2024-09-13T15:09:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.499+0000 7f30f8400700 1 -- start start 2024-09-13T15:09:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 0x7f30f0143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f0157500 0x7f30f0148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f015e030 0x7f30f015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f014a810 con 0x7f30f00cd140 2024-09-13T15:09:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0148550 con 0x7f30f015e030 2024-09-13T15:09:17.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0148b10 con 0x7f30f0157500 2024-09-13T15:09:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 0x7f30f0143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 0x7f30f0143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36078/0 (socket says 172.21.15.50:36078) 2024-09-13T15:09:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 -- 172.21.15.50:0/1101501047 learned_addr learned my addr 172.21.15.50:0/1101501047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f6400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f015e030 0x7f30f015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5000700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f0157500 0x7f30f0148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 -- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f0157500 msgr2=0x7f30f0148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f0157500 0x7f30f0148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 -- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f015e030 msgr2=0x7f30f015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f015e030 0x7f30f015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 -- 172.21.15.50:0/1101501047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40094b0 con 0x7f30f00cd140 2024-09-13T15:09:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f5a00700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 0x7f30f0143f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ba0 tx=0x7f30e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4004450 con 0x7f30f00cd140 2024-09-13T15:09:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e401f070 con 0x7f30f00cd140 2024-09-13T15:09:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f006c3a0 con 0x7f30f00cd140 2024-09-13T15:09:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4003900 con 0x7f30f00cd140 2024-09-13T15:09:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.503+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f01487a0 con 0x7f30f00cd140 2024-09-13T15:09:17.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.507+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f00cd5f0 con 0x7f30f00cd140 2024-09-13T15:09:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.507+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f30e4003a60 con 0x7f30f00cd140 2024-09-13T15:09:17.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.507+0000 7f30ed600700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30d0066760 0x7f30d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:17.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.511+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f30e4021070 con 0x7f30f00cd140 2024-09-13T15:09:17.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.511+0000 7f30f5000700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30d0066760 0x7f30d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:17.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.511+0000 7f30f5000700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30d0066760 0x7f30d0068c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ce600 tx=0x7f30dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.515+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f30e4052b50 con 0x7f30f00cd140 2024-09-13T15:09:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.703+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7f30f01602a0 con 0x7f30f00cd140 2024-09-13T15:09:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.711+0000 7f30ed600700 1 -- 172.21.15.50:0/1101501047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v11)=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f30e40045d0 con 0x7f30f00cd140 2024-09-13T15:09:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30d0066760 msgr2=0x7f30d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30d0066760 0x7f30d0068c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ce600 tx=0x7f30dc009040 comp rx=0 tx=0).stop 2024-09-13T15:09:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 msgr2=0x7f30f0143f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 0x7f30f0143f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ba0 tx=0x7f30e4004770 comp rx=0 tx=0).stop 2024-09-13T15:09:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 shutdown_connections 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30d0066760 0x7f30d0068c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f015e030 0x7f30f015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f0157500 0x7f30f0148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 --2- 172.21.15.50:0/1101501047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30f00cd140 0x7f30f0143f30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 >> 172.21.15.50:0/1101501047 conn(0x7f30f006e660 msgr2=0x7f30f00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 shutdown_connections 2024-09-13T15:09:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:17.715+0000 7f30f8400700 1 -- 172.21.15.50:0/1101501047 wait complete. 2024-09-13T15:09:17.743 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:17.743 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:17.761 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:17.761 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:17.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.027+0000 7fa7e8a00700 1 Processor -- start 2024-09-13T15:09:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.027+0000 7fa7e8a00700 1 -- start start 2024-09-13T15:09:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.027+0000 7fa7e8a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa7e4161180 0x7fa7e406bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.027+0000 7fa7e8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 0x7fa7e40acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e8a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e4071ba0 con 0x7fa7e40ad310 2024-09-13T15:09:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e8a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e4070120 con 0x7fa7e4161180 2024-09-13T15:09:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4070400 con 0x7fa7e40ae200 2024-09-13T15:09:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e3200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa7e40ad310 0x7fa7e40abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60876/0 (socket says 172.21.15.50:60876) 2024-09-13T15:09:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e3200700 1 -- 172.21.15.50:0/3069935260 learned_addr learned my addr 172.21.15.50:0/3069935260 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7d9e00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 0x7fa7e40acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 --2- 172.21.15.50:0/3069935260 >> v2:172.21.15.181:3300/0 conn(0x7fa7e4161180 0x7fa7e406bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051837683 0 0) 0x7fa7e4071ba0 con 0x7fa7e40ad310 2024-09-13T15:09:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c40035d0 con 0x7fa7e40ad310 2024-09-13T15:09:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3209448939 0 0) 0x7fa7c40035d0 con 0x7fa7e40ad310 2024-09-13T15:09:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 msgr2=0x7fa7e40acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 0x7fa7e40acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 >> v2:172.21.15.181:3300/0 conn(0x7fa7e4161180 msgr2=0x7fa7e406bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 --2- 172.21.15.50:0/3069935260 >> v2:172.21.15.181:3300/0 conn(0x7fa7e4161180 0x7fa7e406bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40706e0 con 0x7fa7e40ad310 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fa7dc0019f0 con 0x7fa7e40ad310 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 >> v1:172.21.15.50:6789/0 conn(0x7fa7e40ad310 legacy=0x7fa7e40abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7c4003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7c4004870 0x7fa7c4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 0x7fa7c4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4070120 con 0x7fa7c4003a90 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4070400 con 0x7fa7c4004870 2024-09-13T15:09:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c400ba30 con 0x7fa7e40ae200 2024-09-13T15:09:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7c4003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7d9e00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7c4004870 0x7fa7c4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e3200700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 0x7fa7c4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 -- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 msgr2=0x7fa7c4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e40ae200 0x7fa7c4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 -- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7c4004870 msgr2=0x7fa7c4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7c4004870 0x7fa7c4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.031+0000 7fa7e2800700 1 -- 172.21.15.50:0/3069935260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c40035d0 con 0x7fa7c4003a90 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e2800700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7c4003eb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009ba0 tx=0x7fa7c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80ca28a0ad75a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400e6c0 con 0x7fa7c4003a90 2024-09-13T15:09:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d400e820 con 0x7fa7c4003a90 2024-09-13T15:09:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e1e00700 1 -- 172.21.15.50:0/3069935260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400eb90 con 0x7fa7c4003a90 2024-09-13T15:09:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e8a00700 1 -- 172.21.15.50:0/3069935260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 msgr2=0x7fa7c4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/3069935260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7c4003eb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009ba0 tx=0x7fa7c40058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e3200700 1 -- 172.21.15.50:0/3069935260 reap_dead start 2024-09-13T15:09:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e8a00700 1 -- 172.21.15.50:0/3069935260 shutdown_connections 2024-09-13T15:09:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e8a00700 1 -- 172.21.15.50:0/3069935260 >> 172.21.15.50:0/3069935260 conn(0x7fa7e40cecc0 msgr2=0x7fa7e40cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e8a00700 1 -- 172.21.15.50:0/3069935260 shutdown_connections 2024-09-13T15:09:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.035+0000 7fa7e8a00700 1 -- 172.21.15.50:0/3069935260 wait complete. 2024-09-13T15:09:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 Processor -- start 2024-09-13T15:09:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 -- start start 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7e41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e415c810 0x7fa7e415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e415a9a0 0x7fa7e415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4162860 con 0x7fa7c4003a90 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e415b360 con 0x7fa7e415a9a0 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e415d2b0 con 0x7fa7e415c810 2024-09-13T15:09:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7e41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7e41461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36100/0 (socket says 172.21.15.50:36100) 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.039+0000 7fa7e2800700 1 -- 172.21.15.50:0/661008406 learned_addr learned my addr 172.21.15.50:0/661008406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7d9e00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e415c810 0x7fa7e415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e3200700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e415a9a0 0x7fa7e415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e2800700 1 -- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e415c810 msgr2=0x7fa7e415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e2800700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e415c810 0x7fa7e415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e2800700 1 -- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e415a9a0 msgr2=0x7fa7e415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e2800700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e415a9a0 0x7fa7e415ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e2800700 1 -- 172.21.15.50:0/661008406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e415d590 con 0x7fa7c4003a90 2024-09-13T15:09:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e3200700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e415a9a0 0x7fa7e415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e2800700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7e41461f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40090b0 tx=0x7fa7d40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400e6c0 con 0x7fa7c4003a90 2024-09-13T15:09:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4013e90 con 0x7fa7c4003a90 2024-09-13T15:09:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4004270 con 0x7fa7c4003a90 2024-09-13T15:09:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e415d870 con 0x7fa7c4003a90 2024-09-13T15:09:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e4146730 con 0x7fa7c4003a90 2024-09-13T15:09:18.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.043+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e40677c0 con 0x7fa7c4003a90 2024-09-13T15:09:18.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.047+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7d40043d0 con 0x7fa7c4003a90 2024-09-13T15:09:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.047+0000 7fa7db400700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa7c0066760 0x7fa7c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.047+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa7d4085c50 con 0x7fa7c4003a90 2024-09-13T15:09:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.047+0000 7fa7d9e00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa7c0066760 0x7fa7c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.047+0000 7fa7d9e00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa7c0066760 0x7fa7c0068c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7e406d2e0 tx=0x7fa7cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.051+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7d4052f90 con 0x7fa7c4003a90 2024-09-13T15:09:18.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.247+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7e406bd00 con 0x7fa7c4003a90 2024-09-13T15:09:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7db400700 1 -- 172.21.15.50:0/661008406 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fa7d40565b0 con 0x7fa7c4003a90 2024-09-13T15:09:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:18.255 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:09.084298+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa7c0066760 msgr2=0x7fa7c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa7c0066760 0x7fa7c0068c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7e406d2e0 tx=0x7fa7cc008040 comp rx=0 tx=0).stop 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 msgr2=0x7fa7e41461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7e41461f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40090b0 tx=0x7fa7d40047e0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 shutdown_connections 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa7c0066760 0x7fa7c0068c20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e415a9a0 0x7fa7e415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7e415c810 0x7fa7e415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 --2- 172.21.15.50:0/661008406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7c4003a90 0x7fa7e41461f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 >> 172.21.15.50:0/661008406 conn(0x7fa7e40cecc0 msgr2=0x7fa7e40ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.251+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 shutdown_connections 2024-09-13T15:09:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.255+0000 7fa7e8a00700 1 -- 172.21.15.50:0/661008406 wait complete. 2024-09-13T15:09:18.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:06.006484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:07.097072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:18.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 Processor -- start 2024-09-13T15:09:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 -- start start 2024-09-13T15:09:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f798406c960 0x7f7984161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406cd40 0x7f79840b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7984162340 con 0x7f79840b1980 2024-09-13T15:09:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840b2280 con 0x7f798406c960 2024-09-13T15:09:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7983200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b2560 con 0x7f798406cd40 2024-09-13T15:09:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7981e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f798406c960 0x7f7984161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7982800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f79840b1980 0x7f7984162560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60884/0 (socket says 172.21.15.50:60884) 2024-09-13T15:09:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7981e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f798406c960 0x7f7984161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36116/0 (socket says 172.21.15.50:36116) 2024-09-13T15:09:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7982800700 1 -- 172.21.15.50:0/3446878918 learned_addr learned my addr 172.21.15.50:0/3446878918 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7979400700 1 --2- 172.21.15.50:0/3446878918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406cd40 0x7f79840b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7981e00700 1 -- 172.21.15.50:0/3446878918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406cd40 msgr2=0x7f79840b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7981e00700 1 --2- 172.21.15.50:0/3446878918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406cd40 0x7f79840b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7981e00700 1 -- 172.21.15.50:0/3446878918 >> v1:172.21.15.50:6789/0 conn(0x7f79840b1980 legacy=0x7f7984162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.455+0000 7f7981e00700 1 -- 172.21.15.50:0/3446878918 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840b2840 con 0x7f798406c960 2024-09-13T15:09:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7981e00700 1 --2- 172.21.15.50:0/3446878918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f798406c960 0x7f7984161e00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f7974009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae99834306bfba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7981400700 1 -- 172.21.15.50:0/3446878918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011830 con 0x7f798406c960 2024-09-13T15:09:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7981400700 1 -- 172.21.15.50:0/3446878918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974011990 con 0x7f798406c960 2024-09-13T15:09:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7981400700 1 -- 172.21.15.50:0/3446878918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011d20 con 0x7f798406c960 2024-09-13T15:09:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 -- 172.21.15.50:0/3446878918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f798406c960 msgr2=0x7f7984161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 --2- 172.21.15.50:0/3446878918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f798406c960 0x7f7984161e00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f7974009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 -- 172.21.15.50:0/3446878918 shutdown_connections 2024-09-13T15:09:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 --2- 172.21.15.50:0/3446878918 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406cd40 0x7f79840b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 --2- 172.21.15.50:0/3446878918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f798406c960 0x7f7984161e00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 -- 172.21.15.50:0/3446878918 >> 172.21.15.50:0/3446878918 conn(0x7f798406a390 msgr2=0x7f798406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 -- 172.21.15.50:0/3446878918 shutdown_connections 2024-09-13T15:09:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.459+0000 7f7983200700 1 -- 172.21.15.50:0/3446878918 wait complete. 2024-09-13T15:09:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 Processor -- start 2024-09-13T15:09:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 -- start start 2024-09-13T15:09:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406c960 0x7f79841485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f798406cd40 0x7f7984149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 0x7f79840af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7984148b10 con 0x7f79840b1980 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7984149950 con 0x7f798406cd40 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7983200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7984148310 con 0x7f798406c960 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 0x7f79840af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 0x7f79840af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36130/0 (socket says 172.21.15.50:36130) 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 -- 172.21.15.50:0/3382220316 learned_addr learned my addr 172.21.15.50:0/3382220316 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7981e00700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406c960 0x7f79841485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7979400700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f798406cd40 0x7f7984149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 -- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406c960 msgr2=0x7f79841485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406c960 0x7f79841485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 -- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f798406cd40 msgr2=0x7f7984149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f798406cd40 0x7f7984149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.463+0000 7f7982800700 1 -- 172.21.15.50:0/3382220316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740094b0 con 0x7f79840b1980 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f7982800700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 0x7f79840af6c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f797c00ca80 tx=0x7f797c00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c007480 con 0x7f79840b1980 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0075e0 con 0x7f79840b1980 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7984148d40 con 0x7f79840b1980 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c007950 con 0x7f79840b1980 2024-09-13T15:09:18.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7984149300 con 0x7f79840b1980 2024-09-13T15:09:18.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.467+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79840b1dd0 con 0x7f79840b1980 2024-09-13T15:09:18.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.471+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f797c01b3b0 con 0x7f79840b1980 2024-09-13T15:09:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.471+0000 7f797aa00700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7960066730 0x7f7960068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.471+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f797c083ae0 con 0x7f79840b1980 2024-09-13T15:09:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.471+0000 7f7981e00700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7960066730 0x7f7960068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.471+0000 7f7981e00700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7960066730 0x7f7960068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7974014040 tx=0x7f7974008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.479+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f797c050cb0 con 0x7f79840b1980 2024-09-13T15:09:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.663+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7984149a90 con 0x7f79840b1980 2024-09-13T15:09:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.663+0000 7f797aa00700 1 -- 172.21.15.50:0/3382220316 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f797c017020 con 0x7f79840b1980 2024-09-13T15:09:18.669 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7960066730 msgr2=0x7f7960068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7960066730 0x7f7960068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7974014040 tx=0x7f7974008030 comp rx=0 tx=0).stop 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 msgr2=0x7f79840af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 0x7f79840af6c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f797c00ca80 tx=0x7f797c00cab0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 shutdown_connections 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7960066730 0x7f7960068bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79840b1980 0x7f79840af6c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f798406cd40 0x7f7984149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 --2- 172.21.15.50:0/3382220316 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f798406c960 0x7f79841485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 >> 172.21.15.50:0/3382220316 conn(0x7f798406a390 msgr2=0x7f79840cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 shutdown_connections 2024-09-13T15:09:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.671+0000 7f7983200700 1 -- 172.21.15.50:0/3382220316 wait complete. 2024-09-13T15:09:18.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:09:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 Processor -- start 2024-09-13T15:09:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 -- start start 2024-09-13T15:09:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 0x7f879c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f879c06c980 0x7f879c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0b4680 con 0x7f879c0b2540 2024-09-13T15:09:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0b4960 con 0x7f879c06c980 2024-09-13T15:09:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a2600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0cf030 con 0x7f879c06c5a0 2024-09-13T15:09:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 0x7f879c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f879be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f879c06c980 0x7f879c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 0x7f879c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:39628/0 (socket says 172.21.15.50:39628) 2024-09-13T15:09:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 -- 172.21.15.50:0/1163033688 learned_addr learned my addr 172.21.15.50:0/1163033688 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 -- 172.21.15.50:0/1163033688 >> v2:172.21.15.50:3300/0 conn(0x7f879c06c980 msgr2=0x7f879c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 --2- 172.21.15.50:0/1163033688 >> v2:172.21.15.50:3300/0 conn(0x7f879c06c980 0x7f879c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 -- 172.21.15.50:0/1163033688 >> v1:172.21.15.181:6789/0 conn(0x7f879c0b2540 legacy=0x7f879c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.871+0000 7f87a1200700 1 -- 172.21.15.50:0/1163033688 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0cf310 con 0x7f879c06c5a0 2024-09-13T15:09:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a1200700 1 --2- 172.21.15.50:0/1163033688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 0x7f879c15aa90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8790009910 tx=0x7f8790009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=332b237d5da23290 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f879b400700 1 -- 172.21.15.50:0/1163033688 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011830 con 0x7f879c06c5a0 2024-09-13T15:09:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f879b400700 1 -- 172.21.15.50:0/1163033688 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790011990 con 0x7f879c06c5a0 2024-09-13T15:09:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f879b400700 1 -- 172.21.15.50:0/1163033688 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011d40 con 0x7f879c06c5a0 2024-09-13T15:09:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 -- 172.21.15.50:0/1163033688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 msgr2=0x7f879c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 --2- 172.21.15.50:0/1163033688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 0x7f879c15aa90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8790009910 tx=0x7f8790009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 -- 172.21.15.50:0/1163033688 shutdown_connections 2024-09-13T15:09:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 --2- 172.21.15.50:0/1163033688 >> v2:172.21.15.50:3300/0 conn(0x7f879c06c980 0x7f879c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 --2- 172.21.15.50:0/1163033688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c06c5a0 0x7f879c15aa90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 -- 172.21.15.50:0/1163033688 >> 172.21.15.50:0/1163033688 conn(0x7f879c071d20 msgr2=0x7f879c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 -- 172.21.15.50:0/1163033688 shutdown_connections 2024-09-13T15:09:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.875+0000 7f87a2600700 1 -- 172.21.15.50:0/1163033688 wait complete. 2024-09-13T15:09:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 Processor -- start 2024-09-13T15:09:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 -- start start 2024-09-13T15:09:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879c06c5a0 0x7f879c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 0x7f879c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c0b2540 0x7f879c13b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c15b880 con 0x7f879c06c980 2024-09-13T15:09:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c15bb60 con 0x7f879c06c5a0 2024-09-13T15:09:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a2600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c15be40 con 0x7f879c0b2540 2024-09-13T15:09:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 0x7f879c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a1200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879c06c5a0 0x7f879c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 0x7f879c15b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36148/0 (socket says 172.21.15.50:36148) 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 -- 172.21.15.50:0/2600254631 learned_addr learned my addr 172.21.15.50:0/2600254631 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f87a1c00700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c0b2540 0x7f879c13b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 -- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c0b2540 msgr2=0x7f879c13b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c0b2540 0x7f879c13b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 -- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879c06c5a0 msgr2=0x7f879c14c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.879+0000 7f879be00700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879c06c5a0 0x7f879c14c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f879be00700 1 -- 172.21.15.50:0/2600254631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790009570 con 0x7f879c06c980 2024-09-13T15:09:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f879be00700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 0x7f879c15b030 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f878800e9a0 tx=0x7f878800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788009720 con 0x7f879c06c980 2024-09-13T15:09:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800c690 con 0x7f879c06c980 2024-09-13T15:09:18.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c15c120 con 0x7f879c06c980 2024-09-13T15:09:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800ca20 con 0x7f879c06c980 2024-09-13T15:09:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c15b570 con 0x7f879c06c980 2024-09-13T15:09:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.883+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c06cda0 con 0x7f879c06c980 2024-09-13T15:09:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.887+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f878800cb80 con 0x7f879c06c980 2024-09-13T15:09:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.887+0000 7f8798c00700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f877c066780 0x7f877c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.887+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8788084240 con 0x7f879c06c980 2024-09-13T15:09:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.887+0000 7f87a1200700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f877c066780 0x7f877c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.891+0000 7f87a1200700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f877c066780 0x7f877c068c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8790000c00 tx=0x7f8790008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:18.895+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87880514e0 con 0x7f879c06c980 2024-09-13T15:09:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.083+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f879c06b960 con 0x7f879c06c980 2024-09-13T15:09:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.083+0000 7f8798c00700 1 -- 172.21.15.50:0/2600254631 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8788054b00 con 0x7f879c06c980 2024-09-13T15:09:19.089 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f877c066780 msgr2=0x7f877c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f877c066780 0x7f877c068c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8790000c00 tx=0x7f8790008030 comp rx=0 tx=0).stop 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 msgr2=0x7f879c15b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 0x7f879c15b030 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f878800e9a0 tx=0x7f878800ecb0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 shutdown_connections 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f877c066780 0x7f877c068c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f879c0b2540 0x7f879c13b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f879c06c980 0x7f879c15b030 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 --2- 172.21.15.50:0/2600254631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879c06c5a0 0x7f879c14c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 >> 172.21.15.50:0/2600254631 conn(0x7f879c071d20 msgr2=0x7f879c0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 shutdown_connections 2024-09-13T15:09:19.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.087+0000 7f87a2600700 1 -- 172.21.15.50:0/2600254631 wait complete. 2024-09-13T15:09:19.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:09:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.283+0000 7fa9a7200700 1 Processor -- start 2024-09-13T15:09:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.283+0000 7fa9a7200700 1 -- start start 2024-09-13T15:09:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a7200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a8159920 0x7fa9a80b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a80b30d0 0x7fa9a806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a7200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a80ce740 con 0x7fa9a806cea0 2024-09-13T15:09:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a7200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a80cd2a0 con 0x7fa9a8159920 2024-09-13T15:09:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a806d2d0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a8159920 0x7fa9a80b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a8159920 0x7fa9a80b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36158/0 (socket says 172.21.15.50:36158) 2024-09-13T15:09:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 -- 172.21.15.50:0/2416637635 learned_addr learned my addr 172.21.15.50:0/2416637635 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5400700 1 --2- 172.21.15.50:0/2416637635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a80b30d0 0x7fa9a806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 -- 172.21.15.50:0/2416637635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a80b30d0 msgr2=0x7fa9a806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 --2- 172.21.15.50:0/2416637635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a80b30d0 0x7fa9a806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 -- 172.21.15.50:0/2416637635 >> v1:172.21.15.181:6789/0 conn(0x7fa9a806cea0 legacy=0x7fa9a806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.287+0000 7fa9a5e00700 1 -- 172.21.15.50:0/2416637635 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a80ccc90 con 0x7fa9a8159920 2024-09-13T15:09:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a5e00700 1 --2- 172.21.15.50:0/2416637635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a8159920 0x7fa9a80b2b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa998009910 tx=0x7fa998009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d763b3a3c7c246d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a4a00700 1 -- 172.21.15.50:0/2416637635 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998004230 con 0x7fa9a8159920 2024-09-13T15:09:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a4a00700 1 -- 172.21.15.50:0/2416637635 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa998004390 con 0x7fa9a8159920 2024-09-13T15:09:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a4a00700 1 -- 172.21.15.50:0/2416637635 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998009e60 con 0x7fa9a8159920 2024-09-13T15:09:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 -- 172.21.15.50:0/2416637635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a8159920 msgr2=0x7fa9a80b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 --2- 172.21.15.50:0/2416637635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a8159920 0x7fa9a80b2b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa998009910 tx=0x7fa998009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 -- 172.21.15.50:0/2416637635 shutdown_connections 2024-09-13T15:09:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 --2- 172.21.15.50:0/2416637635 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a80b30d0 0x7fa9a806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 --2- 172.21.15.50:0/2416637635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a8159920 0x7fa9a80b2b90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 -- 172.21.15.50:0/2416637635 >> 172.21.15.50:0/2416637635 conn(0x7fa9a806a390 msgr2=0x7fa9a806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 -- 172.21.15.50:0/2416637635 shutdown_connections 2024-09-13T15:09:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.291+0000 7fa9a7200700 1 -- 172.21.15.50:0/2416637635 wait complete. 2024-09-13T15:09:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 Processor -- start 2024-09-13T15:09:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 -- start start 2024-09-13T15:09:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a806cea0 0x7fa9a81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 0x7fa9a80c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80c9380 0x7fa9a814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c9830 con 0x7fa9a80b30d0 2024-09-13T15:09:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8153220 con 0x7fa9a80c9380 2024-09-13T15:09:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8153500 con 0x7fa9a806cea0 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 0x7fa9a80c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a806cea0 0x7fa9a81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 0x7fa9a80c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36168/0 (socket says 172.21.15.50:36168) 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 -- 172.21.15.50:0/1687472704 learned_addr learned my addr 172.21.15.50:0/1687472704 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a6800700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80c9380 0x7fa9a814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 -- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a806cea0 msgr2=0x7fa9a81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a806cea0 0x7fa9a81529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 -- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80c9380 msgr2=0x7fa9a814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80c9380 0x7fa9a814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.295+0000 7fa9a5400700 1 -- 172.21.15.50:0/1687472704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998009570 con 0x7fa9a80b30d0 2024-09-13T15:09:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa9a5400700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 0x7fa9a80c8e40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa99400e7e0 tx=0x7fa99400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994013610 con 0x7fa9a80b30d0 2024-09-13T15:09:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994013790 con 0x7fa9a80b30d0 2024-09-13T15:09:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a81537e0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994013b40 con 0x7fa9a80b30d0 2024-09-13T15:09:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a8153da0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.299+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a8153fc0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.303+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa994013ca0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.303+0000 7fa99e000700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa988066730 0x7fa988068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.303+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa994083fc0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.303+0000 7fa9a5e00700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa988066730 0x7fa988068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.307+0000 7fa9a5e00700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa988066730 0x7fa988068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa998009910 tx=0x7fa998008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.311+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa994051150 con 0x7fa9a80b30d0 2024-09-13T15:09:19.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.491+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9a806d760 con 0x7fa9a80b30d0 2024-09-13T15:09:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.491+0000 7fa99e000700 1 -- 172.21.15.50:0/1687472704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9940170a0 con 0x7fa9a80b30d0 2024-09-13T15:09:19.498 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:09:19.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa988066730 msgr2=0x7fa988068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa988066730 0x7fa988068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa998009910 tx=0x7fa998008030 comp rx=0 tx=0).stop 2024-09-13T15:09:19.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 msgr2=0x7fa9a80c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 0x7fa9a80c8e40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa99400e7e0 tx=0x7fa99400eaf0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 shutdown_connections 2024-09-13T15:09:19.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa988066730 0x7fa988068bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80c9380 0x7fa9a814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a80b30d0 0x7fa9a80c8e40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 --2- 172.21.15.50:0/1687472704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9a806cea0 0x7fa9a81529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 >> 172.21.15.50:0/1687472704 conn(0x7fa9a806a390 msgr2=0x7fa9a80c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 shutdown_connections 2024-09-13T15:09:19.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.495+0000 7fa9a7200700 1 -- 172.21.15.50:0/1687472704 wait complete. 2024-09-13T15:09:19.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:09:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.691+0000 7f860a000700 1 Processor -- start 2024-09-13T15:09:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.691+0000 7f860a000700 1 -- start start 2024-09-13T15:09:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f860a000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f860415e070 0x7f86040cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f860a000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86040cd970 con 0x7f86040b2c50 2024-09-13T15:09:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f860a000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860415e450 con 0x7f86040d10f0 2024-09-13T15:09:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f860a000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86040d0050 con 0x7f860415e070 2024-09-13T15:09:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8609600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86040b2c50 0x7f86040b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60900/0 (socket says 172.21.15.50:60900) 2024-09-13T15:09:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8609600700 1 -- 172.21.15.50:0/3130430168 learned_addr learned my addr 172.21.15.50:0/3130430168 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8608c00700 1 --2- 172.21.15.50:0/3130430168 >> v2:172.21.15.181:3300/0 conn(0x7f860415e070 0x7f86040cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8603400700 1 -- 172.21.15.50:0/3130430168 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513056544 0 0) 0x7f85fc001490 con 0x7f86040b2c50 2024-09-13T15:09:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8603400700 1 -- 172.21.15.50:0/3130430168 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85ec0035d0 con 0x7f86040b2c50 2024-09-13T15:09:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8608c00700 1 -- 172.21.15.50:0/3130430168 >> v1:172.21.15.181:6789/0 conn(0x7f86040d10f0 legacy=0x7f86040b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8608c00700 1 -- 172.21.15.50:0/3130430168 >> v1:172.21.15.50:6789/0 conn(0x7f86040b2c50 legacy=0x7f86040b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8608c00700 1 -- 172.21.15.50:0/3130430168 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040d0330 con 0x7f860415e070 2024-09-13T15:09:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.695+0000 7f8608c00700 1 --2- 172.21.15.50:0/3130430168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f860415e070 0x7f86040cd430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009850 tx=0x7f85f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1525e125ff29de54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f8603400700 1 -- 172.21.15.50:0/3130430168 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8011830 con 0x7f860415e070 2024-09-13T15:09:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f8603400700 1 -- 172.21.15.50:0/3130430168 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f8011990 con 0x7f860415e070 2024-09-13T15:09:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f8603400700 1 -- 172.21.15.50:0/3130430168 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8011d40 con 0x7f860415e070 2024-09-13T15:09:19.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 -- 172.21.15.50:0/3130430168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f860415e070 msgr2=0x7f86040cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 --2- 172.21.15.50:0/3130430168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f860415e070 0x7f86040cd430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009850 tx=0x7f85f8009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 -- 172.21.15.50:0/3130430168 shutdown_connections 2024-09-13T15:09:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 --2- 172.21.15.50:0/3130430168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f860415e070 0x7f86040cd430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 -- 172.21.15.50:0/3130430168 >> 172.21.15.50:0/3130430168 conn(0x7f8604071f00 msgr2=0x7f86040722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 -- 172.21.15.50:0/3130430168 shutdown_connections 2024-09-13T15:09:19.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.699+0000 7f860a000700 1 -- 172.21.15.50:0/3130430168 wait complete. 2024-09-13T15:09:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 Processor -- start 2024-09-13T15:09:19.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 -- start start 2024-09-13T15:09:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86040b2c50 0x7f86041f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86040d10f0 0x7f860415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 0x7f86041595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041f63c0 con 0x7f860415e070 2024-09-13T15:09:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041f66a0 con 0x7f86040b2c50 2024-09-13T15:09:19.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f860a000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86041f6980 con 0x7f86040d10f0 2024-09-13T15:09:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 0x7f86041595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 0x7f86041595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36176/0 (socket says 172.21.15.50:36176) 2024-09-13T15:09:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 -- 172.21.15.50:0/2976420560 learned_addr learned my addr 172.21.15.50:0/2976420560 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8608c00700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86040b2c50 0x7f86041f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8603e00700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86040d10f0 0x7f860415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 -- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86040d10f0 msgr2=0x7f860415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86040d10f0 0x7f860415cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 -- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86040b2c50 msgr2=0x7f86041f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86040b2c50 0x7f86041f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8609600700 1 -- 172.21.15.50:0/2976420560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80094b0 con 0x7f860415e070 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.703+0000 7f8608c00700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86040b2c50 0x7f86041f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:19.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f8609600700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 0x7f86041595f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00cae0 tx=0x7f85fc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc007480 con 0x7f860415e070 2024-09-13T15:09:19.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc0075e0 con 0x7f860415e070 2024-09-13T15:09:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604158df0 con 0x7f860415e070 2024-09-13T15:09:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc007970 con 0x7f860415e070 2024-09-13T15:09:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86041f6090 con 0x7f860415e070 2024-09-13T15:09:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8604159310 con 0x7f860415e070 2024-09-13T15:09:19.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.707+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85fc01b3b0 con 0x7f860415e070 2024-09-13T15:09:19.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.711+0000 7f8600c00700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f85e4066730 0x7f85e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:19.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.711+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f85fc083ad0 con 0x7f860415e070 2024-09-13T15:09:19.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.711+0000 7f8608c00700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f85e4066730 0x7f85e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:19.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.711+0000 7f8608c00700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f85e4066730 0x7f85e4068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85f80090b0 tx=0x7f85f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:19.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.719+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8604159310 con 0x7f860415e070 2024-09-13T15:09:19.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.919+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f86040cd970 con 0x7f860415e070 2024-09-13T15:09:19.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.919+0000 7f8600c00700 1 -- 172.21.15.50:0/2976420560 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f86040cd970 con 0x7f860415e070 2024-09-13T15:09:19.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f85e4066730 msgr2=0x7f85e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f85e4066730 0x7f85e4068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85f80090b0 tx=0x7f85f8008030 comp rx=0 tx=0).stop 2024-09-13T15:09:19.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 msgr2=0x7f86041595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:19.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 0x7f86041595f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00cae0 tx=0x7f85fc00cb10 comp rx=0 tx=0).stop 2024-09-13T15:09:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 shutdown_connections 2024-09-13T15:09:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f85e4066730 0x7f85e4068bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f860415e070 0x7f86041595f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f86040d10f0 0x7f860415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 --2- 172.21.15.50:0/2976420560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86040b2c50 0x7f86041f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:19.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 >> 172.21.15.50:0/2976420560 conn(0x7f8604071f00 msgr2=0x7f86040ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:19.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 shutdown_connections 2024-09-13T15:09:19.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:19.923+0000 7f860a000700 1 -- 172.21.15.50:0/2976420560 wait complete. 2024-09-13T15:09:19.930 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:09:19.950 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:09:19.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:19.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:19.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:09:19.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:19.997 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:09:20.062 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:20.062 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:20.077 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:20.077 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:20.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:20.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.323+0000 7fc1d2400700 1 Processor -- start 2024-09-13T15:09:20.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.323+0000 7fc1d2400700 1 -- start start 2024-09-13T15:09:20.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1d2400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc161060 0x7fc1cc06b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1d2400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc1cc165650 0x7fc1cc066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1d2400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0b3180 con 0x7fc1cc0665d0 2024-09-13T15:09:20.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1d2400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b29e0 con 0x7fc1cc165650 2024-09-13T15:09:20.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1d2400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc066a80 con 0x7fc1cc161060 2024-09-13T15:09:20.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1caa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc1cc165650 0x7fc1cc066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1cbe00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc1cc0665d0 0x7fc1cc06a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47568/0 (socket says 172.21.15.50:47568) 2024-09-13T15:09:20.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1cbe00700 1 -- 172.21.15.50:0/639391553 learned_addr learned my addr 172.21.15.50:0/639391553 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:20.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1cb400700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc161060 0x7fc1cc06b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1ca000700 1 -- 172.21.15.50:0/639391553 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573867784 0 0) 0x7fc1cc0b3180 con 0x7fc1cc0665d0 2024-09-13T15:09:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1ca000700 1 -- 172.21.15.50:0/639391553 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b00035d0 con 0x7fc1cc0665d0 2024-09-13T15:09:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1caa00700 1 -- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc161060 msgr2=0x7fc1cc06b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1caa00700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc161060 0x7fc1cc06b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1caa00700 1 -- 172.21.15.50:0/639391553 >> v1:172.21.15.181:6789/0 conn(0x7fc1cc0665d0 legacy=0x7fc1cc06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1caa00700 1 -- 172.21.15.50:0/639391553 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0b2bc0 con 0x7fc1cc165650 2024-09-13T15:09:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1cb400700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc161060 0x7fc1cc06b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.327+0000 7fc1caa00700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc165650 0x7fc1cc066090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009850 tx=0x7fc1b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d015ad5d3f6d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1ca000700 1 -- 172.21.15.50:0/639391553 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011830 con 0x7fc1cc165650 2024-09-13T15:09:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1ca000700 1 -- 172.21.15.50:0/639391553 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8011990 con 0x7fc1cc165650 2024-09-13T15:09:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1ca000700 1 -- 172.21.15.50:0/639391553 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011d40 con 0x7fc1cc165650 2024-09-13T15:09:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 -- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc165650 msgr2=0x7fc1cc066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc165650 0x7fc1cc066090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009850 tx=0x7fc1b8009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 -- 172.21.15.50:0/639391553 shutdown_connections 2024-09-13T15:09:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc165650 0x7fc1cc066090 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 --2- 172.21.15.50:0/639391553 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc161060 0x7fc1cc06b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 -- 172.21.15.50:0/639391553 >> 172.21.15.50:0/639391553 conn(0x7fc1cc0b1e00 msgr2=0x7fc1cc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 -- 172.21.15.50:0/639391553 shutdown_connections 2024-09-13T15:09:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.331+0000 7fc1d2400700 1 -- 172.21.15.50:0/639391553 wait complete. 2024-09-13T15:09:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 Processor -- start 2024-09-13T15:09:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 -- start start 2024-09-13T15:09:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 0x7fc1cc1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc161060 0x7fc1cc1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc165650 0x7fc1cc158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc070d10 con 0x7fc1cc0665d0 2024-09-13T15:09:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc159510 con 0x7fc1cc161060 2024-09-13T15:09:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1d2400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc162ba0 con 0x7fc1cc165650 2024-09-13T15:09:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1cb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 0x7fc1cc1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1cb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 0x7fc1cc1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36178/0 (socket says 172.21.15.50:36178) 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1cb400700 1 -- 172.21.15.50:0/3989477572 learned_addr learned my addr 172.21.15.50:0/3989477572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1caa00700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc161060 0x7fc1cc1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.335+0000 7fc1cbe00700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc165650 0x7fc1cc158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1cb400700 1 -- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc165650 msgr2=0x7fc1cc158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1cb400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc165650 0x7fc1cc158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1cb400700 1 -- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc161060 msgr2=0x7fc1cc1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1cb400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc161060 0x7fc1cc1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1cb400700 1 -- 172.21.15.50:0/3989477572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc0094b0 con 0x7fc1cc0665d0 2024-09-13T15:09:20.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1cb400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 0x7fc1cc1545d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00ebe0 tx=0x7fc1bc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:20.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00c850 con 0x7fc1cc0665d0 2024-09-13T15:09:20.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00c9b0 con 0x7fc1cc0665d0 2024-09-13T15:09:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00cd40 con 0x7fc1cc0665d0 2024-09-13T15:09:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80094b0 con 0x7fc1cc0665d0 2024-09-13T15:09:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc163160 con 0x7fc1cc0665d0 2024-09-13T15:09:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.339+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc067730 con 0x7fc1cc0665d0 2024-09-13T15:09:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.343+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1bc013470 con 0x7fc1cc0665d0 2024-09-13T15:09:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.343+0000 7fc1c3400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc1ac066730 0x7fc1ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.343+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1bc0844f0 con 0x7fc1cc0665d0 2024-09-13T15:09:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.343+0000 7fc1caa00700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc1ac066730 0x7fc1ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.347+0000 7fc1caa00700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc1ac066730 0x7fc1ac068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009850 tx=0x7fc1b801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.351+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1bc051570 con 0x7fc1cc0665d0 2024-09-13T15:09:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.539+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1cc15d290 con 0x7fc1cc0665d0 2024-09-13T15:09:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.543+0000 7fc1c3400700 1 -- 172.21.15.50:0/3989477572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fc1bc00cea0 con 0x7fc1cc0665d0 2024-09-13T15:09:20.549 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:09.084298+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc1ac066730 msgr2=0x7fc1ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc1ac066730 0x7fc1ac068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009850 tx=0x7fc1b801c040 comp rx=0 tx=0).stop 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 msgr2=0x7fc1cc1545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 0x7fc1cc1545d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00ebe0 tx=0x7fc1bc00eef0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 shutdown_connections 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc1ac066730 0x7fc1ac068bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1cc165650 0x7fc1cc158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1cc161060 0x7fc1cc1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 --2- 172.21.15.50:0/3989477572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1cc0665d0 0x7fc1cc1545d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 >> 172.21.15.50:0/3989477572 conn(0x7fc1cc0b1e00 msgr2=0x7fc1cc0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 shutdown_connections 2024-09-13T15:09:20.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.547+0000 7fc1d2400700 1 -- 172.21.15.50:0/3989477572 wait complete. 2024-09-13T15:09:20.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:06.006484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:07.097072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:20.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdac0a00700 1 Processor -- start 2024-09-13T15:09:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdac0a00700 1 -- start start 2024-09-13T15:09:20.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdac0a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdabc15ca20 0x7fdabc15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdac0a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc160680 con 0x7fdabc06cd80 2024-09-13T15:09:20.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdac0a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc15d670 con 0x7fdabc06ada0 2024-09-13T15:09:20.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdac0a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0b4a20 con 0x7fdabc15ca20 2024-09-13T15:09:20.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdab9e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdabc06cd80 0x7fdabc0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60904/0 (socket says 172.21.15.50:60904) 2024-09-13T15:09:20.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.751+0000 7fdab9e00700 1 -- 172.21.15.50:0/1396802917 learned_addr learned my addr 172.21.15.50:0/1396802917 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:20.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdaba800700 1 --2- 172.21.15.50:0/1396802917 >> v2:172.21.15.181:3300/0 conn(0x7fdabc15ca20 0x7fdabc15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646681043 0 0) 0x7fdabc160680 con 0x7fdabc06cd80 2024-09-13T15:09:20.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa00035d0 con 0x7fdabc06cd80 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1013870124 0 0) 0x7fdaa00035d0 con 0x7fdabc06cd80 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 >> v2:172.21.15.181:3300/0 conn(0x7fdabc15ca20 msgr2=0x7fdabc15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 --2- 172.21.15.50:0/1396802917 >> v2:172.21.15.181:3300/0 conn(0x7fdabc15ca20 0x7fdabc15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 >> v1:172.21.15.181:6789/0 conn(0x7fdabc06ada0 legacy=0x7fdabc160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc15d950 con 0x7fdabc06cd80 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fdaa8001670 con 0x7fdabc06cd80 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 >> v1:172.21.15.50:6789/0 conn(0x7fdabc06cd80 legacy=0x7fdabc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0003a20 0x7fdaa0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaa0004870 0x7fdaa0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaa0005230 0x7fdaa000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0b4a20 con 0x7fdaa0004870 2024-09-13T15:09:20.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa000c0d0 con 0x7fdaa0003a20 2024-09-13T15:09:20.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa000c290 con 0x7fdaa0005230 2024-09-13T15:09:20.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaa0004870 0x7fdaa0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdaba800700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0003a20 0x7fdaa0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 -- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaa0005230 msgr2=0x7fdaa000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdabb200700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaa0005230 0x7fdaa000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaa0005230 0x7fdaa000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 -- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0003a20 msgr2=0x7fdaa0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0003a20 0x7fdaa0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 -- 172.21.15.50:0/1396802917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa00035d0 con 0x7fdaa0004870 2024-09-13T15:09:20.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdabb200700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaa0005230 0x7fdaa000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdabb200700 1 -- 172.21.15.50:0/1396802917 reap_dead start 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9e00700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaa0004870 0x7fdaa0004cf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c320 tx=0x7fdaa00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a992e2282e3292b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8007c30 con 0x7fdaa0004870 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800ce80 con 0x7fdaa0004870 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdab9400700 1 -- 172.21.15.50:0/1396802917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8005bc0 con 0x7fdaa0004870 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdac0a00700 1 -- 172.21.15.50:0/1396802917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaa0004870 msgr2=0x7fdaa0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.755+0000 7fdac0a00700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaa0004870 0x7fdaa0004cf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c320 tx=0x7fdaa00058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 -- 172.21.15.50:0/1396802917 shutdown_connections 2024-09-13T15:09:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 --2- 172.21.15.50:0/1396802917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaa0004870 0x7fdaa0004cf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 -- 172.21.15.50:0/1396802917 >> 172.21.15.50:0/1396802917 conn(0x7fdabc071d20 msgr2=0x7fdabc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 -- 172.21.15.50:0/1396802917 shutdown_connections 2024-09-13T15:09:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 -- 172.21.15.50:0/1396802917 wait complete. 2024-09-13T15:09:20.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 Processor -- start 2024-09-13T15:09:20.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.759+0000 7fdac0a00700 1 -- start start 2024-09-13T15:09:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0004870 0x7fdabc15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdabc15a0d0 0x7fdabc1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 0x7fdabc154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1548a0 con 0x7fdabc153ee0 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0cd400 con 0x7fdaa0004870 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc15b560 con 0x7fdabc15a0d0 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 0x7fdabc154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 0x7fdabc154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36184/0 (socket says 172.21.15.50:36184) 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 -- 172.21.15.50:0/3090035459 learned_addr learned my addr 172.21.15.50:0/3090035459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdab9e00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdabc15a0d0 0x7fdabc1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdaba800700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0004870 0x7fdabc15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 -- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdabc15a0d0 msgr2=0x7fdabc1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdabc15a0d0 0x7fdabc1514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 -- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0004870 msgr2=0x7fdabc15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0004870 0x7fdabc15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 -- 172.21.15.50:0/3090035459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0cd6a0 con 0x7fdabc153ee0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdabb200700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 0x7fdabc154360 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdabc06f9a0 tx=0x7fdab400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400dee0 con 0x7fdabc153ee0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4003e50 con 0x7fdabc153ee0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40052b0 con 0x7fdabc153ee0 2024-09-13T15:09:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc0cd980 con 0x7fdabc153ee0 2024-09-13T15:09:20.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.763+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc15b840 con 0x7fdabc153ee0 2024-09-13T15:09:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.767+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc06b1d0 con 0x7fdabc153ee0 2024-09-13T15:09:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.767+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdab4005410 con 0x7fdabc153ee0 2024-09-13T15:09:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.767+0000 7fdab2a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda9c066730 0x7fda9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.767+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdab4083d20 con 0x7fdabc153ee0 2024-09-13T15:09:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.771+0000 7fdaba800700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda9c066730 0x7fda9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:20.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.771+0000 7fdaba800700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda9c066730 0x7fda9c068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009cf0 tx=0x7fdaac009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.775+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdab4050f50 con 0x7fdabc153ee0 2024-09-13T15:09:20.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.959+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdabc06ab80 con 0x7fdabc153ee0 2024-09-13T15:09:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.959+0000 7fdab2a00700 1 -- 172.21.15.50:0/3090035459 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdab4018070 con 0x7fdabc153ee0 2024-09-13T15:09:20.966 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda9c066730 msgr2=0x7fda9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda9c066730 0x7fda9c068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009cf0 tx=0x7fdaac009240 comp rx=0 tx=0).stop 2024-09-13T15:09:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 msgr2=0x7fdabc154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 0x7fdabc154360 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdabc06f9a0 tx=0x7fdab400ddc0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 shutdown_connections 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fda9c066730 0x7fda9c068bf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdabc153ee0 0x7fdabc154360 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdabc15a0d0 0x7fdabc1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 --2- 172.21.15.50:0/3090035459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaa0004870 0x7fdabc15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 >> 172.21.15.50:0/3090035459 conn(0x7fdabc071d20 msgr2=0x7fdabc15f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 shutdown_connections 2024-09-13T15:09:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:20.967+0000 7fdac0a00700 1 -- 172.21.15.50:0/3090035459 wait complete. 2024-09-13T15:09:20.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:09:21.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.155+0000 7f41dae00700 1 Processor -- start 2024-09-13T15:09:21.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.155+0000 7f41dae00700 1 -- start start 2024-09-13T15:09:21.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.155+0000 7f41dae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.155+0000 7f41dae00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d40b2280 con 0x7f41d4161e00 2024-09-13T15:09:21.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.155+0000 7f41dae00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d40b2560 con 0x7f41d406c960 2024-09-13T15:09:21.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.155+0000 7f41dae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b2840 con 0x7f41d40b1980 2024-09-13T15:09:21.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d9000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41d4161e00 0x7f41d40b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60918/0 (socket says 172.21.15.50:60918) 2024-09-13T15:09:21.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d9000700 1 -- 172.21.15.50:0/1158583016 learned_addr learned my addr 172.21.15.50:0/1158583016 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:21.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41da400700 1 --2- 172.21.15.50:0/1158583016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777531472 0 0) 0x7f41d40b2280 con 0x7f41d4161e00 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41bc0035d0 con 0x7f41d4161e00 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997498512 0 0) 0x7f41d40b2560 con 0x7f41d406c960 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d40b2280 con 0x7f41d406c960 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3160252266 0 0) 0x7f41bc0035d0 con 0x7f41d4161e00 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41da400700 1 -- 172.21.15.50:0/1158583016 >> v1:172.21.15.181:6789/0 conn(0x7f41d406c960 legacy=0x7f41d406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41da400700 1 -- 172.21.15.50:0/1158583016 >> v1:172.21.15.50:6789/0 conn(0x7f41d4161e00 legacy=0x7f41d40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41da400700 1 -- 172.21.15.50:0/1158583016 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40b2b20 con 0x7f41d40b1980 2024-09-13T15:09:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41da400700 1 --2- 172.21.15.50:0/1158583016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4162560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009880 tx=0x7f41cc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=898e818b2f7debd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:21.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0001670 con 0x7f41d40b1980 2024-09-13T15:09:21.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc004030 con 0x7f41d40b1980 2024-09-13T15:09:21.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.159+0000 7f41d3e00700 1 -- 172.21.15.50:0/1158583016 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0043c0 con 0x7f41d40b1980 2024-09-13T15:09:21.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 -- 172.21.15.50:0/1158583016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 msgr2=0x7f41d4162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 --2- 172.21.15.50:0/1158583016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4162560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009880 tx=0x7f41cc009b90 comp rx=0 tx=0).stop 2024-09-13T15:09:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 -- 172.21.15.50:0/1158583016 shutdown_connections 2024-09-13T15:09:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 --2- 172.21.15.50:0/1158583016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4162560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 -- 172.21.15.50:0/1158583016 >> 172.21.15.50:0/1158583016 conn(0x7f41d406a390 msgr2=0x7f41d406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 -- 172.21.15.50:0/1158583016 shutdown_connections 2024-09-13T15:09:21.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 -- 172.21.15.50:0/1158583016 wait complete. 2024-09-13T15:09:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 Processor -- start 2024-09-13T15:09:21.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.163+0000 7f41dae00700 1 -- start start 2024-09-13T15:09:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41d406c960 0x7f41d41415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 0x7f41d4143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4141af0 con 0x7f41d4161e00 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4154890 con 0x7f41d406c960 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4153a50 con 0x7f41d40b1980 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 0x7f41d4143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 0x7f41d4143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36190/0 (socket says 172.21.15.50:36190) 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 -- 172.21.15.50:0/3399816002 learned_addr learned my addr 172.21.15.50:0/3399816002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41d9000700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41d9a00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41d406c960 0x7f41d41415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 -- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 msgr2=0x7f41d4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 -- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41d406c960 msgr2=0x7f41d41415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41d406c960 0x7f41d41415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 -- 172.21.15.50:0/3399816002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0094b0 con 0x7f41d4161e00 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41da400700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 0x7f41d4143dd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0090b0 tx=0x7f41cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc003c50 con 0x7f41d4161e00 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc003db0 con 0x7f41d4161e00 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc011850 con 0x7f41d4161e00 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d4153c80 con 0x7f41d4161e00 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d4154240 con 0x7f41d4161e00 2024-09-13T15:09:21.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.167+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d4151530 con 0x7f41d4161e00 2024-09-13T15:09:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.171+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41cc018050 con 0x7f41d4161e00 2024-09-13T15:09:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.171+0000 7f41d1600700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b4066730 0x7f41b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.171+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f41cc084dc0 con 0x7f41d4161e00 2024-09-13T15:09:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.171+0000 7f41d9a00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b4066730 0x7f41b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.175+0000 7f41d9a00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b4066730 0x7f41b4068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41c8001560 tx=0x7f41c8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:21.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.179+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41d4151530 con 0x7f41d4161e00 2024-09-13T15:09:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.367+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41d4151530 con 0x7f41d4161e00 2024-09-13T15:09:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.367+0000 7f41d1600700 1 -- 172.21.15.50:0/3399816002 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41cc016020 con 0x7f41d4161e00 2024-09-13T15:09:21.372 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b4066730 msgr2=0x7f41b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b4066730 0x7f41b4068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41c8001560 tx=0x7f41c8009040 comp rx=0 tx=0).stop 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 msgr2=0x7f41d4143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 0x7f41d4143dd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0090b0 tx=0x7f41cc004770 comp rx=0 tx=0).stop 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 shutdown_connections 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b4066730 0x7f41b4068bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d4161e00 0x7f41d4143dd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41d40b1980 0x7f41d4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 --2- 172.21.15.50:0/3399816002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41d406c960 0x7f41d41415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 >> 172.21.15.50:0/3399816002 conn(0x7f41d406a390 msgr2=0x7f41d406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:21.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 shutdown_connections 2024-09-13T15:09:21.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.371+0000 7f41dae00700 1 -- 172.21.15.50:0/3399816002 wait complete. 2024-09-13T15:09:21.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:09:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.567+0000 7f2c75400700 1 Processor -- start 2024-09-13T15:09:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.567+0000 7f2c75400700 1 -- start start 2024-09-13T15:09:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c75400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2c70072000 0x7f2c7006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c75400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7015a240 con 0x7f2c700cb220 2024-09-13T15:09:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c75400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7015a6d0 con 0x7f2c7006dd90 2024-09-13T15:09:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c75400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7015dce0 con 0x7f2c70072000 2024-09-13T15:09:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c74a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2c700cb220 0x7f2c7006c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60924/0 (socket says 172.21.15.50:60924) 2024-09-13T15:09:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c74a00700 1 -- 172.21.15.50:0/1064173230 learned_addr learned my addr 172.21.15.50:0/1064173230 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6f400700 1 --2- 172.21.15.50:0/1064173230 >> v2:172.21.15.181:3300/0 conn(0x7f2c70072000 0x7f2c7006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6ea00700 1 -- 172.21.15.50:0/1064173230 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376563779 0 0) 0x7f2c7015a240 con 0x7f2c700cb220 2024-09-13T15:09:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6ea00700 1 -- 172.21.15.50:0/1064173230 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c540035d0 con 0x7f2c700cb220 2024-09-13T15:09:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6f400700 1 -- 172.21.15.50:0/1064173230 >> v1:172.21.15.181:6789/0 conn(0x7f2c7006dd90 legacy=0x7f2c700718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6f400700 1 -- 172.21.15.50:0/1064173230 >> v1:172.21.15.50:6789/0 conn(0x7f2c700cb220 legacy=0x7f2c7006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6f400700 1 -- 172.21.15.50:0/1064173230 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70159910 con 0x7f2c70072000 2024-09-13T15:09:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6f400700 1 --2- 172.21.15.50:0/1064173230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c7006c3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a9f0 tx=0x7f2c5c00ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a41db02aa1e72f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6ea00700 1 -- 172.21.15.50:0/1064173230 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00cb70 con 0x7f2c70072000 2024-09-13T15:09:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6ea00700 1 -- 172.21.15.50:0/1064173230 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00ae90 con 0x7f2c70072000 2024-09-13T15:09:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c6ea00700 1 -- 172.21.15.50:0/1064173230 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c018400 con 0x7f2c70072000 2024-09-13T15:09:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c75400700 1 -- 172.21.15.50:0/1064173230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 msgr2=0x7f2c7006c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.571+0000 7f2c75400700 1 --2- 172.21.15.50:0/1064173230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c7006c3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a9f0 tx=0x7f2c5c00ad00 comp rx=0 tx=0).stop 2024-09-13T15:09:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- 172.21.15.50:0/1064173230 shutdown_connections 2024-09-13T15:09:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 --2- 172.21.15.50:0/1064173230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c7006c3b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- 172.21.15.50:0/1064173230 >> 172.21.15.50:0/1064173230 conn(0x7f2c700b4770 msgr2=0x7f2c700b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:21.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- 172.21.15.50:0/1064173230 shutdown_connections 2024-09-13T15:09:21.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- 172.21.15.50:0/1064173230 wait complete. 2024-09-13T15:09:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 Processor -- start 2024-09-13T15:09:21.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- start start 2024-09-13T15:09:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 0x7f2c701f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c70099ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c700cb220 0x7f2c700cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c70099a00 con 0x7f2c700cb220 2024-09-13T15:09:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700cbbf0 con 0x7f2c70072000 2024-09-13T15:09:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.575+0000 7f2c75400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c70099440 con 0x7f2c7006dd90 2024-09-13T15:09:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 0x7f2c701f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c74a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c700cb220 0x7f2c700cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 0x7f2c701f78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:39736/0 (socket says 172.21.15.50:39736) 2024-09-13T15:09:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 -- 172.21.15.50:0/3226830437 learned_addr learned my addr 172.21.15.50:0/3226830437 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6f400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c70099ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 -- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 msgr2=0x7f2c70099ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c70099ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 -- 172.21.15.50:0/3226830437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c700cb220 msgr2=0x7f2c700cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c700cb220 0x7f2c700cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 -- 172.21.15.50:0/3226830437 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c00a650 con 0x7f2c7006dd90 2024-09-13T15:09:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c74a00700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c700cb220 0x7f2c700cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c6fe00700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 0x7f2c701f78a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c500 tx=0x7f2c6000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600052d0 con 0x7f2c7006dd90 2024-09-13T15:09:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60005430 con 0x7f2c7006dd90 2024-09-13T15:09:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600055a0 con 0x7f2c7006dd90 2024-09-13T15:09:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c70099720 con 0x7f2c7006dd90 2024-09-13T15:09:21.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.579+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7009a0e0 con 0x7f2c7006dd90 2024-09-13T15:09:21.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.583+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c700cba50 con 0x7f2c7006dd90 2024-09-13T15:09:21.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.583+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c600038e0 con 0x7f2c7006dd90 2024-09-13T15:09:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.587+0000 7f2c67e00700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c50066780 0x7f2c50068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.587+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c60083a30 con 0x7f2c7006dd90 2024-09-13T15:09:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.587+0000 7f2c6f400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c50066780 0x7f2c50068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.587+0000 7f2c6f400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c50066780 0x7f2c50068c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a1c0 tx=0x7f2c5c01b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.591+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c60050c20 con 0x7f2c7006dd90 2024-09-13T15:09:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.779+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c700cba50 con 0x7f2c7006dd90 2024-09-13T15:09:21.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.779+0000 7f2c67e00700 1 -- 172.21.15.50:0/3226830437 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c700cba50 con 0x7f2c7006dd90 2024-09-13T15:09:21.785 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:09:21.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c50066780 msgr2=0x7f2c50068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c50066780 0x7f2c50068c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a1c0 tx=0x7f2c5c01b040 comp rx=0 tx=0).stop 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 msgr2=0x7f2c701f78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 0x7f2c701f78a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c500 tx=0x7f2c6000c810 comp rx=0 tx=0).stop 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 shutdown_connections 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c50066780 0x7f2c50068c40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c700cb220 0x7f2c700cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c70072000 0x7f2c70099ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 --2- 172.21.15.50:0/3226830437 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c7006dd90 0x7f2c701f78a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:21.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 >> 172.21.15.50:0/3226830437 conn(0x7f2c700b4770 msgr2=0x7f2c701513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:21.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 shutdown_connections 2024-09-13T15:09:21.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.787+0000 7f2c75400700 1 -- 172.21.15.50:0/3226830437 wait complete. 2024-09-13T15:09:21.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:09:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.991+0000 7fa454a00700 1 Processor -- start 2024-09-13T15:09:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.991+0000 7fa454a00700 1 -- start start 2024-09-13T15:09:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.991+0000 7fa454a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa450159bd0 0x7fa4500cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa454a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa45006b1b0 0x7fa4501636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa454a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500707d0 con 0x7fa450071870 2024-09-13T15:09:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa454a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500720a0 con 0x7fa45006b1b0 2024-09-13T15:09:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa454a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45006fee0 con 0x7fa450159bd0 2024-09-13T15:09:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa450159bd0 0x7fa4500cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa45006b1b0 0x7fa4501636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44de00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa450071870 0x7fa45006aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47608/0 (socket says 172.21.15.50:47608) 2024-09-13T15:09:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44de00700 1 -- 172.21.15.50:0/1337918961 learned_addr learned my addr 172.21.15.50:0/1337918961 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa450159bd0 0x7fa4500cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:36458/0 (socket says 172.21.15.50:36458) 2024-09-13T15:09:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44d400700 1 -- 172.21.15.50:0/1337918961 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896308134 0 0) 0x7fa4500707d0 con 0x7fa450071870 2024-09-13T15:09:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44d400700 1 -- 172.21.15.50:0/1337918961 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4340035d0 con 0x7fa450071870 2024-09-13T15:09:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 -- 172.21.15.50:0/1337918961 >> v2:172.21.15.50:3300/0 conn(0x7fa45006b1b0 msgr2=0x7fa4501636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 --2- 172.21.15.50:0/1337918961 >> v2:172.21.15.50:3300/0 conn(0x7fa45006b1b0 0x7fa4501636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 -- 172.21.15.50:0/1337918961 >> v1:172.21.15.181:6789/0 conn(0x7fa450071870 legacy=0x7fa45006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 -- 172.21.15.50:0/1337918961 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500b2ef0 con 0x7fa450159bd0 2024-09-13T15:09:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44f200700 1 --2- 172.21.15.50:0/1337918961 >> v2:172.21.15.50:3300/0 conn(0x7fa45006b1b0 0x7fa4501636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44e800700 1 --2- 172.21.15.50:0/1337918961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa450159bd0 0x7fa4500cb700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa440009850 tx=0x7fa440009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c0f4a6fef843967 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:22.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.995+0000 7fa44d400700 1 -- 172.21.15.50:0/1337918961 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440011830 con 0x7fa450159bd0 2024-09-13T15:09:22.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa44d400700 1 -- 172.21.15.50:0/1337918961 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440011990 con 0x7fa450159bd0 2024-09-13T15:09:22.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa44d400700 1 -- 172.21.15.50:0/1337918961 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440011d20 con 0x7fa450159bd0 2024-09-13T15:09:22.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 -- 172.21.15.50:0/1337918961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa450159bd0 msgr2=0x7fa4500cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 --2- 172.21.15.50:0/1337918961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa450159bd0 0x7fa4500cb700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa440009850 tx=0x7fa440009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 -- 172.21.15.50:0/1337918961 shutdown_connections 2024-09-13T15:09:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 --2- 172.21.15.50:0/1337918961 >> v2:172.21.15.50:3300/0 conn(0x7fa45006b1b0 0x7fa4501636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 --2- 172.21.15.50:0/1337918961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa450159bd0 0x7fa4500cb700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 -- 172.21.15.50:0/1337918961 >> 172.21.15.50:0/1337918961 conn(0x7fa4500b0c40 msgr2=0x7fa45006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:22.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 -- 172.21.15.50:0/1337918961 shutdown_connections 2024-09-13T15:09:22.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:21.999+0000 7fa454a00700 1 -- 172.21.15.50:0/1337918961 wait complete. 2024-09-13T15:09:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 Processor -- start 2024-09-13T15:09:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 -- start start 2024-09-13T15:09:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45006b1b0 0x7fa45014a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 0x7fa45013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa450159bd0 0x7fa450148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45013d670 con 0x7fa450071870 2024-09-13T15:09:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa450149270 con 0x7fa45006b1b0 2024-09-13T15:09:22.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa454a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa450149550 con 0x7fa450159bd0 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 0x7fa45013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 0x7fa45013d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36208/0 (socket says 172.21.15.50:36208) 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 -- 172.21.15.50:0/40318125 learned_addr learned my addr 172.21.15.50:0/40318125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44e800700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45006b1b0 0x7fa45014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44f200700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa450159bd0 0x7fa450148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 -- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa450159bd0 msgr2=0x7fa450148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa450159bd0 0x7fa450148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 -- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45006b1b0 msgr2=0x7fa45014a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45006b1b0 0x7fa45014a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 -- 172.21.15.50:0/40318125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448009a70 con 0x7fa450071870 2024-09-13T15:09:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.003+0000 7fa44de00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 0x7fa45013d130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c700 tx=0x7fa43c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:22.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.007+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c005d90 con 0x7fa450071870 2024-09-13T15:09:22.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.007+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c0070d0 con 0x7fa450071870 2024-09-13T15:09:22.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.007+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c007480 con 0x7fa450071870 2024-09-13T15:09:22.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.007+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4400094b0 con 0x7fa450071870 2024-09-13T15:09:22.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.007+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa450149b10 con 0x7fa450071870 2024-09-13T15:09:22.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.007+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa450070c40 con 0x7fa450071870 2024-09-13T15:09:22.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.011+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa43c0075e0 con 0x7fa450071870 2024-09-13T15:09:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.011+0000 7fa446a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa430066730 0x7fa430068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.011+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa43c0838f0 con 0x7fa450071870 2024-09-13T15:09:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.011+0000 7fa44e800700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa430066730 0x7fa430068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.011+0000 7fa44e800700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa430066730 0x7fa430068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa440000c00 tx=0x7fa440008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:22.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.015+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa450070c40 con 0x7fa450071870 2024-09-13T15:09:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.219+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa450070c40 con 0x7fa450071870 2024-09-13T15:09:22.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.219+0000 7fa446a00700 1 -- 172.21.15.50:0/40318125 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa450070c40 con 0x7fa450071870 2024-09-13T15:09:22.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa430066730 msgr2=0x7fa430068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa430066730 0x7fa430068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa440000c00 tx=0x7fa440008030 comp rx=0 tx=0).stop 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 msgr2=0x7fa45013d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 0x7fa45013d130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c700 tx=0x7fa43c00ca10 comp rx=0 tx=0).stop 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 shutdown_connections 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa430066730 0x7fa430068bf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa450159bd0 0x7fa450148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa450071870 0x7fa45013d130 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 --2- 172.21.15.50:0/40318125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45006b1b0 0x7fa45014a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 >> 172.21.15.50:0/40318125 conn(0x7fa4500b0c40 msgr2=0x7fa45006d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 shutdown_connections 2024-09-13T15:09:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.223+0000 7fa454a00700 1 -- 172.21.15.50:0/40318125 wait complete. 2024-09-13T15:09:22.229 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:09:22.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:09:22.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:22.250 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:22.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:09:22.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:22.296 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:09:22.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.531+0000 7efdc1600700 1 Processor -- start 2024-09-13T15:09:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.531+0000 7efdc1600700 1 -- start start 2024-09-13T15:09:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc1600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efdbc143d60 0x7efdbc0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc1600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc1600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc06a430 con 0x7efdbc06ba10 2024-09-13T15:09:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc1600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc06a710 con 0x7efdbc143d60 2024-09-13T15:09:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc1600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc06a9f0 con 0x7efdbc0cf480 2024-09-13T15:09:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc0c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efdbc06ba10 0x7efdbc15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60932/0 (socket says 172.21.15.50:60932) 2024-09-13T15:09:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdc0c00700 1 -- 172.21.15.50:0/14652513 learned_addr learned my addr 172.21.15.50:0/14652513 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbbe00700 1 --2- 172.21.15.50:0/14652513 >> v2:172.21.15.181:3300/0 conn(0x7efdbc143d60 0x7efdbc0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdb3e00700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbb400700 1 -- 172.21.15.50:0/14652513 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163136508 0 0) 0x7efdbc06a430 con 0x7efdbc06ba10 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbb400700 1 -- 172.21.15.50:0/14652513 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda00035d0 con 0x7efdbc06ba10 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbbe00700 1 -- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 msgr2=0x7efdbc06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbbe00700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbbe00700 1 -- 172.21.15.50:0/14652513 >> v1:172.21.15.50:6789/0 conn(0x7efdbc06ba10 legacy=0x7efdbc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.535+0000 7efdbb400700 1 -- 172.21.15.50:0/14652513 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 16400056 0 0) 0x7efda00035d0 con 0x7efdbc06ba10 2024-09-13T15:09:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdbbe00700 1 -- 172.21.15.50:0/14652513 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc06acd0 con 0x7efdbc143d60 2024-09-13T15:09:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdb3e00700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdbbe00700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc0cef40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efdac009850 tx=0x7efdac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17f296980f3382f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdbb400700 1 -- 172.21.15.50:0/14652513 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb40019f0 con 0x7efdbc143d60 2024-09-13T15:09:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdbb400700 1 -- 172.21.15.50:0/14652513 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac004030 con 0x7efdbc143d60 2024-09-13T15:09:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdbb400700 1 -- 172.21.15.50:0/14652513 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0043e0 con 0x7efdbc143d60 2024-09-13T15:09:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 -- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 msgr2=0x7efdbc0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc0cef40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efdac009850 tx=0x7efdac009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 -- 172.21.15.50:0/14652513 shutdown_connections 2024-09-13T15:09:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 --2- 172.21.15.50:0/14652513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc0cef40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 -- 172.21.15.50:0/14652513 >> 172.21.15.50:0/14652513 conn(0x7efdbc06ca10 msgr2=0x7efdbc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 -- 172.21.15.50:0/14652513 shutdown_connections 2024-09-13T15:09:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.539+0000 7efdc1600700 1 -- 172.21.15.50:0/14652513 wait complete. 2024-09-13T15:09:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 Processor -- start 2024-09-13T15:09:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 -- start start 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 0x7efdbc13b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc13a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc13c500 con 0x7efdbc06ba10 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0b1170 con 0x7efdbc143d60 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.543+0000 7efdc1600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc13b8f0 con 0x7efdbc0cf480 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 0x7efdbc13b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 0x7efdbc13b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36210/0 (socket says 172.21.15.50:36210) 2024-09-13T15:09:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 -- 172.21.15.50:0/2684953050 learned_addr learned my addr 172.21.15.50:0/2684953050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdb3e00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdc0c00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc13a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 -- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 msgr2=0x7efdbc0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 -- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 msgr2=0x7efdbc13a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc13a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 -- 172.21.15.50:0/2684953050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40094b0 con 0x7efdbc06ba10 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdbbe00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 0x7efdbc13b280 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efdac000c00 tx=0x7efdac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac003ce0 con 0x7efdbc06ba10 2024-09-13T15:09:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac01f070 con 0x7efdbc06ba10 2024-09-13T15:09:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac0094b0 con 0x7efdbc06ba10 2024-09-13T15:09:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac011870 con 0x7efdbc06ba10 2024-09-13T15:09:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc13beb0 con 0x7efdbc06ba10 2024-09-13T15:09:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.547+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc06b4d0 con 0x7efdbc06ba10 2024-09-13T15:09:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.551+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdac021030 con 0x7efdbc06ba10 2024-09-13T15:09:22.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.555+0000 7efdb8c00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efd98066760 0x7efd98068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:22.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.555+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efdac085610 con 0x7efdbc06ba10 2024-09-13T15:09:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.555+0000 7efdb3e00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efd98066760 0x7efd98068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.555+0000 7efdb3e00700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efd98066760 0x7efd98068c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0b3260 tx=0x7efda4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.559+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efdac0528b0 con 0x7efdbc06ba10 2024-09-13T15:09:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.795+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdbc0cdc80 con 0x7efdbc06ba10 2024-09-13T15:09:22.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.795+0000 7efdb8c00700 1 -- 172.21.15.50:0/2684953050 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7efdac003e60 con 0x7efdbc06ba10 2024-09-13T15:09:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:22.802 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:22.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efd98066760 msgr2=0x7efd98068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efd98066760 0x7efd98068c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0b3260 tx=0x7efda4008040 comp rx=0 tx=0).stop 2024-09-13T15:09:22.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 msgr2=0x7efdbc13b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:22.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 0x7efdbc13b280 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efdac000c00 tx=0x7efdac004770 comp rx=0 tx=0).stop 2024-09-13T15:09:22.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 shutdown_connections 2024-09-13T15:09:22.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efd98066760 0x7efd98068c20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc143d60 0x7efdbc13a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0cf480 0x7efdbc0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 --2- 172.21.15.50:0/2684953050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdbc06ba10 0x7efdbc13b280 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:22.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 >> 172.21.15.50:0/2684953050 conn(0x7efdbc06ca10 msgr2=0x7efdbc0ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:22.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 shutdown_connections 2024-09-13T15:09:22.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:22.799+0000 7efdc1600700 1 -- 172.21.15.50:0/2684953050 wait complete. 2024-09-13T15:09:22.807 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:22.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-13T15:09:23.008 INFO:teuthology.orchestra.run.smithi181.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":80,"msgr_send_messages":68,"msgr_recv_bytes":116896,"msgr_send_bytes":19553,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.020014795,"msgr_running_send_time":0.005236266,"msgr_running_recv_time":0.015359430,"msgr_running_fast_dispatch_time":0.000763986,"msgr_send_messages_queue_lat":{"avgcount":68,"sum":0.072749975,"avgtime":0.001069852},"msgr_handle_ack_lat":{"avgcount":13,"sum":0.000004564,"avgtime":0.000000351},"msgr_recv_encrypted_bytes":110272,"msgr_send_encrypted_bytes":11712},"AsyncMessenger::Worker-1":{"msgr_recv_messages":11,"msgr_send_messages":18,"msgr_recv_bytes":2872,"msgr_send_bytes":97672,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008626870,"msgr_running_send_time":0.001195368,"msgr_running_recv_time":0.006557314,"msgr_running_fast_dispatch_time":0.000444261,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.127589084,"avgtime":0.007974317},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93088},"AsyncMessenger::Worker-2":{"msgr_recv_messages":51,"msgr_send_messages":50,"msgr_recv_bytes":14153,"msgr_send_bytes":48947,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.017455034,"msgr_running_send_time":0.003257486,"msgr_running_recv_time":0.013330540,"msgr_running_fast_dispatch_time":0.000945624,"msgr_send_messages_queue_lat":{"avgcount":48,"sum":0.148581692,"avgtime":0.003095451},"msgr_handle_ack_lat":{"avgcount":53,"sum":0.000018554,"avgtime":0.000000350},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":45,"sum":0.005344555,"avgtime":0.000118767}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000023469,"avgtime":0.000011734}},"mds":{"request":26,"reply":26,"reply_latency":{"avgcount":26,"sum":0.008667728,"avgtime":0.000333374},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":51,"traverse_hit":51,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196983,"rdpos":0,"jlat":{"avgcount":5,"sum":0.019920851,"avgtime":0.003984170},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":45500,"heap":207224},"mds_server":{"dispatch_client_request":26,"dispatch_server_request":0,"handle_client_request":26,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":25,"sum":0.008093814,"avgtime":0.000323752},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000573914,"avgtime":0.000573914},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":24,"average_load":12,"avg_session_uptime":3,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225460,"buffer_anon_items":90,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52448,"mds_co_items":213,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13799,"op_resend":30,"op_reply":43,"op_latency":{"avgcount":43,"sum":1.027977923,"avgtime":0.023906463},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":41,"map_full":0,"map_inc":3,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":138,"get_sum":117434,"get_or_fail_fail":0,"get_or_fail_success":138,"take":0,"take_sum":0,"put":138,"put_sum":117434,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13799,"put":43,"put_sum":13799,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b85f372d20":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2679,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2679,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T15:09:23.010 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 13, "avgtime": 3.51e-07, "sum": 4.564e-06 }, "msgr_recv_bytes": 116896, "msgr_recv_encrypted_bytes": 110272, "msgr_recv_messages": 80, "msgr_running_fast_dispatch_time": 0.000763986, "msgr_running_recv_time": 0.01535943, "msgr_running_send_time": 0.005236266, "msgr_running_total_time": 0.020014795, "msgr_send_bytes": 19553, "msgr_send_encrypted_bytes": 11712, "msgr_send_messages": 68, "msgr_send_messages_queue_lat": { "avgcount": 68, "avgtime": 0.001069852, "sum": 0.072749975 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 2872, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 11, "msgr_running_fast_dispatch_time": 0.000444261, "msgr_running_recv_time": 0.006557314, "msgr_running_send_time": 0.001195368, "msgr_running_total_time": 0.00862687, "msgr_send_bytes": 97672, "msgr_send_encrypted_bytes": 93088, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.007974317, "sum": 0.127589084 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 53, "avgtime": 3.5e-07, "sum": 1.8554e-05 }, "msgr_recv_bytes": 14153, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 51, "msgr_running_fast_dispatch_time": 0.000945624, "msgr_running_recv_time": 0.01333054, "msgr_running_send_time": 0.003257486, "msgr_running_total_time": 0.017455034, "msgr_send_bytes": 48947, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 50, "msgr_send_messages_queue_lat": { "avgcount": 48, "avgtime": 0.003095451, "sum": 0.148581692 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 45, "avgtime": 0.000118767, "sum": 0.005344555 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.1734e-05, "sum": 2.3469e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 26, "reply_latency": { "avgcount": 26, "avgtime": 0.000333374, "sum": 0.008667728 }, "request": 26, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 51, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 51, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.00398417, "sum": 0.019920851 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196983 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207224, "ino": 13, "ino+": 13, "ino-": 0, "rss": 45500 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 26, "dispatch_server_request": 0, "handle_client_request": 26, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 25, "avgtime": 0.000323752, "sum": 0.008093814 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000573914, "sum": 0.000573914 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 12, "avg_session_uptime": 3, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 24 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225460, "buffer_anon_items": 90, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52448, "mds_co_items": 213, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 41, "map_full": 0, "map_inc": 3, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.023906463, "sum": 1.027977923 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 30, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13799, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 138, "get_or_fail_fail": 0, "get_or_fail_success": 138, "get_started": 0, "get_sum": 117434, "max": 104857600, "put": 138, "put_sum": 117434, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13799, "take": 43, "take_sum": 13799, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b85f372d20": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2679, "max": 3758096384, "put": 5, "put_sum": 2679, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T15:09:23.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:09:23.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.183+0000 7f8d75e00700 1 Processor -- start 2024-09-13T15:09:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.183+0000 7f8d75e00700 1 -- start start 2024-09-13T15:09:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d75e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d700cb020 0x7f8d700cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d75e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8d7015c2a0 0x7f8d7015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d75e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700b2ad0 con 0x7f8d7006aaa0 2024-09-13T15:09:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d75e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7015b960 con 0x7f8d700cb020 2024-09-13T15:09:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d75e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7015bc40 con 0x7f8d7015c2a0 2024-09-13T15:09:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d74a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d700cb020 0x7f8d700cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d74a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d700cb020 0x7f8d700cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60326/0 (socket says 172.21.15.50:60326) 2024-09-13T15:09:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d74a00700 1 -- 172.21.15.50:0/3785434920 learned_addr learned my addr 172.21.15.50:0/3785434920 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d67e00700 1 --2- 172.21.15.50:0/3785434920 >> v2:172.21.15.181:3300/0 conn(0x7f8d7015c2a0 0x7f8d7015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d67e00700 1 -- 172.21.15.50:0/3785434920 >> v2:172.21.15.50:3300/0 conn(0x7f8d700cb020 msgr2=0x7f8d700cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d67e00700 1 --2- 172.21.15.50:0/3785434920 >> v2:172.21.15.50:3300/0 conn(0x7f8d700cb020 0x7f8d700cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d67e00700 1 -- 172.21.15.50:0/3785434920 >> v1:172.21.15.181:6789/0 conn(0x7f8d7006aaa0 legacy=0x7f8d700b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.187+0000 7f8d67e00700 1 -- 172.21.15.50:0/3785434920 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7015bf20 con 0x7f8d7015c2a0 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d67e00700 1 --2- 172.21.15.50:0/3785434920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d7015c2a0 0x7f8d7015b0e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8d7015e630 tx=0x7f8d58009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a75bfdd673a3882 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d6fe00700 1 -- 172.21.15.50:0/3785434920 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58011830 con 0x7f8d7015c2a0 2024-09-13T15:09:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d6fe00700 1 -- 172.21.15.50:0/3785434920 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58011990 con 0x7f8d7015c2a0 2024-09-13T15:09:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d6fe00700 1 -- 172.21.15.50:0/3785434920 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58011d20 con 0x7f8d7015c2a0 2024-09-13T15:09:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 -- 172.21.15.50:0/3785434920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d7015c2a0 msgr2=0x7f8d7015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 --2- 172.21.15.50:0/3785434920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d7015c2a0 0x7f8d7015b0e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8d7015e630 tx=0x7f8d58009b30 comp rx=0 tx=0).stop 2024-09-13T15:09:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 -- 172.21.15.50:0/3785434920 shutdown_connections 2024-09-13T15:09:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 --2- 172.21.15.50:0/3785434920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d7015c2a0 0x7f8d7015b0e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 --2- 172.21.15.50:0/3785434920 >> v2:172.21.15.50:3300/0 conn(0x7f8d700cb020 0x7f8d700cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 -- 172.21.15.50:0/3785434920 >> 172.21.15.50:0/3785434920 conn(0x7f8d700b0c40 msgr2=0x7f8d7006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 -- 172.21.15.50:0/3785434920 shutdown_connections 2024-09-13T15:09:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.191+0000 7f8d75e00700 1 -- 172.21.15.50:0/3785434920 wait complete. 2024-09-13T15:09:23.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 Processor -- start 2024-09-13T15:09:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 -- start start 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d7006aaa0 0x7f8d701f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d700cb020 0x7f8d7014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 0x7f8d700c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d701570f0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7014b860 con 0x7f8d700cb020 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d701f1110 con 0x7f8d7006aaa0 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 0x7f8d700c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d74a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d7006aaa0 0x7f8d701f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d67e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d700cb020 0x7f8d7014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 0x7f8d700c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60334/0 (socket says 172.21.15.50:60334) 2024-09-13T15:09:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 -- 172.21.15.50:0/2760041934 learned_addr learned my addr 172.21.15.50:0/2760041934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 -- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d7006aaa0 msgr2=0x7f8d701f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d7006aaa0 0x7f8d701f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 -- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d700cb020 msgr2=0x7f8d7014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d700cb020 0x7f8d7014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.195+0000 7f8d75400700 1 -- 172.21.15.50:0/2760041934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d580094b0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d75400700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 0x7f8d700c9f30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800cc80 tx=0x7f8d6800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68003c20 con 0x7f8d7015c2a0 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68003d80 con 0x7f8d7015c2a0 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6800aaa0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70157340 con 0x7f8d7015c2a0 2024-09-13T15:09:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d70157900 con 0x7f8d7015c2a0 2024-09-13T15:09:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.199+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d701f6cb0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.203+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d6800ac00 con 0x7f8d7015c2a0 2024-09-13T15:09:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.203+0000 7f8d6d600700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8d4c066730 0x7f8d4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.203+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d68084280 con 0x7f8d7015c2a0 2024-09-13T15:09:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.203+0000 7f8d74a00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8d4c066730 0x7f8d4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.203+0000 7f8d74a00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8d4c066730 0x7f8d4c068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d7006cec0 tx=0x7f8d600092e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:23.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.211+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d701f6cb0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.443+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d701f6cb0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d6d600700 1 -- 172.21.15.50:0/2760041934 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8d701f6cb0 con 0x7f8d7015c2a0 2024-09-13T15:09:23.451 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:09:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8d4c066730 msgr2=0x7f8d4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8d4c066730 0x7f8d4c068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d7006cec0 tx=0x7f8d600092e0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 msgr2=0x7f8d700c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 0x7f8d700c9f30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800cc80 tx=0x7f8d6800cf90 comp rx=0 tx=0).stop 2024-09-13T15:09:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 shutdown_connections 2024-09-13T15:09:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8d4c066730 0x7f8d4c068bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7015c2a0 0x7f8d700c9f30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d700cb020 0x7f8d7014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 --2- 172.21.15.50:0/2760041934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d7006aaa0 0x7f8d701f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 >> 172.21.15.50:0/2760041934 conn(0x7f8d700b0c40 msgr2=0x7f8d7015dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 shutdown_connections 2024-09-13T15:09:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:23.447+0000 7f8d75e00700 1 -- 172.21.15.50:0/2760041934 wait complete. 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:09:23.478 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:23.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.479 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42343sec preferred_lft 42343sec 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:09:23.494 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.495 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:09:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:09:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:23.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.497 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:09:23.573 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:09:23.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.577 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:09:23.637 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:09:23.637 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:09:23.637 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:09:23.637 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:09:23.637 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:09:23.637 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:09:23.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.638 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:09:23.639 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:09:23.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:09:23.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:09:23.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:09:23.639 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:09:23.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.774 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:09:23.788 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:09:23.788 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:09:23.789 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:23.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:09:23.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:23.863 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:23.923 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:23.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:23.923 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:23.987 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:09:23.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:23.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:24.119 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:24.119 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:24.141 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:24.141 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:24.141 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:09:24.141 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:09:24.141 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:09:24.147 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:09:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:24.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:24.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:24.176 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:09:24.243 INFO:teuthology.orchestra.run.smithi050.stdout:client5548 2024-09-13T15:09:24.243 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:24.243 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:24.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-13T15:09:24.491 INFO:teuthology.orchestra.run.smithi181.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":81,"msgr_send_messages":69,"msgr_recv_bytes":117168,"msgr_send_bytes":20145,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.020303217,"msgr_running_send_time":0.005353737,"msgr_running_recv_time":0.015433614,"msgr_running_fast_dispatch_time":0.000763986,"msgr_send_messages_queue_lat":{"avgcount":69,"sum":0.072812083,"avgtime":0.001055247},"msgr_handle_ack_lat":{"avgcount":13,"sum":0.000004564,"avgtime":0.000000351},"msgr_recv_encrypted_bytes":110544,"msgr_send_encrypted_bytes":12304},"AsyncMessenger::Worker-1":{"msgr_recv_messages":11,"msgr_send_messages":18,"msgr_recv_bytes":2872,"msgr_send_bytes":97672,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008626870,"msgr_running_send_time":0.001195368,"msgr_running_recv_time":0.006557314,"msgr_running_fast_dispatch_time":0.000444261,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.127589084,"avgtime":0.007974317},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93088},"AsyncMessenger::Worker-2":{"msgr_recv_messages":57,"msgr_send_messages":56,"msgr_recv_bytes":15777,"msgr_send_bytes":51610,"msgr_created_connections":9,"msgr_active_connections":4,"msgr_running_total_time":0.018704509,"msgr_running_send_time":0.003651830,"msgr_running_recv_time":0.014115623,"msgr_running_fast_dispatch_time":0.001033231,"msgr_send_messages_queue_lat":{"avgcount":54,"sum":0.148837864,"avgtime":0.002756256},"msgr_handle_ack_lat":{"avgcount":60,"sum":0.000020327,"avgtime":0.000000338},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.005436896,"avgtime":0.000113268}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000023469,"avgtime":0.000011734}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.009387231,"avgtime":0.000323697},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":57,"traverse_hit":57,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197242,"rdpos":0,"jlat":{"avgcount":6,"sum":0.023122224,"avgtime":0.003853704},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":45756,"heap":207224},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":7,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":28,"sum":0.008813317,"avgtime":0.000314761},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000573914,"avgtime":0.000573914},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":26,"average_load":26,"avg_session_uptime":3,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225460,"buffer_anon_items":90,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52448,"mds_co_items":213,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":14148,"op_resend":30,"op_reply":45,"op_latency":{"avgcount":45,"sum":1.035977751,"avgtime":0.023021727},"op_inflight":0,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":41,"map_full":0,"map_inc":3,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":145,"get_sum":118648,"get_or_fail_fail":0,"get_or_fail_success":145,"take":0,"take_sum":0,"put":145,"put_sum":118648,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":14148,"put":45,"put_sum":14148,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b85f372d20":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2938,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":6,"put_sum":2938,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T15:09:24.492 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 13, "avgtime": 3.51e-07, "sum": 4.564e-06 }, "msgr_recv_bytes": 117168, "msgr_recv_encrypted_bytes": 110544, "msgr_recv_messages": 81, "msgr_running_fast_dispatch_time": 0.000763986, "msgr_running_recv_time": 0.015433614, "msgr_running_send_time": 0.005353737, "msgr_running_total_time": 0.020303217, "msgr_send_bytes": 20145, "msgr_send_encrypted_bytes": 12304, "msgr_send_messages": 69, "msgr_send_messages_queue_lat": { "avgcount": 69, "avgtime": 0.001055247, "sum": 0.072812083 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 2872, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 11, "msgr_running_fast_dispatch_time": 0.000444261, "msgr_running_recv_time": 0.006557314, "msgr_running_send_time": 0.001195368, "msgr_running_total_time": 0.00862687, "msgr_send_bytes": 97672, "msgr_send_encrypted_bytes": 93088, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.007974317, "sum": 0.127589084 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 60, "avgtime": 3.38e-07, "sum": 2.0327e-05 }, "msgr_recv_bytes": 15777, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 57, "msgr_running_fast_dispatch_time": 0.001033231, "msgr_running_recv_time": 0.014115623, "msgr_running_send_time": 0.00365183, "msgr_running_total_time": 0.018704509, "msgr_send_bytes": 51610, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 56, "msgr_send_messages_queue_lat": { "avgcount": 54, "avgtime": 0.002756256, "sum": 0.148837864 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 0.000113268, "sum": 0.005436896 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.1734e-05, "sum": 2.3469e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000323697, "sum": 0.009387231 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 57, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 57, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.003853704, "sum": 0.023122224 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197242 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207224, "ino": 13, "ino+": 13, "ino-": 0, "rss": 45756 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 7, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 28, "avgtime": 0.000314761, "sum": 0.008813317 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000573914, "sum": 0.000573914 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 26, "avg_session_uptime": 3, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 26 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225460, "buffer_anon_items": 90, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52448, "mds_co_items": 213, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 41, "map_full": 0, "map_inc": 3, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 45, "avgtime": 0.023021727, "sum": 1.035977751 }, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 30, "op_rmw": 0, "op_send": 45, "op_send_bytes": 14148, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 145, "get_or_fail_fail": 0, "get_or_fail_success": 145, "get_started": 0, "get_sum": 118648, "max": 104857600, "put": 145, "put_sum": 118648, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 14148, "take": 45, "take_sum": 14148, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b85f372d20": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2938, "max": 3758096384, "put": 6, "put_sum": 2938, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T15:09:24.493 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:24.493 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:24.512 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:24.512 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:24.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.791+0000 7f4ed1200700 1 Processor -- start 2024-09-13T15:09:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.791+0000 7f4ed1200700 1 -- start start 2024-09-13T15:09:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ed1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc159690 0x7f4ecc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ed1200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4ecc159a70 0x7f4ecc0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ed1200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc15d530 con 0x7f4ecc0ce5a0 2024-09-13T15:09:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ed1200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0cf100 con 0x7f4ecc159a70 2024-09-13T15:09:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ed1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc15d810 con 0x7f4ecc159690 2024-09-13T15:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecbe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ecc0ce5a0 0x7f4ecc0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58112/0 (socket says 172.21.15.50:58112) 2024-09-13T15:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecbe00700 1 -- 172.21.15.50:0/4152109972 learned_addr learned my addr 172.21.15.50:0/4152109972 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecaa00700 1 --2- 172.21.15.50:0/4152109972 >> v2:172.21.15.181:3300/0 conn(0x7f4ecc159a70 0x7f4ecc0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecb400700 1 --2- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc159690 0x7f4ecc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4eca000700 1 -- 172.21.15.50:0/4152109972 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213165371 0 0) 0x7f4ecc15d530 con 0x7f4ecc0ce5a0 2024-09-13T15:09:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4eca000700 1 -- 172.21.15.50:0/4152109972 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb00035d0 con 0x7f4ecc0ce5a0 2024-09-13T15:09:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecaa00700 1 -- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc159690 msgr2=0x7f4ecc0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecaa00700 1 --2- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc159690 0x7f4ecc0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecaa00700 1 -- 172.21.15.50:0/4152109972 >> v1:172.21.15.50:6789/0 conn(0x7f4ecc0ce5a0 legacy=0x7f4ecc0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4eca000700 1 -- 172.21.15.50:0/4152109972 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3372656575 0 0) 0x7f4eb00035d0 con 0x7f4ecc0ce5a0 2024-09-13T15:09:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.795+0000 7f4ecaa00700 1 -- 172.21.15.50:0/4152109972 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc15daf0 con 0x7f4ecc159a70 2024-09-13T15:09:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ecaa00700 1 --2- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc0cc970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009850 tx=0x7f4eb8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a566e666f7a805a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4eca000700 1 -- 172.21.15.50:0/4152109972 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40019f0 con 0x7f4ecc159a70 2024-09-13T15:09:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4eca000700 1 -- 172.21.15.50:0/4152109972 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8004030 con 0x7f4ecc159a70 2024-09-13T15:09:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4eca000700 1 -- 172.21.15.50:0/4152109972 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80043e0 con 0x7f4ecc159a70 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 -- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 msgr2=0x7f4ecc0cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 --2- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc0cc970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009850 tx=0x7f4eb8009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 -- 172.21.15.50:0/4152109972 shutdown_connections 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 --2- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc0cc970 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 --2- 172.21.15.50:0/4152109972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc159690 0x7f4ecc0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 -- 172.21.15.50:0/4152109972 >> 172.21.15.50:0/4152109972 conn(0x7f4ecc06ca10 msgr2=0x7f4ecc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 -- 172.21.15.50:0/4152109972 shutdown_connections 2024-09-13T15:09:24.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.799+0000 7f4ed1200700 1 -- 172.21.15.50:0/4152109972 wait complete. 2024-09-13T15:09:24.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.803+0000 7f4ed1200700 1 Processor -- start 2024-09-13T15:09:24.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.803+0000 7f4ed1200700 1 -- start start 2024-09-13T15:09:24.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ed1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc0ce5a0 0x7f4ecc15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ed1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 0x7f4ecc150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ed1200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ed1200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc14cee0 con 0x7f4ecc159690 2024-09-13T15:09:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ed1200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc15c560 con 0x7f4ecc159a70 2024-09-13T15:09:24.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ed1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc15c840 con 0x7f4ecc0ce5a0 2024-09-13T15:09:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 0x7f4ecc150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecb400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc0ce5a0 0x7f4ecc15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 0x7f4ecc150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60348/0 (socket says 172.21.15.50:60348) 2024-09-13T15:09:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 -- 172.21.15.50:0/246974641 learned_addr learned my addr 172.21.15.50:0/246974641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecbe00700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:24.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 -- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc0ce5a0 msgr2=0x7f4ecc15be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc0ce5a0 0x7f4ecc15be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 -- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 msgr2=0x7f4ecc1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc1481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:24.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.807+0000 7f4ecaa00700 1 -- 172.21.15.50:0/246974641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80094b0 con 0x7f4ecc159690 2024-09-13T15:09:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ecaa00700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 0x7f4ecc150180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8000c00 tx=0x7f4eb8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8003b00 con 0x7f4ecc159690 2024-09-13T15:09:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb801f070 con 0x7f4ecc159690 2024-09-13T15:09:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc14e6d0 con 0x7f4ecc159690 2024-09-13T15:09:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8011630 con 0x7f4ecc159690 2024-09-13T15:09:24.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc14ec90 con 0x7f4ecc159690 2024-09-13T15:09:24.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.811+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc14ee80 con 0x7f4ecc159690 2024-09-13T15:09:24.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.815+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4eb8021030 con 0x7f4ecc159690 2024-09-13T15:09:24.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.815+0000 7f4ec3400700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4eac066730 0x7f4eac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.815+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4eb80853d0 con 0x7f4ecc159690 2024-09-13T15:09:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.815+0000 7f4ecb400700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4eac066730 0x7f4eac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.815+0000 7f4ecb400700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4eac066730 0x7f4eac068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009bf0 tx=0x7f4ebc009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:24.823+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4eb8052790 con 0x7f4ecc159690 2024-09-13T15:09:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.031+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ecc15d530 con 0x7f4ecc159690 2024-09-13T15:09:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.035+0000 7f4ec3400700 1 -- 172.21.15.50:0/246974641 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f4eb8055db0 con 0x7f4ecc159690 2024-09-13T15:09:25.041 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:25.041 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:21.733922+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4eac066730 msgr2=0x7f4eac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4eac066730 0x7f4eac068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009bf0 tx=0x7f4ebc009240 comp rx=0 tx=0).stop 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 msgr2=0x7f4ecc150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 0x7f4ecc150180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8000c00 tx=0x7f4eb8004770 comp rx=0 tx=0).stop 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 shutdown_connections 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4eac066730 0x7f4eac068bf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ecc159a70 0x7f4ecc1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc159690 0x7f4ecc150180 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 --2- 172.21.15.50:0/246974641 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ecc0ce5a0 0x7f4ecc15be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 >> 172.21.15.50:0/246974641 conn(0x7f4ecc06ca10 msgr2=0x7f4ecc06b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 shutdown_connections 2024-09-13T15:09:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.039+0000 7f4ed1200700 1 -- 172.21.15.50:0/246974641 wait complete. 2024-09-13T15:09:25.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:06.006484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:07.097072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:25.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:25.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.259+0000 7f8011000700 1 Processor -- start 2024-09-13T15:09:25.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.259+0000 7f8011000700 1 -- start start 2024-09-13T15:09:25.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f8011000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f800c06cd80 0x7f800c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f8011000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06ada0 0x7f800c06b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f8011000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c160680 con 0x7f800c15ca20 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f8011000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c06b750 con 0x7f800c06cd80 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f8011000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c15d670 con 0x7f800c06ada0 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f800aa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f800c06cd80 0x7f800c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f800b400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f800c15ca20 0x7f800c15ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:51392/0 (socket says 172.21.15.50:51392) 2024-09-13T15:09:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f800b400700 1 -- 172.21.15.50:0/3019573034 learned_addr learned my addr 172.21.15.50:0/3019573034 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.263+0000 7f800be00700 1 --2- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06ada0 0x7f800c06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800aa00700 1 -- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06ada0 msgr2=0x7f800c06b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800aa00700 1 --2- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06ada0 0x7f800c06b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800aa00700 1 -- 172.21.15.50:0/3019573034 >> v1:172.21.15.181:6789/0 conn(0x7f800c15ca20 legacy=0x7f800c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800aa00700 1 -- 172.21.15.50:0/3019573034 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c15d950 con 0x7f800c06cd80 2024-09-13T15:09:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800aa00700 1 --2- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c06cd80 0x7f800c0b4310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009850 tx=0x7f7ff8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a6a7411dc502e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800a000700 1 -- 172.21.15.50:0/3019573034 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8011830 con 0x7f800c06cd80 2024-09-13T15:09:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800a000700 1 -- 172.21.15.50:0/3019573034 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8011990 con 0x7f800c06cd80 2024-09-13T15:09:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f800a000700 1 -- 172.21.15.50:0/3019573034 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8011d40 con 0x7f800c06cd80 2024-09-13T15:09:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 -- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c06cd80 msgr2=0x7f800c0b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 --2- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c06cd80 0x7f800c0b4310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009850 tx=0x7f7ff8009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 -- 172.21.15.50:0/3019573034 shutdown_connections 2024-09-13T15:09:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 --2- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06ada0 0x7f800c06b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 --2- 172.21.15.50:0/3019573034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c06cd80 0x7f800c0b4310 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 -- 172.21.15.50:0/3019573034 >> 172.21.15.50:0/3019573034 conn(0x7f800c071d20 msgr2=0x7f800c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 -- 172.21.15.50:0/3019573034 shutdown_connections 2024-09-13T15:09:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.267+0000 7f8011000700 1 -- 172.21.15.50:0/3019573034 wait complete. 2024-09-13T15:09:25.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 Processor -- start 2024-09-13T15:09:25.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 -- start start 2024-09-13T15:09:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 0x7f800c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06cd80 0x7f800c14e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c15ca20 0x7f800c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1563a0 con 0x7f800c06ada0 2024-09-13T15:09:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1544a0 con 0x7f800c15ca20 2024-09-13T15:09:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.271+0000 7f8011000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c155b90 con 0x7f800c06cd80 2024-09-13T15:09:25.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 0x7f800c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 0x7f800c14f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60354/0 (socket says 172.21.15.50:60354) 2024-09-13T15:09:25.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800b400700 1 -- 172.21.15.50:0/3631289194 learned_addr learned my addr 172.21.15.50:0/3631289194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:25.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c15ca20 0x7f800c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800aa00700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06cd80 0x7f800c14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 -- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06cd80 msgr2=0x7f800c14e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06cd80 0x7f800c14e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 -- 172.21.15.50:0/3631289194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 msgr2=0x7f800c14f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 0x7f800c14f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 -- 172.21.15.50:0/3631289194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80094b0 con 0x7f800c15ca20 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800b400700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 0x7f800c14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:25.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f800be00700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c15ca20 0x7f800c1548c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8004009d90 tx=0x7f800400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004009c00 con 0x7f800c15ca20 2024-09-13T15:09:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400f040 con 0x7f800c15ca20 2024-09-13T15:09:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c155de0 con 0x7f800c15ca20 2024-09-13T15:09:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004014480 con 0x7f800c15ca20 2024-09-13T15:09:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.275+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c1540c0 con 0x7f800c15ca20 2024-09-13T15:09:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.279+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c153f00 con 0x7f800c15ca20 2024-09-13T15:09:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.279+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80040145e0 con 0x7f800c15ca20 2024-09-13T15:09:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.279+0000 7f8003400700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fec066730 0x7f7fec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.279+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8004084d90 con 0x7f800c15ca20 2024-09-13T15:09:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.283+0000 7f800b400700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fec066730 0x7f7fec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.283+0000 7f800b400700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fec066730 0x7f7fec068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc005930 tx=0x7f7ffc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:25.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.291+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8004051f90 con 0x7f800c15ca20 2024-09-13T15:09:25.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.471+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f800c06d1c0 con 0x7f800c15ca20 2024-09-13T15:09:25.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.475+0000 7f8003400700 1 -- 172.21.15.50:0/3631289194 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8004018020 con 0x7f800c15ca20 2024-09-13T15:09:25.478 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fec066730 msgr2=0x7f7fec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fec066730 0x7f7fec068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc005930 tx=0x7f7ffc009040 comp rx=0 tx=0).stop 2024-09-13T15:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c15ca20 msgr2=0x7f800c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c15ca20 0x7f800c1548c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8004009d90 tx=0x7f800400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 shutdown_connections 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fec066730 0x7f7fec068bf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800c15ca20 0x7f800c1548c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f800c06cd80 0x7f800c14e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 --2- 172.21.15.50:0/3631289194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f800c06ada0 0x7f800c14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 >> 172.21.15.50:0/3631289194 conn(0x7f800c071d20 msgr2=0x7f800c15ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 shutdown_connections 2024-09-13T15:09:25.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.479+0000 7f8011000700 1 -- 172.21.15.50:0/3631289194 wait complete. 2024-09-13T15:09:25.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:09:25.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.675+0000 7fafa6800700 1 Processor -- start 2024-09-13T15:09:25.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.675+0000 7fafa6800700 1 -- start start 2024-09-13T15:09:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa0159920 0x7fafa00b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa6800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00cd2a0 con 0x7fafa00b30d0 2024-09-13T15:09:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa6800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00ccc90 con 0x7fafa006d070 2024-09-13T15:09:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00b3580 con 0x7fafa0159920 2024-09-13T15:09:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa4a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fafa00b30d0 0x7fafa006c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58128/0 (socket says 172.21.15.50:58128) 2024-09-13T15:09:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa4a00700 1 -- 172.21.15.50:0/2387377269 learned_addr learned my addr 172.21.15.50:0/2387377269 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7fafa5400700 1 --2- 172.21.15.50:0/2387377269 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa0159920 0x7fafa00b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936438964 0 0) 0x7fafa00cd2a0 con 0x7fafa00b30d0 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf880035d0 con 0x7fafa00b30d0 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506215847 0 0) 0x7fafa00ccc90 con 0x7fafa006d070 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.679+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa00cd2a0 con 0x7fafa006d070 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927770456 0 0) 0x7faf880035d0 con 0x7fafa00b30d0 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa5400700 1 -- 172.21.15.50:0/2387377269 >> v1:172.21.15.181:6789/0 conn(0x7fafa006d070 legacy=0x7fafa00cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa5400700 1 -- 172.21.15.50:0/2387377269 >> v1:172.21.15.50:6789/0 conn(0x7fafa00b30d0 legacy=0x7fafa006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa5400700 1 -- 172.21.15.50:0/2387377269 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00b3860 con 0x7fafa0159920 2024-09-13T15:09:25.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa5400700 1 --2- 172.21.15.50:0/2387377269 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa0159920 0x7fafa00b2b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf94009dc0 tx=0x7faf9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3b8914b45b615ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:25.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400e070 con 0x7fafa0159920 2024-09-13T15:09:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94003a40 con 0x7fafa0159920 2024-09-13T15:09:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7faf9fe00700 1 -- 172.21.15.50:0/2387377269 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c001670 con 0x7fafa0159920 2024-09-13T15:09:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 -- 172.21.15.50:0/2387377269 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa0159920 msgr2=0x7fafa00b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 --2- 172.21.15.50:0/2387377269 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa0159920 0x7fafa00b2b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf94009dc0 tx=0x7faf9400b330 comp rx=0 tx=0).stop 2024-09-13T15:09:25.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 -- 172.21.15.50:0/2387377269 shutdown_connections 2024-09-13T15:09:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 --2- 172.21.15.50:0/2387377269 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa0159920 0x7fafa00b2b90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 -- 172.21.15.50:0/2387377269 >> 172.21.15.50:0/2387377269 conn(0x7fafa006a390 msgr2=0x7fafa006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 -- 172.21.15.50:0/2387377269 shutdown_connections 2024-09-13T15:09:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.683+0000 7fafa6800700 1 -- 172.21.15.50:0/2387377269 wait complete. 2024-09-13T15:09:25.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.687+0000 7fafa6800700 1 Processor -- start 2024-09-13T15:09:25.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.687+0000 7fafa6800700 1 -- start start 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 0x7fafa014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa00b30d0 0x7fafa01390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafa01f5f70 0x7fafa01f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa014ea40 con 0x7fafa006d070 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa014f410 con 0x7fafa01f5f70 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa01f6ae0 con 0x7fafa00b30d0 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 0x7fafa014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 0x7fafa014eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60370/0 (socket says 172.21.15.50:60370) 2024-09-13T15:09:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 -- 172.21.15.50:0/70078550 learned_addr learned my addr 172.21.15.50:0/70078550 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa4a00700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa00b30d0 0x7fafa01390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5e00700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafa01f5f70 0x7fafa01f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 -- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa00b30d0 msgr2=0x7fafa01390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa00b30d0 0x7fafa01390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 -- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafa01f5f70 msgr2=0x7fafa01f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafa01f5f70 0x7fafa01f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 -- 172.21.15.50:0/70078550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009a70 con 0x7fafa006d070 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa5400700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 0x7fafa014eed0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faf94015040 tx=0x7faf94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94004340 con 0x7fafa006d070 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940044e0 con 0x7fafa006d070 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa014e3f0 con 0x7fafa006d070 2024-09-13T15:09:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94004890 con 0x7fafa006d070 2024-09-13T15:09:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.691+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa01f6dc0 con 0x7fafa006d070 2024-09-13T15:09:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.695+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa014e250 con 0x7fafa006d070 2024-09-13T15:09:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.695+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf9401c460 con 0x7fafa006d070 2024-09-13T15:09:25.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.695+0000 7faf9d600700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf80066730 0x7faf80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:25.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.695+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf94085900 con 0x7fafa006d070 2024-09-13T15:09:25.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.699+0000 7fafa4a00700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf80066730 0x7faf80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:25.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.699+0000 7fafa4a00700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf80066730 0x7faf80068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafa00ccf00 tx=0x7faf8c001e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:25.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.699+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafa014e250 con 0x7fafa006d070 2024-09-13T15:09:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.879+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafa014e250 con 0x7fafa006d070 2024-09-13T15:09:25.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7faf9d600700 1 -- 172.21.15.50:0/70078550 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf94020020 con 0x7fafa006d070 2024-09-13T15:09:25.887 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf80066730 msgr2=0x7faf80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf80066730 0x7faf80068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafa00ccf00 tx=0x7faf8c001e40 comp rx=0 tx=0).stop 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 msgr2=0x7fafa014eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 0x7fafa014eed0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faf94015040 tx=0x7faf94004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 shutdown_connections 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faf80066730 0x7faf80068bf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fafa01f5f70 0x7fafa01f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fafa00b30d0 0x7fafa01390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 --2- 172.21.15.50:0/70078550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa006d070 0x7fafa014eed0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.883+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 >> 172.21.15.50:0/70078550 conn(0x7fafa006a390 msgr2=0x7fafa0157460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.887+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 shutdown_connections 2024-09-13T15:09:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:25.887+0000 7fafa6800700 1 -- 172.21.15.50:0/70078550 wait complete. 2024-09-13T15:09:25.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:09:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.103+0000 7f3731800700 1 Processor -- start 2024-09-13T15:09:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.103+0000 7f3731800700 1 -- start start 2024-09-13T15:09:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f3731800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f372c15ec90 0x7f372c165480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f3731800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c1659c0 con 0x7f372c06b7b0 2024-09-13T15:09:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f3731800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c161600 con 0x7f372c0667a0 2024-09-13T15:09:26.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f3731800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c162280 con 0x7f372c15ec90 2024-09-13T15:09:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f372c06b7b0 0x7f372c066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58138/0 (socket says 172.21.15.50:58138) 2024-09-13T15:09:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372b400700 1 -- 172.21.15.50:0/1562708629 learned_addr learned my addr 172.21.15.50:0/1562708629 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372be00700 1 --2- 172.21.15.50:0/1562708629 >> v2:172.21.15.181:3300/0 conn(0x7f372c15ec90 0x7f372c165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734444326 0 0) 0x7f372c1659c0 con 0x7f372c06b7b0 2024-09-13T15:09:26.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37100035d0 con 0x7f372c06b7b0 2024-09-13T15:09:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454785142 0 0) 0x7f372c161600 con 0x7f372c0667a0 2024-09-13T15:09:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c1659c0 con 0x7f372c0667a0 2024-09-13T15:09:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372be00700 1 -- 172.21.15.50:0/1562708629 >> v1:172.21.15.181:6789/0 conn(0x7f372c0667a0 legacy=0x7f372c1626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372be00700 1 -- 172.21.15.50:0/1562708629 >> v1:172.21.15.50:6789/0 conn(0x7f372c06b7b0 legacy=0x7f372c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372be00700 1 -- 172.21.15.50:0/1562708629 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c1618e0 con 0x7f372c15ec90 2024-09-13T15:09:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.107+0000 7f372be00700 1 --2- 172.21.15.50:0/1562708629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c165480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f371c009850 tx=0x7f371c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e46d42f3f0f6e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c011830 con 0x7f372c15ec90 2024-09-13T15:09:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c011990 con 0x7f372c15ec90 2024-09-13T15:09:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f372aa00700 1 -- 172.21.15.50:0/1562708629 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c011d00 con 0x7f372c15ec90 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 -- 172.21.15.50:0/1562708629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 msgr2=0x7f372c165480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 --2- 172.21.15.50:0/1562708629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c165480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f371c009850 tx=0x7f371c009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 -- 172.21.15.50:0/1562708629 shutdown_connections 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 --2- 172.21.15.50:0/1562708629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c165480 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 -- 172.21.15.50:0/1562708629 >> 172.21.15.50:0/1562708629 conn(0x7f372c070d10 msgr2=0x7f372c0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 -- 172.21.15.50:0/1562708629 shutdown_connections 2024-09-13T15:09:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.111+0000 7f3731800700 1 -- 172.21.15.50:0/1562708629 wait complete. 2024-09-13T15:09:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.115+0000 7f3731800700 1 Processor -- start 2024-09-13T15:09:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.115+0000 7f3731800700 1 -- start start 2024-09-13T15:09:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.115+0000 7f3731800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 0x7f372c0cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.115+0000 7f3731800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f372c06b7b0 0x7f372c0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c0c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0cb330 con 0x7f372c0667a0 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0cac90 con 0x7f372c15ec90 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0c5550 con 0x7f372c06b7b0 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 0x7f372c0cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 0x7f372c0cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60386/0 (socket says 172.21.15.50:60386) 2024-09-13T15:09:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 -- 172.21.15.50:0/1291266893 learned_addr learned my addr 172.21.15.50:0/1291266893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372b400700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f372c06b7b0 0x7f372c0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3730e00700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c0c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 -- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f372c06b7b0 msgr2=0x7f372c0ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f372c06b7b0 0x7f372c0ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 -- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 msgr2=0x7f372c0c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c0c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 -- 172.21.15.50:0/1291266893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0094b0 con 0x7f372c0667a0 2024-09-13T15:09:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f372be00700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 0x7f372c0cb750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f371c009ba0 tx=0x7f371c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c004550 con 0x7f372c0667a0 2024-09-13T15:09:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c01e070 con 0x7f372c0667a0 2024-09-13T15:09:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c003900 con 0x7f372c0667a0 2024-09-13T15:09:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c0c5830 con 0x7f372c0667a0 2024-09-13T15:09:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c0cbc90 con 0x7f372c0667a0 2024-09-13T15:09:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.119+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0cb470 con 0x7f372c0667a0 2024-09-13T15:09:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.123+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f371c003a60 con 0x7f372c0667a0 2024-09-13T15:09:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.123+0000 7f3723e00700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f370c066730 0x7f370c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.127+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f371c085120 con 0x7f372c0667a0 2024-09-13T15:09:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.127+0000 7f372b400700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f370c066730 0x7f370c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.127+0000 7f372b400700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f370c066730 0x7f370c068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f372c1f4f10 tx=0x7f3718009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.131+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f371c0522a0 con 0x7f372c0667a0 2024-09-13T15:09:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.311+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f372c162850 con 0x7f372c0667a0 2024-09-13T15:09:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.311+0000 7f3723e00700 1 -- 172.21.15.50:0/1291266893 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f371c0558c0 con 0x7f372c0667a0 2024-09-13T15:09:26.317 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f370c066730 msgr2=0x7f370c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f370c066730 0x7f370c068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f372c1f4f10 tx=0x7f3718009040 comp rx=0 tx=0).stop 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 msgr2=0x7f372c0cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 0x7f372c0cb750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f371c009ba0 tx=0x7f371c004770 comp rx=0 tx=0).stop 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 shutdown_connections 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f370c066730 0x7f370c068bf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f372c15ec90 0x7f372c0c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f372c06b7b0 0x7f372c0ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 --2- 172.21.15.50:0/1291266893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f372c0667a0 0x7f372c0cb750 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 >> 172.21.15.50:0/1291266893 conn(0x7f372c070d10 msgr2=0x7f372c1633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 shutdown_connections 2024-09-13T15:09:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.319+0000 7f3731800700 1 -- 172.21.15.50:0/1291266893 wait complete. 2024-09-13T15:09:26.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:09:26.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.519+0000 7f9788800700 1 Processor -- start 2024-09-13T15:09:26.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.519+0000 7f9788800700 1 -- start start 2024-09-13T15:09:26.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9788800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f978006a5d0 0x7f9780071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9788800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f978006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9788800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800ce140 con 0x7f97800cd610 2024-09-13T15:09:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9788800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978006aef0 con 0x7f978006a5d0 2024-09-13T15:09:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9788800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800b1e30 con 0x7f97800b19f0 2024-09-13T15:09:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f978006a5d0 0x7f9780071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f978006a5d0 0x7f9780071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60388/0 (socket says 172.21.15.50:60388) 2024-09-13T15:09:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 -- 172.21.15.50:0/2532766378 learned_addr learned my addr 172.21.15.50:0/2532766378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785400700 1 --2- 172.21.15.50:0/2532766378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f978006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 -- 172.21.15.50:0/2532766378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 msgr2=0x7f978006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:26.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 --2- 172.21.15.50:0/2532766378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f978006a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 -- 172.21.15.50:0/2532766378 >> v1:172.21.15.50:6789/0 conn(0x7f97800cd610 legacy=0x7f978006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 -- 172.21.15.50:0/2532766378 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800cde60 con 0x7f978006a5d0 2024-09-13T15:09:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9785e00700 1 --2- 172.21.15.50:0/2532766378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f978006a5d0 0x7f9780071d20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9774009910 tx=0x7f9774009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d91a489738acf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9784a00700 1 -- 172.21.15.50:0/2532766378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400ba60 con 0x7f978006a5d0 2024-09-13T15:09:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9784a00700 1 -- 172.21.15.50:0/2532766378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400bbc0 con 0x7f978006a5d0 2024-09-13T15:09:26.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.523+0000 7f9784a00700 1 -- 172.21.15.50:0/2532766378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774009e60 con 0x7f978006a5d0 2024-09-13T15:09:26.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 -- 172.21.15.50:0/2532766378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f978006a5d0 msgr2=0x7f9780071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 --2- 172.21.15.50:0/2532766378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f978006a5d0 0x7f9780071d20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9774009910 tx=0x7f9774009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 -- 172.21.15.50:0/2532766378 shutdown_connections 2024-09-13T15:09:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 --2- 172.21.15.50:0/2532766378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f978006a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 --2- 172.21.15.50:0/2532766378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f978006a5d0 0x7f9780071d20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 -- 172.21.15.50:0/2532766378 >> 172.21.15.50:0/2532766378 conn(0x7f97800b08d0 msgr2=0x7f97800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 -- 172.21.15.50:0/2532766378 shutdown_connections 2024-09-13T15:09:26.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 -- 172.21.15.50:0/2532766378 wait complete. 2024-09-13T15:09:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.527+0000 7f9788800700 1 Processor -- start 2024-09-13T15:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 -- start start 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978006a5d0 0x7f97801481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f97801400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 0x7f9780140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97801610b0 con 0x7f97800cd610 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780140f90 con 0x7f978006a5d0 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9780144980 con 0x7f97800b19f0 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 0x7f9780140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 0x7f9780140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60402/0 (socket says 172.21.15.50:60402) 2024-09-13T15:09:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 -- 172.21.15.50:0/104356416 learned_addr learned my addr 172.21.15.50:0/104356416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9785e00700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978006a5d0 0x7f97801481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9785400700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f97801400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 -- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 msgr2=0x7f97801400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f97801400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 -- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978006a5d0 msgr2=0x7f97801481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978006a5d0 0x7f97801481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 -- 172.21.15.50:0/104356416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009570 con 0x7f97800cd610 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9786800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 0x7f9780140610 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f977c00cb50 tx=0x7f977c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c003c20 con 0x7f97800cd610 2024-09-13T15:09:26.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c003d80 con 0x7f97800cd610 2024-09-13T15:09:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00ab10 con 0x7f97800cd610 2024-09-13T15:09:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.531+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97801486f0 con 0x7f97800cd610 2024-09-13T15:09:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.535+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9780144090 con 0x7f97800cd610 2024-09-13T15:09:26.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.535+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97800cda80 con 0x7f97800cd610 2024-09-13T15:09:26.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.535+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f977c00ac70 con 0x7f97800cd610 2024-09-13T15:09:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.539+0000 7f977a000700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9764066730 0x7f9764068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.539+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f977c084340 con 0x7f97800cd610 2024-09-13T15:09:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.539+0000 7f9785e00700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9764066730 0x7f9764068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.539+0000 7f9785e00700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9764066730 0x7f9764068bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9774000c00 tx=0x7f9774008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.543+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f977c051560 con 0x7f97800cd610 2024-09-13T15:09:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.747+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9780144ac0 con 0x7f97800cd610 2024-09-13T15:09:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.747+0000 7f977a000700 1 -- 172.21.15.50:0/104356416 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f977c054b80 con 0x7f97800cd610 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9764066730 msgr2=0x7f9764068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9764066730 0x7f9764068bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9774000c00 tx=0x7f9774008030 comp rx=0 tx=0).stop 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 msgr2=0x7f9780140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 0x7f9780140610 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f977c00cb50 tx=0x7f977c00cf10 comp rx=0 tx=0).stop 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 shutdown_connections 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9764066730 0x7f9764068bf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97800cd610 0x7f9780140610 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97800b19f0 0x7f97801400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 --2- 172.21.15.50:0/104356416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f978006a5d0 0x7f97801481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:26.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 >> 172.21.15.50:0/104356416 conn(0x7f97800b08d0 msgr2=0x7f97800cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 shutdown_connections 2024-09-13T15:09:26.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:26.751+0000 7f9788800700 1 -- 172.21.15.50:0/104356416 wait complete. 2024-09-13T15:09:26.758 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:09:26.778 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:09:26.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:26.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:26.819 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:09:26.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:26.819 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:09:26.880 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-13T15:09:27.064 INFO:teuthology.orchestra.run.smithi181.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":81,"msgr_send_messages":69,"msgr_recv_bytes":117168,"msgr_send_bytes":20145,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.020345056,"msgr_running_send_time":0.005353737,"msgr_running_recv_time":0.015433614,"msgr_running_fast_dispatch_time":0.000763986,"msgr_send_messages_queue_lat":{"avgcount":69,"sum":0.072812083,"avgtime":0.001055247},"msgr_handle_ack_lat":{"avgcount":13,"sum":0.000004564,"avgtime":0.000000351},"msgr_recv_encrypted_bytes":110544,"msgr_send_encrypted_bytes":12304},"AsyncMessenger::Worker-1":{"msgr_recv_messages":11,"msgr_send_messages":19,"msgr_recv_bytes":2872,"msgr_send_bytes":99448,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008779346,"msgr_running_send_time":0.001323990,"msgr_running_recv_time":0.006557314,"msgr_running_fast_dispatch_time":0.000444261,"msgr_send_messages_queue_lat":{"avgcount":17,"sum":0.127667825,"avgtime":0.007509872},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":94864},"AsyncMessenger::Worker-2":{"msgr_recv_messages":62,"msgr_send_messages":58,"msgr_recv_bytes":17095,"msgr_send_bytes":52180,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.019729951,"msgr_running_send_time":0.003977596,"msgr_running_recv_time":0.014486906,"msgr_running_fast_dispatch_time":0.001250289,"msgr_send_messages_queue_lat":{"avgcount":56,"sum":0.148949641,"avgtime":0.002659815},"msgr_handle_ack_lat":{"avgcount":64,"sum":0.000021114,"avgtime":0.000000329},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":50,"sum":0.005548453,"avgtime":0.000110969}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000023469,"avgtime":0.000011734}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.009387231,"avgtime":0.000323697},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":57,"traverse_hit":57,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197383,"rdpos":0,"jlat":{"avgcount":7,"sum":0.027359212,"avgtime":0.003908458},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":46012,"heap":207224},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":9,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":28,"sum":0.008813317,"avgtime":0.000314761},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000573914,"avgtime":0.000573914},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":26,"average_load":26,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":233203,"buffer_anon_items":86,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5520,"osdmap_items":78,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52088,"mds_co_items":212,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":14289,"op_resend":30,"op_reply":46,"op_latency":{"avgcount":46,"sum":1.039977664,"avgtime":0.022608210},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":70},"op":46,"op_r":0,"op_w":46,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":41,"map_full":0,"map_inc":3,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":150,"get_sum":119516,"get_or_fail_fail":0,"get_or_fail_success":150,"take":0,"take_sum":0,"put":150,"put_sum":119516,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":14289,"put":46,"put_sum":14289,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b85f372d20":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":3079,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":7,"put_sum":3079,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T15:09:27.065 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 13, "avgtime": 3.51e-07, "sum": 4.564e-06 }, "msgr_recv_bytes": 117168, "msgr_recv_encrypted_bytes": 110544, "msgr_recv_messages": 81, "msgr_running_fast_dispatch_time": 0.000763986, "msgr_running_recv_time": 0.015433614, "msgr_running_send_time": 0.005353737, "msgr_running_total_time": 0.020345056, "msgr_send_bytes": 20145, "msgr_send_encrypted_bytes": 12304, "msgr_send_messages": 69, "msgr_send_messages_queue_lat": { "avgcount": 69, "avgtime": 0.001055247, "sum": 0.072812083 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 2872, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 11, "msgr_running_fast_dispatch_time": 0.000444261, "msgr_running_recv_time": 0.006557314, "msgr_running_send_time": 0.00132399, "msgr_running_total_time": 0.008779346, "msgr_send_bytes": 99448, "msgr_send_encrypted_bytes": 94864, "msgr_send_messages": 19, "msgr_send_messages_queue_lat": { "avgcount": 17, "avgtime": 0.007509872, "sum": 0.127667825 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 64, "avgtime": 3.29e-07, "sum": 2.1114e-05 }, "msgr_recv_bytes": 17095, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 62, "msgr_running_fast_dispatch_time": 0.001250289, "msgr_running_recv_time": 0.014486906, "msgr_running_send_time": 0.003977596, "msgr_running_total_time": 0.019729951, "msgr_send_bytes": 52180, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 58, "msgr_send_messages_queue_lat": { "avgcount": 56, "avgtime": 0.002659815, "sum": 0.148949641 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 50, "avgtime": 0.000110969, "sum": 0.005548453 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.1734e-05, "sum": 2.3469e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000323697, "sum": 0.009387231 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 57, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 57, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.003908458, "sum": 0.027359212 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197383 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207224, "ino": 13, "ino+": 13, "ino-": 0, "rss": 46012 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 9, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 28, "avgtime": 0.000314761, "sum": 0.008813317 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000573914, "sum": 0.000573914 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 26, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 26 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 233203, "buffer_anon_items": 86, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52088, "mds_co_items": 212, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5520, "osdmap_items": 78, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 41, "map_full": 0, "map_inc": 3, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.02260821, "sum": 1.039977664 }, "op_pg": 0, "op_r": 0, "op_reply": 46, "op_resend": 30, "op_rmw": 0, "op_send": 46, "op_send_bytes": 14289, "op_w": 46, "oplen_avg": { "avgcount": 46, "sum": 70 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 150, "get_or_fail_fail": 0, "get_or_fail_success": 150, "get_started": 0, "get_sum": 119516, "max": 104857600, "put": 150, "put_sum": 119516, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 14289, "take": 46, "take_sum": 14289, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b85f372d20": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 3079, "max": 3758096384, "put": 7, "put_sum": 3079, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T15:09:27.066 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T15:09:27.066 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:09:27.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:09:27.110 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:09:27.152 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:09:27.152 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:27.153 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:27.172 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:09:27.172 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:27.172 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:27.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:09:27.218 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:27.218 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:27.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:09:27.238 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:27.238 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:27.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:09:27.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.455+0000 7f8021400700 1 Processor -- start 2024-09-13T15:09:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.455+0000 7f8021400700 1 -- start start 2024-09-13T15:09:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8021400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0cd430 0x7f801c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8021400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f801c0b2a80 0x7f801c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8021400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c0d1800 con 0x7f801c15e070 2024-09-13T15:09:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8021400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c0b2ef0 con 0x7f801c0b2a80 2024-09-13T15:09:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8021400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c15e450 con 0x7f801c0cd430 2024-09-13T15:09:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f801be00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f801c15e070 0x7f801c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:51424/0 (socket says 172.21.15.50:51424) 2024-09-13T15:09:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f801be00700 1 -- 172.21.15.50:0/4278426730 learned_addr learned my addr 172.21.15.50:0/4278426730 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8020a00700 1 --2- 172.21.15.50:0/4278426730 >> v2:172.21.15.181:3300/0 conn(0x7f801c0b2a80 0x7f801c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f801b400700 1 --2- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0cd430 0x7f801c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8020a00700 1 -- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0cd430 msgr2=0x7f801c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8020a00700 1 --2- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0cd430 0x7f801c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8020a00700 1 -- 172.21.15.50:0/4278426730 >> v1:172.21.15.181:6789/0 conn(0x7f801c15e070 legacy=0x7f801c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8020a00700 1 -- 172.21.15.50:0/4278426730 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0d0050 con 0x7f801c0b2a80 2024-09-13T15:09:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.459+0000 7f8020a00700 1 --2- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0b2a80 0x7f801c0b38b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2a19513f2016a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f801aa00700 1 -- 172.21.15.50:0/4278426730 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400e070 con 0x7f801c0b2a80 2024-09-13T15:09:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f801aa00700 1 -- 172.21.15.50:0/4278426730 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801400bb20 con 0x7f801c0b2a80 2024-09-13T15:09:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f801aa00700 1 -- 172.21.15.50:0/4278426730 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014012430 con 0x7f801c0b2a80 2024-09-13T15:09:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 -- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0b2a80 msgr2=0x7f801c0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 --2- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0b2a80 0x7f801c0b38b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801400b330 comp rx=0 tx=0).stop 2024-09-13T15:09:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 -- 172.21.15.50:0/4278426730 shutdown_connections 2024-09-13T15:09:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 --2- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0b2a80 0x7f801c0b38b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 --2- 172.21.15.50:0/4278426730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0cd430 0x7f801c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 -- 172.21.15.50:0/4278426730 >> 172.21.15.50:0/4278426730 conn(0x7f801c071f00 msgr2=0x7f801c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 -- 172.21.15.50:0/4278426730 shutdown_connections 2024-09-13T15:09:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.463+0000 7f8021400700 1 -- 172.21.15.50:0/4278426730 wait complete. 2024-09-13T15:09:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 Processor -- start 2024-09-13T15:09:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 -- start start 2024-09-13T15:09:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 0x7f801c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0cd430 0x7f801c0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f801c15e070 0x7f801c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0c7430 con 0x7f801c15e070 2024-09-13T15:09:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1592d0 con 0x7f801c0cd430 2024-09-13T15:09:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.467+0000 7f8021400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0b5520 con 0x7f801c0b2a80 2024-09-13T15:09:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 0x7f801c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801b400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0cd430 0x7f801c0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8020a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f801c15e070 0x7f801c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 0x7f801c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36384/0 (socket says 172.21.15.50:36384) 2024-09-13T15:09:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 -- 172.21.15.50:0/3312872486 learned_addr learned my addr 172.21.15.50:0/3312872486 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 -- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0cd430 msgr2=0x7f801c0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0cd430 0x7f801c0c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 -- 172.21.15.50:0/3312872486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f801c15e070 msgr2=0x7f801c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f801c15e070 0x7f801c157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 -- 172.21.15.50:0/3312872486 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014009a70 con 0x7f801c0b2a80 2024-09-13T15:09:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801b400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0cd430 0x7f801c0c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8020a00700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f801c15e070 0x7f801c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f801be00700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 0x7f801c0b5f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f800c001eb0 tx=0x7f800c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c005d90 con 0x7f801c0b2a80 2024-09-13T15:09:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c0070d0 con 0x7f801c0b2a80 2024-09-13T15:09:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c007440 con 0x7f801c0b2a80 2024-09-13T15:09:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c0b2440 con 0x7f801c0b2a80 2024-09-13T15:09:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.471+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c0b5770 con 0x7f801c0b2a80 2024-09-13T15:09:27.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.475+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c0c7830 con 0x7f801c0b2a80 2024-09-13T15:09:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.475+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f800c0075a0 con 0x7f801c0b2a80 2024-09-13T15:09:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.479+0000 7f8013e00700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ffc066730 0x7f7ffc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.479+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f800c083af0 con 0x7f801c0b2a80 2024-09-13T15:09:27.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.479+0000 7f801b400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ffc066730 0x7f7ffc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.479+0000 7f801b400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ffc066730 0x7f7ffc068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f801c1596f0 tx=0x7f8008009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:27.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.483+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f800c050d90 con 0x7f801c0b2a80 2024-09-13T15:09:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.715+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f801c0cd880 con 0x7f801c0b2a80 2024-09-13T15:09:27.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.715+0000 7f8013e00700 1 -- 172.21.15.50:0/3312872486 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f800c017090 con 0x7f801c0b2a80 2024-09-13T15:09:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:27.721 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ffc066730 msgr2=0x7f7ffc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ffc066730 0x7f7ffc068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f801c1596f0 tx=0x7f8008009240 comp rx=0 tx=0).stop 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 msgr2=0x7f801c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 0x7f801c0b5f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f800c001eb0 tx=0x7f800c00c7b0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 shutdown_connections 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ffc066730 0x7f7ffc068bf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f801c15e070 0x7f801c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c0cd430 0x7f801c0c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 --2- 172.21.15.50:0/3312872486 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f801c0b2a80 0x7f801c0b5f70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 >> 172.21.15.50:0/3312872486 conn(0x7f801c071f00 msgr2=0x7f801c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 shutdown_connections 2024-09-13T15:09:27.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.719+0000 7f8021400700 1 -- 172.21.15.50:0/3312872486 wait complete. 2024-09-13T15:09:27.727 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:27.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.915+0000 7fe2e7e00700 1 Processor -- start 2024-09-13T15:09:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.915+0000 7fe2e7e00700 1 -- start start 2024-09-13T15:09:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e7e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe2e806aaa0 0x7fe2e806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e7e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e80b3560 con 0x7fe2e81610b0 2024-09-13T15:09:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e7e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e80b3280 con 0x7fe2e80b2670 2024-09-13T15:09:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e7e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e8070b30 con 0x7fe2e806aaa0 2024-09-13T15:09:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2e81610b0 0x7fe2e80719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58162/0 (socket says 172.21.15.50:58162) 2024-09-13T15:09:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6a00700 1 -- 172.21.15.50:0/4203591065 learned_addr learned my addr 172.21.15.50:0/4203591065 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2de000700 1 --2- 172.21.15.50:0/4203591065 >> v2:172.21.15.181:3300/0 conn(0x7fe2e806aaa0 0x7fe2e806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702736704 0 0) 0x7fe2e80b3560 con 0x7fe2e81610b0 2024-09-13T15:09:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2cc0035d0 con 0x7fe2e81610b0 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3416313513 0 0) 0x7fe2cc0035d0 con 0x7fe2e81610b0 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 >> v2:172.21.15.181:3300/0 conn(0x7fe2e806aaa0 msgr2=0x7fe2e806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 --2- 172.21.15.50:0/4203591065 >> v2:172.21.15.181:3300/0 conn(0x7fe2e806aaa0 0x7fe2e806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 >> v1:172.21.15.181:6789/0 conn(0x7fe2e80b2670 legacy=0x7fe2e80b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8070ee0 con 0x7fe2e81610b0 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fe2d8001670 con 0x7fe2e81610b0 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 >> v1:172.21.15.50:6789/0 conn(0x7fe2e81610b0 legacy=0x7fe2e80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2cc003ac0 0x7fe2cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc004870 0x7fe2cc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2cc005230 0x7fe2cc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8070b30 con 0x7fe2cc005230 2024-09-13T15:09:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc00c180 con 0x7fe2cc004870 2024-09-13T15:09:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc00c340 con 0x7fe2cc003ac0 2024-09-13T15:09:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e7400700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2cc005230 0x7fe2cc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2e6a00700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2cc003ac0 0x7fe2cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.919+0000 7fe2de000700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc004870 0x7fe2cc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 -- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2cc003ac0 msgr2=0x7fe2cc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2cc003ac0 0x7fe2cc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 -- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc004870 msgr2=0x7fe2cc004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc004870 0x7fe2cc004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 -- 172.21.15.50:0/4203591065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0035d0 con 0x7fe2cc005230 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e6a00700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2cc003ac0 0x7fe2cc003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 -- 172.21.15.50:0/4203591065 reap_dead start 2024-09-13T15:09:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7400700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2cc005230 0x7fe2cc00ba30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c290 tx=0x7fe2cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6df14778410fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0001e70 con 0x7fe2cc005230 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000ce70 con 0x7fe2cc005230 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e6000700 1 -- 172.21.15.50:0/4203591065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0003c40 con 0x7fe2cc005230 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 -- 172.21.15.50:0/4203591065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2cc005230 msgr2=0x7fe2cc00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2cc005230 0x7fe2cc00ba30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c290 tx=0x7fe2cc0058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 -- 172.21.15.50:0/4203591065 shutdown_connections 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/4203591065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2cc005230 0x7fe2cc00ba30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 -- 172.21.15.50:0/4203591065 >> 172.21.15.50:0/4203591065 conn(0x7fe2e80b0c40 msgr2=0x7fe2e806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 -- 172.21.15.50:0/4203591065 shutdown_connections 2024-09-13T15:09:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.923+0000 7fe2e7e00700 1 -- 172.21.15.50:0/4203591065 wait complete. 2024-09-13T15:09:27.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 Processor -- start 2024-09-13T15:09:27.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 -- start start 2024-09-13T15:09:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc005230 0x7fe2e80afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 0x7fe2e81f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2e814c560 0x7fe2e814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e814fa90 con 0x7fe2e80ae580 2024-09-13T15:09:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80af690 con 0x7fe2cc005230 2024-09-13T15:09:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81f7e00 con 0x7fe2e814c560 2024-09-13T15:09:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2de000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 0x7fe2e81f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2de000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 0x7fe2e81f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60422/0 (socket says 172.21.15.50:60422) 2024-09-13T15:09:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2de000700 1 -- 172.21.15.50:0/2148869393 learned_addr learned my addr 172.21.15.50:0/2148869393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e6a00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc005230 0x7fe2e80afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.927+0000 7fe2e7400700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2e814c560 0x7fe2e814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2de000700 1 -- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2e814c560 msgr2=0x7fe2e814ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2de000700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2e814c560 0x7fe2e814ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2de000700 1 -- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc005230 msgr2=0x7fe2e80afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2de000700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc005230 0x7fe2e80afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2de000700 1 -- 172.21.15.50:0/2148869393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80aea80 con 0x7fe2e80ae580 2024-09-13T15:09:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2de000700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 0x7fe2e81f78c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00108f0 tx=0x7fe2d0010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0016670 con 0x7fe2e80ae580 2024-09-13T15:09:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d00167d0 con 0x7fe2e80ae580 2024-09-13T15:09:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0016b40 con 0x7fe2e80ae580 2024-09-13T15:09:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e80aed60 con 0x7fe2e80ae580 2024-09-13T15:09:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e80af320 con 0x7fe2e80ae580 2024-09-13T15:09:27.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.931+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e806cb70 con 0x7fe2e80ae580 2024-09-13T15:09:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.935+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2d0016ca0 con 0x7fe2e80ae580 2024-09-13T15:09:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.935+0000 7fe2df400700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2c4066730 0x7fe2c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.935+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2d00845c0 con 0x7fe2e80ae580 2024-09-13T15:09:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.935+0000 7fe2e6a00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2c4066730 0x7fe2c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.935+0000 7fe2e6a00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2c4066730 0x7fe2c4068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8001eb0 tx=0x7fe2d8007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:27.943+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2d00517c0 con 0x7fe2e80ae580 2024-09-13T15:09:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.135+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2e80af840 con 0x7fe2e80ae580 2024-09-13T15:09:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.139+0000 7fe2df400700 1 -- 172.21.15.50:0/2148869393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16754 (secure 0 0 0) 0x7fe2e80af840 con 0x7fe2e80ae580 2024-09-13T15:09:28.145 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:28.145 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:21.733922+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2c4066730 msgr2=0x7fe2c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2c4066730 0x7fe2c4068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8001eb0 tx=0x7fe2d8007040 comp rx=0 tx=0).stop 2024-09-13T15:09:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 msgr2=0x7fe2e81f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 0x7fe2e81f78c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00108f0 tx=0x7fe2d0010c00 comp rx=0 tx=0).stop 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 shutdown_connections 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2c4066730 0x7fe2c4068bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2e814c560 0x7fe2e814ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2e80ae580 0x7fe2e81f78c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 --2- 172.21.15.50:0/2148869393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2cc005230 0x7fe2e80afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 >> 172.21.15.50:0/2148869393 conn(0x7fe2e80b0c40 msgr2=0x7fe2e815f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 shutdown_connections 2024-09-13T15:09:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.143+0000 7fe2e7e00700 1 -- 172.21.15.50:0/2148869393 wait complete. 2024-09-13T15:09:28.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:06.006484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:07.097072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:28.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:28.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.359+0000 7f7dffe00700 1 Processor -- start 2024-09-13T15:09:28.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.359+0000 7f7dffe00700 1 -- start start 2024-09-13T15:09:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.359+0000 7f7dffe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e00161e00 0x7f7e000b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dffe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e000b2280 con 0x7f7e000b1980 2024-09-13T15:09:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dffe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e000b2560 con 0x7f7e0006c960 2024-09-13T15:09:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dffe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000b2840 con 0x7f7e00161e00 2024-09-13T15:09:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfe000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e00161e00 0x7f7e000b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfea00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7e0006c960 0x7f7e0006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:51444/0 (socket says 172.21.15.50:51444) 2024-09-13T15:09:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfea00700 1 -- 172.21.15.50:0/3138984202 learned_addr learned my addr 172.21.15.50:0/3138984202 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfe000700 1 -- 172.21.15.50:0/3138984202 >> v1:172.21.15.181:6789/0 conn(0x7f7e0006c960 legacy=0x7f7e0006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfe000700 1 -- 172.21.15.50:0/3138984202 >> v1:172.21.15.50:6789/0 conn(0x7f7e000b1980 legacy=0x7f7e00162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfd600700 1 -- 172.21.15.50:0/3138984202 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410455249 0 0) 0x7f7e000b2560 con 0x7f7e0006c960 2024-09-13T15:09:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfe000700 1 -- 172.21.15.50:0/3138984202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000b2b20 con 0x7f7e00161e00 2024-09-13T15:09:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfe000700 1 --2- 172.21.15.50:0/3138984202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e00161e00 0x7f7e000b3320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009850 tx=0x7f7dec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20c982a69858634 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfd600700 1 -- 172.21.15.50:0/3138984202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec004230 con 0x7f7e00161e00 2024-09-13T15:09:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfd600700 1 -- 172.21.15.50:0/3138984202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec004390 con 0x7f7e00161e00 2024-09-13T15:09:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.363+0000 7f7dfd600700 1 -- 172.21.15.50:0/3138984202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0036c0 con 0x7f7e00161e00 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 -- 172.21.15.50:0/3138984202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e00161e00 msgr2=0x7f7e000b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 --2- 172.21.15.50:0/3138984202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e00161e00 0x7f7e000b3320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009850 tx=0x7f7dec009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 -- 172.21.15.50:0/3138984202 shutdown_connections 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 --2- 172.21.15.50:0/3138984202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e00161e00 0x7f7e000b3320 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 -- 172.21.15.50:0/3138984202 >> 172.21.15.50:0/3138984202 conn(0x7f7e0006a390 msgr2=0x7f7e0006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 -- 172.21.15.50:0/3138984202 shutdown_connections 2024-09-13T15:09:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.367+0000 7f7dffe00700 1 -- 172.21.15.50:0/3138984202 wait complete. 2024-09-13T15:09:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 Processor -- start 2024-09-13T15:09:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 -- start start 2024-09-13T15:09:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 0x7f7e00147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e000b1980 0x7f7e00158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00161e00 0x7f7e0006fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001534c0 con 0x7f7e0006c960 2024-09-13T15:09:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00147fa0 con 0x7f7e00161e00 2024-09-13T15:09:28.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dffe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00153760 con 0x7f7e000b1980 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dfea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 0x7f7e00147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dfea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 0x7f7e00147a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60440/0 (socket says 172.21.15.50:60440) 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dfea00700 1 -- 172.21.15.50:0/4258995734 learned_addr learned my addr 172.21.15.50:0/4258995734 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dfe000700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e000b1980 0x7f7e00158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.371+0000 7f7dff400700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00161e00 0x7f7e0006fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dfea00700 1 -- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e000b1980 msgr2=0x7f7e00158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dfea00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e000b1980 0x7f7e00158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dfea00700 1 -- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00161e00 msgr2=0x7f7e0006fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dfea00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00161e00 0x7f7e0006fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dfea00700 1 -- 172.21.15.50:0/4258995734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0094b0 con 0x7f7e0006c960 2024-09-13T15:09:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dfea00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 0x7f7e00147a60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c550 tx=0x7f7df000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0004ca0 con 0x7f7e0006c960 2024-09-13T15:09:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0004e00 con 0x7f7e0006c960 2024-09-13T15:09:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e00153a40 con 0x7f7e0006c960 2024-09-13T15:09:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0007310 con 0x7f7e0006c960 2024-09-13T15:09:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e00154000 con 0x7f7e0006c960 2024-09-13T15:09:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.375+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e000b2560 con 0x7f7e0006c960 2024-09-13T15:09:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.379+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7df0007470 con 0x7f7e0006c960 2024-09-13T15:09:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.379+0000 7f7df7400700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7de0066730 0x7f7de0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.379+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7df0083f40 con 0x7f7e0006c960 2024-09-13T15:09:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.379+0000 7f7dfe000700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7de0066730 0x7f7de0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.383+0000 7f7dfe000700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7de0066730 0x7f7de0068bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009850 tx=0x7f7dec010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.387+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7df00510b0 con 0x7f7e0006c960 2024-09-13T15:09:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.571+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e000cdac0 con 0x7f7e0006c960 2024-09-13T15:09:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.575+0000 7f7df7400700 1 -- 172.21.15.50:0/4258995734 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7df0007720 con 0x7f7e0006c960 2024-09-13T15:09:28.579 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7de0066730 msgr2=0x7f7de0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7de0066730 0x7f7de0068bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009850 tx=0x7f7dec010000 comp rx=0 tx=0).stop 2024-09-13T15:09:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 msgr2=0x7f7e00147a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 0x7f7e00147a60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c550 tx=0x7f7df000c860 comp rx=0 tx=0).stop 2024-09-13T15:09:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 shutdown_connections 2024-09-13T15:09:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7de0066730 0x7f7de0068bf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e00161e00 0x7f7e0006fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7e000b1980 0x7f7e00158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 --2- 172.21.15.50:0/4258995734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e0006c960 0x7f7e00147a60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 >> 172.21.15.50:0/4258995734 conn(0x7f7e0006a390 msgr2=0x7f7e0006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 shutdown_connections 2024-09-13T15:09:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.579+0000 7f7dffe00700 1 -- 172.21.15.50:0/4258995734 wait complete. 2024-09-13T15:09:28.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:09:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.783+0000 7f4f33200700 1 Processor -- start 2024-09-13T15:09:28.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.783+0000 7f4f33200700 1 -- start start 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f33200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406cd80 0x7f4f340b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f33200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f3406ada0 0x7f4f3406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f33200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f34160680 con 0x7f4f3415ca20 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f33200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3406b770 con 0x7f4f3406ada0 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f33200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3415d670 con 0x7f4f3406cd80 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f32800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f3406ada0 0x7f4f3406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f31e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4f3415ca20 0x7f4f3415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:51460/0 (socket says 172.21.15.50:51460) 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f31e00700 1 -- 172.21.15.50:0/4267044546 learned_addr learned my addr 172.21.15.50:0/4267044546 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.787+0000 7f4f31400700 1 --2- 172.21.15.50:0/4267044546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406cd80 0x7f4f340b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f31400700 1 -- 172.21.15.50:0/4267044546 >> v2:172.21.15.50:3300/0 conn(0x7f4f3406ada0 msgr2=0x7f4f3406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f31400700 1 --2- 172.21.15.50:0/4267044546 >> v2:172.21.15.50:3300/0 conn(0x7f4f3406ada0 0x7f4f3406b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f31400700 1 -- 172.21.15.50:0/4267044546 >> v1:172.21.15.181:6789/0 conn(0x7f4f3415ca20 legacy=0x7f4f3415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f31400700 1 -- 172.21.15.50:0/4267044546 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3415d950 con 0x7f4f3406cd80 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f31400700 1 --2- 172.21.15.50:0/4267044546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406cd80 0x7f4f340b4310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009850 tx=0x7f4f20009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981ecfc93d3e9454 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f30a00700 1 -- 172.21.15.50:0/4267044546 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20011830 con 0x7f4f3406cd80 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f30a00700 1 -- 172.21.15.50:0/4267044546 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20011990 con 0x7f4f3406cd80 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f30a00700 1 -- 172.21.15.50:0/4267044546 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20011d40 con 0x7f4f3406cd80 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 -- 172.21.15.50:0/4267044546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406cd80 msgr2=0x7f4f340b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 --2- 172.21.15.50:0/4267044546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406cd80 0x7f4f340b4310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009850 tx=0x7f4f20009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 -- 172.21.15.50:0/4267044546 shutdown_connections 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 --2- 172.21.15.50:0/4267044546 >> v2:172.21.15.50:3300/0 conn(0x7f4f3406ada0 0x7f4f3406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 --2- 172.21.15.50:0/4267044546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406cd80 0x7f4f340b4310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 -- 172.21.15.50:0/4267044546 >> 172.21.15.50:0/4267044546 conn(0x7f4f34071d20 msgr2=0x7f4f34072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 -- 172.21.15.50:0/4267044546 shutdown_connections 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.791+0000 7f4f33200700 1 -- 172.21.15.50:0/4267044546 wait complete. 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 Processor -- start 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 -- start start 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406ada0 0x7f4f34150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3406cd80 0x7f4f341f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 0x7f4f340b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3415be70 con 0x7f4f3415ca20 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34153510 con 0x7f4f3406cd80 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f33200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f341f66d0 con 0x7f4f3406ada0 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 0x7f4f340b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 0x7f4f340b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60454/0 (socket says 172.21.15.50:60454) 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 -- 172.21.15.50:0/3627595389 learned_addr learned my addr 172.21.15.50:0/3627595389 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f31400700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3406cd80 0x7f4f341f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f31e00700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406ada0 0x7f4f34150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 -- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406ada0 msgr2=0x7f4f34150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406ada0 0x7f4f34150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 -- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3406cd80 msgr2=0x7f4f341f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3406cd80 0x7f4f341f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:28.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f32800700 1 -- 172.21.15.50:0/3627595389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200094b0 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.795+0000 7f4f31400700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3406cd80 0x7f4f341f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f32800700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 0x7f4f340b5000 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00efc0 tx=0x7f4f2c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c009ea0 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c00f040 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f341f69b0 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00ced0 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f34153a40 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.799+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f34153c30 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.803+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f2c014480 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.803+0000 7f4f2a000700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f14066730 0x7f4f14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.803+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f2c084b10 con 0x7f4f3415ca20 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.803+0000 7f4f31e00700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f14066730 0x7f4f14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:28.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.807+0000 7f4f31e00700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f14066730 0x7f4f14068bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f24000f60 tx=0x7f4f24007f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:28.811+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f2c051dc0 con 0x7f4f3415ca20 2024-09-13T15:09:29.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.003+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f3406d1c0 con 0x7f4f3415ca20 2024-09-13T15:09:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.003+0000 7f4f2a000700 1 -- 172.21.15.50:0/3627595389 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f2c018020 con 0x7f4f3415ca20 2024-09-13T15:09:29.008 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:09:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f14066730 msgr2=0x7f4f14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f14066730 0x7f4f14068bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f24000f60 tx=0x7f4f24007f30 comp rx=0 tx=0).stop 2024-09-13T15:09:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 msgr2=0x7f4f340b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 0x7f4f340b5000 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00efc0 tx=0x7f4f2c00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 shutdown_connections 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f14066730 0x7f4f14068bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f3415ca20 0x7f4f340b5000 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f3406cd80 0x7f4f341f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 --2- 172.21.15.50:0/3627595389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f3406ada0 0x7f4f34150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 >> 172.21.15.50:0/3627595389 conn(0x7f4f34071d20 msgr2=0x7f4f34151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 shutdown_connections 2024-09-13T15:09:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.007+0000 7f4f33200700 1 -- 172.21.15.50:0/3627595389 wait complete. 2024-09-13T15:09:29.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:09:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 Processor -- start 2024-09-13T15:09:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 -- start start 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f12901604a0 0x7f12900d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12900cfee0 0x7f12900ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12900cdb00 con 0x7f12900d38e0 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12900cdde0 con 0x7f12900cfee0 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.203+0000 7f1296400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12900ce0c0 con 0x7f12901604a0 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128ea00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f12900d38e0 0x7f12900cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58190/0 (socket says 172.21.15.50:58190) 2024-09-13T15:09:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128ea00700 1 -- 172.21.15.50:0/2106531461 learned_addr learned my addr 172.21.15.50:0/2106531461 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128fe00700 1 --2- 172.21.15.50:0/2106531461 >> v2:172.21.15.50:3300/0 conn(0x7f12900cfee0 0x7f12900ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128f400700 1 --2- 172.21.15.50:0/2106531461 >> v2:172.21.15.181:3300/0 conn(0x7f12901604a0 0x7f12900d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128e000700 1 -- 172.21.15.50:0/2106531461 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658111581 0 0) 0x7f12900cdb00 con 0x7f12900d38e0 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128e000700 1 -- 172.21.15.50:0/2106531461 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12740035d0 con 0x7f12900d38e0 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128fe00700 1 -- 172.21.15.50:0/2106531461 >> v2:172.21.15.181:3300/0 conn(0x7f12901604a0 msgr2=0x7f12900d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128e000700 1 -- 172.21.15.50:0/2106531461 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56393787 0 0) 0x7f12740035d0 con 0x7f12900d38e0 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128fe00700 1 --2- 172.21.15.50:0/2106531461 >> v2:172.21.15.181:3300/0 conn(0x7f12901604a0 0x7f12900d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128fe00700 1 -- 172.21.15.50:0/2106531461 >> v1:172.21.15.50:6789/0 conn(0x7f12900d38e0 legacy=0x7f12900cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128fe00700 1 -- 172.21.15.50:0/2106531461 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900ce3a0 con 0x7f12900cfee0 2024-09-13T15:09:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128fe00700 1 --2- 172.21.15.50:0/2106531461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12900cfee0 0x7f12900ce8c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f129006e220 tx=0x7f128800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d890e9dac19218f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128e000700 1 -- 172.21.15.50:0/2106531461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800e070 con 0x7f12900cfee0 2024-09-13T15:09:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128e000700 1 -- 172.21.15.50:0/2106531461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288003a40 con 0x7f12900cfee0 2024-09-13T15:09:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f128e000700 1 -- 172.21.15.50:0/2106531461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c001670 con 0x7f12900cfee0 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 -- 172.21.15.50:0/2106531461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12900cfee0 msgr2=0x7f12900ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 --2- 172.21.15.50:0/2106531461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12900cfee0 0x7f12900ce8c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f129006e220 tx=0x7f128800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 -- 172.21.15.50:0/2106531461 shutdown_connections 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 --2- 172.21.15.50:0/2106531461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12900cfee0 0x7f12900ce8c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 --2- 172.21.15.50:0/2106531461 >> v2:172.21.15.181:3300/0 conn(0x7f12901604a0 0x7f12900d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 -- 172.21.15.50:0/2106531461 >> 172.21.15.50:0/2106531461 conn(0x7f12900d2dc0 msgr2=0x7f12900d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.207+0000 7f1296400700 1 -- 172.21.15.50:0/2106531461 shutdown_connections 2024-09-13T15:09:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.211+0000 7f1296400700 1 -- 172.21.15.50:0/2106531461 wait complete. 2024-09-13T15:09:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.211+0000 7f1296400700 1 Processor -- start 2024-09-13T15:09:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.211+0000 7f1296400700 1 -- start start 2024-09-13T15:09:29.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12900cfee0 0x7f12901512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12900d38e0 0x7f12900ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 0x7f129006c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12901517f0 con 0x7f12901604a0 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129009ce90 con 0x7f12900d38e0 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129009d170 con 0x7f12900cfee0 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 0x7f129006c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 0x7f129006c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60474/0 (socket says 172.21.15.50:60474) 2024-09-13T15:09:29.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 -- 172.21.15.50:0/1004724117 learned_addr learned my addr 172.21.15.50:0/1004724117 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128ea00700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12900d38e0 0x7f12900ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128f400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12900cfee0 0x7f12901512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 -- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12900cfee0 msgr2=0x7f12901512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12900cfee0 0x7f12901512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 -- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12900d38e0 msgr2=0x7f12900ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12900d38e0 0x7f12900ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 -- 172.21.15.50:0/1004724117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009a70 con 0x7f12901604a0 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f128fe00700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 0x7f129006c090 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f128800b370 tx=0x7f1288004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288004540 con 0x7f12901604a0 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12880046e0 con 0x7f12901604a0 2024-09-13T15:09:29.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129009d450 con 0x7f12901604a0 2024-09-13T15:09:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288012430 con 0x7f12901604a0 2024-09-13T15:09:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.215+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129009da10 con 0x7f12901604a0 2024-09-13T15:09:29.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.219+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129008cb20 con 0x7f12901604a0 2024-09-13T15:09:29.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.219+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1288012590 con 0x7f12901604a0 2024-09-13T15:09:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.219+0000 7f1287400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1270066730 0x7f1270068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.223+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1288085e80 con 0x7f12901604a0 2024-09-13T15:09:29.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.223+0000 7f128f400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1270066730 0x7f1270068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.223+0000 7f128f400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1270066730 0x7f1270068bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1280009bf0 tx=0x7f1280009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:29.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.227+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1288053080 con 0x7f12901604a0 2024-09-13T15:09:29.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.411+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12900d16e0 con 0x7f12901604a0 2024-09-13T15:09:29.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1287400700 1 -- 172.21.15.50:0/1004724117 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12880566a0 con 0x7f12901604a0 2024-09-13T15:09:29.419 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1270066730 msgr2=0x7f1270068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1270066730 0x7f1270068bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1280009bf0 tx=0x7f1280009240 comp rx=0 tx=0).stop 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 msgr2=0x7f129006c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 0x7f129006c090 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f128800b370 tx=0x7f1288004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 shutdown_connections 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1270066730 0x7f1270068bf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12901604a0 0x7f129006c090 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12900d38e0 0x7f12900ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 --2- 172.21.15.50:0/1004724117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12900cfee0 0x7f12901512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 >> 172.21.15.50:0/1004724117 conn(0x7f12900d2dc0 msgr2=0x7f12900cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 shutdown_connections 2024-09-13T15:09:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.415+0000 7f1296400700 1 -- 172.21.15.50:0/1004724117 wait complete. 2024-09-13T15:09:29.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:29.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.623+0000 7fefd6c00700 1 Processor -- start 2024-09-13T15:09:29.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.623+0000 7fefd6c00700 1 -- start start 2024-09-13T15:09:29.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd00b2d80 0x7fefd006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00b3560 con 0x7fefd006aaa0 2024-09-13T15:09:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00b3280 con 0x7fefd01610b0 2024-09-13T15:09:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd0070b30 con 0x7fefd00b2d80 2024-09-13T15:09:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd4e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fefd006aaa0 0x7fefd00b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58198/0 (socket says 172.21.15.50:58198) 2024-09-13T15:09:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd4e00700 1 -- 172.21.15.50:0/2710789877 learned_addr learned my addr 172.21.15.50:0/2710789877 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:29.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6200700 1 --2- 172.21.15.50:0/2710789877 >> v2:172.21.15.50:3300/0 conn(0x7fefd00b2d80 0x7fefd006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33536614 0 0) 0x7fefd00b3560 con 0x7fefd006aaa0 2024-09-13T15:09:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb80035d0 con 0x7fefd006aaa0 2024-09-13T15:09:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808496868 0 0) 0x7fefd00b3280 con 0x7fefd01610b0 2024-09-13T15:09:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd00b3560 con 0x7fefd01610b0 2024-09-13T15:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6200700 1 -- 172.21.15.50:0/2710789877 >> v1:172.21.15.181:6789/0 conn(0x7fefd01610b0 legacy=0x7fefd00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6200700 1 -- 172.21.15.50:0/2710789877 >> v1:172.21.15.50:6789/0 conn(0x7fefd006aaa0 legacy=0x7fefd00b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6200700 1 -- 172.21.15.50:0/2710789877 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0070ee0 con 0x7fefd00b2d80 2024-09-13T15:09:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefd6200700 1 --2- 172.21.15.50:0/2710789877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd006af10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009dc0 tx=0x7fefc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a951a7ffba985eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.627+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800e070 con 0x7fefd00b2d80 2024-09-13T15:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800bae0 con 0x7fefd00b2d80 2024-09-13T15:09:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefcfe00700 1 -- 172.21.15.50:0/2710789877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800be50 con 0x7fefd00b2d80 2024-09-13T15:09:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 -- 172.21.15.50:0/2710789877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 msgr2=0x7fefd006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 --2- 172.21.15.50:0/2710789877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd006af10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009dc0 tx=0x7fefc800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 -- 172.21.15.50:0/2710789877 shutdown_connections 2024-09-13T15:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 --2- 172.21.15.50:0/2710789877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd006af10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 -- 172.21.15.50:0/2710789877 >> 172.21.15.50:0/2710789877 conn(0x7fefd00b0c40 msgr2=0x7fefd006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 -- 172.21.15.50:0/2710789877 shutdown_connections 2024-09-13T15:09:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 -- 172.21.15.50:0/2710789877 wait complete. 2024-09-13T15:09:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 Processor -- start 2024-09-13T15:09:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.631+0000 7fefd6c00700 1 -- start start 2024-09-13T15:09:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefd006aaa0 0x7fefd0162650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd0162b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefd01610b0 0x7fefd01f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01f47b0 con 0x7fefd00b2d80 2024-09-13T15:09:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01630d0 con 0x7fefd006aaa0 2024-09-13T15:09:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01f7d30 con 0x7fefd01610b0 2024-09-13T15:09:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd0162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd0162b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60486/0 (socket says 172.21.15.50:60486) 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 -- 172.21.15.50:0/525689700 learned_addr learned my addr 172.21.15.50:0/525689700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6200700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefd01610b0 0x7fefd01f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd5800700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefd006aaa0 0x7fefd0162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 -- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefd01610b0 msgr2=0x7fefd01f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefd01610b0 0x7fefd01f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 -- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefd006aaa0 msgr2=0x7fefd0162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefd006aaa0 0x7fefd0162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 -- 172.21.15.50:0/525689700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8009a70 con 0x7fefd00b2d80 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd4e00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd0162b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00c560 tx=0x7fefbc00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc005d90 con 0x7fefd00b2d80 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc0070d0 con 0x7fefd00b2d80 2024-09-13T15:09:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd01f8010 con 0x7fefd00b2d80 2024-09-13T15:09:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc007460 con 0x7fefd00b2d80 2024-09-13T15:09:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.635+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd01f85d0 con 0x7fefd00b2d80 2024-09-13T15:09:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.639+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd006af10 con 0x7fefd00b2d80 2024-09-13T15:09:29.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.639+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefbc0075c0 con 0x7fefd00b2d80 2024-09-13T15:09:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.639+0000 7fefcd600700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefb0066730 0x7fefb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.639+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fefbc083820 con 0x7fefd00b2d80 2024-09-13T15:09:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.643+0000 7fefd5800700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefb0066730 0x7fefb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.643+0000 7fefd5800700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefb0066730 0x7fefb0068bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fefc40011e0 tx=0x7fefc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.647+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fefbc050990 con 0x7fefd00b2d80 2024-09-13T15:09:29.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.883+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefd015eba0 con 0x7fefd00b2d80 2024-09-13T15:09:29.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.883+0000 7fefcd600700 1 -- 172.21.15.50:0/525689700 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fefbc053fb0 con 0x7fefd00b2d80 2024-09-13T15:09:29.888 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:29.888 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:29.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefb0066730 msgr2=0x7fefb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefb0066730 0x7fefb0068bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fefc40011e0 tx=0x7fefc4009040 comp rx=0 tx=0).stop 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 msgr2=0x7fefd0162b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd0162b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00c560 tx=0x7fefbc00c870 comp rx=0 tx=0).stop 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 shutdown_connections 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fefb0066730 0x7fefb0068bf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefd01610b0 0x7fefd01f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd00b2d80 0x7fefd0162b90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 --2- 172.21.15.50:0/525689700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefd006aaa0 0x7fefd0162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 >> 172.21.15.50:0/525689700 conn(0x7fefd00b0c40 msgr2=0x7fefd00b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 shutdown_connections 2024-09-13T15:09:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:29.887+0000 7fefd6c00700 1 -- 172.21.15.50:0/525689700 wait complete. 2024-09-13T15:09:29.893 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:29.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:30.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.087+0000 7fe6ab000700 1 Processor -- start 2024-09-13T15:09:30.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.087+0000 7fe6ab000700 1 -- start start 2024-09-13T15:09:30.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.087+0000 7fe6ab000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe6a40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.087+0000 7fe6ab000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a4071150 con 0x7fe6a40cb200 2024-09-13T15:09:30.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.087+0000 7fe6ab000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40cd540 con 0x7fe6a406e0a0 2024-09-13T15:09:30.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.087+0000 7fe6ab000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40ceb20 con 0x7fe6a40ccfd0 2024-09-13T15:09:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a9c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6a40cb200 0x7fe6a406d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58208/0 (socket says 172.21.15.50:58208) 2024-09-13T15:09:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a9c00700 1 -- 172.21.15.50:0/2683321559 learned_addr learned my addr 172.21.15.50:0/2683321559 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe6a40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191557243 0 0) 0x7fe6a4071150 con 0x7fe6a40cb200 2024-09-13T15:09:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe68c0035d0 con 0x7fe6a40cb200 2024-09-13T15:09:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520509568 0 0) 0x7fe6a40cd540 con 0x7fe6a406e0a0 2024-09-13T15:09:30.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6a4071150 con 0x7fe6a406e0a0 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858362741 0 0) 0x7fe68c0035d0 con 0x7fe6a40cb200 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 msgr2=0x7fe6a40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe6a40ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 >> v1:172.21.15.181:6789/0 conn(0x7fe6a406e0a0 legacy=0x7fe6a40704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40cd820 con 0x7fe6a40cb200 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fe698001670 con 0x7fe6a40cb200 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 >> v1:172.21.15.50:6789/0 conn(0x7fe6a40cb200 legacy=0x7fe6a406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe68c004cb0 0x7fe68c0050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe68c003810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe68c003d50 0x7fe68c0041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40ceb20 con 0x7fe68c003d50 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c00bbf0 con 0x7fe68c004cb0 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c00bdb0 con 0x7fe6a40ccfd0 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe68c003d50 0x7fe68c0041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a9c00700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe68c004cb0 0x7fe68c0050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a9200700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe68c003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 -- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 msgr2=0x7fe68c003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe68c003810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 -- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe68c004cb0 msgr2=0x7fe68c0050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe68c004cb0 0x7fe68c0050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6aa600700 1 -- 172.21.15.50:0/2683321559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0035d0 con 0x7fe68c003d50 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.091+0000 7fe6a9200700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe6a40ccfd0 0x7fe68c003810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6aa600700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe68c003d50 0x7fe68c0041d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009fc0 tx=0x7fe68c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a778551ffc5ab439 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00ec30 con 0x7fe68c003d50 2024-09-13T15:09:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00f040 con 0x7fe68c003d50 2024-09-13T15:09:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6a3e00700 1 -- 172.21.15.50:0/2683321559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c014480 con 0x7fe68c003d50 2024-09-13T15:09:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6ab000700 1 -- 172.21.15.50:0/2683321559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe68c003d50 msgr2=0x7fe68c0041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6ab000700 1 --2- 172.21.15.50:0/2683321559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe68c003d50 0x7fe68c0041d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009fc0 tx=0x7fe68c0058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6aa600700 1 -- 172.21.15.50:0/2683321559 reap_dead start 2024-09-13T15:09:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6ab000700 1 -- 172.21.15.50:0/2683321559 shutdown_connections 2024-09-13T15:09:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6ab000700 1 -- 172.21.15.50:0/2683321559 >> 172.21.15.50:0/2683321559 conn(0x7fe6a40cf0d0 msgr2=0x7fe6a40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6ab000700 1 -- 172.21.15.50:0/2683321559 shutdown_connections 2024-09-13T15:09:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.095+0000 7fe6ab000700 1 -- 172.21.15.50:0/2683321559 wait complete. 2024-09-13T15:09:30.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 Processor -- start 2024-09-13T15:09:30.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 -- start start 2024-09-13T15:09:30.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe68c003d50 0x7fe6a40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 0x7fe6a40c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6a415bc60 0x7fe6a409bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c66e0 con 0x7fe6a40c5650 2024-09-13T15:09:30.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c7eb0 con 0x7fe6a415bc60 2024-09-13T15:09:30.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6ab000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c5ad0 con 0x7fe68c003d50 2024-09-13T15:09:30.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6a9200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 0x7fe6a40c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6a9200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 0x7fe6a40c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60502/0 (socket says 172.21.15.50:60502) 2024-09-13T15:09:30.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6a9200700 1 -- 172.21.15.50:0/1256322258 learned_addr learned my addr 172.21.15.50:0/1256322258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6aa600700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6a415bc60 0x7fe6a409bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.099+0000 7fe6a9c00700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe68c003d50 0x7fe6a40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a9200700 1 -- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe68c003d50 msgr2=0x7fe6a40c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a9200700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe68c003d50 0x7fe6a40c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a9200700 1 -- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6a415bc60 msgr2=0x7fe6a409bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a9200700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6a415bc60 0x7fe6a409bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a9200700 1 -- 172.21.15.50:0/1256322258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40c68d0 con 0x7fe6a40c5650 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a9200700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 0x7fe6a40c7970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe69000e780 tx=0x7fe69000eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690017070 con 0x7fe6a40c5650 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6900052e0 con 0x7fe6a40c5650 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a40c6bb0 con 0x7fe6a40c5650 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690005450 con 0x7fe6a40c5650 2024-09-13T15:09:30.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a40c7170 con 0x7fe6a40c5650 2024-09-13T15:09:30.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.103+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a40b4d30 con 0x7fe6a40c5650 2024-09-13T15:09:30.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.107+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe690006880 con 0x7fe6a40c5650 2024-09-13T15:09:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.107+0000 7fe6a1600700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe684066730 0x7fe684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.107+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe690083a90 con 0x7fe6a40c5650 2024-09-13T15:09:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.107+0000 7fe6a9c00700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe684066730 0x7fe684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.111+0000 7fe6a9c00700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe684066730 0x7fe684068bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe698001eb0 tx=0x7fe698009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.111+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe690050cb0 con 0x7fe6a40c5650 2024-09-13T15:09:30.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.307+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6a40aca50 con 0x7fe6a40c5650 2024-09-13T15:09:30.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.311+0000 7fe6a1600700 1 -- 172.21.15.50:0/1256322258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16754 (secure 0 0 0) 0x7fe6900542d0 con 0x7fe6a40c5650 2024-09-13T15:09:30.316 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:30.316 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:21.733922+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe684066730 msgr2=0x7fe684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe684066730 0x7fe684068bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe698001eb0 tx=0x7fe698009040 comp rx=0 tx=0).stop 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 msgr2=0x7fe6a40c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 0x7fe6a40c7970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe69000e780 tx=0x7fe69000eb40 comp rx=0 tx=0).stop 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 shutdown_connections 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe684066730 0x7fe684068bf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6a415bc60 0x7fe6a409bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a40c5650 0x7fe6a40c7970 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 --2- 172.21.15.50:0/1256322258 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe68c003d50 0x7fe6a40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 >> 172.21.15.50:0/1256322258 conn(0x7fe6a40cf0d0 msgr2=0x7fe6a40ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:30.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 shutdown_connections 2024-09-13T15:09:30.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.315+0000 7fe6ab000700 1 -- 172.21.15.50:0/1256322258 wait complete. 2024-09-13T15:09:30.346 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:09:30.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.515+0000 7fbf92600700 1 Processor -- start 2024-09-13T15:09:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.515+0000 7fbf92600700 1 -- start start 2024-09-13T15:09:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.515+0000 7fbf92600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 0x7fbf8c1679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.515+0000 7fbf92600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0ad480 con 0x7fbf8c0ce4c0 2024-09-13T15:09:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.515+0000 7fbf92600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c157790 con 0x7fbf8c1573b0 2024-09-13T15:09:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.515+0000 7fbf92600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0ad6d0 con 0x7fbf8c06ace0 2024-09-13T15:09:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf8c0ce4c0 0x7fbf8c06a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58222/0 (socket says 172.21.15.50:58222) 2024-09-13T15:09:30.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1722924527 learned_addr learned my addr 172.21.15.50:0/1722924527 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8be00700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 0x7fbf8c1679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511491650 0 0) 0x7fbf8c0ad480 con 0x7fbf8c0ce4c0 2024-09-13T15:09:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf700035d0 con 0x7fbf8c0ce4c0 2024-09-13T15:09:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284905210 0 0) 0x7fbf8c157790 con 0x7fbf8c1573b0 2024-09-13T15:09:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c0ad480 con 0x7fbf8c1573b0 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3881948281 0 0) 0x7fbf700035d0 con 0x7fbf8c0ce4c0 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 msgr2=0x7fbf8c1679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 0x7fbf8c1679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 >> v1:172.21.15.181:6789/0 conn(0x7fbf8c1573b0 legacy=0x7fbf8c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0ad9b0 con 0x7fbf8c0ce4c0 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fbf78001670 con 0x7fbf8c0ce4c0 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 >> v1:172.21.15.50:6789/0 conn(0x7fbf8c0ce4c0 legacy=0x7fbf8c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf70003be0 0x7fbf70003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf70004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 0x7fbf70005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0ad6d0 con 0x7fbf70003be0 2024-09-13T15:09:30.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000bbc0 con 0x7fbf70004870 2024-09-13T15:09:30.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000bd80 con 0x7fbf8c06ace0 2024-09-13T15:09:30.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8b400700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf70003be0 0x7fbf70003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf70004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8be00700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 0x7fbf70005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 msgr2=0x7fbf70005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c06ace0 0x7fbf70005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1722924527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf70003be0 msgr2=0x7fbf70003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf70003be0 0x7fbf70003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.519+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1722924527 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf700035d0 con 0x7fbf70004870 2024-09-13T15:09:30.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf70004cf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c1c0 tx=0x7fbf700058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4f545b9d1cf874 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800ccc0 con 0x7fbf70004870 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7800ce20 con 0x7fbf70004870 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf8a000700 1 -- 172.21.15.50:0/1722924527 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78005bc0 con 0x7fbf70004870 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf92600700 1 -- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 msgr2=0x7fbf70004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf92600700 1 --2- 172.21.15.50:0/1722924527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf70004cf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c1c0 tx=0x7fbf700058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf8be00700 1 -- 172.21.15.50:0/1722924527 reap_dead start 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf92600700 1 -- 172.21.15.50:0/1722924527 shutdown_connections 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf92600700 1 -- 172.21.15.50:0/1722924527 >> 172.21.15.50:0/1722924527 conn(0x7fbf8c0b08d0 msgr2=0x7fbf8c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf92600700 1 -- 172.21.15.50:0/1722924527 shutdown_connections 2024-09-13T15:09:30.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.523+0000 7fbf92600700 1 -- 172.21.15.50:0/1722924527 wait complete. 2024-09-13T15:09:30.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 Processor -- start 2024-09-13T15:09:30.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 -- start start 2024-09-13T15:09:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf8c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 0x7fbf8c159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c0aec30 0x7fbf8c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0af5f0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c1f2b10 con 0x7fbf70004870 2024-09-13T15:09:30.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c15a760 con 0x7fbf8c0aec30 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 0x7fbf8c159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 0x7fbf8c159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60522/0 (socket says 172.21.15.50:60522) 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1638714107 learned_addr learned my addr 172.21.15.50:0/1638714107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8b400700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf8c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8be00700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c0aec30 0x7fbf8c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c0aec30 msgr2=0x7fbf8c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c0aec30 0x7fbf8c0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 msgr2=0x7fbf8c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf8c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 -- 172.21.15.50:0/1638714107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c159ec0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf8aa00700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 0x7fbf8c159600 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c7b0 tx=0x7fbf78001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78004ca0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78004e20 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c15a1a0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.527+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78007310 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.531+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c159b40 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.531+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c06a5d0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.531+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf78019070 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.535+0000 7fbf83400700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbf6c066730 0x7fbf6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.535+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf78085240 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.535+0000 7fbf8b400700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbf6c066730 0x7fbf6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.535+0000 7fbf8b400700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbf6c066730 0x7fbf6c068bf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c007fd0 tx=0x7fbf7c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.539+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf780524e0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.771+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8c0cbea0 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.771+0000 7fbf83400700 1 -- 172.21.15.50:0/1638714107 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fbf78055b00 con 0x7fbf8c14d3c0 2024-09-13T15:09:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:30.776 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.771+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbf6c066730 msgr2=0x7fbf6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.771+0000 7fbf92600700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbf6c066730 0x7fbf6c068bf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c007fd0 tx=0x7fbf7c009040 comp rx=0 tx=0).stop 2024-09-13T15:09:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 msgr2=0x7fbf8c159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 0x7fbf8c159600 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c7b0 tx=0x7fbf78001930 comp rx=0 tx=0).stop 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 shutdown_connections 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbf6c066730 0x7fbf6c068bf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf8c0aec30 0x7fbf8c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c14d3c0 0x7fbf8c159600 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 --2- 172.21.15.50:0/1638714107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf70004870 0x7fbf8c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 >> 172.21.15.50:0/1638714107 conn(0x7fbf8c0b08d0 msgr2=0x7fbf8c1563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 shutdown_connections 2024-09-13T15:09:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.775+0000 7fbf92600700 1 -- 172.21.15.50:0/1638714107 wait complete. 2024-09-13T15:09:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:30.802 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 Processor -- start 2024-09-13T15:09:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 -- start start 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3738157040 0x7f37380cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f373815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37380ccba0 0x7f3738066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37380cc3c0 con 0x7f37380ccba0 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373815da70 con 0x7f3738157040 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3737200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373815dd50 con 0x7f3738157420 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37380ccba0 0x7f3738066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37380ccba0 0x7f3738066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60534/0 (socket says 172.21.15.50:60534) 2024-09-13T15:09:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 -- 172.21.15.50:0/3678853688 learned_addr learned my addr 172.21.15.50:0/3678853688 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 -- 172.21.15.50:0/3678853688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 msgr2=0x7f373815d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3735e00700 1 --2- 172.21.15.50:0/3678853688 >> v2:172.21.15.181:3300/0 conn(0x7f3738157040 0x7f37380cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3735400700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f373815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f373815d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 -- 172.21.15.50:0/3678853688 >> v2:172.21.15.181:3300/0 conn(0x7f3738157040 msgr2=0x7f37380cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 --2- 172.21.15.50:0/3678853688 >> v2:172.21.15.181:3300/0 conn(0x7f3738157040 0x7f37380cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 -- 172.21.15.50:0/3678853688 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373815e030 con 0x7f37380ccba0 2024-09-13T15:09:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3735e00700 1 --2- 172.21.15.50:0/3678853688 >> v2:172.21.15.181:3300/0 conn(0x7f3738157040 0x7f37380cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3735400700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f373815d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.967+0000 7f3736800700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f3738066090 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f373806d8c0 tx=0x7f373000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbaad614ab2d708 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3734a00700 1 -- 172.21.15.50:0/3678853688 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000e070 con 0x7f37380ccba0 2024-09-13T15:09:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3734a00700 1 -- 172.21.15.50:0/3678853688 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000b9c0 con 0x7f37380ccba0 2024-09-13T15:09:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3734a00700 1 -- 172.21.15.50:0/3678853688 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000bd70 con 0x7f37380ccba0 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 -- 172.21.15.50:0/3678853688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 msgr2=0x7f3738066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f3738066090 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f373806d8c0 tx=0x7f373000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 -- 172.21.15.50:0/3678853688 shutdown_connections 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f3738066090 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 --2- 172.21.15.50:0/3678853688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f373815d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 --2- 172.21.15.50:0/3678853688 >> v2:172.21.15.181:3300/0 conn(0x7f3738157040 0x7f37380cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 -- 172.21.15.50:0/3678853688 >> 172.21.15.50:0/3678853688 conn(0x7f373806ca10 msgr2=0x7f373806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 -- 172.21.15.50:0/3678853688 shutdown_connections 2024-09-13T15:09:30.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.971+0000 7f3737200700 1 -- 172.21.15.50:0/3678853688 wait complete. 2024-09-13T15:09:30.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 Processor -- start 2024-09-13T15:09:30.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 -- start start 2024-09-13T15:09:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f37381f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3738157040 0x7f373815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f37381442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738147ea0 con 0x7f37380ccba0 2024-09-13T15:09:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37381f5f90 con 0x7f3738157040 2024-09-13T15:09:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3737200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3738143b50 con 0x7f3738157420 2024-09-13T15:09:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3735e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f37381f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3735e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f37381f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60544/0 (socket says 172.21.15.50:60544) 2024-09-13T15:09:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3735e00700 1 -- 172.21.15.50:0/4070654926 learned_addr learned my addr 172.21.15.50:0/4070654926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3736800700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f37381442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.975+0000 7f3735400700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3738157040 0x7f373815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3735e00700 1 -- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 msgr2=0x7f37381442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3735e00700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f37381442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3735e00700 1 -- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3738157040 msgr2=0x7f373815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3735e00700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3738157040 0x7f373815c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:30.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3735e00700 1 -- 172.21.15.50:0/4070654926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009b30 con 0x7f37380ccba0 2024-09-13T15:09:30.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3735e00700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f37381f5a50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f372800c770 tx=0x7f372800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728011800 con 0x7f37380ccba0 2024-09-13T15:09:30.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3728011960 con 0x7f37380ccba0 2024-09-13T15:09:30.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3738143e30 con 0x7f37380ccba0 2024-09-13T15:09:30.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728011d10 con 0x7f37380ccba0 2024-09-13T15:09:30.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37381f64a0 con 0x7f37380ccba0 2024-09-13T15:09:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.979+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373815d220 con 0x7f37380ccba0 2024-09-13T15:09:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.983+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3728018360 con 0x7f37380ccba0 2024-09-13T15:09:30.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.983+0000 7f372e000700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3718066730 0x7f3718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:30.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.983+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3728084360 con 0x7f37380ccba0 2024-09-13T15:09:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.983+0000 7f3735400700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3718066730 0x7f3718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.987+0000 7f3735400700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3718066730 0x7f3718068bf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3724006fd0 tx=0x7f3724008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:30.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:30.987+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37280514e0 con 0x7f37380ccba0 2024-09-13T15:09:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.215+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f373806a9f0 con 0x7f37380ccba0 2024-09-13T15:09:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.215+0000 7f372e000700 1 -- 172.21.15.50:0/4070654926 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f3728054b00 con 0x7f37380ccba0 2024-09-13T15:09:31.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:31.221 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:08.080311+0000","modified":"2024-09-13T15:09:11.091926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5272":{"gid":5272,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.181:6837/3742425350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3742425350},{"type":"v1","addr":"172.21.15.181:6837","nonce":3742425350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T15:09:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3718066730 msgr2=0x7f3718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3718066730 0x7f3718068bf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3724006fd0 tx=0x7f3724008040 comp rx=0 tx=0).stop 2024-09-13T15:09:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 msgr2=0x7f37381f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f37381f5a50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f372800c770 tx=0x7f372800ca80 comp rx=0 tx=0).stop 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 shutdown_connections 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3718066730 0x7f3718068bf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3738157420 0x7f37381442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3738157040 0x7f373815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 --2- 172.21.15.50:0/4070654926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37380ccba0 0x7f37381f5a50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 >> 172.21.15.50:0/4070654926 conn(0x7f373806ca10 msgr2=0x7f373815e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 shutdown_connections 2024-09-13T15:09:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.219+0000 7f3737200700 1 -- 172.21.15.50:0/4070654926 wait complete. 2024-09-13T15:09:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-13T15:09:31.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 Processor -- start 2024-09-13T15:09:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 -- start start 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f296806aaa0 0x7f296815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296815e560 con 0x7f29680b3980 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680adf90 con 0x7f296806aaa0 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296815d920 con 0x7f296815e9f0 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f2967e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f296806aaa0 0x7f296815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f2967e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f296806aaa0 0x7f296815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60560/0 (socket says 172.21.15.50:60560) 2024-09-13T15:09:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f2967e00700 1 -- 172.21.15.50:0/602166637 learned_addr learned my addr 172.21.15.50:0/602166637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.419+0000 7f296ce00700 1 --2- 172.21.15.50:0/602166637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2967e00700 1 -- 172.21.15.50:0/602166637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 msgr2=0x7f296815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2967e00700 1 --2- 172.21.15.50:0/602166637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2967e00700 1 -- 172.21.15.50:0/602166637 >> v1:172.21.15.181:6789/0 conn(0x7f29680b3980 legacy=0x7f296806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2967e00700 1 -- 172.21.15.50:0/602166637 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296815dc00 con 0x7f296806aaa0 2024-09-13T15:09:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2967e00700 1 --2- 172.21.15.50:0/602166637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806aaa0 0x7f296815d310 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2958009910 tx=0x7f2958009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4806d56a51303f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2966a00700 1 -- 172.21.15.50:0/602166637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958004230 con 0x7f296806aaa0 2024-09-13T15:09:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2966a00700 1 -- 172.21.15.50:0/602166637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2958004390 con 0x7f296806aaa0 2024-09-13T15:09:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f2966a00700 1 -- 172.21.15.50:0/602166637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958009e60 con 0x7f296806aaa0 2024-09-13T15:09:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 -- 172.21.15.50:0/602166637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806aaa0 msgr2=0x7f296815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 --2- 172.21.15.50:0/602166637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806aaa0 0x7f296815d310 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2958009910 tx=0x7f2958009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 -- 172.21.15.50:0/602166637 shutdown_connections 2024-09-13T15:09:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 --2- 172.21.15.50:0/602166637 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 --2- 172.21.15.50:0/602166637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806aaa0 0x7f296815d310 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 -- 172.21.15.50:0/602166637 >> 172.21.15.50:0/602166637 conn(0x7f29680b0c40 msgr2=0x7f296806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 -- 172.21.15.50:0/602166637 shutdown_connections 2024-09-13T15:09:31.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.423+0000 7f296d800700 1 -- 172.21.15.50:0/602166637 wait complete. 2024-09-13T15:09:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.427+0000 7f296d800700 1 Processor -- start 2024-09-13T15:09:31.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.427+0000 7f296d800700 1 -- start start 2024-09-13T15:09:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f296806aaa0 0x7f296815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 0x7f29680cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968139220 con 0x7f29680b3980 2024-09-13T15:09:31.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968139500 con 0x7f296806aaa0 2024-09-13T15:09:31.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680cb0e0 con 0x7f296815e9f0 2024-09-13T15:09:31.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 0x7f29680cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 0x7f29680cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60566/0 (socket says 172.21.15.50:60566) 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 -- 172.21.15.50:0/4171734879 learned_addr learned my addr 172.21.15.50:0/4171734879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967e00700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f296806aaa0 0x7f296815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296ce00700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 -- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 msgr2=0x7f296815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 -- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f296806aaa0 msgr2=0x7f296815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f296806aaa0 0x7f296815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 -- 172.21.15.50:0/4171734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009570 con 0x7f29680b3980 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967e00700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f296806aaa0 0x7f296815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:31.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f2967400700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 0x7f29680cb8e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f295400c4e0 tx=0x7f295400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954011790 con 0x7f29680b3980 2024-09-13T15:09:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2954011910 con 0x7f29680b3980 2024-09-13T15:09:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29680cb3c0 con 0x7f29680b3980 2024-09-13T15:09:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954011cc0 con 0x7f29680b3980 2024-09-13T15:09:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.431+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296815c230 con 0x7f29680b3980 2024-09-13T15:09:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.435+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29680cb600 con 0x7f29680b3980 2024-09-13T15:09:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.435+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f295401c460 con 0x7f29680b3980 2024-09-13T15:09:31.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.435+0000 7f295fe00700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2948066730 0x7f2948068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.435+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2954084190 con 0x7f29680b3980 2024-09-13T15:09:31.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.435+0000 7f2967e00700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2948066730 0x7f2948068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.439+0000 7f2967e00700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2948066730 0x7f2948068bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2958009910 tx=0x7f2958008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:31.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.447+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29680cb600 con 0x7f29680b3980 2024-09-13T15:09:31.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.643+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29680cb600 con 0x7f29680b3980 2024-09-13T15:09:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.643+0000 7f295fe00700 1 -- 172.21.15.50:0/4171734879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f29680cb600 con 0x7f29680b3980 2024-09-13T15:09:31.649 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:31.650 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:21.733922+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:06.006484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:07.097072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2948066730 msgr2=0x7f2948068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2948066730 0x7f2948068bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2958009910 tx=0x7f2958008030 comp rx=0 tx=0).stop 2024-09-13T15:09:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 msgr2=0x7f29680cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 0x7f29680cb8e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f295400c4e0 tx=0x7f295400c8a0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 shutdown_connections 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2948066730 0x7f2948068bf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f296815e9f0 0x7f296815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29680b3980 0x7f29680cb8e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 --2- 172.21.15.50:0/4171734879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f296806aaa0 0x7f296815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 >> 172.21.15.50:0/4171734879 conn(0x7f29680b0c40 msgr2=0x7f29680aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 shutdown_connections 2024-09-13T15:09:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.647+0000 7f296d800700 1 -- 172.21.15.50:0/4171734879 wait complete. 2024-09-13T15:09:31.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:09:31.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.851+0000 7f3e2f200700 1 Processor -- start 2024-09-13T15:09:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.851+0000 7f3e2f200700 1 -- start start 2024-09-13T15:09:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2f200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3e300cb020 0x7f3e300cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e3015c2a0 0x7f3e3015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2f200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e300b2ad0 con 0x7f3e3006aaa0 2024-09-13T15:09:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2f200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3015b960 con 0x7f3e3015c2a0 2024-09-13T15:09:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2f200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3015bc40 con 0x7f3e300cb020 2024-09-13T15:09:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2d400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e3015c2a0 0x7f3e3015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2e800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3e3006aaa0 0x7f3e300b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58226/0 (socket says 172.21.15.50:58226) 2024-09-13T15:09:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2e800700 1 -- 172.21.15.50:0/1531104156 learned_addr learned my addr 172.21.15.50:0/1531104156 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2de00700 1 --2- 172.21.15.50:0/1531104156 >> v2:172.21.15.181:3300/0 conn(0x7f3e300cb020 0x7f3e300cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2d400700 1 -- 172.21.15.50:0/1531104156 >> v2:172.21.15.181:3300/0 conn(0x7f3e300cb020 msgr2=0x7f3e300cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2d400700 1 --2- 172.21.15.50:0/1531104156 >> v2:172.21.15.181:3300/0 conn(0x7f3e300cb020 0x7f3e300cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2d400700 1 -- 172.21.15.50:0/1531104156 >> v1:172.21.15.50:6789/0 conn(0x7f3e3006aaa0 legacy=0x7f3e300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.855+0000 7f3e2d400700 1 -- 172.21.15.50:0/1531104156 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3015bf20 con 0x7f3e3015c2a0 2024-09-13T15:09:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2d400700 1 --2- 172.21.15.50:0/1531104156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3015c2a0 0x7f3e3015b0e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e3006b660 tx=0x7f3e1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3454840ae0008528 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2ca00700 1 -- 172.21.15.50:0/1531104156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c011830 con 0x7f3e3015c2a0 2024-09-13T15:09:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2ca00700 1 -- 172.21.15.50:0/1531104156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c011990 con 0x7f3e3015c2a0 2024-09-13T15:09:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2ca00700 1 -- 172.21.15.50:0/1531104156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c011d40 con 0x7f3e3015c2a0 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 -- 172.21.15.50:0/1531104156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3015c2a0 msgr2=0x7f3e3015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1531104156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3015c2a0 0x7f3e3015b0e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e3006b660 tx=0x7f3e1c009b30 comp rx=0 tx=0).stop 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 -- 172.21.15.50:0/1531104156 shutdown_connections 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1531104156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3015c2a0 0x7f3e3015b0e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1531104156 >> v2:172.21.15.181:3300/0 conn(0x7f3e300cb020 0x7f3e300cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 -- 172.21.15.50:0/1531104156 >> 172.21.15.50:0/1531104156 conn(0x7f3e300b0c40 msgr2=0x7f3e3006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 -- 172.21.15.50:0/1531104156 shutdown_connections 2024-09-13T15:09:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.859+0000 7f3e2f200700 1 -- 172.21.15.50:0/1531104156 wait complete. 2024-09-13T15:09:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 Processor -- start 2024-09-13T15:09:31.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 -- start start 2024-09-13T15:09:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e3006aaa0 0x7f3e301e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 0x7f3e301434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e3015c2a0 0x7f3e30143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3013d390 con 0x7f3e300cb020 2024-09-13T15:09:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301e5350 con 0x7f3e3015c2a0 2024-09-13T15:09:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3013c9f0 con 0x7f3e3006aaa0 2024-09-13T15:09:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 0x7f3e301434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 0x7f3e301434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60576/0 (socket says 172.21.15.50:60576) 2024-09-13T15:09:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 -- 172.21.15.50:0/1186444345 learned_addr learned my addr 172.21.15.50:0/1186444345 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2e800700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e3015c2a0 0x7f3e30143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2de00700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e3006aaa0 0x7f3e301e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 -- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e3006aaa0 msgr2=0x7f3e301e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e3006aaa0 0x7f3e301e49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 -- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e3015c2a0 msgr2=0x7f3e30143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e3015c2a0 0x7f3e30143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 -- 172.21.15.50:0/1186444345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0094b0 con 0x7f3e300cb020 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2de00700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e3006aaa0 0x7f3e301e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2e800700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e3015c2a0 0x7f3e30143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e2d400700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 0x7f3e301434f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c014040 tx=0x7f3e1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.863+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0038c0 con 0x7f3e300cb020 2024-09-13T15:09:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.867+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c01e070 con 0x7f3e300cb020 2024-09-13T15:09:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.867+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3013ccd0 con 0x7f3e300cb020 2024-09-13T15:09:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.867+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003c80 con 0x7f3e300cb020 2024-09-13T15:09:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.867+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e301f09e0 con 0x7f3e300cb020 2024-09-13T15:09:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.867+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e300ca840 con 0x7f3e300cb020 2024-09-13T15:09:31.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.867+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e1c01a420 con 0x7f3e300cb020 2024-09-13T15:09:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.871+0000 7f3e26000700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e10066760 0x7f3e10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.871+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3e1c020070 con 0x7f3e300cb020 2024-09-13T15:09:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.871+0000 7f3e2de00700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e10066760 0x7f3e10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:31.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.871+0000 7f3e2de00700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e10066760 0x7f3e10068c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009a10 tx=0x7f3e20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:31.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:31.879+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e1c052b00 con 0x7f3e300cb020 2024-09-13T15:09:32.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.107+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3e3006c900 con 0x7f3e300cb020 2024-09-13T15:09:32.111 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:09:32.107+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:09:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.119+0000 7f3e26000700 1 -- 172.21.15.50:0/1186444345 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3e1c015090 con 0x7f3e300cb020 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e10066760 msgr2=0x7f3e10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e10066760 0x7f3e10068c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009a10 tx=0x7f3e20008040 comp rx=0 tx=0).stop 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 msgr2=0x7f3e301434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 0x7f3e301434f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c014040 tx=0x7f3e1c004770 comp rx=0 tx=0).stop 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 shutdown_connections 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e10066760 0x7f3e10068c20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e3015c2a0 0x7f3e30143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e300cb020 0x7f3e301434f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 --2- 172.21.15.50:0/1186444345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e3006aaa0 0x7f3e301e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 >> 172.21.15.50:0/1186444345 conn(0x7f3e300b0c40 msgr2=0x7f3e30158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 shutdown_connections 2024-09-13T15:09:32.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.123+0000 7f3e2f200700 1 -- 172.21.15.50:0/1186444345 wait complete. 2024-09-13T15:09:32.128 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:09:32.131 INFO:tasks.ceph.mds.b.smithi181.stderr: -2387> 2024-09-13T15:09:10.569+0000 7fc0ff200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:09:32.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:09:32.183 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:09:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143fe00700 1 Processor -- start 2024-09-13T15:09:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143fe00700 1 -- start start 2024-09-13T15:09:32.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f144006d070 0x7f14401657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:32.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143fe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400b1980 con 0x7f1440143b70 2024-09-13T15:09:32.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143fe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400b2500 con 0x7f144006d620 2024-09-13T15:09:32.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143fe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400b1bd0 con 0x7f144006d070 2024-09-13T15:09:32.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f144006d070 0x7f14401657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:32.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.331+0000 7f143ea00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1440143b70 0x7f14400cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58234/0 (socket says 172.21.15.50:58234) 2024-09-13T15:09:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143ea00700 1 -- 172.21.15.50:0/2504686355 learned_addr learned my addr 172.21.15.50:0/2504686355 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143f400700 1 -- 172.21.15.50:0/2504686355 >> v1:172.21.15.181:6789/0 conn(0x7f144006d620 legacy=0x7f144006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143f400700 1 -- 172.21.15.50:0/2504686355 >> v1:172.21.15.50:6789/0 conn(0x7f1440143b70 legacy=0x7f14400cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143f400700 1 -- 172.21.15.50:0/2504686355 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400b1eb0 con 0x7f144006d070 2024-09-13T15:09:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143d600700 1 -- 172.21.15.50:0/2504686355 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244797527 0 0) 0x7f14400b1980 con 0x7f1440143b70 2024-09-13T15:09:32.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143f400700 1 --2- 172.21.15.50:0/2504686355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f144006d070 0x7f14401657b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1438009d90 tx=0x7f143800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60c2f8a3bdd19ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143d600700 1 -- 172.21.15.50:0/2504686355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800e070 con 0x7f144006d070 2024-09-13T15:09:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143d600700 1 -- 172.21.15.50:0/2504686355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800bbd0 con 0x7f144006d070 2024-09-13T15:09:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143d600700 1 -- 172.21.15.50:0/2504686355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438012430 con 0x7f144006d070 2024-09-13T15:09:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 -- 172.21.15.50:0/2504686355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f144006d070 msgr2=0x7f14401657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 --2- 172.21.15.50:0/2504686355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f144006d070 0x7f14401657b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1438009d90 tx=0x7f143800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 -- 172.21.15.50:0/2504686355 shutdown_connections 2024-09-13T15:09:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 --2- 172.21.15.50:0/2504686355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f144006d070 0x7f14401657b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 -- 172.21.15.50:0/2504686355 >> 172.21.15.50:0/2504686355 conn(0x7f144006a390 msgr2=0x7f144006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 -- 172.21.15.50:0/2504686355 shutdown_connections 2024-09-13T15:09:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.335+0000 7f143fe00700 1 -- 172.21.15.50:0/2504686355 wait complete. 2024-09-13T15:09:32.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 Processor -- start 2024-09-13T15:09:32.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 -- start start 2024-09-13T15:09:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f144006d070 0x7f144015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f144006d620 0x7f14401424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 0x7f1440142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440141a00 con 0x7f1440143b70 2024-09-13T15:09:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144015d5c0 con 0x7f144006d070 2024-09-13T15:09:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.339+0000 7f143fe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144013b9f0 con 0x7f144006d620 2024-09-13T15:09:32.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 0x7f1440142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:32.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 0x7f1440142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60600/0 (socket says 172.21.15.50:60600) 2024-09-13T15:09:32.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 -- 172.21.15.50:0/2100327308 learned_addr learned my addr 172.21.15.50:0/2100327308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:32.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143ea00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f144006d070 0x7f144015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:32.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143e000700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f144006d620 0x7f14401424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:32.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 -- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f144006d620 msgr2=0x7f14401424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f144006d620 0x7f14401424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 -- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f144006d070 msgr2=0x7f144015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:32.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f144006d070 0x7f144015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:32.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 -- 172.21.15.50:0/2100327308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009a70 con 0x7f1440143b70 2024-09-13T15:09:32.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143f400700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 0x7f1440142a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1438014040 tx=0x7f1438004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143801b810 con 0x7f1440143b70 2024-09-13T15:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438020070 con 0x7f1440143b70 2024-09-13T15:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1440140e80 con 0x7f1440143b70 2024-09-13T15:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143801bbb0 con 0x7f1440143b70 2024-09-13T15:09:32.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.343+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1440141440 con 0x7f1440143b70 2024-09-13T15:09:32.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.347+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144013bbf0 con 0x7f1440143b70 2024-09-13T15:09:32.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.347+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f143801bd10 con 0x7f1440143b70 2024-09-13T15:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.347+0000 7f1437400700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1420066730 0x7f1420068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.347+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1438022070 con 0x7f1440143b70 2024-09-13T15:09:32.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.351+0000 7f143ea00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1420066730 0x7f1420068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:32.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.351+0000 7f143ea00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1420066730 0x7f1420068bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1430000f60 tx=0x7f1430004a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:32.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.355+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f144013bbf0 con 0x7f1440143b70 2024-09-13T15:09:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:32.583+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f144013bbc0 con 0x7f1440143b70 2024-09-13T15:09:33.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.123+0000 7f1437400700 1 -- 172.21.15.50:0/2100327308 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1438056f90 con 0x7f1440143b70 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1420066730 msgr2=0x7f1420068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1420066730 0x7f1420068bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1430000f60 tx=0x7f1430004a70 comp rx=0 tx=0).stop 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 msgr2=0x7f1440142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 0x7f1440142a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1438014040 tx=0x7f1438004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 shutdown_connections 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1420066730 0x7f1420068bf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1440143b70 0x7f1440142a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f144006d620 0x7f14401424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 --2- 172.21.15.50:0/2100327308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f144006d070 0x7f144015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.127+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 >> 172.21.15.50:0/2100327308 conn(0x7f144006a390 msgr2=0x7f144013e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.131+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 shutdown_connections 2024-09-13T15:09:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.131+0000 7f143fe00700 1 -- 172.21.15.50:0/2100327308 wait complete. 2024-09-13T15:09:33.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:09:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.339+0000 7ff1bb400700 1 Processor -- start 2024-09-13T15:09:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.339+0000 7ff1bb400700 1 -- start start 2024-09-13T15:09:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1bb400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1b4144330 0x7ff1b40cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b406d760 0x7ff1b40b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1bb400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff1b4144710 0x7ff1b40b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1bb400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40cce10 con 0x7ff1b4144330 2024-09-13T15:09:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1bb400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b406bcf0 con 0x7ff1b4144710 2024-09-13T15:09:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1bb400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b406cb50 con 0x7ff1b406d760 2024-09-13T15:09:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1b4144330 0x7ff1b40cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1b4144330 0x7ff1b40cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50874/0 (socket says 172.21.15.50:50874) 2024-09-13T15:09:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 -- 172.21.15.50:0/1822497594 learned_addr learned my addr 172.21.15.50:0/1822497594 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b3e00700 1 --2- 172.21.15.50:0/1822497594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b406d760 0x7ff1b40b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b9400700 1 --2- 172.21.15.50:0/1822497594 >> v2:172.21.15.181:3300/0 conn(0x7ff1b4144710 0x7ff1b40b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 -- 172.21.15.50:0/1822497594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b406d760 msgr2=0x7ff1b40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 --2- 172.21.15.50:0/1822497594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b406d760 0x7ff1b40b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 -- 172.21.15.50:0/1822497594 >> v2:172.21.15.181:3300/0 conn(0x7ff1b4144710 msgr2=0x7ff1b40b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 --2- 172.21.15.50:0/1822497594 >> v2:172.21.15.181:3300/0 conn(0x7ff1b4144710 0x7ff1b40b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 -- 172.21.15.50:0/1822497594 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40cf4b0 con 0x7ff1b4144330 2024-09-13T15:09:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.343+0000 7ff1b8a00700 1 --2- 172.21.15.50:0/1822497594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b4144330 0x7ff1b40cef70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1b415e530 tx=0x7ff1a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e5b5df807baf0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1b3400700 1 -- 172.21.15.50:0/1822497594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8011830 con 0x7ff1b4144330 2024-09-13T15:09:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1b3400700 1 -- 172.21.15.50:0/1822497594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8011990 con 0x7ff1b4144330 2024-09-13T15:09:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1b3400700 1 -- 172.21.15.50:0/1822497594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8011d20 con 0x7ff1b4144330 2024-09-13T15:09:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 -- 172.21.15.50:0/1822497594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b4144330 msgr2=0x7ff1b40cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 --2- 172.21.15.50:0/1822497594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b4144330 0x7ff1b40cef70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1b415e530 tx=0x7ff1a8009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 -- 172.21.15.50:0/1822497594 shutdown_connections 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 --2- 172.21.15.50:0/1822497594 >> v2:172.21.15.181:3300/0 conn(0x7ff1b4144710 0x7ff1b40b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 --2- 172.21.15.50:0/1822497594 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b406d760 0x7ff1b40b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 --2- 172.21.15.50:0/1822497594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b4144330 0x7ff1b40cef70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 -- 172.21.15.50:0/1822497594 >> 172.21.15.50:0/1822497594 conn(0x7ff1b406a570 msgr2=0x7ff1b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 -- 172.21.15.50:0/1822497594 shutdown_connections 2024-09-13T15:09:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.347+0000 7ff1bb400700 1 -- 172.21.15.50:0/1822497594 wait complete. 2024-09-13T15:09:33.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 Processor -- start 2024-09-13T15:09:33.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 -- start start 2024-09-13T15:09:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 0x7ff1b4137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b4144330 0x7ff1b4139d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1b4152010 0x7ff1b41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41529e0 con 0x7ff1b406d760 2024-09-13T15:09:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41f2910 con 0x7ff1b4152010 2024-09-13T15:09:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1bb400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41f3730 con 0x7ff1b4144330 2024-09-13T15:09:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 0x7ff1b4137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 0x7ff1b4137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50890/0 (socket says 172.21.15.50:50890) 2024-09-13T15:09:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 -- 172.21.15.50:0/291130812 learned_addr learned my addr 172.21.15.50:0/291130812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b3e00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b4144330 0x7ff1b4139d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b9400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1b4152010 0x7ff1b41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 -- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b4144330 msgr2=0x7ff1b4139d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b4144330 0x7ff1b4139d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 -- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1b4152010 msgr2=0x7ff1b41524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1b4152010 0x7ff1b41524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.351+0000 7ff1b8a00700 1 -- 172.21.15.50:0/291130812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8009570 con 0x7ff1b406d760 2024-09-13T15:09:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1b8a00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 0x7ff1b4137430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1b406b360 tx=0x7ff1a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8004240 con 0x7ff1b406d760 2024-09-13T15:09:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a801f070 con 0x7ff1b406d760 2024-09-13T15:09:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8004600 con 0x7ff1b406d760 2024-09-13T15:09:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b41f2b20 con 0x7ff1b406d760 2024-09-13T15:09:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b41f30e0 con 0x7ff1b406d760 2024-09-13T15:09:33.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.355+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b40af8f0 con 0x7ff1b406d760 2024-09-13T15:09:33.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.359+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1a8021030 con 0x7ff1b406d760 2024-09-13T15:09:33.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.359+0000 7ff1b0c00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff194066730 0x7ff194068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.359+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff1a8085310 con 0x7ff1b406d760 2024-09-13T15:09:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.359+0000 7ff1b3e00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff194066730 0x7ff194068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.359+0000 7ff1b3e00700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff194066730 0x7ff194068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff1b41f5e60 tx=0x7ff1a0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:33.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.367+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1a80525a0 con 0x7ff1b406d760 2024-09-13T15:09:33.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:33.551+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1b40af610 con 0x7ff1b406d760 2024-09-13T15:09:34.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.127+0000 7ff1b0c00700 1 -- 172.21.15.50:0/291130812 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff1a80036c0 con 0x7ff1b406d760 2024-09-13T15:09:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff194066730 msgr2=0x7ff194068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff194066730 0x7ff194068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff1b41f5e60 tx=0x7ff1a0009240 comp rx=0 tx=0).stop 2024-09-13T15:09:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 msgr2=0x7ff1b4137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 0x7ff1b4137430 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1b406b360 tx=0x7ff1a8004770 comp rx=0 tx=0).stop 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 shutdown_connections 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff194066730 0x7ff194068bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1b4152010 0x7ff1b41524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1b4144330 0x7ff1b4139d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 --2- 172.21.15.50:0/291130812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b406d760 0x7ff1b4137430 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 >> 172.21.15.50:0/291130812 conn(0x7ff1b406a570 msgr2=0x7ff1b415b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 shutdown_connections 2024-09-13T15:09:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.135+0000 7ff1bb400700 1 -- 172.21.15.50:0/291130812 wait complete. 2024-09-13T15:09:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:09:34.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:09:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384f200700 1 Processor -- start 2024-09-13T15:09:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384f200700 1 -- start start 2024-09-13T15:09:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38500b73f0 0x7f38500cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384f200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38500d1620 con 0x7f385015cd50 2024-09-13T15:09:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384f200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38500d1900 con 0x7f38500cfd90 2024-09-13T15:09:34.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384f200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38500b5be0 con 0x7f38500b73f0 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38500b73f0 0x7f38500cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38500b73f0 0x7f38500cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50898/0 (socket says 172.21.15.50:50898) 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384e800700 1 -- 172.21.15.50:0/1124238906 learned_addr learned my addr 172.21.15.50:0/1124238906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384e800700 1 -- 172.21.15.50:0/1124238906 >> v1:172.21.15.181:6789/0 conn(0x7f38500cfd90 legacy=0x7f38500cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.347+0000 7f384e800700 1 -- 172.21.15.50:0/1124238906 >> v1:172.21.15.50:6789/0 conn(0x7f385015cd50 legacy=0x7f38500cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384e800700 1 -- 172.21.15.50:0/1124238906 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500b5ec0 con 0x7f38500b73f0 2024-09-13T15:09:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384e800700 1 --2- 172.21.15.50:0/1124238906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cded0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3848009e50 tx=0x7f384800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ff2a099c47b594 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384ca00700 1 -- 172.21.15.50:0/1124238906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800e070 con 0x7f38500b73f0 2024-09-13T15:09:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384ca00700 1 -- 172.21.15.50:0/1124238906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848003a40 con 0x7f38500b73f0 2024-09-13T15:09:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384ca00700 1 -- 172.21.15.50:0/1124238906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848003df0 con 0x7f38500b73f0 2024-09-13T15:09:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 -- 172.21.15.50:0/1124238906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 msgr2=0x7f38500cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 --2- 172.21.15.50:0/1124238906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cded0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3848009e50 tx=0x7f384800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 -- 172.21.15.50:0/1124238906 shutdown_connections 2024-09-13T15:09:34.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 --2- 172.21.15.50:0/1124238906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cded0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 -- 172.21.15.50:0/1124238906 >> 172.21.15.50:0/1124238906 conn(0x7f38500d2cf0 msgr2=0x7f38500d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 -- 172.21.15.50:0/1124238906 shutdown_connections 2024-09-13T15:09:34.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.351+0000 7f384f200700 1 -- 172.21.15.50:0/1124238906 wait complete. 2024-09-13T15:09:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 Processor -- start 2024-09-13T15:09:34.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 -- start start 2024-09-13T15:09:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38500cfd90 0x7f38501562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f385015cd50 0x7f38500ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38500cbf30 con 0x7f38500b73f0 2024-09-13T15:09:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850156800 con 0x7f38500cfd90 2024-09-13T15:09:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38500cad10 con 0x7f385015cd50 2024-09-13T15:09:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50908/0 (socket says 172.21.15.50:50908) 2024-09-13T15:09:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.355+0000 7f384de00700 1 -- 172.21.15.50:0/461548592 learned_addr learned my addr 172.21.15.50:0/461548592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384e800700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f385015cd50 0x7f38500ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384d400700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38500cfd90 0x7f38501562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384de00700 1 -- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f385015cd50 msgr2=0x7f38500ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384de00700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f385015cd50 0x7f38500ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384de00700 1 -- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38500cfd90 msgr2=0x7f38501562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384de00700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38500cfd90 0x7f38501562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384de00700 1 -- 172.21.15.50:0/461548592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848009b30 con 0x7f38500b73f0 2024-09-13T15:09:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384d400700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38500cfd90 0x7f38501562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384de00700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cb9f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f384000c500 tx=0x7f384000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400052d0 con 0x7f38500b73f0 2024-09-13T15:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840005430 con 0x7f38500b73f0 2024-09-13T15:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38501f24c0 con 0x7f38500b73f0 2024-09-13T15:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400055a0 con 0x7f38500b73f0 2024-09-13T15:09:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38500cc440 con 0x7f38500b73f0 2024-09-13T15:09:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.359+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38500d3810 con 0x7f38500b73f0 2024-09-13T15:09:34.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.363+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38400036a0 con 0x7f38500b73f0 2024-09-13T15:09:34.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.363+0000 7f3846000700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3830066730 0x7f3830068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.363+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f3840083460 con 0x7f38500b73f0 2024-09-13T15:09:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.363+0000 7f384d400700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3830066730 0x7f3830068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.367+0000 7f384d400700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3830066730 0x7f3830068bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f385015a030 tx=0x7f383c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.371+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3840050730 con 0x7f38500b73f0 2024-09-13T15:09:34.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:34.555+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38500b71d0 con 0x7f38500b73f0 2024-09-13T15:09:35.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.139+0000 7f3846000700 1 -- 172.21.15.50:0/461548592 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3840053d50 con 0x7f38500b73f0 2024-09-13T15:09:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3830066730 msgr2=0x7f3830068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3830066730 0x7f3830068bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f385015a030 tx=0x7f383c009040 comp rx=0 tx=0).stop 2024-09-13T15:09:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 msgr2=0x7f38500cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cb9f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f384000c500 tx=0x7f384000c810 comp rx=0 tx=0).stop 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 shutdown_connections 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3830066730 0x7f3830068bf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f385015cd50 0x7f38500ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38500cfd90 0x7f38501562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 --2- 172.21.15.50:0/461548592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38500b73f0 0x7f38500cb9f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 >> 172.21.15.50:0/461548592 conn(0x7f38500d2cf0 msgr2=0x7f38500b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 shutdown_connections 2024-09-13T15:09:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.143+0000 7f384f200700 1 -- 172.21.15.50:0/461548592 wait complete. 2024-09-13T15:09:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:09:35.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T15:09:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 Processor -- start 2024-09-13T15:09:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 -- start start 2024-09-13T15:09:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0be4144330 0x7f0be40cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be406d760 0x7f0be40b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0be4144710 0x7f0be40b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be40cce10 con 0x7f0be4144330 2024-09-13T15:09:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be406bcf0 con 0x7f0be4144710 2024-09-13T15:09:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be9600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be406cb50 con 0x7f0be406d760 2024-09-13T15:09:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.343+0000 7f0be2a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0be4144330 0x7f0be40cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0be4144710 0x7f0be40b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0be4144710 0x7f0be40b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:41134/0 (socket says 172.21.15.50:41134) 2024-09-13T15:09:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 -- 172.21.15.50:0/2594304159 learned_addr learned my addr 172.21.15.50:0/2594304159 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:35.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be2000700 1 --2- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be406d760 0x7f0be40b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 -- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be406d760 msgr2=0x7f0be40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 --2- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be406d760 0x7f0be40b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 -- 172.21.15.50:0/2594304159 >> v2:172.21.15.50:3300/0 conn(0x7f0be4144330 msgr2=0x7f0be40cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 --2- 172.21.15.50:0/2594304159 >> v2:172.21.15.50:3300/0 conn(0x7f0be4144330 0x7f0be40cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 -- 172.21.15.50:0/2594304159 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40cf4b0 con 0x7f0be4144710 2024-09-13T15:09:35.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be2a00700 1 --2- 172.21.15.50:0/2594304159 >> v2:172.21.15.50:3300/0 conn(0x7f0be4144330 0x7f0be40cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be3400700 1 --2- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be4144710 0x7f0be40b3ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0be415e530 tx=0x7f0bdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff1e1a51a62f6987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be1600700 1 -- 172.21.15.50:0/2594304159 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00e070 con 0x7f0be4144710 2024-09-13T15:09:35.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be1600700 1 -- 172.21.15.50:0/2594304159 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc00b910 con 0x7f0be4144710 2024-09-13T15:09:35.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be1600700 1 -- 172.21.15.50:0/2594304159 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00bcc0 con 0x7f0be4144710 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 -- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be4144710 msgr2=0x7f0be40b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 --2- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be4144710 0x7f0be40b3ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0be415e530 tx=0x7f0bdc00b330 comp rx=0 tx=0).stop 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 -- 172.21.15.50:0/2594304159 shutdown_connections 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 --2- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be4144710 0x7f0be40b3ae0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 --2- 172.21.15.50:0/2594304159 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be406d760 0x7f0be40b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 --2- 172.21.15.50:0/2594304159 >> v2:172.21.15.50:3300/0 conn(0x7f0be4144330 0x7f0be40cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 -- 172.21.15.50:0/2594304159 >> 172.21.15.50:0/2594304159 conn(0x7f0be406a570 msgr2=0x7f0be406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 -- 172.21.15.50:0/2594304159 shutdown_connections 2024-09-13T15:09:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.347+0000 7f0be9600700 1 -- 172.21.15.50:0/2594304159 wait complete. 2024-09-13T15:09:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.351+0000 7f0be9600700 1 Processor -- start 2024-09-13T15:09:35.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.351+0000 7f0be9600700 1 -- start start 2024-09-13T15:09:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 0x7f0be406fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be4144330 0x7f0be4150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be41f5e90 0x7f0be413b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be413a4d0 con 0x7f0be406d760 2024-09-13T15:09:35.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41f63c0 con 0x7f0be41f5e90 2024-09-13T15:09:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41f66a0 con 0x7f0be4144330 2024-09-13T15:09:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 0x7f0be406fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 0x7f0be406fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50926/0 (socket says 172.21.15.50:50926) 2024-09-13T15:09:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 -- 172.21.15.50:0/1430854924 learned_addr learned my addr 172.21.15.50:0/1430854924 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2000700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be4144330 0x7f0be4150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be3400700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be41f5e90 0x7f0be413b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 -- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be4144330 msgr2=0x7f0be4150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be4144330 0x7f0be4150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 -- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be41f5e90 msgr2=0x7f0be413b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be41f5e90 0x7f0be413b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 -- 172.21.15.50:0/1430854924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40094b0 con 0x7f0be406d760 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be2a00700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 0x7f0be406fe20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400ebe0 tx=0x7f0bd400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400c850 con 0x7f0be406d760 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400c9b0 con 0x7f0be406d760 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400cd40 con 0x7f0be406d760 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc009b30 con 0x7f0be406d760 2024-09-13T15:09:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.355+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be41f6c60 con 0x7f0be406d760 2024-09-13T15:09:35.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.359+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be4151dd0 con 0x7f0be406d760 2024-09-13T15:09:35.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.359+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0bd4013470 con 0x7f0be406d760 2024-09-13T15:09:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.363+0000 7f0bdaa00700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0bc4066730 0x7f0bc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.363+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0bd4083fe0 con 0x7f0be406d760 2024-09-13T15:09:35.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.363+0000 7f0be2000700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0bc4066730 0x7f0bc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.363+0000 7f0be2000700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0bc4066730 0x7f0bc4068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0be41f5df0 tx=0x7f0bd0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.367+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0bd40514d0 con 0x7f0be406d760 2024-09-13T15:09:35.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:35.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:35.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.555+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0be40ce0c0 con 0x7f0be406d760 2024-09-13T15:09:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.563+0000 7f0bdaa00700 1 -- 172.21.15.50:0/1430854924 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0bd400cea0 con 0x7f0be406d760 2024-09-13T15:09:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0bc4066730 msgr2=0x7f0bc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0bc4066730 0x7f0bc4068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0be41f5df0 tx=0x7f0bd0009240 comp rx=0 tx=0).stop 2024-09-13T15:09:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 msgr2=0x7f0be406fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 0x7f0be406fe20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400ebe0 tx=0x7f0bd400eef0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 shutdown_connections 2024-09-13T15:09:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0bc4066730 0x7f0bc4068bf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0be41f5e90 0x7f0be413b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0be4144330 0x7f0be4150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 --2- 172.21.15.50:0/1430854924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0be406d760 0x7f0be406fe20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 >> 172.21.15.50:0/1430854924 conn(0x7f0be406a570 msgr2=0x7f0be413fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 shutdown_connections 2024-09-13T15:09:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.567+0000 7f0be9600700 1 -- 172.21.15.50:0/1430854924 wait complete. 2024-09-13T15:09:35.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-09-13T15:09:35.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.807+0000 7f616f000700 1 Processor -- start 2024-09-13T15:09:35.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.807+0000 7f616f000700 1 -- start start 2024-09-13T15:09:35.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f616f000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f616815a980 0x7f616815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f616f000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680ad5a0 con 0x7f616815ad60 2024-09-13T15:09:35.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f616f000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680ac050 con 0x7f616806d6b0 2024-09-13T15:09:35.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f616f000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616815f430 con 0x7f616815a980 2024-09-13T15:09:35.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f616815a980 0x7f616815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f616815a980 0x7f616815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50940/0 (socket says 172.21.15.50:50940) 2024-09-13T15:09:35.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f616815ad60 0x7f616815bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56202/0 (socket says 172.21.15.50:56202) 2024-09-13T15:09:35.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 -- 172.21.15.50:0/369918234 learned_addr learned my addr 172.21.15.50:0/369918234 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:35.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 -- 172.21.15.50:0/369918234 >> v1:172.21.15.181:6789/0 conn(0x7f616806d6b0 legacy=0x7f616806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 -- 172.21.15.50:0/369918234 >> v1:172.21.15.50:6789/0 conn(0x7f616815ad60 legacy=0x7f616815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 -- 172.21.15.50:0/369918234 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616815eb90 con 0x7f616815a980 2024-09-13T15:09:35.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6166a00700 1 -- 172.21.15.50:0/369918234 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091650771 0 0) 0x7f61680ad5a0 con 0x7f616815ad60 2024-09-13T15:09:35.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6167e00700 1 --2- 172.21.15.50:0/369918234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815a980 0x7f616815e500 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6158009e50 tx=0x7f615800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f47c085c26ffe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6166a00700 1 -- 172.21.15.50:0/369918234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800e070 con 0x7f616815a980 2024-09-13T15:09:35.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6166a00700 1 -- 172.21.15.50:0/369918234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800b9c0 con 0x7f616815a980 2024-09-13T15:09:35.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.811+0000 7f6166a00700 1 -- 172.21.15.50:0/369918234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800bd70 con 0x7f616815a980 2024-09-13T15:09:35.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 -- 172.21.15.50:0/369918234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815a980 msgr2=0x7f616815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 --2- 172.21.15.50:0/369918234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815a980 0x7f616815e500 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6158009e50 tx=0x7f615800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:35.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 -- 172.21.15.50:0/369918234 shutdown_connections 2024-09-13T15:09:35.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 --2- 172.21.15.50:0/369918234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815a980 0x7f616815e500 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 -- 172.21.15.50:0/369918234 >> 172.21.15.50:0/369918234 conn(0x7f61680cedd0 msgr2=0x7f61680cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:35.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 -- 172.21.15.50:0/369918234 shutdown_connections 2024-09-13T15:09:35.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 -- 172.21.15.50:0/369918234 wait complete. 2024-09-13T15:09:35.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 Processor -- start 2024-09-13T15:09:35.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.815+0000 7f616f000700 1 -- start start 2024-09-13T15:09:35.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616806d6b0 0x7f61680af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f616815a980 0x7f616814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 0x7f61680adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616815c6f0 con 0x7f616815ad60 2024-09-13T15:09:35.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616809c0d0 con 0x7f616815a980 2024-09-13T15:09:35.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680aff60 con 0x7f616806d6b0 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 0x7f61680adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 0x7f61680adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50948/0 (socket says 172.21.15.50:50948) 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 -- 172.21.15.50:0/1356742321 learned_addr learned my addr 172.21.15.50:0/1356742321 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f6167400700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f616815a980 0x7f616814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f6167e00700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616806d6b0 0x7f61680af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 -- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616806d6b0 msgr2=0x7f61680af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616806d6b0 0x7f61680af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 -- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f616815a980 msgr2=0x7f616814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f616815a980 0x7f616814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 -- 172.21.15.50:0/1356742321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009b30 con 0x7f616815ad60 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616d000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 0x7f61680adc40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f616000c480 tx=0x7f616000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600052d0 con 0x7f616815ad60 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616000ce90 con 0x7f616815ad60 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680b0240 con 0x7f616815ad60 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600036a0 con 0x7f616815ad60 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.819+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61680ce830 con 0x7f616815ad60 2024-09-13T15:09:35.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.823+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616809c280 con 0x7f616815ad60 2024-09-13T15:09:35.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.823+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6160003800 con 0x7f616815ad60 2024-09-13T15:09:35.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.823+0000 7f615fe00700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61480667b0 0x7f6148068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.823+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f61600832a0 con 0x7f616815ad60 2024-09-13T15:09:35.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.823+0000 7f6167e00700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61480667b0 0x7f6148068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.827+0000 7f6167e00700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61480667b0 0x7f6148068c70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f615800b370 tx=0x7f6158009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:35.831+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f616809c280 con 0x7f616815ad60 2024-09-13T15:09:36.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.011+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7f616809c240 con 0x7f616815ad60 2024-09-13T15:09:36.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.019+0000 7f615fe00700 1 -- 172.21.15.50:0/1356742321 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v13) v1 ==== 106+0+0 (secure 0 0 0) 0x7f6160050820 con 0x7f616815ad60 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61480667b0 msgr2=0x7f6148068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61480667b0 0x7f6148068c70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f615800b370 tx=0x7f6158009000 comp rx=0 tx=0).stop 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 msgr2=0x7f61680adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 0x7f61680adc40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f616000c480 tx=0x7f616000c790 comp rx=0 tx=0).stop 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 shutdown_connections 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f61480667b0 0x7f6148068c70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f616815ad60 0x7f61680adc40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f616815a980 0x7f616814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 --2- 172.21.15.50:0/1356742321 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f616806d6b0 0x7f61680af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 >> 172.21.15.50:0/1356742321 conn(0x7f61680cedd0 msgr2=0x7f61680aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 shutdown_connections 2024-09-13T15:09:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.023+0000 7f616f000700 1 -- 172.21.15.50:0/1356742321 wait complete. 2024-09-13T15:09:36.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-13T15:09:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 Processor -- start 2024-09-13T15:09:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 -- start start 2024-09-13T15:09:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1815b700 0x7f8d1815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d1806c460 0x7f8d1806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8d1806a5d0 0x7f8d1806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1806afa0 con 0x7f8d1806c460 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d180cdd90 con 0x7f8d1806a5d0 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d1d600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1806ce10 con 0x7f8d1815b700 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d16000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d1806c460 0x7f8d1806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d16000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d1806c460 0x7f8d1806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50962/0 (socket says 172.21.15.50:50962) 2024-09-13T15:09:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d16000700 1 -- 172.21.15.50:0/2752511332 learned_addr learned my addr 172.21.15.50:0/2752511332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d17400700 1 --2- 172.21.15.50:0/2752511332 >> v2:172.21.15.181:3300/0 conn(0x7f8d1806a5d0 0x7f8d1806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.223+0000 7f8d16a00700 1 --2- 172.21.15.50:0/2752511332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1815b700 0x7f8d1815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d16000700 1 -- 172.21.15.50:0/2752511332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1815b700 msgr2=0x7f8d1815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d16000700 1 --2- 172.21.15.50:0/2752511332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1815b700 0x7f8d1815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d16000700 1 -- 172.21.15.50:0/2752511332 >> v2:172.21.15.181:3300/0 conn(0x7f8d1806a5d0 msgr2=0x7f8d1806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d16000700 1 --2- 172.21.15.50:0/2752511332 >> v2:172.21.15.181:3300/0 conn(0x7f8d1806a5d0 0x7f8d1806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d16000700 1 -- 172.21.15.50:0/2752511332 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1815c020 con 0x7f8d1806c460 2024-09-13T15:09:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d16000700 1 --2- 172.21.15.50:0/2752511332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d1806d2a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d180722a0 tx=0x7f8d04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f52b5c560ee03f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d15600700 1 -- 172.21.15.50:0/2752511332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04011830 con 0x7f8d1806c460 2024-09-13T15:09:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d15600700 1 -- 172.21.15.50:0/2752511332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04011990 con 0x7f8d1806c460 2024-09-13T15:09:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d15600700 1 -- 172.21.15.50:0/2752511332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04011d20 con 0x7f8d1806c460 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 -- 172.21.15.50:0/2752511332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 msgr2=0x7f8d1806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 --2- 172.21.15.50:0/2752511332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d1806d2a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d180722a0 tx=0x7f8d04009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 -- 172.21.15.50:0/2752511332 shutdown_connections 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 --2- 172.21.15.50:0/2752511332 >> v2:172.21.15.181:3300/0 conn(0x7f8d1806a5d0 0x7f8d1806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 --2- 172.21.15.50:0/2752511332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d1806d2a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 --2- 172.21.15.50:0/2752511332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1815b700 0x7f8d1815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 -- 172.21.15.50:0/2752511332 >> 172.21.15.50:0/2752511332 conn(0x7f8d180b08d0 msgr2=0x7f8d180b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 -- 172.21.15.50:0/2752511332 shutdown_connections 2024-09-13T15:09:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.227+0000 7f8d1d600700 1 -- 172.21.15.50:0/2752511332 wait complete. 2024-09-13T15:09:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.231+0000 7f8d1d600700 1 Processor -- start 2024-09-13T15:09:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.231+0000 7f8d1d600700 1 -- start start 2024-09-13T15:09:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1806a5d0 0x7f8d18149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d181f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d1815b700 0x7f8d1814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d181f28c0 con 0x7f8d1806c460 2024-09-13T15:09:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1814d5d0 con 0x7f8d1815b700 2024-09-13T15:09:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1814a300 con 0x7f8d1806a5d0 2024-09-13T15:09:36.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d181f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d181f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50974/0 (socket says 172.21.15.50:50974) 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 -- 172.21.15.50:0/703747879 learned_addr learned my addr 172.21.15.50:0/703747879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d17400700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d1815b700 0x7f8d1814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16a00700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1806a5d0 0x7f8d18149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 -- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1806a5d0 msgr2=0x7f8d18149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1806a5d0 0x7f8d18149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 -- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d1815b700 msgr2=0x7f8d1814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d1815b700 0x7f8d1814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 -- 172.21.15.50:0/703747879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04009570 con 0x7f8d1806c460 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d16000700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d181f2380 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8d180721e0 tx=0x7f8d04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040044d0 con 0x7f8d1806c460 2024-09-13T15:09:36.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0401f070 con 0x7f8d1806c460 2024-09-13T15:09:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04003900 con 0x7f8d1806c460 2024-09-13T15:09:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1814a5e0 con 0x7f8d1806c460 2024-09-13T15:09:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.235+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d18137290 con 0x7f8d1806c460 2024-09-13T15:09:36.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.239+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d18136e10 con 0x7f8d1806c460 2024-09-13T15:09:36.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.239+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d04003a60 con 0x7f8d1806c460 2024-09-13T15:09:36.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.239+0000 7f8d0ea00700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cf8066760 0x7f8cf8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.243+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8d04021070 con 0x7f8d1806c460 2024-09-13T15:09:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.243+0000 7f8d16a00700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cf8066760 0x7f8cf8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:36.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.243+0000 7f8d16a00700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cf8066760 0x7f8cf8068c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d08007380 tx=0x7f8d0800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:36.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.247+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d040b6db0 con 0x7f8d1806c460 2024-09-13T15:09:36.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:36.491+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7f8d1806caa0 con 0x7f8d1806c460 2024-09-13T15:09:37.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.147+0000 7f8d0ea00700 1 -- 172.21.15.50:0/703747879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v134) v1 ==== 144+0+0 (secure 0 0 0) 0x7f8d040150d0 con 0x7f8d1806c460 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cf8066760 msgr2=0x7f8cf8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cf8066760 0x7f8cf8068c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d08007380 tx=0x7f8d0800b040 comp rx=0 tx=0).stop 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 msgr2=0x7f8d181f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d181f2380 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8d180721e0 tx=0x7f8d04004770 comp rx=0 tx=0).stop 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 shutdown_connections 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cf8066760 0x7f8cf8068c20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d1815b700 0x7f8d1814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d1806c460 0x7f8d181f2380 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 --2- 172.21.15.50:0/703747879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8d1806a5d0 0x7f8d18149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 >> 172.21.15.50:0/703747879 conn(0x7f8d180b08d0 msgr2=0x7f8d180af330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 shutdown_connections 2024-09-13T15:09:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.151+0000 7f8d1d600700 1 -- 172.21.15.50:0/703747879 wait complete. 2024-09-13T15:09:37.182 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2024-09-13T15:09:37.182 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2024-09-13T15:09:37.182 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T15:09:37.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.355+0000 7f1692a00700 1 Processor -- start 2024-09-13T15:09:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1692a00700 1 -- start start 2024-09-13T15:09:37.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1692a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f168c071d20 0x7f168c0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1692a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c0cd610 0x7f168c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1692a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0ce140 con 0x7f168c06a5d0 2024-09-13T15:09:37.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1692a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0cde60 con 0x7f168c071d20 2024-09-13T15:09:37.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1692a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c06c3b0 con 0x7f168c0cd610 2024-09-13T15:09:37.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1683e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f168c071d20 0x7f168c0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f168be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f168c06a5d0 0x7f168c06a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56204/0 (socket says 172.21.15.50:56204) 2024-09-13T15:09:37.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f168be00700 1 -- 172.21.15.50:0/3864466250 learned_addr learned my addr 172.21.15.50:0/3864466250 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:37.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f1690a00700 1 --2- 172.21.15.50:0/3864466250 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c0cd610 0x7f168c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.359+0000 7f168b400700 1 -- 172.21.15.50:0/3864466250 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409121759 0 0) 0x7f168c0ce140 con 0x7f168c06a5d0 2024-09-13T15:09:37.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1683e00700 1 -- 172.21.15.50:0/3864466250 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c0cd610 msgr2=0x7f168c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:37.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1683e00700 1 --2- 172.21.15.50:0/3864466250 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c0cd610 0x7f168c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1683e00700 1 -- 172.21.15.50:0/3864466250 >> v1:172.21.15.50:6789/0 conn(0x7f168c06a5d0 legacy=0x7f168c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1683e00700 1 -- 172.21.15.50:0/3864466250 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c06c690 con 0x7f168c071d20 2024-09-13T15:09:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1683e00700 1 --2- 172.21.15.50:0/3864466250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0b19f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1674009850 tx=0x7f1674009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab6d751890d071 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f168b400700 1 -- 172.21.15.50:0/3864466250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674011830 con 0x7f168c071d20 2024-09-13T15:09:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f168b400700 1 -- 172.21.15.50:0/3864466250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674011990 con 0x7f168c071d20 2024-09-13T15:09:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f168b400700 1 -- 172.21.15.50:0/3864466250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674011d40 con 0x7f168c071d20 2024-09-13T15:09:37.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 -- 172.21.15.50:0/3864466250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 msgr2=0x7f168c0b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 --2- 172.21.15.50:0/3864466250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0b19f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1674009850 tx=0x7f1674009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 -- 172.21.15.50:0/3864466250 shutdown_connections 2024-09-13T15:09:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 --2- 172.21.15.50:0/3864466250 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c0cd610 0x7f168c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 --2- 172.21.15.50:0/3864466250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0b19f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 -- 172.21.15.50:0/3864466250 >> 172.21.15.50:0/3864466250 conn(0x7f168c0b08d0 msgr2=0x7f168c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 -- 172.21.15.50:0/3864466250 shutdown_connections 2024-09-13T15:09:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.363+0000 7f1692a00700 1 -- 172.21.15.50:0/3864466250 wait complete. 2024-09-13T15:09:37.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.367+0000 7f1692a00700 1 Processor -- start 2024-09-13T15:09:37.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.367+0000 7f1692a00700 1 -- start start 2024-09-13T15:09:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c06a5d0 0x7f168c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f168c0cd610 0x7f168c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c144780 con 0x7f168c071d20 2024-09-13T15:09:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1582d0 con 0x7f168c0cd610 2024-09-13T15:09:37.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c143b70 con 0x7f168c06a5d0 2024-09-13T15:09:37.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50988/0 (socket says 172.21.15.50:50988) 2024-09-13T15:09:37.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 -- 172.21.15.50:0/895298681 learned_addr learned my addr 172.21.15.50:0/895298681 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1690a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f168c0cd610 0x7f168c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f168be00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c06a5d0 0x7f168c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 -- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c06a5d0 msgr2=0x7f168c1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c06a5d0 0x7f168c1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 -- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f168c0cd610 msgr2=0x7f168c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f168c0cd610 0x7f168c0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 -- 172.21.15.50:0/895298681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740094b0 con 0x7f168c071d20 2024-09-13T15:09:37.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1690a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f168c0cd610 0x7f168c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1683e00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0ad8c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1674000c00 tx=0x7f1674004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167401aac0 con 0x7f168c071d20 2024-09-13T15:09:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167401f070 con 0x7f168c071d20 2024-09-13T15:09:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c143e50 con 0x7f168c071d20 2024-09-13T15:09:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167401ae60 con 0x7f168c071d20 2024-09-13T15:09:37.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.371+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c144410 con 0x7f168c071d20 2024-09-13T15:09:37.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.375+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c1448f0 con 0x7f168c071d20 2024-09-13T15:09:37.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.375+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f167401b430 con 0x7f168c071d20 2024-09-13T15:09:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.375+0000 7f1688c00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1668066730 0x7f1668068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.375+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1674085150 con 0x7f168c071d20 2024-09-13T15:09:37.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.379+0000 7f168be00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1668066730 0x7f1668068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.379+0000 7f168be00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1668066730 0x7f1668068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f167c000f60 tx=0x7f167c007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.383+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1674052690 con 0x7f168c071d20 2024-09-13T15:09:37.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.579+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168c0b19f0 con 0x7f168c071d20 2024-09-13T15:09:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.583+0000 7f1688c00700 1 -- 172.21.15.50:0/895298681 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f1674006ce0 con 0x7f168c071d20 2024-09-13T15:09:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:37.588 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:35.128549+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6837/3742425350":"2024-09-14T15:09:32.110729+0000","172.21.15.181:6836/3742425350":"2024-09-14T15:09:32.110729+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1668066730 msgr2=0x7f1668068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1668066730 0x7f1668068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f167c000f60 tx=0x7f167c007c00 comp rx=0 tx=0).stop 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 msgr2=0x7f168c0ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0ad8c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1674000c00 tx=0x7f1674004770 comp rx=0 tx=0).stop 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 shutdown_connections 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1668066730 0x7f1668068bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f168c0cd610 0x7f168c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f168c071d20 0x7f168c0ad8c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 --2- 172.21.15.50:0/895298681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f168c06a5d0 0x7f168c1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 >> 172.21.15.50:0/895298681 conn(0x7f168c0b08d0 msgr2=0x7f168c070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 shutdown_connections 2024-09-13T15:09:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.587+0000 7f1692a00700 1 -- 172.21.15.50:0/895298681 wait complete. 2024-09-13T15:09:37.614 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:37.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:37.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.787+0000 7faa1a600700 1 Processor -- start 2024-09-13T15:09:37.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.787+0000 7faa1a600700 1 -- start start 2024-09-13T15:09:37.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faa1406c960 0x7faa1406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa140cd730 0x7faa140cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1406d2f0 con 0x7faa14159920 2024-09-13T15:09:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa140cd2a0 con 0x7faa140cd730 2024-09-13T15:09:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa140ccc90 con 0x7faa1406c960 2024-09-13T15:09:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa140cd730 0x7faa140cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa14159920 0x7faa140b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56208/0 (socket says 172.21.15.50:56208) 2024-09-13T15:09:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19200700 1 -- 172.21.15.50:0/1632367300 learned_addr learned my addr 172.21.15.50:0/1632367300 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa13e00700 1 --2- 172.21.15.50:0/1632367300 >> v2:172.21.15.181:3300/0 conn(0x7faa1406c960 0x7faa1406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19c00700 1 -- 172.21.15.50:0/1632367300 >> v2:172.21.15.181:3300/0 conn(0x7faa1406c960 msgr2=0x7faa1406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa13400700 1 -- 172.21.15.50:0/1632367300 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343077891 0 0) 0x7faa08001110 con 0x7faa14159920 2024-09-13T15:09:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19c00700 1 --2- 172.21.15.50:0/1632367300 >> v2:172.21.15.181:3300/0 conn(0x7faa1406c960 0x7faa1406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19c00700 1 -- 172.21.15.50:0/1632367300 >> v1:172.21.15.50:6789/0 conn(0x7faa14159920 legacy=0x7faa140b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19c00700 1 -- 172.21.15.50:0/1632367300 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140b3580 con 0x7faa140cd730 2024-09-13T15:09:37.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa19c00700 1 --2- 172.21.15.50:0/1632367300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cd730 0x7faa140cdb40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7faa140cc6b0 tx=0x7faa0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd530e9d7a80458a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:37.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa13400700 1 -- 172.21.15.50:0/1632367300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00e070 con 0x7faa140cd730 2024-09-13T15:09:37.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa13400700 1 -- 172.21.15.50:0/1632367300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c00bb20 con 0x7faa140cd730 2024-09-13T15:09:37.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa13400700 1 -- 172.21.15.50:0/1632367300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c012430 con 0x7faa140cd730 2024-09-13T15:09:37.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 -- 172.21.15.50:0/1632367300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cd730 msgr2=0x7faa140cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.791+0000 7faa1a600700 1 --2- 172.21.15.50:0/1632367300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cd730 0x7faa140cdb40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7faa140cc6b0 tx=0x7faa0c00b330 comp rx=0 tx=0).stop 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 -- 172.21.15.50:0/1632367300 shutdown_connections 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 --2- 172.21.15.50:0/1632367300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cd730 0x7faa140cdb40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 --2- 172.21.15.50:0/1632367300 >> v2:172.21.15.181:3300/0 conn(0x7faa1406c960 0x7faa1406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 -- 172.21.15.50:0/1632367300 >> 172.21.15.50:0/1632367300 conn(0x7faa1406a390 msgr2=0x7faa1406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 -- 172.21.15.50:0/1632367300 shutdown_connections 2024-09-13T15:09:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 -- 172.21.15.50:0/1632367300 wait complete. 2024-09-13T15:09:37.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 Processor -- start 2024-09-13T15:09:37.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.795+0000 7faa1a600700 1 -- start start 2024-09-13T15:09:37.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 0x7faa141441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa140cd730 0x7faa140aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa140ab010 0x7faa140c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140ab4c0 con 0x7faa1406c960 2024-09-13T15:09:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141f2530 con 0x7faa140ab010 2024-09-13T15:09:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa140a8c50 con 0x7faa140cd730 2024-09-13T15:09:37.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 0x7faa141441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 0x7faa141441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50996/0 (socket says 172.21.15.50:50996) 2024-09-13T15:09:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 -- 172.21.15.50:0/4018914925 learned_addr learned my addr 172.21.15.50:0/4018914925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa13e00700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa140cd730 0x7faa140aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19c00700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa140ab010 0x7faa140c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 -- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa140cd730 msgr2=0x7faa140aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa140cd730 0x7faa140aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 -- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa140ab010 msgr2=0x7faa140c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa140ab010 0x7faa140c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 -- 172.21.15.50:0/4018914925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009a70 con 0x7faa1406c960 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa19200700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 0x7faa141441a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c510 tx=0x7faa0800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08004ca0 con 0x7faa1406c960 2024-09-13T15:09:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa08004e20 con 0x7faa1406c960 2024-09-13T15:09:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa140c9440 con 0x7faa1406c960 2024-09-13T15:09:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08007310 con 0x7faa1406c960 2024-09-13T15:09:37.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.799+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa140a88e0 con 0x7faa1406c960 2024-09-13T15:09:37.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.803+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa140ab920 con 0x7faa1406c960 2024-09-13T15:09:37.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.803+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa08007470 con 0x7faa1406c960 2024-09-13T15:09:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.803+0000 7faa10c00700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9f4066730 0x7fa9f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.803+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7faa08083960 con 0x7faa1406c960 2024-09-13T15:09:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.807+0000 7faa13e00700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9f4066730 0x7fa9f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.807+0000 7faa13e00700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9f4066730 0x7fa9f4068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa14156700 tx=0x7faa00009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:37.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.811+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faa08050e80 con 0x7faa1406c960 2024-09-13T15:09:37.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.991+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa1406d2f0 con 0x7faa1406c960 2024-09-13T15:09:37.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa10c00700 1 -- 172.21.15.50:0/4018914925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa1406d2f0 con 0x7faa1406c960 2024-09-13T15:09:37.999 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9f4066730 msgr2=0x7fa9f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9f4066730 0x7fa9f4068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa14156700 tx=0x7faa00009240 comp rx=0 tx=0).stop 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 msgr2=0x7faa141441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 0x7faa141441a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c510 tx=0x7faa0800c820 comp rx=0 tx=0).stop 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 shutdown_connections 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9f4066730 0x7fa9f4068bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa140ab010 0x7faa140c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa140cd730 0x7faa140aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 --2- 172.21.15.50:0/4018914925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa1406c960 0x7faa141441a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.995+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 >> 172.21.15.50:0/4018914925 conn(0x7faa1406a390 msgr2=0x7faa14158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.999+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 shutdown_connections 2024-09-13T15:09:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:37.999+0000 7faa1a600700 1 -- 172.21.15.50:0/4018914925 wait complete. 2024-09-13T15:09:38.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-13T15:09:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff92d000700 1 Processor -- start 2024-09-13T15:09:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff92d000700 1 -- start start 2024-09-13T15:09:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff92d000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff92806aaa0 0x7ff92806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff92d000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9280ccb40 con 0x7ff9280cb020 2024-09-13T15:09:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff92d000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92806b430 con 0x7ff9280cc6f0 2024-09-13T15:09:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff92d000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9280b2ad0 con 0x7ff92806aaa0 2024-09-13T15:09:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff927400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9280cb020 0x7ff92815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56218/0 (socket says 172.21.15.50:56218) 2024-09-13T15:09:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff927400700 1 -- 172.21.15.50:0/229288744 learned_addr learned my addr 172.21.15.50:0/229288744 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.195+0000 7ff927e00700 1 --2- 172.21.15.50:0/229288744 >> v2:172.21.15.181:3300/0 conn(0x7ff92806aaa0 0x7ff92806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310750239 0 0) 0x7ff9280ccb40 con 0x7ff9280cb020 2024-09-13T15:09:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff90c0035d0 con 0x7ff9280cb020 2024-09-13T15:09:38.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87943666 0 0) 0x7ff914001110 con 0x7ff9280cc6f0 2024-09-13T15:09:38.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9280ccb40 con 0x7ff9280cc6f0 2024-09-13T15:09:38.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 612400907 0 0) 0x7ff90c0035d0 con 0x7ff9280cb020 2024-09-13T15:09:38.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 >> v2:172.21.15.181:3300/0 conn(0x7ff92806aaa0 msgr2=0x7ff92806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:38.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 --2- 172.21.15.50:0/229288744 >> v2:172.21.15.181:3300/0 conn(0x7ff92806aaa0 0x7ff92806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 >> v1:172.21.15.181:6789/0 conn(0x7ff9280cc6f0 legacy=0x7ff92815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92815b960 con 0x7ff9280cb020 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7ff918001670 con 0x7ff9280cb020 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 >> v1:172.21.15.50:6789/0 conn(0x7ff9280cb020 legacy=0x7ff92815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c003c20 0x7ff90c004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c004870 0x7ff90c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c005230 0x7ff90c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280b2ad0 con 0x7ff90c005230 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c00c130 con 0x7ff90c004870 2024-09-13T15:09:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c00c2f0 con 0x7ff90c003c20 2024-09-13T15:09:38.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c005230 0x7ff90c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff926a00700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c004870 0x7ff90c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927400700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c003c20 0x7ff90c004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 -- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c003c20 msgr2=0x7ff90c004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c003c20 0x7ff90c004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 -- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c004870 msgr2=0x7ff90c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c004870 0x7ff90c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 -- 172.21.15.50:0/229288744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c0035d0 con 0x7ff90c005230 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927400700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c003c20 0x7ff90c004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 -- 172.21.15.50:0/229288744 reap_dead start 2024-09-13T15:09:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.199+0000 7ff927e00700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c005230 0x7ff90c00ba30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff920009fc0 tx=0x7ff90c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4876c34bbb2e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920003a40 con 0x7ff90c005230 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000f040 con 0x7ff90c005230 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff926000700 1 -- 172.21.15.50:0/229288744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920003e00 con 0x7ff90c005230 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 -- 172.21.15.50:0/229288744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c005230 msgr2=0x7ff90c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c005230 0x7ff90c00ba30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff920009fc0 tx=0x7ff90c0058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 -- 172.21.15.50:0/229288744 shutdown_connections 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 --2- 172.21.15.50:0/229288744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c005230 0x7ff90c00ba30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 -- 172.21.15.50:0/229288744 >> 172.21.15.50:0/229288744 conn(0x7ff9280b0c40 msgr2=0x7ff92806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 -- 172.21.15.50:0/229288744 shutdown_connections 2024-09-13T15:09:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.203+0000 7ff92d000700 1 -- 172.21.15.50:0/229288744 wait complete. 2024-09-13T15:09:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 Processor -- start 2024-09-13T15:09:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 -- start start 2024-09-13T15:09:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c005230 0x7ff928137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 0x7ff9281e6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9280ca010 0x7ff9281e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff928137560 con 0x7ff9280c9bb0 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281e32d0 con 0x7ff9280ca010 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff92d000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281e35b0 con 0x7ff90c005230 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 0x7ff9281e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 0x7ff9281e6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51024/0 (socket says 172.21.15.50:51024) 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 -- 172.21.15.50:0/994167478 learned_addr learned my addr 172.21.15.50:0/994167478 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff927400700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c005230 0x7ff928137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff927e00700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9280ca010 0x7ff9281e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 -- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c005230 msgr2=0x7ff928137020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c005230 0x7ff928137020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 -- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9280ca010 msgr2=0x7ff9281e6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9280ca010 0x7ff9281e6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 -- 172.21.15.50:0/994167478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9281e3890 con 0x7ff9280c9bb0 2024-09-13T15:09:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.207+0000 7ff926a00700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 0x7ff9281e6570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff91400f770 tx=0x7ff91400fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.211+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914005320 con 0x7ff9280c9bb0 2024-09-13T15:09:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.211+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9140054a0 con 0x7ff9280c9bb0 2024-09-13T15:09:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.211+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9281e3b70 con 0x7ff9280c9bb0 2024-09-13T15:09:38.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.211+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914006ac0 con 0x7ff9280c9bb0 2024-09-13T15:09:38.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.211+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9281e2f80 con 0x7ff9280c9bb0 2024-09-13T15:09:38.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.211+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92806aef0 con 0x7ff9280c9bb0 2024-09-13T15:09:38.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.215+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff914006c20 con 0x7ff9280c9bb0 2024-09-13T15:09:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.215+0000 7ff91f400700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff908066730 0x7ff908068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.215+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff914083620 con 0x7ff9280c9bb0 2024-09-13T15:09:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.215+0000 7ff927400700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff908066730 0x7ff908068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.215+0000 7ff927400700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff908066730 0x7ff908068bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff918005b20 tx=0x7ff918007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:38.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.219+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff914050b50 con 0x7ff9280c9bb0 2024-09-13T15:09:38.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:38.475+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7ff92806b430 con 0x7ff9280c9bb0 2024-09-13T15:09:39.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.159+0000 7ff91f400700 1 -- 172.21.15.50:0/994167478 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v136) v1 ==== 156+0+0 (secure 0 0 0) 0x7ff92806b430 con 0x7ff9280c9bb0 2024-09-13T15:09:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.163+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff908066730 msgr2=0x7ff908068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.163+0000 7ff92d000700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff908066730 0x7ff908068bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff918005b20 tx=0x7ff918007040 comp rx=0 tx=0).stop 2024-09-13T15:09:39.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.163+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 msgr2=0x7ff9281e6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.163+0000 7ff92d000700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 0x7ff9281e6570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff91400f770 tx=0x7ff91400fa80 comp rx=0 tx=0).stop 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 shutdown_connections 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff908066730 0x7ff908068bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9280ca010 0x7ff9281e6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280c9bb0 0x7ff9281e6570 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 --2- 172.21.15.50:0/994167478 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c005230 0x7ff928137020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 >> 172.21.15.50:0/994167478 conn(0x7ff9280b0c40 msgr2=0x7ff928159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 shutdown_connections 2024-09-13T15:09:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.167+0000 7ff92d000700 1 -- 172.21.15.50:0/994167478 wait complete. 2024-09-13T15:09:39.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T15:09:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 Processor -- start 2024-09-13T15:09:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 -- start start 2024-09-13T15:09:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f103006c4c0 0x7f10300ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f103006c8c0 0x7f10300cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103015ea30 con 0x7f1030146720 2024-09-13T15:09:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1030070670 con 0x7f103006c8c0 2024-09-13T15:09:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.379+0000 7f1037c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1030070950 con 0x7f103006c4c0 2024-09-13T15:09:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1030146720 0x7f103015e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56226/0 (socket says 172.21.15.50:56226) 2024-09-13T15:09:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035200700 1 -- 172.21.15.50:0/3743491179 learned_addr learned my addr 172.21.15.50:0/3743491179 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035c00700 1 --2- 172.21.15.50:0/3743491179 >> v2:172.21.15.50:3300/0 conn(0x7f103006c8c0 0x7f10300cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f102fe00700 1 --2- 172.21.15.50:0/3743491179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f103006c4c0 0x7f10300ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035c00700 1 -- 172.21.15.50:0/3743491179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f103006c4c0 msgr2=0x7f10300ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035c00700 1 --2- 172.21.15.50:0/3743491179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f103006c4c0 0x7f10300ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035c00700 1 -- 172.21.15.50:0/3743491179 >> v1:172.21.15.50:6789/0 conn(0x7f1030146720 legacy=0x7f103015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f102f400700 1 -- 172.21.15.50:0/3743491179 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772270593 0 0) 0x7f103015ea30 con 0x7f1030146720 2024-09-13T15:09:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035c00700 1 -- 172.21.15.50:0/3743491179 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030070c30 con 0x7f103006c8c0 2024-09-13T15:09:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1035c00700 1 --2- 172.21.15.50:0/3743491179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c8c0 0x7f10300cf0b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1028009d90 tx=0x7f102800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42352b06589a29c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f102f400700 1 -- 172.21.15.50:0/3743491179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102800e070 con 0x7f103006c8c0 2024-09-13T15:09:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f102f400700 1 -- 172.21.15.50:0/3743491179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102800bb20 con 0x7f103006c8c0 2024-09-13T15:09:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f102f400700 1 -- 172.21.15.50:0/3743491179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028012430 con 0x7f103006c8c0 2024-09-13T15:09:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1037c00700 1 -- 172.21.15.50:0/3743491179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c8c0 msgr2=0x7f10300cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.383+0000 7f1037c00700 1 --2- 172.21.15.50:0/3743491179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c8c0 0x7f10300cf0b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1028009d90 tx=0x7f102800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 -- 172.21.15.50:0/3743491179 shutdown_connections 2024-09-13T15:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 --2- 172.21.15.50:0/3743491179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c8c0 0x7f10300cf0b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 --2- 172.21.15.50:0/3743491179 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f103006c4c0 0x7f10300ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 -- 172.21.15.50:0/3743491179 >> 172.21.15.50:0/3743491179 conn(0x7f103006a570 msgr2=0x7f103006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 -- 172.21.15.50:0/3743491179 shutdown_connections 2024-09-13T15:09:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 -- 172.21.15.50:0/3743491179 wait complete. 2024-09-13T15:09:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 Processor -- start 2024-09-13T15:09:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.387+0000 7f1037c00700 1 -- start start 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 0x7f10300afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f103006c8c0 0x7f10301f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1030146720 0x7f10300c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10301f6fb0 con 0x7f103006c4c0 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1030142b00 con 0x7f103006c8c0 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10300af7c0 con 0x7f1030146720 2024-09-13T15:09:39.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 0x7f10300afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:39.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 0x7f10300afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51046/0 (socket says 172.21.15.50:51046) 2024-09-13T15:09:39.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 -- 172.21.15.50:0/854091253 learned_addr learned my addr 172.21.15.50:0/854091253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1030146720 0x7f10300c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f102fe00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f103006c8c0 0x7f10301f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 -- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1030146720 msgr2=0x7f10300c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1030146720 0x7f10300c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 -- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f103006c8c0 msgr2=0x7f10301f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f103006c8c0 0x7f10301f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 -- 172.21.15.50:0/854091253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028009a70 con 0x7f103006c4c0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1035200700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 0x7f10300afc50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f102400c510 tx=0x7f102400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024004ca0 con 0x7f103006c4c0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024004e20 con 0x7f103006c4c0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024007310 con 0x7f103006c4c0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.391+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10300aebb0 con 0x7f103006c4c0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.395+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10300af170 con 0x7f103006c4c0 2024-09-13T15:09:39.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.395+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103015e320 con 0x7f103006c4c0 2024-09-13T15:09:39.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.395+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1024007470 con 0x7f103006c4c0 2024-09-13T15:09:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.399+0000 7f102cc00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1010066730 0x7f1010068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.399+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1024083d10 con 0x7f103006c4c0 2024-09-13T15:09:39.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.399+0000 7f102fe00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1010066730 0x7f1010068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.399+0000 7f102fe00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1010066730 0x7f1010068bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1030142760 tx=0x7f101c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.407+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1024089020 con 0x7f103006c4c0 2024-09-13T15:09:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.595+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f103006c1e0 con 0x7f103006c4c0 2024-09-13T15:09:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.603+0000 7f102cc00700 1 -- 172.21.15.50:0/854091253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f10240511a0 con 0x7f103006c4c0 2024-09-13T15:09:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1010066730 msgr2=0x7f1010068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1010066730 0x7f1010068bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1030142760 tx=0x7f101c008040 comp rx=0 tx=0).stop 2024-09-13T15:09:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 msgr2=0x7f10300afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 0x7f10300afc50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f102400c510 tx=0x7f102400c8d0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 shutdown_connections 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1010066730 0x7f1010068bf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1030146720 0x7f10300c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f103006c8c0 0x7f10301f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 --2- 172.21.15.50:0/854091253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f103006c4c0 0x7f10300afc50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 >> 172.21.15.50:0/854091253 conn(0x7f103006a570 msgr2=0x7f103015d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 shutdown_connections 2024-09-13T15:09:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:39.607+0000 7f1037c00700 1 -- 172.21.15.50:0/854091253 wait complete. 2024-09-13T15:09:39.635 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:09:39.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:09:39.676 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:09:39.720 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:09:39.720 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:39.721 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:39.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:09:39.738 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:39.738 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:39.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:09:39.784 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:39.784 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:39.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:09:39.801 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:39.802 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:39.843 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:09:39.843 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T15:09:39.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:40.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.015+0000 7f4260400700 1 Processor -- start 2024-09-13T15:09:40.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.015+0000 7f4260400700 1 -- start start 2024-09-13T15:09:40.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4260400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f425806a5d0 0x7f4258071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4260400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580b19f0 0x7f425806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4260400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42580ce140 con 0x7f42580cd610 2024-09-13T15:09:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4260400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425806aef0 con 0x7f425806a5d0 2024-09-13T15:09:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4260400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42580b1e30 con 0x7f42580b19f0 2024-09-13T15:09:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f425806a5d0 0x7f4258071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f425806a5d0 0x7f4258071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:41266/0 (socket says 172.21.15.50:41266) 2024-09-13T15:09:40.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 -- 172.21.15.50:0/2088420841 learned_addr learned my addr 172.21.15.50:0/2088420841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:40.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425d000700 1 --2- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580b19f0 0x7f425806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425e400700 1 --1- 172.21.15.50:0/2088420841 >> v1:172.21.15.181:6789/0 conn(0x7f42580cd610 0x7f425806ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:56174/0 (socket says 172.21.15.50:56174) 2024-09-13T15:09:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 -- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580b19f0 msgr2=0x7f425806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 --2- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580b19f0 0x7f425806a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 -- 172.21.15.50:0/2088420841 >> v1:172.21.15.181:6789/0 conn(0x7f42580cd610 legacy=0x7f425806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 -- 172.21.15.50:0/2088420841 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580cde60 con 0x7f425806a5d0 2024-09-13T15:09:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f425da00700 1 --2- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f425806a5d0 0x7f4258071d20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f424c009910 tx=0x7f424c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cfdcbbfc0a084e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:40.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4257e00700 1 -- 172.21.15.50:0/2088420841 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c011830 con 0x7f425806a5d0 2024-09-13T15:09:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4257e00700 1 -- 172.21.15.50:0/2088420841 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c011990 con 0x7f425806a5d0 2024-09-13T15:09:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.019+0000 7f4257e00700 1 -- 172.21.15.50:0/2088420841 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c011d40 con 0x7f425806a5d0 2024-09-13T15:09:40.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 -- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f425806a5d0 msgr2=0x7f4258071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 --2- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f425806a5d0 0x7f4258071d20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f424c009910 tx=0x7f424c009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 -- 172.21.15.50:0/2088420841 shutdown_connections 2024-09-13T15:09:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 --2- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580b19f0 0x7f425806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 --2- 172.21.15.50:0/2088420841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f425806a5d0 0x7f4258071d20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 -- 172.21.15.50:0/2088420841 >> 172.21.15.50:0/2088420841 conn(0x7f42580b08d0 msgr2=0x7f42580b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:40.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 -- 172.21.15.50:0/2088420841 shutdown_connections 2024-09-13T15:09:40.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.023+0000 7f4260400700 1 -- 172.21.15.50:0/2088420841 wait complete. 2024-09-13T15:09:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 Processor -- start 2024-09-13T15:09:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 -- start start 2024-09-13T15:09:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 0x7f42581f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42580b19f0 0x7f4258160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580cd610 0x7f4258142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4258160b50 con 0x7f425806a5d0 2024-09-13T15:09:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4258142b50 con 0x7f42580b19f0 2024-09-13T15:09:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f4260400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42581fa7e0 con 0x7f42580cd610 2024-09-13T15:09:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 0x7f42581f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 0x7f42581f7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51058/0 (socket says 172.21.15.50:51058) 2024-09-13T15:09:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 -- 172.21.15.50:0/2380587483 learned_addr learned my addr 172.21.15.50:0/2380587483 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425e400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580cd610 0x7f4258142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425d000700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42580b19f0 0x7f4258160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 -- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580cd610 msgr2=0x7f4258142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580cd610 0x7f4258142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 -- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42580b19f0 msgr2=0x7f4258160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42580b19f0 0x7f4258160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.027+0000 7f425da00700 1 -- 172.21.15.50:0/2380587483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009570 con 0x7f425806a5d0 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f425da00700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 0x7f42581f7b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f42580722d0 tx=0x7f424c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c004510 con 0x7f425806a5d0 2024-09-13T15:09:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c01e070 con 0x7f425806a5d0 2024-09-13T15:09:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42581faac0 con 0x7f425806a5d0 2024-09-13T15:09:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c003900 con 0x7f425806a5d0 2024-09-13T15:09:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42581fb080 con 0x7f425806a5d0 2024-09-13T15:09:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.031+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42580cda80 con 0x7f425806a5d0 2024-09-13T15:09:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.035+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f424c003a60 con 0x7f425806a5d0 2024-09-13T15:09:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.035+0000 7f4255600700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4238066730 0x7f4238068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.035+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f424c084c30 con 0x7f425806a5d0 2024-09-13T15:09:40.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.039+0000 7f425d000700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4238066730 0x7f4238068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.039+0000 7f425d000700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4238066730 0x7f4238068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42580b0520 tx=0x7f4244009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.043+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f424c0520d0 con 0x7f425806a5d0 2024-09-13T15:09:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.291+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42580af410 con 0x7f425806a5d0 2024-09-13T15:09:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.291+0000 7f4255600700 1 -- 172.21.15.50:0/2380587483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f424c015de0 con 0x7f425806a5d0 2024-09-13T15:09:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:40.295 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1117211268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1117211268},{"type":"v1","addr":"172.21.15.181:6835","nonce":1117211268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3946139053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3946139053},{"type":"v1","addr":"172.21.15.50:6833","nonce":3946139053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2375266097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2375266097},{"type":"v1","addr":"172.21.15.50:6835","nonce":2375266097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2165693339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2165693339},{"type":"v1","addr":"172.21.15.181:6837","nonce":2165693339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4238066730 msgr2=0x7f4238068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4238066730 0x7f4238068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42580b0520 tx=0x7f4244009240 comp rx=0 tx=0).stop 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 msgr2=0x7f42581f7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 0x7f42581f7b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f42580722d0 tx=0x7f424c004770 comp rx=0 tx=0).stop 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 shutdown_connections 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4238066730 0x7f4238068bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f42580cd610 0x7f4258142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42580b19f0 0x7f4258160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 --2- 172.21.15.50:0/2380587483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f425806a5d0 0x7f42581f7b80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 >> 172.21.15.50:0/2380587483 conn(0x7f42580b08d0 msgr2=0x7f42580b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 shutdown_connections 2024-09-13T15:09:40.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.295+0000 7f4260400700 1 -- 172.21.15.50:0/2380587483 wait complete. 2024-09-13T15:09:40.301 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2024-09-13T15:09:40.319 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:09:40.319 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T15:09:40.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:09:40.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:09:40.320 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:09:40.320 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T15:09:40.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:09:40.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:09:40.320 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:09:40.320 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T15:09:40.321 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:09:40.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:09:40.321 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:09:40.321 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T15:09:40.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:09:40.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:09:40.339 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:09:40.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:09:40.342 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:09:40.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:09:40.343 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:09:40.343 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:09:40.344 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:09:40.344 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:09:40.389 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:09:40.390 DEBUG:teuthology.parallel:result is None 2024-09-13T15:09:40.390 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:09:40.391 DEBUG:teuthology.parallel:result is None 2024-09-13T15:09:40.392 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:09:40.392 DEBUG:teuthology.parallel:result is None 2024-09-13T15:09:40.395 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:09:40.396 DEBUG:teuthology.parallel:result is None 2024-09-13T15:09:40.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T15:09:40.507 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:09:40.507 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:09:40.514 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:09:40.514 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:09:40.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 Processor -- start 2024-09-13T15:09:40.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 -- start start 2024-09-13T15:09:40.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f757c0cc6f0 0x7f757c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c06aaa0 0x7f757c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0ccb40 con 0x7f757c0cb020 2024-09-13T15:09:40.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c06b430 con 0x7f757c0cc6f0 2024-09-13T15:09:40.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0b2ad0 con 0x7f757c06aaa0 2024-09-13T15:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f757c0cb020 0x7f757c15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56270/0 (socket says 172.21.15.50:56270) 2024-09-13T15:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579e00700 1 -- 172.21.15.50:0/1265950117 learned_addr learned my addr 172.21.15.50:0/1265950117 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579400700 1 --2- 172.21.15.50:0/1265950117 >> v2:172.21.15.50:3300/0 conn(0x7f757c0cc6f0 0x7f757c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f757a800700 1 --2- 172.21.15.50:0/1265950117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c06aaa0 0x7f757c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579400700 1 -- 172.21.15.50:0/1265950117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c06aaa0 msgr2=0x7f757c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579400700 1 --2- 172.21.15.50:0/1265950117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c06aaa0 0x7f757c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579400700 1 -- 172.21.15.50:0/1265950117 >> v1:172.21.15.50:6789/0 conn(0x7f757c0cb020 legacy=0x7f757c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7579400700 1 -- 172.21.15.50:0/1265950117 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c15b960 con 0x7f757c0cc6f0 2024-09-13T15:09:40.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.559+0000 7f7578a00700 1 -- 172.21.15.50:0/1265950117 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480514459 0 0) 0x7f757c0ccb40 con 0x7f757c0cb020 2024-09-13T15:09:40.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f7579400700 1 --2- 172.21.15.50:0/1265950117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0cc6f0 0x7f757c15b0e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7568009850 tx=0x7f7568009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c845f053b0bc90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:40.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f7578a00700 1 -- 172.21.15.50:0/1265950117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011830 con 0x7f757c0cc6f0 2024-09-13T15:09:40.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f7578a00700 1 -- 172.21.15.50:0/1265950117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568011990 con 0x7f757c0cc6f0 2024-09-13T15:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f7578a00700 1 -- 172.21.15.50:0/1265950117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011d40 con 0x7f757c0cc6f0 2024-09-13T15:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 -- 172.21.15.50:0/1265950117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0cc6f0 msgr2=0x7f757c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 --2- 172.21.15.50:0/1265950117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0cc6f0 0x7f757c15b0e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7568009850 tx=0x7f7568009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 -- 172.21.15.50:0/1265950117 shutdown_connections 2024-09-13T15:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 --2- 172.21.15.50:0/1265950117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c06aaa0 0x7f757c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 --2- 172.21.15.50:0/1265950117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0cc6f0 0x7f757c15b0e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 -- 172.21.15.50:0/1265950117 >> 172.21.15.50:0/1265950117 conn(0x7f757c0b0c40 msgr2=0x7f757c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:40.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 -- 172.21.15.50:0/1265950117 shutdown_connections 2024-09-13T15:09:40.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 -- 172.21.15.50:0/1265950117 wait complete. 2024-09-13T15:09:40.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 Processor -- start 2024-09-13T15:09:40.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.563+0000 7f757b200700 1 -- start start 2024-09-13T15:09:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 0x7f757c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c0cb020 0x7f757c0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f757c0cc6f0 0x7f757c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c1446e0 con 0x7f757c06aaa0 2024-09-13T15:09:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c155760 con 0x7f757c0cc6f0 2024-09-13T15:09:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c155a40 con 0x7f757c0cb020 2024-09-13T15:09:40.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 0x7f757c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 0x7f757c1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51108/0 (socket says 172.21.15.50:51108) 2024-09-13T15:09:40.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 -- 172.21.15.50:0/559630812 learned_addr learned my addr 172.21.15.50:0/559630812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:40.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757a800700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f757c0cc6f0 0x7f757c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579400700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c0cb020 0x7f757c0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 -- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c0cb020 msgr2=0x7f757c0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c0cb020 0x7f757c0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 -- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f757c0cc6f0 msgr2=0x7f757c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f757c0cc6f0 0x7f757c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 -- 172.21.15.50:0/559630812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75680094b0 con 0x7f757c06aaa0 2024-09-13T15:09:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7579e00700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 0x7f757c1441a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c580 tx=0x7f756c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c004ca0 con 0x7f757c06aaa0 2024-09-13T15:09:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c004e20 con 0x7f757c06aaa0 2024-09-13T15:09:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c007310 con 0x7f757c06aaa0 2024-09-13T15:09:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c155d20 con 0x7f757c06aaa0 2024-09-13T15:09:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.567+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c1562e0 con 0x7f757c06aaa0 2024-09-13T15:09:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.571+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c0cb400 con 0x7f757c06aaa0 2024-09-13T15:09:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.571+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f756c007470 con 0x7f757c06aaa0 2024-09-13T15:09:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.575+0000 7f7572000700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f755c066760 0x7f755c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.575+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f756c083c00 con 0x7f757c06aaa0 2024-09-13T15:09:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.575+0000 7f7579400700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f755c066760 0x7f755c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.575+0000 7f7579400700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f755c066760 0x7f755c068c20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f75680090b0 tx=0x7f756801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:40.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.583+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f756c051120 con 0x7f757c06aaa0 2024-09-13T15:09:40.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:40.783+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f757c0ce2a0 con 0x7f757c06aaa0 2024-09-13T15:09:41.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.611+0000 7f7572000700 1 -- 172.21.15.50:0/559630812 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7f756c007720 con 0x7f757c06aaa0 2024-09-13T15:09:41.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f755c066760 msgr2=0x7f755c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f755c066760 0x7f755c068c20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f75680090b0 tx=0x7f756801c040 comp rx=0 tx=0).stop 2024-09-13T15:09:41.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 msgr2=0x7f757c1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 0x7f757c1441a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c580 tx=0x7f756c00c890 comp rx=0 tx=0).stop 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 shutdown_connections 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f755c066760 0x7f755c068c20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f757c0cc6f0 0x7f757c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f757c0cb020 0x7f757c0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 --2- 172.21.15.50:0/559630812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06aaa0 0x7f757c1441a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 >> 172.21.15.50:0/559630812 conn(0x7f757c0b0c40 msgr2=0x7f757c158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 shutdown_connections 2024-09-13T15:09:41.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.615+0000 7f757b200700 1 -- 172.21.15.50:0/559630812 wait complete. 2024-09-13T15:09:41.622 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-13T15:09:41.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T15:09:41.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.823+0000 7f2c3a600700 1 Processor -- start 2024-09-13T15:09:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.823+0000 7f2c3a600700 1 -- start start 2024-09-13T15:09:41.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c3a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c3406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c3a600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c340b3560 con 0x7f2c340b2670 2024-09-13T15:09:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c3a600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3406b420 con 0x7f2c341610b0 2024-09-13T15:09:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c3a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34070b30 con 0x7f2c3406aaa0 2024-09-13T15:09:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c39c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2c340b2670 0x7f2c340cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56276/0 (socket says 172.21.15.50:56276) 2024-09-13T15:09:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c39c00700 1 -- 172.21.15.50:0/2227927572 learned_addr learned my addr 172.21.15.50:0/2227927572 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c2be00700 1 --2- 172.21.15.50:0/2227927572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c3406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511592301 0 0) 0x7f2c340b3560 con 0x7f2c340b2670 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c180035d0 con 0x7f2c340b2670 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006309034 0 0) 0x7f2c3406b420 con 0x7f2c341610b0 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c340b3560 con 0x7f2c341610b0 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c2be00700 1 -- 172.21.15.50:0/2227927572 >> v1:172.21.15.181:6789/0 conn(0x7f2c341610b0 legacy=0x7f2c340719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c2be00700 1 -- 172.21.15.50:0/2227927572 >> v1:172.21.15.50:6789/0 conn(0x7f2c340b2670 legacy=0x7f2c340cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c2be00700 1 -- 172.21.15.50:0/2227927572 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340b3280 con 0x7f2c3406aaa0 2024-09-13T15:09:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c2be00700 1 --2- 172.21.15.50:0/2227927572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c3406aee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009880 tx=0x7f2c1c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5856bbf1ecfbac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c011830 con 0x7f2c3406aaa0 2024-09-13T15:09:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c011990 con 0x7f2c3406aaa0 2024-09-13T15:09:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.827+0000 7f2c33e00700 1 -- 172.21.15.50:0/2227927572 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c011d00 con 0x7f2c3406aaa0 2024-09-13T15:09:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 -- 172.21.15.50:0/2227927572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 msgr2=0x7f2c3406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 --2- 172.21.15.50:0/2227927572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c3406aee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009880 tx=0x7f2c1c009b90 comp rx=0 tx=0).stop 2024-09-13T15:09:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 -- 172.21.15.50:0/2227927572 shutdown_connections 2024-09-13T15:09:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 --2- 172.21.15.50:0/2227927572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c3406aee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 -- 172.21.15.50:0/2227927572 >> 172.21.15.50:0/2227927572 conn(0x7f2c340b0c40 msgr2=0x7f2c3406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 -- 172.21.15.50:0/2227927572 shutdown_connections 2024-09-13T15:09:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 -- 172.21.15.50:0/2227927572 wait complete. 2024-09-13T15:09:41.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.831+0000 7f2c3a600700 1 Processor -- start 2024-09-13T15:09:41.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 -- start start 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c34158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 0x7f2c34163850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c341610b0 0x7f2c34163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34159e20 con 0x7f2c340b2670 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c341ec570 con 0x7f2c341610b0 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c3a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c341ec850 con 0x7f2c3406aaa0 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 0x7f2c34163850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 0x7f2c34163850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51120/0 (socket says 172.21.15.50:51120) 2024-09-13T15:09:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 -- 172.21.15.50:0/3342772073 learned_addr learned my addr 172.21.15.50:0/3342772073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c39200700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c34158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c39c00700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c341610b0 0x7f2c34163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 -- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 msgr2=0x7f2c34158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c34158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 -- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c341610b0 msgr2=0x7f2c34163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c341610b0 0x7f2c34163d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 -- 172.21.15.50:0/3342772073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0094b0 con 0x7f2c340b2670 2024-09-13T15:09:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.835+0000 7f2c2be00700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 0x7f2c34163850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0090b0 tx=0x7f2c1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c004510 con 0x7f2c340b2670 2024-09-13T15:09:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c0036c0 con 0x7f2c340b2670 2024-09-13T15:09:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c341ecb30 con 0x7f2c340b2670 2024-09-13T15:09:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c003a70 con 0x7f2c340b2670 2024-09-13T15:09:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c34158b40 con 0x7f2c340b2670 2024-09-13T15:09:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3415a040 con 0x7f2c340b2670 2024-09-13T15:09:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.839+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c1c003bd0 con 0x7f2c340b2670 2024-09-13T15:09:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.843+0000 7f2c31600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c10066730 0x7f2c10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.843+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2c1c085420 con 0x7f2c340b2670 2024-09-13T15:09:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.843+0000 7f2c39200700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c10066730 0x7f2c10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.843+0000 7f2c39200700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c10066730 0x7f2c10068bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c240011e0 tx=0x7f2c24009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:41.851+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c3415a040 con 0x7f2c340b2670 2024-09-13T15:09:42.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.103+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2c3415a040 con 0x7f2c340b2670 2024-09-13T15:09:42.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c31600700 1 -- 172.21.15.50:0/3342772073 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2c3415a040 con 0x7f2c340b2670 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w==", 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ==", 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.112 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw==", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ==", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw==", 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw==", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g==", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.115 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg==", 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.116 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg==", 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-13T15:09:42.117 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw==", 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA==", 2024-09-13T15:09:42.118 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g==", 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg==", 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A==", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw==", 2024-09-13T15:09:42.121 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g==", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:09:42.122 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORmfQGsHhAAoWi5rerqSyo7H67168RTZw==", 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg==", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w==", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:09:42.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:09:42.125 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:09:42.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:42.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:09:42.125 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c10066730 msgr2=0x7f2c10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c10066730 0x7f2c10068bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c240011e0 tx=0x7f2c24009040 comp rx=0 tx=0).stop 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 msgr2=0x7f2c34163850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 0x7f2c34163850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0090b0 tx=0x7f2c1c004770 comp rx=0 tx=0).stop 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 shutdown_connections 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2c10066730 0x7f2c10068bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2c341610b0 0x7f2c34163d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c340b2670 0x7f2c34163850 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 --2- 172.21.15.50:0/3342772073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2c3406aaa0 0x7f2c34158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 >> 172.21.15.50:0/3342772073 conn(0x7f2c340b0c40 msgr2=0x7f2c3415f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.107+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 shutdown_connections 2024-09-13T15:09:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.111+0000 7f2c3a600700 1 -- 172.21.15.50:0/3342772073 wait complete. 2024-09-13T15:09:42.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.299+0000 7f2a25400700 1 Processor -- start 2024-09-13T15:09:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.299+0000 7f2a25400700 1 -- start start 2024-09-13T15:09:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.299+0000 7f2a25400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2a2015d310 0x7f2a200b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.299+0000 7f2a25400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2015e560 con 0x7f2a2015e9f0 2024-09-13T15:09:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a25400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2015d920 con 0x7f2a2006aaa0 2024-09-13T15:09:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a25400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200b3ec0 con 0x7f2a2015d310 2024-09-13T15:09:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a24a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a2015e9f0 0x7f2a2015ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56290/0 (socket says 172.21.15.50:56290) 2024-09-13T15:09:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a24a00700 1 -- 172.21.15.50:0/3593206540 learned_addr learned my addr 172.21.15.50:0/3593206540 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a17400700 1 --2- 172.21.15.50:0/3593206540 >> v2:172.21.15.181:3300/0 conn(0x7f2a2015d310 0x7f2a200b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553359021 0 0) 0x7f2a2015e560 con 0x7f2a2015e9f0 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a040035d0 con 0x7f2a2015e9f0 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965493954 0 0) 0x7f2a2015d920 con 0x7f2a2006aaa0 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a2015e560 con 0x7f2a2006aaa0 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a17400700 1 -- 172.21.15.50:0/3593206540 >> v1:172.21.15.181:6789/0 conn(0x7f2a2006aaa0 legacy=0x7f2a2006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a17400700 1 -- 172.21.15.50:0/3593206540 >> v1:172.21.15.50:6789/0 conn(0x7f2a2015e9f0 legacy=0x7f2a2015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a17400700 1 -- 172.21.15.50:0/3593206540 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2015dc00 con 0x7f2a2015d310 2024-09-13T15:09:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a17400700 1 --2- 172.21.15.50:0/3593206540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a200b3980 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009850 tx=0x7f2a08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f91841ab6aa18fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011830 con 0x7f2a2015d310 2024-09-13T15:09:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08011990 con 0x7f2a2015d310 2024-09-13T15:09:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.303+0000 7f2a1f400700 1 -- 172.21.15.50:0/3593206540 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011d00 con 0x7f2a2015d310 2024-09-13T15:09:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 -- 172.21.15.50:0/3593206540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 msgr2=0x7f2a200b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 --2- 172.21.15.50:0/3593206540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a200b3980 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009850 tx=0x7f2a08009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 -- 172.21.15.50:0/3593206540 shutdown_connections 2024-09-13T15:09:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 --2- 172.21.15.50:0/3593206540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a200b3980 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 -- 172.21.15.50:0/3593206540 >> 172.21.15.50:0/3593206540 conn(0x7f2a200b0c40 msgr2=0x7f2a2006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 -- 172.21.15.50:0/3593206540 shutdown_connections 2024-09-13T15:09:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.307+0000 7f2a25400700 1 -- 172.21.15.50:0/3593206540 wait complete. 2024-09-13T15:09:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 Processor -- start 2024-09-13T15:09:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 -- start start 2024-09-13T15:09:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a2006aaa0 0x7f2a2013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a2015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 0x7f2a20138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2013a720 con 0x7f2a2015e9f0 2024-09-13T15:09:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2015ce40 con 0x7f2a2015d310 2024-09-13T15:09:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a25400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a201396b0 con 0x7f2a2006aaa0 2024-09-13T15:09:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 0x7f2a20138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 0x7f2a20138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51132/0 (socket says 172.21.15.50:51132) 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 -- 172.21.15.50:0/2845755073 learned_addr learned my addr 172.21.15.50:0/2845755073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a17400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a2015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a1fe00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a2006aaa0 0x7f2a2013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 -- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a2006aaa0 msgr2=0x7f2a2013d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a2006aaa0 0x7f2a2013d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 -- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 msgr2=0x7f2a2015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a2015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 -- 172.21.15.50:0/2845755073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080094b0 con 0x7f2a2015e9f0 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a17400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a2015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.311+0000 7f2a24a00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 0x7f2a20138e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c500 tx=0x7f2a1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18005d90 con 0x7f2a2015e9f0 2024-09-13T15:09:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a180070d0 con 0x7f2a2015e9f0 2024-09-13T15:09:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a20139990 con 0x7f2a2015e9f0 2024-09-13T15:09:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18007480 con 0x7f2a2015e9f0 2024-09-13T15:09:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2013a970 con 0x7f2a2015e9f0 2024-09-13T15:09:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2013ab60 con 0x7f2a2015e9f0 2024-09-13T15:09:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.315+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a180075e0 con 0x7f2a2015e9f0 2024-09-13T15:09:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.319+0000 7f2a1cc00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29fc066730 0x7f29fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.319+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2a18083420 con 0x7f2a2015e9f0 2024-09-13T15:09:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.319+0000 7f2a1fe00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29fc066730 0x7f29fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.319+0000 7f2a1fe00700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29fc066730 0x7f29fc068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2a100021f0 tx=0x7f2a10009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:42.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.327+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a18050990 con 0x7f2a2015e9f0 2024-09-13T15:09:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.527+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a200b3980 con 0x7f2a2015e9f0 2024-09-13T15:09:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.527+0000 7f2a1cc00700 1 -- 172.21.15.50:0/2845755073 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13050 (secure 0 0 0) 0x7f2a18053fb0 con 0x7f2a2015e9f0 2024-09-13T15:09:42.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:42.534 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":49,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:41.607031+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29fc066730 msgr2=0x7f29fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29fc066730 0x7f29fc068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2a100021f0 tx=0x7f2a10009040 comp rx=0 tx=0).stop 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 msgr2=0x7f2a20138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 0x7f2a20138e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c500 tx=0x7f2a1800c8c0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 shutdown_connections 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29fc066730 0x7f29fc068bf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2015e9f0 0x7f2a20138e60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a2015d310 0x7f2a2015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 --2- 172.21.15.50:0/2845755073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a2006aaa0 0x7f2a2013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 >> 172.21.15.50:0/2845755073 conn(0x7f2a200b0c40 msgr2=0x7f2a2006d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:42.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 shutdown_connections 2024-09-13T15:09:42.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.535+0000 7f2a25400700 1 -- 172.21.15.50:0/2845755073 wait complete. 2024-09-13T15:09:42.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:42.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:42.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.743+0000 7f36ba400700 1 Processor -- start 2024-09-13T15:09:42.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.743+0000 7f36ba400700 1 -- start start 2024-09-13T15:09:42.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36ba400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b415a3a0 0x7f36b415a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36ba400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36b40b35b0 0x7f36b406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36ba400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40b58f0 con 0x7f36b406f2b0 2024-09-13T15:09:42.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36ba400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b406f720 con 0x7f36b40b35b0 2024-09-13T15:09:42.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36ba400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40b3a90 con 0x7f36b415a3a0 2024-09-13T15:09:42.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b3e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36b406f2b0 0x7f36b406a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56306/0 (socket says 172.21.15.50:56306) 2024-09-13T15:09:42.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b3e00700 1 -- 172.21.15.50:0/1332300190 learned_addr learned my addr 172.21.15.50:0/1332300190 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:42.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2a00700 1 --2- 172.21.15.50:0/1332300190 >> v2:172.21.15.50:3300/0 conn(0x7f36b40b35b0 0x7f36b406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b3400700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b415a3a0 0x7f36b415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2000700 1 -- 172.21.15.50:0/1332300190 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724996989 0 0) 0x7f36b40b58f0 con 0x7f36b406f2b0 2024-09-13T15:09:42.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2000700 1 -- 172.21.15.50:0/1332300190 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36980035d0 con 0x7f36b406f2b0 2024-09-13T15:09:42.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2a00700 1 -- 172.21.15.50:0/1332300190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b415a3a0 msgr2=0x7f36b415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:42.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2a00700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b415a3a0 0x7f36b415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2a00700 1 -- 172.21.15.50:0/1332300190 >> v1:172.21.15.50:6789/0 conn(0x7f36b406f2b0 legacy=0x7f36b406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b2a00700 1 -- 172.21.15.50:0/1332300190 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40b3d70 con 0x7f36b40b35b0 2024-09-13T15:09:42.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.747+0000 7f36b3400700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b415a3a0 0x7f36b415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:42.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36b2a00700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b40b35b0 0x7f36b406ed70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009850 tx=0x7f36a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61aa6b88704b59bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:42.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36b2000700 1 -- 172.21.15.50:0/1332300190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0011830 con 0x7f36b40b35b0 2024-09-13T15:09:42.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36b2000700 1 -- 172.21.15.50:0/1332300190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0011990 con 0x7f36b40b35b0 2024-09-13T15:09:42.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36b2000700 1 -- 172.21.15.50:0/1332300190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0011d40 con 0x7f36b40b35b0 2024-09-13T15:09:42.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 -- 172.21.15.50:0/1332300190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b40b35b0 msgr2=0x7f36b406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b40b35b0 0x7f36b406ed70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009850 tx=0x7f36a0009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:42.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 -- 172.21.15.50:0/1332300190 shutdown_connections 2024-09-13T15:09:42.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b40b35b0 0x7f36b406ed70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 --2- 172.21.15.50:0/1332300190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b415a3a0 0x7f36b415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 -- 172.21.15.50:0/1332300190 >> 172.21.15.50:0/1332300190 conn(0x7f36b406d530 msgr2=0x7f36b406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:42.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 -- 172.21.15.50:0/1332300190 shutdown_connections 2024-09-13T15:09:42.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.751+0000 7f36ba400700 1 -- 172.21.15.50:0/1332300190 wait complete. 2024-09-13T15:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 Processor -- start 2024-09-13T15:09:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 -- start start 2024-09-13T15:09:42.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b406f2b0 0x7f36b41564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b40b35b0 0x7f36b4154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 0x7f36b4157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4153480 con 0x7f36b415a3a0 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40ae2d0 con 0x7f36b406f2b0 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36ba400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b41f3a10 con 0x7f36b40b35b0 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 0x7f36b4157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 0x7f36b4157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51148/0 (socket says 172.21.15.50:51148) 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b3e00700 1 -- 172.21.15.50:0/1652275572 learned_addr learned my addr 172.21.15.50:0/1652275572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b2a00700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b40b35b0 0x7f36b4154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b3400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b406f2b0 0x7f36b41564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b3e00700 1 -- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b40b35b0 msgr2=0x7f36b4154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.755+0000 7f36b3e00700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b40b35b0 0x7f36b4154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36b3e00700 1 -- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b406f2b0 msgr2=0x7f36b41564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36b3e00700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b406f2b0 0x7f36b41564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36b3e00700 1 -- 172.21.15.50:0/1652275572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00094b0 con 0x7f36b415a3a0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36b3e00700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 0x7f36b4157540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00cb40 tx=0x7f36ac00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00a7b0 con 0x7f36b415a3a0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac00a910 con 0x7f36b415a3a0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00ac80 con 0x7f36b415a3a0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b41536b0 con 0x7f36b415a3a0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b4153c30 con 0x7f36b415a3a0 2024-09-13T15:09:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b406ed70 con 0x7f36b415a3a0 2024-09-13T15:09:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.759+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36ac01b3b0 con 0x7f36b415a3a0 2024-09-13T15:09:42.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.763+0000 7f36ab400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3694066730 0x7f3694068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.763+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f36ac083780 con 0x7f36b415a3a0 2024-09-13T15:09:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.763+0000 7f36b3400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3694066730 0x7f3694068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.763+0000 7f36b3400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3694066730 0x7f3694068bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f36b40aeb50 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.771+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36ac050e40 con 0x7f36b415a3a0 2024-09-13T15:09:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.947+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36b406efe0 con 0x7f36b415a3a0 2024-09-13T15:09:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.947+0000 7f36ab400700 1 -- 172.21.15.50:0/1652275572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36ac017020 con 0x7f36b415a3a0 2024-09-13T15:09:42.954 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.951+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3694066730 msgr2=0x7f3694068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3694066730 0x7f3694068bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f36b40aeb50 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2024-09-13T15:09:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 msgr2=0x7f36b4157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 0x7f36b4157540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00cb40 tx=0x7f36ac00cb70 comp rx=0 tx=0).stop 2024-09-13T15:09:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 shutdown_connections 2024-09-13T15:09:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3694066730 0x7f3694068bf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b415a3a0 0x7f36b4157540 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f36b40b35b0 0x7f36b4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 --2- 172.21.15.50:0/1652275572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36b406f2b0 0x7f36b41564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 >> 172.21.15.50:0/1652275572 conn(0x7f36b406d530 msgr2=0x7f36b40ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 shutdown_connections 2024-09-13T15:09:42.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:42.955+0000 7f36ba400700 1 -- 172.21.15.50:0/1652275572 wait complete. 2024-09-13T15:09:42.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:09:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.163+0000 7fa94f600700 1 Processor -- start 2024-09-13T15:09:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.163+0000 7fa94f600700 1 -- start start 2024-09-13T15:09:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94f600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa94813dbf0 0x7fa9480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94f600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa94815ef90 0x7fa94806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94f600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94815f5f0 con 0x7fa9480b5410 2024-09-13T15:09:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94f600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94815b090 con 0x7fa94815ef90 2024-09-13T15:09:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94f600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480b5850 con 0x7fa94813dbf0 2024-09-13T15:09:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa94815ef90 0x7fa94806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa94815ef90 0x7fa94806a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:41484/0 (socket says 172.21.15.50:41484) 2024-09-13T15:09:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 -- 172.21.15.50:0/98021969 learned_addr learned my addr 172.21.15.50:0/98021969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa947e00700 1 --1- 172.21.15.50:0/98021969 >> v1:172.21.15.181:6789/0 conn(0x7fa9480b5410 0x7fa94815e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:59194/0 (socket says 172.21.15.50:59194) 2024-09-13T15:09:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94cc00700 1 --2- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa94813dbf0 0x7fa9480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 -- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa94813dbf0 msgr2=0x7fa9480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 --2- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa94813dbf0 0x7fa9480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 -- 172.21.15.50:0/98021969 >> v1:172.21.15.181:6789/0 conn(0x7fa9480b5410 legacy=0x7fa94815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 -- 172.21.15.50:0/98021969 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94813dfd0 con 0x7fa94815ef90 2024-09-13T15:09:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa94d600700 1 --2- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94806a390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa940009e50 tx=0x7fa94000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=136c78711efcf93d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.167+0000 7fa947400700 1 -- 172.21.15.50:0/98021969 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000e070 con 0x7fa94815ef90 2024-09-13T15:09:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa947400700 1 -- 172.21.15.50:0/98021969 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000b910 con 0x7fa94815ef90 2024-09-13T15:09:43.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa947400700 1 -- 172.21.15.50:0/98021969 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000bcc0 con 0x7fa94815ef90 2024-09-13T15:09:43.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 -- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 msgr2=0x7fa94806a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 --2- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94806a390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa940009e50 tx=0x7fa94000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:43.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 -- 172.21.15.50:0/98021969 shutdown_connections 2024-09-13T15:09:43.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 --2- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94806a390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 --2- 172.21.15.50:0/98021969 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa94813dbf0 0x7fa9480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 -- 172.21.15.50:0/98021969 >> 172.21.15.50:0/98021969 conn(0x7fa94806cbe0 msgr2=0x7fa94806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:43.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 -- 172.21.15.50:0/98021969 shutdown_connections 2024-09-13T15:09:43.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 -- 172.21.15.50:0/98021969 wait complete. 2024-09-13T15:09:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 Processor -- start 2024-09-13T15:09:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.171+0000 7fa94f600700 1 -- start start 2024-09-13T15:09:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94f600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9480b5410 0x7fa9481549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94f600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 0x7fa94814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94f600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94813c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94f600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480b3340 con 0x7fa94813dbf0 2024-09-13T15:09:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94f600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480b2d60 con 0x7fa94815ef90 2024-09-13T15:09:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94f600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481f27b0 con 0x7fa9480b5410 2024-09-13T15:09:43.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 0x7fa94814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 0x7fa94814c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41946/0 (socket says 172.21.15.50:41946) 2024-09-13T15:09:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 -- 172.21.15.50:0/4203110657 learned_addr learned my addr 172.21.15.50:0/4203110657 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94d600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94813c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa94cc00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9480b5410 0x7fa9481549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 -- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9480b5410 msgr2=0x7fa9481549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9480b5410 0x7fa9481549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 -- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 msgr2=0x7fa94813c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94813c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 -- 172.21.15.50:0/4203110657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009b30 con 0x7fa94813dbf0 2024-09-13T15:09:43.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.175+0000 7fa947e00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 0x7fa94814c330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa93400c6e0 tx=0x7fa93400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:43.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934005cd0 con 0x7fa94813dbf0 2024-09-13T15:09:43.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934005e30 con 0x7fa94813dbf0 2024-09-13T15:09:43.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340072d0 con 0x7fa94813dbf0 2024-09-13T15:09:43.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948159280 con 0x7fa94813dbf0 2024-09-13T15:09:43.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9481546e0 con 0x7fa94813dbf0 2024-09-13T15:09:43.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9480b5a00 con 0x7fa94813dbf0 2024-09-13T15:09:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.179+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa934007430 con 0x7fa94813dbf0 2024-09-13T15:09:43.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.183+0000 7fa944c00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa928066760 0x7fa928068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.183+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa934083220 con 0x7fa94813dbf0 2024-09-13T15:09:43.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.183+0000 7fa94cc00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa928066760 0x7fa928068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.183+0000 7fa94cc00700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa928066760 0x7fa928068c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bf0 tx=0x7fa93c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:43.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.191+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9340507b0 con 0x7fa94813dbf0 2024-09-13T15:09:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.387+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa94815bb10 con 0x7fa94813dbf0 2024-09-13T15:09:43.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.387+0000 7fa944c00700 1 -- 172.21.15.50:0/4203110657 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa934017090 con 0x7fa94813dbf0 2024-09-13T15:09:43.393 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:09:43.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:09:43.393 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:09:43.393 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:09:43.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:09:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:09:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa928066760 msgr2=0x7fa928068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa928066760 0x7fa928068c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bf0 tx=0x7fa93c009240 comp rx=0 tx=0).stop 2024-09-13T15:09:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 msgr2=0x7fa94814c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 0x7fa94814c330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa93400c6e0 tx=0x7fa93400c9f0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 shutdown_connections 2024-09-13T15:09:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa928066760 0x7fa928068c20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94815ef90 0x7fa94813c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94813dbf0 0x7fa94814c330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 --2- 172.21.15.50:0/4203110657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9480b5410 0x7fa9481549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 >> 172.21.15.50:0/4203110657 conn(0x7fa94806cbe0 msgr2=0x7fa94806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 shutdown_connections 2024-09-13T15:09:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.391+0000 7fa94f600700 1 -- 172.21.15.50:0/4203110657 wait complete. 2024-09-13T15:09:43.418 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:09:43.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:09:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.587+0000 7ff1e0a00700 1 Processor -- start 2024-09-13T15:09:43.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.587+0000 7ff1e0a00700 1 -- start start 2024-09-13T15:09:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1e0a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1dc144330 0x7ff1dc0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1e0a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc144710 0x7ff1dc0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1e0a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc06bcf0 con 0x7ff1dc06d760 2024-09-13T15:09:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1e0a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc0cce10 con 0x7ff1dc144330 2024-09-13T15:09:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1e0a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc06cb50 con 0x7ff1dc144710 2024-09-13T15:09:43.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1dc144330 0x7ff1dc0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1dc144330 0x7ff1dc0cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41960/0 (socket says 172.21.15.50:41960) 2024-09-13T15:09:43.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff1dc06d760 0x7ff1dc0b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:59210/0 (socket says 172.21.15.50:59210) 2024-09-13T15:09:43.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 -- 172.21.15.50:0/2757706732 learned_addr learned my addr 172.21.15.50:0/2757706732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:43.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1da800700 1 --2- 172.21.15.50:0/2757706732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc144710 0x7ff1dc0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 -- 172.21.15.50:0/2757706732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc144710 msgr2=0x7ff1dc0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:43.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 --2- 172.21.15.50:0/2757706732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc144710 0x7ff1dc0b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 -- 172.21.15.50:0/2757706732 >> v1:172.21.15.181:6789/0 conn(0x7ff1dc06d760 legacy=0x7ff1dc0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d8a00700 1 -- 172.21.15.50:0/2757706732 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157196424 0 0) 0x7ff1dc06bcf0 con 0x7ff1dc06d760 2024-09-13T15:09:43.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.591+0000 7ff1d9e00700 1 -- 172.21.15.50:0/2757706732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0cf4b0 con 0x7ff1dc144330 2024-09-13T15:09:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1d9e00700 1 --2- 172.21.15.50:0/2757706732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc0cef70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009910 tx=0x7ff1cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba23aada0ed754d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1d8a00700 1 -- 172.21.15.50:0/2757706732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00ba60 con 0x7ff1dc144330 2024-09-13T15:09:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1d8a00700 1 -- 172.21.15.50:0/2757706732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00bbc0 con 0x7ff1dc144330 2024-09-13T15:09:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1d8a00700 1 -- 172.21.15.50:0/2757706732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc009e60 con 0x7ff1dc144330 2024-09-13T15:09:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 -- 172.21.15.50:0/2757706732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 msgr2=0x7ff1dc0cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/2757706732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc0cef70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009910 tx=0x7ff1cc009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 -- 172.21.15.50:0/2757706732 shutdown_connections 2024-09-13T15:09:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/2757706732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc144710 0x7ff1dc0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/2757706732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc0cef70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 -- 172.21.15.50:0/2757706732 >> 172.21.15.50:0/2757706732 conn(0x7ff1dc06a570 msgr2=0x7ff1dc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 -- 172.21.15.50:0/2757706732 shutdown_connections 2024-09-13T15:09:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.595+0000 7ff1e0a00700 1 -- 172.21.15.50:0/2757706732 wait complete. 2024-09-13T15:09:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 Processor -- start 2024-09-13T15:09:43.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 -- start start 2024-09-13T15:09:43.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1dc06d760 0x7ff1dc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc154e90 0x7ff1dc152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0b1650 con 0x7ff1dc144330 2024-09-13T15:09:43.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc1515a0 con 0x7ff1dc06d760 2024-09-13T15:09:43.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1e0a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc155320 con 0x7ff1dc154e90 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41972/0 (socket says 172.21.15.50:41972) 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 -- 172.21.15.50:0/898061168 learned_addr learned my addr 172.21.15.50:0/898061168 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9e00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1dc06d760 0x7ff1dc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1da800700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc154e90 0x7ff1dc152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 -- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc154e90 msgr2=0x7ff1dc152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc154e90 0x7ff1dc152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 -- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1dc06d760 msgr2=0x7ff1dc143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1dc06d760 0x7ff1dc143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1d9400700 1 -- 172.21.15.50:0/898061168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc009570 con 0x7ff1dc144330 2024-09-13T15:09:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.599+0000 7ff1da800700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc154e90 0x7ff1dc152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1d9400700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc151060 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c750 tx=0x7ff1c800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8004ca0 con 0x7ff1dc144330 2024-09-13T15:09:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8004e00 con 0x7ff1dc144330 2024-09-13T15:09:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8007310 con 0x7ff1dc144330 2024-09-13T15:09:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc0b0db0 con 0x7ff1dc144330 2024-09-13T15:09:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc0b1370 con 0x7ff1dc144330 2024-09-13T15:09:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc0b3d90 con 0x7ff1dc144330 2024-09-13T15:09:43.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.603+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1c8007470 con 0x7ff1dc144330 2024-09-13T15:09:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.607+0000 7ff1d2000700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1bc066730 0x7ff1bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.607+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff1c8083c50 con 0x7ff1dc144330 2024-09-13T15:09:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.607+0000 7ff1d9e00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1bc066730 0x7ff1bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.607+0000 7ff1d9e00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1bc066730 0x7ff1bc068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009c60 tx=0x7ff1cc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.615+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1c80511c0 con 0x7ff1dc144330 2024-09-13T15:09:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:43.803+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff1dc15e200 con 0x7ff1dc144330 2024-09-13T15:09:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.191+0000 7ff1d2000700 1 -- 172.21.15.50:0/898061168 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff1c8007720 con 0x7ff1dc144330 2024-09-13T15:09:44.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1bc066730 msgr2=0x7ff1bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1bc066730 0x7ff1bc068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009c60 tx=0x7ff1cc008030 comp rx=0 tx=0).stop 2024-09-13T15:09:44.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 msgr2=0x7ff1dc151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc151060 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c750 tx=0x7ff1c800ca60 comp rx=0 tx=0).stop 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 shutdown_connections 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1bc066730 0x7ff1bc068bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1dc154e90 0x7ff1dc152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1dc144330 0x7ff1dc151060 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 --2- 172.21.15.50:0/898061168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1dc06d760 0x7ff1dc143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 >> 172.21.15.50:0/898061168 conn(0x7ff1dc06a570 msgr2=0x7ff1dc0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 shutdown_connections 2024-09-13T15:09:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.195+0000 7ff1e0a00700 1 -- 172.21.15.50:0/898061168 wait complete. 2024-09-13T15:09:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:09:44.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:09:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.399+0000 7f2427200700 1 Processor -- start 2024-09-13T15:09:44.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.399+0000 7f2427200700 1 -- start start 2024-09-13T15:09:44.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2427200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24280b41c0 0x7f24280b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2427200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280b5780 con 0x7f242806c5a0 2024-09-13T15:09:44.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2427200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280b5a60 con 0x7f24280cd380 2024-09-13T15:09:44.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2427200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280b39c0 con 0x7f24280b41c0 2024-09-13T15:09:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2425e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f242806c5a0 0x7f242815ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58792/0 (socket says 172.21.15.50:58792) 2024-09-13T15:09:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2425e00700 1 -- 172.21.15.50:0/2846863719 learned_addr learned my addr 172.21.15.50:0/2846863719 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2426800700 1 --2- 172.21.15.50:0/2846863719 >> v2:172.21.15.50:3300/0 conn(0x7f24280b41c0 0x7f24280b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510788292 0 0) 0x7f24280b5a60 con 0x7f24280cd380 2024-09-13T15:09:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f240c0035d0 con 0x7f24280cd380 2024-09-13T15:09:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331883753 0 0) 0x7f24280b5780 con 0x7f242806c5a0 2024-09-13T15:09:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24280b5a60 con 0x7f242806c5a0 2024-09-13T15:09:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2426800700 1 -- 172.21.15.50:0/2846863719 >> v1:172.21.15.181:6789/0 conn(0x7f24280cd380 legacy=0x7f242806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2426800700 1 -- 172.21.15.50:0/2846863719 >> v1:172.21.15.50:6789/0 conn(0x7f242806c5a0 legacy=0x7f242815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2426800700 1 -- 172.21.15.50:0/2846863719 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280b3ca0 con 0x7f24280b41c0 2024-09-13T15:09:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2426800700 1 --2- 172.21.15.50:0/2846863719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280b4650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2420009d90 tx=0x7f242000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00828516f00d259 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000e070 con 0x7f24280b41c0 2024-09-13T15:09:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000bb20 con 0x7f24280b41c0 2024-09-13T15:09:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.403+0000 7f2424a00700 1 -- 172.21.15.50:0/2846863719 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000be90 con 0x7f24280b41c0 2024-09-13T15:09:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 -- 172.21.15.50:0/2846863719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 msgr2=0x7f24280b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 --2- 172.21.15.50:0/2846863719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280b4650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2420009d90 tx=0x7f242000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 -- 172.21.15.50:0/2846863719 shutdown_connections 2024-09-13T15:09:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 --2- 172.21.15.50:0/2846863719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280b4650 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 -- 172.21.15.50:0/2846863719 >> 172.21.15.50:0/2846863719 conn(0x7f2428066270 msgr2=0x7f2428071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 -- 172.21.15.50:0/2846863719 shutdown_connections 2024-09-13T15:09:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 -- 172.21.15.50:0/2846863719 wait complete. 2024-09-13T15:09:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.407+0000 7f2427200700 1 Processor -- start 2024-09-13T15:09:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 -- start start 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f242806c5a0 0x7f24281e4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24280cd380 0x7f24280cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280b26f0 con 0x7f24280b41c0 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280ae960 con 0x7f24280cd380 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2427200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280b2350 con 0x7f242806c5a0 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280ad8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42000/0 (socket says 172.21.15.50:42000) 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 -- 172.21.15.50:0/181016372 learned_addr learned my addr 172.21.15.50:0/181016372 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425e00700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f242806c5a0 0x7f24281e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2426800700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24280cd380 0x7f24280cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 -- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f242806c5a0 msgr2=0x7f24281e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f242806c5a0 0x7f24281e4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 -- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24280cd380 msgr2=0x7f24280cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24280cd380 0x7f24280cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425400700 1 -- 172.21.15.50:0/181016372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009a70 con 0x7f24280b41c0 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2425e00700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f242806c5a0 0x7f24281e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.411+0000 7f2426800700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24280cd380 0x7f24280cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f2425400700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280ad8e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24140010e0 tx=0x7f241400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24140052d0 con 0x7f24280b41c0 2024-09-13T15:09:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414005430 con 0x7f24280b41c0 2024-09-13T15:09:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24140055a0 con 0x7f24280b41c0 2024-09-13T15:09:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24280ade20 con 0x7f24280b41c0 2024-09-13T15:09:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24280ae3a0 con 0x7f24280b41c0 2024-09-13T15:09:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.415+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24280b2830 con 0x7f24280b41c0 2024-09-13T15:09:44.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.419+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24140038e0 con 0x7f24280b41c0 2024-09-13T15:09:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.419+0000 7f241e000700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2408066730 0x7f2408068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.419+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f24140835d0 con 0x7f24280b41c0 2024-09-13T15:09:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.423+0000 7f2425e00700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2408066730 0x7f2408068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.423+0000 7f2425e00700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2408066730 0x7f2408068bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2418005930 tx=0x7f2418009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.427+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24280b2830 con 0x7f24280b41c0 2024-09-13T15:09:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:44.611+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f24280b2830 con 0x7f24280b41c0 2024-09-13T15:09:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.203+0000 7f241e000700 1 -- 172.21.15.50:0/181016372 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7f24280b2830 con 0x7f24280b41c0 2024-09-13T15:09:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2408066730 msgr2=0x7f2408068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2408066730 0x7f2408068bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2418005930 tx=0x7f2418009040 comp rx=0 tx=0).stop 2024-09-13T15:09:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 msgr2=0x7f24280ad8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280ad8e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24140010e0 tx=0x7f241400c860 comp rx=0 tx=0).stop 2024-09-13T15:09:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 shutdown_connections 2024-09-13T15:09:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2408066730 0x7f2408068bf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24280cd380 0x7f24280cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24280b41c0 0x7f24280ad8e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 --2- 172.21.15.50:0/181016372 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f242806c5a0 0x7f24281e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.211+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 >> 172.21.15.50:0/181016372 conn(0x7f2428066270 msgr2=0x7f242806a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.215+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 shutdown_connections 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.215+0000 7f2427200700 1 -- 172.21.15.50:0/181016372 wait complete. 2024-09-13T15:09:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:09:45.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:09:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 Processor -- start 2024-09-13T15:09:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 -- start start 2024-09-13T15:09:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8d406c960 0x7fd8d4161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8d406cd40 0x7fd8d40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d40b1980 0x7fd8d4162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d4162340 con 0x7fd8d406c960 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40b2280 con 0x7fd8d406cd40 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.415+0000 7fd8d9e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40b2560 con 0x7fd8d40b1980 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8d406c960 0x7fd8d4161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d3e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd8d406cd40 0x7fd8d40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d40b1980 0x7fd8d4162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8d406c960 0x7fd8d4161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42006/0 (socket says 172.21.15.50:42006) 2024-09-13T15:09:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 -- 172.21.15.50:0/2824089704 learned_addr learned my addr 172.21.15.50:0/2824089704 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 -- 172.21.15.50:0/2824089704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d40b1980 msgr2=0x7fd8d4162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/2824089704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d40b1980 0x7fd8d4162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 -- 172.21.15.50:0/2824089704 >> v2:172.21.15.181:3300/0 conn(0x7fd8d406cd40 msgr2=0x7fd8d40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/2824089704 >> v2:172.21.15.181:3300/0 conn(0x7fd8d406cd40 0x7fd8d40b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 -- 172.21.15.50:0/2824089704 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40b2840 con 0x7fd8d406c960 2024-09-13T15:09:45.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/2824089704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d406c960 0x7fd8d4161e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40cb1d0 tx=0x7fd8c8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c2dd6b69a3c8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:45.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d3400700 1 -- 172.21.15.50:0/2824089704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8011830 con 0x7fd8d406c960 2024-09-13T15:09:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d3400700 1 -- 172.21.15.50:0/2824089704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8011990 con 0x7fd8d406c960 2024-09-13T15:09:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d3400700 1 -- 172.21.15.50:0/2824089704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8011d20 con 0x7fd8d406c960 2024-09-13T15:09:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 -- 172.21.15.50:0/2824089704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d406c960 msgr2=0x7fd8d4161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/2824089704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d406c960 0x7fd8d4161e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40cb1d0 tx=0x7fd8c8009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 -- 172.21.15.50:0/2824089704 shutdown_connections 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/2824089704 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d40b1980 0x7fd8d4162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/2824089704 >> v2:172.21.15.181:3300/0 conn(0x7fd8d406cd40 0x7fd8d40b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/2824089704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d406c960 0x7fd8d4161e00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.419+0000 7fd8d9e00700 1 -- 172.21.15.50:0/2824089704 >> 172.21.15.50:0/2824089704 conn(0x7fd8d406a390 msgr2=0x7fd8d406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.423+0000 7fd8d9e00700 1 -- 172.21.15.50:0/2824089704 shutdown_connections 2024-09-13T15:09:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.423+0000 7fd8d9e00700 1 -- 172.21.15.50:0/2824089704 wait complete. 2024-09-13T15:09:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.423+0000 7fd8d9e00700 1 Processor -- start 2024-09-13T15:09:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 -- start start 2024-09-13T15:09:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d406c960 0x7fd8d414f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d406cd40 0x7fd8d4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 0x7fd8d41f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d41f9c50 con 0x7fd8d40b1980 2024-09-13T15:09:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d414fb40 con 0x7fd8d406c960 2024-09-13T15:09:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d41525e0 con 0x7fd8d406cd40 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 0x7fd8d41f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 0x7fd8d41f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42012/0 (socket says 172.21.15.50:42012) 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 -- 172.21.15.50:0/879091260 learned_addr learned my addr 172.21.15.50:0/879091260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d3e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d406cd40 0x7fd8d4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d406c960 0x7fd8d414f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 -- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d406cd40 msgr2=0x7fd8d4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d406cd40 0x7fd8d4151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 -- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d406c960 msgr2=0x7fd8d414f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d406c960 0x7fd8d414f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 -- 172.21.15.50:0/879091260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8009570 con 0x7fd8d40b1980 2024-09-13T15:09:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d406c960 0x7fd8d414f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.427+0000 7fd8d9400700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 0x7fd8d41f6860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00efc0 tx=0x7fd8cc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.431+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00cb20 con 0x7fd8d40b1980 2024-09-13T15:09:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.431+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc00f040 con 0x7fd8d40b1980 2024-09-13T15:09:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.431+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00cec0 con 0x7fd8d40b1980 2024-09-13T15:09:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.431+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d41528c0 con 0x7fd8d40b1980 2024-09-13T15:09:45.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.431+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4152e80 con 0x7fd8d40b1980 2024-09-13T15:09:45.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.431+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d40b1dd0 con 0x7fd8d40b1980 2024-09-13T15:09:45.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.435+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8cc014480 con 0x7fd8d40b1980 2024-09-13T15:09:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.435+0000 7fd8d0c00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd8b4066760 0x7fd8b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.435+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fd8cc085390 con 0x7fd8d40b1980 2024-09-13T15:09:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.435+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd8b4066760 0x7fd8b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.439+0000 7fd8d8a00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd8b4066760 0x7fd8b4068c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8000c00 tx=0x7fd8c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:45.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.439+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8cc0524f0 con 0x7fd8d40b1980 2024-09-13T15:09:45.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.659+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd8d406b100 con 0x7fd8d40b1980 2024-09-13T15:09:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.667+0000 7fd8d0c00700 1 -- 172.21.15.50:0/879091260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd8cc0180c0 con 0x7fd8d40b1980 2024-09-13T15:09:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd8b4066760 msgr2=0x7fd8b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd8b4066760 0x7fd8b4068c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8000c00 tx=0x7fd8c8008030 comp rx=0 tx=0).stop 2024-09-13T15:09:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 msgr2=0x7fd8d41f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 0x7fd8d41f6860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00efc0 tx=0x7fd8cc00c0c0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 shutdown_connections 2024-09-13T15:09:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd8b4066760 0x7fd8b4068c20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40b1980 0x7fd8d41f6860 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8d406cd40 0x7fd8d4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 --2- 172.21.15.50:0/879091260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d406c960 0x7fd8d414f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.675+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 >> 172.21.15.50:0/879091260 conn(0x7fd8d406a390 msgr2=0x7fd8d40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.683+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 shutdown_connections 2024-09-13T15:09:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.683+0000 7fd8d9e00700 1 -- 172.21.15.50:0/879091260 wait complete. 2024-09-13T15:09:45.703 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 7 and data pool 8 2024-09-13T15:09:45.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.891+0000 7f9371a00700 1 Processor -- start 2024-09-13T15:09:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.891+0000 7f9371a00700 1 -- start start 2024-09-13T15:09:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9371a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f936c06ace0 0x7f936c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9371a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 0x7f936c06bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9371a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c13fcc0 con 0x7f936c13ebc0 2024-09-13T15:09:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9371a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c13f0f0 con 0x7f936c06ace0 2024-09-13T15:09:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9371a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c13f390 con 0x7f936c0703d0 2024-09-13T15:09:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f936c13ebc0 0x7f936c06a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58794/0 (socket says 172.21.15.50:58794) 2024-09-13T15:09:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936aa00700 1 -- 172.21.15.50:0/4208998554 learned_addr learned my addr 172.21.15.50:0/4208998554 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936b400700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 0x7f936c06bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9363e00700 1 --2- 172.21.15.50:0/4208998554 >> v2:172.21.15.181:3300/0 conn(0x7f936c06ace0 0x7f936c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595079321 0 0) 0x7f936c13fcc0 con 0x7f936c13ebc0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93500057e0 con 0x7f936c13ebc0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1043123835 0 0) 0x7f93500057e0 con 0x7f936c13ebc0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 msgr2=0x7f936c06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 0x7f936c06bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 >> v2:172.21.15.181:3300/0 conn(0x7f936c06ace0 msgr2=0x7f936c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 --2- 172.21.15.50:0/4208998554 >> v2:172.21.15.181:3300/0 conn(0x7f936c06ace0 0x7f936c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c13f670 con 0x7f936c13ebc0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f935c001670 con 0x7f936c13ebc0 2024-09-13T15:09:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 >> v1:172.21.15.50:6789/0 conn(0x7f936c13ebc0 legacy=0x7f936c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 0x7f9350005c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93500061b0 0x7f9350006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9350006fc0 0x7f9350007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c13f0f0 con 0x7f9350006fc0 2024-09-13T15:09:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c13f390 con 0x7f93500061b0 2024-09-13T15:09:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935000dc90 con 0x7f936c0703d0 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936b400700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9350006fc0 0x7f9350007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f9363e00700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93500061b0 0x7f9350006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936aa00700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 0x7f9350005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936b400700 1 -- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 msgr2=0x7f9350005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.895+0000 7f936b400700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c0703d0 0x7f9350005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936b400700 1 -- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93500061b0 msgr2=0x7f9350006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936b400700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93500061b0 0x7f9350006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936b400700 1 -- 172.21.15.50:0/4208998554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500057e0 con 0x7f9350006fc0 2024-09-13T15:09:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936b400700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9350006fc0 0x7f9350007440 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9364007360 tx=0x7f9350007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704ed8b8cfb30bec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364007e80 con 0x7f9350006fc0 2024-09-13T15:09:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9364014400 con 0x7f9350006fc0 2024-09-13T15:09:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936a000700 1 -- 172.21.15.50:0/4208998554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364014790 con 0x7f9350006fc0 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f9371a00700 1 -- 172.21.15.50:0/4208998554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9350006fc0 msgr2=0x7f9350007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f9371a00700 1 --2- 172.21.15.50:0/4208998554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9350006fc0 0x7f9350007440 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9364007360 tx=0x7f9350007ab0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f936b400700 1 -- 172.21.15.50:0/4208998554 reap_dead start 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f9371a00700 1 -- 172.21.15.50:0/4208998554 shutdown_connections 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f9371a00700 1 -- 172.21.15.50:0/4208998554 >> 172.21.15.50:0/4208998554 conn(0x7f936c0b08d0 msgr2=0x7f936c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f9371a00700 1 -- 172.21.15.50:0/4208998554 shutdown_connections 2024-09-13T15:09:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.899+0000 7f9371a00700 1 -- 172.21.15.50:0/4208998554 wait complete. 2024-09-13T15:09:45.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 Processor -- start 2024-09-13T15:09:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 -- start start 2024-09-13T15:09:45.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f936c0afd60 0x7f936c158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c158ff0 0x7f936c1ec6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 0x7f936c1ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0ce240 con 0x7f936c0b0140 2024-09-13T15:09:45.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1ed150 con 0x7f936c0afd60 2024-09-13T15:09:45.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f9371a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c06c460 con 0x7f936c158ff0 2024-09-13T15:09:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f936b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 0x7f936c1ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f936b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 0x7f936c1ecc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42022/0 (socket says 172.21.15.50:42022) 2024-09-13T15:09:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.903+0000 7f936b400700 1 -- 172.21.15.50:0/910347971 learned_addr learned my addr 172.21.15.50:0/910347971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9363e00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c158ff0 0x7f936c1ec6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936aa00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f936c0afd60 0x7f936c158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936b400700 1 -- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c158ff0 msgr2=0x7f936c1ec6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936b400700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c158ff0 0x7f936c1ec6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936b400700 1 -- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f936c0afd60 msgr2=0x7f936c158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936b400700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f936c0afd60 0x7f936c158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936b400700 1 -- 172.21.15.50:0/910347971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c151000 con 0x7f936c0b0140 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f936b400700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 0x7f936c1ecc10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9364014000 tx=0x7f9364004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364007000 con 0x7f936c0b0140 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9364003a40 con 0x7f936c0b0140 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364003df0 con 0x7f936c0b0140 2024-09-13T15:09:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c0ce440 con 0x7f936c0b0140 2024-09-13T15:09:45.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c0cea00 con 0x7f936c0b0140 2024-09-13T15:09:45.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.907+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c06fe90 con 0x7f936c0b0140 2024-09-13T15:09:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.911+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9364004030 con 0x7f936c0b0140 2024-09-13T15:09:45.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.911+0000 7f9362a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9348066760 0x7f9348068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:45.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.911+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9364085630 con 0x7f936c0b0140 2024-09-13T15:09:45.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.911+0000 7f936aa00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9348066760 0x7f9348068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.915+0000 7f936aa00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9348066760 0x7f9348068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f935c0017a0 tx=0x7f935c007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:45.919+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93640529c0 con 0x7f936c0b0140 2024-09-13T15:09:46.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.123+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f936c06d530 con 0x7f936c0b0140 2024-09-13T15:09:46.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.127+0000 7f9362a00700 1 -- 172.21.15.50:0/910347971 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f9364055fe0 con 0x7f936c0b0140 2024-09-13T15:09:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:46.132 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":52,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:45.665285+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9348066760 msgr2=0x7f9348068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9348066760 0x7f9348068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f935c0017a0 tx=0x7f935c007040 comp rx=0 tx=0).stop 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 msgr2=0x7f936c1ecc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 0x7f936c1ecc10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9364014000 tx=0x7f9364004b60 comp rx=0 tx=0).stop 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 shutdown_connections 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9348066760 0x7f9348068c20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f936c0b0140 0x7f936c1ecc10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f936c158ff0 0x7f936c1ec6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 --2- 172.21.15.50:0/910347971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f936c0afd60 0x7f936c158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 >> 172.21.15.50:0/910347971 conn(0x7f936c0b08d0 msgr2=0x7f936c15db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:46.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 shutdown_connections 2024-09-13T15:09:46.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.131+0000 7f9371a00700 1 -- 172.21.15.50:0/910347971 wait complete. 2024-09-13T15:09:46.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.327+0000 7ffb36e00700 1 Processor -- start 2024-09-13T15:09:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.327+0000 7ffb36e00700 1 -- start start 2024-09-13T15:09:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30159bd0 0x7ffb300cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb30071870 0x7ffb3006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb300707d0 con 0x7ffb3006afe0 2024-09-13T15:09:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3006b490 con 0x7ffb30071870 2024-09-13T15:09:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300720a0 con 0x7ffb30159bd0 2024-09-13T15:09:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb30071870 0x7ffb3006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffb3006afe0 0x7ffb300b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58796/0 (socket says 172.21.15.50:58796) 2024-09-13T15:09:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb36400700 1 -- 172.21.15.50:0/4253919546 learned_addr learned my addr 172.21.15.50:0/4253919546 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35a00700 1 --2- 172.21.15.50:0/4253919546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30159bd0 0x7ffb300cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb2fe00700 1 -- 172.21.15.50:0/4253919546 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886314578 0 0) 0x7ffb300707d0 con 0x7ffb3006afe0 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb2fe00700 1 -- 172.21.15.50:0/4253919546 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb180057e0 con 0x7ffb3006afe0 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35000700 1 -- 172.21.15.50:0/4253919546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30159bd0 msgr2=0x7ffb300cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35000700 1 --2- 172.21.15.50:0/4253919546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30159bd0 0x7ffb300cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35000700 1 -- 172.21.15.50:0/4253919546 >> v1:172.21.15.50:6789/0 conn(0x7ffb3006afe0 legacy=0x7ffb300b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35000700 1 -- 172.21.15.50:0/4253919546 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3006fee0 con 0x7ffb30071870 2024-09-13T15:09:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.331+0000 7ffb35000700 1 --2- 172.21.15.50:0/4253919546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb30071870 0x7ffb3006aaa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009880 tx=0x7ffb1c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df3ec015a48537e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb2fe00700 1 -- 172.21.15.50:0/4253919546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c011830 con 0x7ffb30071870 2024-09-13T15:09:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb2fe00700 1 -- 172.21.15.50:0/4253919546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c011990 con 0x7ffb30071870 2024-09-13T15:09:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb2fe00700 1 -- 172.21.15.50:0/4253919546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c011d20 con 0x7ffb30071870 2024-09-13T15:09:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 -- 172.21.15.50:0/4253919546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb30071870 msgr2=0x7ffb3006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 --2- 172.21.15.50:0/4253919546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb30071870 0x7ffb3006aaa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009880 tx=0x7ffb1c009b90 comp rx=0 tx=0).stop 2024-09-13T15:09:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 -- 172.21.15.50:0/4253919546 shutdown_connections 2024-09-13T15:09:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 --2- 172.21.15.50:0/4253919546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb30071870 0x7ffb3006aaa0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 --2- 172.21.15.50:0/4253919546 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30159bd0 0x7ffb300cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 -- 172.21.15.50:0/4253919546 >> 172.21.15.50:0/4253919546 conn(0x7ffb300b0c40 msgr2=0x7ffb3006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 -- 172.21.15.50:0/4253919546 shutdown_connections 2024-09-13T15:09:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.335+0000 7ffb36e00700 1 -- 172.21.15.50:0/4253919546 wait complete. 2024-09-13T15:09:46.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 Processor -- start 2024-09-13T15:09:46.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 -- start start 2024-09-13T15:09:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 0x7ffb301f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30071870 0x7ffb30150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb30159bd0 0x7ffb3014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301f2bc0 con 0x7ffb3006afe0 2024-09-13T15:09:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3014d8a0 con 0x7ffb30159bd0 2024-09-13T15:09:46.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30150c70 con 0x7ffb30071870 2024-09-13T15:09:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 0x7ffb301f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 0x7ffb301f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42050/0 (socket says 172.21.15.50:42050) 2024-09-13T15:09:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 -- 172.21.15.50:0/2367035707 learned_addr learned my addr 172.21.15.50:0/2367035707 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35000700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30071870 0x7ffb30150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb36400700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb30159bd0 0x7ffb3014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 -- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30071870 msgr2=0x7ffb30150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30071870 0x7ffb30150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 -- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb30159bd0 msgr2=0x7ffb3014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb30159bd0 0x7ffb3014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 -- 172.21.15.50:0/2367035707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094b0 con 0x7ffb3006afe0 2024-09-13T15:09:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb35a00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 0x7ffb301f2680 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e870 tx=0x7ffb2400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.339+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240095a0 con 0x7ffb3006afe0 2024-09-13T15:09:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.343+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400ee70 con 0x7ffb3006afe0 2024-09-13T15:09:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.343+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb30151810 con 0x7ffb3006afe0 2024-09-13T15:09:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.343+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400ca50 con 0x7ffb3006afe0 2024-09-13T15:09:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.343+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb30151dd0 con 0x7ffb3006afe0 2024-09-13T15:09:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.343+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3006aaa0 con 0x7ffb3006afe0 2024-09-13T15:09:46.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.343+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb2400cbb0 con 0x7ffb3006afe0 2024-09-13T15:09:46.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.347+0000 7ffb2d600700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffb10066760 0x7ffb10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.347+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ffb24084260 con 0x7ffb3006afe0 2024-09-13T15:09:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.347+0000 7ffb35000700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffb10066760 0x7ffb10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.347+0000 7ffb35000700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffb10066760 0x7ffb10068c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009880 tx=0x7ffb1c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.355+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb24051410 con 0x7ffb3006afe0 2024-09-13T15:09:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.563+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb3014cdb0 con 0x7ffb3006afe0 2024-09-13T15:09:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.567+0000 7ffb2d600700 1 -- 172.21.15.50:0/2367035707 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16775 (secure 0 0 0) 0x7ffb24054a30 con 0x7ffb3006afe0 2024-09-13T15:09:46.572 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:46.572 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":52,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:45.665285+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffb10066760 msgr2=0x7ffb10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffb10066760 0x7ffb10068c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009880 tx=0x7ffb1c008030 comp rx=0 tx=0).stop 2024-09-13T15:09:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 msgr2=0x7ffb301f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 0x7ffb301f2680 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e870 tx=0x7ffb2400ec30 comp rx=0 tx=0).stop 2024-09-13T15:09:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 shutdown_connections 2024-09-13T15:09:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffb10066760 0x7ffb10068c20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb30159bd0 0x7ffb3014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffb30071870 0x7ffb30150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 --2- 172.21.15.50:0/2367035707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb3006afe0 0x7ffb301f2680 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 >> 172.21.15.50:0/2367035707 conn(0x7ffb300b0c40 msgr2=0x7ffb300b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 shutdown_connections 2024-09-13T15:09:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.571+0000 7ffb36e00700 1 -- 172.21.15.50:0/2367035707 wait complete. 2024-09-13T15:09:46.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:09:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.775+0000 7fc9c6000700 1 Processor -- start 2024-09-13T15:09:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.775+0000 7fc9c6000700 1 -- start start 2024-09-13T15:09:46.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.775+0000 7fc9c6000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9c0159920 0x7fc9c00b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc9c00b30d0 0x7fc9c006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00ce740 con 0x7fc9c006cea0 2024-09-13T15:09:46.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00cd2a0 con 0x7fc9c0159920 2024-09-13T15:09:46.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c006d2b0 con 0x7fc9c00b30d0 2024-09-13T15:09:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9c0159920 0x7fc9c00b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9c0159920 0x7fc9c00b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42052/0 (socket says 172.21.15.50:42052) 2024-09-13T15:09:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 -- 172.21.15.50:0/12544295 learned_addr learned my addr 172.21.15.50:0/12544295 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9bfe00700 1 --2- 172.21.15.50:0/12544295 >> v2:172.21.15.181:3300/0 conn(0x7fc9c00b30d0 0x7fc9c006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 -- 172.21.15.50:0/12544295 >> v2:172.21.15.181:3300/0 conn(0x7fc9c00b30d0 msgr2=0x7fc9c006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 --2- 172.21.15.50:0/12544295 >> v2:172.21.15.181:3300/0 conn(0x7fc9c00b30d0 0x7fc9c006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 -- 172.21.15.50:0/12544295 >> v1:172.21.15.181:6789/0 conn(0x7fc9c006cea0 legacy=0x7fc9c006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 -- 172.21.15.50:0/12544295 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00ccc90 con 0x7fc9c0159920 2024-09-13T15:09:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c4c00700 1 --2- 172.21.15.50:0/12544295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0159920 0x7fc9c00b2b90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00cc6b0 tx=0x7fc9b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3b794876449ded server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9bf400700 1 -- 172.21.15.50:0/12544295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4011830 con 0x7fc9c0159920 2024-09-13T15:09:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9bf400700 1 -- 172.21.15.50:0/12544295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4011990 con 0x7fc9c0159920 2024-09-13T15:09:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9bf400700 1 -- 172.21.15.50:0/12544295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4011d20 con 0x7fc9c0159920 2024-09-13T15:09:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- 172.21.15.50:0/12544295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0159920 msgr2=0x7fc9c00b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 --2- 172.21.15.50:0/12544295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0159920 0x7fc9c00b2b90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00cc6b0 tx=0x7fc9b4009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- 172.21.15.50:0/12544295 shutdown_connections 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 --2- 172.21.15.50:0/12544295 >> v2:172.21.15.181:3300/0 conn(0x7fc9c00b30d0 0x7fc9c006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 --2- 172.21.15.50:0/12544295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c0159920 0x7fc9c00b2b90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- 172.21.15.50:0/12544295 >> 172.21.15.50:0/12544295 conn(0x7fc9c006a390 msgr2=0x7fc9c006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- 172.21.15.50:0/12544295 shutdown_connections 2024-09-13T15:09:46.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.779+0000 7fc9c6000700 1 -- 172.21.15.50:0/12544295 wait complete. 2024-09-13T15:09:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 Processor -- start 2024-09-13T15:09:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 -- start start 2024-09-13T15:09:46.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c006cea0 0x7fc9c01f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9c00b30d0 0x7fc9c01383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 0x7fc9c014bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c014e260 con 0x7fc9c013a440 2024-09-13T15:09:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c014dc70 con 0x7fc9c006cea0 2024-09-13T15:09:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.783+0000 7fc9c6000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c013ae90 con 0x7fc9c00b30d0 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 0x7fc9c014bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 0x7fc9c014bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42056/0 (socket says 172.21.15.50:42056) 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 -- 172.21.15.50:0/3337133544 learned_addr learned my addr 172.21.15.50:0/3337133544 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c4c00700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c006cea0 0x7fc9c01f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9bfe00700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9c00b30d0 0x7fc9c01383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 -- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9c00b30d0 msgr2=0x7fc9c01383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9c00b30d0 0x7fc9c01383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 -- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c006cea0 msgr2=0x7fc9c01f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c006cea0 0x7fc9c01f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 -- 172.21.15.50:0/3337133544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009570 con 0x7fc9c013a440 2024-09-13T15:09:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c5600700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 0x7fc9c014bd60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800cc80 tx=0x7fc9b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8003c20 con 0x7fc9c013a440 2024-09-13T15:09:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8003d80 con 0x7fc9c013a440 2024-09-13T15:09:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800aaa0 con 0x7fc9c013a440 2024-09-13T15:09:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c013b170 con 0x7fc9c013a440 2024-09-13T15:09:46.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c01f2570 con 0x7fc9c013a440 2024-09-13T15:09:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.787+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c00cbf60 con 0x7fc9c013a440 2024-09-13T15:09:46.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.791+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9b800ac00 con 0x7fc9c013a440 2024-09-13T15:09:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.791+0000 7fc9bcc00700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9a0066730 0x7fc9a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.791+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc9b8084290 con 0x7fc9c013a440 2024-09-13T15:09:46.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.791+0000 7fc9c4c00700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9a0066730 0x7fc9a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:46.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.795+0000 7fc9c4c00700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9a0066730 0x7fc9a0068bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4000c00 tx=0x7fc9b4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:46.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:46.799+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9b8051420 con 0x7fc9c013a440 2024-09-13T15:09:47.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.023+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9c013b360 con 0x7fc9c013a440 2024-09-13T15:09:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.683+0000 7fc9bcc00700 1 -- 172.21.15.50:0/3337133544 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc9b8054a40 con 0x7fc9c013a440 2024-09-13T15:09:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9a0066730 msgr2=0x7fc9a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9a0066730 0x7fc9a0068bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4000c00 tx=0x7fc9b4008030 comp rx=0 tx=0).stop 2024-09-13T15:09:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 msgr2=0x7fc9c014bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 0x7fc9c014bd60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800cc80 tx=0x7fc9b800cf90 comp rx=0 tx=0).stop 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 shutdown_connections 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc9a0066730 0x7fc9a0068bf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c013a440 0x7fc9c014bd60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9c00b30d0 0x7fc9c01383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 --2- 172.21.15.50:0/3337133544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c006cea0 0x7fc9c01f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 >> 172.21.15.50:0/3337133544 conn(0x7fc9c006a390 msgr2=0x7fc9c006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 shutdown_connections 2024-09-13T15:09:47.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.687+0000 7fc9c6000700 1 -- 172.21.15.50:0/3337133544 wait complete. 2024-09-13T15:09:47.719 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:09:47.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:09:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.899+0000 7f6f7a800700 1 Processor -- start 2024-09-13T15:09:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.899+0000 7f6f7a800700 1 -- start start 2024-09-13T15:09:47.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f7a800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f7415b460 0x7f6f7415b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f7a800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740b52e0 con 0x7f6f740b3000 2024-09-13T15:09:47.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f7a800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740b55c0 con 0x7f6f7415bd80 2024-09-13T15:09:47.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f7a800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740d06e0 con 0x7f6f7415b460 2024-09-13T15:09:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f73e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6f740b3000 0x7f6f740cd730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58804/0 (socket says 172.21.15.50:58804) 2024-09-13T15:09:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f73e00700 1 -- 172.21.15.50:0/1362718815 learned_addr learned my addr 172.21.15.50:0/1362718815 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f73400700 1 --2- 172.21.15.50:0/1362718815 >> v2:172.21.15.181:3300/0 conn(0x7f6f7415b460 0x7f6f7415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207117627 0 0) 0x7f6f740b52e0 con 0x7f6f740b3000 2024-09-13T15:09:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.903+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f580035d0 con 0x7f6f740b3000 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484629730 0 0) 0x7f6f740b55c0 con 0x7f6f7415bd80 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f740b52e0 con 0x7f6f7415bd80 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 717869401 0 0) 0x7f6f580035d0 con 0x7f6f740b3000 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 >> v2:172.21.15.181:3300/0 conn(0x7f6f7415b460 msgr2=0x7f6f7415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 --2- 172.21.15.50:0/1362718815 >> v2:172.21.15.181:3300/0 conn(0x7f6f7415b460 0x7f6f7415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 >> v1:172.21.15.181:6789/0 conn(0x7f6f7415bd80 legacy=0x7f6f740b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740b58a0 con 0x7f6f740b3000 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f6f6c0019f0 con 0x7f6f740b3000 2024-09-13T15:09:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 >> v1:172.21.15.50:6789/0 conn(0x7f6f740b3000 legacy=0x7f6f740cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f58003bb0 0x7f6f58003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f58004870 0x7f6f58004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58005230 0x7f6f5800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740d06e0 con 0x7f6f58003bb0 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5800c0b0 con 0x7f6f58005230 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5800c270 con 0x7f6f58004870 2024-09-13T15:09:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f58003bb0 0x7f6f58003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73e00700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58005230 0x7f6f5800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72a00700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f58004870 0x7f6f58004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 -- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f58004870 msgr2=0x7f6f58004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f58004870 0x7f6f58004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 -- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58005230 msgr2=0x7f6f5800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58005230 0x7f6f5800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 -- 172.21.15.50:0/1362718815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f580035d0 con 0x7f6f58003bb0 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73e00700 1 -- 172.21.15.50:0/1362718815 reap_dead start 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f73400700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f58003bb0 0x7f6f58003fb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009b70 tx=0x7f6f580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff6a77855027824 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400e6c0 con 0x7f6f58003bb0 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400e820 con 0x7f6f58003bb0 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f72000700 1 -- 172.21.15.50:0/1362718815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400eb90 con 0x7f6f58003bb0 2024-09-13T15:09:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 -- 172.21.15.50:0/1362718815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f58003bb0 msgr2=0x7f6f58003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f58003bb0 0x7f6f58003fb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009b70 tx=0x7f6f580058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 -- 172.21.15.50:0/1362718815 shutdown_connections 2024-09-13T15:09:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 --2- 172.21.15.50:0/1362718815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f58003bb0 0x7f6f58003fb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 -- 172.21.15.50:0/1362718815 >> 172.21.15.50:0/1362718815 conn(0x7f6f7406e660 msgr2=0x7f6f7406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 -- 172.21.15.50:0/1362718815 shutdown_connections 2024-09-13T15:09:47.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.907+0000 7f6f7a800700 1 -- 172.21.15.50:0/1362718815 wait complete. 2024-09-13T15:09:47.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 Processor -- start 2024-09-13T15:09:47.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 -- start start 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58003bb0 0x7f6f7414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 0x7f6f74150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f741545a0 0x7f6f741420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7414f840 con 0x7f6f7414ead0 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7414fb10 con 0x7f6f58003bb0 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f7a800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7414fdf0 con 0x7f6f741545a0 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f72a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 0x7f6f74150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f72a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 0x7f6f74150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42072/0 (socket says 172.21.15.50:42072) 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.911+0000 7f6f72a00700 1 -- 172.21.15.50:0/811032898 learned_addr learned my addr 172.21.15.50:0/811032898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f73400700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58003bb0 0x7f6f7414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f73e00700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f741545a0 0x7f6f741420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f72a00700 1 -- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f741545a0 msgr2=0x7f6f741420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f72a00700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f741545a0 0x7f6f741420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f72a00700 1 -- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58003bb0 msgr2=0x7f6f7414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f72a00700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58003bb0 0x7f6f7414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f72a00700 1 -- 172.21.15.50:0/811032898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f741500d0 con 0x7f6f7414ead0 2024-09-13T15:09:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f72a00700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 0x7f6f74150bb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000e780 tx=0x7f6f6000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600052e0 con 0x7f6f7414ead0 2024-09-13T15:09:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60005460 con 0x7f6f7414ead0 2024-09-13T15:09:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f741503b0 con 0x7f6f7414ead0 2024-09-13T15:09:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600038e0 con 0x7f6f7414ead0 2024-09-13T15:09:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f741510f0 con 0x7f6f7414ead0 2024-09-13T15:09:47.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.915+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f741508d0 con 0x7f6f7414ead0 2024-09-13T15:09:47.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.919+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f60003a40 con 0x7f6f7414ead0 2024-09-13T15:09:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.919+0000 7f6f6b400700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f54066730 0x7f6f54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.919+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6f600839e0 con 0x7f6f7414ead0 2024-09-13T15:09:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.919+0000 7f6f73400700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f54066730 0x7f6f54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.923+0000 7f6f73400700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f54066730 0x7f6f54068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f640090b0 tx=0x7f6f6401e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:47.927+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f741508d0 con 0x7f6f7414ead0 2024-09-13T15:09:48.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.147+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f741508d0 con 0x7f6f7414ead0 2024-09-13T15:09:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.691+0000 7f6f6b400700 1 -- 172.21.15.50:0/811032898 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f741508d0 con 0x7f6f7414ead0 2024-09-13T15:09:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f54066730 msgr2=0x7f6f54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f54066730 0x7f6f54068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f640090b0 tx=0x7f6f6401e040 comp rx=0 tx=0).stop 2024-09-13T15:09:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 msgr2=0x7f6f74150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 0x7f6f74150bb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000e780 tx=0x7f6f6000ea90 comp rx=0 tx=0).stop 2024-09-13T15:09:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 shutdown_connections 2024-09-13T15:09:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f54066730 0x7f6f54068bf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f741545a0 0x7f6f741420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7414ead0 0x7f6f74150bb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 --2- 172.21.15.50:0/811032898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f58003bb0 0x7f6f7414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 >> 172.21.15.50:0/811032898 conn(0x7f6f7406e660 msgr2=0x7f6f74070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 shutdown_connections 2024-09-13T15:09:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.695+0000 7f6f7a800700 1 -- 172.21.15.50:0/811032898 wait complete. 2024-09-13T15:09:48.722 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:09:48.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.887+0000 7f25d6e00700 1 Processor -- start 2024-09-13T15:09:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.887+0000 7f25d6e00700 1 -- start start 2024-09-13T15:09:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d00cb020 0x7f25d00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f25d006aaa0 0x7f25d006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d006b430 con 0x7f25d015c2a0 2024-09-13T15:09:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00b2ad0 con 0x7f25d00cb020 2024-09-13T15:09:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d015b960 con 0x7f25d006aaa0 2024-09-13T15:09:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d00cb020 0x7f25d00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25d00cb020 0x7f25d00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42078/0 (socket says 172.21.15.50:42078) 2024-09-13T15:09:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 -- 172.21.15.50:0/2428873501 learned_addr learned my addr 172.21.15.50:0/2428873501 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6400700 1 --2- 172.21.15.50:0/2428873501 >> v2:172.21.15.181:3300/0 conn(0x7f25d006aaa0 0x7f25d006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 -- 172.21.15.50:0/2428873501 >> v2:172.21.15.181:3300/0 conn(0x7f25d006aaa0 msgr2=0x7f25d006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 --2- 172.21.15.50:0/2428873501 >> v2:172.21.15.181:3300/0 conn(0x7f25d006aaa0 0x7f25d006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 -- 172.21.15.50:0/2428873501 >> v1:172.21.15.181:6789/0 conn(0x7f25d015c2a0 legacy=0x7f25d015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 -- 172.21.15.50:0/2428873501 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d015bc40 con 0x7f25d00cb020 2024-09-13T15:09:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d6400700 1 --2- 172.21.15.50:0/2428873501 >> v2:172.21.15.181:3300/0 conn(0x7f25d006aaa0 0x7f25d006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25d5a00700 1 --2- 172.21.15.50:0/2428873501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d00cc6f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f25d00cd7e0 tx=0x7f25c4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb58fdc651990e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25cfe00700 1 -- 172.21.15.50:0/2428873501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400b8a0 con 0x7f25d00cb020 2024-09-13T15:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25cfe00700 1 -- 172.21.15.50:0/2428873501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400ba00 con 0x7f25d00cb020 2024-09-13T15:09:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.891+0000 7f25cfe00700 1 -- 172.21.15.50:0/2428873501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400bd90 con 0x7f25d00cb020 2024-09-13T15:09:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 -- 172.21.15.50:0/2428873501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 msgr2=0x7f25d00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 --2- 172.21.15.50:0/2428873501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d00cc6f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f25d00cd7e0 tx=0x7f25c4009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 -- 172.21.15.50:0/2428873501 shutdown_connections 2024-09-13T15:09:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 --2- 172.21.15.50:0/2428873501 >> v2:172.21.15.181:3300/0 conn(0x7f25d006aaa0 0x7f25d006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 --2- 172.21.15.50:0/2428873501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d00cc6f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 -- 172.21.15.50:0/2428873501 >> 172.21.15.50:0/2428873501 conn(0x7f25d00b0c40 msgr2=0x7f25d006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 -- 172.21.15.50:0/2428873501 shutdown_connections 2024-09-13T15:09:48.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 -- 172.21.15.50:0/2428873501 wait complete. 2024-09-13T15:09:48.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 Processor -- start 2024-09-13T15:09:48.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.895+0000 7f25d6e00700 1 -- start start 2024-09-13T15:09:48.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d006aaa0 0x7f25d01501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:48.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d01520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:48.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d015c2a0 0x7f25d014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:48.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d014fe20 con 0x7f25d00cb020 2024-09-13T15:09:48.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d014f860 con 0x7f25d015c2a0 2024-09-13T15:09:48.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d014fb40 con 0x7f25d006aaa0 2024-09-13T15:09:48.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d01520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:48.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d01520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42094/0 (socket says 172.21.15.50:42094) 2024-09-13T15:09:48.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 -- 172.21.15.50:0/4197880014 learned_addr learned my addr 172.21.15.50:0/4197880014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:48.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6400700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d015c2a0 0x7f25d014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:48.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5a00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d006aaa0 0x7f25d01501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:48.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 -- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d006aaa0 msgr2=0x7f25d01501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d006aaa0 0x7f25d01501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 -- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d015c2a0 msgr2=0x7f25d014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d015c2a0 0x7f25d014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 -- 172.21.15.50:0/4197880014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009570 con 0x7f25d00cb020 2024-09-13T15:09:48.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d5000700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d01520a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c410 tx=0x7f25bc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:48.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0052d0 con 0x7f25d00cb020 2024-09-13T15:09:48.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc005430 con 0x7f25d00cb020 2024-09-13T15:09:48.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0156ae0 con 0x7f25d00cb020 2024-09-13T15:09:48.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.899+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0055a0 con 0x7f25d00cb020 2024-09-13T15:09:48.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.903+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d01506f0 con 0x7f25d00cb020 2024-09-13T15:09:48.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.903+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0157000 con 0x7f25d00cb020 2024-09-13T15:09:48.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.903+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25bc0036a0 con 0x7f25d00cb020 2024-09-13T15:09:48.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.907+0000 7f25cd600700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:48.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.907+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f25bc083420 con 0x7f25d00cb020 2024-09-13T15:09:48.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.907+0000 7f25d5a00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:48.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.907+0000 7f25d5a00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f25c4000c00 tx=0x7f25c4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:48.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:48.911+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25d0157000 con 0x7f25d00cb020 2024-09-13T15:09:49.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.139+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25d006b430 con 0x7f25d00cb020 2024-09-13T15:09:49.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25cd600700 1 -- 172.21.15.50:0/4197880014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f25d006b430 con 0x7f25d00cb020 2024-09-13T15:09:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:49.147 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:45.665636+0000","modified":"2024-09-13T15:09:48.684241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/442961988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":442961988},{"type":"v1","addr":"172.21.15.50:6835","nonce":442961988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T15:09:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 msgr2=0x7f25b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f25c4000c00 tx=0x7f25c4008030 comp rx=0 tx=0).stop 2024-09-13T15:09:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 msgr2=0x7f25d01520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d01520a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c410 tx=0x7f25bc00c7d0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 shutdown_connections 2024-09-13T15:09:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f25b0066730 0x7f25b0068bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25d015c2a0 0x7f25d014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25d00cb020 0x7f25d01520a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 --2- 172.21.15.50:0/4197880014 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25d006aaa0 0x7f25d01501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 >> 172.21.15.50:0/4197880014 conn(0x7f25d00b0c40 msgr2=0x7f25d006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 shutdown_connections 2024-09-13T15:09:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.143+0000 7f25d6e00700 1 -- 172.21.15.50:0/4197880014 wait complete. 2024-09-13T15:09:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-13T15:09:49.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.339+0000 7f74c9600700 1 Processor -- start 2024-09-13T15:09:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.339+0000 7f74c9600700 1 -- start start 2024-09-13T15:09:49.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74c406c880 0x7f74c40b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f74c406cc60 0x7f74c415d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c40b2fa0 con 0x7f74c415d980 2024-09-13T15:09:49.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40b50e0 con 0x7f74c406c880 2024-09-13T15:09:49.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40b3280 con 0x7f74c406cc60 2024-09-13T15:09:49.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74c406c880 0x7f74c40b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74c406c880 0x7f74c40b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42104/0 (socket says 172.21.15.50:42104) 2024-09-13T15:09:49.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 -- 172.21.15.50:0/757627219 learned_addr learned my addr 172.21.15.50:0/757627219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:49.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3400700 1 --2- 172.21.15.50:0/757627219 >> v2:172.21.15.181:3300/0 conn(0x7f74c406cc60 0x7f74c415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c8c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74c415d980 0x7f74c40ce120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58812/0 (socket says 172.21.15.50:58812) 2024-09-13T15:09:49.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 -- 172.21.15.50:0/757627219 >> v2:172.21.15.181:3300/0 conn(0x7f74c406cc60 msgr2=0x7f74c415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:49.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 --2- 172.21.15.50:0/757627219 >> v2:172.21.15.181:3300/0 conn(0x7f74c406cc60 0x7f74c415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 -- 172.21.15.50:0/757627219 >> v1:172.21.15.50:6789/0 conn(0x7f74c415d980 legacy=0x7f74c40ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 -- 172.21.15.50:0/757627219 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40b3560 con 0x7f74c406c880 2024-09-13T15:09:49.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c3e00700 1 --2- 172.21.15.50:0/757627219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c40b4ba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f74c40cfac0 tx=0x7f74b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4137d5caec8bb587 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:49.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c2a00700 1 -- 172.21.15.50:0/757627219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4011830 con 0x7f74c406c880 2024-09-13T15:09:49.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c2a00700 1 -- 172.21.15.50:0/757627219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4011990 con 0x7f74c406c880 2024-09-13T15:09:49.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c2a00700 1 -- 172.21.15.50:0/757627219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4011d20 con 0x7f74c406c880 2024-09-13T15:09:49.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 -- 172.21.15.50:0/757627219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 msgr2=0x7f74c40b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.343+0000 7f74c9600700 1 --2- 172.21.15.50:0/757627219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c40b4ba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f74c40cfac0 tx=0x7f74b4009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 -- 172.21.15.50:0/757627219 shutdown_connections 2024-09-13T15:09:49.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 --2- 172.21.15.50:0/757627219 >> v2:172.21.15.181:3300/0 conn(0x7f74c406cc60 0x7f74c415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 --2- 172.21.15.50:0/757627219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c40b4ba0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 -- 172.21.15.50:0/757627219 >> 172.21.15.50:0/757627219 conn(0x7f74c406e660 msgr2=0x7f74c406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:49.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 -- 172.21.15.50:0/757627219 shutdown_connections 2024-09-13T15:09:49.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 -- 172.21.15.50:0/757627219 wait complete. 2024-09-13T15:09:49.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 Processor -- start 2024-09-13T15:09:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.347+0000 7f74c9600700 1 -- start start 2024-09-13T15:09:49.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c41f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74c406cc60 0x7f74c413b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74c415d980 0x7f74c40cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c413c090 con 0x7f74c406c880 2024-09-13T15:09:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c413bad0 con 0x7f74c415d980 2024-09-13T15:09:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c413bdb0 con 0x7f74c406cc60 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c41f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c41f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42120/0 (socket says 172.21.15.50:42120) 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 -- 172.21.15.50:0/2872790862 learned_addr learned my addr 172.21.15.50:0/2872790862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3400700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74c406cc60 0x7f74c413b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c8c00700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74c415d980 0x7f74c40cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 -- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74c406cc60 msgr2=0x7f74c413b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74c406cc60 0x7f74c413b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 -- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74c415d980 msgr2=0x7f74c40cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74c415d980 0x7f74c40cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 -- 172.21.15.50:0/2872790862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4009570 con 0x7f74c406c880 2024-09-13T15:09:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3400700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74c406cc60 0x7f74c413b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c8c00700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74c415d980 0x7f74c40cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c3e00700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c41f1f10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f74c40b5290 tx=0x7f74b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004550 con 0x7f74c406c880 2024-09-13T15:09:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b401f070 con 0x7f74c406c880 2024-09-13T15:09:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c41391b0 con 0x7f74c406c880 2024-09-13T15:09:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4003900 con 0x7f74c406c880 2024-09-13T15:09:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.351+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41f2450 con 0x7f74c406c880 2024-09-13T15:09:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.355+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c41396d0 con 0x7f74c406c880 2024-09-13T15:09:49.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.355+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74b4003a60 con 0x7f74c406c880 2024-09-13T15:09:49.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.359+0000 7f74bbe00700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74a4066730 0x7f74a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.359+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74b4021070 con 0x7f74c406c880 2024-09-13T15:09:49.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.359+0000 7f74c3400700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74a4066730 0x7f74a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.359+0000 7f74c3400700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74a4066730 0x7f74a4068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009b70 tx=0x7f74b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:49.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.363+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74c41396d0 con 0x7f74c406c880 2024-09-13T15:09:49.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.551+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c41396d0 con 0x7f74c406c880 2024-09-13T15:09:49.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.555+0000 7f74bbe00700 1 -- 172.21.15.50:0/2872790862 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f74c41396d0 con 0x7f74c406c880 2024-09-13T15:09:49.559 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:49.560 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:46.669735+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.555+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74a4066730 msgr2=0x7f74a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.555+0000 7f74c9600700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74a4066730 0x7f74a4068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009b70 tx=0x7f74b0008040 comp rx=0 tx=0).stop 2024-09-13T15:09:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.555+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 msgr2=0x7f74c41f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.555+0000 7f74c9600700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c41f1f10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f74c40b5290 tx=0x7f74b4004770 comp rx=0 tx=0).stop 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 shutdown_connections 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74a4066730 0x7f74a4068bf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74c415d980 0x7f74c40cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74c406cc60 0x7f74c413b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 --2- 172.21.15.50:0/2872790862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74c406c880 0x7f74c41f1f10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 >> 172.21.15.50:0/2872790862 conn(0x7f74c406e660 msgr2=0x7f74c40af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 shutdown_connections 2024-09-13T15:09:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.559+0000 7f74c9600700 1 -- 172.21.15.50:0/2872790862 wait complete. 2024-09-13T15:09:49.584 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:09:49.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:09:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 Processor -- start 2024-09-13T15:09:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 -- start start 2024-09-13T15:09:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 0x7f0da00cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0da01613a0 0x7f0da00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00ce200 con 0x7f0da00ae360 2024-09-13T15:09:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00cdff0 con 0x7f0da01613a0 2024-09-13T15:09:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0da4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00ce4e0 con 0x7f0da0160fc0 2024-09-13T15:09:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0d9f400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 0x7f0da00cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0d9ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0da01613a0 0x7f0da00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0d9f400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 0x7f0da00cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:44886/0 (socket says 172.21.15.50:44886) 2024-09-13T15:09:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.759+0000 7f0d9f400700 1 -- 172.21.15.50:0/66278186 learned_addr learned my addr 172.21.15.50:0/66278186 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9f400700 1 -- 172.21.15.50:0/66278186 >> v2:172.21.15.50:3300/0 conn(0x7f0da01613a0 msgr2=0x7f0da00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9f400700 1 --2- 172.21.15.50:0/66278186 >> v2:172.21.15.50:3300/0 conn(0x7f0da01613a0 0x7f0da00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9f400700 1 -- 172.21.15.50:0/66278186 >> v1:172.21.15.50:6789/0 conn(0x7f0da00ae360 legacy=0x7f0da00cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9f400700 1 -- 172.21.15.50:0/66278186 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00ce7c0 con 0x7f0da0160fc0 2024-09-13T15:09:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9f400700 1 --2- 172.21.15.50:0/66278186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 0x7f0da00cdab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009e50 tx=0x7f0d9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624df056cc856995 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9e000700 1 -- 172.21.15.50:0/66278186 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000e070 con 0x7f0da0160fc0 2024-09-13T15:09:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9e000700 1 -- 172.21.15.50:0/66278186 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9000b910 con 0x7f0da0160fc0 2024-09-13T15:09:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0d9e000700 1 -- 172.21.15.50:0/66278186 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000bcc0 con 0x7f0da0160fc0 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 -- 172.21.15.50:0/66278186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 msgr2=0x7f0da00cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 --2- 172.21.15.50:0/66278186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 0x7f0da00cdab0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009e50 tx=0x7f0d9000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 -- 172.21.15.50:0/66278186 shutdown_connections 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 --2- 172.21.15.50:0/66278186 >> v2:172.21.15.50:3300/0 conn(0x7f0da01613a0 0x7f0da00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 --2- 172.21.15.50:0/66278186 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da0160fc0 0x7f0da00cdab0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 -- 172.21.15.50:0/66278186 >> 172.21.15.50:0/66278186 conn(0x7f0da006a570 msgr2=0x7f0da006a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 -- 172.21.15.50:0/66278186 shutdown_connections 2024-09-13T15:09:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.763+0000 7f0da4e00700 1 -- 172.21.15.50:0/66278186 wait complete. 2024-09-13T15:09:49.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 Processor -- start 2024-09-13T15:09:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 -- start start 2024-09-13T15:09:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da00ae360 0x7f0da015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 0x7f0da0158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0da01613a0 0x7f0da01631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da015ace0 con 0x7f0da0160fc0 2024-09-13T15:09:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0158c80 con 0x7f0da01613a0 2024-09-13T15:09:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0da4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00af090 con 0x7f0da00ae360 2024-09-13T15:09:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 0x7f0da0158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 0x7f0da0158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42124/0 (socket says 172.21.15.50:42124) 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 -- 172.21.15.50:0/2762919059 learned_addr learned my addr 172.21.15.50:0/2762919059 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9f400700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da00ae360 0x7f0da015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9fe00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0da01613a0 0x7f0da01631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 -- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da00ae360 msgr2=0x7f0da015a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da00ae360 0x7f0da015a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 -- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0da01613a0 msgr2=0x7f0da01631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0da01613a0 0x7f0da01631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 -- 172.21.15.50:0/2762919059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009b30 con 0x7f0da0160fc0 2024-09-13T15:09:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.767+0000 7f0d9ea00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 0x7f0da0158740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e7d0 tx=0x7f0d8c00eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:49.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c013680 con 0x7f0da0160fc0 2024-09-13T15:09:49.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c0137e0 con 0x7f0da0160fc0 2024-09-13T15:09:49.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c013b70 con 0x7f0da0160fc0 2024-09-13T15:09:49.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00af370 con 0x7f0da0160fc0 2024-09-13T15:09:49.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da00af930 con 0x7f0da0160fc0 2024-09-13T15:09:49.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da015ae50 con 0x7f0da0160fc0 2024-09-13T15:09:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.771+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d8c013cd0 con 0x7f0da0160fc0 2024-09-13T15:09:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.775+0000 7f0d97400700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d80066730 0x7f0d80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.775+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0d8c084250 con 0x7f0da0160fc0 2024-09-13T15:09:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.775+0000 7f0d9f400700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d80066730 0x7f0d80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:49.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.775+0000 7f0d9f400700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d80066730 0x7f0d80068bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000b370 tx=0x7f0d90009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.779+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0da015ae50 con 0x7f0da0160fc0 2024-09-13T15:09:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.967+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0da00afb50 con 0x7f0d80066730 2024-09-13T15:09:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.991+0000 7f0d97400700 1 -- 172.21.15.50:0/2762919059 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286519 (secure 0 0 0) 0x7f0da00afb50 con 0x7f0d80066730 2024-09-13T15:09:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d80066730 msgr2=0x7f0d80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d80066730 0x7f0d80068bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000b370 tx=0x7f0d90009000 comp rx=0 tx=0).stop 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 msgr2=0x7f0da0158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 0x7f0da0158740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e7d0 tx=0x7f0d8c00eae0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 shutdown_connections 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0d80066730 0x7f0d80068bf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0da01613a0 0x7f0da01631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da0160fc0 0x7f0da0158740 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 --2- 172.21.15.50:0/2762919059 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0da00ae360 0x7f0da015a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 >> 172.21.15.50:0/2762919059 conn(0x7f0da006a570 msgr2=0x7f0da00716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 shutdown_connections 2024-09-13T15:09:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:49.995+0000 7f0da4e00700 1 -- 172.21.15.50:0/2762919059 wait complete. 2024-09-13T15:09:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:09:50.031 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-13T15:09:48.054802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238456,"kb_used_data":5884,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736264,"statfs":{"total":773094113280,"available":772849934336,"internally_reserved":0,"allocated":6025216,"data_stored":3301179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001229"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711934+0000","last_change":"2024-09-13T15:09:45.703629+0000","last_active":"2024-09-13T15:09:45.711934+0000","last_peered":"2024-09-13T15:09:45.711934+0000","last_clean":"2024-09-13T15:09:45.711934+0000","last_became_active":"2024-09-13T15:09:45.703401+0000","last_became_peered":"2024-09-13T15:09:45.703401+0000","last_unstale":"2024-09-13T15:09:45.711934+0000","last_undegraded":"2024-09-13T15:09:45.711934+0000","last_fullsized":"2024-09-13T15:09:45.711934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:34.280691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698834+0000","last_change":"2024-09-13T15:09:45.694636+0000","last_active":"2024-09-13T15:09:45.698834+0000","last_peered":"2024-09-13T15:09:45.698834+0000","last_clean":"2024-09-13T15:09:45.698834+0000","last_became_active":"2024-09-13T15:09:45.694285+0000","last_became_peered":"2024-09-13T15:09:45.694285+0000","last_unstale":"2024-09-13T15:09:45.698834+0000","last_undegraded":"2024-09-13T15:09:45.698834+0000","last_fullsized":"2024-09-13T15:09:45.698834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:07.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714295+0000","last_change":"2024-09-13T15:09:45.712443+0000","last_active":"2024-09-13T15:09:45.714295+0000","last_peered":"2024-09-13T15:09:45.714295+0000","last_clean":"2024-09-13T15:09:45.714295+0000","last_became_active":"2024-09-13T15:09:45.711403+0000","last_became_peered":"2024-09-13T15:09:45.711403+0000","last_unstale":"2024-09-13T15:09:45.714295+0000","last_undegraded":"2024-09-13T15:09:45.714295+0000","last_fullsized":"2024-09-13T15:09:45.714295+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.083588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705174+0000","last_change":"2024-09-13T15:09:45.702859+0000","last_active":"2024-09-13T15:09:45.705174+0000","last_peered":"2024-09-13T15:09:45.705174+0000","last_clean":"2024-09-13T15:09:45.705174+0000","last_became_active":"2024-09-13T15:09:45.702510+0000","last_became_peered":"2024-09-13T15:09:45.702510+0000","last_unstale":"2024-09-13T15:09:45.705174+0000","last_undegraded":"2024-09-13T15:09:45.705174+0000","last_fullsized":"2024-09-13T15:09:45.705174+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.692012+0000","last_change":"2024-09-13T15:09:45.689214+0000","last_active":"2024-09-13T15:09:45.692012+0000","last_peered":"2024-09-13T15:09:45.692012+0000","last_clean":"2024-09-13T15:09:45.692012+0000","last_became_active":"2024-09-13T15:09:45.688903+0000","last_became_peered":"2024-09-13T15:09:45.688903+0000","last_unstale":"2024-09-13T15:09:45.692012+0000","last_undegraded":"2024-09-13T15:09:45.692012+0000","last_fullsized":"2024-09-13T15:09:45.692012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.710437+0000","last_change":"2024-09-13T15:09:45.697010+0000","last_active":"2024-09-13T15:09:45.710437+0000","last_peered":"2024-09-13T15:09:45.710437+0000","last_clean":"2024-09-13T15:09:45.710437+0000","last_became_active":"2024-09-13T15:09:45.696217+0000","last_became_peered":"2024-09-13T15:09:45.696217+0000","last_unstale":"2024-09-13T15:09:45.710437+0000","last_undegraded":"2024-09-13T15:09:45.710437+0000","last_fullsized":"2024-09-13T15:09:45.710437+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.696110+0000","last_change":"2024-09-13T15:09:45.692993+0000","last_active":"2024-09-13T15:09:45.696110+0000","last_peered":"2024-09-13T15:09:45.696110+0000","last_clean":"2024-09-13T15:09:45.696110+0000","last_became_active":"2024-09-13T15:09:45.692693+0000","last_became_peered":"2024-09-13T15:09:45.692693+0000","last_unstale":"2024-09-13T15:09:45.696110+0000","last_undegraded":"2024-09-13T15:09:45.696110+0000","last_fullsized":"2024-09-13T15:09:45.696110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:57.501456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717484+0000","last_change":"2024-09-13T15:09:45.702429+0000","last_active":"2024-09-13T15:09:45.717484+0000","last_peered":"2024-09-13T15:09:45.717484+0000","last_clean":"2024-09-13T15:09:45.717484+0000","last_became_active":"2024-09-13T15:09:45.702123+0000","last_became_peered":"2024-09-13T15:09:45.702123+0000","last_unstale":"2024-09-13T15:09:45.717484+0000","last_undegraded":"2024-09-13T15:09:45.717484+0000","last_fullsized":"2024-09-13T15:09:45.717484+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:38.735535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714099+0000","last_change":"2024-09-13T15:09:45.693874+0000","last_active":"2024-09-13T15:09:45.714099+0000","last_peered":"2024-09-13T15:09:45.714099+0000","last_clean":"2024-09-13T15:09:45.714099+0000","last_became_active":"2024-09-13T15:09:45.693632+0000","last_became_peered":"2024-09-13T15:09:45.693632+0000","last_unstale":"2024-09-13T15:09:45.714099+0000","last_undegraded":"2024-09-13T15:09:45.714099+0000","last_fullsized":"2024-09-13T15:09:45.714099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:53.657062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711005+0000","last_change":"2024-09-13T15:09:45.696707+0000","last_active":"2024-09-13T15:09:45.711005+0000","last_peered":"2024-09-13T15:09:45.711005+0000","last_clean":"2024-09-13T15:09:45.711005+0000","last_became_active":"2024-09-13T15:09:45.696465+0000","last_became_peered":"2024-09-13T15:09:45.696465+0000","last_unstale":"2024-09-13T15:09:45.711005+0000","last_undegraded":"2024-09-13T15:09:45.711005+0000","last_fullsized":"2024-09-13T15:09:45.711005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.703176+0000","last_change":"2024-09-13T15:09:45.684278+0000","last_active":"2024-09-13T15:09:45.703176+0000","last_peered":"2024-09-13T15:09:45.703176+0000","last_clean":"2024-09-13T15:09:45.703176+0000","last_became_active":"2024-09-13T15:09:45.684005+0000","last_became_peered":"2024-09-13T15:09:45.684005+0000","last_unstale":"2024-09-13T15:09:45.703176+0000","last_undegraded":"2024-09-13T15:09:45.703176+0000","last_fullsized":"2024-09-13T15:09:45.703176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:21.715455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717381+0000","last_change":"2024-09-13T15:09:45.701263+0000","last_active":"2024-09-13T15:09:45.717381+0000","last_peered":"2024-09-13T15:09:45.717381+0000","last_clean":"2024-09-13T15:09:45.717381+0000","last_became_active":"2024-09-13T15:09:45.701041+0000","last_became_peered":"2024-09-13T15:09:45.701041+0000","last_unstale":"2024-09-13T15:09:45.717381+0000","last_undegraded":"2024-09-13T15:09:45.717381+0000","last_fullsized":"2024-09-13T15:09:45.717381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:49.647307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711038+0000","last_change":"2024-09-13T15:09:45.695290+0000","last_active":"2024-09-13T15:09:45.711038+0000","last_peered":"2024-09-13T15:09:45.711038+0000","last_clean":"2024-09-13T15:09:45.711038+0000","last_became_active":"2024-09-13T15:09:45.695024+0000","last_became_peered":"2024-09-13T15:09:45.695024+0000","last_unstale":"2024-09-13T15:09:45.711038+0000","last_undegraded":"2024-09-13T15:09:45.711038+0000","last_fullsized":"2024-09-13T15:09:45.711038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:07.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712023+0000","last_change":"2024-09-13T15:09:45.709159+0000","last_active":"2024-09-13T15:09:45.712023+0000","last_peered":"2024-09-13T15:09:45.712023+0000","last_clean":"2024-09-13T15:09:45.712023+0000","last_became_active":"2024-09-13T15:09:45.708902+0000","last_became_peered":"2024-09-13T15:09:45.708902+0000","last_unstale":"2024-09-13T15:09:45.712023+0000","last_undegraded":"2024-09-13T15:09:45.712023+0000","last_fullsized":"2024-09-13T15:09:45.712023+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:00.914432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.704398+0000","last_change":"2024-09-13T15:09:45.699385+0000","last_active":"2024-09-13T15:09:45.704398+0000","last_peered":"2024-09-13T15:09:45.704398+0000","last_clean":"2024-09-13T15:09:45.704398+0000","last_became_active":"2024-09-13T15:09:45.698309+0000","last_became_peered":"2024-09-13T15:09:45.698309+0000","last_unstale":"2024-09-13T15:09:45.704398+0000","last_undegraded":"2024-09-13T15:09:45.704398+0000","last_fullsized":"2024-09-13T15:09:45.704398+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:37.780375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.710506+0000","last_change":"2024-09-13T15:09:45.697299+0000","last_active":"2024-09-13T15:09:45.710506+0000","last_peered":"2024-09-13T15:09:45.710506+0000","last_clean":"2024-09-13T15:09:45.710506+0000","last_became_active":"2024-09-13T15:09:45.696249+0000","last_became_peered":"2024-09-13T15:09:45.696249+0000","last_unstale":"2024-09-13T15:09:45.710506+0000","last_undegraded":"2024-09-13T15:09:45.710506+0000","last_fullsized":"2024-09-13T15:09:45.710506+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:35.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708874+0000","last_change":"2024-09-13T15:09:45.699747+0000","last_active":"2024-09-13T15:09:45.708874+0000","last_peered":"2024-09-13T15:09:45.708874+0000","last_clean":"2024-09-13T15:09:45.708874+0000","last_became_active":"2024-09-13T15:09:45.699344+0000","last_became_peered":"2024-09-13T15:09:45.699344+0000","last_unstale":"2024-09-13T15:09:45.708874+0000","last_undegraded":"2024-09-13T15:09:45.708874+0000","last_fullsized":"2024-09-13T15:09:45.708874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:48.016999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698816+0000","last_change":"2024-09-13T15:09:45.694501+0000","last_active":"2024-09-13T15:09:45.698816+0000","last_peered":"2024-09-13T15:09:45.698816+0000","last_clean":"2024-09-13T15:09:45.698816+0000","last_became_active":"2024-09-13T15:09:45.693950+0000","last_became_peered":"2024-09-13T15:09:45.693950+0000","last_unstale":"2024-09-13T15:09:45.698816+0000","last_undegraded":"2024-09-13T15:09:45.698816+0000","last_fullsized":"2024-09-13T15:09:45.698816+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:17.618969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698643+0000","last_change":"2024-09-13T15:09:45.695528+0000","last_active":"2024-09-13T15:09:45.698643+0000","last_peered":"2024-09-13T15:09:45.698643+0000","last_clean":"2024-09-13T15:09:45.698643+0000","last_became_active":"2024-09-13T15:09:45.695149+0000","last_became_peered":"2024-09-13T15:09:45.695149+0000","last_unstale":"2024-09-13T15:09:45.698643+0000","last_undegraded":"2024-09-13T15:09:45.698643+0000","last_fullsized":"2024-09-13T15:09:45.698643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:22.645951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705560+0000","last_change":"2024-09-13T15:09:45.700513+0000","last_active":"2024-09-13T15:09:45.705560+0000","last_peered":"2024-09-13T15:09:45.705560+0000","last_clean":"2024-09-13T15:09:45.705560+0000","last_became_active":"2024-09-13T15:09:45.697440+0000","last_became_peered":"2024-09-13T15:09:45.697440+0000","last_unstale":"2024-09-13T15:09:45.705560+0000","last_undegraded":"2024-09-13T15:09:45.705560+0000","last_fullsized":"2024-09-13T15:09:45.705560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:13.389728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705078+0000","last_change":"2024-09-13T15:09:45.698453+0000","last_active":"2024-09-13T15:09:45.705078+0000","last_peered":"2024-09-13T15:09:45.705078+0000","last_clean":"2024-09-13T15:09:45.705078+0000","last_became_active":"2024-09-13T15:09:45.698199+0000","last_became_peered":"2024-09-13T15:09:45.698199+0000","last_unstale":"2024-09-13T15:09:45.705078+0000","last_undegraded":"2024-09-13T15:09:45.705078+0000","last_fullsized":"2024-09-13T15:09:45.705078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:31.398491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712331+0000","last_change":"2024-09-13T15:09:45.693901+0000","last_active":"2024-09-13T15:09:45.712331+0000","last_peered":"2024-09-13T15:09:45.712331+0000","last_clean":"2024-09-13T15:09:45.712331+0000","last_became_active":"2024-09-13T15:09:45.693633+0000","last_became_peered":"2024-09-13T15:09:45.693633+0000","last_unstale":"2024-09-13T15:09:45.712331+0000","last_undegraded":"2024-09-13T15:09:45.712331+0000","last_fullsized":"2024-09-13T15:09:45.712331+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:47.494007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.703184+0000","last_change":"2024-09-13T15:09:45.686716+0000","last_active":"2024-09-13T15:09:45.703184+0000","last_peered":"2024-09-13T15:09:45.703184+0000","last_clean":"2024-09-13T15:09:45.703184+0000","last_became_active":"2024-09-13T15:09:45.686419+0000","last_became_peered":"2024-09-13T15:09:45.686419+0000","last_unstale":"2024-09-13T15:09:45.703184+0000","last_undegraded":"2024-09-13T15:09:45.703184+0000","last_fullsized":"2024-09-13T15:09:45.703184+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:16.957466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700490+0000","last_change":"2024-09-13T15:09:45.698280+0000","last_active":"2024-09-13T15:09:45.700490+0000","last_peered":"2024-09-13T15:09:45.700490+0000","last_clean":"2024-09-13T15:09:45.700490+0000","last_became_active":"2024-09-13T15:09:45.698042+0000","last_became_peered":"2024-09-13T15:09:45.698042+0000","last_unstale":"2024-09-13T15:09:45.700490+0000","last_undegraded":"2024-09-13T15:09:45.700490+0000","last_fullsized":"2024-09-13T15:09:45.700490+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:53.657062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.716024+0000","last_change":"2024-09-13T15:09:45.714999+0000","last_active":"2024-09-13T15:09:45.716024+0000","last_peered":"2024-09-13T15:09:45.716024+0000","last_clean":"2024-09-13T15:09:45.716024+0000","last_became_active":"2024-09-13T15:09:45.714758+0000","last_became_peered":"2024-09-13T15:09:45.714758+0000","last_unstale":"2024-09-13T15:09:45.716024+0000","last_undegraded":"2024-09-13T15:09:45.716024+0000","last_fullsized":"2024-09-13T15:09:45.716024+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:49.813119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717916+0000","last_change":"2024-09-13T15:09:45.711527+0000","last_active":"2024-09-13T15:09:45.717916+0000","last_peered":"2024-09-13T15:09:45.717916+0000","last_clean":"2024-09-13T15:09:45.717916+0000","last_became_active":"2024-09-13T15:09:45.711296+0000","last_became_peered":"2024-09-13T15:09:45.711296+0000","last_unstale":"2024-09-13T15:09:45.717916+0000","last_undegraded":"2024-09-13T15:09:45.717916+0000","last_fullsized":"2024-09-13T15:09:45.717916+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:49.813119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.707791+0000","last_change":"2024-09-13T15:09:45.694010+0000","last_active":"2024-09-13T15:09:45.707791+0000","last_peered":"2024-09-13T15:09:45.707791+0000","last_clean":"2024-09-13T15:09:45.707791+0000","last_became_active":"2024-09-13T15:09:45.693503+0000","last_became_peered":"2024-09-13T15:09:45.693503+0000","last_unstale":"2024-09-13T15:09:45.707791+0000","last_undegraded":"2024-09-13T15:09:45.707791+0000","last_fullsized":"2024-09-13T15:09:45.707791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.706248+0000","last_change":"2024-09-13T15:09:45.703503+0000","last_active":"2024-09-13T15:09:45.706248+0000","last_peered":"2024-09-13T15:09:45.706248+0000","last_clean":"2024-09-13T15:09:45.706248+0000","last_became_active":"2024-09-13T15:09:45.703220+0000","last_became_peered":"2024-09-13T15:09:45.703220+0000","last_unstale":"2024-09-13T15:09:45.706248+0000","last_undegraded":"2024-09-13T15:09:45.706248+0000","last_fullsized":"2024-09-13T15:09:45.706248+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:24.142284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.709657+0000","last_change":"2024-09-13T15:09:45.702998+0000","last_active":"2024-09-13T15:09:45.709657+0000","last_peered":"2024-09-13T15:09:45.709657+0000","last_clean":"2024-09-13T15:09:45.709657+0000","last_became_active":"2024-09-13T15:09:45.702703+0000","last_became_peered":"2024-09-13T15:09:45.702703+0000","last_unstale":"2024-09-13T15:09:45.709657+0000","last_undegraded":"2024-09-13T15:09:45.709657+0000","last_fullsized":"2024-09-13T15:09:45.709657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:13.172867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.701481+0000","last_change":"2024-09-13T15:09:45.696044+0000","last_active":"2024-09-13T15:09:45.701481+0000","last_peered":"2024-09-13T15:09:45.701481+0000","last_clean":"2024-09-13T15:09:45.701481+0000","last_became_active":"2024-09-13T15:09:45.694907+0000","last_became_peered":"2024-09-13T15:09:45.694907+0000","last_unstale":"2024-09-13T15:09:45.701481+0000","last_undegraded":"2024-09-13T15:09:45.701481+0000","last_fullsized":"2024-09-13T15:09:45.701481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714952+0000","last_change":"2024-09-13T15:09:45.713491+0000","last_active":"2024-09-13T15:09:45.714952+0000","last_peered":"2024-09-13T15:09:45.714952+0000","last_clean":"2024-09-13T15:09:45.714952+0000","last_became_active":"2024-09-13T15:09:45.712817+0000","last_became_peered":"2024-09-13T15:09:45.712817+0000","last_unstale":"2024-09-13T15:09:45.714952+0000","last_undegraded":"2024-09-13T15:09:45.714952+0000","last_fullsized":"2024-09-13T15:09:45.714952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:49.647307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708082+0000","last_change":"2024-09-13T15:09:45.707064+0000","last_active":"2024-09-13T15:09:45.708082+0000","last_peered":"2024-09-13T15:09:45.708082+0000","last_clean":"2024-09-13T15:09:45.708082+0000","last_became_active":"2024-09-13T15:09:45.706833+0000","last_became_peered":"2024-09-13T15:09:45.706833+0000","last_unstale":"2024-09-13T15:09:45.708082+0000","last_undegraded":"2024-09-13T15:09:45.708082+0000","last_fullsized":"2024-09-13T15:09:45.708082+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.702500+0000","last_change":"2024-09-13T15:09:45.695562+0000","last_active":"2024-09-13T15:09:45.702500+0000","last_peered":"2024-09-13T15:09:45.702500+0000","last_clean":"2024-09-13T15:09:45.702500+0000","last_became_active":"2024-09-13T15:09:45.695281+0000","last_became_peered":"2024-09-13T15:09:45.695281+0000","last_unstale":"2024-09-13T15:09:45.702500+0000","last_undegraded":"2024-09-13T15:09:45.702500+0000","last_fullsized":"2024-09-13T15:09:45.702500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:34.280691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705370+0000","last_change":"2024-09-13T15:09:45.221314+0000","last_active":"2024-09-13T15:09:45.705370+0000","last_peered":"2024-09-13T15:09:45.705370+0000","last_clean":"2024-09-13T15:09:45.705370+0000","last_became_active":"2024-09-13T15:09:45.221069+0000","last_became_peered":"2024-09-13T15:09:45.221069+0000","last_unstale":"2024-09-13T15:09:45.705370+0000","last_undegraded":"2024-09-13T15:09:45.705370+0000","last_fullsized":"2024-09-13T15:09:45.705370+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:47.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700446+0000","last_change":"2024-09-13T15:09:45.693522+0000","last_active":"2024-09-13T15:09:45.700446+0000","last_peered":"2024-09-13T15:09:45.700446+0000","last_clean":"2024-09-13T15:09:45.700446+0000","last_became_active":"2024-09-13T15:09:45.693253+0000","last_became_peered":"2024-09-13T15:09:45.693253+0000","last_unstale":"2024-09-13T15:09:45.700446+0000","last_undegraded":"2024-09-13T15:09:45.700446+0000","last_fullsized":"2024-09-13T15:09:45.700446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:52.880780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.715873+0000","last_change":"2024-09-13T15:09:45.240297+0000","last_active":"2024-09-13T15:09:45.715873+0000","last_peered":"2024-09-13T15:09:45.715873+0000","last_clean":"2024-09-13T15:09:45.715873+0000","last_became_active":"2024-09-13T15:09:45.238179+0000","last_became_peered":"2024-09-13T15:09:45.238179+0000","last_unstale":"2024-09-13T15:09:45.715873+0000","last_undegraded":"2024-09-13T15:09:45.715873+0000","last_fullsized":"2024-09-13T15:09:45.715873+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:11.909853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705100+0000","last_change":"2024-09-13T15:09:45.697605+0000","last_active":"2024-09-13T15:09:45.705100+0000","last_peered":"2024-09-13T15:09:45.705100+0000","last_clean":"2024-09-13T15:09:45.705100+0000","last_became_active":"2024-09-13T15:09:45.697338+0000","last_became_peered":"2024-09-13T15:09:45.697338+0000","last_unstale":"2024-09-13T15:09:45.705100+0000","last_undegraded":"2024-09-13T15:09:45.705100+0000","last_fullsized":"2024-09-13T15:09:45.705100+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:20.205959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.710394+0000","last_change":"2024-09-13T15:09:45.232700+0000","last_active":"2024-09-13T15:09:45.710394+0000","last_peered":"2024-09-13T15:09:45.710394+0000","last_clean":"2024-09-13T15:09:45.710394+0000","last_became_active":"2024-09-13T15:09:45.232442+0000","last_became_peered":"2024-09-13T15:09:45.232442+0000","last_unstale":"2024-09-13T15:09:45.710394+0000","last_undegraded":"2024-09-13T15:09:45.710394+0000","last_fullsized":"2024-09-13T15:09:45.710394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:05.428032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717560+0000","last_change":"2024-09-13T15:09:45.707462+0000","last_active":"2024-09-13T15:09:45.717560+0000","last_peered":"2024-09-13T15:09:45.717560+0000","last_clean":"2024-09-13T15:09:45.717560+0000","last_became_active":"2024-09-13T15:09:45.706899+0000","last_became_peered":"2024-09-13T15:09:45.706899+0000","last_unstale":"2024-09-13T15:09:45.717560+0000","last_undegraded":"2024-09-13T15:09:45.717560+0000","last_fullsized":"2024-09-13T15:09:45.717560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:22.645951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.715850+0000","last_change":"2024-09-13T15:09:45.234877+0000","last_active":"2024-09-13T15:09:45.715850+0000","last_peered":"2024-09-13T15:09:45.715850+0000","last_clean":"2024-09-13T15:09:45.715850+0000","last_became_active":"2024-09-13T15:09:45.234561+0000","last_became_peered":"2024-09-13T15:09:45.234561+0000","last_unstale":"2024-09-13T15:09:45.715850+0000","last_undegraded":"2024-09-13T15:09:45.715850+0000","last_fullsized":"2024-09-13T15:09:45.715850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:19.193278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.695099+0000","last_change":"2024-09-13T15:09:45.691284+0000","last_active":"2024-09-13T15:09:45.695099+0000","last_peered":"2024-09-13T15:09:45.695099+0000","last_clean":"2024-09-13T15:09:45.695099+0000","last_became_active":"2024-09-13T15:09:45.690910+0000","last_became_peered":"2024-09-13T15:09:45.690910+0000","last_unstale":"2024-09-13T15:09:45.695099+0000","last_undegraded":"2024-09-13T15:09:45.695099+0000","last_fullsized":"2024-09-13T15:09:45.695099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:00.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711230+0000","last_change":"2024-09-13T15:09:45.239784+0000","last_active":"2024-09-13T15:09:45.711230+0000","last_peered":"2024-09-13T15:09:45.711230+0000","last_clean":"2024-09-13T15:09:45.711230+0000","last_became_active":"2024-09-13T15:09:45.239570+0000","last_became_peered":"2024-09-13T15:09:45.239570+0000","last_unstale":"2024-09-13T15:09:45.711230+0000","last_undegraded":"2024-09-13T15:09:45.711230+0000","last_fullsized":"2024-09-13T15:09:45.711230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:33.268009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.701416+0000","last_change":"2024-09-13T15:09:45.695698+0000","last_active":"2024-09-13T15:09:45.701416+0000","last_peered":"2024-09-13T15:09:45.701416+0000","last_clean":"2024-09-13T15:09:45.701416+0000","last_became_active":"2024-09-13T15:09:45.695421+0000","last_became_peered":"2024-09-13T15:09:45.695421+0000","last_unstale":"2024-09-13T15:09:45.701416+0000","last_undegraded":"2024-09-13T15:09:45.701416+0000","last_fullsized":"2024-09-13T15:09:45.701416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700163+0000","last_change":"2024-09-13T15:09:45.218697+0000","last_active":"2024-09-13T15:09:45.700163+0000","last_peered":"2024-09-13T15:09:45.700163+0000","last_clean":"2024-09-13T15:09:45.700163+0000","last_became_active":"2024-09-13T15:09:45.217706+0000","last_became_peered":"2024-09-13T15:09:45.217706+0000","last_unstale":"2024-09-13T15:09:45.700163+0000","last_undegraded":"2024-09-13T15:09:45.700163+0000","last_fullsized":"2024-09-13T15:09:45.700163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:52.051701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717893+0000","last_change":"2024-09-13T15:09:45.710936+0000","last_active":"2024-09-13T15:09:45.717893+0000","last_peered":"2024-09-13T15:09:45.717893+0000","last_clean":"2024-09-13T15:09:45.717893+0000","last_became_active":"2024-09-13T15:09:45.708435+0000","last_became_peered":"2024-09-13T15:09:45.708435+0000","last_unstale":"2024-09-13T15:09:45.717893+0000","last_undegraded":"2024-09-13T15:09:45.717893+0000","last_fullsized":"2024-09-13T15:09:45.717893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.775367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.685382+0000","last_change":"2024-09-13T15:09:45.220293+0000","last_active":"2024-09-13T15:09:45.685382+0000","last_peered":"2024-09-13T15:09:45.685382+0000","last_clean":"2024-09-13T15:09:45.685382+0000","last_became_active":"2024-09-13T15:09:45.219814+0000","last_became_peered":"2024-09-13T15:09:45.219814+0000","last_unstale":"2024-09-13T15:09:45.685382+0000","last_undegraded":"2024-09-13T15:09:45.685382+0000","last_fullsized":"2024-09-13T15:09:45.685382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:35.548303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.696598+0000","last_change":"2024-09-13T15:09:45.691628+0000","last_active":"2024-09-13T15:09:45.696598+0000","last_peered":"2024-09-13T15:09:45.696598+0000","last_clean":"2024-09-13T15:09:45.696598+0000","last_became_active":"2024-09-13T15:09:45.687819+0000","last_became_peered":"2024-09-13T15:09:45.687819+0000","last_unstale":"2024-09-13T15:09:45.696598+0000","last_undegraded":"2024-09-13T15:09:45.696598+0000","last_fullsized":"2024-09-13T15:09:45.696598+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:52.880780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681273+0000","last_change":"2024-09-13T15:09:45.241644+0000","last_active":"2024-09-13T15:09:45.681273+0000","last_peered":"2024-09-13T15:09:45.681273+0000","last_clean":"2024-09-13T15:09:45.681273+0000","last_became_active":"2024-09-13T15:09:45.235590+0000","last_became_peered":"2024-09-13T15:09:45.235590+0000","last_unstale":"2024-09-13T15:09:45.681273+0000","last_undegraded":"2024-09-13T15:09:45.681273+0000","last_fullsized":"2024-09-13T15:09:45.681273+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:46.498874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.707829+0000","last_change":"2024-09-13T15:09:45.706095+0000","last_active":"2024-09-13T15:09:45.707829+0000","last_peered":"2024-09-13T15:09:45.707829+0000","last_clean":"2024-09-13T15:09:45.707829+0000","last_became_active":"2024-09-13T15:09:45.705783+0000","last_became_peered":"2024-09-13T15:09:45.705783+0000","last_unstale":"2024-09-13T15:09:45.707829+0000","last_undegraded":"2024-09-13T15:09:45.707829+0000","last_fullsized":"2024-09-13T15:09:45.707829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.677656+0000","last_change":"2024-09-13T15:09:45.228838+0000","last_active":"2024-09-13T15:09:45.677656+0000","last_peered":"2024-09-13T15:09:45.677656+0000","last_clean":"2024-09-13T15:09:45.677656+0000","last_became_active":"2024-09-13T15:09:45.228558+0000","last_became_peered":"2024-09-13T15:09:45.228558+0000","last_unstale":"2024-09-13T15:09:45.677656+0000","last_undegraded":"2024-09-13T15:09:45.677656+0000","last_fullsized":"2024-09-13T15:09:45.677656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.026968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700972+0000","last_change":"2024-09-13T15:09:45.694042+0000","last_active":"2024-09-13T15:09:45.700972+0000","last_peered":"2024-09-13T15:09:45.700972+0000","last_clean":"2024-09-13T15:09:45.700972+0000","last_became_active":"2024-09-13T15:09:45.693773+0000","last_became_peered":"2024-09-13T15:09:45.693773+0000","last_unstale":"2024-09-13T15:09:45.700972+0000","last_undegraded":"2024-09-13T15:09:45.700972+0000","last_fullsized":"2024-09-13T15:09:45.700972+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:07.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.679241+0000","last_change":"2024-09-13T15:09:45.234148+0000","last_active":"2024-09-13T15:09:45.679241+0000","last_peered":"2024-09-13T15:09:45.679241+0000","last_clean":"2024-09-13T15:09:45.679241+0000","last_became_active":"2024-09-13T15:09:45.233848+0000","last_became_peered":"2024-09-13T15:09:45.233848+0000","last_unstale":"2024-09-13T15:09:45.679241+0000","last_undegraded":"2024-09-13T15:09:45.679241+0000","last_fullsized":"2024-09-13T15:09:45.679241+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:53.652825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708559+0000","last_change":"2024-09-13T15:09:45.701484+0000","last_active":"2024-09-13T15:09:45.708559+0000","last_peered":"2024-09-13T15:09:45.708559+0000","last_clean":"2024-09-13T15:09:45.708559+0000","last_became_active":"2024-09-13T15:09:45.701171+0000","last_became_peered":"2024-09-13T15:09:45.701171+0000","last_unstale":"2024-09-13T15:09:45.708559+0000","last_undegraded":"2024-09-13T15:09:45.708559+0000","last_fullsized":"2024-09-13T15:09:45.708559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:13.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.709265+0000","last_change":"2024-09-13T15:09:45.232897+0000","last_active":"2024-09-13T15:09:45.709265+0000","last_peered":"2024-09-13T15:09:45.709265+0000","last_clean":"2024-09-13T15:09:45.709265+0000","last_became_active":"2024-09-13T15:09:45.232672+0000","last_became_peered":"2024-09-13T15:09:45.232672+0000","last_unstale":"2024-09-13T15:09:45.709265+0000","last_undegraded":"2024-09-13T15:09:45.709265+0000","last_fullsized":"2024-09-13T15:09:45.709265+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:33.799980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705958+0000","last_change":"2024-09-13T15:09:45.703002+0000","last_active":"2024-09-13T15:09:45.705958+0000","last_peered":"2024-09-13T15:09:45.705958+0000","last_clean":"2024-09-13T15:09:45.705958+0000","last_became_active":"2024-09-13T15:09:45.702766+0000","last_became_peered":"2024-09-13T15:09:45.702766+0000","last_unstale":"2024-09-13T15:09:45.705958+0000","last_undegraded":"2024-09-13T15:09:45.705958+0000","last_fullsized":"2024-09-13T15:09:45.705958+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:52.880780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.719365+0000","last_change":"2024-09-13T15:09:45.234439+0000","last_active":"2024-09-13T15:09:45.719365+0000","last_peered":"2024-09-13T15:09:45.719365+0000","last_clean":"2024-09-13T15:09:45.719365+0000","last_became_active":"2024-09-13T15:09:45.234135+0000","last_became_peered":"2024-09-13T15:09:45.234135+0000","last_unstale":"2024-09-13T15:09:45.719365+0000","last_undegraded":"2024-09-13T15:09:45.719365+0000","last_fullsized":"2024-09-13T15:09:45.719365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:51.868098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705678+0000","last_change":"2024-09-13T15:09:45.699976+0000","last_active":"2024-09-13T15:09:45.705678+0000","last_peered":"2024-09-13T15:09:45.705678+0000","last_clean":"2024-09-13T15:09:45.705678+0000","last_became_active":"2024-09-13T15:09:45.699679+0000","last_became_peered":"2024-09-13T15:09:45.699679+0000","last_unstale":"2024-09-13T15:09:45.705678+0000","last_undegraded":"2024-09-13T15:09:45.705678+0000","last_fullsized":"2024-09-13T15:09:45.705678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:00.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711146+0000","last_change":"2024-09-13T15:09:45.237989+0000","last_active":"2024-09-13T15:09:45.711146+0000","last_peered":"2024-09-13T15:09:45.711146+0000","last_clean":"2024-09-13T15:09:45.711146+0000","last_became_active":"2024-09-13T15:09:45.235545+0000","last_became_peered":"2024-09-13T15:09:45.235545+0000","last_unstale":"2024-09-13T15:09:45.711146+0000","last_undegraded":"2024-09-13T15:09:45.711146+0000","last_fullsized":"2024-09-13T15:09:45.711146+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:25.314005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698626+0000","last_change":"2024-09-13T15:09:45.695373+0000","last_active":"2024-09-13T15:09:45.698626+0000","last_peered":"2024-09-13T15:09:45.698626+0000","last_clean":"2024-09-13T15:09:45.698626+0000","last_became_active":"2024-09-13T15:09:45.694850+0000","last_became_peered":"2024-09-13T15:09:45.694850+0000","last_unstale":"2024-09-13T15:09:45.698626+0000","last_undegraded":"2024-09-13T15:09:45.698626+0000","last_fullsized":"2024-09-13T15:09:45.698626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:54.858351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.688292+0000","last_change":"2024-09-13T15:09:45.234120+0000","last_active":"2024-09-13T15:09:45.688292+0000","last_peered":"2024-09-13T15:09:45.688292+0000","last_clean":"2024-09-13T15:09:45.688292+0000","last_became_active":"2024-09-13T15:09:45.233788+0000","last_became_peered":"2024-09-13T15:09:45.233788+0000","last_unstale":"2024-09-13T15:09:45.688292+0000","last_undegraded":"2024-09-13T15:09:45.688292+0000","last_fullsized":"2024-09-13T15:09:45.688292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:15.944784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711019+0000","last_change":"2024-09-13T15:09:45.690749+0000","last_active":"2024-09-13T15:09:45.711019+0000","last_peered":"2024-09-13T15:09:45.711019+0000","last_clean":"2024-09-13T15:09:45.711019+0000","last_became_active":"2024-09-13T15:09:45.690506+0000","last_became_peered":"2024-09-13T15:09:45.690506+0000","last_unstale":"2024-09-13T15:09:45.711019+0000","last_undegraded":"2024-09-13T15:09:45.711019+0000","last_fullsized":"2024-09-13T15:09:45.711019+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:54.906075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.676111+0000","last_change":"2024-09-13T15:09:45.225826+0000","last_active":"2024-09-13T15:09:45.676111+0000","last_peered":"2024-09-13T15:09:45.676111+0000","last_clean":"2024-09-13T15:09:45.676111+0000","last_became_active":"2024-09-13T15:09:45.225426+0000","last_became_peered":"2024-09-13T15:09:45.225426+0000","last_unstale":"2024-09-13T15:09:45.676111+0000","last_undegraded":"2024-09-13T15:09:45.676111+0000","last_fullsized":"2024-09-13T15:09:45.676111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.385809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708692+0000","last_change":"2024-09-13T15:09:45.699602+0000","last_active":"2024-09-13T15:09:45.708692+0000","last_peered":"2024-09-13T15:09:45.708692+0000","last_clean":"2024-09-13T15:09:45.708692+0000","last_became_active":"2024-09-13T15:09:45.699018+0000","last_became_peered":"2024-09-13T15:09:45.699018+0000","last_unstale":"2024-09-13T15:09:45.708692+0000","last_undegraded":"2024-09-13T15:09:45.708692+0000","last_fullsized":"2024-09-13T15:09:45.708692+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:38.092469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712731+0000","last_change":"2024-09-13T15:09:45.230137+0000","last_active":"2024-09-13T15:09:45.712731+0000","last_peered":"2024-09-13T15:09:45.712731+0000","last_clean":"2024-09-13T15:09:45.712731+0000","last_became_active":"2024-09-13T15:09:45.229858+0000","last_became_peered":"2024-09-13T15:09:45.229858+0000","last_unstale":"2024-09-13T15:09:45.712731+0000","last_undegraded":"2024-09-13T15:09:45.712731+0000","last_fullsized":"2024-09-13T15:09:45.712731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:59.622311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717461+0000","last_change":"2024-09-13T15:09:45.702072+0000","last_active":"2024-09-13T15:09:45.717461+0000","last_peered":"2024-09-13T15:09:45.717461+0000","last_clean":"2024-09-13T15:09:45.717461+0000","last_became_active":"2024-09-13T15:09:45.701829+0000","last_became_peered":"2024-09-13T15:09:45.701829+0000","last_unstale":"2024-09-13T15:09:45.717461+0000","last_undegraded":"2024-09-13T15:09:45.717461+0000","last_fullsized":"2024-09-13T15:09:45.717461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:13.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717869+0000","last_change":"2024-09-13T15:09:45.242018+0000","last_active":"2024-09-13T15:09:45.717869+0000","last_peered":"2024-09-13T15:09:45.717869+0000","last_clean":"2024-09-13T15:09:45.717869+0000","last_became_active":"2024-09-13T15:09:45.241658+0000","last_became_peered":"2024-09-13T15:09:45.241658+0000","last_unstale":"2024-09-13T15:09:45.717869+0000","last_undegraded":"2024-09-13T15:09:45.717869+0000","last_fullsized":"2024-09-13T15:09:45.717869+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:16.606287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.696093+0000","last_change":"2024-09-13T15:09:45.692461+0000","last_active":"2024-09-13T15:09:45.696093+0000","last_peered":"2024-09-13T15:09:45.696093+0000","last_clean":"2024-09-13T15:09:45.696093+0000","last_became_active":"2024-09-13T15:09:45.692211+0000","last_became_peered":"2024-09-13T15:09:45.692211+0000","last_unstale":"2024-09-13T15:09:45.696093+0000","last_undegraded":"2024-09-13T15:09:45.696093+0000","last_fullsized":"2024-09-13T15:09:45.696093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:37.780375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.703794+0000","last_change":"2024-09-13T15:09:45.212221+0000","last_active":"2024-09-13T15:09:45.703794+0000","last_peered":"2024-09-13T15:09:45.703794+0000","last_clean":"2024-09-13T15:09:45.703794+0000","last_became_active":"2024-09-13T15:09:45.211928+0000","last_became_peered":"2024-09-13T15:09:45.211928+0000","last_unstale":"2024-09-13T15:09:45.703794+0000","last_undegraded":"2024-09-13T15:09:45.703794+0000","last_fullsized":"2024-09-13T15:09:45.703794+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:05.717809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.694998+0000","last_change":"2024-09-13T15:09:45.690459+0000","last_active":"2024-09-13T15:09:45.694998+0000","last_peered":"2024-09-13T15:09:45.694998+0000","last_clean":"2024-09-13T15:09:45.694998+0000","last_became_active":"2024-09-13T15:09:45.690219+0000","last_became_peered":"2024-09-13T15:09:45.690219+0000","last_unstale":"2024-09-13T15:09:45.694998+0000","last_undegraded":"2024-09-13T15:09:45.694998+0000","last_fullsized":"2024-09-13T15:09:45.694998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.716709+0000","last_change":"2024-09-13T15:09:45.231717+0000","last_active":"2024-09-13T15:09:45.716709+0000","last_peered":"2024-09-13T15:09:45.716709+0000","last_clean":"2024-09-13T15:09:45.716709+0000","last_became_active":"2024-09-13T15:09:45.231455+0000","last_became_peered":"2024-09-13T15:09:45.231455+0000","last_unstale":"2024-09-13T15:09:45.716709+0000","last_undegraded":"2024-09-13T15:09:45.716709+0000","last_fullsized":"2024-09-13T15:09:45.716709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:45.798002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711902+0000","last_change":"2024-09-13T15:09:45.701806+0000","last_active":"2024-09-13T15:09:45.711902+0000","last_peered":"2024-09-13T15:09:45.711902+0000","last_clean":"2024-09-13T15:09:45.711902+0000","last_became_active":"2024-09-13T15:09:45.701596+0000","last_became_peered":"2024-09-13T15:09:45.701596+0000","last_unstale":"2024-09-13T15:09:45.711902+0000","last_undegraded":"2024-09-13T15:09:45.711902+0000","last_fullsized":"2024-09-13T15:09:45.711902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:54.665507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.687648+0000","last_change":"2024-09-13T15:09:45.233116+0000","last_active":"2024-09-13T15:09:45.687648+0000","last_peered":"2024-09-13T15:09:45.687648+0000","last_clean":"2024-09-13T15:09:45.687648+0000","last_became_active":"2024-09-13T15:09:45.232849+0000","last_became_peered":"2024-09-13T15:09:45.232849+0000","last_unstale":"2024-09-13T15:09:45.687648+0000","last_undegraded":"2024-09-13T15:09:45.687648+0000","last_fullsized":"2024-09-13T15:09:45.687648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:20.702773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.701998+0000","last_change":"2024-09-13T15:09:45.699238+0000","last_active":"2024-09-13T15:09:45.701998+0000","last_peered":"2024-09-13T15:09:45.701998+0000","last_clean":"2024-09-13T15:09:45.701998+0000","last_became_active":"2024-09-13T15:09:45.698931+0000","last_became_peered":"2024-09-13T15:09:45.698931+0000","last_unstale":"2024-09-13T15:09:45.701998+0000","last_undegraded":"2024-09-13T15:09:45.701998+0000","last_fullsized":"2024-09-13T15:09:45.701998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:17.618969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711158+0000","last_change":"2024-09-13T15:09:45.224167+0000","last_active":"2024-09-13T15:09:45.711158+0000","last_peered":"2024-09-13T15:09:45.711158+0000","last_clean":"2024-09-13T15:09:45.711158+0000","last_became_active":"2024-09-13T15:09:45.223916+0000","last_became_peered":"2024-09-13T15:09:45.223916+0000","last_unstale":"2024-09-13T15:09:45.711158+0000","last_undegraded":"2024-09-13T15:09:45.711158+0000","last_fullsized":"2024-09-13T15:09:45.711158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:54.852141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705479+0000","last_change":"2024-09-13T15:09:45.701936+0000","last_active":"2024-09-13T15:09:45.705479+0000","last_peered":"2024-09-13T15:09:45.705479+0000","last_clean":"2024-09-13T15:09:45.705479+0000","last_became_active":"2024-09-13T15:09:45.701144+0000","last_became_peered":"2024-09-13T15:09:45.701144+0000","last_unstale":"2024-09-13T15:09:45.705479+0000","last_undegraded":"2024-09-13T15:09:45.705479+0000","last_fullsized":"2024-09-13T15:09:45.705479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:34.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681547+0000","last_change":"2024-09-13T15:09:45.230533+0000","last_active":"2024-09-13T15:09:45.681547+0000","last_peered":"2024-09-13T15:09:45.681547+0000","last_clean":"2024-09-13T15:09:45.681547+0000","last_became_active":"2024-09-13T15:09:45.230144+0000","last_became_peered":"2024-09-13T15:09:45.230144+0000","last_unstale":"2024-09-13T15:09:45.681547+0000","last_undegraded":"2024-09-13T15:09:45.681547+0000","last_fullsized":"2024-09-13T15:09:45.681547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:25.314005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.702289+0000","last_change":"2024-09-13T15:09:45.701184+0000","last_active":"2024-09-13T15:09:45.702289+0000","last_peered":"2024-09-13T15:09:45.702289+0000","last_clean":"2024-09-13T15:09:45.702289+0000","last_became_active":"2024-09-13T15:09:45.700892+0000","last_became_peered":"2024-09-13T15:09:45.700892+0000","last_unstale":"2024-09-13T15:09:45.702289+0000","last_undegraded":"2024-09-13T15:09:45.702289+0000","last_fullsized":"2024-09-13T15:09:45.702289+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:47.494007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.678524+0000","last_change":"2024-09-13T15:09:45.242222+0000","last_active":"2024-09-13T15:09:45.678524+0000","last_peered":"2024-09-13T15:09:45.678524+0000","last_clean":"2024-09-13T15:09:45.678524+0000","last_became_active":"2024-09-13T15:09:45.241962+0000","last_became_peered":"2024-09-13T15:09:45.241962+0000","last_unstale":"2024-09-13T15:09:45.678524+0000","last_undegraded":"2024-09-13T15:09:45.678524+0000","last_fullsized":"2024-09-13T15:09:45.678524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:38.123681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.718927+0000","last_change":"2024-09-13T15:09:45.715536+0000","last_active":"2024-09-13T15:09:45.718927+0000","last_peered":"2024-09-13T15:09:45.718927+0000","last_clean":"2024-09-13T15:09:45.718927+0000","last_became_active":"2024-09-13T15:09:45.715260+0000","last_became_peered":"2024-09-13T15:09:45.715260+0000","last_unstale":"2024-09-13T15:09:45.718927+0000","last_undegraded":"2024-09-13T15:09:45.718927+0000","last_fullsized":"2024-09-13T15:09:45.718927+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:17.618969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.676218+0000","last_change":"2024-09-13T15:09:45.223873+0000","last_active":"2024-09-13T15:09:45.676218+0000","last_peered":"2024-09-13T15:09:45.676218+0000","last_clean":"2024-09-13T15:09:45.676218+0000","last_became_active":"2024-09-13T15:09:45.223530+0000","last_became_peered":"2024-09-13T15:09:45.223530+0000","last_unstale":"2024-09-13T15:09:45.676218+0000","last_undegraded":"2024-09-13T15:09:45.676218+0000","last_fullsized":"2024-09-13T15:09:45.676218+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:25.396049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708063+0000","last_change":"2024-09-13T15:09:45.706732+0000","last_active":"2024-09-13T15:09:45.708063+0000","last_peered":"2024-09-13T15:09:45.708063+0000","last_clean":"2024-09-13T15:09:45.708063+0000","last_became_active":"2024-09-13T15:09:45.706436+0000","last_became_peered":"2024-09-13T15:09:45.706436+0000","last_unstale":"2024-09-13T15:09:45.708063+0000","last_undegraded":"2024-09-13T15:09:45.708063+0000","last_fullsized":"2024-09-13T15:09:45.708063+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708683+0000","last_change":"2024-09-13T15:09:45.235634+0000","last_active":"2024-09-13T15:09:45.708683+0000","last_peered":"2024-09-13T15:09:45.708683+0000","last_clean":"2024-09-13T15:09:45.708683+0000","last_became_active":"2024-09-13T15:09:45.235326+0000","last_became_peered":"2024-09-13T15:09:45.235326+0000","last_unstale":"2024-09-13T15:09:45.708683+0000","last_undegraded":"2024-09-13T15:09:45.708683+0000","last_fullsized":"2024-09-13T15:09:45.708683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:18.488067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712635+0000","last_change":"2024-09-13T15:09:45.704126+0000","last_active":"2024-09-13T15:09:45.712635+0000","last_peered":"2024-09-13T15:09:45.712635+0000","last_clean":"2024-09-13T15:09:45.712635+0000","last_became_active":"2024-09-13T15:09:45.703875+0000","last_became_peered":"2024-09-13T15:09:45.703875+0000","last_unstale":"2024-09-13T15:09:45.712635+0000","last_undegraded":"2024-09-13T15:09:45.712635+0000","last_fullsized":"2024-09-13T15:09:45.712635+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:00.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.677417+0000","last_change":"2024-09-13T15:09:45.229816+0000","last_active":"2024-09-13T15:09:45.677417+0000","last_peered":"2024-09-13T15:09:45.677417+0000","last_clean":"2024-09-13T15:09:45.677417+0000","last_became_active":"2024-09-13T15:09:45.229523+0000","last_became_peered":"2024-09-13T15:09:45.229523+0000","last_unstale":"2024-09-13T15:09:45.677417+0000","last_undegraded":"2024-09-13T15:09:45.677417+0000","last_fullsized":"2024-09-13T15:09:45.677417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:12.377046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712396+0000","last_change":"2024-09-13T15:09:45.694940+0000","last_active":"2024-09-13T15:09:45.712396+0000","last_peered":"2024-09-13T15:09:45.712396+0000","last_clean":"2024-09-13T15:09:45.712396+0000","last_became_active":"2024-09-13T15:09:45.692120+0000","last_became_peered":"2024-09-13T15:09:45.692120+0000","last_unstale":"2024-09-13T15:09:45.712396+0000","last_undegraded":"2024-09-13T15:09:45.712396+0000","last_fullsized":"2024-09-13T15:09:45.712396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:51.359286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.684305+0000","last_change":"2024-09-13T15:09:45.236213+0000","last_active":"2024-09-13T15:09:45.684305+0000","last_peered":"2024-09-13T15:09:45.684305+0000","last_clean":"2024-09-13T15:09:45.684305+0000","last_became_active":"2024-09-13T15:09:45.235957+0000","last_became_peered":"2024-09-13T15:09:45.235957+0000","last_unstale":"2024-09-13T15:09:45.684305+0000","last_undegraded":"2024-09-13T15:09:45.684305+0000","last_fullsized":"2024-09-13T15:09:45.684305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:06.358658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711965+0000","last_change":"2024-09-13T15:09:45.709742+0000","last_active":"2024-09-13T15:09:45.711965+0000","last_peered":"2024-09-13T15:09:45.711965+0000","last_clean":"2024-09-13T15:09:45.711965+0000","last_became_active":"2024-09-13T15:09:45.709488+0000","last_became_peered":"2024-09-13T15:09:45.709488+0000","last_unstale":"2024-09-13T15:09:45.711965+0000","last_undegraded":"2024-09-13T15:09:45.711965+0000","last_fullsized":"2024-09-13T15:09:45.711965+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:38.735535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681923+0000","last_change":"2024-09-13T15:09:45.230255+0000","last_active":"2024-09-13T15:09:45.681923+0000","last_peered":"2024-09-13T15:09:45.681923+0000","last_clean":"2024-09-13T15:09:45.681923+0000","last_became_active":"2024-09-13T15:09:45.229975+0000","last_became_peered":"2024-09-13T15:09:45.229975+0000","last_unstale":"2024-09-13T15:09:45.681923+0000","last_undegraded":"2024-09-13T15:09:45.681923+0000","last_fullsized":"2024-09-13T15:09:45.681923+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:38.123681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.707376+0000","last_change":"2024-09-13T15:09:45.701988+0000","last_active":"2024-09-13T15:09:45.707376+0000","last_peered":"2024-09-13T15:09:45.707376+0000","last_clean":"2024-09-13T15:09:45.707376+0000","last_became_active":"2024-09-13T15:09:45.701745+0000","last_became_peered":"2024-09-13T15:09:45.701745+0000","last_unstale":"2024-09-13T15:09:45.707376+0000","last_undegraded":"2024-09-13T15:09:45.707376+0000","last_fullsized":"2024-09-13T15:09:45.707376+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681642+0000","last_change":"2024-09-13T15:09:45.234918+0000","last_active":"2024-09-13T15:09:45.681642+0000","last_peered":"2024-09-13T15:09:45.681642+0000","last_clean":"2024-09-13T15:09:45.681642+0000","last_became_active":"2024-09-13T15:09:45.234683+0000","last_became_peered":"2024-09-13T15:09:45.234683+0000","last_unstale":"2024-09-13T15:09:45.681642+0000","last_undegraded":"2024-09-13T15:09:45.681642+0000","last_fullsized":"2024-09-13T15:09:45.681642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:28.391130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711148+0000","last_change":"2024-09-13T15:09:45.709996+0000","last_active":"2024-09-13T15:09:45.711148+0000","last_peered":"2024-09-13T15:09:45.711148+0000","last_clean":"2024-09-13T15:09:45.711148+0000","last_became_active":"2024-09-13T15:09:45.709765+0000","last_became_peered":"2024-09-13T15:09:45.709765+0000","last_unstale":"2024-09-13T15:09:45.711148+0000","last_undegraded":"2024-09-13T15:09:45.711148+0000","last_fullsized":"2024-09-13T15:09:45.711148+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:41.712825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.679094+0000","last_change":"2024-09-13T15:09:45.228364+0000","last_active":"2024-09-13T15:09:45.679094+0000","last_peered":"2024-09-13T15:09:45.679094+0000","last_clean":"2024-09-13T15:09:45.679094+0000","last_became_active":"2024-09-13T15:09:45.228061+0000","last_became_peered":"2024-09-13T15:09:45.228061+0000","last_unstale":"2024-09-13T15:09:45.679094+0000","last_undegraded":"2024-09-13T15:09:45.679094+0000","last_fullsized":"2024-09-13T15:09:45.679094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:25.979851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714117+0000","last_change":"2024-09-13T15:09:45.699888+0000","last_active":"2024-09-13T15:09:45.714117+0000","last_peered":"2024-09-13T15:09:45.714117+0000","last_clean":"2024-09-13T15:09:45.714117+0000","last_became_active":"2024-09-13T15:09:45.699646+0000","last_became_peered":"2024-09-13T15:09:45.699646+0000","last_unstale":"2024-09-13T15:09:45.714117+0000","last_undegraded":"2024-09-13T15:09:45.714117+0000","last_fullsized":"2024-09-13T15:09:45.714117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:13.172867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.685750+0000","last_change":"2024-09-13T15:09:45.223440+0000","last_active":"2024-09-13T15:09:45.685750+0000","last_peered":"2024-09-13T15:09:45.685750+0000","last_clean":"2024-09-13T15:09:45.685750+0000","last_became_active":"2024-09-13T15:09:45.223164+0000","last_became_peered":"2024-09-13T15:09:45.223164+0000","last_unstale":"2024-09-13T15:09:45.685750+0000","last_undegraded":"2024-09-13T15:09:45.685750+0000","last_fullsized":"2024-09-13T15:09:45.685750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:23.129602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.706276+0000","last_change":"2024-09-13T15:09:45.703785+0000","last_active":"2024-09-13T15:09:45.706276+0000","last_peered":"2024-09-13T15:09:45.706276+0000","last_clean":"2024-09-13T15:09:45.706276+0000","last_became_active":"2024-09-13T15:09:45.703456+0000","last_became_peered":"2024-09-13T15:09:45.703456+0000","last_unstale":"2024-09-13T15:09:45.706276+0000","last_undegraded":"2024-09-13T15:09:45.706276+0000","last_fullsized":"2024-09-13T15:09:45.706276+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:14.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.685450+0000","last_change":"2024-09-13T15:09:45.238082+0000","last_active":"2024-09-13T15:09:45.685450+0000","last_peered":"2024-09-13T15:09:45.685450+0000","last_clean":"2024-09-13T15:09:45.685450+0000","last_became_active":"2024-09-13T15:09:45.237828+0000","last_became_peered":"2024-09-13T15:09:45.237828+0000","last_unstale":"2024-09-13T15:09:45.685450+0000","last_undegraded":"2024-09-13T15:09:45.685450+0000","last_fullsized":"2024-09-13T15:09:45.685450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:51.868098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.211565+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:09:45.211565+0000","last_peered":"2024-09-13T15:09:45.211565+0000","last_clean":"2024-09-13T15:09:45.211565+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:09:45.211565+0000","last_undegraded":"2024-09-13T15:09:45.211565+0000","last_fullsized":"2024-09-13T15:09:45.211565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":855743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.248},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.2330000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":1.014}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.2969999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.141}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.365},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3440000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.429},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.93300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":264356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.751},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1359999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":0.87}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.377},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.216}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.177},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":1.415},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.4650000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":272470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.008}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.47},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":1.073}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.5269999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.405},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.377}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.1279999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.302}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":265375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.141},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.78}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.651},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.887}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.3580000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.448},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5309999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.7},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":2.2090000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.581}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":602112,"data_stored":264356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.2}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.603},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.177}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.401}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.327},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.5589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":258780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":0.5},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.179}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.206},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.389}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":606208,"data_stored":265375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.1759999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.4890000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":1.02}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.383},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":1.3520000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.421},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.2210000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1196032,"data_stored":854724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.3959999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":0.877}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.45},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.046}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.218}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.321},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.159},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.359}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:09:50.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:09:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.239+0000 7f2fe2e00700 1 Processor -- start 2024-09-13T15:09:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.239+0000 7f2fe2e00700 1 -- start start 2024-09-13T15:09:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fdc143840 0x7f2fdc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc06ccb0 0x7f2fdc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0d1470 con 0x7f2fdc0cd420 2024-09-13T15:09:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b5a20 con 0x7f2fdc143840 2024-09-13T15:09:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0d19a0 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fdc143840 0x7f2fdc15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2fdc143840 0x7f2fdc15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42136/0 (socket says 172.21.15.50:42136) 2024-09-13T15:09:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 -- 172.21.15.50:0/4278940311 learned_addr learned my addr 172.21.15.50:0/4278940311 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2400700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc06ccb0 0x7f2fdc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 -- 172.21.15.50:0/4278940311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc06ccb0 msgr2=0x7f2fdc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc06ccb0 0x7f2fdc0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 -- 172.21.15.50:0/4278940311 >> v1:172.21.15.50:6789/0 conn(0x7f2fdc0cd420 legacy=0x7f2fdc06c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 -- 172.21.15.50:0/4278940311 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0b56f0 con 0x7f2fdc143840 2024-09-13T15:09:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe2400700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc06ccb0 0x7f2fdc0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fe1a00700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc143840 0x7f2fdc15efa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009910 tx=0x7f2fd0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d1c443d411eaf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fdbe00700 1 -- 172.21.15.50:0/4278940311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000ba60 con 0x7f2fdc143840 2024-09-13T15:09:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fdbe00700 1 -- 172.21.15.50:0/4278940311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd000bbc0 con 0x7f2fdc143840 2024-09-13T15:09:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.243+0000 7f2fdbe00700 1 -- 172.21.15.50:0/4278940311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0009e60 con 0x7f2fdc143840 2024-09-13T15:09:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 -- 172.21.15.50:0/4278940311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc143840 msgr2=0x7f2fdc15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc143840 0x7f2fdc15efa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009910 tx=0x7f2fd0009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:50.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 -- 172.21.15.50:0/4278940311 shutdown_connections 2024-09-13T15:09:50.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc06ccb0 0x7f2fdc0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/4278940311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc143840 0x7f2fdc15efa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 -- 172.21.15.50:0/4278940311 >> 172.21.15.50:0/4278940311 conn(0x7f2fdc0b62a0 msgr2=0x7f2fdc071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:50.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 -- 172.21.15.50:0/4278940311 shutdown_connections 2024-09-13T15:09:50.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.247+0000 7f2fe2e00700 1 -- 172.21.15.50:0/4278940311 wait complete. 2024-09-13T15:09:50.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 Processor -- start 2024-09-13T15:09:50.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 -- start start 2024-09-13T15:09:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 0x7f2fdc13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fdc0cd420 0x7f2fdc13a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc143840 0x7f2fdc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc13b870 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc13afd0 con 0x7f2fdc0cd420 2024-09-13T15:09:50.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc13b2b0 con 0x7f2fdc143840 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 0x7f2fdc13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 0x7f2fdc13a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42144/0 (socket says 172.21.15.50:42144) 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 -- 172.21.15.50:0/2747075729 learned_addr learned my addr 172.21.15.50:0/2747075729 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1000700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fdc0cd420 0x7f2fdc13a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2400700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc143840 0x7f2fdc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 -- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc143840 msgr2=0x7f2fdc0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc143840 0x7f2fdc0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 -- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fdc0cd420 msgr2=0x7f2fdc13a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fdc0cd420 0x7f2fdc13a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1a00700 1 -- 172.21.15.50:0/2747075729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd0009570 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe1000700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fdc0cd420 0x7f2fdc13a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.251+0000 7f2fe2400700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc143840 0x7f2fdc0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fe1a00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 0x7f2fdc13a0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0000c00 tx=0x7f2fd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0004550 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc13b590 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd001f070 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0003900 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc15a980 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.255+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc135610 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.259+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2fd0003a60 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.259+0000 7f2fd9600700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2fbc066730 0x7f2fbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.259+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2fd0021070 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.259+0000 7f2fe1000700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2fbc066730 0x7f2fbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.263+0000 7f2fe1000700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2fbc066730 0x7f2fbc068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0b4c60 tx=0x7f2fc8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.267+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2fdc135610 con 0x7f2fdc06ccb0 2024-09-13T15:09:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.455+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fdc13b420 con 0x7f2fbc066730 2024-09-13T15:09:50.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.471+0000 7f2fd9600700 1 -- 172.21.15.50:0/2747075729 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286519 (secure 0 0 0) 0x7f2fdc13b420 con 0x7f2fbc066730 2024-09-13T15:09:50.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2fbc066730 msgr2=0x7f2fbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2fbc066730 0x7f2fbc068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0b4c60 tx=0x7f2fc8009040 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 msgr2=0x7f2fdc13a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 0x7f2fdc13a0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0000c00 tx=0x7f2fd0004770 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 shutdown_connections 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2fbc066730 0x7f2fbc068bf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fdc143840 0x7f2fdc0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fdc0cd420 0x7f2fdc13a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 --2- 172.21.15.50:0/2747075729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fdc06ccb0 0x7f2fdc13a0c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 >> 172.21.15.50:0/2747075729 conn(0x7f2fdc0b62a0 msgr2=0x7f2fdc15da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 shutdown_connections 2024-09-13T15:09:50.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.483+0000 7f2fe2e00700 1 -- 172.21.15.50:0/2747075729 wait complete. 2024-09-13T15:09:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:09:50.511 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-09-13T15:09:50.055428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238456,"kb_used_data":5884,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736264,"statfs":{"total":773094113280,"available":772849934336,"internally_reserved":0,"allocated":6025216,"data_stored":3301179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.861060"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711934+0000","last_change":"2024-09-13T15:09:45.703629+0000","last_active":"2024-09-13T15:09:45.711934+0000","last_peered":"2024-09-13T15:09:45.711934+0000","last_clean":"2024-09-13T15:09:45.711934+0000","last_became_active":"2024-09-13T15:09:45.703401+0000","last_became_peered":"2024-09-13T15:09:45.703401+0000","last_unstale":"2024-09-13T15:09:45.711934+0000","last_undegraded":"2024-09-13T15:09:45.711934+0000","last_fullsized":"2024-09-13T15:09:45.711934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:34.280691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698834+0000","last_change":"2024-09-13T15:09:45.694636+0000","last_active":"2024-09-13T15:09:45.698834+0000","last_peered":"2024-09-13T15:09:45.698834+0000","last_clean":"2024-09-13T15:09:45.698834+0000","last_became_active":"2024-09-13T15:09:45.694285+0000","last_became_peered":"2024-09-13T15:09:45.694285+0000","last_unstale":"2024-09-13T15:09:45.698834+0000","last_undegraded":"2024-09-13T15:09:45.698834+0000","last_fullsized":"2024-09-13T15:09:45.698834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:07.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714295+0000","last_change":"2024-09-13T15:09:45.712443+0000","last_active":"2024-09-13T15:09:45.714295+0000","last_peered":"2024-09-13T15:09:45.714295+0000","last_clean":"2024-09-13T15:09:45.714295+0000","last_became_active":"2024-09-13T15:09:45.711403+0000","last_became_peered":"2024-09-13T15:09:45.711403+0000","last_unstale":"2024-09-13T15:09:45.714295+0000","last_undegraded":"2024-09-13T15:09:45.714295+0000","last_fullsized":"2024-09-13T15:09:45.714295+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.083588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705174+0000","last_change":"2024-09-13T15:09:45.702859+0000","last_active":"2024-09-13T15:09:45.705174+0000","last_peered":"2024-09-13T15:09:45.705174+0000","last_clean":"2024-09-13T15:09:45.705174+0000","last_became_active":"2024-09-13T15:09:45.702510+0000","last_became_peered":"2024-09-13T15:09:45.702510+0000","last_unstale":"2024-09-13T15:09:45.705174+0000","last_undegraded":"2024-09-13T15:09:45.705174+0000","last_fullsized":"2024-09-13T15:09:45.705174+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.692012+0000","last_change":"2024-09-13T15:09:45.689214+0000","last_active":"2024-09-13T15:09:45.692012+0000","last_peered":"2024-09-13T15:09:45.692012+0000","last_clean":"2024-09-13T15:09:45.692012+0000","last_became_active":"2024-09-13T15:09:45.688903+0000","last_became_peered":"2024-09-13T15:09:45.688903+0000","last_unstale":"2024-09-13T15:09:45.692012+0000","last_undegraded":"2024-09-13T15:09:45.692012+0000","last_fullsized":"2024-09-13T15:09:45.692012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.710437+0000","last_change":"2024-09-13T15:09:45.697010+0000","last_active":"2024-09-13T15:09:45.710437+0000","last_peered":"2024-09-13T15:09:45.710437+0000","last_clean":"2024-09-13T15:09:45.710437+0000","last_became_active":"2024-09-13T15:09:45.696217+0000","last_became_peered":"2024-09-13T15:09:45.696217+0000","last_unstale":"2024-09-13T15:09:45.710437+0000","last_undegraded":"2024-09-13T15:09:45.710437+0000","last_fullsized":"2024-09-13T15:09:45.710437+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.696110+0000","last_change":"2024-09-13T15:09:45.692993+0000","last_active":"2024-09-13T15:09:45.696110+0000","last_peered":"2024-09-13T15:09:45.696110+0000","last_clean":"2024-09-13T15:09:45.696110+0000","last_became_active":"2024-09-13T15:09:45.692693+0000","last_became_peered":"2024-09-13T15:09:45.692693+0000","last_unstale":"2024-09-13T15:09:45.696110+0000","last_undegraded":"2024-09-13T15:09:45.696110+0000","last_fullsized":"2024-09-13T15:09:45.696110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:57.501456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717484+0000","last_change":"2024-09-13T15:09:45.702429+0000","last_active":"2024-09-13T15:09:45.717484+0000","last_peered":"2024-09-13T15:09:45.717484+0000","last_clean":"2024-09-13T15:09:45.717484+0000","last_became_active":"2024-09-13T15:09:45.702123+0000","last_became_peered":"2024-09-13T15:09:45.702123+0000","last_unstale":"2024-09-13T15:09:45.717484+0000","last_undegraded":"2024-09-13T15:09:45.717484+0000","last_fullsized":"2024-09-13T15:09:45.717484+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:38.735535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714099+0000","last_change":"2024-09-13T15:09:45.693874+0000","last_active":"2024-09-13T15:09:45.714099+0000","last_peered":"2024-09-13T15:09:45.714099+0000","last_clean":"2024-09-13T15:09:45.714099+0000","last_became_active":"2024-09-13T15:09:45.693632+0000","last_became_peered":"2024-09-13T15:09:45.693632+0000","last_unstale":"2024-09-13T15:09:45.714099+0000","last_undegraded":"2024-09-13T15:09:45.714099+0000","last_fullsized":"2024-09-13T15:09:45.714099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:53.657062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711005+0000","last_change":"2024-09-13T15:09:45.696707+0000","last_active":"2024-09-13T15:09:45.711005+0000","last_peered":"2024-09-13T15:09:45.711005+0000","last_clean":"2024-09-13T15:09:45.711005+0000","last_became_active":"2024-09-13T15:09:45.696465+0000","last_became_peered":"2024-09-13T15:09:45.696465+0000","last_unstale":"2024-09-13T15:09:45.711005+0000","last_undegraded":"2024-09-13T15:09:45.711005+0000","last_fullsized":"2024-09-13T15:09:45.711005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.703176+0000","last_change":"2024-09-13T15:09:45.684278+0000","last_active":"2024-09-13T15:09:45.703176+0000","last_peered":"2024-09-13T15:09:45.703176+0000","last_clean":"2024-09-13T15:09:45.703176+0000","last_became_active":"2024-09-13T15:09:45.684005+0000","last_became_peered":"2024-09-13T15:09:45.684005+0000","last_unstale":"2024-09-13T15:09:45.703176+0000","last_undegraded":"2024-09-13T15:09:45.703176+0000","last_fullsized":"2024-09-13T15:09:45.703176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:21.715455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717381+0000","last_change":"2024-09-13T15:09:45.701263+0000","last_active":"2024-09-13T15:09:45.717381+0000","last_peered":"2024-09-13T15:09:45.717381+0000","last_clean":"2024-09-13T15:09:45.717381+0000","last_became_active":"2024-09-13T15:09:45.701041+0000","last_became_peered":"2024-09-13T15:09:45.701041+0000","last_unstale":"2024-09-13T15:09:45.717381+0000","last_undegraded":"2024-09-13T15:09:45.717381+0000","last_fullsized":"2024-09-13T15:09:45.717381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:49.647307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711038+0000","last_change":"2024-09-13T15:09:45.695290+0000","last_active":"2024-09-13T15:09:45.711038+0000","last_peered":"2024-09-13T15:09:45.711038+0000","last_clean":"2024-09-13T15:09:45.711038+0000","last_became_active":"2024-09-13T15:09:45.695024+0000","last_became_peered":"2024-09-13T15:09:45.695024+0000","last_unstale":"2024-09-13T15:09:45.711038+0000","last_undegraded":"2024-09-13T15:09:45.711038+0000","last_fullsized":"2024-09-13T15:09:45.711038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:07.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712023+0000","last_change":"2024-09-13T15:09:45.709159+0000","last_active":"2024-09-13T15:09:45.712023+0000","last_peered":"2024-09-13T15:09:45.712023+0000","last_clean":"2024-09-13T15:09:45.712023+0000","last_became_active":"2024-09-13T15:09:45.708902+0000","last_became_peered":"2024-09-13T15:09:45.708902+0000","last_unstale":"2024-09-13T15:09:45.712023+0000","last_undegraded":"2024-09-13T15:09:45.712023+0000","last_fullsized":"2024-09-13T15:09:45.712023+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:00.914432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.704398+0000","last_change":"2024-09-13T15:09:45.699385+0000","last_active":"2024-09-13T15:09:45.704398+0000","last_peered":"2024-09-13T15:09:45.704398+0000","last_clean":"2024-09-13T15:09:45.704398+0000","last_became_active":"2024-09-13T15:09:45.698309+0000","last_became_peered":"2024-09-13T15:09:45.698309+0000","last_unstale":"2024-09-13T15:09:45.704398+0000","last_undegraded":"2024-09-13T15:09:45.704398+0000","last_fullsized":"2024-09-13T15:09:45.704398+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:37.780375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.710506+0000","last_change":"2024-09-13T15:09:45.697299+0000","last_active":"2024-09-13T15:09:45.710506+0000","last_peered":"2024-09-13T15:09:45.710506+0000","last_clean":"2024-09-13T15:09:45.710506+0000","last_became_active":"2024-09-13T15:09:45.696249+0000","last_became_peered":"2024-09-13T15:09:45.696249+0000","last_unstale":"2024-09-13T15:09:45.710506+0000","last_undegraded":"2024-09-13T15:09:45.710506+0000","last_fullsized":"2024-09-13T15:09:45.710506+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:35.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708874+0000","last_change":"2024-09-13T15:09:45.699747+0000","last_active":"2024-09-13T15:09:45.708874+0000","last_peered":"2024-09-13T15:09:45.708874+0000","last_clean":"2024-09-13T15:09:45.708874+0000","last_became_active":"2024-09-13T15:09:45.699344+0000","last_became_peered":"2024-09-13T15:09:45.699344+0000","last_unstale":"2024-09-13T15:09:45.708874+0000","last_undegraded":"2024-09-13T15:09:45.708874+0000","last_fullsized":"2024-09-13T15:09:45.708874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:48.016999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698816+0000","last_change":"2024-09-13T15:09:45.694501+0000","last_active":"2024-09-13T15:09:45.698816+0000","last_peered":"2024-09-13T15:09:45.698816+0000","last_clean":"2024-09-13T15:09:45.698816+0000","last_became_active":"2024-09-13T15:09:45.693950+0000","last_became_peered":"2024-09-13T15:09:45.693950+0000","last_unstale":"2024-09-13T15:09:45.698816+0000","last_undegraded":"2024-09-13T15:09:45.698816+0000","last_fullsized":"2024-09-13T15:09:45.698816+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:17.618969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698643+0000","last_change":"2024-09-13T15:09:45.695528+0000","last_active":"2024-09-13T15:09:45.698643+0000","last_peered":"2024-09-13T15:09:45.698643+0000","last_clean":"2024-09-13T15:09:45.698643+0000","last_became_active":"2024-09-13T15:09:45.695149+0000","last_became_peered":"2024-09-13T15:09:45.695149+0000","last_unstale":"2024-09-13T15:09:45.698643+0000","last_undegraded":"2024-09-13T15:09:45.698643+0000","last_fullsized":"2024-09-13T15:09:45.698643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:22.645951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705560+0000","last_change":"2024-09-13T15:09:45.700513+0000","last_active":"2024-09-13T15:09:45.705560+0000","last_peered":"2024-09-13T15:09:45.705560+0000","last_clean":"2024-09-13T15:09:45.705560+0000","last_became_active":"2024-09-13T15:09:45.697440+0000","last_became_peered":"2024-09-13T15:09:45.697440+0000","last_unstale":"2024-09-13T15:09:45.705560+0000","last_undegraded":"2024-09-13T15:09:45.705560+0000","last_fullsized":"2024-09-13T15:09:45.705560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:13.389728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705078+0000","last_change":"2024-09-13T15:09:45.698453+0000","last_active":"2024-09-13T15:09:45.705078+0000","last_peered":"2024-09-13T15:09:45.705078+0000","last_clean":"2024-09-13T15:09:45.705078+0000","last_became_active":"2024-09-13T15:09:45.698199+0000","last_became_peered":"2024-09-13T15:09:45.698199+0000","last_unstale":"2024-09-13T15:09:45.705078+0000","last_undegraded":"2024-09-13T15:09:45.705078+0000","last_fullsized":"2024-09-13T15:09:45.705078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:31.398491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712331+0000","last_change":"2024-09-13T15:09:45.693901+0000","last_active":"2024-09-13T15:09:45.712331+0000","last_peered":"2024-09-13T15:09:45.712331+0000","last_clean":"2024-09-13T15:09:45.712331+0000","last_became_active":"2024-09-13T15:09:45.693633+0000","last_became_peered":"2024-09-13T15:09:45.693633+0000","last_unstale":"2024-09-13T15:09:45.712331+0000","last_undegraded":"2024-09-13T15:09:45.712331+0000","last_fullsized":"2024-09-13T15:09:45.712331+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:47.494007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.703184+0000","last_change":"2024-09-13T15:09:45.686716+0000","last_active":"2024-09-13T15:09:45.703184+0000","last_peered":"2024-09-13T15:09:45.703184+0000","last_clean":"2024-09-13T15:09:45.703184+0000","last_became_active":"2024-09-13T15:09:45.686419+0000","last_became_peered":"2024-09-13T15:09:45.686419+0000","last_unstale":"2024-09-13T15:09:45.703184+0000","last_undegraded":"2024-09-13T15:09:45.703184+0000","last_fullsized":"2024-09-13T15:09:45.703184+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:16.957466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700490+0000","last_change":"2024-09-13T15:09:45.698280+0000","last_active":"2024-09-13T15:09:45.700490+0000","last_peered":"2024-09-13T15:09:45.700490+0000","last_clean":"2024-09-13T15:09:45.700490+0000","last_became_active":"2024-09-13T15:09:45.698042+0000","last_became_peered":"2024-09-13T15:09:45.698042+0000","last_unstale":"2024-09-13T15:09:45.700490+0000","last_undegraded":"2024-09-13T15:09:45.700490+0000","last_fullsized":"2024-09-13T15:09:45.700490+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:53.657062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.716024+0000","last_change":"2024-09-13T15:09:45.714999+0000","last_active":"2024-09-13T15:09:45.716024+0000","last_peered":"2024-09-13T15:09:45.716024+0000","last_clean":"2024-09-13T15:09:45.716024+0000","last_became_active":"2024-09-13T15:09:45.714758+0000","last_became_peered":"2024-09-13T15:09:45.714758+0000","last_unstale":"2024-09-13T15:09:45.716024+0000","last_undegraded":"2024-09-13T15:09:45.716024+0000","last_fullsized":"2024-09-13T15:09:45.716024+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:49.813119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717916+0000","last_change":"2024-09-13T15:09:45.711527+0000","last_active":"2024-09-13T15:09:45.717916+0000","last_peered":"2024-09-13T15:09:45.717916+0000","last_clean":"2024-09-13T15:09:45.717916+0000","last_became_active":"2024-09-13T15:09:45.711296+0000","last_became_peered":"2024-09-13T15:09:45.711296+0000","last_unstale":"2024-09-13T15:09:45.717916+0000","last_undegraded":"2024-09-13T15:09:45.717916+0000","last_fullsized":"2024-09-13T15:09:45.717916+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:49.813119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.707791+0000","last_change":"2024-09-13T15:09:45.694010+0000","last_active":"2024-09-13T15:09:45.707791+0000","last_peered":"2024-09-13T15:09:45.707791+0000","last_clean":"2024-09-13T15:09:45.707791+0000","last_became_active":"2024-09-13T15:09:45.693503+0000","last_became_peered":"2024-09-13T15:09:45.693503+0000","last_unstale":"2024-09-13T15:09:45.707791+0000","last_undegraded":"2024-09-13T15:09:45.707791+0000","last_fullsized":"2024-09-13T15:09:45.707791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.706248+0000","last_change":"2024-09-13T15:09:45.703503+0000","last_active":"2024-09-13T15:09:45.706248+0000","last_peered":"2024-09-13T15:09:45.706248+0000","last_clean":"2024-09-13T15:09:45.706248+0000","last_became_active":"2024-09-13T15:09:45.703220+0000","last_became_peered":"2024-09-13T15:09:45.703220+0000","last_unstale":"2024-09-13T15:09:45.706248+0000","last_undegraded":"2024-09-13T15:09:45.706248+0000","last_fullsized":"2024-09-13T15:09:45.706248+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:24.142284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.709657+0000","last_change":"2024-09-13T15:09:45.702998+0000","last_active":"2024-09-13T15:09:45.709657+0000","last_peered":"2024-09-13T15:09:45.709657+0000","last_clean":"2024-09-13T15:09:45.709657+0000","last_became_active":"2024-09-13T15:09:45.702703+0000","last_became_peered":"2024-09-13T15:09:45.702703+0000","last_unstale":"2024-09-13T15:09:45.709657+0000","last_undegraded":"2024-09-13T15:09:45.709657+0000","last_fullsized":"2024-09-13T15:09:45.709657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:13.172867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.701481+0000","last_change":"2024-09-13T15:09:45.696044+0000","last_active":"2024-09-13T15:09:45.701481+0000","last_peered":"2024-09-13T15:09:45.701481+0000","last_clean":"2024-09-13T15:09:45.701481+0000","last_became_active":"2024-09-13T15:09:45.694907+0000","last_became_peered":"2024-09-13T15:09:45.694907+0000","last_unstale":"2024-09-13T15:09:45.701481+0000","last_undegraded":"2024-09-13T15:09:45.701481+0000","last_fullsized":"2024-09-13T15:09:45.701481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714952+0000","last_change":"2024-09-13T15:09:45.713491+0000","last_active":"2024-09-13T15:09:45.714952+0000","last_peered":"2024-09-13T15:09:45.714952+0000","last_clean":"2024-09-13T15:09:45.714952+0000","last_became_active":"2024-09-13T15:09:45.712817+0000","last_became_peered":"2024-09-13T15:09:45.712817+0000","last_unstale":"2024-09-13T15:09:45.714952+0000","last_undegraded":"2024-09-13T15:09:45.714952+0000","last_fullsized":"2024-09-13T15:09:45.714952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:49.647307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708082+0000","last_change":"2024-09-13T15:09:45.707064+0000","last_active":"2024-09-13T15:09:45.708082+0000","last_peered":"2024-09-13T15:09:45.708082+0000","last_clean":"2024-09-13T15:09:45.708082+0000","last_became_active":"2024-09-13T15:09:45.706833+0000","last_became_peered":"2024-09-13T15:09:45.706833+0000","last_unstale":"2024-09-13T15:09:45.708082+0000","last_undegraded":"2024-09-13T15:09:45.708082+0000","last_fullsized":"2024-09-13T15:09:45.708082+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.702500+0000","last_change":"2024-09-13T15:09:45.695562+0000","last_active":"2024-09-13T15:09:45.702500+0000","last_peered":"2024-09-13T15:09:45.702500+0000","last_clean":"2024-09-13T15:09:45.702500+0000","last_became_active":"2024-09-13T15:09:45.695281+0000","last_became_peered":"2024-09-13T15:09:45.695281+0000","last_unstale":"2024-09-13T15:09:45.702500+0000","last_undegraded":"2024-09-13T15:09:45.702500+0000","last_fullsized":"2024-09-13T15:09:45.702500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:34.280691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705370+0000","last_change":"2024-09-13T15:09:45.221314+0000","last_active":"2024-09-13T15:09:45.705370+0000","last_peered":"2024-09-13T15:09:45.705370+0000","last_clean":"2024-09-13T15:09:45.705370+0000","last_became_active":"2024-09-13T15:09:45.221069+0000","last_became_peered":"2024-09-13T15:09:45.221069+0000","last_unstale":"2024-09-13T15:09:45.705370+0000","last_undegraded":"2024-09-13T15:09:45.705370+0000","last_fullsized":"2024-09-13T15:09:45.705370+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:47.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700446+0000","last_change":"2024-09-13T15:09:45.693522+0000","last_active":"2024-09-13T15:09:45.700446+0000","last_peered":"2024-09-13T15:09:45.700446+0000","last_clean":"2024-09-13T15:09:45.700446+0000","last_became_active":"2024-09-13T15:09:45.693253+0000","last_became_peered":"2024-09-13T15:09:45.693253+0000","last_unstale":"2024-09-13T15:09:45.700446+0000","last_undegraded":"2024-09-13T15:09:45.700446+0000","last_fullsized":"2024-09-13T15:09:45.700446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:52.880780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.715873+0000","last_change":"2024-09-13T15:09:45.240297+0000","last_active":"2024-09-13T15:09:45.715873+0000","last_peered":"2024-09-13T15:09:45.715873+0000","last_clean":"2024-09-13T15:09:45.715873+0000","last_became_active":"2024-09-13T15:09:45.238179+0000","last_became_peered":"2024-09-13T15:09:45.238179+0000","last_unstale":"2024-09-13T15:09:45.715873+0000","last_undegraded":"2024-09-13T15:09:45.715873+0000","last_fullsized":"2024-09-13T15:09:45.715873+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:11.909853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705100+0000","last_change":"2024-09-13T15:09:45.697605+0000","last_active":"2024-09-13T15:09:45.705100+0000","last_peered":"2024-09-13T15:09:45.705100+0000","last_clean":"2024-09-13T15:09:45.705100+0000","last_became_active":"2024-09-13T15:09:45.697338+0000","last_became_peered":"2024-09-13T15:09:45.697338+0000","last_unstale":"2024-09-13T15:09:45.705100+0000","last_undegraded":"2024-09-13T15:09:45.705100+0000","last_fullsized":"2024-09-13T15:09:45.705100+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:20.205959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.710394+0000","last_change":"2024-09-13T15:09:45.232700+0000","last_active":"2024-09-13T15:09:45.710394+0000","last_peered":"2024-09-13T15:09:45.710394+0000","last_clean":"2024-09-13T15:09:45.710394+0000","last_became_active":"2024-09-13T15:09:45.232442+0000","last_became_peered":"2024-09-13T15:09:45.232442+0000","last_unstale":"2024-09-13T15:09:45.710394+0000","last_undegraded":"2024-09-13T15:09:45.710394+0000","last_fullsized":"2024-09-13T15:09:45.710394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:05.428032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717560+0000","last_change":"2024-09-13T15:09:45.707462+0000","last_active":"2024-09-13T15:09:45.717560+0000","last_peered":"2024-09-13T15:09:45.717560+0000","last_clean":"2024-09-13T15:09:45.717560+0000","last_became_active":"2024-09-13T15:09:45.706899+0000","last_became_peered":"2024-09-13T15:09:45.706899+0000","last_unstale":"2024-09-13T15:09:45.717560+0000","last_undegraded":"2024-09-13T15:09:45.717560+0000","last_fullsized":"2024-09-13T15:09:45.717560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:22.645951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.715850+0000","last_change":"2024-09-13T15:09:45.234877+0000","last_active":"2024-09-13T15:09:45.715850+0000","last_peered":"2024-09-13T15:09:45.715850+0000","last_clean":"2024-09-13T15:09:45.715850+0000","last_became_active":"2024-09-13T15:09:45.234561+0000","last_became_peered":"2024-09-13T15:09:45.234561+0000","last_unstale":"2024-09-13T15:09:45.715850+0000","last_undegraded":"2024-09-13T15:09:45.715850+0000","last_fullsized":"2024-09-13T15:09:45.715850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:19.193278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.695099+0000","last_change":"2024-09-13T15:09:45.691284+0000","last_active":"2024-09-13T15:09:45.695099+0000","last_peered":"2024-09-13T15:09:45.695099+0000","last_clean":"2024-09-13T15:09:45.695099+0000","last_became_active":"2024-09-13T15:09:45.690910+0000","last_became_peered":"2024-09-13T15:09:45.690910+0000","last_unstale":"2024-09-13T15:09:45.695099+0000","last_undegraded":"2024-09-13T15:09:45.695099+0000","last_fullsized":"2024-09-13T15:09:45.695099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:00.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711230+0000","last_change":"2024-09-13T15:09:45.239784+0000","last_active":"2024-09-13T15:09:45.711230+0000","last_peered":"2024-09-13T15:09:45.711230+0000","last_clean":"2024-09-13T15:09:45.711230+0000","last_became_active":"2024-09-13T15:09:45.239570+0000","last_became_peered":"2024-09-13T15:09:45.239570+0000","last_unstale":"2024-09-13T15:09:45.711230+0000","last_undegraded":"2024-09-13T15:09:45.711230+0000","last_fullsized":"2024-09-13T15:09:45.711230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:33.268009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.701416+0000","last_change":"2024-09-13T15:09:45.695698+0000","last_active":"2024-09-13T15:09:45.701416+0000","last_peered":"2024-09-13T15:09:45.701416+0000","last_clean":"2024-09-13T15:09:45.701416+0000","last_became_active":"2024-09-13T15:09:45.695421+0000","last_became_peered":"2024-09-13T15:09:45.695421+0000","last_unstale":"2024-09-13T15:09:45.701416+0000","last_undegraded":"2024-09-13T15:09:45.701416+0000","last_fullsized":"2024-09-13T15:09:45.701416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700163+0000","last_change":"2024-09-13T15:09:45.218697+0000","last_active":"2024-09-13T15:09:45.700163+0000","last_peered":"2024-09-13T15:09:45.700163+0000","last_clean":"2024-09-13T15:09:45.700163+0000","last_became_active":"2024-09-13T15:09:45.217706+0000","last_became_peered":"2024-09-13T15:09:45.217706+0000","last_unstale":"2024-09-13T15:09:45.700163+0000","last_undegraded":"2024-09-13T15:09:45.700163+0000","last_fullsized":"2024-09-13T15:09:45.700163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:52.051701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717893+0000","last_change":"2024-09-13T15:09:45.710936+0000","last_active":"2024-09-13T15:09:45.717893+0000","last_peered":"2024-09-13T15:09:45.717893+0000","last_clean":"2024-09-13T15:09:45.717893+0000","last_became_active":"2024-09-13T15:09:45.708435+0000","last_became_peered":"2024-09-13T15:09:45.708435+0000","last_unstale":"2024-09-13T15:09:45.717893+0000","last_undegraded":"2024-09-13T15:09:45.717893+0000","last_fullsized":"2024-09-13T15:09:45.717893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.775367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.685382+0000","last_change":"2024-09-13T15:09:45.220293+0000","last_active":"2024-09-13T15:09:45.685382+0000","last_peered":"2024-09-13T15:09:45.685382+0000","last_clean":"2024-09-13T15:09:45.685382+0000","last_became_active":"2024-09-13T15:09:45.219814+0000","last_became_peered":"2024-09-13T15:09:45.219814+0000","last_unstale":"2024-09-13T15:09:45.685382+0000","last_undegraded":"2024-09-13T15:09:45.685382+0000","last_fullsized":"2024-09-13T15:09:45.685382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:35.548303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.696598+0000","last_change":"2024-09-13T15:09:45.691628+0000","last_active":"2024-09-13T15:09:45.696598+0000","last_peered":"2024-09-13T15:09:45.696598+0000","last_clean":"2024-09-13T15:09:45.696598+0000","last_became_active":"2024-09-13T15:09:45.687819+0000","last_became_peered":"2024-09-13T15:09:45.687819+0000","last_unstale":"2024-09-13T15:09:45.696598+0000","last_undegraded":"2024-09-13T15:09:45.696598+0000","last_fullsized":"2024-09-13T15:09:45.696598+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:52.880780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681273+0000","last_change":"2024-09-13T15:09:45.241644+0000","last_active":"2024-09-13T15:09:45.681273+0000","last_peered":"2024-09-13T15:09:45.681273+0000","last_clean":"2024-09-13T15:09:45.681273+0000","last_became_active":"2024-09-13T15:09:45.235590+0000","last_became_peered":"2024-09-13T15:09:45.235590+0000","last_unstale":"2024-09-13T15:09:45.681273+0000","last_undegraded":"2024-09-13T15:09:45.681273+0000","last_fullsized":"2024-09-13T15:09:45.681273+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:46.498874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.707829+0000","last_change":"2024-09-13T15:09:45.706095+0000","last_active":"2024-09-13T15:09:45.707829+0000","last_peered":"2024-09-13T15:09:45.707829+0000","last_clean":"2024-09-13T15:09:45.707829+0000","last_became_active":"2024-09-13T15:09:45.705783+0000","last_became_peered":"2024-09-13T15:09:45.705783+0000","last_unstale":"2024-09-13T15:09:45.707829+0000","last_undegraded":"2024-09-13T15:09:45.707829+0000","last_fullsized":"2024-09-13T15:09:45.707829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:39.136363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.677656+0000","last_change":"2024-09-13T15:09:45.228838+0000","last_active":"2024-09-13T15:09:45.677656+0000","last_peered":"2024-09-13T15:09:45.677656+0000","last_clean":"2024-09-13T15:09:45.677656+0000","last_became_active":"2024-09-13T15:09:45.228558+0000","last_became_peered":"2024-09-13T15:09:45.228558+0000","last_unstale":"2024-09-13T15:09:45.677656+0000","last_undegraded":"2024-09-13T15:09:45.677656+0000","last_fullsized":"2024-09-13T15:09:45.677656+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.026968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.700972+0000","last_change":"2024-09-13T15:09:45.694042+0000","last_active":"2024-09-13T15:09:45.700972+0000","last_peered":"2024-09-13T15:09:45.700972+0000","last_clean":"2024-09-13T15:09:45.700972+0000","last_became_active":"2024-09-13T15:09:45.693773+0000","last_became_peered":"2024-09-13T15:09:45.693773+0000","last_unstale":"2024-09-13T15:09:45.700972+0000","last_undegraded":"2024-09-13T15:09:45.700972+0000","last_fullsized":"2024-09-13T15:09:45.700972+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:07.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.679241+0000","last_change":"2024-09-13T15:09:45.234148+0000","last_active":"2024-09-13T15:09:45.679241+0000","last_peered":"2024-09-13T15:09:45.679241+0000","last_clean":"2024-09-13T15:09:45.679241+0000","last_became_active":"2024-09-13T15:09:45.233848+0000","last_became_peered":"2024-09-13T15:09:45.233848+0000","last_unstale":"2024-09-13T15:09:45.679241+0000","last_undegraded":"2024-09-13T15:09:45.679241+0000","last_fullsized":"2024-09-13T15:09:45.679241+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:53.652825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708559+0000","last_change":"2024-09-13T15:09:45.701484+0000","last_active":"2024-09-13T15:09:45.708559+0000","last_peered":"2024-09-13T15:09:45.708559+0000","last_clean":"2024-09-13T15:09:45.708559+0000","last_became_active":"2024-09-13T15:09:45.701171+0000","last_became_peered":"2024-09-13T15:09:45.701171+0000","last_unstale":"2024-09-13T15:09:45.708559+0000","last_undegraded":"2024-09-13T15:09:45.708559+0000","last_fullsized":"2024-09-13T15:09:45.708559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:13.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.709265+0000","last_change":"2024-09-13T15:09:45.232897+0000","last_active":"2024-09-13T15:09:45.709265+0000","last_peered":"2024-09-13T15:09:45.709265+0000","last_clean":"2024-09-13T15:09:45.709265+0000","last_became_active":"2024-09-13T15:09:45.232672+0000","last_became_peered":"2024-09-13T15:09:45.232672+0000","last_unstale":"2024-09-13T15:09:45.709265+0000","last_undegraded":"2024-09-13T15:09:45.709265+0000","last_fullsized":"2024-09-13T15:09:45.709265+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:33.799980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705958+0000","last_change":"2024-09-13T15:09:45.703002+0000","last_active":"2024-09-13T15:09:45.705958+0000","last_peered":"2024-09-13T15:09:45.705958+0000","last_clean":"2024-09-13T15:09:45.705958+0000","last_became_active":"2024-09-13T15:09:45.702766+0000","last_became_peered":"2024-09-13T15:09:45.702766+0000","last_unstale":"2024-09-13T15:09:45.705958+0000","last_undegraded":"2024-09-13T15:09:45.705958+0000","last_fullsized":"2024-09-13T15:09:45.705958+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:52.880780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.719365+0000","last_change":"2024-09-13T15:09:45.234439+0000","last_active":"2024-09-13T15:09:45.719365+0000","last_peered":"2024-09-13T15:09:45.719365+0000","last_clean":"2024-09-13T15:09:45.719365+0000","last_became_active":"2024-09-13T15:09:45.234135+0000","last_became_peered":"2024-09-13T15:09:45.234135+0000","last_unstale":"2024-09-13T15:09:45.719365+0000","last_undegraded":"2024-09-13T15:09:45.719365+0000","last_fullsized":"2024-09-13T15:09:45.719365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:51.868098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705678+0000","last_change":"2024-09-13T15:09:45.699976+0000","last_active":"2024-09-13T15:09:45.705678+0000","last_peered":"2024-09-13T15:09:45.705678+0000","last_clean":"2024-09-13T15:09:45.705678+0000","last_became_active":"2024-09-13T15:09:45.699679+0000","last_became_peered":"2024-09-13T15:09:45.699679+0000","last_unstale":"2024-09-13T15:09:45.705678+0000","last_undegraded":"2024-09-13T15:09:45.705678+0000","last_fullsized":"2024-09-13T15:09:45.705678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:00.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711146+0000","last_change":"2024-09-13T15:09:45.237989+0000","last_active":"2024-09-13T15:09:45.711146+0000","last_peered":"2024-09-13T15:09:45.711146+0000","last_clean":"2024-09-13T15:09:45.711146+0000","last_became_active":"2024-09-13T15:09:45.235545+0000","last_became_peered":"2024-09-13T15:09:45.235545+0000","last_unstale":"2024-09-13T15:09:45.711146+0000","last_undegraded":"2024-09-13T15:09:45.711146+0000","last_fullsized":"2024-09-13T15:09:45.711146+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:25.314005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.698626+0000","last_change":"2024-09-13T15:09:45.695373+0000","last_active":"2024-09-13T15:09:45.698626+0000","last_peered":"2024-09-13T15:09:45.698626+0000","last_clean":"2024-09-13T15:09:45.698626+0000","last_became_active":"2024-09-13T15:09:45.694850+0000","last_became_peered":"2024-09-13T15:09:45.694850+0000","last_unstale":"2024-09-13T15:09:45.698626+0000","last_undegraded":"2024-09-13T15:09:45.698626+0000","last_fullsized":"2024-09-13T15:09:45.698626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:54.858351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.688292+0000","last_change":"2024-09-13T15:09:45.234120+0000","last_active":"2024-09-13T15:09:45.688292+0000","last_peered":"2024-09-13T15:09:45.688292+0000","last_clean":"2024-09-13T15:09:45.688292+0000","last_became_active":"2024-09-13T15:09:45.233788+0000","last_became_peered":"2024-09-13T15:09:45.233788+0000","last_unstale":"2024-09-13T15:09:45.688292+0000","last_undegraded":"2024-09-13T15:09:45.688292+0000","last_fullsized":"2024-09-13T15:09:45.688292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:15.944784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711019+0000","last_change":"2024-09-13T15:09:45.690749+0000","last_active":"2024-09-13T15:09:45.711019+0000","last_peered":"2024-09-13T15:09:45.711019+0000","last_clean":"2024-09-13T15:09:45.711019+0000","last_became_active":"2024-09-13T15:09:45.690506+0000","last_became_peered":"2024-09-13T15:09:45.690506+0000","last_unstale":"2024-09-13T15:09:45.711019+0000","last_undegraded":"2024-09-13T15:09:45.711019+0000","last_fullsized":"2024-09-13T15:09:45.711019+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:54.906075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.676111+0000","last_change":"2024-09-13T15:09:45.225826+0000","last_active":"2024-09-13T15:09:45.676111+0000","last_peered":"2024-09-13T15:09:45.676111+0000","last_clean":"2024-09-13T15:09:45.676111+0000","last_became_active":"2024-09-13T15:09:45.225426+0000","last_became_peered":"2024-09-13T15:09:45.225426+0000","last_unstale":"2024-09-13T15:09:45.676111+0000","last_undegraded":"2024-09-13T15:09:45.676111+0000","last_fullsized":"2024-09-13T15:09:45.676111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.385809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708692+0000","last_change":"2024-09-13T15:09:45.699602+0000","last_active":"2024-09-13T15:09:45.708692+0000","last_peered":"2024-09-13T15:09:45.708692+0000","last_clean":"2024-09-13T15:09:45.708692+0000","last_became_active":"2024-09-13T15:09:45.699018+0000","last_became_peered":"2024-09-13T15:09:45.699018+0000","last_unstale":"2024-09-13T15:09:45.708692+0000","last_undegraded":"2024-09-13T15:09:45.708692+0000","last_fullsized":"2024-09-13T15:09:45.708692+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:38.092469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712731+0000","last_change":"2024-09-13T15:09:45.230137+0000","last_active":"2024-09-13T15:09:45.712731+0000","last_peered":"2024-09-13T15:09:45.712731+0000","last_clean":"2024-09-13T15:09:45.712731+0000","last_became_active":"2024-09-13T15:09:45.229858+0000","last_became_peered":"2024-09-13T15:09:45.229858+0000","last_unstale":"2024-09-13T15:09:45.712731+0000","last_undegraded":"2024-09-13T15:09:45.712731+0000","last_fullsized":"2024-09-13T15:09:45.712731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:59.622311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717461+0000","last_change":"2024-09-13T15:09:45.702072+0000","last_active":"2024-09-13T15:09:45.717461+0000","last_peered":"2024-09-13T15:09:45.717461+0000","last_clean":"2024-09-13T15:09:45.717461+0000","last_became_active":"2024-09-13T15:09:45.701829+0000","last_became_peered":"2024-09-13T15:09:45.701829+0000","last_unstale":"2024-09-13T15:09:45.717461+0000","last_undegraded":"2024-09-13T15:09:45.717461+0000","last_fullsized":"2024-09-13T15:09:45.717461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:13.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.717869+0000","last_change":"2024-09-13T15:09:45.242018+0000","last_active":"2024-09-13T15:09:45.717869+0000","last_peered":"2024-09-13T15:09:45.717869+0000","last_clean":"2024-09-13T15:09:45.717869+0000","last_became_active":"2024-09-13T15:09:45.241658+0000","last_became_peered":"2024-09-13T15:09:45.241658+0000","last_unstale":"2024-09-13T15:09:45.717869+0000","last_undegraded":"2024-09-13T15:09:45.717869+0000","last_fullsized":"2024-09-13T15:09:45.717869+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:16.606287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.696093+0000","last_change":"2024-09-13T15:09:45.692461+0000","last_active":"2024-09-13T15:09:45.696093+0000","last_peered":"2024-09-13T15:09:45.696093+0000","last_clean":"2024-09-13T15:09:45.696093+0000","last_became_active":"2024-09-13T15:09:45.692211+0000","last_became_peered":"2024-09-13T15:09:45.692211+0000","last_unstale":"2024-09-13T15:09:45.696093+0000","last_undegraded":"2024-09-13T15:09:45.696093+0000","last_fullsized":"2024-09-13T15:09:45.696093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:37.780375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.703794+0000","last_change":"2024-09-13T15:09:45.212221+0000","last_active":"2024-09-13T15:09:45.703794+0000","last_peered":"2024-09-13T15:09:45.703794+0000","last_clean":"2024-09-13T15:09:45.703794+0000","last_became_active":"2024-09-13T15:09:45.211928+0000","last_became_peered":"2024-09-13T15:09:45.211928+0000","last_unstale":"2024-09-13T15:09:45.703794+0000","last_undegraded":"2024-09-13T15:09:45.703794+0000","last_fullsized":"2024-09-13T15:09:45.703794+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:05.717809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.694998+0000","last_change":"2024-09-13T15:09:45.690459+0000","last_active":"2024-09-13T15:09:45.694998+0000","last_peered":"2024-09-13T15:09:45.694998+0000","last_clean":"2024-09-13T15:09:45.694998+0000","last_became_active":"2024-09-13T15:09:45.690219+0000","last_became_peered":"2024-09-13T15:09:45.690219+0000","last_unstale":"2024-09-13T15:09:45.694998+0000","last_undegraded":"2024-09-13T15:09:45.694998+0000","last_fullsized":"2024-09-13T15:09:45.694998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.716709+0000","last_change":"2024-09-13T15:09:45.231717+0000","last_active":"2024-09-13T15:09:45.716709+0000","last_peered":"2024-09-13T15:09:45.716709+0000","last_clean":"2024-09-13T15:09:45.716709+0000","last_became_active":"2024-09-13T15:09:45.231455+0000","last_became_peered":"2024-09-13T15:09:45.231455+0000","last_unstale":"2024-09-13T15:09:45.716709+0000","last_undegraded":"2024-09-13T15:09:45.716709+0000","last_fullsized":"2024-09-13T15:09:45.716709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:45.798002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711902+0000","last_change":"2024-09-13T15:09:45.701806+0000","last_active":"2024-09-13T15:09:45.711902+0000","last_peered":"2024-09-13T15:09:45.711902+0000","last_clean":"2024-09-13T15:09:45.711902+0000","last_became_active":"2024-09-13T15:09:45.701596+0000","last_became_peered":"2024-09-13T15:09:45.701596+0000","last_unstale":"2024-09-13T15:09:45.711902+0000","last_undegraded":"2024-09-13T15:09:45.711902+0000","last_fullsized":"2024-09-13T15:09:45.711902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:54.665507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.687648+0000","last_change":"2024-09-13T15:09:45.233116+0000","last_active":"2024-09-13T15:09:45.687648+0000","last_peered":"2024-09-13T15:09:45.687648+0000","last_clean":"2024-09-13T15:09:45.687648+0000","last_became_active":"2024-09-13T15:09:45.232849+0000","last_became_peered":"2024-09-13T15:09:45.232849+0000","last_unstale":"2024-09-13T15:09:45.687648+0000","last_undegraded":"2024-09-13T15:09:45.687648+0000","last_fullsized":"2024-09-13T15:09:45.687648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:20.702773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.701998+0000","last_change":"2024-09-13T15:09:45.699238+0000","last_active":"2024-09-13T15:09:45.701998+0000","last_peered":"2024-09-13T15:09:45.701998+0000","last_clean":"2024-09-13T15:09:45.701998+0000","last_became_active":"2024-09-13T15:09:45.698931+0000","last_became_peered":"2024-09-13T15:09:45.698931+0000","last_unstale":"2024-09-13T15:09:45.701998+0000","last_undegraded":"2024-09-13T15:09:45.701998+0000","last_fullsized":"2024-09-13T15:09:45.701998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:17.618969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711158+0000","last_change":"2024-09-13T15:09:45.224167+0000","last_active":"2024-09-13T15:09:45.711158+0000","last_peered":"2024-09-13T15:09:45.711158+0000","last_clean":"2024-09-13T15:09:45.711158+0000","last_became_active":"2024-09-13T15:09:45.223916+0000","last_became_peered":"2024-09-13T15:09:45.223916+0000","last_unstale":"2024-09-13T15:09:45.711158+0000","last_undegraded":"2024-09-13T15:09:45.711158+0000","last_fullsized":"2024-09-13T15:09:45.711158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:54.852141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.705479+0000","last_change":"2024-09-13T15:09:45.701936+0000","last_active":"2024-09-13T15:09:45.705479+0000","last_peered":"2024-09-13T15:09:45.705479+0000","last_clean":"2024-09-13T15:09:45.705479+0000","last_became_active":"2024-09-13T15:09:45.701144+0000","last_became_peered":"2024-09-13T15:09:45.701144+0000","last_unstale":"2024-09-13T15:09:45.705479+0000","last_undegraded":"2024-09-13T15:09:45.705479+0000","last_fullsized":"2024-09-13T15:09:45.705479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:34.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681547+0000","last_change":"2024-09-13T15:09:45.230533+0000","last_active":"2024-09-13T15:09:45.681547+0000","last_peered":"2024-09-13T15:09:45.681547+0000","last_clean":"2024-09-13T15:09:45.681547+0000","last_became_active":"2024-09-13T15:09:45.230144+0000","last_became_peered":"2024-09-13T15:09:45.230144+0000","last_unstale":"2024-09-13T15:09:45.681547+0000","last_undegraded":"2024-09-13T15:09:45.681547+0000","last_fullsized":"2024-09-13T15:09:45.681547+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:25.314005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.702289+0000","last_change":"2024-09-13T15:09:45.701184+0000","last_active":"2024-09-13T15:09:45.702289+0000","last_peered":"2024-09-13T15:09:45.702289+0000","last_clean":"2024-09-13T15:09:45.702289+0000","last_became_active":"2024-09-13T15:09:45.700892+0000","last_became_peered":"2024-09-13T15:09:45.700892+0000","last_unstale":"2024-09-13T15:09:45.702289+0000","last_undegraded":"2024-09-13T15:09:45.702289+0000","last_fullsized":"2024-09-13T15:09:45.702289+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:47.494007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.678524+0000","last_change":"2024-09-13T15:09:45.242222+0000","last_active":"2024-09-13T15:09:45.678524+0000","last_peered":"2024-09-13T15:09:45.678524+0000","last_clean":"2024-09-13T15:09:45.678524+0000","last_became_active":"2024-09-13T15:09:45.241962+0000","last_became_peered":"2024-09-13T15:09:45.241962+0000","last_unstale":"2024-09-13T15:09:45.678524+0000","last_undegraded":"2024-09-13T15:09:45.678524+0000","last_fullsized":"2024-09-13T15:09:45.678524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:38.123681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.718927+0000","last_change":"2024-09-13T15:09:45.715536+0000","last_active":"2024-09-13T15:09:45.718927+0000","last_peered":"2024-09-13T15:09:45.718927+0000","last_clean":"2024-09-13T15:09:45.718927+0000","last_became_active":"2024-09-13T15:09:45.715260+0000","last_became_peered":"2024-09-13T15:09:45.715260+0000","last_unstale":"2024-09-13T15:09:45.718927+0000","last_undegraded":"2024-09-13T15:09:45.718927+0000","last_fullsized":"2024-09-13T15:09:45.718927+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:17.618969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.676218+0000","last_change":"2024-09-13T15:09:45.223873+0000","last_active":"2024-09-13T15:09:45.676218+0000","last_peered":"2024-09-13T15:09:45.676218+0000","last_clean":"2024-09-13T15:09:45.676218+0000","last_became_active":"2024-09-13T15:09:45.223530+0000","last_became_peered":"2024-09-13T15:09:45.223530+0000","last_unstale":"2024-09-13T15:09:45.676218+0000","last_undegraded":"2024-09-13T15:09:45.676218+0000","last_fullsized":"2024-09-13T15:09:45.676218+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:25.396049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708063+0000","last_change":"2024-09-13T15:09:45.706732+0000","last_active":"2024-09-13T15:09:45.708063+0000","last_peered":"2024-09-13T15:09:45.708063+0000","last_clean":"2024-09-13T15:09:45.708063+0000","last_became_active":"2024-09-13T15:09:45.706436+0000","last_became_peered":"2024-09-13T15:09:45.706436+0000","last_unstale":"2024-09-13T15:09:45.708063+0000","last_undegraded":"2024-09-13T15:09:45.708063+0000","last_fullsized":"2024-09-13T15:09:45.708063+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:26.326687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.708683+0000","last_change":"2024-09-13T15:09:45.235634+0000","last_active":"2024-09-13T15:09:45.708683+0000","last_peered":"2024-09-13T15:09:45.708683+0000","last_clean":"2024-09-13T15:09:45.708683+0000","last_became_active":"2024-09-13T15:09:45.235326+0000","last_became_peered":"2024-09-13T15:09:45.235326+0000","last_unstale":"2024-09-13T15:09:45.708683+0000","last_undegraded":"2024-09-13T15:09:45.708683+0000","last_fullsized":"2024-09-13T15:09:45.708683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:18.488067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712635+0000","last_change":"2024-09-13T15:09:45.704126+0000","last_active":"2024-09-13T15:09:45.712635+0000","last_peered":"2024-09-13T15:09:45.712635+0000","last_clean":"2024-09-13T15:09:45.712635+0000","last_became_active":"2024-09-13T15:09:45.703875+0000","last_became_peered":"2024-09-13T15:09:45.703875+0000","last_unstale":"2024-09-13T15:09:45.712635+0000","last_undegraded":"2024-09-13T15:09:45.712635+0000","last_fullsized":"2024-09-13T15:09:45.712635+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:00.634993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.677417+0000","last_change":"2024-09-13T15:09:45.229816+0000","last_active":"2024-09-13T15:09:45.677417+0000","last_peered":"2024-09-13T15:09:45.677417+0000","last_clean":"2024-09-13T15:09:45.677417+0000","last_became_active":"2024-09-13T15:09:45.229523+0000","last_became_peered":"2024-09-13T15:09:45.229523+0000","last_unstale":"2024-09-13T15:09:45.677417+0000","last_undegraded":"2024-09-13T15:09:45.677417+0000","last_fullsized":"2024-09-13T15:09:45.677417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:12.377046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.712396+0000","last_change":"2024-09-13T15:09:45.694940+0000","last_active":"2024-09-13T15:09:45.712396+0000","last_peered":"2024-09-13T15:09:45.712396+0000","last_clean":"2024-09-13T15:09:45.712396+0000","last_became_active":"2024-09-13T15:09:45.692120+0000","last_became_peered":"2024-09-13T15:09:45.692120+0000","last_unstale":"2024-09-13T15:09:45.712396+0000","last_undegraded":"2024-09-13T15:09:45.712396+0000","last_fullsized":"2024-09-13T15:09:45.712396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:51.359286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.684305+0000","last_change":"2024-09-13T15:09:45.236213+0000","last_active":"2024-09-13T15:09:45.684305+0000","last_peered":"2024-09-13T15:09:45.684305+0000","last_clean":"2024-09-13T15:09:45.684305+0000","last_became_active":"2024-09-13T15:09:45.235957+0000","last_became_peered":"2024-09-13T15:09:45.235957+0000","last_unstale":"2024-09-13T15:09:45.684305+0000","last_undegraded":"2024-09-13T15:09:45.684305+0000","last_fullsized":"2024-09-13T15:09:45.684305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:06.358658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711965+0000","last_change":"2024-09-13T15:09:45.709742+0000","last_active":"2024-09-13T15:09:45.711965+0000","last_peered":"2024-09-13T15:09:45.711965+0000","last_clean":"2024-09-13T15:09:45.711965+0000","last_became_active":"2024-09-13T15:09:45.709488+0000","last_became_peered":"2024-09-13T15:09:45.709488+0000","last_unstale":"2024-09-13T15:09:45.711965+0000","last_undegraded":"2024-09-13T15:09:45.711965+0000","last_fullsized":"2024-09-13T15:09:45.711965+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:38.735535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681923+0000","last_change":"2024-09-13T15:09:45.230255+0000","last_active":"2024-09-13T15:09:45.681923+0000","last_peered":"2024-09-13T15:09:45.681923+0000","last_clean":"2024-09-13T15:09:45.681923+0000","last_became_active":"2024-09-13T15:09:45.229975+0000","last_became_peered":"2024-09-13T15:09:45.229975+0000","last_unstale":"2024-09-13T15:09:45.681923+0000","last_undegraded":"2024-09-13T15:09:45.681923+0000","last_fullsized":"2024-09-13T15:09:45.681923+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:38.123681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.707376+0000","last_change":"2024-09-13T15:09:45.701988+0000","last_active":"2024-09-13T15:09:45.707376+0000","last_peered":"2024-09-13T15:09:45.707376+0000","last_clean":"2024-09-13T15:09:45.707376+0000","last_became_active":"2024-09-13T15:09:45.701745+0000","last_became_peered":"2024-09-13T15:09:45.701745+0000","last_unstale":"2024-09-13T15:09:45.707376+0000","last_undegraded":"2024-09-13T15:09:45.707376+0000","last_fullsized":"2024-09-13T15:09:45.707376+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:29.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.681642+0000","last_change":"2024-09-13T15:09:45.234918+0000","last_active":"2024-09-13T15:09:45.681642+0000","last_peered":"2024-09-13T15:09:45.681642+0000","last_clean":"2024-09-13T15:09:45.681642+0000","last_became_active":"2024-09-13T15:09:45.234683+0000","last_became_peered":"2024-09-13T15:09:45.234683+0000","last_unstale":"2024-09-13T15:09:45.681642+0000","last_undegraded":"2024-09-13T15:09:45.681642+0000","last_fullsized":"2024-09-13T15:09:45.681642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:28.391130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.711148+0000","last_change":"2024-09-13T15:09:45.709996+0000","last_active":"2024-09-13T15:09:45.711148+0000","last_peered":"2024-09-13T15:09:45.711148+0000","last_clean":"2024-09-13T15:09:45.711148+0000","last_became_active":"2024-09-13T15:09:45.709765+0000","last_became_peered":"2024-09-13T15:09:45.709765+0000","last_unstale":"2024-09-13T15:09:45.711148+0000","last_undegraded":"2024-09-13T15:09:45.711148+0000","last_fullsized":"2024-09-13T15:09:45.711148+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:41.712825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.679094+0000","last_change":"2024-09-13T15:09:45.228364+0000","last_active":"2024-09-13T15:09:45.679094+0000","last_peered":"2024-09-13T15:09:45.679094+0000","last_clean":"2024-09-13T15:09:45.679094+0000","last_became_active":"2024-09-13T15:09:45.228061+0000","last_became_peered":"2024-09-13T15:09:45.228061+0000","last_unstale":"2024-09-13T15:09:45.679094+0000","last_undegraded":"2024-09-13T15:09:45.679094+0000","last_fullsized":"2024-09-13T15:09:45.679094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:25.979851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.714117+0000","last_change":"2024-09-13T15:09:45.699888+0000","last_active":"2024-09-13T15:09:45.714117+0000","last_peered":"2024-09-13T15:09:45.714117+0000","last_clean":"2024-09-13T15:09:45.714117+0000","last_became_active":"2024-09-13T15:09:45.699646+0000","last_became_peered":"2024-09-13T15:09:45.699646+0000","last_unstale":"2024-09-13T15:09:45.714117+0000","last_undegraded":"2024-09-13T15:09:45.714117+0000","last_fullsized":"2024-09-13T15:09:45.714117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:13.172867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.685750+0000","last_change":"2024-09-13T15:09:45.223440+0000","last_active":"2024-09-13T15:09:45.685750+0000","last_peered":"2024-09-13T15:09:45.685750+0000","last_clean":"2024-09-13T15:09:45.685750+0000","last_became_active":"2024-09-13T15:09:45.223164+0000","last_became_peered":"2024-09-13T15:09:45.223164+0000","last_unstale":"2024-09-13T15:09:45.685750+0000","last_undegraded":"2024-09-13T15:09:45.685750+0000","last_fullsized":"2024-09-13T15:09:45.685750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:23.129602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.706276+0000","last_change":"2024-09-13T15:09:45.703785+0000","last_active":"2024-09-13T15:09:45.706276+0000","last_peered":"2024-09-13T15:09:45.706276+0000","last_clean":"2024-09-13T15:09:45.706276+0000","last_became_active":"2024-09-13T15:09:45.703456+0000","last_became_peered":"2024-09-13T15:09:45.703456+0000","last_unstale":"2024-09-13T15:09:45.706276+0000","last_undegraded":"2024-09-13T15:09:45.706276+0000","last_fullsized":"2024-09-13T15:09:45.706276+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:45.192443+0000","last_clean_scrub_stamp":"2024-09-13T15:09:45.192443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:14.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.685450+0000","last_change":"2024-09-13T15:09:45.238082+0000","last_active":"2024-09-13T15:09:45.685450+0000","last_peered":"2024-09-13T15:09:45.685450+0000","last_clean":"2024-09-13T15:09:45.685450+0000","last_became_active":"2024-09-13T15:09:45.237828+0000","last_became_peered":"2024-09-13T15:09:45.237828+0000","last_unstale":"2024-09-13T15:09:45.685450+0000","last_undegraded":"2024-09-13T15:09:45.685450+0000","last_fullsized":"2024-09-13T15:09:45.685450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:09:44.179761+0000","last_clean_scrub_stamp":"2024-09-13T15:09:44.179761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:51.868098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T15:09:45.211565+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:09:45.211565+0000","last_peered":"2024-09-13T15:09:45.211565+0000","last_clean":"2024-09-13T15:09:45.211565+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:09:45.211565+0000","last_undegraded":"2024-09-13T15:09:45.211565+0000","last_fullsized":"2024-09-13T15:09:45.211565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":855743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.248},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.2330000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":1.014}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.2969999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.141}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.365},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3440000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.429},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.93300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":264356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.751},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1359999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":0.87}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.377},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.216}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.177},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":1.415},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.4650000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":272470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.008}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.47},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":1.073}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.5269999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.405},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.377}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.1279999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.302}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":265375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.141},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.78}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.651},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.887}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.3580000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.448},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5309999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.7},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":2.2090000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.581}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":602112,"data_stored":264356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.2}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.603},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.177}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.401}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.327},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.5589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":258780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":0.5},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.179}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.206},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.389}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":606208,"data_stored":265375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.1759999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.4890000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":1.02}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.383},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":1.3520000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.421},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.2210000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1196032,"data_stored":854724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.3959999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":0.877}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.45},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.046}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.218}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.321},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.159},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.359}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:09:50.516 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:09:50.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T15:09:50.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 Processor -- start 2024-09-13T15:09:50.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 -- start start 2024-09-13T15:09:50.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1b0c06cc10 0x7f1b0c161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c0b25b0 0x7f1b0c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c1606c0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c06b840 con 0x7f1b0c06cc10 2024-09-13T15:09:50.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c06d080 con 0x7f1b0c0b25b0 2024-09-13T15:09:50.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1b0c15caf0 0x7f1b0c0af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58846/0 (socket says 172.21.15.50:58846) 2024-09-13T15:09:50.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.747+0000 7f1b0aa00700 1 -- 172.21.15.50:0/479544228 learned_addr learned my addr 172.21.15.50:0/479544228 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:50.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0b400700 1 --2- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c0b25b0 0x7f1b0c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0a000700 1 --2- 172.21.15.50:0/479544228 >> v2:172.21.15.181:3300/0 conn(0x7f1b0c06cc10 0x7f1b0c161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b09600700 1 -- 172.21.15.50:0/479544228 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028213678 0 0) 0x7f1b0c1606c0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b09600700 1 -- 172.21.15.50:0/479544228 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af00035d0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0a000700 1 -- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c0b25b0 msgr2=0x7f1b0c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0a000700 1 --2- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c0b25b0 0x7f1b0c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0a000700 1 -- 172.21.15.50:0/479544228 >> v1:172.21.15.50:6789/0 conn(0x7f1b0c15caf0 legacy=0x7f1b0c0af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0a000700 1 -- 172.21.15.50:0/479544228 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0afee0 con 0x7f1b0c06cc10 2024-09-13T15:09:50.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0a000700 1 --2- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c06cc10 0x7f1b0c161110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009850 tx=0x7f1af8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf08c2421430397 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b09600700 1 -- 172.21.15.50:0/479544228 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8011830 con 0x7f1b0c06cc10 2024-09-13T15:09:50.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b09600700 1 -- 172.21.15.50:0/479544228 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af8011990 con 0x7f1b0c06cc10 2024-09-13T15:09:50.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b09600700 1 -- 172.21.15.50:0/479544228 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8011d40 con 0x7f1b0c06cc10 2024-09-13T15:09:50.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 -- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c06cc10 msgr2=0x7f1b0c161110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 --2- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c06cc10 0x7f1b0c161110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009850 tx=0x7f1af8009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 -- 172.21.15.50:0/479544228 shutdown_connections 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 --2- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c0b25b0 0x7f1b0c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 --2- 172.21.15.50:0/479544228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c06cc10 0x7f1b0c161110 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 -- 172.21.15.50:0/479544228 >> 172.21.15.50:0/479544228 conn(0x7f1b0c066270 msgr2=0x7f1b0c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 -- 172.21.15.50:0/479544228 shutdown_connections 2024-09-13T15:09:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.751+0000 7f1b0be00700 1 -- 172.21.15.50:0/479544228 wait complete. 2024-09-13T15:09:50.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.755+0000 7f1b0be00700 1 Processor -- start 2024-09-13T15:09:50.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.755+0000 7f1b0be00700 1 -- start start 2024-09-13T15:09:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.755+0000 7f1b0be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c06cc10 0x7f1b0c15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.755+0000 7f1b0be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c0b25b0 0x7f1b0c146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 0x7f1b0c1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c9d40 con 0x7f1b0c15caf0 2024-09-13T15:09:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0ca020 con 0x7f1b0c0b25b0 2024-09-13T15:09:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0ca300 con 0x7f1b0c06cc10 2024-09-13T15:09:50.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 0x7f1b0c1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 0x7f1b0c1474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42156/0 (socket says 172.21.15.50:42156) 2024-09-13T15:09:50.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 -- 172.21.15.50:0/2992513806 learned_addr learned my addr 172.21.15.50:0/2992513806 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0a000700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c0b25b0 0x7f1b0c146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0aa00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c06cc10 0x7f1b0c15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 -- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c06cc10 msgr2=0x7f1b0c15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c06cc10 0x7f1b0c15b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 -- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c0b25b0 msgr2=0x7f1b0c146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c0b25b0 0x7f1b0c146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 -- 172.21.15.50:0/2992513806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80094b0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0b400700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 0x7f1b0c1474f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400efc0 tx=0x7f1b0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04009ea0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400f040 con 0x7f1b0c15caf0 2024-09-13T15:09:50.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c0ca5e0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400ced0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.759+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c15b8e0 con 0x7f1b0c15caf0 2024-09-13T15:09:50.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.763+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c15bb30 con 0x7f1b0c15caf0 2024-09-13T15:09:50.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.763+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b04014480 con 0x7f1b0c15caf0 2024-09-13T15:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.767+0000 7f1b03400700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1aec066760 0x7f1aec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.767+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b04084b40 con 0x7f1b0c15caf0 2024-09-13T15:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.767+0000 7f1b0aa00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1aec066760 0x7f1aec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.767+0000 7f1b0aa00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1aec066760 0x7f1aec068c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1afc007fd0 tx=0x7f1afc007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:50.771+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b04051cf0 con 0x7f1b0c15caf0 2024-09-13T15:09:51.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.019+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1b0c0cab00 con 0x7f1b0c15caf0 2024-09-13T15:09:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.023+0000 7f1b03400700 1 -- 172.21.15.50:0/2992513806 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1b0c0cab00 con 0x7f1b0c15caf0 2024-09-13T15:09:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1aec066760 msgr2=0x7f1aec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1aec066760 0x7f1aec068c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1afc007fd0 tx=0x7f1afc007de0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 msgr2=0x7f1b0c1474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 0x7f1b0c1474f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400efc0 tx=0x7f1b0400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 shutdown_connections 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1aec066760 0x7f1aec068c20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b0c15caf0 0x7f1b0c1474f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1b0c0b25b0 0x7f1b0c146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 --2- 172.21.15.50:0/2992513806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1b0c06cc10 0x7f1b0c15b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 >> 172.21.15.50:0/2992513806 conn(0x7f1b0c066270 msgr2=0x7f1b0c06a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 shutdown_connections 2024-09-13T15:09:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.031+0000 7f1b0be00700 1 -- 172.21.15.50:0/2992513806 wait complete. 2024-09-13T15:09:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-13T15:09:51.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:51.182 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-13T15:09:51.175+0000 7f6c01400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:09:51.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 Processor -- start 2024-09-13T15:09:51.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 -- start start 2024-09-13T15:09:51.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff92815d170 0x7ff9280b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:51.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9280cdfe0 0x7ff9280ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:51.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9280d1390 con 0x7ff92815cd90 2024-09-13T15:09:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9280b2530 con 0x7ff92815d170 2024-09-13T15:09:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.235+0000 7ff92d000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280d05f0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff92815d170 0x7ff9280b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff92815d170 0x7ff9280b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42158/0 (socket says 172.21.15.50:42158) 2024-09-13T15:09:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 -- 172.21.15.50:0/3574711581 learned_addr learned my addr 172.21.15.50:0/3574711581 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff927e00700 1 --2- 172.21.15.50:0/3574711581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9280cdfe0 0x7ff9280ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 -- 172.21.15.50:0/3574711581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9280cdfe0 msgr2=0x7ff9280ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 --2- 172.21.15.50:0/3574711581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9280cdfe0 0x7ff9280ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 -- 172.21.15.50:0/3574711581 >> v1:172.21.15.181:6789/0 conn(0x7ff92815cd90 legacy=0x7ff9280cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 -- 172.21.15.50:0/3574711581 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280d1670 con 0x7ff92815d170 2024-09-13T15:09:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff91fe00700 1 --2- 172.21.15.50:0/3574711581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff92815d170 0x7ff9280b1f50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff910009910 tx=0x7ff910009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861aeb250a1e3ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff926a00700 1 -- 172.21.15.50:0/3574711581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910011830 con 0x7ff92815d170 2024-09-13T15:09:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff926a00700 1 -- 172.21.15.50:0/3574711581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910011990 con 0x7ff92815d170 2024-09-13T15:09:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff926a00700 1 -- 172.21.15.50:0/3574711581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910011d40 con 0x7ff92815d170 2024-09-13T15:09:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 -- 172.21.15.50:0/3574711581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff92815d170 msgr2=0x7ff9280b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 --2- 172.21.15.50:0/3574711581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff92815d170 0x7ff9280b1f50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff910009910 tx=0x7ff910009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 -- 172.21.15.50:0/3574711581 shutdown_connections 2024-09-13T15:09:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 --2- 172.21.15.50:0/3574711581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9280cdfe0 0x7ff9280ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 --2- 172.21.15.50:0/3574711581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff92815d170 0x7ff9280b1f50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 -- 172.21.15.50:0/3574711581 >> 172.21.15.50:0/3574711581 conn(0x7ff9280d2c10 msgr2=0x7ff9280d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 -- 172.21.15.50:0/3574711581 shutdown_connections 2024-09-13T15:09:51.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.239+0000 7ff92d000700 1 -- 172.21.15.50:0/3574711581 wait complete. 2024-09-13T15:09:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 Processor -- start 2024-09-13T15:09:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 -- start start 2024-09-13T15:09:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 0x7ff9280c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff92815cd90 0x7ff928149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff92815d170 0x7ff92814bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92814b2a0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92814a620 con 0x7ff92815cd90 2024-09-13T15:09:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff92d000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92814a900 con 0x7ff92815d170 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.243+0000 7ff927400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 0x7ff9280c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 0x7ff9280c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42170/0 (socket says 172.21.15.50:42170) 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 -- 172.21.15.50:0/2053759037 learned_addr learned my addr 172.21.15.50:0/2053759037 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927e00700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff92815d170 0x7ff92814bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff91fe00700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff92815cd90 0x7ff928149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 -- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff92815d170 msgr2=0x7ff92814bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff92815d170 0x7ff92814bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 -- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff92815cd90 msgr2=0x7ff928149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff92815cd90 0x7ff928149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 -- 172.21.15.50:0/2053759037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009570 con 0x7ff9280cdfe0 2024-09-13T15:09:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff91fe00700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff92815cd90 0x7ff928149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff927400700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 0x7ff9280c8b30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c500 tx=0x7ff91800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9180052d0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918005430 con 0x7ff9280cdfe0 2024-09-13T15:09:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9180055a0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92814abe0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92814c980 con 0x7ff9280cdfe0 2024-09-13T15:09:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.247+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9280ce450 con 0x7ff9280cdfe0 2024-09-13T15:09:51.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.251+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9180038e0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.251+0000 7ff91f400700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff904066730 0x7ff904068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.251+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff918083790 con 0x7ff9280cdfe0 2024-09-13T15:09:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.251+0000 7ff91fe00700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff904066730 0x7ff904068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.255+0000 7ff91fe00700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff904066730 0x7ff904068bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff910014040 tx=0x7ff910008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.259+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff918050920 con 0x7ff9280cdfe0 2024-09-13T15:09:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.495+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9280cdae0 con 0x7ff9280cdfe0 2024-09-13T15:09:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff91f400700 1 -- 172.21.15.50:0/2053759037 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7ff918053f40 con 0x7ff9280cdfe0 2024-09-13T15:09:51.502 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:51.502 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:45.665636+0000","modified":"2024-09-13T15:09:48.684241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/442961988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":442961988},{"type":"v1","addr":"172.21.15.50:6835","nonce":442961988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff904066730 msgr2=0x7ff904068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff904066730 0x7ff904068bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff910014040 tx=0x7ff910008030 comp rx=0 tx=0).stop 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 msgr2=0x7ff9280c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 0x7ff9280c8b30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c500 tx=0x7ff91800c810 comp rx=0 tx=0).stop 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 shutdown_connections 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff904066730 0x7ff904068bf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff92815d170 0x7ff92814bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff92815cd90 0x7ff928149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 --2- 172.21.15.50:0/2053759037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9280cdfe0 0x7ff9280c8b30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 >> 172.21.15.50:0/2053759037 conn(0x7ff9280d2c10 msgr2=0x7ff9280b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 shutdown_connections 2024-09-13T15:09:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:51.499+0000 7ff92d000700 1 -- 172.21.15.50:0/2053759037 wait complete. 2024-09-13T15:09:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-13T15:09:51.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:09:45.665636+0000', 'modified': '2024-09-13T15:09:48.684241+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5724}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5724': {'gid': 5724, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/442961988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 442961988}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 442961988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:09:51.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:09:51.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T15:09:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.107+0000 7fdb25600700 1 Processor -- start 2024-09-13T15:09:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.107+0000 7fdb25600700 1 -- start start 2024-09-13T15:09:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.107+0000 7fdb25600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb200b2d80 0x7fdb2006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.107+0000 7fdb25600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb200b3560 con 0x7fdb201610b0 2024-09-13T15:09:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.107+0000 7fdb25600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb200b3280 con 0x7fdb2006aaa0 2024-09-13T15:09:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.107+0000 7fdb25600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20070b30 con 0x7fdb200b2d80 2024-09-13T15:09:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb1fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdb201610b0 0x7fdb200719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58852/0 (socket says 172.21.15.50:58852) 2024-09-13T15:09:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb1fe00700 1 -- 172.21.15.50:0/3734515551 learned_addr learned my addr 172.21.15.50:0/3734515551 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb24c00700 1 --2- 172.21.15.50:0/3734515551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb200b2d80 0x7fdb2006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb1ea00700 1 -- 172.21.15.50:0/3734515551 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540501939 0 0) 0x7fdb200b3560 con 0x7fdb201610b0 2024-09-13T15:09:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb24c00700 1 -- 172.21.15.50:0/3734515551 >> v1:172.21.15.181:6789/0 conn(0x7fdb2006aaa0 legacy=0x7fdb200b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb24c00700 1 -- 172.21.15.50:0/3734515551 >> v1:172.21.15.50:6789/0 conn(0x7fdb201610b0 legacy=0x7fdb200719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb24c00700 1 -- 172.21.15.50:0/3734515551 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb20070ee0 con 0x7fdb200b2d80 2024-09-13T15:09:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb24c00700 1 --2- 172.21.15.50:0/3734515551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb200b2d80 0x7fdb2006af10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009df0 tx=0x7fdb1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8bcc8e821642975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb1ea00700 1 -- 172.21.15.50:0/3734515551 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800e070 con 0x7fdb200b2d80 2024-09-13T15:09:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb1ea00700 1 -- 172.21.15.50:0/3734515551 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1800bad0 con 0x7fdb200b2d80 2024-09-13T15:09:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb1ea00700 1 -- 172.21.15.50:0/3734515551 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800be60 con 0x7fdb200b2d80 2024-09-13T15:09:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb25600700 1 -- 172.21.15.50:0/3734515551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb200b2d80 msgr2=0x7fdb2006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb25600700 1 --2- 172.21.15.50:0/3734515551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb200b2d80 0x7fdb2006af10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009df0 tx=0x7fdb1800b330 comp rx=0 tx=0).stop 2024-09-13T15:09:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb25600700 1 -- 172.21.15.50:0/3734515551 shutdown_connections 2024-09-13T15:09:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb25600700 1 --2- 172.21.15.50:0/3734515551 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb200b2d80 0x7fdb2006af10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb25600700 1 -- 172.21.15.50:0/3734515551 >> 172.21.15.50:0/3734515551 conn(0x7fdb200b0c40 msgr2=0x7fdb2006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.111+0000 7fdb25600700 1 -- 172.21.15.50:0/3734515551 shutdown_connections 2024-09-13T15:09:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.115+0000 7fdb25600700 1 -- 172.21.15.50:0/3734515551 wait complete. 2024-09-13T15:09:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.115+0000 7fdb25600700 1 Processor -- start 2024-09-13T15:09:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.115+0000 7fdb25600700 1 -- start start 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb2006aaa0 0x7fdb20155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 0x7fdb20158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb201610b0 0x7fdb20164200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20164740 con 0x7fdb200b2d80 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201617b0 con 0x7fdb201610b0 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201594d0 con 0x7fdb2006aaa0 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 0x7fdb20158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 0x7fdb20158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42184/0 (socket says 172.21.15.50:42184) 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 -- 172.21.15.50:0/3113173311 learned_addr learned my addr 172.21.15.50:0/3113173311 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb2006aaa0 0x7fdb20155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb24c00700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb201610b0 0x7fdb20164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 -- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb2006aaa0 msgr2=0x7fdb20155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb2006aaa0 0x7fdb20155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 -- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb201610b0 msgr2=0x7fdb20164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb201610b0 0x7fdb20164200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 -- 172.21.15.50:0/3113173311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18009a70 con 0x7fdb200b2d80 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb1f400700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 0x7fdb20158df0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c780 tx=0x7fdb0c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb17e00700 1 -- 172.21.15.50:0/3113173311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0054e0 con 0x7fdb200b2d80 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb17e00700 1 -- 172.21.15.50:0/3113173311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c0036a0 con 0x7fdb200b2d80 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb20161a00 con 0x7fdb200b2d80 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb17e00700 1 -- 172.21.15.50:0/3113173311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c003a50 con 0x7fdb200b2d80 2024-09-13T15:09:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.119+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb20161fc0 con 0x7fdb200b2d80 2024-09-13T15:09:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.123+0000 7fdb17e00700 1 -- 172.21.15.50:0/3113173311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb0c003bb0 con 0x7fdb200b2d80 2024-09-13T15:09:52.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.127+0000 7fdb17e00700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdb00066730 0x7fdb00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.127+0000 7fdb17e00700 1 -- 172.21.15.50:0/3113173311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb0c083820 con 0x7fdb200b2d80 2024-09-13T15:09:52.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.127+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdb00066730 0x7fdb00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.127+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdb00066730 0x7fdb00068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb10000f60 tx=0x7fdb10007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.127+0000 7fdb29ef6740 1 Processor -- start 2024-09-13T15:09:52.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.127+0000 7fdb29ef6740 1 -- start start 2024-09-13T15:09:52.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x1787180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x174f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x174fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x16aed80 con 0x1786da0 2024-09-13T15:09:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x16ac510 con 0x17876c0 2024-09-13T15:09:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x16a7e00 con 0x1765d00 2024-09-13T15:09:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x1787180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x1787180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42194/0 (socket says 172.21.15.50:42194) 2024-09-13T15:09:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 -- 172.21.15.50:0/2711409322 learned_addr learned my addr 172.21.15.50:0/2711409322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1f400700 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x174f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb24c00700 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x174fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 -- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 msgr2=0x174f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x174f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 -- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 msgr2=0x174fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x174fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 -- 172.21.15.50:0/2711409322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x151a960 con 0x1786da0 2024-09-13T15:09:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1f400700 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x174f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x1787180 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb100157e0 tx=0x7fdb10004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d2dc3f5fa93674 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb0be00700 1 -- 172.21.15.50:0/2711409322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10015110 con 0x1786da0 2024-09-13T15:09:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb0be00700 1 -- 172.21.15.50:0/2711409322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10015270 con 0x1786da0 2024-09-13T15:09:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb0be00700 1 -- 172.21.15.50:0/2711409322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10021650 con 0x1786da0 2024-09-13T15:09:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- 172.21.15.50:0/2711409322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 msgr2=0x1787180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x1787180 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb100157e0 tx=0x7fdb10004f90 comp rx=0 tx=0).stop 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- 172.21.15.50:0/2711409322 shutdown_connections 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x174fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x174f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/2711409322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x1787180 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- 172.21.15.50:0/2711409322 >> 172.21.15.50:0/2711409322 conn(0x14cf4d0 msgr2=0x1768c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- 172.21.15.50:0/2711409322 shutdown_connections 2024-09-13T15:09:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.131+0000 7fdb29ef6740 1 -- 172.21.15.50:0/2711409322 wait complete. 2024-09-13T15:09:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 -- start start 2024-09-13T15:09:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 Processor -- start 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x1740390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x173f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x1766c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1665730 con 0x1786da0 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x166b5b0 con 0x17876c0 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1553aa0 con 0x1765d00 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb29ef6740 10 client.0 _ll_register_callbacks cb 0x16a1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x173f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x173f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42204/0 (socket says 172.21.15.50:42204) 2024-09-13T15:09:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 -- 172.21.15.50:0/135698073 learned_addr learned my addr 172.21.15.50:0/135698073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x1740390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb24c00700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x1766c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 -- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 msgr2=0x1740390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x1740390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 -- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 msgr2=0x1766c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.135+0000 7fdb1f400700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x1766c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb1f400700 1 -- 172.21.15.50:0/135698073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb10015550 con 0x1786da0 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x1740390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb1f400700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x173f0f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c081fd0 tx=0x7fdb0c054bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f6f6b619a5ce29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:09:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 1 -- 172.21.15.50:0/135698073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c06c070 con 0x1786da0 2024-09-13T15:09:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 1 -- 172.21.15.50:0/135698073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb0c0584a0 con 0x1786da0 2024-09-13T15:09:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14dc1e0 con 0x1786da0 2024-09-13T15:09:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 1 -- 172.21.15.50:0/135698073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb0c05ca60 con 0x1786da0 2024-09-13T15:09:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 10 client.5859 fetch_fsmap learned FSMap version 23 2024-09-13T15:09:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x166e220 con 0x1786da0 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 1 -- 172.21.15.50:0/135698073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14dc1e0 con 0x1786da0 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 1 -- 172.21.15.50:0/135698073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdb0c05c5d0 con 0x1786da0 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 10 client.5859 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 10 client.5859 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 20 client.5859 populate_metadata read hostname 'smithi050' 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x173ccf0 0x173d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 4 client.5859 mds_command: new command op to 5724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:09:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 --> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1526460 con 0x173ccf0 2024-09-13T15:09:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x173ccf0 0x173d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x173ccf0 0x173d0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcb3255cb7eb393a server_cookie=768995e42b7b0363 in_seq=0 out_seq=0 2024-09-13T15:09:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.139+0000 7fdb08c00700 10 client.5859 ms_handle_connect on v2:172.21.15.50:6833/442961988 2024-09-13T15:09:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb08c00700 1 -- 172.21.15.50:0/135698073 <== mds.0 v2:172.21.15.50:6833/442961988 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x1526460 con 0x173ccf0 2024-09-13T15:09:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb08c00700 10 client.5859 handle_command_reply: tid=0 2024-09-13T15:09:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 client.5859 shutdown 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 msgr2=0x173f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x173f0f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c081fd0 tx=0x7fdb0c054bb0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 shutdown_connections 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x173ccf0 0x173d0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17876c0 0x1766c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x173f0f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/135698073 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1765d00 0x1740390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb08c00700 0 client.5859 ms_handle_reset on v2:172.21.15.50:6833/442961988 2024-09-13T15:09:52.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 >> 172.21.15.50:0/135698073 conn(0x14cf4d0 msgr2=0x1762860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 shutdown_connections 2024-09-13T15:09:52.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 1 -- 172.21.15.50:0/135698073 wait complete. 2024-09-13T15:09:52.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.143+0000 7fdb29ef6740 20 client.5859 trim_cache size 0 max 16384 2024-09-13T15:09:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 Processor -- start 2024-09-13T15:09:52.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 -- start start 2024-09-13T15:09:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x17855e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1786da0 0x1785b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 0x1786060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x16d6ec0 con 0x17876c0 2024-09-13T15:09:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1669e90 con 0x1765d00 2024-09-13T15:09:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x16ab670 con 0x1786da0 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb24c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 0x1786060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb24c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 0x1786060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42208/0 (socket says 172.21.15.50:42208) 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.167+0000 7fdb24c00700 1 -- 172.21.15.50:0/3038270219 learned_addr learned my addr 172.21.15.50:0/3038270219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x17855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb1f400700 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1786da0 0x1785b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb24c00700 1 -- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1786da0 msgr2=0x1785b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb24c00700 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1786da0 0x1785b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb24c00700 1 -- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 msgr2=0x17855e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb24c00700 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x17855e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb24c00700 1 -- 172.21.15.50:0/3038270219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1654450 con 0x17876c0 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x17855e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb24c00700 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 0x1786060 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb200b1690 tx=0x7fdb1800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bdb95d1eb5fa16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb15200700 1 -- 172.21.15.50:0/3038270219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18003ba0 con 0x17876c0 2024-09-13T15:09:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb15200700 1 -- 172.21.15.50:0/3038270219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18004230 con 0x17876c0 2024-09-13T15:09:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb15200700 1 -- 172.21.15.50:0/3038270219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb180045e0 con 0x17876c0 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 -- 172.21.15.50:0/3038270219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 msgr2=0x1786060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 0x1786060 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb200b1690 tx=0x7fdb1800f000 comp rx=0 tx=0).stop 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 -- 172.21.15.50:0/3038270219 shutdown_connections 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17876c0 0x1786060 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1786da0 0x1785b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/3038270219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x17855e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 -- 172.21.15.50:0/3038270219 >> 172.21.15.50:0/3038270219 conn(0x14cf4d0 msgr2=0x1765090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 -- 172.21.15.50:0/3038270219 shutdown_connections 2024-09-13T15:09:52.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 -- 172.21.15.50:0/3038270219 wait complete. 2024-09-13T15:09:52.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.171+0000 7fdb29ef6740 1 -- start start 2024-09-13T15:09:52.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 Processor -- start 2024-09-13T15:09:52.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x179f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x17e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17876c0 0x17e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a5e60 con 0x1786da0 2024-09-13T15:09:52.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1765b30 con 0x1765d00 2024-09-13T15:09:52.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x17423a0 con 0x17876c0 2024-09-13T15:09:52.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 10 client.0 _ll_register_callbacks cb 0x16fe710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:09:52.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x17e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x179f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x17e72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42214/0 (socket says 172.21.15.50:42214) 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 -- 172.21.15.50:0/489318678 learned_addr learned my addr 172.21.15.50:0/489318678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb24c00700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17876c0 0x17e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 -- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17876c0 msgr2=0x17e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17876c0 0x17e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 -- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 msgr2=0x179f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x179f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 -- 172.21.15.50:0/489318678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb20070ee0 con 0x1786da0 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb24c00700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17876c0 0x17e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb1f400700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x17e72c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c051090 tx=0x7fdb0c081a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec69ffd894ba7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb08c00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:09:52.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb08c00700 1 -- 172.21.15.50:0/489318678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c06c040 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb08c00700 1 -- 172.21.15.50:0/489318678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb0c058280 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.175+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb10015270 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 1 -- 172.21.15.50:0/489318678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb0c05a7c0 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 10 client.5865 fetch_fsmap learned FSMap version 23 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x1648720 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 1 -- 172.21.15.50:0/489318678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10015270 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 1 -- 172.21.15.50:0/489318678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdb0c050670 con 0x1786da0 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 10 client.5865 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 10 client.5865 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 20 client.5865 populate_metadata read hostname 'smithi050' 2024-09-13T15:09:52.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x179d3a0 0x179d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 4 client.5865 mds_command: new command op to 5724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:09:52.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 --> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] -- command(tid 0: {"prefix": "status"}) v1 -- 0x154b1e0 con 0x179d3a0 2024-09-13T15:09:52.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x179d3a0 0x179d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb1fe00700 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x179d3a0 0x179d780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9b8978da4ed4b56 server_cookie=4d098e00a86ea343 in_seq=0 out_seq=0 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 10 client.5865 ms_handle_connect on v2:172.21.15.50:6833/442961988 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 1 -- 172.21.15.50:0/489318678 <== mds.0 v2:172.21.15.50:6833/442961988 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x154b1e0 con 0x179d3a0 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 10 client.5865 handle_command_reply: tid=0 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 client.5865 shutdown 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 msgr2=0x17e72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x17e72c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c051090 tx=0x7fdb0c081a40 comp rx=0 tx=0).stop 2024-09-13T15:09:52.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 shutdown_connections 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:6833/442961988,v1:172.21.15.50:6835/442961988] conn(0x179d3a0 0x179d780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17876c0 0x17e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1786da0 0x17e72c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb08c00700 0 client.5865 ms_handle_reset on v2:172.21.15.50:6833/442961988 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 --2- 172.21.15.50:0/489318678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1765d00 0x179f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 >> 172.21.15.50:0/489318678 conn(0x14cf4d0 msgr2=0x1764870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 shutdown_connections 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.179+0000 7fdb29ef6740 1 -- 172.21.15.50:0/489318678 wait complete. 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb29ef6740 20 client.5865 trim_cache size 0 max 16384 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:09:52.187 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5724, 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.5145910899999997, 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 53, 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 53, 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 11.665164576 2024-09-13T15:09:52.188 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdb00066730 msgr2=0x7fdb00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdb00066730 0x7fdb00068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb10000f60 tx=0x7fdb10007e90 comp rx=0 tx=0).stop 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 msgr2=0x7fdb20158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 0x7fdb20158df0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c780 tx=0x7fdb0c00ca90 comp rx=0 tx=0).stop 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 shutdown_connections 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdb00066730 0x7fdb00068bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb201610b0 0x7fdb20164200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb200b2d80 0x7fdb20158df0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 --2- 172.21.15.50:0/3113173311 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdb2006aaa0 0x7fdb20155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 >> 172.21.15.50:0/3113173311 conn(0x7fdb200b0c40 msgr2=0x7fdb200b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 shutdown_connections 2024-09-13T15:09:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.183+0000 7fdb25600700 1 -- 172.21.15.50:0/3113173311 wait complete. 2024-09-13T15:09:52.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:09:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 Processor -- start 2024-09-13T15:09:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 -- start start 2024-09-13T15:09:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84a40cb020 0x7f84a40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a415c2a0 0x7f84a415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a40b2ad0 con 0x7f84a406aaa0 2024-09-13T15:09:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a415b960 con 0x7f84a40cb020 2024-09-13T15:09:52.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.395+0000 7f84a8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a415bc40 con 0x7f84a415c2a0 2024-09-13T15:09:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84a40cb020 0x7f84a40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84a40cb020 0x7f84a40cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:41766/0 (socket says 172.21.15.50:41766) 2024-09-13T15:09:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 -- 172.21.15.50:0/625425986 learned_addr learned my addr 172.21.15.50:0/625425986 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f84a406aaa0 0x7f84a40b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:59288/0 (socket says 172.21.15.50:59288) 2024-09-13T15:09:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f849be00700 1 --2- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a415c2a0 0x7f84a415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 -- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a415c2a0 msgr2=0x7f84a415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 --2- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a415c2a0 0x7f84a415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 -- 172.21.15.50:0/625425986 >> v1:172.21.15.181:6789/0 conn(0x7f84a406aaa0 legacy=0x7f84a40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 -- 172.21.15.50:0/625425986 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a415bf20 con 0x7f84a40cb020 2024-09-13T15:09:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a3400700 1 --2- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a40cb020 0x7f84a40cc6f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8494009910 tx=0x7f8494009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f25aa2887326d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a2a00700 1 -- 172.21.15.50:0/625425986 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494011830 con 0x7f84a40cb020 2024-09-13T15:09:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a2a00700 1 -- 172.21.15.50:0/625425986 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494011990 con 0x7f84a40cb020 2024-09-13T15:09:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a2a00700 1 -- 172.21.15.50:0/625425986 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494011d40 con 0x7f84a40cb020 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a8a00700 1 -- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a40cb020 msgr2=0x7f84a40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a8a00700 1 --2- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a40cb020 0x7f84a40cc6f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8494009910 tx=0x7f8494009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a8a00700 1 -- 172.21.15.50:0/625425986 shutdown_connections 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a8a00700 1 --2- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a415c2a0 0x7f84a415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a8a00700 1 --2- 172.21.15.50:0/625425986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a40cb020 0x7f84a40cc6f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.399+0000 7f84a8a00700 1 -- 172.21.15.50:0/625425986 >> 172.21.15.50:0/625425986 conn(0x7f84a40b0c40 msgr2=0x7f84a406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.403+0000 7f84a8a00700 1 -- 172.21.15.50:0/625425986 shutdown_connections 2024-09-13T15:09:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.403+0000 7f84a8a00700 1 -- 172.21.15.50:0/625425986 wait complete. 2024-09-13T15:09:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.403+0000 7f84a8a00700 1 Processor -- start 2024-09-13T15:09:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.403+0000 7f84a8a00700 1 -- start start 2024-09-13T15:09:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a406aaa0 0x7f84a4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a8a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 0x7f84a413d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a8a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a415c2a0 0x7f84a413c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a8a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c7fb0 con 0x7f84a40cb020 2024-09-13T15:09:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a8a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a413a610 con 0x7f84a415c2a0 2024-09-13T15:09:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a413a860 con 0x7f84a406aaa0 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 0x7f84a413d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a406aaa0 0x7f84a4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 0x7f84a413d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42216/0 (socket says 172.21.15.50:42216) 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 -- 172.21.15.50:0/1847326520 learned_addr learned my addr 172.21.15.50:0/1847326520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f84a3e00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a415c2a0 0x7f84a413c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 -- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a406aaa0 msgr2=0x7f84a4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a406aaa0 0x7f84a4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 -- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a415c2a0 msgr2=0x7f84a413c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a415c2a0 0x7f84a413c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 -- 172.21.15.50:0/1847326520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009570 con 0x7f84a40cb020 2024-09-13T15:09:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.407+0000 7f849be00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 0x7f84a413d340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f848c009fd0 tx=0x7f848c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.411+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c0095a0 con 0x7f84a40cb020 2024-09-13T15:09:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.411+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c013680 con 0x7f84a40cb020 2024-09-13T15:09:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.411+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c013a10 con 0x7f84a40cb020 2024-09-13T15:09:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.411+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a413e210 con 0x7f84a40cb020 2024-09-13T15:09:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.411+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a4157470 con 0x7f84a40cb020 2024-09-13T15:09:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.411+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a413e070 con 0x7f84a40cb020 2024-09-13T15:09:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.415+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f848c013b70 con 0x7f84a40cb020 2024-09-13T15:09:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.415+0000 7f849b400700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8480066730 0x7f8480068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.415+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f848c0843e0 con 0x7f84a40cb020 2024-09-13T15:09:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.415+0000 7f84a3400700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8480066730 0x7f8480068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.415+0000 7f84a3400700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8480066730 0x7f8480068bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8494000c00 tx=0x7f8494008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.423+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f84a413e070 con 0x7f84a40cb020 2024-09-13T15:09:52.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.659+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84a413e070 con 0x7f84a40cb020 2024-09-13T15:09:52.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.659+0000 7f849b400700 1 -- 172.21.15.50:0/1847326520 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84a413e070 con 0x7f84a40cb020 2024-09-13T15:09:52.664 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:09:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8480066730 msgr2=0x7f8480068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8480066730 0x7f8480068bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8494000c00 tx=0x7f8494008030 comp rx=0 tx=0).stop 2024-09-13T15:09:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 msgr2=0x7f84a413d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 0x7f84a413d340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f848c009fd0 tx=0x7f848c00eb20 comp rx=0 tx=0).stop 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 shutdown_connections 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8480066730 0x7f8480068bf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a415c2a0 0x7f84a413c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a40cb020 0x7f84a413d340 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 --2- 172.21.15.50:0/1847326520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84a406aaa0 0x7f84a4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 >> 172.21.15.50:0/1847326520 conn(0x7f84a40b0c40 msgr2=0x7f84a40b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 shutdown_connections 2024-09-13T15:09:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:52.667+0000 7f84a8a00700 1 -- 172.21.15.50:0/1847326520 wait complete. 2024-09-13T15:09:52.696 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:09:52.696 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:09:52.696 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:09:52.696 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:09:52.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:52.697 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:09:52.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:09:52.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:09:52.697 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:52.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:52.697 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:09:52.718 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:09:52.718 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:52.719 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42314sec preferred_lft 42314sec 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.720 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:09:52.721 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:09:52.722 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.722 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:52.722 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:09:52.722 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:09:52.722 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:52.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:52.723 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:09:52.800 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:09:52.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:52.804 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:09:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:09:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:09:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:09:52.866 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:09:52.867 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:09:52.867 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:09:52.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:52.867 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:09:52.867 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:09:52.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:09:52.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:09:52.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:09:52.867 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:09:53.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:53.002 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:09:53.019 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:09:53.019 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:09:53.020 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:53.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:53.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:09:53.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:53.102 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:53.162 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:09:53.162 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:53.162 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:53.221 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:09:53.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:53.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:53.357 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:53.357 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:53.380 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:53.380 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:53.380 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:09:53.380 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:09:53.380 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:09:53.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:09:53.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:53.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:53.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:53.417 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:09:53.498 INFO:teuthology.orchestra.run.smithi050.stdout:client5866 2024-09-13T15:09:53.498 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:53.498 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:53.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:09:53.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.782+0000 7feebea00700 1 Processor -- start 2024-09-13T15:09:53.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.782+0000 7feebea00700 1 -- start start 2024-09-13T15:09:53.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb806d180 0x7feeb80cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feeb815cf10 0x7feeb80d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebea00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80b0190 con 0x7feeb815cb30 2024-09-13T15:09:53.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebea00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80d0770 con 0x7feeb815cf10 2024-09-13T15:09:53.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb806a530 con 0x7feeb806d180 2024-09-13T15:09:53.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebd600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feeb815cb30 0x7feeb806ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36970/0 (socket says 172.21.15.50:36970) 2024-09-13T15:09:53.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebd600700 1 -- 172.21.15.50:0/2968494152 learned_addr learned my addr 172.21.15.50:0/2968494152 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebe000700 1 --2- 172.21.15.50:0/2968494152 >> v2:172.21.15.50:3300/0 conn(0x7feeb815cf10 0x7feeb80d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebcc00700 1 --2- 172.21.15.50:0/2968494152 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb806d180 0x7feeb80cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebe000700 1 -- 172.21.15.50:0/2968494152 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb806d180 msgr2=0x7feeb80cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebe000700 1 --2- 172.21.15.50:0/2968494152 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb806d180 0x7feeb80cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebe000700 1 -- 172.21.15.50:0/2968494152 >> v1:172.21.15.50:6789/0 conn(0x7feeb815cb30 legacy=0x7feeb806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebe000700 1 -- 172.21.15.50:0/2968494152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb806a810 con 0x7feeb815cf10 2024-09-13T15:09:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feebe000700 1 --2- 172.21.15.50:0/2968494152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cf10 0x7feeb80d0230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009d90 tx=0x7feeb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6b63ee752ed1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:53.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feeb7e00700 1 -- 172.21.15.50:0/2968494152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000e070 con 0x7feeb815cf10 2024-09-13T15:09:53.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feeb7e00700 1 -- 172.21.15.50:0/2968494152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000bb20 con 0x7feeb815cf10 2024-09-13T15:09:53.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.786+0000 7feeb7e00700 1 -- 172.21.15.50:0/2968494152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0012430 con 0x7feeb815cf10 2024-09-13T15:09:53.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 -- 172.21.15.50:0/2968494152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cf10 msgr2=0x7feeb80d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 --2- 172.21.15.50:0/2968494152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cf10 0x7feeb80d0230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009d90 tx=0x7feeb000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 -- 172.21.15.50:0/2968494152 shutdown_connections 2024-09-13T15:09:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 --2- 172.21.15.50:0/2968494152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cf10 0x7feeb80d0230 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 --2- 172.21.15.50:0/2968494152 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb806d180 0x7feeb80cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 -- 172.21.15.50:0/2968494152 >> 172.21.15.50:0/2968494152 conn(0x7feeb8071f00 msgr2=0x7feeb80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 -- 172.21.15.50:0/2968494152 shutdown_connections 2024-09-13T15:09:53.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 -- 172.21.15.50:0/2968494152 wait complete. 2024-09-13T15:09:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 Processor -- start 2024-09-13T15:09:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.790+0000 7feebea00700 1 -- start start 2024-09-13T15:09:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb806d180 0x7feeb81f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 0x7feeb80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb815cf10 0x7feeb80b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c5fe0 con 0x7feeb815cb30 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c4f40 con 0x7feeb806d180 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c5220 con 0x7feeb815cf10 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 0x7feeb80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 0x7feeb80c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55992/0 (socket says 172.21.15.50:55992) 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 -- 172.21.15.50:0/3912612364 learned_addr learned my addr 172.21.15.50:0/3912612364 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebe000700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb815cf10 0x7feeb80b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebd600700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb806d180 0x7feeb81f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 -- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb815cf10 msgr2=0x7feeb80b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb815cf10 0x7feeb80b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 -- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb806d180 msgr2=0x7feeb81f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb806d180 0x7feeb81f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 -- 172.21.15.50:0/3912612364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0009a70 con 0x7feeb815cb30 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebe000700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb815cf10 0x7feeb80b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebcc00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 0x7feeb80c4510 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7feea4009fd0 tx=0x7feea400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40095a0 con 0x7feeb815cb30 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4013680 con 0x7feeb815cb30 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80c5500 con 0x7feeb815cb30 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4013a30 con 0x7feeb815cb30 2024-09-13T15:09:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.794+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80c5ac0 con 0x7feeb815cb30 2024-09-13T15:09:53.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.798+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb806ca70 con 0x7feeb815cb30 2024-09-13T15:09:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.798+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feea4013b90 con 0x7feeb815cb30 2024-09-13T15:09:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.802+0000 7feeb5600700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fee98066730 0x7fee98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.802+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feea4084190 con 0x7feeb815cb30 2024-09-13T15:09:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.802+0000 7feebd600700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fee98066730 0x7fee98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.802+0000 7feebd600700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fee98066730 0x7fee98068bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feeac005930 tx=0x7feeac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:53.806+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feea4051290 con 0x7feeb815cb30 2024-09-13T15:09:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.034+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feeb80afb80 con 0x7feeb815cb30 2024-09-13T15:09:54.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feeb5600700 1 -- 172.21.15.50:0/3912612364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7feea40548b0 con 0x7feeb815cb30 2024-09-13T15:09:54.042 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:09:54.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fee98066730 msgr2=0x7fee98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fee98066730 0x7fee98068bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feeac005930 tx=0x7feeac009040 comp rx=0 tx=0).stop 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 msgr2=0x7feeb80c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 0x7feeb80c4510 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7feea4009fd0 tx=0x7feea400eb20 comp rx=0 tx=0).stop 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 shutdown_connections 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fee98066730 0x7fee98068bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feeb815cf10 0x7feeb80b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeb815cb30 0x7feeb80c4510 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 --2- 172.21.15.50:0/3912612364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb806d180 0x7feeb81f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 >> 172.21.15.50:0/3912612364 conn(0x7feeb8071f00 msgr2=0x7feeb80cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 shutdown_connections 2024-09-13T15:09:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:54.038+0000 7feebea00700 1 -- 172.21.15.50:0/3912612364 wait complete. 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:09:54.070 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:09:54.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.071 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:09:54.087 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:09:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:54.088 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42303sec preferred_lft 42303sec 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:09:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:09:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:09:54.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.091 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:09:54.167 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:09:54.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.170 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:09:54.233 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:09:54.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.235 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:09:54.235 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:09:54.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:09:54.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:09:54.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:09:54.235 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:09:54.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.366 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:09:54.383 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:09:54.458 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:09:54.460 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:09:54.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.460 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:09:54.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:54.532 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:54.594 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:09:54.594 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:09:54.594 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:54.651 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:09:54.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.651 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:54.777 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:54.777 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:54.802 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:09:54.802 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:09:54.802 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:09:54.802 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:09:54.802 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:09:54.811 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:09:54.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.811 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:54.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:54.839 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:09:54.906 INFO:teuthology.orchestra.run.smithi181.stdout:client5872 2024-09-13T15:09:54.906 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:54.906 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:54.966 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:09:54.966 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:09:55.011 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:09:55.054 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:09:55.054 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:55.054 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:55.072 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:55.072 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:55.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.350+0000 7fc585a00700 1 Processor -- start 2024-09-13T15:09:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.350+0000 7fc585a00700 1 -- start start 2024-09-13T15:09:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.350+0000 7fc585a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc5801610b0 0x7fc5800719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.350+0000 7fc585a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5800b3560 con 0x7fc5800b2d80 2024-09-13T15:09:55.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.350+0000 7fc585a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5800b3280 con 0x7fc58006aaa0 2024-09-13T15:09:55.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.350+0000 7fc585a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc580070b30 con 0x7fc5801610b0 2024-09-13T15:09:55.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc585000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc5800b2d80 0x7fc5800cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36984/0 (socket says 172.21.15.50:36984) 2024-09-13T15:09:55.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc585000700 1 -- 172.21.15.50:0/1116175582 learned_addr learned my addr 172.21.15.50:0/1116175582 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:55.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57fe00700 1 --2- 172.21.15.50:0/1116175582 >> v2:172.21.15.181:3300/0 conn(0x7fc5801610b0 0x7fc5800719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684633186 0 0) 0x7fc5800b3280 con 0x7fc58006aaa0 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5640035d0 con 0x7fc58006aaa0 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367599230 0 0) 0x7fc5800b3560 con 0x7fc5800b2d80 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5800b3280 con 0x7fc5800b2d80 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57fe00700 1 -- 172.21.15.50:0/1116175582 >> v1:172.21.15.181:6789/0 conn(0x7fc58006aaa0 legacy=0x7fc5800b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57fe00700 1 -- 172.21.15.50:0/1116175582 >> v1:172.21.15.50:6789/0 conn(0x7fc5800b2d80 legacy=0x7fc5800cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57fe00700 1 -- 172.21.15.50:0/1116175582 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580070ee0 con 0x7fc5801610b0 2024-09-13T15:09:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57fe00700 1 --2- 172.21.15.50:0/1116175582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5801610b0 0x7fc5800719c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc570009dc0 tx=0x7fc57000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6024e877ada203e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000e070 con 0x7fc5801610b0 2024-09-13T15:09:55.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000bae0 con 0x7fc5801610b0 2024-09-13T15:09:55.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.354+0000 7fc57f400700 1 -- 172.21.15.50:0/1116175582 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000be90 con 0x7fc5801610b0 2024-09-13T15:09:55.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 -- 172.21.15.50:0/1116175582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5801610b0 msgr2=0x7fc5800719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 --2- 172.21.15.50:0/1116175582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5801610b0 0x7fc5800719c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc570009dc0 tx=0x7fc57000b330 comp rx=0 tx=0).stop 2024-09-13T15:09:55.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 -- 172.21.15.50:0/1116175582 shutdown_connections 2024-09-13T15:09:55.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 --2- 172.21.15.50:0/1116175582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5801610b0 0x7fc5800719c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 -- 172.21.15.50:0/1116175582 >> 172.21.15.50:0/1116175582 conn(0x7fc5800b0c40 msgr2=0x7fc58006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:55.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 -- 172.21.15.50:0/1116175582 shutdown_connections 2024-09-13T15:09:55.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 -- 172.21.15.50:0/1116175582 wait complete. 2024-09-13T15:09:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 Processor -- start 2024-09-13T15:09:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.358+0000 7fc585a00700 1 -- start start 2024-09-13T15:09:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc58006aaa0 0x7fc5800c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5800b2d80 0x7fc58014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 0x7fc5801fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580154360 con 0x7fc5801610b0 2024-09-13T15:09:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800a8e90 con 0x7fc5800b2d80 2024-09-13T15:09:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800a9130 con 0x7fc58006aaa0 2024-09-13T15:09:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 0x7fc5801fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 0x7fc5801fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55998/0 (socket says 172.21.15.50:55998) 2024-09-13T15:09:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 -- 172.21.15.50:0/3714517071 learned_addr learned my addr 172.21.15.50:0/3714517071 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc577400700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5800b2d80 0x7fc58014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc57fe00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc58006aaa0 0x7fc5800c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 -- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc58006aaa0 msgr2=0x7fc5800c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc58006aaa0 0x7fc5800c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 -- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5800b2d80 msgr2=0x7fc58014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5800b2d80 0x7fc58014dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 -- 172.21.15.50:0/3714517071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570009a70 con 0x7fc5801610b0 2024-09-13T15:09:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585000700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 0x7fc5801fa000 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc5780010e0 tx=0x7fc57800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578005d90 con 0x7fc5801610b0 2024-09-13T15:09:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780070d0 con 0x7fc5801610b0 2024-09-13T15:09:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578007480 con 0x7fc5801610b0 2024-09-13T15:09:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5800a9410 con 0x7fc5801610b0 2024-09-13T15:09:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.362+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5800a99d0 con 0x7fc5801610b0 2024-09-13T15:09:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.366+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5800a9bf0 con 0x7fc5801610b0 2024-09-13T15:09:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.366+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5780075e0 con 0x7fc5801610b0 2024-09-13T15:09:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.370+0000 7fc57cc00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc55c066730 0x7fc55c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.370+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc578083680 con 0x7fc5801610b0 2024-09-13T15:09:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.370+0000 7fc57fe00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc55c066730 0x7fc55c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.370+0000 7fc57fe00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc55c066730 0x7fc55c068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc570014040 tx=0x7fc57001e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.374+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5780508b0 con 0x7fc5801610b0 2024-09-13T15:09:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.566+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5800719c0 con 0x7fc5801610b0 2024-09-13T15:09:55.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.570+0000 7fc57cc00700 1 -- 172.21.15.50:0/3714517071 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fc578053ed0 con 0x7fc5801610b0 2024-09-13T15:09:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:55.577 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:46.669735+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc55c066730 msgr2=0x7fc55c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc55c066730 0x7fc55c068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc570014040 tx=0x7fc57001e040 comp rx=0 tx=0).stop 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 msgr2=0x7fc5801fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 0x7fc5801fa000 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc5780010e0 tx=0x7fc57800c7d0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 shutdown_connections 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc55c066730 0x7fc55c068bf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5801610b0 0x7fc5801fa000 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5800b2d80 0x7fc58014dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 --2- 172.21.15.50:0/3714517071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc58006aaa0 0x7fc5800c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 >> 172.21.15.50:0/3714517071 conn(0x7fc5800b0c40 msgr2=0x7fc5800af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 shutdown_connections 2024-09-13T15:09:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.574+0000 7fc585a00700 1 -- 172.21.15.50:0/3714517071 wait complete. 2024-09-13T15:09:55.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:43.873444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:44.686028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:55.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.766+0000 7f5b7b200700 1 Processor -- start 2024-09-13T15:09:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b7b200700 1 -- start start 2024-09-13T15:09:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b7b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b7c070a40 0x7f5b7c0ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b7b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c0adc60 0x7f5b7c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b7b200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c073660 con 0x7f5b7c15ac40 2024-09-13T15:09:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b7b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0ae0d0 con 0x7f5b7c070a40 2024-09-13T15:09:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b7b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0738b0 con 0x7f5b7c0adc60 2024-09-13T15:09:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.770+0000 7f5b79400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5b7c070a40 0x7f5b7c0ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5b7c15ac40 0x7f5b7c0b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:46532/0 (socket says 172.21.15.50:46532) 2024-09-13T15:09:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79e00700 1 -- 172.21.15.50:0/2309855850 learned_addr learned my addr 172.21.15.50:0/2309855850 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b7a800700 1 --2- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c0adc60 0x7f5b7c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79400700 1 -- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c0adc60 msgr2=0x7f5b7c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b78a00700 1 -- 172.21.15.50:0/2309855850 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916235957 0 0) 0x7f5b7c073660 con 0x7f5b7c15ac40 2024-09-13T15:09:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79400700 1 --2- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c0adc60 0x7f5b7c15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79400700 1 -- 172.21.15.50:0/2309855850 >> v1:172.21.15.181:6789/0 conn(0x7f5b7c15ac40 legacy=0x7f5b7c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79400700 1 -- 172.21.15.50:0/2309855850 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c073b90 con 0x7f5b7c070a40 2024-09-13T15:09:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b79400700 1 --2- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c070a40 0x7f5b7c0ad720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009850 tx=0x7f5b68009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f55c5fe5b1ca384d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b78a00700 1 -- 172.21.15.50:0/2309855850 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011830 con 0x7f5b7c070a40 2024-09-13T15:09:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b78a00700 1 -- 172.21.15.50:0/2309855850 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68011990 con 0x7f5b7c070a40 2024-09-13T15:09:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b78a00700 1 -- 172.21.15.50:0/2309855850 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011d40 con 0x7f5b7c070a40 2024-09-13T15:09:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b7b200700 1 -- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c070a40 msgr2=0x7f5b7c0ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b7b200700 1 --2- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c070a40 0x7f5b7c0ad720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009850 tx=0x7f5b68009b60 comp rx=0 tx=0).stop 2024-09-13T15:09:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b7b200700 1 -- 172.21.15.50:0/2309855850 shutdown_connections 2024-09-13T15:09:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b7b200700 1 --2- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c0adc60 0x7f5b7c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.774+0000 7f5b7b200700 1 --2- 172.21.15.50:0/2309855850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c070a40 0x7f5b7c0ad720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- 172.21.15.50:0/2309855850 >> 172.21.15.50:0/2309855850 conn(0x7f5b7c0b4770 msgr2=0x7f5b7c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- 172.21.15.50:0/2309855850 shutdown_connections 2024-09-13T15:09:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- 172.21.15.50:0/2309855850 wait complete. 2024-09-13T15:09:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 Processor -- start 2024-09-13T15:09:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- start start 2024-09-13T15:09:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c070a40 0x7f5b7c0985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 0x7f5b7c150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c151cb0 0x7f5b7c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c153fd0 con 0x7f5b7c151cb0 2024-09-13T15:09:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c154b50 con 0x7f5b7c0adc60 2024-09-13T15:09:55.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.778+0000 7f5b7b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c154220 con 0x7f5b7c070a40 2024-09-13T15:09:55.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 0x7f5b7c150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c070a40 0x7f5b7c0985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 0x7f5b7c150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:41390/0 (socket says 172.21.15.50:41390) 2024-09-13T15:09:55.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 -- 172.21.15.50:0/3069296399 learned_addr learned my addr 172.21.15.50:0/3069296399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:55.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b7a800700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c151cb0 0x7f5b7c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 -- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c070a40 msgr2=0x7f5b7c0985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c070a40 0x7f5b7c0985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 -- 172.21.15.50:0/3069296399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c151cb0 msgr2=0x7f5b7c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c151cb0 0x7f5b7c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 -- 172.21.15.50:0/3069296399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680094b0 con 0x7f5b7c0adc60 2024-09-13T15:09:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b79400700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 0x7f5b7c150720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5b68000c00 tx=0x7f5b68004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6801a990 con 0x7f5b7c0adc60 2024-09-13T15:09:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c154500 con 0x7f5b7c0adc60 2024-09-13T15:09:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6801f070 con 0x7f5b7c0adc60 2024-09-13T15:09:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6801ad30 con 0x7f5b7c0adc60 2024-09-13T15:09:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.782+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c154fe0 con 0x7f5b7c0adc60 2024-09-13T15:09:55.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.786+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c0ad720 con 0x7f5b7c0adc60 2024-09-13T15:09:55.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.786+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b6801b430 con 0x7f5b7c0adc60 2024-09-13T15:09:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.786+0000 7f5b72000700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b5c066730 0x7f5b5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.786+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b68085bc0 con 0x7f5b7c0adc60 2024-09-13T15:09:55.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.790+0000 7f5b79e00700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b5c066730 0x7f5b5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.790+0000 7f5b79e00700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b5c066730 0x7f5b5c068bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000f60 tx=0x7f5b6c007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.794+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b68052de0 con 0x7f5b7c0adc60 2024-09-13T15:09:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.982+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b7c154c90 con 0x7f5b7c0adc60 2024-09-13T15:09:55.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b72000700 1 -- 172.21.15.50:0/3069296399 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b680330a0 con 0x7f5b7c0adc60 2024-09-13T15:09:55.991 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b5c066730 msgr2=0x7f5b5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b5c066730 0x7f5b5c068bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000f60 tx=0x7f5b6c007e90 comp rx=0 tx=0).stop 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 msgr2=0x7f5b7c150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 0x7f5b7c150720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5b68000c00 tx=0x7f5b68004770 comp rx=0 tx=0).stop 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 shutdown_connections 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5b5c066730 0x7f5b5c068bf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c151cb0 0x7f5b7c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b7c0adc60 0x7f5b7c150720 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 --2- 172.21.15.50:0/3069296399 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5b7c070a40 0x7f5b7c0985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.986+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 >> 172.21.15.50:0/3069296399 conn(0x7f5b7c0b4770 msgr2=0x7f5b7c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:55.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.990+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 shutdown_connections 2024-09-13T15:09:55.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:55.990+0000 7f5b7b200700 1 -- 172.21.15.50:0/3069296399 wait complete. 2024-09-13T15:09:56.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:09:56.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.198+0000 7efc6be00700 1 Processor -- start 2024-09-13T15:09:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.202+0000 7efc6be00700 1 -- start start 2024-09-13T15:09:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.202+0000 7efc6be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efc6c06d620 0x7efc6c06c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.202+0000 7efc6be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 0x7efc6c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.202+0000 7efc6be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c0b1980 con 0x7efc6c143b70 2024-09-13T15:09:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.202+0000 7efc6be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0b2500 con 0x7efc6c06d620 2024-09-13T15:09:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.202+0000 7efc6be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c06d2f0 con 0x7efc6c06cea0 2024-09-13T15:09:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efc6c143b70 0x7efc6c0cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36986/0 (socket says 172.21.15.50:36986) 2024-09-13T15:09:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 -- 172.21.15.50:0/2749184114 learned_addr learned my addr 172.21.15.50:0/2749184114 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6a000700 1 --2- 172.21.15.50:0/2749184114 >> v2:172.21.15.181:3300/0 conn(0x7efc6c06d620 0x7efc6c06c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6b400700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 0x7efc6c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314401035 0 0) 0x7efc6c0b1980 con 0x7efc6c143b70 2024-09-13T15:09:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc500035d0 con 0x7efc6c143b70 2024-09-13T15:09:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159334490 0 0) 0x7efc500035d0 con 0x7efc6c143b70 2024-09-13T15:09:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 msgr2=0x7efc6c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 0x7efc6c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 >> v2:172.21.15.181:3300/0 conn(0x7efc6c06d620 msgr2=0x7efc6c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 --2- 172.21.15.50:0/2749184114 >> v2:172.21.15.181:3300/0 conn(0x7efc6c06d620 0x7efc6c06c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0b1bd0 con 0x7efc6c143b70 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7efc5c001670 con 0x7efc6c143b70 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 >> v1:172.21.15.50:6789/0 conn(0x7efc6c143b70 legacy=0x7efc6c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc50003a20 0x7efc50003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc50004870 0x7efc50004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 0x7efc50005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0b2500 con 0x7efc50003a20 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c06d2f0 con 0x7efc50004870 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5000ba30 con 0x7efc6c06cea0 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6a000700 1 --2- 172.21.15.50:0/2749184114 >> v2:172.21.15.181:3300/0 conn(0x7efc6c06d620 0x7efc6c06c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc50003a20 0x7efc50003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6b400700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 0x7efc50005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6a000700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc50004870 0x7efc50004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 -- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 msgr2=0x7efc50005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc6c06cea0 0x7efc50005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 -- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc50004870 msgr2=0x7efc50004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc50004870 0x7efc50004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 -- 172.21.15.50:0/2749184114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500035d0 con 0x7efc50003a20 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.206+0000 7efc6aa00700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc50003a20 0x7efc50003e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c320 tx=0x7efc500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9cd6f2f356e561 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00ce60 con 0x7efc50003a20 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c005980 con 0x7efc50003a20 2024-09-13T15:09:56.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc69600700 1 -- 172.21.15.50:0/2749184114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c005d10 con 0x7efc50003a20 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6be00700 1 -- 172.21.15.50:0/2749184114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc50003a20 msgr2=0x7efc50003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6be00700 1 --2- 172.21.15.50:0/2749184114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc50003a20 0x7efc50003e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c320 tx=0x7efc500058a0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6b400700 1 -- 172.21.15.50:0/2749184114 reap_dead start 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6be00700 1 -- 172.21.15.50:0/2749184114 shutdown_connections 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6be00700 1 -- 172.21.15.50:0/2749184114 >> 172.21.15.50:0/2749184114 conn(0x7efc6c06a390 msgr2=0x7efc6c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6be00700 1 -- 172.21.15.50:0/2749184114 shutdown_connections 2024-09-13T15:09:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.210+0000 7efc6be00700 1 -- 172.21.15.50:0/2749184114 wait complete. 2024-09-13T15:09:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 Processor -- start 2024-09-13T15:09:56.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 -- start start 2024-09-13T15:09:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc50003a20 0x7efc6c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 0x7efc6c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc6c155b40 0x7efc6c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1511c0 con 0x7efc6c14db10 2024-09-13T15:09:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c140e20 con 0x7efc6c155b40 2024-09-13T15:09:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c150920 con 0x7efc50003a20 2024-09-13T15:09:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 0x7efc6c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 0x7efc6c0b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56028/0 (socket says 172.21.15.50:56028) 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 -- 172.21.15.50:0/3551857320 learned_addr learned my addr 172.21.15.50:0/3551857320 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6b400700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc6c155b40 0x7efc6c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6aa00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc50003a20 0x7efc6c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 -- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc50003a20 msgr2=0x7efc6c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc50003a20 0x7efc6c0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 -- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc6c155b40 msgr2=0x7efc6c155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc6c155b40 0x7efc6c155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.214+0000 7efc6a000700 1 -- 172.21.15.50:0/3551857320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c150c00 con 0x7efc6c14db10 2024-09-13T15:09:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc6a000700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 0x7efc6c0b3390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efc58010c60 tx=0x7efc58010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580097b0 con 0x7efc6c14db10 2024-09-13T15:09:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800e8d0 con 0x7efc6c14db10 2024-09-13T15:09:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c150ee0 con 0x7efc6c14db10 2024-09-13T15:09:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800ec40 con 0x7efc6c14db10 2024-09-13T15:09:56.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c156710 con 0x7efc6c14db10 2024-09-13T15:09:56.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.218+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c140bd0 con 0x7efc6c14db10 2024-09-13T15:09:56.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.222+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc58016460 con 0x7efc6c14db10 2024-09-13T15:09:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.222+0000 7efc62a00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc4c066730 0x7efc4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.222+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efc58084600 con 0x7efc6c14db10 2024-09-13T15:09:56.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.222+0000 7efc6aa00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc4c066730 0x7efc4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.226+0000 7efc6aa00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc4c066730 0x7efc4c068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efc5c008fd0 tx=0x7efc5c00a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:56.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.230+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc58051820 con 0x7efc6c14db10 2024-09-13T15:09:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.414+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc6c06c960 con 0x7efc6c14db10 2024-09-13T15:09:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.414+0000 7efc62a00700 1 -- 172.21.15.50:0/3551857320 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc58006ce0 con 0x7efc6c14db10 2024-09-13T15:09:56.420 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:09:56.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc4c066730 msgr2=0x7efc4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc4c066730 0x7efc4c068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efc5c008fd0 tx=0x7efc5c00a000 comp rx=0 tx=0).stop 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 msgr2=0x7efc6c0b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 0x7efc6c0b3390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efc58010c60 tx=0x7efc58010f70 comp rx=0 tx=0).stop 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 shutdown_connections 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc4c066730 0x7efc4c068bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc6c155b40 0x7efc6c155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6c14db10 0x7efc6c0b3390 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 --2- 172.21.15.50:0/3551857320 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc50003a20 0x7efc6c0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 >> 172.21.15.50:0/3551857320 conn(0x7efc6c06a390 msgr2=0x7efc6c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 shutdown_connections 2024-09-13T15:09:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.418+0000 7efc6be00700 1 -- 172.21.15.50:0/3551857320 wait complete. 2024-09-13T15:09:56.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:09:56.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.610+0000 7fb834400700 1 Processor -- start 2024-09-13T15:09:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.610+0000 7fb834400700 1 -- start start 2024-09-13T15:09:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb834400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb82c15e140 0x7fb82c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb834400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15c4c0 0x7fb82c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb834400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb82c0abdc0 0x7fb82c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb834400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c15f500 con 0x7fb82c15e140 2024-09-13T15:09:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb834400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c0ad530 con 0x7fb82c0abdc0 2024-09-13T15:09:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb834400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c15e980 con 0x7fb82c15c4c0 2024-09-13T15:09:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb831a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb82c15e140 0x7fb82c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb831a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb82c15e140 0x7fb82c06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56030/0 (socket says 172.21.15.50:56030) 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb831a00700 1 -- 172.21.15.50:0/3880760178 learned_addr learned my addr 172.21.15.50:0/3880760178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.614+0000 7fb831000700 1 --2- 172.21.15.50:0/3880760178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15c4c0 0x7fb82c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb832400700 1 --2- 172.21.15.50:0/3880760178 >> v2:172.21.15.181:3300/0 conn(0x7fb82c0abdc0 0x7fb82c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb831a00700 1 -- 172.21.15.50:0/3880760178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15c4c0 msgr2=0x7fb82c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb831a00700 1 --2- 172.21.15.50:0/3880760178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15c4c0 0x7fb82c06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb831a00700 1 -- 172.21.15.50:0/3880760178 >> v2:172.21.15.181:3300/0 conn(0x7fb82c0abdc0 msgr2=0x7fb82c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb831a00700 1 --2- 172.21.15.50:0/3880760178 >> v2:172.21.15.181:3300/0 conn(0x7fb82c0abdc0 0x7fb82c06bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb831a00700 1 -- 172.21.15.50:0/3880760178 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c15ec60 con 0x7fb82c15e140 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb832400700 1 --2- 172.21.15.50:0/3880760178 >> v2:172.21.15.181:3300/0 conn(0x7fb82c0abdc0 0x7fb82c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb831a00700 1 --2- 172.21.15.50:0/3880760178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c15e140 0x7fb82c06d5b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0ced80 tx=0x7fb820009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b6c86ccd682f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb82be00700 1 -- 172.21.15.50:0/3880760178 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011830 con 0x7fb82c15e140 2024-09-13T15:09:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb82be00700 1 -- 172.21.15.50:0/3880760178 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820011990 con 0x7fb82c15e140 2024-09-13T15:09:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb82be00700 1 -- 172.21.15.50:0/3880760178 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011d20 con 0x7fb82c15e140 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 -- 172.21.15.50:0/3880760178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c15e140 msgr2=0x7fb82c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 --2- 172.21.15.50:0/3880760178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c15e140 0x7fb82c06d5b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0ced80 tx=0x7fb820009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 -- 172.21.15.50:0/3880760178 shutdown_connections 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 --2- 172.21.15.50:0/3880760178 >> v2:172.21.15.181:3300/0 conn(0x7fb82c0abdc0 0x7fb82c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 --2- 172.21.15.50:0/3880760178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15c4c0 0x7fb82c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 --2- 172.21.15.50:0/3880760178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c15e140 0x7fb82c06d5b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 -- 172.21.15.50:0/3880760178 >> 172.21.15.50:0/3880760178 conn(0x7fb82c0cedd0 msgr2=0x7fb82c0cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 -- 172.21.15.50:0/3880760178 shutdown_connections 2024-09-13T15:09:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.618+0000 7fb834400700 1 -- 172.21.15.50:0/3880760178 wait complete. 2024-09-13T15:09:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 Processor -- start 2024-09-13T15:09:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 -- start start 2024-09-13T15:09:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 0x7fb82c14a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb82c15c4c0 0x7fb82c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15e140 0x7fb82c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c14ad70 con 0x7fb82c0abdc0 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c1f06e0 con 0x7fb82c15c4c0 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb834400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0af120 con 0x7fb82c15e140 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb831a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 0x7fb82c14a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb831a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 0x7fb82c14a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56040/0 (socket says 172.21.15.50:56040) 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb831a00700 1 -- 172.21.15.50:0/698500562 learned_addr learned my addr 172.21.15.50:0/698500562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb831000700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb82c15c4c0 0x7fb82c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb831a00700 1 -- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15e140 msgr2=0x7fb82c0aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.622+0000 7fb831a00700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15e140 0x7fb82c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb831a00700 1 -- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb82c15c4c0 msgr2=0x7fb82c0ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb831a00700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb82c15c4c0 0x7fb82c0ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb831a00700 1 -- 172.21.15.50:0/698500562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820009570 con 0x7fb82c0abdc0 2024-09-13T15:09:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb831a00700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 0x7fb82c14a220 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb82c06e410 tx=0x7fb820004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820004590 con 0x7fb82c0abdc0 2024-09-13T15:09:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82001e070 con 0x7fb82c0abdc0 2024-09-13T15:09:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c0cb800 con 0x7fb82c0abdc0 2024-09-13T15:09:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200038e0 con 0x7fb82c0abdc0 2024-09-13T15:09:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c0cbdc0 con 0x7fb82c0abdc0 2024-09-13T15:09:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.626+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c15afd0 con 0x7fb82c0abdc0 2024-09-13T15:09:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.630+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb820003a40 con 0x7fb82c0abdc0 2024-09-13T15:09:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.630+0000 7fb829600700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb80c066730 0x7fb80c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.630+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8200853a0 con 0x7fb82c0abdc0 2024-09-13T15:09:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.630+0000 7fb831000700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb80c066730 0x7fb80c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:56.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.630+0000 7fb831000700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb80c066730 0x7fb80c068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb82c14e580 tx=0x7fb818008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.638+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb820052660 con 0x7fb82c0abdc0 2024-09-13T15:09:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.818+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb82c09cf40 con 0x7fb82c0abdc0 2024-09-13T15:09:56.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.822+0000 7fb829600700 1 -- 172.21.15.50:0/698500562 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb820055c80 con 0x7fb82c0abdc0 2024-09-13T15:09:56.827 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:09:56.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb80c066730 msgr2=0x7fb80c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb80c066730 0x7fb80c068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb82c14e580 tx=0x7fb818008040 comp rx=0 tx=0).stop 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 msgr2=0x7fb82c14a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 0x7fb82c14a220 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb82c06e410 tx=0x7fb820004770 comp rx=0 tx=0).stop 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 shutdown_connections 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb80c066730 0x7fb80c068bf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb82c15e140 0x7fb82c0aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb82c15c4c0 0x7fb82c0ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 --2- 172.21.15.50:0/698500562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c0abdc0 0x7fb82c14a220 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 >> 172.21.15.50:0/698500562 conn(0x7fb82c0cedd0 msgr2=0x7fb82c06bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 shutdown_connections 2024-09-13T15:09:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:56.826+0000 7fb834400700 1 -- 172.21.15.50:0/698500562 wait complete. 2024-09-13T15:09:56.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:09:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.026+0000 7f2467400700 1 Processor -- start 2024-09-13T15:09:57.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.026+0000 7f2467400700 1 -- start start 2024-09-13T15:09:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.026+0000 7f2467400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24601573b0 0x7f24600cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.026+0000 7f2467400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2467400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600ad480 con 0x7f24600ce2f0 2024-09-13T15:09:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2467400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2460157790 con 0x7f24601573b0 2024-09-13T15:09:57.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2467400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24600ad6d0 con 0x7f246006ace0 2024-09-13T15:09:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24601573b0 0x7f24600cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24601573b0 0x7f24600cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56044/0 (socket says 172.21.15.50:56044) 2024-09-13T15:09:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f245fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f24600ce2f0 0x7f246006a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36990/0 (socket says 172.21.15.50:36990) 2024-09-13T15:09:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 -- 172.21.15.50:0/2549827648 learned_addr learned my addr 172.21.15.50:0/2549827648 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:57.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2465400700 1 --2- 172.21.15.50:0/2549827648 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 -- 172.21.15.50:0/2549827648 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 msgr2=0x7f246006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 --2- 172.21.15.50:0/2549827648 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246006ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 -- 172.21.15.50:0/2549827648 >> v1:172.21.15.50:6789/0 conn(0x7f24600ce2f0 legacy=0x7f246006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 -- 172.21.15.50:0/2549827648 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600ad9b0 con 0x7f24601573b0 2024-09-13T15:09:57.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f245f400700 1 -- 172.21.15.50:0/2549827648 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032515701 0 0) 0x7f24600ad480 con 0x7f24600ce2f0 2024-09-13T15:09:57.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f2464a00700 1 --2- 172.21.15.50:0/2549827648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24601573b0 0x7f24600cddb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2454009910 tx=0x7f2454009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfbf7a35090ac55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f245f400700 1 -- 172.21.15.50:0/2549827648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454011830 con 0x7f24601573b0 2024-09-13T15:09:57.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f245f400700 1 -- 172.21.15.50:0/2549827648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454011990 con 0x7f24601573b0 2024-09-13T15:09:57.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.030+0000 7f245f400700 1 -- 172.21.15.50:0/2549827648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454011d40 con 0x7f24601573b0 2024-09-13T15:09:57.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 -- 172.21.15.50:0/2549827648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24601573b0 msgr2=0x7f24600cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 --2- 172.21.15.50:0/2549827648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24601573b0 0x7f24600cddb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2454009910 tx=0x7f2454009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:57.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 -- 172.21.15.50:0/2549827648 shutdown_connections 2024-09-13T15:09:57.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 --2- 172.21.15.50:0/2549827648 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246006ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 --2- 172.21.15.50:0/2549827648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24601573b0 0x7f24600cddb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 -- 172.21.15.50:0/2549827648 >> 172.21.15.50:0/2549827648 conn(0x7f24600b08d0 msgr2=0x7f24600b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:57.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 -- 172.21.15.50:0/2549827648 shutdown_connections 2024-09-13T15:09:57.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 -- 172.21.15.50:0/2549827648 wait complete. 2024-09-13T15:09:57.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.034+0000 7f2467400700 1 Processor -- start 2024-09-13T15:09:57.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 -- start start 2024-09-13T15:09:57.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246015f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 0x7f2460147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24601573b0 0x7f24601477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601f68b0 con 0x7f24600ce2f0 2024-09-13T15:09:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601f5f80 con 0x7f24601573b0 2024-09-13T15:09:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2467400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24601f6260 con 0x7f246006ace0 2024-09-13T15:09:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 0x7f2460147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 0x7f2460147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56056/0 (socket says 172.21.15.50:56056) 2024-09-13T15:09:57.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 -- 172.21.15.50:0/2619085055 learned_addr learned my addr 172.21.15.50:0/2619085055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:57.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2464a00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f2465400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24601573b0 0x7f24601477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 -- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 msgr2=0x7f246015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 -- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24601573b0 msgr2=0x7f24601477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24601573b0 0x7f24601477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 -- 172.21.15.50:0/2619085055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009570 con 0x7f24600ce2f0 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.038+0000 7f245fe00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 0x7f2460147280 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c580 tx=0x7f244c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.042+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c004ca0 con 0x7f24600ce2f0 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.042+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24601f6540 con 0x7f24600ce2f0 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.042+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c004e20 con 0x7f24600ce2f0 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.042+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c007310 con 0x7f24600ce2f0 2024-09-13T15:09:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.042+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246014a300 con 0x7f24600ce2f0 2024-09-13T15:09:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.042+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246006ff60 con 0x7f24600ce2f0 2024-09-13T15:09:57.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.046+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f244c007470 con 0x7f24600ce2f0 2024-09-13T15:09:57.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.046+0000 7f245cc00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2440066730 0x7f2440068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.046+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f244c0840f0 con 0x7f24600ce2f0 2024-09-13T15:09:57.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.046+0000 7f2464a00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2440066730 0x7f2440068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.046+0000 7f2464a00700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2440066730 0x7f2440068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2454014040 tx=0x7f2454008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.054+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f244c051290 con 0x7f24600ce2f0 2024-09-13T15:09:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.246+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2460070470 con 0x7f24600ce2f0 2024-09-13T15:09:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.250+0000 7f245cc00700 1 -- 172.21.15.50:0/2619085055 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f244c007720 con 0x7f24600ce2f0 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2440066730 msgr2=0x7f2440068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2440066730 0x7f2440068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2454014040 tx=0x7f2454008030 comp rx=0 tx=0).stop 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 msgr2=0x7f2460147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 0x7f2460147280 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c580 tx=0x7f244c00c940 comp rx=0 tx=0).stop 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 shutdown_connections 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2440066730 0x7f2440068bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24601573b0 0x7f24601477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600ce2f0 0x7f2460147280 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 --2- 172.21.15.50:0/2619085055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f246006ace0 0x7f246015f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 >> 172.21.15.50:0/2619085055 conn(0x7f24600b08d0 msgr2=0x7f2460161150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:57.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 shutdown_connections 2024-09-13T15:09:57.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.254+0000 7f2467400700 1 -- 172.21.15.50:0/2619085055 wait complete. 2024-09-13T15:09:57.262 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:09:57.281 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:09:57.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:57.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:09:57.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:09:57.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:57.323 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:09:57.384 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:57.384 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:57.401 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:57.401 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:57.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:09:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.638+0000 7fc18a600700 1 Processor -- start 2024-09-13T15:09:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.638+0000 7fc18a600700 1 -- start start 2024-09-13T15:09:57.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc18a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc18a600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1840cd610 0x7fc18406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc18a600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1840ce140 con 0x7fc1840b19f0 2024-09-13T15:09:57.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc18a600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840b1e30 con 0x7fc1840cd610 2024-09-13T15:09:57.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc18a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840cde60 con 0x7fc18406a5d0 2024-09-13T15:09:57.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1840cd610 0x7fc18406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1840cd610 0x7fc18406ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56062/0 (socket says 172.21.15.50:56062) 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 -- 172.21.15.50:0/1439759385 learned_addr learned my addr 172.21.15.50:0/1439759385 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183400700 1 --2- 172.21.15.50:0/1439759385 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 -- 172.21.15.50:0/1439759385 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 msgr2=0x7fc184071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 --2- 172.21.15.50:0/1439759385 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 -- 172.21.15.50:0/1439759385 >> v1:172.21.15.50:6789/0 conn(0x7fc1840b19f0 legacy=0x7fc18406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 -- 172.21.15.50:0/1439759385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18406c3b0 con 0x7fc1840cd610 2024-09-13T15:09:57.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc183e00700 1 --2- 172.21.15.50:0/1439759385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840cd610 0x7fc18406ce90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009e50 tx=0x7fc17c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe48d93ec86bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc182a00700 1 -- 172.21.15.50:0/1439759385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00e070 con 0x7fc1840cd610 2024-09-13T15:09:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc182a00700 1 -- 172.21.15.50:0/1439759385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00b910 con 0x7fc1840cd610 2024-09-13T15:09:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.642+0000 7fc182a00700 1 -- 172.21.15.50:0/1439759385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00bcc0 con 0x7fc1840cd610 2024-09-13T15:09:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 -- 172.21.15.50:0/1439759385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840cd610 msgr2=0x7fc18406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 --2- 172.21.15.50:0/1439759385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840cd610 0x7fc18406ce90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009e50 tx=0x7fc17c00b330 comp rx=0 tx=0).stop 2024-09-13T15:09:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 -- 172.21.15.50:0/1439759385 shutdown_connections 2024-09-13T15:09:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 --2- 172.21.15.50:0/1439759385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840cd610 0x7fc18406ce90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 --2- 172.21.15.50:0/1439759385 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 -- 172.21.15.50:0/1439759385 >> 172.21.15.50:0/1439759385 conn(0x7fc1840b08d0 msgr2=0x7fc1840b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 -- 172.21.15.50:0/1439759385 shutdown_connections 2024-09-13T15:09:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 -- 172.21.15.50:0/1439759385 wait complete. 2024-09-13T15:09:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 Processor -- start 2024-09-13T15:09:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.646+0000 7fc18a600700 1 -- start start 2024-09-13T15:09:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 0x7fc184160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1840cd610 0x7fc1840a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1841fb290 con 0x7fc1840b19f0 2024-09-13T15:09:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840adc20 con 0x7fc1840cd610 2024-09-13T15:09:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1841fa680 con 0x7fc18406a5d0 2024-09-13T15:09:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 0x7fc184160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 0x7fc184160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56070/0 (socket says 172.21.15.50:56070) 2024-09-13T15:09:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 -- 172.21.15.50:0/971985378 learned_addr learned my addr 172.21.15.50:0/971985378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc183e00700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1840cd610 0x7fc1840a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc183400700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 -- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 msgr2=0x7fc184145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 -- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1840cd610 msgr2=0x7fc1840a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1840cd610 0x7fc1840a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 -- 172.21.15.50:0/971985378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c009b30 con 0x7fc1840b19f0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17aa00700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 0x7fc184160720 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c4d0 tx=0x7fc16c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0052d0 con 0x7fc1840b19f0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c005430 con 0x7fc1840b19f0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1841fa960 con 0x7fc1840b19f0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0055a0 con 0x7fc1840b19f0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.650+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1841faf20 con 0x7fc1840b19f0 2024-09-13T15:09:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.654+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1841fb400 con 0x7fc1840b19f0 2024-09-13T15:09:57.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.654+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc16c0038c0 con 0x7fc1840b19f0 2024-09-13T15:09:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.658+0000 7fc17be00700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc160066730 0x7fc160068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.658+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc16c083830 con 0x7fc1840b19f0 2024-09-13T15:09:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.658+0000 7fc183400700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc160066730 0x7fc160068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.658+0000 7fc183400700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc160066730 0x7fc160068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc174009b80 tx=0x7fc174008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.662+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc16c0509d0 con 0x7fc1840b19f0 2024-09-13T15:09:57.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.858+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc184071d20 con 0x7fc1840b19f0 2024-09-13T15:09:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.858+0000 7fc17be00700 1 -- 172.21.15.50:0/971985378 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fc16c053ff0 con 0x7fc1840b19f0 2024-09-13T15:09:57.866 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:09:57.866 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:46.669735+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:09:57.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc160066730 msgr2=0x7fc160068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc160066730 0x7fc160068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc174009b80 tx=0x7fc174008040 comp rx=0 tx=0).stop 2024-09-13T15:09:57.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 msgr2=0x7fc184160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 0x7fc184160720 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c4d0 tx=0x7fc16c00c890 comp rx=0 tx=0).stop 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 shutdown_connections 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc160066730 0x7fc160068bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1840cd610 0x7fc1840a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1840b19f0 0x7fc184160720 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 --2- 172.21.15.50:0/971985378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc18406a5d0 0x7fc184145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 >> 172.21.15.50:0/971985378 conn(0x7fc1840b08d0 msgr2=0x7fc184071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:57.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.862+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 shutdown_connections 2024-09-13T15:09:57.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:57.866+0000 7fc18a600700 1 -- 172.21.15.50:0/971985378 wait complete. 2024-09-13T15:09:57.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:43.873444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:44.686028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:09:57.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:09:58.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 Processor -- start 2024-09-13T15:09:58.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 -- start start 2024-09-13T15:09:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f867c06c4c0 0x7f867c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f867c06c8c0 0x7f867c0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c15ea30 con 0x7f867c146720 2024-09-13T15:09:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c070670 con 0x7f867c06c8c0 2024-09-13T15:09:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.074+0000 7f8680e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c070950 con 0x7f867c06c4c0 2024-09-13T15:09:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8679e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f867c146720 0x7f867c15e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37000/0 (socket says 172.21.15.50:37000) 2024-09-13T15:09:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8679e00700 1 -- 172.21.15.50:0/2761123375 learned_addr learned my addr 172.21.15.50:0/2761123375 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f867a800700 1 --2- 172.21.15.50:0/2761123375 >> v2:172.21.15.50:3300/0 conn(0x7f867c06c8c0 0x7f867c0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8679400700 1 --2- 172.21.15.50:0/2761123375 >> v2:172.21.15.181:3300/0 conn(0x7f867c06c4c0 0x7f867c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8678a00700 1 -- 172.21.15.50:0/2761123375 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539260859 0 0) 0x7f867c15ea30 con 0x7f867c146720 2024-09-13T15:09:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8678a00700 1 -- 172.21.15.50:0/2761123375 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86600035d0 con 0x7f867c146720 2024-09-13T15:09:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f867a800700 1 -- 172.21.15.50:0/2761123375 >> v2:172.21.15.181:3300/0 conn(0x7f867c06c4c0 msgr2=0x7f867c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f867a800700 1 --2- 172.21.15.50:0/2761123375 >> v2:172.21.15.181:3300/0 conn(0x7f867c06c4c0 0x7f867c0ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f867a800700 1 -- 172.21.15.50:0/2761123375 >> v1:172.21.15.50:6789/0 conn(0x7f867c146720 legacy=0x7f867c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f867a800700 1 -- 172.21.15.50:0/2761123375 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c070c30 con 0x7f867c06c8c0 2024-09-13T15:09:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f867a800700 1 --2- 172.21.15.50:0/2761123375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c06c8c0 0x7f867c0cf0b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f867c06fdd0 tx=0x7f867400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5657d6ffeb271d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8678a00700 1 -- 172.21.15.50:0/2761123375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400e070 con 0x7f867c06c8c0 2024-09-13T15:09:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8678a00700 1 -- 172.21.15.50:0/2761123375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400bb20 con 0x7f867c06c8c0 2024-09-13T15:09:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.078+0000 7f8678a00700 1 -- 172.21.15.50:0/2761123375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400be90 con 0x7f867c06c8c0 2024-09-13T15:09:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 -- 172.21.15.50:0/2761123375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c06c8c0 msgr2=0x7f867c0cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 --2- 172.21.15.50:0/2761123375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c06c8c0 0x7f867c0cf0b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f867c06fdd0 tx=0x7f867400b330 comp rx=0 tx=0).stop 2024-09-13T15:09:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 -- 172.21.15.50:0/2761123375 shutdown_connections 2024-09-13T15:09:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 --2- 172.21.15.50:0/2761123375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c06c8c0 0x7f867c0cf0b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 --2- 172.21.15.50:0/2761123375 >> v2:172.21.15.181:3300/0 conn(0x7f867c06c4c0 0x7f867c0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 -- 172.21.15.50:0/2761123375 >> 172.21.15.50:0/2761123375 conn(0x7f867c06a570 msgr2=0x7f867c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 -- 172.21.15.50:0/2761123375 shutdown_connections 2024-09-13T15:09:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 -- 172.21.15.50:0/2761123375 wait complete. 2024-09-13T15:09:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.082+0000 7f8680e00700 1 Processor -- start 2024-09-13T15:09:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 -- start start 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f867c06c4c0 0x7f867c0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f867c06c8c0 0x7f867c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 0x7f867c0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1565d0 con 0x7f867c146720 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1e5670 con 0x7f867c06c4c0 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1e5910 con 0x7f867c06c8c0 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 0x7f867c0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 0x7f867c0ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56090/0 (socket says 172.21.15.50:56090) 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 -- 172.21.15.50:0/1832835679 learned_addr learned my addr 172.21.15.50:0/1832835679 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8679e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f867c06c4c0 0x7f867c0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8679400700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f867c06c8c0 0x7f867c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 -- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f867c06c8c0 msgr2=0x7f867c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f867c06c8c0 0x7f867c156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 -- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f867c06c4c0 msgr2=0x7f867c0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f867c06c4c0 0x7f867c0b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 -- 172.21.15.50:0/1832835679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009a70 con 0x7f867c146720 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8679400700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f867c06c8c0 0x7f867c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f867a800700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 0x7f867c0ae3e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f867400b370 tx=0x7f8674004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674007000 con 0x7f867c146720 2024-09-13T15:09:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674012650 con 0x7f867c146720 2024-09-13T15:09:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674012a00 con 0x7f867c146720 2024-09-13T15:09:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.086+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c1e5bf0 con 0x7f867c146720 2024-09-13T15:09:58.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.090+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0aed50 con 0x7f867c146720 2024-09-13T15:09:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.090+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0aeee0 con 0x7f867c146720 2024-09-13T15:09:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.090+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8674012b60 con 0x7f867c146720 2024-09-13T15:09:58.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.094+0000 7f8672000700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8658066760 0x7f8658068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.094+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8674085fa0 con 0x7f867c146720 2024-09-13T15:09:58.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.094+0000 7f8679e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8658066760 0x7f8658068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.098+0000 7f8679e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8658066760 0x7f8658068c20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f866c005930 tx=0x7f866c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.098+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8674053270 con 0x7f867c146720 2024-09-13T15:09:58.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.286+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f867c15e320 con 0x7f867c146720 2024-09-13T15:09:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8672000700 1 -- 172.21.15.50:0/1832835679 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8674056890 con 0x7f867c146720 2024-09-13T15:09:58.294 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:09:58.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8658066760 msgr2=0x7f8658068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8658066760 0x7f8658068c20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f866c005930 tx=0x7f866c009040 comp rx=0 tx=0).stop 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 msgr2=0x7f867c0ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 0x7f867c0ae3e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f867400b370 tx=0x7f8674004af0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 shutdown_connections 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8658066760 0x7f8658068c20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f867c146720 0x7f867c0ae3e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f867c06c8c0 0x7f867c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 --2- 172.21.15.50:0/1832835679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f867c06c4c0 0x7f867c0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 >> 172.21.15.50:0/1832835679 conn(0x7f867c06a570 msgr2=0x7f867c15ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 shutdown_connections 2024-09-13T15:09:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.290+0000 7f8680e00700 1 -- 172.21.15.50:0/1832835679 wait complete. 2024-09-13T15:09:58.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:09:58.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.478+0000 7f68e2c00700 1 Processor -- start 2024-09-13T15:09:58.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.478+0000 7f68e2c00700 1 -- start start 2024-09-13T15:09:58.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68dc0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc06d560 con 0x7f68dc0b1ec0 2024-09-13T15:09:58.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc06d840 con 0x7f68dc1590a0 2024-09-13T15:09:58.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0b2310 con 0x7f68dc15a000 2024-09-13T15:09:58.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68dc0b1ec0 0x7f68dc070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37010/0 (socket says 172.21.15.50:37010) 2024-09-13T15:09:58.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2200700 1 -- 172.21.15.50:0/3328242203 learned_addr learned my addr 172.21.15.50:0/3328242203 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:09:58.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68dc0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958948095 0 0) 0x7f68dc06d560 con 0x7f68dc0b1ec0 2024-09-13T15:09:58.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c00057e0 con 0x7f68dc0b1ec0 2024-09-13T15:09:58.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3282674446 0 0) 0x7f68c00057e0 con 0x7f68dc0b1ec0 2024-09-13T15:09:58.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 msgr2=0x7f68dc0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:58.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68dc0b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 >> v1:172.21.15.181:6789/0 conn(0x7f68dc1590a0 legacy=0x7f68dc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0cc7f0 con 0x7f68dc0b1ec0 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f68d4001670 con 0x7f68dc0b1ec0 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 >> v1:172.21.15.50:6789/0 conn(0x7f68dc0b1ec0 legacy=0x7f68dc070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68c0005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c00061a0 0x7f68c0006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0006fc0 0x7f68c0007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000dc70 con 0x7f68c00061a0 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000dde0 con 0x7f68c0006fc0 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000dfa0 con 0x7f68dc15a000 2024-09-13T15:09:58.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c00061a0 0x7f68c0006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e2200700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0006fc0 0x7f68c0007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e1800700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68c0005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 -- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 msgr2=0x7f68c0005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:58.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68c0005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 -- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0006fc0 msgr2=0x7f68c0007440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:58.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0006fc0 0x7f68c0007440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e0e00700 1 -- 172.21.15.50:0/3328242203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00057e0 con 0x7f68c00061a0 2024-09-13T15:09:58.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.482+0000 7f68e1800700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc15a000 0x7f68c0005c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:58.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e0e00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c00061a0 0x7f68c0006a80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009b70 tx=0x7f68c0007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9bb9dea123a411 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800e6c0 con 0x7f68c00061a0 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800e820 con 0x7f68c00061a0 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68dbe00700 1 -- 172.21.15.50:0/3328242203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800eb90 con 0x7f68c00061a0 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 -- 172.21.15.50:0/3328242203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c00061a0 msgr2=0x7f68c0006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 --2- 172.21.15.50:0/3328242203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68c00061a0 0x7f68c0006a80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009b70 tx=0x7f68c0007ab0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2200700 1 -- 172.21.15.50:0/3328242203 reap_dead start 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 -- 172.21.15.50:0/3328242203 shutdown_connections 2024-09-13T15:09:58.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 -- 172.21.15.50:0/3328242203 >> 172.21.15.50:0/3328242203 conn(0x7f68dc06a390 msgr2=0x7f68dc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:58.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 -- 172.21.15.50:0/3328242203 shutdown_connections 2024-09-13T15:09:58.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 -- 172.21.15.50:0/3328242203 wait complete. 2024-09-13T15:09:58.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.486+0000 7f68e2c00700 1 Processor -- start 2024-09-13T15:09:58.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 -- start start 2024-09-13T15:09:58.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc14a520 0x7f68dc14af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 0x7f68dc06c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68dc14a900 0x7f68dc06cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0acd20 con 0x7f68dc0ac890 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0ad000 con 0x7f68dc14a900 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0ad2e0 con 0x7f68dc14a520 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 0x7f68dc06c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 0x7f68dc06c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56116/0 (socket says 172.21.15.50:56116) 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 -- 172.21.15.50:0/1877128814 learned_addr learned my addr 172.21.15.50:0/1877128814 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:58.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e1800700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc14a520 0x7f68dc14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2200700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68dc14a900 0x7f68dc06cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 -- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc14a520 msgr2=0x7f68dc14af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc14a520 0x7f68dc14af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 -- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68dc14a900 msgr2=0x7f68dc06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68dc14a900 0x7f68dc06cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 -- 172.21.15.50:0/1877128814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0ad5c0 con 0x7f68dc0ac890 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2200700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68dc14a900 0x7f68dc06cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e0e00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 0x7f68dc06c750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f68c8016000 tx=0x7f68c80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800e6c0 con 0x7f68dc0ac890 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c80038e0 con 0x7f68dc0ac890 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc0acd20 con 0x7f68dc0ac890 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8009ee0 con 0x7f68dc0ac890 2024-09-13T15:09:58.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.490+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc14b660 con 0x7f68dc0ac890 2024-09-13T15:09:58.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.494+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc0ad7e0 con 0x7f68dc0ac890 2024-09-13T15:09:58.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.494+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68c8003c90 con 0x7f68dc0ac890 2024-09-13T15:09:58.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.498+0000 7f68d9600700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f68bc066730 0x7f68bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.498+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f68c80856e0 con 0x7f68dc0ac890 2024-09-13T15:09:58.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.498+0000 7f68e1800700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f68bc066730 0x7f68bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.498+0000 7f68e1800700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f68bc066730 0x7f68bc068bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f68cc002230 tx=0x7f68cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.502+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68c8052900 con 0x7f68dc0ac890 2024-09-13T15:09:58.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.682+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68dc06dde0 con 0x7f68dc0ac890 2024-09-13T15:09:58.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.682+0000 7f68d9600700 1 -- 172.21.15.50:0/1877128814 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68c8055f20 con 0x7f68dc0ac890 2024-09-13T15:09:58.689 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:09:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f68bc066730 msgr2=0x7f68bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f68bc066730 0x7f68bc068bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f68cc002230 tx=0x7f68cc009040 comp rx=0 tx=0).stop 2024-09-13T15:09:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 msgr2=0x7f68dc06c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 0x7f68dc06c750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f68c8016000 tx=0x7f68c80047e0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 shutdown_connections 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f68bc066730 0x7f68bc068bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68dc14a900 0x7f68dc06cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68dc0ac890 0x7f68dc06c750 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 --2- 172.21.15.50:0/1877128814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f68dc14a520 0x7f68dc14af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 >> 172.21.15.50:0/1877128814 conn(0x7f68dc06a390 msgr2=0x7f68dc0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 shutdown_connections 2024-09-13T15:09:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.686+0000 7f68e2c00700 1 -- 172.21.15.50:0/1877128814 wait complete. 2024-09-13T15:09:58.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:09:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.902+0000 7f3079600700 1 Processor -- start 2024-09-13T15:09:58.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.902+0000 7f3079600700 1 -- start start 2024-09-13T15:09:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3079600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3074160d30 0x7f307406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3079600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30740b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3079600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740b0020 con 0x7f307406d150 2024-09-13T15:09:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3079600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740d1770 con 0x7f3074160d30 2024-09-13T15:09:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3079600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30740d03f0 con 0x7f307406b340 2024-09-13T15:09:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3074160d30 0x7f307406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3074160d30 0x7f307406cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56122/0 (socket says 172.21.15.50:56122) 2024-09-13T15:09:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f307406d150 0x7f307406ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37022/0 (socket says 172.21.15.50:37022) 2024-09-13T15:09:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 -- 172.21.15.50:0/3847895939 learned_addr learned my addr 172.21.15.50:0/3847895939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3078c00700 1 --2- 172.21.15.50:0/3847895939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30740b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3072a00700 1 -- 172.21.15.50:0/3847895939 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150006211 0 0) 0x7f30740b0020 con 0x7f307406d150 2024-09-13T15:09:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 -- 172.21.15.50:0/3847895939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 msgr2=0x7f30740b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 --2- 172.21.15.50:0/3847895939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30740b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 -- 172.21.15.50:0/3847895939 >> v1:172.21.15.50:6789/0 conn(0x7f307406d150 legacy=0x7f307406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.906+0000 7f3073e00700 1 -- 172.21.15.50:0/3847895939 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30740d06d0 con 0x7f3074160d30 2024-09-13T15:09:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3073e00700 1 --2- 172.21.15.50:0/3847895939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f307406cc10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3064009910 tx=0x7f3064009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f7793ef097a6d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3072a00700 1 -- 172.21.15.50:0/3847895939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064011830 con 0x7f3074160d30 2024-09-13T15:09:58.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3072a00700 1 -- 172.21.15.50:0/3847895939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064011990 con 0x7f3074160d30 2024-09-13T15:09:58.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3072a00700 1 -- 172.21.15.50:0/3847895939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064011d40 con 0x7f3074160d30 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 -- 172.21.15.50:0/3847895939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 msgr2=0x7f307406cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 --2- 172.21.15.50:0/3847895939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f307406cc10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3064009910 tx=0x7f3064009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 -- 172.21.15.50:0/3847895939 shutdown_connections 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 --2- 172.21.15.50:0/3847895939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30740b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 --2- 172.21.15.50:0/3847895939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f307406cc10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 -- 172.21.15.50:0/3847895939 >> 172.21.15.50:0/3847895939 conn(0x7f3074071d20 msgr2=0x7f3074072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 -- 172.21.15.50:0/3847895939 shutdown_connections 2024-09-13T15:09:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.910+0000 7f3079600700 1 -- 172.21.15.50:0/3847895939 wait complete. 2024-09-13T15:09:58.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 Processor -- start 2024-09-13T15:09:58.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 -- start start 2024-09-13T15:09:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30741f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f307406d150 0x7f307415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f3074158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30741f77b0 con 0x7f3074160d30 2024-09-13T15:09:58.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307415a7c0 con 0x7f307406d150 2024-09-13T15:09:58.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3079600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307415a9d0 con 0x7f307406b340 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f3074158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f3074158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56134/0 (socket says 172.21.15.50:56134) 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 -- 172.21.15.50:0/1061370087 learned_addr learned my addr 172.21.15.50:0/1061370087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3073e00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30741f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3073400700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f307406d150 0x7f307415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 -- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 msgr2=0x7f30741f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30741f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 -- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f307406d150 msgr2=0x7f307415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f307406d150 0x7f307415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3078c00700 1 -- 172.21.15.50:0/1061370087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064009570 con 0x7f3074160d30 2024-09-13T15:09:58.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3073e00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30741f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:58.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.914+0000 7f3073400700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f307406d150 0x7f307415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:58.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f3078c00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f3074158ef0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f306c00ef90 tx=0x7f306c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c009b20 con 0x7f3074160d30 2024-09-13T15:09:58.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00f040 con 0x7f3074160d30 2024-09-13T15:09:58.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307415acb0 con 0x7f3074160d30 2024-09-13T15:09:58.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c009e50 con 0x7f3074160d30 2024-09-13T15:09:58.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307415b270 con 0x7f3074160d30 2024-09-13T15:09:58.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.918+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3074161110 con 0x7f3074160d30 2024-09-13T15:09:58.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.922+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f306c014480 con 0x7f3074160d30 2024-09-13T15:09:58.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.922+0000 7f306be00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3054066730 0x7f3054068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:58.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.922+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f306c084e70 con 0x7f3074160d30 2024-09-13T15:09:58.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.926+0000 7f3073e00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3054066730 0x7f3054068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:58.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.926+0000 7f3073e00700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3054066730 0x7f3054068bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3064000c00 tx=0x7f3064008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:58.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:58.930+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f306c0520b0 con 0x7f3074160d30 2024-09-13T15:09:59.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.110+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f307406bf10 con 0x7f3074160d30 2024-09-13T15:09:59.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f306be00700 1 -- 172.21.15.50:0/1061370087 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f306c018070 con 0x7f3074160d30 2024-09-13T15:09:59.118 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3054066730 msgr2=0x7f3054068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3054066730 0x7f3054068bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3064000c00 tx=0x7f3064008030 comp rx=0 tx=0).stop 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 msgr2=0x7f3074158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f3074158ef0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f306c00ef90 tx=0x7f306c00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 shutdown_connections 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3054066730 0x7f3054068bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3074160d30 0x7f3074158ef0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f307406d150 0x7f307415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 --2- 172.21.15.50:0/1061370087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f307406b340 0x7f30741f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 >> 172.21.15.50:0/1061370087 conn(0x7f3074071d20 msgr2=0x7f30741618a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 shutdown_connections 2024-09-13T15:09:59.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.114+0000 7f3079600700 1 -- 172.21.15.50:0/1061370087 wait complete. 2024-09-13T15:09:59.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:09:59.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.322+0000 7f813ae00700 1 Processor -- start 2024-09-13T15:09:59.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.322+0000 7f813ae00700 1 -- start start 2024-09-13T15:09:59.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f813ae00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f813406d680 0x7f8134073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f813ae00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8134072510 0x7f813406da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f813ae00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813415c2a0 con 0x7f81340cac10 2024-09-13T15:09:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f813ae00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8134073db0 con 0x7f8134072510 2024-09-13T15:09:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f813ae00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813406dfa0 con 0x7f813406d680 2024-09-13T15:09:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8134072510 0x7f813406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8134072510 0x7f813406da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56138/0 (socket says 172.21.15.50:56138) 2024-09-13T15:09:59.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 -- 172.21.15.50:0/1134426044 learned_addr learned my addr 172.21.15.50:0/1134426044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:59.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 -- 172.21.15.50:0/1134426044 >> v2:172.21.15.181:3300/0 conn(0x7f813406d680 msgr2=0x7f8134073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:59.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133e00700 1 --2- 172.21.15.50:0/1134426044 >> v2:172.21.15.181:3300/0 conn(0x7f813406d680 0x7f8134073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 --2- 172.21.15.50:0/1134426044 >> v2:172.21.15.181:3300/0 conn(0x7f813406d680 0x7f8134073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 -- 172.21.15.50:0/1134426044 >> v1:172.21.15.181:6789/0 conn(0x7f81340cac10 legacy=0x7f813415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:59.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133400700 1 -- 172.21.15.50:0/1134426044 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813415b690 con 0x7f8134072510 2024-09-13T15:09:59.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.326+0000 7f8133e00700 1 --2- 172.21.15.50:0/1134426044 >> v2:172.21.15.181:3300/0 conn(0x7f813406d680 0x7f8134073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f8133400700 1 --2- 172.21.15.50:0/1134426044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8134072510 0x7f813406da60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f81340cccc0 tx=0x7f8120009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b28dbb7a27a76c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f8132a00700 1 -- 172.21.15.50:0/1134426044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120004230 con 0x7f8134072510 2024-09-13T15:09:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f8132a00700 1 -- 172.21.15.50:0/1134426044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120004390 con 0x7f8134072510 2024-09-13T15:09:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f8132a00700 1 -- 172.21.15.50:0/1134426044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200036c0 con 0x7f8134072510 2024-09-13T15:09:59.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 -- 172.21.15.50:0/1134426044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8134072510 msgr2=0x7f813406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 --2- 172.21.15.50:0/1134426044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8134072510 0x7f813406da60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f81340cccc0 tx=0x7f8120009bf0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 -- 172.21.15.50:0/1134426044 shutdown_connections 2024-09-13T15:09:59.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 --2- 172.21.15.50:0/1134426044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8134072510 0x7f813406da60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 --2- 172.21.15.50:0/1134426044 >> v2:172.21.15.181:3300/0 conn(0x7f813406d680 0x7f8134073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 -- 172.21.15.50:0/1134426044 >> 172.21.15.50:0/1134426044 conn(0x7f81340718f0 msgr2=0x7f8134071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:59.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 -- 172.21.15.50:0/1134426044 shutdown_connections 2024-09-13T15:09:59.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.330+0000 7f813ae00700 1 -- 172.21.15.50:0/1134426044 wait complete. 2024-09-13T15:09:59.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 Processor -- start 2024-09-13T15:09:59.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 -- start start 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 0x7f81340b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8134072510 0x7f81340b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81340cac10 0x7f81341f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b1970 con 0x7f813406d680 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b0d60 con 0x7f81340cac10 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f813ae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b1040 con 0x7f8134072510 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 0x7f81340b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 0x7f81340b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56140/0 (socket says 172.21.15.50:56140) 2024-09-13T15:09:59.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 -- 172.21.15.50:0/2038874680 learned_addr learned my addr 172.21.15.50:0/2038874680 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8138e00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81340cac10 0x7f81341f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133400700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8134072510 0x7f81340b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 -- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8134072510 msgr2=0x7f81340b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8134072510 0x7f81340b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 -- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81340cac10 msgr2=0x7f81341f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81340cac10 0x7f81341f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.334+0000 7f8133e00700 1 -- 172.21.15.50:0/2038874680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009570 con 0x7f813406d680 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f8133e00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 0x7f81340b22a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f812400c770 tx=0x7f812400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011800 con 0x7f813406d680 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124011960 con 0x7f813406d680 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011d10 con 0x7f813406d680 2024-09-13T15:09:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81340b1320 con 0x7f813406d680 2024-09-13T15:09:59.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81340b27e0 con 0x7f813406d680 2024-09-13T15:09:59.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.338+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81340b29d0 con 0x7f813406d680 2024-09-13T15:09:59.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.342+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8124018360 con 0x7f813406d680 2024-09-13T15:09:59.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.342+0000 7f812be00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8114066730 0x7f8114068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.342+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8124084300 con 0x7f813406d680 2024-09-13T15:09:59.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.342+0000 7f8133400700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8114066730 0x7f8114068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.346+0000 7f8133400700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8114066730 0x7f8114068bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f81340cccc0 tx=0x7f8120008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.350+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81240514a0 con 0x7f813406d680 2024-09-13T15:09:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.546+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f813415d1c0 con 0x7f813406d680 2024-09-13T15:09:59.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.546+0000 7f812be00700 1 -- 172.21.15.50:0/2038874680 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8124054ac0 con 0x7f813406d680 2024-09-13T15:09:59.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8114066730 msgr2=0x7f8114068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8114066730 0x7f8114068bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f81340cccc0 tx=0x7f8120008030 comp rx=0 tx=0).stop 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 msgr2=0x7f81340b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 0x7f81340b22a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f812400c770 tx=0x7f812400ca80 comp rx=0 tx=0).stop 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 shutdown_connections 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8114066730 0x7f8114068bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81340cac10 0x7f81341f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8134072510 0x7f81340b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 --2- 172.21.15.50:0/2038874680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813406d680 0x7f81340b22a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 >> 172.21.15.50:0/2038874680 conn(0x7f81340718f0 msgr2=0x7f81340cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 shutdown_connections 2024-09-13T15:09:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.550+0000 7f813ae00700 1 -- 172.21.15.50:0/2038874680 wait complete. 2024-09-13T15:09:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:09:59.579 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:09:59.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:59.579 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:09:59.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:09:59.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:09:59.622 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:09:59.680 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:09:59.680 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:59.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:09:59.700 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:09:59.700 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:09:59.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:09:59.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.930+0000 7f7482200700 1 Processor -- start 2024-09-13T15:09:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.930+0000 7f7482200700 1 -- start start 2024-09-13T15:09:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7482200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 0x7f747c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7482200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f747c06aaa0 0x7f747c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7482200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0b3560 con 0x7f747c0b2670 2024-09-13T15:09:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7482200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c070b30 con 0x7f747c06aaa0 2024-09-13T15:09:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7482200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c06b420 con 0x7f747c1610b0 2024-09-13T15:09:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 0x7f747c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 0x7f747c0719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:50810/0 (socket says 172.21.15.50:50810) 2024-09-13T15:09:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 -- 172.21.15.50:0/2545565425 learned_addr learned my addr 172.21.15.50:0/2545565425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7481800700 1 --1- 172.21.15.50:0/2545565425 >> v1:172.21.15.181:6789/0 conn(0x7f747c0b2670 0x7f747c0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:46566/0 (socket says 172.21.15.50:46566) 2024-09-13T15:09:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f747be00700 1 --2- 172.21.15.50:0/2545565425 >> v2:172.21.15.181:3300/0 conn(0x7f747c06aaa0 0x7f747c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 -- 172.21.15.50:0/2545565425 >> v2:172.21.15.181:3300/0 conn(0x7f747c06aaa0 msgr2=0x7f747c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 --2- 172.21.15.50:0/2545565425 >> v2:172.21.15.181:3300/0 conn(0x7f747c06aaa0 0x7f747c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 -- 172.21.15.50:0/2545565425 >> v1:172.21.15.181:6789/0 conn(0x7f747c0b2670 legacy=0x7f747c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f7480e00700 1 -- 172.21.15.50:0/2545565425 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0b3280 con 0x7f747c1610b0 2024-09-13T15:09:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.934+0000 7f747be00700 1 --2- 172.21.15.50:0/2545565425 >> v2:172.21.15.181:3300/0 conn(0x7f747c06aaa0 0x7f747c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7480e00700 1 --2- 172.21.15.50:0/2545565425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 0x7f747c0719c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7470009910 tx=0x7f7470009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffdd67f2424a86b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f747b400700 1 -- 172.21.15.50:0/2545565425 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470011830 con 0x7f747c1610b0 2024-09-13T15:09:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f747b400700 1 -- 172.21.15.50:0/2545565425 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7470011990 con 0x7f747c1610b0 2024-09-13T15:09:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f747b400700 1 -- 172.21.15.50:0/2545565425 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470011d40 con 0x7f747c1610b0 2024-09-13T15:09:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 -- 172.21.15.50:0/2545565425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 msgr2=0x7f747c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 --2- 172.21.15.50:0/2545565425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 0x7f747c0719c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7470009910 tx=0x7f7470009c20 comp rx=0 tx=0).stop 2024-09-13T15:09:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 -- 172.21.15.50:0/2545565425 shutdown_connections 2024-09-13T15:09:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 --2- 172.21.15.50:0/2545565425 >> v2:172.21.15.181:3300/0 conn(0x7f747c06aaa0 0x7f747c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 --2- 172.21.15.50:0/2545565425 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c1610b0 0x7f747c0719c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 -- 172.21.15.50:0/2545565425 >> 172.21.15.50:0/2545565425 conn(0x7f747c0b0c40 msgr2=0x7f747c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 -- 172.21.15.50:0/2545565425 shutdown_connections 2024-09-13T15:09:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.938+0000 7f7482200700 1 -- 172.21.15.50:0/2545565425 wait complete. 2024-09-13T15:09:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 Processor -- start 2024-09-13T15:09:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 -- start start 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c06aaa0 0x7f747c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747c0b2670 0x7f747c1f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 0x7f747c15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c159bf0 con 0x7f747c1610b0 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c159020 con 0x7f747c0b2670 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7482200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1592c0 con 0x7f747c06aaa0 2024-09-13T15:09:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7481800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 0x7f747c15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7481800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 0x7f747c15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56156/0 (socket says 172.21.15.50:56156) 2024-09-13T15:09:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7481800700 1 -- 172.21.15.50:0/1699909103 learned_addr learned my addr 172.21.15.50:0/1699909103 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:09:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f7480e00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c06aaa0 0x7f747c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.942+0000 7f747be00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747c0b2670 0x7f747c1f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7480e00700 1 -- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747c0b2670 msgr2=0x7f747c1f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7480e00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747c0b2670 0x7f747c1f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7480e00700 1 -- 172.21.15.50:0/1699909103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 msgr2=0x7f747c15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7480e00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 0x7f747c15a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7480e00700 1 -- 172.21.15.50:0/1699909103 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680094b0 con 0x7f747c06aaa0 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7481800700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 0x7f747c15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7480e00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c06aaa0 0x7f747c157550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7470016000 tx=0x7f7470004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470004310 con 0x7f747c06aaa0 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747001f070 con 0x7f747c06aaa0 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74700036c0 con 0x7f747c06aaa0 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470009570 con 0x7f747c06aaa0 2024-09-13T15:09:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.946+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c159880 con 0x7f747c06aaa0 2024-09-13T15:09:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.950+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0adf30 con 0x7f747c06aaa0 2024-09-13T15:09:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.950+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7470021030 con 0x7f747c06aaa0 2024-09-13T15:09:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.954+0000 7f7478c00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f745c066760 0x7f745c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.954+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7470085b50 con 0x7f747c06aaa0 2024-09-13T15:09:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.954+0000 7f747be00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f745c066760 0x7f745c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.954+0000 7f747be00700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f745c066760 0x7f745c068c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f747c0cdcc0 tx=0x7f7468009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:09:59.958+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7470052f10 con 0x7f747c06aaa0 2024-09-13T15:10:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.202+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f747c159400 con 0x7f747c06aaa0 2024-09-13T15:10:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.202+0000 7f7478c00700 1 -- 172.21.15.50:0/1699909103 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f747c159400 con 0x7f747c06aaa0 2024-09-13T15:10:00.209 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:00.209 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:45.665636+0000","modified":"2024-09-13T15:09:48.684241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/442961988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":442961988},{"type":"v1","addr":"172.21.15.50:6835","nonce":442961988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T15:10:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.206+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f745c066760 msgr2=0x7f745c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.206+0000 7f7482200700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f745c066760 0x7f745c068c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f747c0cdcc0 tx=0x7f7468009240 comp rx=0 tx=0).stop 2024-09-13T15:10:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.206+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c06aaa0 msgr2=0x7f747c157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.206+0000 7f7482200700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c06aaa0 0x7f747c157550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7470016000 tx=0x7f7470004770 comp rx=0 tx=0).stop 2024-09-13T15:10:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 shutdown_connections 2024-09-13T15:10:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f745c066760 0x7f745c068c20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f747c1610b0 0x7f747c15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747c0b2670 0x7f747c1f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 --2- 172.21.15.50:0/1699909103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f747c06aaa0 0x7f747c157550 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 >> 172.21.15.50:0/1699909103 conn(0x7f747c0b0c40 msgr2=0x7f747c15f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 shutdown_connections 2024-09-13T15:10:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.210+0000 7f7482200700 1 -- 172.21.15.50:0/1699909103 wait complete. 2024-09-13T15:10:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-13T15:10:00.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.410+0000 7faca6800700 1 Processor -- start 2024-09-13T15:10:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.410+0000 7faca6800700 1 -- start start 2024-09-13T15:10:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca6800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faca00cb020 0x7faca00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 0x7faca006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca6800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca006b430 con 0x7faca015c2a0 2024-09-13T15:10:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca6800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca00b2ad0 con 0x7faca00cb020 2024-09-13T15:10:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca015b960 con 0x7faca006aaa0 2024-09-13T15:10:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 0x7faca006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 0x7faca006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:50820/0 (socket says 172.21.15.50:50820) 2024-09-13T15:10:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca4a00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7faca015c2a0 0x7faca015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:46578/0 (socket says 172.21.15.50:46578) 2024-09-13T15:10:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5e00700 1 -- 172.21.15.50:0/1304812236 learned_addr learned my addr 172.21.15.50:0/1304812236 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5400700 1 --2- 172.21.15.50:0/1304812236 >> v2:172.21.15.181:3300/0 conn(0x7faca00cb020 0x7faca00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7fac9fe00700 1 -- 172.21.15.50:0/1304812236 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530903 0 0) 0x7fac8c001110 con 0x7faca015c2a0 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7fac9fe00700 1 -- 172.21.15.50:0/1304812236 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac880035d0 con 0x7faca015c2a0 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5400700 1 -- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 msgr2=0x7faca006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5400700 1 --2- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 0x7faca006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5400700 1 -- 172.21.15.50:0/1304812236 >> v1:172.21.15.181:6789/0 conn(0x7faca015c2a0 legacy=0x7faca015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5400700 1 -- 172.21.15.50:0/1304812236 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca015bc40 con 0x7faca00cb020 2024-09-13T15:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5e00700 1 --2- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 0x7faca006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.414+0000 7faca5400700 1 --2- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca00cc6f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac94009d90 tx=0x7fac9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef3c7d671babbc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7fac9fe00700 1 -- 172.21.15.50:0/1304812236 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400e070 con 0x7faca00cb020 2024-09-13T15:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7fac9fe00700 1 -- 172.21.15.50:0/1304812236 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400bb20 con 0x7faca00cb020 2024-09-13T15:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7fac9fe00700 1 -- 172.21.15.50:0/1304812236 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94012430 con 0x7faca00cb020 2024-09-13T15:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 -- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 msgr2=0x7faca00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 --2- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca00cc6f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac94009d90 tx=0x7fac9400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 -- 172.21.15.50:0/1304812236 shutdown_connections 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 --2- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca006aaa0 0x7faca006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 --2- 172.21.15.50:0/1304812236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca00cc6f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 -- 172.21.15.50:0/1304812236 >> 172.21.15.50:0/1304812236 conn(0x7faca00b0c40 msgr2=0x7faca006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 -- 172.21.15.50:0/1304812236 shutdown_connections 2024-09-13T15:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.418+0000 7faca6800700 1 -- 172.21.15.50:0/1304812236 wait complete. 2024-09-13T15:10:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 Processor -- start 2024-09-13T15:10:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 -- start start 2024-09-13T15:10:00.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 0x7faca01f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca015c2a0 0x7faca01f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca00c7d20 con 0x7faca006aaa0 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca014f290 con 0x7faca00cb020 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca6800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca01f2c90 con 0x7faca015c2a0 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 0x7faca01f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 0x7faca01f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56170/0 (socket says 172.21.15.50:56170) 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 -- 172.21.15.50:0/3687258768 learned_addr learned my addr 172.21.15.50:0/3687258768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca4a00700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5e00700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca015c2a0 0x7faca01f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 -- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca015c2a0 msgr2=0x7faca01f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca015c2a0 0x7faca01f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 -- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 msgr2=0x7faca014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5400700 1 -- 172.21.15.50:0/3687258768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98009570 con 0x7faca006aaa0 2024-09-13T15:10:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.422+0000 7faca5e00700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca015c2a0 0x7faca01f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7faca5400700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 0x7faca01f2670 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faca00b1690 tx=0x7fac94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94004800 con 0x7faca006aaa0 2024-09-13T15:10:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac94020070 con 0x7faca006aaa0 2024-09-13T15:10:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940276c0 con 0x7faca006aaa0 2024-09-13T15:10:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac94009a70 con 0x7faca006aaa0 2024-09-13T15:10:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca01f3250 con 0x7faca006aaa0 2024-09-13T15:10:00.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.426+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca006aef0 con 0x7faca006aaa0 2024-09-13T15:10:00.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.430+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac94027820 con 0x7faca006aaa0 2024-09-13T15:10:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.430+0000 7fac9d600700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac80066730 0x7fac80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.430+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fac94022070 con 0x7faca006aaa0 2024-09-13T15:10:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.430+0000 7faca4a00700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac80066730 0x7fac80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.430+0000 7faca4a00700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac80066730 0x7fac80068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fac8c007fd0 tx=0x7fac8c000bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.438+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac940b7db0 con 0x7faca006aaa0 2024-09-13T15:10:00.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.630+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faca00b3b70 con 0x7faca006aaa0 2024-09-13T15:10:00.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.630+0000 7fac9d600700 1 -- 172.21.15.50:0/3687258768 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fac94053390 con 0x7faca006aaa0 2024-09-13T15:10:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:00.638 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:46.669735+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:00.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac80066730 msgr2=0x7fac80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac80066730 0x7fac80068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fac8c007fd0 tx=0x7fac8c000bc0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 msgr2=0x7faca01f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 0x7faca01f2670 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faca00b1690 tx=0x7fac94004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 shutdown_connections 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac80066730 0x7fac80068bf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faca015c2a0 0x7faca01f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca00cb020 0x7faca014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 --2- 172.21.15.50:0/3687258768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faca006aaa0 0x7faca01f2670 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.634+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 >> 172.21.15.50:0/3687258768 conn(0x7faca00b0c40 msgr2=0x7faca015da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:00.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.638+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 shutdown_connections 2024-09-13T15:10:00.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.638+0000 7faca6800700 1 -- 172.21.15.50:0/3687258768 wait complete. 2024-09-13T15:10:00.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:09:43.873444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:09:44.686028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:00.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:00.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.838+0000 7f1623400700 1 Processor -- start 2024-09-13T15:10:00.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1623400700 1 -- start start 2024-09-13T15:10:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1623400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f161c144330 0x7f161c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1623400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c144710 0x7f161c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1623400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c06bcf0 con 0x7f161c06d760 2024-09-13T15:10:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1623400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c0cce10 con 0x7f161c144330 2024-09-13T15:10:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1623400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c06cb50 con 0x7f161c144710 2024-09-13T15:10:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f161be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f161c06d760 0x7f161c0b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37032/0 (socket says 172.21.15.50:37032) 2024-09-13T15:10:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f161be00700 1 -- 172.21.15.50:0/2330021759 learned_addr learned my addr 172.21.15.50:0/2330021759 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1621400700 1 --2- 172.21.15.50:0/2330021759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c144710 0x7f161c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.842+0000 7f1620a00700 1 --2- 172.21.15.50:0/2330021759 >> v2:172.21.15.181:3300/0 conn(0x7f161c144330 0x7f161c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1621400700 1 -- 172.21.15.50:0/2330021759 >> v2:172.21.15.181:3300/0 conn(0x7f161c144330 msgr2=0x7f161c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:00.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1621400700 1 --2- 172.21.15.50:0/2330021759 >> v2:172.21.15.181:3300/0 conn(0x7f161c144330 0x7f161c0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1621400700 1 -- 172.21.15.50:0/2330021759 >> v1:172.21.15.50:6789/0 conn(0x7f161c06d760 legacy=0x7f161c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f161b400700 1 -- 172.21.15.50:0/2330021759 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921885009 0 0) 0x7f161c06bcf0 con 0x7f161c06d760 2024-09-13T15:10:00.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1621400700 1 -- 172.21.15.50:0/2330021759 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0cf4b0 con 0x7f161c144710 2024-09-13T15:10:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1621400700 1 --2- 172.21.15.50:0/2330021759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c144710 0x7f161c0b1b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1614009d90 tx=0x7f161400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8582bed07f743b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f161b400700 1 -- 172.21.15.50:0/2330021759 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400e070 con 0x7f161c144710 2024-09-13T15:10:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f161b400700 1 -- 172.21.15.50:0/2330021759 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400bb20 con 0x7f161c144710 2024-09-13T15:10:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f161b400700 1 -- 172.21.15.50:0/2330021759 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614012430 con 0x7f161c144710 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 -- 172.21.15.50:0/2330021759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c144710 msgr2=0x7f161c0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 --2- 172.21.15.50:0/2330021759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c144710 0x7f161c0b1b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1614009d90 tx=0x7f161400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 -- 172.21.15.50:0/2330021759 shutdown_connections 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 --2- 172.21.15.50:0/2330021759 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c144710 0x7f161c0b1b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 --2- 172.21.15.50:0/2330021759 >> v2:172.21.15.181:3300/0 conn(0x7f161c144330 0x7f161c0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 -- 172.21.15.50:0/2330021759 >> 172.21.15.50:0/2330021759 conn(0x7f161c06a570 msgr2=0x7f161c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 -- 172.21.15.50:0/2330021759 shutdown_connections 2024-09-13T15:10:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.846+0000 7f1623400700 1 -- 172.21.15.50:0/2330021759 wait complete. 2024-09-13T15:10:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 Processor -- start 2024-09-13T15:10:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 -- start start 2024-09-13T15:10:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 0x7f161c13b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f161c144330 0x7f161c1f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c159ae0 0x7f161c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c15a4d0 con 0x7f161c06d760 2024-09-13T15:10:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c13ba60 con 0x7f161c144330 2024-09-13T15:10:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1623400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c13f5d0 con 0x7f161c159ae0 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.850+0000 7f1620a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 0x7f161c13b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 0x7f161c13b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56186/0 (socket says 172.21.15.50:56186) 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 -- 172.21.15.50:0/3048186435 learned_addr learned my addr 172.21.15.50:0/3048186435 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f161be00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f161c144330 0x7f161c1f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1621400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c159ae0 0x7f161c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 -- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c159ae0 msgr2=0x7f161c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c159ae0 0x7f161c159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 -- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f161c144330 msgr2=0x7f161c1f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f161c144330 0x7f161c1f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 -- 172.21.15.50:0/3048186435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009a70 con 0x7f161c06d760 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1620a00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 0x7f161c13b520 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f161000e9d0 tx=0x7f161000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610009720 con 0x7f161c06d760 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000ee70 con 0x7f161c06d760 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c13f8b0 con 0x7f161c06d760 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000ca50 con 0x7f161c06d760 2024-09-13T15:10:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c070440 con 0x7f161c06d760 2024-09-13T15:10:00.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.854+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c06c7a0 con 0x7f161c06d760 2024-09-13T15:10:00.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.858+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f161000cbb0 con 0x7f161c06d760 2024-09-13T15:10:00.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.862+0000 7f1618c00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15fc066730 0x7f15fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.862+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1610084390 con 0x7f161c06d760 2024-09-13T15:10:00.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.862+0000 7f161be00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15fc066730 0x7f15fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.862+0000 7f161be00700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15fc066730 0x7f15fc068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f161c06aec0 tx=0x7f1608007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:00.866+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1610051520 con 0x7f161c06d760 2024-09-13T15:10:01.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.046+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f161c143a40 con 0x7f161c06d760 2024-09-13T15:10:01.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.050+0000 7f1618c00700 1 -- 172.21.15.50:0/3048186435 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f161000ce60 con 0x7f161c06d760 2024-09-13T15:10:01.055 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15fc066730 msgr2=0x7f15fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15fc066730 0x7f15fc068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f161c06aec0 tx=0x7f1608007e00 comp rx=0 tx=0).stop 2024-09-13T15:10:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 msgr2=0x7f161c13b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 0x7f161c13b520 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f161000e9d0 tx=0x7f161000ece0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 shutdown_connections 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15fc066730 0x7f15fc068bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f161c159ae0 0x7f161c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f161c144330 0x7f161c1f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 --2- 172.21.15.50:0/3048186435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f161c06d760 0x7f161c13b520 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 >> 172.21.15.50:0/3048186435 conn(0x7f161c06a570 msgr2=0x7f161c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 shutdown_connections 2024-09-13T15:10:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.054+0000 7f1623400700 1 -- 172.21.15.50:0/3048186435 wait complete. 2024-09-13T15:10:01.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:10:01.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.262+0000 7f56b7200700 1 Processor -- start 2024-09-13T15:10:01.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.262+0000 7f56b7200700 1 -- start start 2024-09-13T15:10:01.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.262+0000 7f56b7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b806cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b7200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b80b0020 con 0x7f56b806b340 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b7200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b80d1770 con 0x7f56b806d150 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80d03f0 con 0x7f56b8160d30 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f56b806d150 0x7f56b806ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:46586/0 (socket says 172.21.15.50:46586) 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b6800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f56b806b340 0x7f56b80b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37034/0 (socket says 172.21.15.50:37034) 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5400700 1 -- 172.21.15.50:0/3759117133 learned_addr learned my addr 172.21.15.50:0/3759117133 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:01.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5e00700 1 --2- 172.21.15.50:0/3759117133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b806cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967107322 0 0) 0x7f56b80d1770 con 0x7f56b806d150 2024-09-13T15:10:01.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f569c0035d0 con 0x7f56b806d150 2024-09-13T15:10:01.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782604221 0 0) 0x7f56b80b0020 con 0x7f56b806b340 2024-09-13T15:10:01.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b80d1770 con 0x7f56b806b340 2024-09-13T15:10:01.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5e00700 1 -- 172.21.15.50:0/3759117133 >> v1:172.21.15.181:6789/0 conn(0x7f56b806d150 legacy=0x7f56b806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5e00700 1 -- 172.21.15.50:0/3759117133 >> v1:172.21.15.50:6789/0 conn(0x7f56b806b340 legacy=0x7f56b80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5e00700 1 -- 172.21.15.50:0/3759117133 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80d06d0 con 0x7f56b8160d30 2024-09-13T15:10:01.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b5e00700 1 --2- 172.21.15.50:0/3759117133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b806cc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009880 tx=0x7f56a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5fd9dbf4334da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8011830 con 0x7f56b8160d30 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8011990 con 0x7f56b8160d30 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.266+0000 7f56b4a00700 1 -- 172.21.15.50:0/3759117133 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8011d20 con 0x7f56b8160d30 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 -- 172.21.15.50:0/3759117133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 msgr2=0x7f56b806cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 --2- 172.21.15.50:0/3759117133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b806cc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009880 tx=0x7f56a8009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 -- 172.21.15.50:0/3759117133 shutdown_connections 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 --2- 172.21.15.50:0/3759117133 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b806cc10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 -- 172.21.15.50:0/3759117133 >> 172.21.15.50:0/3759117133 conn(0x7f56b8071d20 msgr2=0x7f56b8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 -- 172.21.15.50:0/3759117133 shutdown_connections 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 -- 172.21.15.50:0/3759117133 wait complete. 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 Processor -- start 2024-09-13T15:10:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 -- start start 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.270+0000 7f56b7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b806b340 0x7f56b814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 0x7f56b8159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b814b0c0 con 0x7f56b806d150 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b814b3a0 con 0x7f56b806b340 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b814b680 con 0x7f56b8160d30 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 0x7f56b8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 0x7f56b8159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56190/0 (socket says 172.21.15.50:56190) 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 -- 172.21.15.50:0/2539439381 learned_addr learned my addr 172.21.15.50:0/2539439381 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b6800700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5e00700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b806b340 0x7f56b814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 -- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 msgr2=0x7f56b815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 -- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b806b340 msgr2=0x7f56b814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b806b340 0x7f56b814a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 -- 172.21.15.50:0/2539439381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a80094b0 con 0x7f56b806d150 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b5400700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 0x7f56b8159670 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c4d0 tx=0x7f56a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400cea0 con 0x7f56b806d150 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4005d90 con 0x7f56b806d150 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b814b960 con 0x7f56b806d150 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a40072f0 con 0x7f56b806d150 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b814ad90 con 0x7f56b806d150 2024-09-13T15:10:01.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.274+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8161110 con 0x7f56b806d150 2024-09-13T15:10:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.278+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56a4007450 con 0x7f56b806d150 2024-09-13T15:10:01.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.278+0000 7f56ae000700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5698066730 0x7f5698068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.278+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f56a4083700 con 0x7f56b806d150 2024-09-13T15:10:01.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.282+0000 7f56b5e00700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5698066730 0x7f5698068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.282+0000 7f56b5e00700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5698066730 0x7f5698068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f56a80090b0 tx=0x7f56a801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.286+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56a4050890 con 0x7f56b806d150 2024-09-13T15:10:01.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.470+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56b8163470 con 0x7f56b806d150 2024-09-13T15:10:01.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.470+0000 7f56ae000700 1 -- 172.21.15.50:0/2539439381 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56a4053eb0 con 0x7f56b806d150 2024-09-13T15:10:01.476 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:10:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5698066730 msgr2=0x7f5698068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5698066730 0x7f5698068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f56a80090b0 tx=0x7f56a801c040 comp rx=0 tx=0).stop 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 msgr2=0x7f56b8159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 0x7f56b8159670 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c4d0 tx=0x7f56a400c7e0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 shutdown_connections 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5698066730 0x7f5698068bf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56b8160d30 0x7f56b815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56b806d150 0x7f56b8159670 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 --2- 172.21.15.50:0/2539439381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b806b340 0x7f56b814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 >> 172.21.15.50:0/2539439381 conn(0x7f56b8071d20 msgr2=0x7f56b8161320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 shutdown_connections 2024-09-13T15:10:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.474+0000 7f56b7200700 1 -- 172.21.15.50:0/2539439381 wait complete. 2024-09-13T15:10:01.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:10:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.674+0000 7fd876400700 1 Processor -- start 2024-09-13T15:10:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd876400700 1 -- start start 2024-09-13T15:10:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd876400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd870160d30 0x7fd87006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd876400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8700b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd876400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8700b0020 con 0x7fd87006d150 2024-09-13T15:10:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd876400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8700d1770 con 0x7fd870160d30 2024-09-13T15:10:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd876400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700d03f0 con 0x7fd87006b340 2024-09-13T15:10:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd86fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd87006d150 0x7fd87006ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37040/0 (socket says 172.21.15.50:37040) 2024-09-13T15:10:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd86fe00700 1 -- 172.21.15.50:0/4255558531 learned_addr learned my addr 172.21.15.50:0/4255558531 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd875000700 1 --2- 172.21.15.50:0/4255558531 >> v2:172.21.15.181:3300/0 conn(0x7fd870160d30 0x7fd87006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.678+0000 7fd875a00700 1 --2- 172.21.15.50:0/4255558531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8700b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd86f400700 1 -- 172.21.15.50:0/4255558531 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177324112 0 0) 0x7fd8700b0020 con 0x7fd87006d150 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd875a00700 1 -- 172.21.15.50:0/4255558531 >> v2:172.21.15.181:3300/0 conn(0x7fd870160d30 msgr2=0x7fd87006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd875a00700 1 --2- 172.21.15.50:0/4255558531 >> v2:172.21.15.181:3300/0 conn(0x7fd870160d30 0x7fd87006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd875a00700 1 -- 172.21.15.50:0/4255558531 >> v1:172.21.15.50:6789/0 conn(0x7fd87006d150 legacy=0x7fd87006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd875a00700 1 -- 172.21.15.50:0/4255558531 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700d06d0 con 0x7fd87006b340 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd875000700 1 --2- 172.21.15.50:0/4255558531 >> v2:172.21.15.181:3300/0 conn(0x7fd870160d30 0x7fd87006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd875a00700 1 --2- 172.21.15.50:0/4255558531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8700b3ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd868009d90 tx=0x7fd86800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa793c3bf0e1f067 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd86f400700 1 -- 172.21.15.50:0/4255558531 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800e070 con 0x7fd87006b340 2024-09-13T15:10:01.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd86f400700 1 -- 172.21.15.50:0/4255558531 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800bb20 con 0x7fd87006b340 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd86f400700 1 -- 172.21.15.50:0/4255558531 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868012430 con 0x7fd87006b340 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 -- 172.21.15.50:0/4255558531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 msgr2=0x7fd8700b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 --2- 172.21.15.50:0/4255558531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8700b3ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd868009d90 tx=0x7fd86800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 -- 172.21.15.50:0/4255558531 shutdown_connections 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 --2- 172.21.15.50:0/4255558531 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8700b3ca0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 --2- 172.21.15.50:0/4255558531 >> v2:172.21.15.181:3300/0 conn(0x7fd870160d30 0x7fd87006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 -- 172.21.15.50:0/4255558531 >> 172.21.15.50:0/4255558531 conn(0x7fd870071d20 msgr2=0x7fd870072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 -- 172.21.15.50:0/4255558531 shutdown_connections 2024-09-13T15:10:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.682+0000 7fd876400700 1 -- 172.21.15.50:0/4255558531 wait complete. 2024-09-13T15:10:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.686+0000 7fd876400700 1 Processor -- start 2024-09-13T15:10:01.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.686+0000 7fd876400700 1 -- start start 2024-09-13T15:10:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd876400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8701fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd876400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd87006d150 0x7fd87015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd876400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 0x7fd8700ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd876400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701faa70 con 0x7fd870160d30 2024-09-13T15:10:01.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd876400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701f6940 con 0x7fd87006d150 2024-09-13T15:10:01.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd876400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701f6c20 con 0x7fd87006b340 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 0x7fd8700ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 0x7fd8700ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56196/0 (socket says 172.21.15.50:56196) 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 -- 172.21.15.50:0/3584711422 learned_addr learned my addr 172.21.15.50:0/3584711422 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875000700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8701fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd86fe00700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd87006d150 0x7fd87015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 -- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 msgr2=0x7fd8701fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8701fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 -- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd87006d150 msgr2=0x7fd87015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd87006d150 0x7fd87015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 -- 172.21.15.50:0/3584711422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640094b0 con 0x7fd870160d30 2024-09-13T15:10:01.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd875a00700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 0x7fd8700ae8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd868014040 tx=0x7fd868004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:01.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868004830 con 0x7fd870160d30 2024-09-13T15:10:01.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd868020070 con 0x7fd870160d30 2024-09-13T15:10:01.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.690+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680276c0 con 0x7fd870160d30 2024-09-13T15:10:01.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.694+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd868009a70 con 0x7fd870160d30 2024-09-13T15:10:01.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.694+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8701f71e0 con 0x7fd870160d30 2024-09-13T15:10:01.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.694+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd870161110 con 0x7fd870160d30 2024-09-13T15:10:01.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.694+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd868012430 con 0x7fd870160d30 2024-09-13T15:10:01.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.698+0000 7fd86cc00700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd850066730 0x7fd850068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.698+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd868022070 con 0x7fd870160d30 2024-09-13T15:10:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.698+0000 7fd875000700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd850066730 0x7fd850068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.698+0000 7fd875000700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd850066730 0x7fd850068bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd87015ad50 tx=0x7fd864009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:01.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.702+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd868053130 con 0x7fd870160d30 2024-09-13T15:10:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.882+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd87006ce80 con 0x7fd870160d30 2024-09-13T15:10:01.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.882+0000 7fd86cc00700 1 -- 172.21.15.50:0/3584711422 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd86802c020 con 0x7fd870160d30 2024-09-13T15:10:01.892 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:10:01.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd850066730 msgr2=0x7fd850068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd850066730 0x7fd850068bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd87015ad50 tx=0x7fd864009240 comp rx=0 tx=0).stop 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 msgr2=0x7fd8700ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 0x7fd8700ae8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd868014040 tx=0x7fd868004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 shutdown_connections 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd850066730 0x7fd850068bf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd870160d30 0x7fd8700ae8f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd87006d150 0x7fd87015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 --2- 172.21.15.50:0/3584711422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd87006b340 0x7fd8701fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 >> 172.21.15.50:0/3584711422 conn(0x7fd870071d20 msgr2=0x7fd8700b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 shutdown_connections 2024-09-13T15:10:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:01.886+0000 7fd876400700 1 -- 172.21.15.50:0/3584711422 wait complete. 2024-09-13T15:10:01.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:02.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.090+0000 7fb52d000700 1 Processor -- start 2024-09-13T15:10:02.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.090+0000 7fb52d000700 1 -- start start 2024-09-13T15:10:02.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb52d000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb5280cb700 0x7fb52806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb52d000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb52806afe0 0x7fb5281636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb52d000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5280707d0 con 0x7fb528159bd0 2024-09-13T15:10:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb52d000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52806b470 con 0x7fb52806afe0 2024-09-13T15:10:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb52d000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280720a0 con 0x7fb5280cb700 2024-09-13T15:10:02.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb52806afe0 0x7fb5281636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb52806afe0 0x7fb5281636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56204/0 (socket says 172.21.15.50:56204) 2024-09-13T15:10:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 -- 172.21.15.50:0/4160050335 learned_addr learned my addr 172.21.15.50:0/4160050335 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb51ea00700 1 --2- 172.21.15.50:0/4160050335 >> v2:172.21.15.181:3300/0 conn(0x7fb5280cb700 0x7fb52806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 -- 172.21.15.50:0/4160050335 >> v2:172.21.15.181:3300/0 conn(0x7fb5280cb700 msgr2=0x7fb52806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 --2- 172.21.15.50:0/4160050335 >> v2:172.21.15.181:3300/0 conn(0x7fb5280cb700 0x7fb52806aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 -- 172.21.15.50:0/4160050335 >> v1:172.21.15.50:6789/0 conn(0x7fb528159bd0 legacy=0x7fb528071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 -- 172.21.15.50:0/4160050335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52806fee0 con 0x7fb52806afe0 2024-09-13T15:10:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.094+0000 7fb527e00700 1 --2- 172.21.15.50:0/4160050335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281636b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb5280b34a0 tx=0x7fb52000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd3573e18bf0586 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb526a00700 1 -- 172.21.15.50:0/4160050335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52000e070 con 0x7fb52806afe0 2024-09-13T15:10:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb526a00700 1 -- 172.21.15.50:0/4160050335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52000b8d0 con 0x7fb52806afe0 2024-09-13T15:10:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb526a00700 1 -- 172.21.15.50:0/4160050335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52000bc80 con 0x7fb52806afe0 2024-09-13T15:10:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 -- 172.21.15.50:0/4160050335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 msgr2=0x7fb5281636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 --2- 172.21.15.50:0/4160050335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281636b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb5280b34a0 tx=0x7fb52000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 -- 172.21.15.50:0/4160050335 shutdown_connections 2024-09-13T15:10:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 --2- 172.21.15.50:0/4160050335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281636b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 --2- 172.21.15.50:0/4160050335 >> v2:172.21.15.181:3300/0 conn(0x7fb5280cb700 0x7fb52806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 -- 172.21.15.50:0/4160050335 >> 172.21.15.50:0/4160050335 conn(0x7fb5280b0c40 msgr2=0x7fb52806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 -- 172.21.15.50:0/4160050335 shutdown_connections 2024-09-13T15:10:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.098+0000 7fb52d000700 1 -- 172.21.15.50:0/4160050335 wait complete. 2024-09-13T15:10:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 Processor -- start 2024-09-13T15:10:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 -- start start 2024-09-13T15:10:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb5280cb700 0x7fb5280af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb528159bd0 0x7fb5280af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528148c00 con 0x7fb52806afe0 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280ad0b0 con 0x7fb528159bd0 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.102+0000 7fb52d000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280ac520 con 0x7fb5280cb700 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56216/0 (socket says 172.21.15.50:56216) 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 -- 172.21.15.50:0/4026998689 learned_addr learned my addr 172.21.15.50:0/4026998689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527e00700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb528159bd0 0x7fb5280af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb51ea00700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb5280cb700 0x7fb5280af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 -- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb5280cb700 msgr2=0x7fb5280af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb5280cb700 0x7fb5280af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 -- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb528159bd0 msgr2=0x7fb5280af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb528159bd0 0x7fb5280af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 -- 172.21.15.50:0/4026998689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520009b30 con 0x7fb52806afe0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb527400700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281486c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c410 tx=0x7fb51800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5180052d0 con 0x7fb52806afe0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb518005430 con 0x7fb52806afe0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5180055a0 con 0x7fb52806afe0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5280ab910 con 0x7fb52806afe0 2024-09-13T15:10:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.106+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5280abed0 con 0x7fb52806afe0 2024-09-13T15:10:02.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.110+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52806aaa0 con 0x7fb52806afe0 2024-09-13T15:10:02.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.110+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5180036a0 con 0x7fb52806afe0 2024-09-13T15:10:02.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.110+0000 7fb51fe00700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb504066730 0x7fb504068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.110+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5180834c0 con 0x7fb52806afe0 2024-09-13T15:10:02.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.110+0000 7fb51ea00700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb504066730 0x7fb504068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.114+0000 7fb51ea00700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb504066730 0x7fb504068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb528145ad0 tx=0x7fb510009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.114+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5180505d0 con 0x7fb52806afe0 2024-09-13T15:10:02.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.350+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb52806a710 con 0x7fb52806afe0 2024-09-13T15:10:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.350+0000 7fb51fe00700 1 -- 172.21.15.50:0/4026998689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fb518053bf0 con 0x7fb52806afe0 2024-09-13T15:10:02.356 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:02.356 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:45.665636+0000","modified":"2024-09-13T15:09:48.684241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/442961988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":442961988},{"type":"v1","addr":"172.21.15.50:6835","nonce":442961988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T15:10:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb504066730 msgr2=0x7fb504068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb504066730 0x7fb504068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb528145ad0 tx=0x7fb510009240 comp rx=0 tx=0).stop 2024-09-13T15:10:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 msgr2=0x7fb5281486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281486c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c410 tx=0x7fb51800c720 comp rx=0 tx=0).stop 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 shutdown_connections 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb504066730 0x7fb504068bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb528159bd0 0x7fb5280af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb5280cb700 0x7fb5280af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 --2- 172.21.15.50:0/4026998689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb52806afe0 0x7fb5281486c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 >> 172.21.15.50:0/4026998689 conn(0x7fb5280b0c40 msgr2=0x7fb5281584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 shutdown_connections 2024-09-13T15:10:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.354+0000 7fb52d000700 1 -- 172.21.15.50:0/4026998689 wait complete. 2024-09-13T15:10:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-13T15:10:02.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.550+0000 7f4a29600700 1 Processor -- start 2024-09-13T15:10:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.550+0000 7f4a29600700 1 -- start start 2024-09-13T15:10:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a29600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a240cb020 0x7f4a240cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a29600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4a2415c2a0 0x7f4a2415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a29600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240b2ad0 con 0x7f4a2406aaa0 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a29600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2415b960 con 0x7f4a2415c2a0 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a29600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2415bc40 con 0x7f4a240cb020 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a28c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a2406aaa0 0x7f4a240b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37044/0 (socket says 172.21.15.50:37044) 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a28c00700 1 -- 172.21.15.50:0/4046449932 learned_addr learned my addr 172.21.15.50:0/4046449932 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23e00700 1 --2- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a240cb020 0x7f4a240cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23400700 1 --2- 172.21.15.50:0/4046449932 >> v2:172.21.15.181:3300/0 conn(0x7f4a2415c2a0 0x7f4a2415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a22a00700 1 -- 172.21.15.50:0/4046449932 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780172401 0 0) 0x7f4a240b2ad0 con 0x7f4a2406aaa0 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a22a00700 1 -- 172.21.15.50:0/4046449932 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a080035d0 con 0x7f4a2406aaa0 2024-09-13T15:10:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23400700 1 -- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a240cb020 msgr2=0x7f4a240cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23400700 1 --2- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a240cb020 0x7f4a240cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23400700 1 -- 172.21.15.50:0/4046449932 >> v1:172.21.15.50:6789/0 conn(0x7f4a2406aaa0 legacy=0x7f4a240b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23400700 1 -- 172.21.15.50:0/4046449932 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2415bf20 con 0x7f4a2415c2a0 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a23400700 1 --2- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a2415b0e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009850 tx=0x7f4a10009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df0fb82185fbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a22a00700 1 -- 172.21.15.50:0/4046449932 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011830 con 0x7f4a2415c2a0 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a22a00700 1 -- 172.21.15.50:0/4046449932 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011990 con 0x7f4a2415c2a0 2024-09-13T15:10:02.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.554+0000 7f4a22a00700 1 -- 172.21.15.50:0/4046449932 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011d40 con 0x7f4a2415c2a0 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 -- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 msgr2=0x7f4a2415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 --2- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a2415b0e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009850 tx=0x7f4a10009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 -- 172.21.15.50:0/4046449932 shutdown_connections 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 --2- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a2415b0e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 --2- 172.21.15.50:0/4046449932 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a240cb020 0x7f4a240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 -- 172.21.15.50:0/4046449932 >> 172.21.15.50:0/4046449932 conn(0x7f4a240b0c40 msgr2=0x7f4a2406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 -- 172.21.15.50:0/4046449932 shutdown_connections 2024-09-13T15:10:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 -- 172.21.15.50:0/4046449932 wait complete. 2024-09-13T15:10:02.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.558+0000 7f4a29600700 1 Processor -- start 2024-09-13T15:10:02.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 -- start start 2024-09-13T15:10:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a2406aaa0 0x7f4a240c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 0x7f4a240c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a240c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240c61d0 con 0x7f4a240cb020 2024-09-13T15:10:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240c6470 con 0x7f4a2415c2a0 2024-09-13T15:10:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240c6710 con 0x7f4a2406aaa0 2024-09-13T15:10:02.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 0x7f4a240c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 0x7f4a240c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56226/0 (socket says 172.21.15.50:56226) 2024-09-13T15:10:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 -- 172.21.15.50:0/3419887047 learned_addr learned my addr 172.21.15.50:0/3419887047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23e00700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a2406aaa0 0x7f4a240c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a28c00700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a240c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 -- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a2406aaa0 msgr2=0x7f4a240c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a2406aaa0 0x7f4a240c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 -- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 msgr2=0x7f4a240c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a240c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 -- 172.21.15.50:0/3419887047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100094b0 con 0x7f4a240cb020 2024-09-13T15:10:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a23400700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 0x7f4a240c9020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4a10014040 tx=0x7f4a10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10004510 con 0x7f4a240cb020 2024-09-13T15:10:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1001e070 con 0x7f4a240cb020 2024-09-13T15:10:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10003900 con 0x7f4a240cb020 2024-09-13T15:10:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.562+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a240c69f0 con 0x7f4a240cb020 2024-09-13T15:10:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.566+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a240c6fb0 con 0x7f4a240cb020 2024-09-13T15:10:02.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.566+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2415b280 con 0x7f4a240cb020 2024-09-13T15:10:02.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.566+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a10003a60 con 0x7f4a240cb020 2024-09-13T15:10:02.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.570+0000 7f4a1be00700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a04066760 0x7f4a04068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.570+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a10020070 con 0x7f4a240cb020 2024-09-13T15:10:02.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.570+0000 7f4a23e00700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a04066760 0x7f4a04068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.570+0000 7f4a23e00700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a04066760 0x7f4a04068c20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009bf0 tx=0x7f4a14009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.578+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a100527f0 con 0x7f4a240cb020 2024-09-13T15:10:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.774+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a240c8bd0 con 0x7f4a240cb020 2024-09-13T15:10:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a1be00700 1 -- 172.21.15.50:0/3419887047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f4a10006ce0 con 0x7f4a240cb020 2024-09-13T15:10:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:02.783 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:46.669735+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a04066760 msgr2=0x7f4a04068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a04066760 0x7f4a04068c20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009bf0 tx=0x7f4a14009240 comp rx=0 tx=0).stop 2024-09-13T15:10:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 msgr2=0x7f4a240c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 0x7f4a240c9020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4a10014040 tx=0x7f4a10004770 comp rx=0 tx=0).stop 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 shutdown_connections 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a04066760 0x7f4a04068c20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2415c2a0 0x7f4a240c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240cb020 0x7f4a240c9020 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 --2- 172.21.15.50:0/3419887047 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a2406aaa0 0x7f4a240c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 >> 172.21.15.50:0/3419887047 conn(0x7f4a240b0c40 msgr2=0x7f4a2415d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 shutdown_connections 2024-09-13T15:10:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.778+0000 7f4a29600700 1 -- 172.21.15.50:0/3419887047 wait complete. 2024-09-13T15:10:02.810 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:10:02.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.978+0000 7fc53e600700 1 Processor -- start 2024-09-13T15:10:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.978+0000 7fc53e600700 1 -- start start 2024-09-13T15:10:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc53e600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc53806a390 0x7fc53806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc53e600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53806ad10 con 0x7fc5380ccdb0 2024-09-13T15:10:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc53e600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5380cb1a0 con 0x7fc538161150 2024-09-13T15:10:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc53e600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5380cb440 con 0x7fc53806a390 2024-09-13T15:10:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc53dc00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc5380ccdb0 0x7fc53806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37054/0 (socket says 172.21.15.50:37054) 2024-09-13T15:10:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc53dc00700 1 -- 172.21.15.50:0/2447503812 learned_addr learned my addr 172.21.15.50:0/2447503812 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537e00700 1 --2- 172.21.15.50:0/2447503812 >> v2:172.21.15.181:3300/0 conn(0x7fc53806a390 0x7fc53806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922232006 0 0) 0x7fc53806ad10 con 0x7fc5380ccdb0 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5200035d0 con 0x7fc5380ccdb0 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394702255 0 0) 0x7fc5380cb1a0 con 0x7fc538161150 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc53806ad10 con 0x7fc538161150 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129335901 0 0) 0x7fc5200035d0 con 0x7fc5380ccdb0 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 >> v2:172.21.15.181:3300/0 conn(0x7fc53806a390 msgr2=0x7fc53806a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 --2- 172.21.15.50:0/2447503812 >> v2:172.21.15.181:3300/0 conn(0x7fc53806a390 0x7fc53806a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 >> v1:172.21.15.181:6789/0 conn(0x7fc538161150 legacy=0x7fc5380cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380cb720 con 0x7fc5380ccdb0 2024-09-13T15:10:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fc5300019f0 con 0x7fc5380ccdb0 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 >> v1:172.21.15.50:6789/0 conn(0x7fc5380ccdb0 legacy=0x7fc53806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc520003c20 0x7fc520004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.982+0000 7fc537400700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc520004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc520005340 0x7fc52000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380cb440 con 0x7fc520004870 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52000c250 con 0x7fc520005340 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52000c410 con 0x7fc520003c20 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc520004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53d200700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc520003c20 0x7fc520004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53dc00700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc520005340 0x7fc52000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 -- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc520003c20 msgr2=0x7fc520004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc520003c20 0x7fc520004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 -- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc520005340 msgr2=0x7fc52000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc520005340 0x7fc52000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53dc00700 1 -- 172.21.15.50:0/2447503812 reap_dead start 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 -- 172.21.15.50:0/2447503812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200035d0 con 0x7fc520004870 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537e00700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc520004cf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc524009b70 tx=0x7fc5200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15382fce62b4d49c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400e6c0 con 0x7fc520004870 2024-09-13T15:10:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400e820 con 0x7fc520004870 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc537400700 1 -- 172.21.15.50:0/2447503812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400eb90 con 0x7fc520004870 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 -- 172.21.15.50:0/2447503812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 msgr2=0x7fc520004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc520004cf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc524009b70 tx=0x7fc5200058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 -- 172.21.15.50:0/2447503812 shutdown_connections 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 --2- 172.21.15.50:0/2447503812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc520004cf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 -- 172.21.15.50:0/2447503812 >> 172.21.15.50:0/2447503812 conn(0x7fc538071f00 msgr2=0x7fc5380722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 -- 172.21.15.50:0/2447503812 shutdown_connections 2024-09-13T15:10:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.986+0000 7fc53e600700 1 -- 172.21.15.50:0/2447503812 wait complete. 2024-09-13T15:10:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 Processor -- start 2024-09-13T15:10:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 -- start start 2024-09-13T15:10:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc5381f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc53814fca0 0x7fc5380c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc538151220 0x7fc5381516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538150180 con 0x7fc520004870 2024-09-13T15:10:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538150460 con 0x7fc538151220 2024-09-13T15:10:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.990+0000 7fc53e600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc538150740 con 0x7fc53814fca0 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc5381f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc5381f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56242/0 (socket says 172.21.15.50:56242) 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53dc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc538151220 0x7fc5381516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 -- 172.21.15.50:0/323399827 learned_addr learned my addr 172.21.15.50:0/323399827 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc537e00700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc53814fca0 0x7fc5380c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 -- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc53814fca0 msgr2=0x7fc5380c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc53814fca0 0x7fc5380c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 -- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc538151220 msgr2=0x7fc5381516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc538151220 0x7fc5381516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 -- 172.21.15.50:0/323399827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538150a20 con 0x7fc520004870 2024-09-13T15:10:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53d200700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc5381f6120 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00e780 tx=0x7fc52c00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0052e0 con 0x7fc520004870 2024-09-13T15:10:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c005440 con 0x7fc520004870 2024-09-13T15:10:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0038e0 con 0x7fc520004870 2024-09-13T15:10:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc538150d00 con 0x7fc520004870 2024-09-13T15:10:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5381f6840 con 0x7fc520004870 2024-09-13T15:10:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.994+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc538150ef0 con 0x7fc520004870 2024-09-13T15:10:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.998+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc52c003a40 con 0x7fc520004870 2024-09-13T15:10:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.998+0000 7fc534c00700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc518066760 0x7fc518068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.998+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc52c083630 con 0x7fc520004870 2024-09-13T15:10:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.998+0000 7fc537e00700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc518066760 0x7fc518068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:02.998+0000 7fc537e00700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc518066760 0x7fc518068c20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc5240090b0 tx=0x7fc52401f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.006+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc52c0507c0 con 0x7fc520004870 2024-09-13T15:10:03.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.238+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc53806a7d0 con 0x7fc520004870 2024-09-13T15:10:03.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.238+0000 7fc534c00700 1 -- 172.21.15.50:0/323399827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fc52c053de0 con 0x7fc520004870 2024-09-13T15:10:03.244 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:03.244 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:45.665636+0000","modified":"2024-09-13T15:09:48.684241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/442961988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":442961988},{"type":"v1","addr":"172.21.15.50:6835","nonce":442961988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc518066760 msgr2=0x7fc518068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc518066760 0x7fc518068c20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc5240090b0 tx=0x7fc52401f040 comp rx=0 tx=0).stop 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 msgr2=0x7fc5381f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc5381f6120 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00e780 tx=0x7fc52c00ea90 comp rx=0 tx=0).stop 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 shutdown_connections 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc518066760 0x7fc518068c20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc538151220 0x7fc5381516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc53814fca0 0x7fc5380c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 --2- 172.21.15.50:0/323399827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520004870 0x7fc5381f6120 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 >> 172.21.15.50:0/323399827 conn(0x7fc538071f00 msgr2=0x7fc5380c3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 shutdown_connections 2024-09-13T15:10:03.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.242+0000 7fc53e600700 1 -- 172.21.15.50:0/323399827 wait complete. 2024-09-13T15:10:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-13T15:10:03.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.438+0000 7f4019000700 1 Processor -- start 2024-09-13T15:10:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.438+0000 7f4019000700 1 -- start start 2024-09-13T15:10:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4019000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f40140cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4019000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140b0190 con 0x7f401406d180 2024-09-13T15:10:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4019000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401406a530 con 0x7f401415cb30 2024-09-13T15:10:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4019000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401406a810 con 0x7f40140d0400 2024-09-13T15:10:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f401406d180 0x7f40140cfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59058/0 (socket says 172.21.15.50:59058) 2024-09-13T15:10:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012a00700 1 -- 172.21.15.50:0/2411858581 learned_addr learned my addr 172.21.15.50:0/2411858581 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4013e00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f40140cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364910715 0 0) 0x7f40140b0190 con 0x7f401406d180 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff80035d0 con 0x7f401406d180 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619523927 0 0) 0x7f401406a530 con 0x7f401415cb30 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40140b0190 con 0x7f401415cb30 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700023461 0 0) 0x7f3ff80035d0 con 0x7f401406d180 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 msgr2=0x7f40140cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f40140cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 >> v1:172.21.15.181:6789/0 conn(0x7f401415cb30 legacy=0x7f401406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401406aaf0 con 0x7f401406d180 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f4000001670 con 0x7f401406d180 2024-09-13T15:10:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.442+0000 7f4013e00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f40140cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 >> v1:172.21.15.50:6789/0 conn(0x7f401406d180 legacy=0x7f40140cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff8003c50 0x7f3ff8004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f3ff8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f3ff8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401406a810 con 0x7f3ff8004870 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff800bb10 con 0x7f3ff8003c50 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff800bcd0 con 0x7f40140d0400 2024-09-13T15:10:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f3ff8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4013e00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f3ff8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4013400700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff8003c50 0x7f3ff8004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 -- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 msgr2=0x7f3ff8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40140d0400 0x7f3ff8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 -- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff8003c50 msgr2=0x7f3ff8004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff8003c50 0x7f3ff8004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 -- 172.21.15.50:0/2411858581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c009a70 con 0x7f3ff8004870 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012a00700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f3ff8004cf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4000001eb0 tx=0x7f3ff80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b029ffdf6a1616ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000ccf0 con 0x7f3ff8004870 2024-09-13T15:10:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4000001af0 con 0x7f3ff8004870 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4012000700 1 -- 172.21.15.50:0/2411858581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000005bc0 con 0x7f3ff8004870 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4019000700 1 -- 172.21.15.50:0/2411858581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 msgr2=0x7f3ff8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4019000700 1 --2- 172.21.15.50:0/2411858581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f3ff8004cf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4000001eb0 tx=0x7f3ff80058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4013e00700 1 -- 172.21.15.50:0/2411858581 reap_dead start 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4019000700 1 -- 172.21.15.50:0/2411858581 shutdown_connections 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4019000700 1 -- 172.21.15.50:0/2411858581 >> 172.21.15.50:0/2411858581 conn(0x7f4014071f00 msgr2=0x7f40140722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.446+0000 7f4019000700 1 -- 172.21.15.50:0/2411858581 shutdown_connections 2024-09-13T15:10:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 -- 172.21.15.50:0/2411858581 wait complete. 2024-09-13T15:10:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 Processor -- start 2024-09-13T15:10:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 -- start start 2024-09-13T15:10:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f40140b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40141580a0 0x7f40140b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40141578b0 0x7f40140ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140b29c0 con 0x7f3ff8004870 2024-09-13T15:10:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140b2ca0 con 0x7f40141578b0 2024-09-13T15:10:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.450+0000 7f4019000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40140c7af0 con 0x7f40141580a0 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f40140b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f40140b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39368/0 (socket says 172.21.15.50:39368) 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 -- 172.21.15.50:0/1828111629 learned_addr learned my addr 172.21.15.50:0/1828111629 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013e00700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40141578b0 0x7f40140ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4012a00700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40141580a0 0x7f40140b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 -- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40141580a0 msgr2=0x7f40140b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40141580a0 0x7f40140b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 -- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40141578b0 msgr2=0x7f40140ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40141578b0 0x7f40140ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 -- 172.21.15.50:0/1828111629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40140c7dd0 con 0x7f3ff8004870 2024-09-13T15:10:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4013400700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f40140b11f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f400400e7b0 tx=0x7f400400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040052e0 con 0x7f3ff8004870 2024-09-13T15:10:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004005440 con 0x7f3ff8004870 2024-09-13T15:10:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40140c80b0 con 0x7f3ff8004870 2024-09-13T15:10:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040038e0 con 0x7f3ff8004870 2024-09-13T15:10:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.454+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4014157d60 con 0x7f3ff8004870 2024-09-13T15:10:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.458+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40140c82a0 con 0x7f3ff8004870 2024-09-13T15:10:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.458+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4004003a40 con 0x7f3ff8004870 2024-09-13T15:10:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.462+0000 7f400b400700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066760 0x7f3ff4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.462+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4004083b50 con 0x7f3ff8004870 2024-09-13T15:10:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.462+0000 7f4012a00700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066760 0x7f3ff4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.462+0000 7f4012a00700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066760 0x7f3ff4068c20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4000015040 tx=0x7f400000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.466+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4004050da0 con 0x7f3ff8004870 2024-09-13T15:10:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.710+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f401406b2f0 con 0x7f3ff8004870 2024-09-13T15:10:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f400b400700 1 -- 172.21.15.50:0/1828111629 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f4004019090 con 0x7f3ff8004870 2024-09-13T15:10:03.719 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:03.719 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:09:45.665636+0000","modified":"2024-09-13T15:09:48.684241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/442961988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":442961988},{"type":"v1","addr":"172.21.15.50:6835","nonce":442961988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T15:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066760 msgr2=0x7f3ff4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066760 0x7f3ff4068c20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4000015040 tx=0x7f400000a000 comp rx=0 tx=0).stop 2024-09-13T15:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 msgr2=0x7f40140b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f40140b11f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f400400e7b0 tx=0x7f400400eac0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 shutdown_connections 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ff4066760 0x7f3ff4068c20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40141578b0 0x7f40140ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40141580a0 0x7f40140b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 --2- 172.21.15.50:0/1828111629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ff8004870 0x7f40140b11f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 >> 172.21.15.50:0/1828111629 conn(0x7f4014071f00 msgr2=0x7f40140b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.714+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 shutdown_connections 2024-09-13T15:10:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.718+0000 7f4019000700 1 -- 172.21.15.50:0/1828111629 wait complete. 2024-09-13T15:10:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-13T15:10:03.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.910+0000 7fd96b200700 1 Processor -- start 2024-09-13T15:10:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.910+0000 7fd96b200700 1 -- start start 2024-09-13T15:10:03.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd96b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd964161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd96b200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640ac890 con 0x7fd96415cc50 2024-09-13T15:10:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd96b200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96406bd20 con 0x7fd96406b870 2024-09-13T15:10:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd96b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964161800 con 0x7fd9640667a0 2024-09-13T15:10:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd969e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd96415cc50 0x7fd964066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59068/0 (socket says 172.21.15.50:59068) 2024-09-13T15:10:03.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd969e00700 1 -- 172.21.15.50:0/397205315 learned_addr learned my addr 172.21.15.50:0/397205315 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd969400700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd964161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615923933 0 0) 0x7fd9640ac890 con 0x7fd96415cc50 2024-09-13T15:10:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c0035d0 con 0x7fd96415cc50 2024-09-13T15:10:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485505416 0 0) 0x7fd96406bd20 con 0x7fd96406b870 2024-09-13T15:10:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9640ac890 con 0x7fd96406b870 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3782805492 0 0) 0x7fd94c0035d0 con 0x7fd96415cc50 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 msgr2=0x7fd964161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd964161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 >> v1:172.21.15.181:6789/0 conn(0x7fd96406b870 legacy=0x7fd96406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640af2a0 con 0x7fd96415cc50 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fd958001670 con 0x7fd96415cc50 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 >> v1:172.21.15.50:6789/0 conn(0x7fd96415cc50 legacy=0x7fd964066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd94c003c50 0x7fd94c004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.914+0000 7fd968a00700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd94c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd94c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964161800 con 0x7fd94c004870 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c00bb90 con 0x7fd94c003c50 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c00bd50 con 0x7fd9640667a0 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd94c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96a800700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd94c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969e00700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd94c003c50 0x7fd94c004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 -- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 msgr2=0x7fd94c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd94c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 -- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd94c003c50 msgr2=0x7fd94c004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd94c003c50 0x7fd94c004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 -- 172.21.15.50:0/397205315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0035d0 con 0x7fd94c004870 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969e00700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd94c003c50 0x7fd94c004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:03.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96a800700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640667a0 0x7fd94c005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd969400700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd94c004cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd954009b70 tx=0x7fd94c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd025bd257ae116a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400e6c0 con 0x7fd94c004870 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95400e820 con 0x7fd94c004870 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd968a00700 1 -- 172.21.15.50:0/397205315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400eb90 con 0x7fd94c004870 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96b200700 1 -- 172.21.15.50:0/397205315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 msgr2=0x7fd94c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96b200700 1 --2- 172.21.15.50:0/397205315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd94c004cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd954009b70 tx=0x7fd94c0058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96a800700 1 -- 172.21.15.50:0/397205315 reap_dead start 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96b200700 1 -- 172.21.15.50:0/397205315 shutdown_connections 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96b200700 1 -- 172.21.15.50:0/397205315 >> 172.21.15.50:0/397205315 conn(0x7fd96406ca10 msgr2=0x7fd96406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96b200700 1 -- 172.21.15.50:0/397205315 shutdown_connections 2024-09-13T15:10:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.918+0000 7fd96b200700 1 -- 172.21.15.50:0/397205315 wait complete. 2024-09-13T15:10:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.922+0000 7fd96b200700 1 Processor -- start 2024-09-13T15:10:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.922+0000 7fd96b200700 1 -- start start 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd96414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640b05e0 0x7fd9640b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640b4310 0x7fd9640b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640b4cd0 con 0x7fd94c004870 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96415dc20 con 0x7fd9640b05e0 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640b1d60 con 0x7fd9640b4310 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd96414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd96414f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39388/0 (socket says 172.21.15.50:39388) 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 -- 172.21.15.50:0/1681309931 learned_addr learned my addr 172.21.15.50:0/1681309931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969400700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640b05e0 0x7fd9640b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96a800700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640b4310 0x7fd9640b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 -- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640b4310 msgr2=0x7fd9640b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640b4310 0x7fd9640b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 -- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640b05e0 msgr2=0x7fd9640b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640b05e0 0x7fd9640b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 -- 172.21.15.50:0/1681309931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640b1150 con 0x7fd94c004870 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96a800700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640b4310 0x7fd9640b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd969e00700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd96414f2d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd958001200 tx=0x7fd95800de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958007ea0 con 0x7fd94c004870 2024-09-13T15:10:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd958004ca0 con 0x7fd94c004870 2024-09-13T15:10:03.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9640b1430 con 0x7fd94c004870 2024-09-13T15:10:03.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580072d0 con 0x7fd94c004870 2024-09-13T15:10:03.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.926+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9640b19f0 con 0x7fd94c004870 2024-09-13T15:10:03.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.930+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964160cf0 con 0x7fd94c004870 2024-09-13T15:10:03.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.930+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd958007430 con 0x7fd94c004870 2024-09-13T15:10:03.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.934+0000 7fd95e000700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd948066730 0x7fd948068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.934+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd958083ff0 con 0x7fd94c004870 2024-09-13T15:10:03.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.934+0000 7fd969400700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd948066730 0x7fd948068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.934+0000 7fd969400700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd948066730 0x7fd948068bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd9540090b0 tx=0x7fd954008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:03.938+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9580b5db0 con 0x7fd94c004870 2024-09-13T15:10:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.130+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd96415a010 con 0x7fd94c004870 2024-09-13T15:10:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.134+0000 7fd95e000700 1 -- 172.21.15.50:0/1681309931 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16762 (secure 0 0 0) 0x7fd958019090 con 0x7fd94c004870 2024-09-13T15:10:04.140 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:09:46.669735+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:09:43.873444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T15:09:44.686028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd948066730 msgr2=0x7fd948068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd948066730 0x7fd948068bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd9540090b0 tx=0x7fd954008030 comp rx=0 tx=0).stop 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 msgr2=0x7fd96414f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd96414f2d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd958001200 tx=0x7fd95800de70 comp rx=0 tx=0).stop 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 shutdown_connections 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd948066730 0x7fd948068bf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd9640b4310 0x7fd9640b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9640b05e0 0x7fd9640b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 --2- 172.21.15.50:0/1681309931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd94c004870 0x7fd96414f2d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 >> 172.21.15.50:0/1681309931 conn(0x7fd96406ca10 msgr2=0x7fd9640cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 shutdown_connections 2024-09-13T15:10:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.138+0000 7fd96b200700 1 -- 172.21.15.50:0/1681309931 wait complete. 2024-09-13T15:10:04.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:10:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.326+0000 7fd3bbe00700 1 Processor -- start 2024-09-13T15:10:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.326+0000 7fd3bbe00700 1 -- start start 2024-09-13T15:10:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.326+0000 7fd3bbe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3bc15e070 0x7fd3bc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0cd970 con 0x7fd3bc0d10f0 2024-09-13T15:10:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc15e450 con 0x7fd3bc15e070 2024-09-13T15:10:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0d0050 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3bc15e070 0x7fd3bc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3bc15e070 0x7fd3bc0cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39400/0 (socket says 172.21.15.50:39400) 2024-09-13T15:10:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 -- 172.21.15.50:0/2107847438 learned_addr learned my addr 172.21.15.50:0/2107847438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bb400700 1 --2- 172.21.15.50:0/2107847438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 -- 172.21.15.50:0/2107847438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 msgr2=0x7fd3bc0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:04.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 --2- 172.21.15.50:0/2107847438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc0b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 -- 172.21.15.50:0/2107847438 >> v1:172.21.15.181:6789/0 conn(0x7fd3bc0d10f0 legacy=0x7fd3bc0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 -- 172.21.15.50:0/2107847438 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0d0330 con 0x7fd3bc15e070 2024-09-13T15:10:04.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3baa00700 1 --2- 172.21.15.50:0/2107847438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc15e070 0x7fd3bc0cd430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009910 tx=0x7fd3ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa03e8a32545718 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3b9600700 1 -- 172.21.15.50:0/2107847438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00ba60 con 0x7fd3bc15e070 2024-09-13T15:10:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3b9600700 1 -- 172.21.15.50:0/2107847438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00bbc0 con 0x7fd3bc15e070 2024-09-13T15:10:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3b9600700 1 -- 172.21.15.50:0/2107847438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac009e60 con 0x7fd3bc15e070 2024-09-13T15:10:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2107847438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc15e070 msgr2=0x7fd3bc0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/2107847438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc15e070 0x7fd3bc0cd430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009910 tx=0x7fd3ac009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2107847438 shutdown_connections 2024-09-13T15:10:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/2107847438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/2107847438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc15e070 0x7fd3bc0cd430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2107847438 >> 172.21.15.50:0/2107847438 conn(0x7fd3bc071f00 msgr2=0x7fd3bc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2107847438 shutdown_connections 2024-09-13T15:10:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.330+0000 7fd3bbe00700 1 -- 172.21.15.50:0/2107847438 wait complete. 2024-09-13T15:10:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 Processor -- start 2024-09-13T15:10:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 -- start start 2024-09-13T15:10:04.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc0d10f0 0x7fd3bc15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc15e070 0x7fd3bc14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0c66b0 con 0x7fd3bc0d10f0 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15bf50 con 0x7fd3bc15e070 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0c5aa0 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3baa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3baa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:53754/0 (socket says 172.21.15.50:53754) 2024-09-13T15:10:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3baa00700 1 -- 172.21.15.50:0/1222216765 learned_addr learned my addr 172.21.15.50:0/1222216765 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3ba000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc0d10f0 0x7fd3bc15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.334+0000 7fd3bb400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc15e070 0x7fd3bc14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3baa00700 1 -- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc15e070 msgr2=0x7fd3bc14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3baa00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc15e070 0x7fd3bc14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3baa00700 1 -- 172.21.15.50:0/1222216765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc0d10f0 msgr2=0x7fd3bc15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3baa00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc0d10f0 0x7fd3bc15ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3baa00700 1 -- 172.21.15.50:0/1222216765 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009570 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3baa00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc158ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b3c0 tx=0x7fd3ac004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac004510 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac01f070 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc0c5d80 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac003900 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc0c6340 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.338+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0afdc0 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.342+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3ac003a60 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.342+0000 7fd3b3400700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c066780 0x7fd39c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.342+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd3ac021070 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.342+0000 7fd3ba000700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c066780 0x7fd39c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.342+0000 7fd3ba000700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c066780 0x7fd39c068c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0c9490 tx=0x7fd3a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.350+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3ac052f90 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.574+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd3bc0cd480 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.582 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:10:04.578+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:10:04.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.594+0000 7fd3b3400700 1 -- 172.21.15.50:0/1222216765 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd3ac015020 con 0x7fd3bc0b2c50 2024-09-13T15:10:04.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c066780 msgr2=0x7fd39c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c066780 0x7fd39c068c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0c9490 tx=0x7fd3a8009040 comp rx=0 tx=0).stop 2024-09-13T15:10:04.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 msgr2=0x7fd3bc158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc158ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b3c0 tx=0x7fd3ac004770 comp rx=0 tx=0).stop 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 shutdown_connections 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd39c066780 0x7fd39c068c40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3bc15e070 0x7fd3bc14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3bc0d10f0 0x7fd3bc15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 --2- 172.21.15.50:0/1222216765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd3bc0b2c50 0x7fd3bc158ba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 >> 172.21.15.50:0/1222216765 conn(0x7fd3bc071f00 msgr2=0x7fd3bc0cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 shutdown_connections 2024-09-13T15:10:04.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.598+0000 7fd3bbe00700 1 -- 172.21.15.50:0/1222216765 wait complete. 2024-09-13T15:10:04.605 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:10:04.609 INFO:tasks.ceph.mds.a.smithi050.stderr: -1928> 2024-09-13T15:09:51.175+0000 7f6c01400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:10:04.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:10:04.667 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:10:04.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.798+0000 7fb294800700 1 Processor -- start 2024-09-13T15:10:04.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.798+0000 7fb294800700 1 -- start start 2024-09-13T15:10:04.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb294800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb28c0ce280 0x7fb28c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb294800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb28c15a880 0x7fb28c070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb294800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c15df90 con 0x7fb28c0cf1e0 2024-09-13T15:10:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb294800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c0cf670 con 0x7fb28c15a880 2024-09-13T15:10:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb294800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c15ac90 con 0x7fb28c0ce280 2024-09-13T15:10:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb28c15a880 0x7fb28c070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb291e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb28c0ce280 0x7fb28c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb28c15a880 0x7fb28c070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39438/0 (socket says 172.21.15.50:39438) 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 -- 172.21.15.50:0/2279591115 learned_addr learned my addr 172.21.15.50:0/2279591115 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 -- 172.21.15.50:0/2279591115 >> v2:172.21.15.181:3300/0 conn(0x7fb28c0ce280 msgr2=0x7fb28c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 --2- 172.21.15.50:0/2279591115 >> v2:172.21.15.181:3300/0 conn(0x7fb28c0ce280 0x7fb28c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 -- 172.21.15.50:0/2279591115 >> v1:172.21.15.50:6789/0 conn(0x7fb28c0cf1e0 legacy=0x7fb28c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 -- 172.21.15.50:0/2279591115 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c15aea0 con 0x7fb28c15a880 2024-09-13T15:10:04.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb291e00700 1 --2- 172.21.15.50:0/2279591115 >> v2:172.21.15.181:3300/0 conn(0x7fb28c0ce280 0x7fb28c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb292800700 1 --2- 172.21.15.50:0/2279591115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c070ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06fed0 tx=0x7fb28800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c1c65d3c889c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb290a00700 1 -- 172.21.15.50:0/2279591115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800e070 con 0x7fb28c15a880 2024-09-13T15:10:04.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb290a00700 1 -- 172.21.15.50:0/2279591115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800b910 con 0x7fb28c15a880 2024-09-13T15:10:04.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.802+0000 7fb290a00700 1 -- 172.21.15.50:0/2279591115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800bcc0 con 0x7fb28c15a880 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 -- 172.21.15.50:0/2279591115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 msgr2=0x7fb28c070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 --2- 172.21.15.50:0/2279591115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c070ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06fed0 tx=0x7fb28800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 -- 172.21.15.50:0/2279591115 shutdown_connections 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 --2- 172.21.15.50:0/2279591115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c070ca0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 --2- 172.21.15.50:0/2279591115 >> v2:172.21.15.181:3300/0 conn(0x7fb28c0ce280 0x7fb28c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 -- 172.21.15.50:0/2279591115 >> 172.21.15.50:0/2279591115 conn(0x7fb28c06a570 msgr2=0x7fb28c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 -- 172.21.15.50:0/2279591115 shutdown_connections 2024-09-13T15:10:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.806+0000 7fb294800700 1 -- 172.21.15.50:0/2279591115 wait complete. 2024-09-13T15:10:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 Processor -- start 2024-09-13T15:10:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 -- start start 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c0ce280 0x7fb28c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c0cf1e0 0x7fb28c14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c150fb0 con 0x7fb28c15a880 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0aff20 con 0x7fb28c0ce280 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb294800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0b0200 con 0x7fb28c0cf1e0 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c0af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39448/0 (socket says 172.21.15.50:39448) 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 -- 172.21.15.50:0/3555575962 learned_addr learned my addr 172.21.15.50:0/3555575962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb291e00700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c0ce280 0x7fb28c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb291400700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c0cf1e0 0x7fb28c14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 -- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c0cf1e0 msgr2=0x7fb28c14dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c0cf1e0 0x7fb28c14dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 -- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c0ce280 msgr2=0x7fb28c152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c0ce280 0x7fb28c152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb292800700 1 -- 172.21.15.50:0/3555575962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2800094b0 con 0x7fb28c15a880 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.810+0000 7fb291400700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c0cf1e0 0x7fb28c14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb292800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c0af5b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06b7d0 tx=0x7fb288004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288004930 con 0x7fb28c15a880 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2880099b0 con 0x7fb28c15a880 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb288009b30 con 0x7fb28c15a880 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28801b670 con 0x7fb28c15a880 2024-09-13T15:10:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c151200 con 0x7fb28c15a880 2024-09-13T15:10:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c0ce660 con 0x7fb28c15a880 2024-09-13T15:10:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.814+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb28801b7d0 con 0x7fb28c15a880 2024-09-13T15:10:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.818+0000 7fb286000700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb270066730 0x7fb270068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.818+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fb288085b40 con 0x7fb28c15a880 2024-09-13T15:10:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.818+0000 7fb291e00700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb270066730 0x7fb270068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.818+0000 7fb291e00700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb270066730 0x7fb270068bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb280009d80 tx=0x7fb280009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:04.822+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb288052d00 con 0x7fb28c15a880 2024-09-13T15:10:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.042+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb28c1513c0 con 0x7fb28c15a880 2024-09-13T15:10:05.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:05.576 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:05.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.598+0000 7fb286000700 1 -- 172.21.15.50:0/3555575962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb288056320 con 0x7fb28c15a880 2024-09-13T15:10:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb270066730 msgr2=0x7fb270068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb270066730 0x7fb270068bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb280009d80 tx=0x7fb280009240 comp rx=0 tx=0).stop 2024-09-13T15:10:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 msgr2=0x7fb28c0af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c0af5b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06b7d0 tx=0x7fb288004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 shutdown_connections 2024-09-13T15:10:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb270066730 0x7fb270068bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb28c15a880 0x7fb28c0af5b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb28c0cf1e0 0x7fb28c14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 --2- 172.21.15.50:0/3555575962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb28c0ce280 0x7fb28c152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 >> 172.21.15.50:0/3555575962 conn(0x7fb28c06a570 msgr2=0x7fb28c15b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 shutdown_connections 2024-09-13T15:10:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.602+0000 7fb294800700 1 -- 172.21.15.50:0/3555575962 wait complete. 2024-09-13T15:10:05.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:10:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 Processor -- start 2024-09-13T15:10:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 -- start start 2024-09-13T15:10:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc700b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efc700b5d80 0x7efc700d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc700ceea0 0x7efc700d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7015c040 con 0x7efc700ceea0 2024-09-13T15:10:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7015f450 con 0x7efc700b5d80 2024-09-13T15:10:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc74c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7015e5f0 con 0x7efc70154f40 2024-09-13T15:10:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc6e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc700ceea0 0x7efc700d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc6e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc700ceea0 0x7efc700d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39458/0 (socket says 172.21.15.50:39458) 2024-09-13T15:10:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.870+0000 7efc6e800700 1 -- 172.21.15.50:0/95494482 learned_addr learned my addr 172.21.15.50:0/95494482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6de00700 1 --2- 172.21.15.50:0/95494482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc700b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6d400700 1 --2- 172.21.15.50:0/95494482 >> v2:172.21.15.181:3300/0 conn(0x7efc700b5d80 0x7efc700d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6e800700 1 -- 172.21.15.50:0/95494482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 msgr2=0x7efc700b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6e800700 1 --2- 172.21.15.50:0/95494482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc700b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6e800700 1 -- 172.21.15.50:0/95494482 >> v2:172.21.15.181:3300/0 conn(0x7efc700b5d80 msgr2=0x7efc700d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6e800700 1 --2- 172.21.15.50:0/95494482 >> v2:172.21.15.181:3300/0 conn(0x7efc700b5d80 0x7efc700d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6e800700 1 -- 172.21.15.50:0/95494482 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7015e840 con 0x7efc700ceea0 2024-09-13T15:10:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6e800700 1 --2- 172.21.15.50:0/95494482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700ceea0 0x7efc700d0fb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efc7006cac0 tx=0x7efc6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfc31e784734525 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6ca00700 1 -- 172.21.15.50:0/95494482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800e070 con 0x7efc700ceea0 2024-09-13T15:10:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6ca00700 1 -- 172.21.15.50:0/95494482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6800b910 con 0x7efc700ceea0 2024-09-13T15:10:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc6ca00700 1 -- 172.21.15.50:0/95494482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800bcc0 con 0x7efc700ceea0 2024-09-13T15:10:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 -- 172.21.15.50:0/95494482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700ceea0 msgr2=0x7efc700d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 --2- 172.21.15.50:0/95494482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700ceea0 0x7efc700d0fb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efc7006cac0 tx=0x7efc6800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 -- 172.21.15.50:0/95494482 shutdown_connections 2024-09-13T15:10:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 --2- 172.21.15.50:0/95494482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700ceea0 0x7efc700d0fb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 --2- 172.21.15.50:0/95494482 >> v2:172.21.15.181:3300/0 conn(0x7efc700b5d80 0x7efc700d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 --2- 172.21.15.50:0/95494482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc700b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 -- 172.21.15.50:0/95494482 >> 172.21.15.50:0/95494482 conn(0x7efc7006e660 msgr2=0x7efc7006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 -- 172.21.15.50:0/95494482 shutdown_connections 2024-09-13T15:10:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.874+0000 7efc74c00700 1 -- 172.21.15.50:0/95494482 wait complete. 2024-09-13T15:10:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.878+0000 7efc74c00700 1 Processor -- start 2024-09-13T15:10:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.878+0000 7efc74c00700 1 -- start start 2024-09-13T15:10:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 0x7efc700cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700ceea0 0x7efc7006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc70147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7006b3d0 con 0x7efc700b5d80 2024-09-13T15:10:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7006ada0 con 0x7efc700ceea0 2024-09-13T15:10:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc70149d30 con 0x7efc70154f40 2024-09-13T15:10:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 0x7efc700cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 0x7efc700cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39460/0 (socket says 172.21.15.50:39460) 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 -- 172.21.15.50:0/4089892917 learned_addr learned my addr 172.21.15.50:0/4089892917 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6d400700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700ceea0 0x7efc7006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6e800700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc70147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 -- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 msgr2=0x7efc70147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc70147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 -- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700ceea0 msgr2=0x7efc7006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700ceea0 0x7efc7006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 -- 172.21.15.50:0/4089892917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68009b30 con 0x7efc700b5d80 2024-09-13T15:10:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6d400700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700ceea0 0x7efc7006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc6de00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 0x7efc700cd360 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efc6000e870 tx=0x7efc6000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600095c0 con 0x7efc700b5d80 2024-09-13T15:10:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6000ee70 con 0x7efc700b5d80 2024-09-13T15:10:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7014a010 con 0x7efc700b5d80 2024-09-13T15:10:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6000ca70 con 0x7efc700b5d80 2024-09-13T15:10:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.882+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc700cd8a0 con 0x7efc700b5d80 2024-09-13T15:10:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.886+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc70067a20 con 0x7efc700b5d80 2024-09-13T15:10:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.886+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc6000cbd0 con 0x7efc700b5d80 2024-09-13T15:10:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.890+0000 7efc66000700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc50066730 0x7efc50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.890+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6115+0+0 (secure 0 0 0) 0x7efc60084370 con 0x7efc700b5d80 2024-09-13T15:10:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.890+0000 7efc6d400700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc50066730 0x7efc50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.890+0000 7efc6d400700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc50066730 0x7efc50068bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efc70158bc0 tx=0x7efc5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:05.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:05.898+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc600514b0 con 0x7efc700b5d80 2024-09-13T15:10:06.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.086+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc700b5840 con 0x7efc700b5d80 2024-09-13T15:10:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.602+0000 7efc66000700 1 -- 172.21.15.50:0/4089892917 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc60054ad0 con 0x7efc700b5d80 2024-09-13T15:10:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc50066730 msgr2=0x7efc50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc50066730 0x7efc50068bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efc70158bc0 tx=0x7efc5c008040 comp rx=0 tx=0).stop 2024-09-13T15:10:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 msgr2=0x7efc700cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 0x7efc700cd360 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efc6000e870 tx=0x7efc6000ec30 comp rx=0 tx=0).stop 2024-09-13T15:10:06.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 shutdown_connections 2024-09-13T15:10:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efc50066730 0x7efc50068bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc70154f40 0x7efc70147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc700ceea0 0x7efc7006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 --2- 172.21.15.50:0/4089892917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc700b5d80 0x7efc700cd360 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 >> 172.21.15.50:0/4089892917 conn(0x7efc7006e660 msgr2=0x7efc700b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 shutdown_connections 2024-09-13T15:10:06.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.610+0000 7efc74c00700 1 -- 172.21.15.50:0/4089892917 wait complete. 2024-09-13T15:10:06.624 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:10:06.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:10:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.826+0000 7ff9e3200700 1 Processor -- start 2024-09-13T15:10:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.826+0000 7ff9e3200700 1 -- start start 2024-09-13T15:10:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e3200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff9e40cc6f0 0x7ff9e406c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e3200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e406d920 con 0x7ff9e40ccb20 2024-09-13T15:10:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e3200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40b1300 con 0x7ff9e41586a0 2024-09-13T15:10:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e3200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e406db90 con 0x7ff9e40cc6f0 2024-09-13T15:10:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e2800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9e40ccb20 0x7ff9e415af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59090/0 (socket says 172.21.15.50:59090) 2024-09-13T15:10:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e2800700 1 -- 172.21.15.50:0/1237946469 learned_addr learned my addr 172.21.15.50:0/1237946469 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:06.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e1400700 1 --2- 172.21.15.50:0/1237946469 >> v2:172.21.15.181:3300/0 conn(0x7ff9e40cc6f0 0x7ff9e406c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544359335 0 0) 0x7ff9e406d920 con 0x7ff9e40ccb20 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c80035d0 con 0x7ff9e40ccb20 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767586171 0 0) 0x7ff9e40b1300 con 0x7ff9e41586a0 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e406d920 con 0x7ff9e41586a0 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2705760811 0 0) 0x7ff9c80035d0 con 0x7ff9e40ccb20 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 >> v2:172.21.15.181:3300/0 conn(0x7ff9e40cc6f0 msgr2=0x7ff9e406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 --2- 172.21.15.50:0/1237946469 >> v2:172.21.15.181:3300/0 conn(0x7ff9e40cc6f0 0x7ff9e406c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 >> v1:172.21.15.181:6789/0 conn(0x7ff9e41586a0 legacy=0x7ff9e406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e406bc30 con 0x7ff9e40ccb20 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7ff9dc0019f0 con 0x7ff9e40ccb20 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 >> v1:172.21.15.50:6789/0 conn(0x7ff9e40ccb20 legacy=0x7ff9e415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9c8004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9c8004870 0x7ff9c8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.830+0000 7ff9e0a00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9c8005280 0x7ff9c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e406db90 con 0x7ff9c8003c20 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c800c1d0 con 0x7ff9c8005280 2024-09-13T15:10:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c800c390 con 0x7ff9c8004870 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9c8004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e2800700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9c8005280 0x7ff9c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1400700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9c8004870 0x7ff9c8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 -- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9c8004870 msgr2=0x7ff9c8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9c8004870 0x7ff9c8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 -- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9c8005280 msgr2=0x7ff9c800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9c8005280 0x7ff9c800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 -- 172.21.15.50:0/1237946469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80035d0 con 0x7ff9c8003c20 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e2800700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9c8005280 0x7ff9c800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e2800700 1 -- 172.21.15.50:0/1237946469 reap_dead start 2024-09-13T15:10:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1400700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9c8004870 0x7ff9c8004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9c8004020 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4007fd0 tx=0x7ff9c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68974d14a82f78f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4001450 con 0x7ff9c8003c20 2024-09-13T15:10:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4006aa0 con 0x7ff9c8003c20 2024-09-13T15:10:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e0a00700 1 -- 172.21.15.50:0/1237946469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4006e50 con 0x7ff9c8003c20 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 -- 172.21.15.50:0/1237946469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 msgr2=0x7ff9c8004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9c8004020 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4007fd0 tx=0x7ff9c80058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 -- 172.21.15.50:0/1237946469 shutdown_connections 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 --2- 172.21.15.50:0/1237946469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9c8004020 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 -- 172.21.15.50:0/1237946469 >> 172.21.15.50:0/1237946469 conn(0x7ff9e40b05a0 msgr2=0x7ff9e40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 -- 172.21.15.50:0/1237946469 shutdown_connections 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.834+0000 7ff9e3200700 1 -- 172.21.15.50:0/1237946469 wait complete. 2024-09-13T15:10:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.838+0000 7ff9e3200700 1 Processor -- start 2024-09-13T15:10:06.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.838+0000 7ff9e3200700 1 -- start start 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9e414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9e40c4220 0x7ff9e40c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9e40c46a0 0x7ff9e40c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e414f720 con 0x7ff9c8003c20 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c4c00 con 0x7ff9e40c4220 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c4ee0 con 0x7ff9e40c46a0 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9e414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9e414f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39474/0 (socket says 172.21.15.50:39474) 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 -- 172.21.15.50:0/2271475215 learned_addr learned my addr 172.21.15.50:0/2271475215 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e2800700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9e40c46a0 0x7ff9e40c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1400700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9e40c4220 0x7ff9e40c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 -- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9e40c46a0 msgr2=0x7ff9e40c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9e40c46a0 0x7ff9e40c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 -- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9e40c4220 msgr2=0x7ff9e40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9e40c4220 0x7ff9e40c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 -- 172.21.15.50:0/2271475215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40c51c0 con 0x7ff9c8003c20 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e1e00700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9e414f1e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c1a0 tx=0x7ff9d40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40054d0 con 0x7ff9c8003c20 2024-09-13T15:10:06.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4007030 con 0x7ff9c8003c20 2024-09-13T15:10:06.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40073e0 con 0x7ff9c8003c20 2024-09-13T15:10:06.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e415b510 con 0x7ff9c8003c20 2024-09-13T15:10:06.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e415ba30 con 0x7ff9c8003c20 2024-09-13T15:10:06.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.842+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e415b6a0 con 0x7ff9c8003c20 2024-09-13T15:10:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.846+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9d4007540 con 0x7ff9c8003c20 2024-09-13T15:10:06.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.846+0000 7ff9da000700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff9c4066760 0x7ff9c4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.846+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5677+0+0 (secure 0 0 0) 0x7ff9d4084bf0 con 0x7ff9c8003c20 2024-09-13T15:10:06.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.850+0000 7ff9e1400700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff9c4066760 0x7ff9c4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.850+0000 7ff9e1400700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff9c4066760 0x7ff9c4068c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff9e415d680 tx=0x7ff9d0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:06.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:06.854+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9d4051f70 con 0x7ff9c8003c20 2024-09-13T15:10:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.038+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff9e40711e0 con 0x7ff9c8003c20 2024-09-13T15:10:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.614+0000 7ff9da000700 1 -- 172.21.15.50:0/2271475215 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9d4055590 con 0x7ff9c8003c20 2024-09-13T15:10:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff9c4066760 msgr2=0x7ff9c4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff9c4066760 0x7ff9c4068c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff9e415d680 tx=0x7ff9d0008040 comp rx=0 tx=0).stop 2024-09-13T15:10:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 msgr2=0x7ff9e414f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9e414f1e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c1a0 tx=0x7ff9d40012d0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 shutdown_connections 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff9c4066760 0x7ff9c4068c20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff9e40c46a0 0x7ff9e40c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9e40c4220 0x7ff9e40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 --2- 172.21.15.50:0/2271475215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9c8003c20 0x7ff9e414f1e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 >> 172.21.15.50:0/2271475215 conn(0x7ff9e40b05a0 msgr2=0x7ff9e40715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 shutdown_connections 2024-09-13T15:10:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.622+0000 7ff9e3200700 1 -- 172.21.15.50:0/2271475215 wait complete. 2024-09-13T15:10:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:10:07.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T15:10:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.826+0000 7f73df600700 1 Processor -- start 2024-09-13T15:10:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.826+0000 7f73df600700 1 -- start start 2024-09-13T15:10:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73df600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73d806c4c0 0x7f73d80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73df600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d815ea30 con 0x7f73d8146720 2024-09-13T15:10:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73df600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d8070670 con 0x7f73d806c8c0 2024-09-13T15:10:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73df600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d8070950 con 0x7f73d806c4c0 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73d806c4c0 0x7f73d80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73dcc00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73d8146720 0x7f73d815e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59100/0 (socket says 172.21.15.50:59100) 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73dcc00700 1 -- 172.21.15.50:0/1252436847 learned_addr learned my addr 172.21.15.50:0/1252436847 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7e00700 1 -- 172.21.15.50:0/1252436847 >> v1:172.21.15.181:6789/0 conn(0x7f73d806c8c0 legacy=0x7f73d8071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7e00700 1 -- 172.21.15.50:0/1252436847 >> v1:172.21.15.50:6789/0 conn(0x7f73d8146720 legacy=0x7f73d815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7e00700 1 -- 172.21.15.50:0/1252436847 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8070c30 con 0x7f73d806c4c0 2024-09-13T15:10:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7400700 1 -- 172.21.15.50:0/1252436847 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744441028 0 0) 0x7f73d815ea30 con 0x7f73d8146720 2024-09-13T15:10:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7e00700 1 --2- 172.21.15.50:0/1252436847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d80ceb70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009850 tx=0x7f73c4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14d24bf1a1e1573 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7400700 1 -- 172.21.15.50:0/1252436847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011830 con 0x7f73d806c4c0 2024-09-13T15:10:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7400700 1 -- 172.21.15.50:0/1252436847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4011990 con 0x7f73d806c4c0 2024-09-13T15:10:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.830+0000 7f73d7400700 1 -- 172.21.15.50:0/1252436847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011d20 con 0x7f73d806c4c0 2024-09-13T15:10:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 -- 172.21.15.50:0/1252436847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 msgr2=0x7f73d80ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 --2- 172.21.15.50:0/1252436847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d80ceb70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009850 tx=0x7f73c4009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 -- 172.21.15.50:0/1252436847 shutdown_connections 2024-09-13T15:10:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 --2- 172.21.15.50:0/1252436847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d80ceb70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 -- 172.21.15.50:0/1252436847 >> 172.21.15.50:0/1252436847 conn(0x7f73d806a570 msgr2=0x7f73d806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:07.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 -- 172.21.15.50:0/1252436847 shutdown_connections 2024-09-13T15:10:07.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 -- 172.21.15.50:0/1252436847 wait complete. 2024-09-13T15:10:07.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.834+0000 7f73df600700 1 Processor -- start 2024-09-13T15:10:07.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 -- start start 2024-09-13T15:10:07.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d81438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:07.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73d806c8c0 0x7f73d80c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:07.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73d8146720 0x7f73d80c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:07.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d8143df0 con 0x7f73d806c4c0 2024-09-13T15:10:07.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d815aac0 con 0x7f73d8146720 2024-09-13T15:10:07.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73df600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d8159740 con 0x7f73d806c8c0 2024-09-13T15:10:07.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d81438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:07.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d81438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39498/0 (socket says 172.21.15.50:39498) 2024-09-13T15:10:07.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 -- 172.21.15.50:0/2136119149 learned_addr learned my addr 172.21.15.50:0/2136119149 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:07.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73d7e00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73d806c8c0 0x7f73d80c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:07.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dd600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73d8146720 0x7f73d80c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:07.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 -- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73d806c8c0 msgr2=0x7f73d80c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73d806c8c0 0x7f73d80c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 -- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73d8146720 msgr2=0x7f73d80c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73d8146720 0x7f73d80c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 -- 172.21.15.50:0/2136119149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40094b0 con 0x7f73d806c4c0 2024-09-13T15:10:07.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.838+0000 7f73dcc00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d81438b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c4d0 tx=0x7f73cc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.842+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00cea0 con 0x7f73d806c4c0 2024-09-13T15:10:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.842+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc004ca0 con 0x7f73d806c4c0 2024-09-13T15:10:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.842+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d8159a20 con 0x7f73d806c4c0 2024-09-13T15:10:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.842+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc007310 con 0x7f73d806c4c0 2024-09-13T15:10:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.842+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d8159fe0 con 0x7f73d806c4c0 2024-09-13T15:10:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.842+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d815e320 con 0x7f73d806c4c0 2024-09-13T15:10:07.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.846+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f73cc007470 con 0x7f73d806c4c0 2024-09-13T15:10:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.846+0000 7f73d4c00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73b8066730 0x7f73b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.846+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f73cc083c20 con 0x7f73d806c4c0 2024-09-13T15:10:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.846+0000 7f73d7e00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73b8066730 0x7f73b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:07.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.846+0000 7f73d7e00700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73b8066730 0x7f73b8068bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f73c4000c00 tx=0x7f73c4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:07.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:07.854+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f73cc051020 con 0x7f73d806c4c0 2024-09-13T15:10:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.034+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f73d815c120 con 0x7f73d806c4c0 2024-09-13T15:10:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73d4c00700 1 -- 172.21.15.50:0/2136119149 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f73cc007720 con 0x7f73d806c4c0 2024-09-13T15:10:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73b8066730 msgr2=0x7f73b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73b8066730 0x7f73b8068bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f73c4000c00 tx=0x7f73c4008030 comp rx=0 tx=0).stop 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 msgr2=0x7f73d81438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d81438b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c4d0 tx=0x7f73cc00c7e0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 shutdown_connections 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f73b8066730 0x7f73b8068bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73d8146720 0x7f73d80c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73d806c8c0 0x7f73d80c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 --2- 172.21.15.50:0/2136119149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d806c4c0 0x7f73d81438b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 >> 172.21.15.50:0/2136119149 conn(0x7f73d806a570 msgr2=0x7f73d8144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 shutdown_connections 2024-09-13T15:10:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.046+0000 7f73df600700 1 -- 172.21.15.50:0/2136119149 wait complete. 2024-09-13T15:10:08.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-13T15:10:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.254+0000 7fbebfe00700 1 Processor -- start 2024-09-13T15:10:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.254+0000 7fbebfe00700 1 -- start start 2024-09-13T15:10:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebfe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbeb81446c0 0x7fbeb80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbeb80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebfe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb80b4d10 con 0x7fbeb80cfcf0 2024-09-13T15:10:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebfe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb80d14a0 con 0x7fbeb81446c0 2024-09-13T15:10:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebfe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8144aa0 con 0x7fbeb80d0af0 2024-09-13T15:10:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebca00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbeb80cfcf0 0x7fbeb80cc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59108/0 (socket says 172.21.15.50:59108) 2024-09-13T15:10:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebca00700 1 -- 172.21.15.50:0/4279428673 learned_addr learned my addr 172.21.15.50:0/4279428673 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebd400700 1 --2- 172.21.15.50:0/4279428673 >> v2:172.21.15.181:3300/0 conn(0x7fbeb81446c0 0x7fbeb80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebde00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbeb80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607524528 0 0) 0x7fbeb80b4d10 con 0x7fbeb80cfcf0 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea00035d0 con 0x7fbeb80cfcf0 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3525528399 0 0) 0x7fbea00035d0 con 0x7fbeb80cfcf0 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 msgr2=0x7fbeb80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbeb80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 >> v2:172.21.15.181:3300/0 conn(0x7fbeb81446c0 msgr2=0x7fbeb80b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 --2- 172.21.15.50:0/4279428673 >> v2:172.21.15.181:3300/0 conn(0x7fbeb81446c0 0x7fbeb80b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb80b4100 con 0x7fbeb80cfcf0 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fbea4001670 con 0x7fbeb80cfcf0 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 >> v1:172.21.15.50:6789/0 conn(0x7fbeb80cfcf0 legacy=0x7fbeb80cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea0003a20 0x7fbea0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbea0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbea0004db0 0x7fbea0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80d14a0 con 0x7fbea0003a20 2024-09-13T15:10:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8144aa0 con 0x7fbea0004db0 2024-09-13T15:10:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea000ba30 con 0x7fbeb80d0af0 2024-09-13T15:10:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebd400700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea0003a20 0x7fbea0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.258+0000 7fbebca00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbea0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebde00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbea0004db0 0x7fbea0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebca00700 1 -- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbea0004db0 msgr2=0x7fbea0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebca00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbea0004db0 0x7fbea0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebca00700 1 -- 172.21.15.50:0/4279428673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea0003a20 msgr2=0x7fbea0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebca00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea0003a20 0x7fbea0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebca00700 1 -- 172.21.15.50:0/4279428673 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00035d0 con 0x7fbeb80d0af0 2024-09-13T15:10:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebd400700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbea0003a20 0x7fbea0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebca00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbea0004870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c2f0 tx=0x7fbea00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde225a2bca46c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400ce30 con 0x7fbeb80d0af0 2024-09-13T15:10:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea4005980 con 0x7fbeb80d0af0 2024-09-13T15:10:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbeb7e00700 1 -- 172.21.15.50:0/4279428673 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4005d30 con 0x7fbeb80d0af0 2024-09-13T15:10:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebfe00700 1 -- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 msgr2=0x7fbea0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebfe00700 1 --2- 172.21.15.50:0/4279428673 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb80d0af0 0x7fbea0004870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c2f0 tx=0x7fbea00058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebde00700 1 -- 172.21.15.50:0/4279428673 reap_dead start 2024-09-13T15:10:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebfe00700 1 -- 172.21.15.50:0/4279428673 shutdown_connections 2024-09-13T15:10:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebfe00700 1 -- 172.21.15.50:0/4279428673 >> 172.21.15.50:0/4279428673 conn(0x7fbeb80726d0 msgr2=0x7fbeb806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebfe00700 1 -- 172.21.15.50:0/4279428673 shutdown_connections 2024-09-13T15:10:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.262+0000 7fbebfe00700 1 -- 172.21.15.50:0/4279428673 wait complete. 2024-09-13T15:10:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.266+0000 7fbebfe00700 1 Processor -- start 2024-09-13T15:10:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.266+0000 7fbebfe00700 1 -- start start 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 0x7fbeb8140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb81422b0 0x7fbeb8142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbeb8159860 0x7fbeb8159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb815a220 con 0x7fbeb80d0af0 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8140ab0 con 0x7fbeb8159860 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8142e10 con 0x7fbeb81422b0 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 0x7fbeb8140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 0x7fbeb8140570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39502/0 (socket says 172.21.15.50:39502) 2024-09-13T15:10:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 -- 172.21.15.50:0/489596029 learned_addr learned my addr 172.21.15.50:0/489596029 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebde00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbeb8159860 0x7fbeb8159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebca00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb81422b0 0x7fbeb8142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 -- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb81422b0 msgr2=0x7fbeb8142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb81422b0 0x7fbeb8142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 -- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbeb8159860 msgr2=0x7fbeb8159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbeb8159860 0x7fbeb8159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 -- 172.21.15.50:0/489596029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb81430f0 con 0x7fbeb80d0af0 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebca00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb81422b0 0x7fbeb8142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebde00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbeb8159860 0x7fbeb8159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebd400700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 0x7fbeb8140570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbeac011cd0 tx=0x7fbeac00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac011e70 con 0x7fbeb80d0af0 2024-09-13T15:10:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac00fd40 con 0x7fbeb80d0af0 2024-09-13T15:10:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb81433d0 con 0x7fbeb80d0af0 2024-09-13T15:10:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac004240 con 0x7fbeb80d0af0 2024-09-13T15:10:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.270+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb815a550 con 0x7fbeb80d0af0 2024-09-13T15:10:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.274+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb80b3a70 con 0x7fbeb80d0af0 2024-09-13T15:10:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.274+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbeac0043a0 con 0x7fbeb80d0af0 2024-09-13T15:10:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.274+0000 7fbeb5600700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbe98066730 0x7fbe98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.274+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbeac0846e0 con 0x7fbeb80d0af0 2024-09-13T15:10:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.278+0000 7fbebca00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbe98066730 0x7fbe98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.278+0000 7fbebca00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbe98066730 0x7fbe98068bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbeb806a400 tx=0x7fbea400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.282+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbeac051b70 con 0x7fbeb80d0af0 2024-09-13T15:10:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.542+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7fbeb813d550 con 0x7fbeb80d0af0 2024-09-13T15:10:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.618+0000 7fbeb5600700 1 -- 172.21.15.50:0/489596029 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v164) v1 ==== 153+0+0 (secure 0 0 0) 0x7fbeac022020 con 0x7fbeb80d0af0 2024-09-13T15:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbe98066730 msgr2=0x7fbe98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbe98066730 0x7fbe98068bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbeb806a400 tx=0x7fbea400a000 comp rx=0 tx=0).stop 2024-09-13T15:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 msgr2=0x7fbeb8140570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 0x7fbeb8140570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbeac011cd0 tx=0x7fbeac00f520 comp rx=0 tx=0).stop 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 shutdown_connections 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbe98066730 0x7fbe98068bf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbeb8159860 0x7fbeb8159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbeb81422b0 0x7fbeb8142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 --2- 172.21.15.50:0/489596029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb80d0af0 0x7fbeb8140570 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 >> 172.21.15.50:0/489596029 conn(0x7fbeb80726d0 msgr2=0x7fbeb80c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 shutdown_connections 2024-09-13T15:10:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.622+0000 7fbebfe00700 1 -- 172.21.15.50:0/489596029 wait complete. 2024-09-13T15:10:08.651 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... skipped 'Requires FUSE client to use mds_cluster.is_addr_blocklisted()' 2024-09-13T15:10:08.652 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T15:10:08.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 Processor -- start 2024-09-13T15:10:08.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 -- start start 2024-09-13T15:10:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 0x7f5da40719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5da406aaa0 0x7f5da406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40b3560 con 0x7f5da40b2670 2024-09-13T15:10:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da4070b30 con 0x7f5da406aaa0 2024-09-13T15:10:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.822+0000 7f5da8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da406b420 con 0x7f5da41610b0 2024-09-13T15:10:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 0x7f5da40719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5da40b2670 0x7f5da40cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:58002/0 (socket says 172.21.15.50:58002) 2024-09-13T15:10:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3e00700 1 -- 172.21.15.50:0/459866388 learned_addr learned my addr 172.21.15.50:0/459866388 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 0x7f5da40719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:53846/0 (socket says 172.21.15.50:53846) 2024-09-13T15:10:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da2a00700 1 --2- 172.21.15.50:0/459866388 >> v2:172.21.15.181:3300/0 conn(0x7f5da406aaa0 0x7f5da406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 -- 172.21.15.50:0/459866388 >> v2:172.21.15.181:3300/0 conn(0x7f5da406aaa0 msgr2=0x7f5da406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 --2- 172.21.15.50:0/459866388 >> v2:172.21.15.181:3300/0 conn(0x7f5da406aaa0 0x7f5da406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 -- 172.21.15.50:0/459866388 >> v1:172.21.15.181:6789/0 conn(0x7f5da40b2670 legacy=0x7f5da40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da2000700 1 -- 172.21.15.50:0/459866388 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034932710 0 0) 0x7f5da40b3560 con 0x7f5da40b2670 2024-09-13T15:10:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 -- 172.21.15.50:0/459866388 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40b3280 con 0x7f5da41610b0 2024-09-13T15:10:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da3400700 1 --2- 172.21.15.50:0/459866388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 0x7f5da40719c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009850 tx=0x7f5d94009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e72815bc54c8e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da2000700 1 -- 172.21.15.50:0/459866388 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011830 con 0x7f5da41610b0 2024-09-13T15:10:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da2000700 1 -- 172.21.15.50:0/459866388 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94011990 con 0x7f5da41610b0 2024-09-13T15:10:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da2000700 1 -- 172.21.15.50:0/459866388 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011d40 con 0x7f5da41610b0 2024-09-13T15:10:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 -- 172.21.15.50:0/459866388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 msgr2=0x7f5da40719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 --2- 172.21.15.50:0/459866388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 0x7f5da40719c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009850 tx=0x7f5d94009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 -- 172.21.15.50:0/459866388 shutdown_connections 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 --2- 172.21.15.50:0/459866388 >> v2:172.21.15.181:3300/0 conn(0x7f5da406aaa0 0x7f5da406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 --2- 172.21.15.50:0/459866388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da41610b0 0x7f5da40719c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 -- 172.21.15.50:0/459866388 >> 172.21.15.50:0/459866388 conn(0x7f5da40b0c40 msgr2=0x7f5da406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.826+0000 7f5da8a00700 1 -- 172.21.15.50:0/459866388 shutdown_connections 2024-09-13T15:10:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.830+0000 7f5da8a00700 1 -- 172.21.15.50:0/459866388 wait complete. 2024-09-13T15:10:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.830+0000 7f5da8a00700 1 Processor -- start 2024-09-13T15:10:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.830+0000 7f5da8a00700 1 -- start start 2024-09-13T15:10:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.830+0000 7f5da8a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da406aaa0 0x7f5da415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5da40b2670 0x7f5da40a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 0x7f5da40aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4162790 con 0x7f5da41610b0 2024-09-13T15:10:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40a9990 con 0x7f5da40b2670 2024-09-13T15:10:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40a9c70 con 0x7f5da406aaa0 2024-09-13T15:10:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 0x7f5da40aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 0x7f5da40aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39512/0 (socket says 172.21.15.50:39512) 2024-09-13T15:10:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 -- 172.21.15.50:0/3779991105 learned_addr learned my addr 172.21.15.50:0/3779991105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da2a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5da40b2670 0x7f5da40a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3400700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da406aaa0 0x7f5da415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 -- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da406aaa0 msgr2=0x7f5da415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da406aaa0 0x7f5da415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 -- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5da40b2670 msgr2=0x7f5da40a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5da40b2670 0x7f5da40a8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 -- 172.21.15.50:0/3779991105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940094b0 con 0x7f5da41610b0 2024-09-13T15:10:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da2a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5da40b2670 0x7f5da40a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da3e00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 0x7f5da40aaba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c002230 tx=0x7f5d9c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00ac20 con 0x7f5da41610b0 2024-09-13T15:10:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00ada0 con 0x7f5da41610b0 2024-09-13T15:10:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c007310 con 0x7f5da41610b0 2024-09-13T15:10:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4162a30 con 0x7f5da41610b0 2024-09-13T15:10:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.834+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da415c4c0 con 0x7f5da41610b0 2024-09-13T15:10:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.838+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da4162c50 con 0x7f5da41610b0 2024-09-13T15:10:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.838+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d9c007470 con 0x7f5da41610b0 2024-09-13T15:10:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.838+0000 7f5d9b400700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5d84066730 0x7f5d84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.838+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5d9c083ba0 con 0x7f5da41610b0 2024-09-13T15:10:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.838+0000 7f5da3400700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5d84066730 0x7f5d84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.842+0000 7f5da3400700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5d84066730 0x7f5d84068bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d940090b0 tx=0x7f5d9401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:08.846+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5d9c0510c0 con 0x7f5da41610b0 2024-09-13T15:10:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.042+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5da4161490 con 0x7f5da41610b0 2024-09-13T15:10:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.042+0000 7f5d9b400700 1 -- 172.21.15.50:0/3779991105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+13177 (secure 0 0 0) 0x7f5d9c018020 con 0x7f5da41610b0 2024-09-13T15:10:09.050 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:09.050 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:07.612453+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/442961988":"2024-09-14T15:10:04.581422+0000","172.21.15.50:6833/442961988":"2024-09-14T15:10:04.581422+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5d84066730 msgr2=0x7f5d84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5d84066730 0x7f5d84068bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d940090b0 tx=0x7f5d9401c040 comp rx=0 tx=0).stop 2024-09-13T15:10:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 msgr2=0x7f5da40aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 0x7f5da40aaba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c002230 tx=0x7f5d9c00a060 comp rx=0 tx=0).stop 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 shutdown_connections 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5d84066730 0x7f5d84068bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5da41610b0 0x7f5da40aaba0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5da40b2670 0x7f5da40a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 --2- 172.21.15.50:0/3779991105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5da406aaa0 0x7f5da415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 >> 172.21.15.50:0/3779991105 conn(0x7f5da40b0c40 msgr2=0x7f5da40b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 shutdown_connections 2024-09-13T15:10:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.050+0000 7f5da8a00700 1 -- 172.21.15.50:0/3779991105 wait complete. 2024-09-13T15:10:09.076 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:09.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.258+0000 7fe2c6000700 1 Processor -- start 2024-09-13T15:10:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.258+0000 7fe2c6000700 1 -- start start 2024-09-13T15:10:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c6000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe2c006d620 0x7fe2c006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c6000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2c006cea0 0x7fe2c00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c6000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c00b1980 con 0x7fe2c0143b70 2024-09-13T15:10:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c6000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00b2500 con 0x7fe2c006cea0 2024-09-13T15:10:09.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c6000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c006d2f0 con 0x7fe2c006d620 2024-09-13T15:10:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c4c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2c0143b70 0x7fe2c00cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59124/0 (socket says 172.21.15.50:59124) 2024-09-13T15:10:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c4c00700 1 -- 172.21.15.50:0/1461283152 learned_addr learned my addr 172.21.15.50:0/1461283152 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c5600700 1 --2- 172.21.15.50:0/1461283152 >> v2:172.21.15.50:3300/0 conn(0x7fe2c006cea0 0x7fe2c00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2bfe00700 1 --2- 172.21.15.50:0/1461283152 >> v2:172.21.15.181:3300/0 conn(0x7fe2c006d620 0x7fe2c006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c5600700 1 -- 172.21.15.50:0/1461283152 >> v2:172.21.15.181:3300/0 conn(0x7fe2c006d620 msgr2=0x7fe2c006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c5600700 1 --2- 172.21.15.50:0/1461283152 >> v2:172.21.15.181:3300/0 conn(0x7fe2c006d620 0x7fe2c006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c5600700 1 -- 172.21.15.50:0/1461283152 >> v1:172.21.15.50:6789/0 conn(0x7fe2c0143b70 legacy=0x7fe2c00cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2bf400700 1 -- 172.21.15.50:0/1461283152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605883811 0 0) 0x7fe2c00b1980 con 0x7fe2c0143b70 2024-09-13T15:10:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c5600700 1 -- 172.21.15.50:0/1461283152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00b1bd0 con 0x7fe2c006cea0 2024-09-13T15:10:09.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2c5600700 1 --2- 172.21.15.50:0/1461283152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006cea0 0x7fe2c00b2990 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00ce860 tx=0x7fe2b8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5a19eeb7534972 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2bf400700 1 -- 172.21.15.50:0/1461283152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8011830 con 0x7fe2c006cea0 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2bf400700 1 -- 172.21.15.50:0/1461283152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8011990 con 0x7fe2c006cea0 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.262+0000 7fe2bf400700 1 -- 172.21.15.50:0/1461283152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8011d20 con 0x7fe2c006cea0 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 -- 172.21.15.50:0/1461283152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006cea0 msgr2=0x7fe2c00b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 --2- 172.21.15.50:0/1461283152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006cea0 0x7fe2c00b2990 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00ce860 tx=0x7fe2b8009b30 comp rx=0 tx=0).stop 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 -- 172.21.15.50:0/1461283152 shutdown_connections 2024-09-13T15:10:09.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 --2- 172.21.15.50:0/1461283152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006cea0 0x7fe2c00b2990 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 --2- 172.21.15.50:0/1461283152 >> v2:172.21.15.181:3300/0 conn(0x7fe2c006d620 0x7fe2c006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 -- 172.21.15.50:0/1461283152 >> 172.21.15.50:0/1461283152 conn(0x7fe2c006a390 msgr2=0x7fe2c006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 -- 172.21.15.50:0/1461283152 shutdown_connections 2024-09-13T15:10:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 -- 172.21.15.50:0/1461283152 wait complete. 2024-09-13T15:10:09.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 Processor -- start 2024-09-13T15:10:09.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.266+0000 7fe2c6000700 1 -- start start 2024-09-13T15:10:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2c006cea0 0x7fe2c01369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 0x7fe2c00adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2c0143b70 0x7fe2c0137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c01391d0 con 0x7fe2c006d620 2024-09-13T15:10:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0136510 con 0x7fe2c0143b70 2024-09-13T15:10:09.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0137c80 con 0x7fe2c006cea0 2024-09-13T15:10:09.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 0x7fe2c00adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 0x7fe2c00adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39530/0 (socket says 172.21.15.50:39530) 2024-09-13T15:10:09.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 -- 172.21.15.50:0/133712049 learned_addr learned my addr 172.21.15.50:0/133712049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c4c00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2c006cea0 0x7fe2c01369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c5600700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2c0143b70 0x7fe2c0137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 -- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2c006cea0 msgr2=0x7fe2c01369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2c006cea0 0x7fe2c01369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 -- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2c0143b70 msgr2=0x7fe2c0137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2c0143b70 0x7fe2c0137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 -- 172.21.15.50:0/133712049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80094b0 con 0x7fe2c006d620 2024-09-13T15:10:09.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bfe00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 0x7fe2c00adbf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00e9d0 tx=0x7fe2ac00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:09.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac009720 con 0x7fe2c006d620 2024-09-13T15:10:09.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac00ee70 con 0x7fe2c006d620 2024-09-13T15:10:09.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c0135be0 con 0x7fe2c006d620 2024-09-13T15:10:09.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00c9f0 con 0x7fe2c006d620 2024-09-13T15:10:09.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.270+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c01361a0 con 0x7fe2c006d620 2024-09-13T15:10:09.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.274+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c01366c0 con 0x7fe2c006d620 2024-09-13T15:10:09.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.274+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2ac00cb50 con 0x7fe2c006d620 2024-09-13T15:10:09.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.274+0000 7fe2bcc00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2a0066760 0x7fe2a0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.274+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe2ac083e40 con 0x7fe2c006d620 2024-09-13T15:10:09.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.278+0000 7fe2c4c00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2a0066760 0x7fe2a0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.278+0000 7fe2c4c00700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2a0066760 0x7fe2a0068c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40012e0 tx=0x7fe2b4001b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:09.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.278+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2c01366c0 con 0x7fe2c006d620 2024-09-13T15:10:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.458+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2c0136680 con 0x7fe2c006d620 2024-09-13T15:10:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.458+0000 7fe2bcc00700 1 -- 172.21.15.50:0/133712049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2ac054e70 con 0x7fe2c006d620 2024-09-13T15:10:09.465 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:09.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2a0066760 msgr2=0x7fe2a0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2a0066760 0x7fe2a0068c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40012e0 tx=0x7fe2b4001b70 comp rx=0 tx=0).stop 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 msgr2=0x7fe2c00adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 0x7fe2c00adbf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00e9d0 tx=0x7fe2ac00ece0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 shutdown_connections 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe2a0066760 0x7fe2a0068c20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2c0143b70 0x7fe2c0137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2c006d620 0x7fe2c00adbf0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 --2- 172.21.15.50:0/133712049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2c006cea0 0x7fe2c01369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 >> 172.21.15.50:0/133712049 conn(0x7fe2c006a390 msgr2=0x7fe2c00af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 shutdown_connections 2024-09-13T15:10:09.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.462+0000 7fe2c6000700 1 -- 172.21.15.50:0/133712049 wait complete. 2024-09-13T15:10:09.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-13T15:10:09.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.658+0000 7f87dd800700 1 Processor -- start 2024-09-13T15:10:09.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.658+0000 7f87dd800700 1 -- start start 2024-09-13T15:10:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87dd800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87d80cb020 0x7f87d80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87dd800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80b2ad0 con 0x7f87d806aaa0 2024-09-13T15:10:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87dd800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d815b960 con 0x7f87d815c2a0 2024-09-13T15:10:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87dd800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d815bc40 con 0x7f87d80cb020 2024-09-13T15:10:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87d7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87d80cb020 0x7f87d80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87d7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87d80cb020 0x7f87d80cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39542/0 (socket says 172.21.15.50:39542) 2024-09-13T15:10:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87d7e00700 1 -- 172.21.15.50:0/1087000772 learned_addr learned my addr 172.21.15.50:0/1087000772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87d7e00700 1 -- 172.21.15.50:0/1087000772 >> v1:172.21.15.181:6789/0 conn(0x7f87d815c2a0 legacy=0x7f87d815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87d7e00700 1 -- 172.21.15.50:0/1087000772 >> v1:172.21.15.50:6789/0 conn(0x7f87d806aaa0 legacy=0x7f87d80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.662+0000 7f87d7e00700 1 -- 172.21.15.50:0/1087000772 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d815bf20 con 0x7f87d80cb020 2024-09-13T15:10:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87d7e00700 1 --2- 172.21.15.50:0/1087000772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d80cb020 0x7f87d80cc6f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009e50 tx=0x7f87c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b1630f92f9e9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87d7400700 1 -- 172.21.15.50:0/1087000772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800e070 con 0x7f87d80cb020 2024-09-13T15:10:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87d7400700 1 -- 172.21.15.50:0/1087000772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c800b9c0 con 0x7f87d80cb020 2024-09-13T15:10:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87d7400700 1 -- 172.21.15.50:0/1087000772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800bd70 con 0x7f87d80cb020 2024-09-13T15:10:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 -- 172.21.15.50:0/1087000772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d80cb020 msgr2=0x7f87d80cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 --2- 172.21.15.50:0/1087000772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d80cb020 0x7f87d80cc6f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009e50 tx=0x7f87c800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 -- 172.21.15.50:0/1087000772 shutdown_connections 2024-09-13T15:10:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 --2- 172.21.15.50:0/1087000772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d80cb020 0x7f87d80cc6f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 -- 172.21.15.50:0/1087000772 >> 172.21.15.50:0/1087000772 conn(0x7f87d80b0c40 msgr2=0x7f87d806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 -- 172.21.15.50:0/1087000772 shutdown_connections 2024-09-13T15:10:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.666+0000 7f87dd800700 1 -- 172.21.15.50:0/1087000772 wait complete. 2024-09-13T15:10:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 Processor -- start 2024-09-13T15:10:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 -- start start 2024-09-13T15:10:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d806aaa0 0x7f87d80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87d80cb020 0x7f87d81e4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 0x7f87d81f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80c81f0 con 0x7f87d815c2a0 2024-09-13T15:10:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81f2e30 con 0x7f87d806aaa0 2024-09-13T15:10:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81f3110 con 0x7f87d80cb020 2024-09-13T15:10:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 0x7f87d81f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 0x7f87d81f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39550/0 (socket says 172.21.15.50:39550) 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 -- 172.21.15.50:0/2505537473 learned_addr learned my addr 172.21.15.50:0/2505537473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87cf400700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87d80cb020 0x7f87d81e4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87d7e00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d806aaa0 0x7f87d80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 -- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87d80cb020 msgr2=0x7f87d81e4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87d80cb020 0x7f87d81e4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 -- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d806aaa0 msgr2=0x7f87d80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d806aaa0 0x7f87d80c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 -- 172.21.15.50:0/2505537473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8009b30 con 0x7f87d815c2a0 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dce00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 0x7f87d81f2370 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c480 tx=0x7f87d000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00052d0 con 0x7f87d815c2a0 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0005430 con 0x7f87d815c2a0 2024-09-13T15:10:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00055a0 con 0x7f87d815c2a0 2024-09-13T15:10:09.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.670+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d80c7e10 con 0x7f87d815c2a0 2024-09-13T15:10:09.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.674+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d80c9960 con 0x7f87d815c2a0 2024-09-13T15:10:09.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.674+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d80c8330 con 0x7f87d815c2a0 2024-09-13T15:10:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.674+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87d00038e0 con 0x7f87d815c2a0 2024-09-13T15:10:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.678+0000 7f87d4c00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f87b4066730 0x7f87b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.678+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f87d0083500 con 0x7f87d815c2a0 2024-09-13T15:10:09.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.678+0000 7f87d7e00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f87b4066730 0x7f87b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:09.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.678+0000 7f87d7e00700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f87b4066730 0x7f87b4068bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b370 tx=0x7f87c8009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:09.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.682+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87d0050a20 con 0x7f87d815c2a0 2024-09-13T15:10:09.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:09.926+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7f87d80b3ce0 con 0x7f87d815c2a0 2024-09-13T15:10:10.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.630+0000 7f87d4c00700 1 -- 172.21.15.50:0/2505537473 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v166) v1 ==== 145+0+0 (secure 0 0 0) 0x7f87d0054040 con 0x7f87d815c2a0 2024-09-13T15:10:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f87b4066730 msgr2=0x7f87b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f87b4066730 0x7f87b4068bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b370 tx=0x7f87c8009000 comp rx=0 tx=0).stop 2024-09-13T15:10:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 msgr2=0x7f87d81f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 0x7f87d81f2370 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c480 tx=0x7f87d000c840 comp rx=0 tx=0).stop 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 shutdown_connections 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f87b4066730 0x7f87b4068bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87d815c2a0 0x7f87d81f2370 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87d80cb020 0x7f87d81e4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 --2- 172.21.15.50:0/2505537473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d806aaa0 0x7f87d80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 >> 172.21.15.50:0/2505537473 conn(0x7f87d80b0c40 msgr2=0x7f87d806ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 shutdown_connections 2024-09-13T15:10:10.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.634+0000 7f87dd800700 1 -- 172.21.15.50:0/2505537473 wait complete. 2024-09-13T15:10:10.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T15:10:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.838+0000 7f8183200700 1 Processor -- start 2024-09-13T15:10:10.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.838+0000 7f8183200700 1 -- start start 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.838+0000 7f8183200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f818406c5a0 0x7f818415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.838+0000 7f8183200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81840cf830 0x7f81840cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840b4680 con 0x7f818406c980 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840b5dd0 con 0x7f818406c5a0 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840b4960 con 0x7f81840cf830 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f818406c5a0 0x7f818415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f818406c5a0 0x7f818415aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39566/0 (socket says 172.21.15.50:39566) 2024-09-13T15:10:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 -- 172.21.15.50:0/3110537870 learned_addr learned my addr 172.21.15.50:0/3110537870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8182800700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81840cf830 0x7f81840cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 -- 172.21.15.50:0/3110537870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81840cf830 msgr2=0x7f81840cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:10.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81840cf830 0x7f81840cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 -- 172.21.15.50:0/3110537870 >> v1:172.21.15.50:6789/0 conn(0x7f818406c980 legacy=0x7f81840b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 -- 172.21.15.50:0/3110537870 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840cf030 con 0x7f818406c5a0 2024-09-13T15:10:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8182800700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81840cf830 0x7f81840cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8181e00700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f818406c5a0 0x7f818415aa90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8174009910 tx=0x7f8174009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8e2264c8b1b837 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8180a00700 1 -- 172.21.15.50:0/3110537870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400ba60 con 0x7f818406c5a0 2024-09-13T15:10:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8180a00700 1 -- 172.21.15.50:0/3110537870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817400bbc0 con 0x7f818406c5a0 2024-09-13T15:10:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8180a00700 1 -- 172.21.15.50:0/3110537870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174009e60 con 0x7f818406c5a0 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- 172.21.15.50:0/3110537870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f818406c5a0 msgr2=0x7f818415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f818406c5a0 0x7f818415aa90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8174009910 tx=0x7f8174009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- 172.21.15.50:0/3110537870 shutdown_connections 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f81840cf830 0x7f81840cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 --2- 172.21.15.50:0/3110537870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f818406c5a0 0x7f818415aa90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- 172.21.15.50:0/3110537870 >> 172.21.15.50:0/3110537870 conn(0x7f8184071d20 msgr2=0x7f8184072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.842+0000 7f8183200700 1 -- 172.21.15.50:0/3110537870 shutdown_connections 2024-09-13T15:10:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.846+0000 7f8183200700 1 -- 172.21.15.50:0/3110537870 wait complete. 2024-09-13T15:10:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.846+0000 7f8183200700 1 Processor -- start 2024-09-13T15:10:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 -- start start 2024-09-13T15:10:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818406c5a0 0x7f81841f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818406c980 0x7f8184158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 0x7f8184158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184159360 con 0x7f81840cf830 2024-09-13T15:10:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184159640 con 0x7f818406c980 2024-09-13T15:10:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8183200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8184159920 con 0x7f818406c5a0 2024-09-13T15:10:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 0x7f8184158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 0x7f8184158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39572/0 (socket says 172.21.15.50:39572) 2024-09-13T15:10:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8181400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818406c980 0x7f8184158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 -- 172.21.15.50:0/272993598 learned_addr learned my addr 172.21.15.50:0/272993598 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8181e00700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818406c5a0 0x7f81841f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 -- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818406c5a0 msgr2=0x7f81841f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818406c5a0 0x7f81841f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 -- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818406c980 msgr2=0x7f8184158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818406c980 0x7f8184158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 -- 172.21.15.50:0/272993598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174009570 con 0x7f81840cf830 2024-09-13T15:10:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8181400700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818406c980 0x7f8184158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.850+0000 7f8182800700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 0x7f8184158d50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f817c00cd50 tx=0x7f817c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:10.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.854+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c00cea0 con 0x7f81840cf830 2024-09-13T15:10:10.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.854+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c00f480 con 0x7f81840cf830 2024-09-13T15:10:10.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.854+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8184159c00 con 0x7f81840cf830 2024-09-13T15:10:10.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.854+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c00f830 con 0x7f81840cf830 2024-09-13T15:10:10.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.854+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8184148910 con 0x7f81840cf830 2024-09-13T15:10:10.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.854+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818415a120 con 0x7f81840cf830 2024-09-13T15:10:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.858+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f817c00b040 con 0x7f81840cf830 2024-09-13T15:10:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.858+0000 7f817a000700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8164066730 0x7f8164068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.858+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f817c084770 con 0x7f81840cf830 2024-09-13T15:10:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.858+0000 7f8181e00700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8164066730 0x7f8164068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.862+0000 7f8181e00700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8164066730 0x7f8164068bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8174000c00 tx=0x7f8174008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:10.866+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f818415a120 con 0x7f81840cf830 2024-09-13T15:10:11.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.046+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f818415a120 con 0x7f81840cf830 2024-09-13T15:10:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f817a000700 1 -- 172.21.15.50:0/272993598 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f818415a120 con 0x7f81840cf830 2024-09-13T15:10:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8164066730 msgr2=0x7f8164068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8164066730 0x7f8164068bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8174000c00 tx=0x7f8174008030 comp rx=0 tx=0).stop 2024-09-13T15:10:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 msgr2=0x7f8184158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 0x7f8184158d50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f817c00cd50 tx=0x7f817c00a560 comp rx=0 tx=0).stop 2024-09-13T15:10:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 shutdown_connections 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8164066730 0x7f8164068bf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81840cf830 0x7f8184158d50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818406c980 0x7f8184158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 --2- 172.21.15.50:0/272993598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f818406c5a0 0x7f81841f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 >> 172.21.15.50:0/272993598 conn(0x7f8184071d20 msgr2=0x7f818415b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 shutdown_connections 2024-09-13T15:10:11.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.058+0000 7f8183200700 1 -- 172.21.15.50:0/272993598 wait complete. 2024-09-13T15:10:11.086 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:10:11.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:10:11.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:10:11.174 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:10:11.174 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:11.174 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:11.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:10:11.192 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:11.193 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:11.237 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:10:11.238 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:11.238 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:11.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:10:11.254 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:11.254 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:11.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:10:11.300 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T15:10:11.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.478+0000 7fdf09a00700 1 Processor -- start 2024-09-13T15:10:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.478+0000 7fdf09a00700 1 -- start start 2024-09-13T15:10:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.478+0000 7fdf09a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf041610b0 0x7fdf040719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.478+0000 7fdf09a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf0406aaa0 0x7fdf0406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.478+0000 7fdf09a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf040b3560 con 0x7fdf040b2670 2024-09-13T15:10:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.478+0000 7fdf09a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf04070b30 con 0x7fdf0406aaa0 2024-09-13T15:10:11.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0406b420 con 0x7fdf041610b0 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf0406aaa0 0x7fdf0406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf0406aaa0 0x7fdf0406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39588/0 (socket says 172.21.15.50:39588) 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 -- 172.21.15.50:0/3665197745 learned_addr learned my addr 172.21.15.50:0/3665197745 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf03e00700 1 --2- 172.21.15.50:0/3665197745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf041610b0 0x7fdf040719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 -- 172.21.15.50:0/3665197745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf041610b0 msgr2=0x7fdf040719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 --2- 172.21.15.50:0/3665197745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf041610b0 0x7fdf040719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 -- 172.21.15.50:0/3665197745 >> v1:172.21.15.181:6789/0 conn(0x7fdf040b2670 legacy=0x7fdf040cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 -- 172.21.15.50:0/3665197745 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040b3280 con 0x7fdf0406aaa0 2024-09-13T15:10:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdefb400700 1 --2- 172.21.15.50:0/3665197745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0406aaa0 0x7fdf0406aee0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009910 tx=0x7fdeec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3701e2e35da6bbfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf03400700 1 -- 172.21.15.50:0/3665197745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011830 con 0x7fdf0406aaa0 2024-09-13T15:10:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf03400700 1 -- 172.21.15.50:0/3665197745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec011990 con 0x7fdf0406aaa0 2024-09-13T15:10:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf03400700 1 -- 172.21.15.50:0/3665197745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011d40 con 0x7fdf0406aaa0 2024-09-13T15:10:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 -- 172.21.15.50:0/3665197745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0406aaa0 msgr2=0x7fdf0406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 --2- 172.21.15.50:0/3665197745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0406aaa0 0x7fdf0406aee0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009910 tx=0x7fdeec009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 -- 172.21.15.50:0/3665197745 shutdown_connections 2024-09-13T15:10:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 --2- 172.21.15.50:0/3665197745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0406aaa0 0x7fdf0406aee0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 --2- 172.21.15.50:0/3665197745 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf041610b0 0x7fdf040719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 -- 172.21.15.50:0/3665197745 >> 172.21.15.50:0/3665197745 conn(0x7fdf040b0c40 msgr2=0x7fdf0406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 -- 172.21.15.50:0/3665197745 shutdown_connections 2024-09-13T15:10:11.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.482+0000 7fdf09a00700 1 -- 172.21.15.50:0/3665197745 wait complete. 2024-09-13T15:10:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.486+0000 7fdf09a00700 1 Processor -- start 2024-09-13T15:10:11.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.486+0000 7fdf09a00700 1 -- start start 2024-09-13T15:10:11.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf0406aaa0 0x7fdf04157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 0x7fdf04163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf041610b0 0x7fdf041626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04164200 con 0x7fdf040b2670 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04158ad0 con 0x7fdf041610b0 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04158db0 con 0x7fdf0406aaa0 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 0x7fdf04163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 0x7fdf04163cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39592/0 (socket says 172.21.15.50:39592) 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 -- 172.21.15.50:0/4239973807 learned_addr learned my addr 172.21.15.50:0/4239973807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf03e00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf0406aaa0 0x7fdf04157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:11.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09000700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf041610b0 0x7fdf041626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 -- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf0406aaa0 msgr2=0x7fdf04157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf0406aaa0 0x7fdf04157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 -- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf041610b0 msgr2=0x7fdf041626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf041610b0 0x7fdf041626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 -- 172.21.15.50:0/4239973807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec009570 con 0x7fdf040b2670 2024-09-13T15:10:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09000700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf041610b0 0x7fdf041626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:11.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdefb400700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 0x7fdf04163cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdeec000c00 tx=0x7fdeec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:11.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec004380 con 0x7fdf040b2670 2024-09-13T15:10:11.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf04159090 con 0x7fdf040b2670 2024-09-13T15:10:11.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec01f070 con 0x7fdf040b2670 2024-09-13T15:10:11.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0036c0 con 0x7fdf040b2670 2024-09-13T15:10:11.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.490+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf04159650 con 0x7fdf040b2670 2024-09-13T15:10:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.494+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf04161490 con 0x7fdf040b2670 2024-09-13T15:10:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.494+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdeec021030 con 0x7fdf040b2670 2024-09-13T15:10:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.498+0000 7fdf00c00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdee0066730 0x7fdee0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.498+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdeec085300 con 0x7fdf040b2670 2024-09-13T15:10:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.498+0000 7fdf03e00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdee0066730 0x7fdee0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.498+0000 7fdf03e00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdee0066730 0x7fdee0068bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdef4011340 tx=0x7fdef400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.502+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdeec052820 con 0x7fdf040b2670 2024-09-13T15:10:11.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.734+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf040b02a0 con 0x7fdf040b2670 2024-09-13T15:10:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.734+0000 7fdf00c00700 1 -- 172.21.15.50:0/4239973807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fdeec006da0 con 0x7fdf040b2670 2024-09-13T15:10:11.739 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:11.739 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3466917741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3466917741},{"type":"v1","addr":"172.21.15.181:6836","nonce":3466917741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1973195538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1973195538},{"type":"v1","addr":"172.21.15.181:6837","nonce":1973195538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/638141097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":638141097},{"type":"v1","addr":"172.21.15.50:6834","nonce":638141097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":6015,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3484633298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3484633298},{"type":"v1","addr":"172.21.15.50:6835","nonce":3484633298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2024-09-13T15:10:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.734+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdee0066730 msgr2=0x7fdee0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.734+0000 7fdf09a00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdee0066730 0x7fdee0068bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdef4011340 tx=0x7fdef400b040 comp rx=0 tx=0).stop 2024-09-13T15:10:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.734+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 msgr2=0x7fdf04163cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.734+0000 7fdf09a00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 0x7fdf04163cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdeec000c00 tx=0x7fdeec004770 comp rx=0 tx=0).stop 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 shutdown_connections 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdee0066730 0x7fdee0068bf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf041610b0 0x7fdf041626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf040b2670 0x7fdf04163cc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 --2- 172.21.15.50:0/4239973807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf0406aaa0 0x7fdf04157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 >> 172.21.15.50:0/4239973807 conn(0x7fdf040b0c40 msgr2=0x7fdf040cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 shutdown_connections 2024-09-13T15:10:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:11.738+0000 7fdf09a00700 1 -- 172.21.15.50:0/4239973807 wait complete. 2024-09-13T15:10:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-13T15:10:11.765 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:10:11.765 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T15:10:11.765 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:10:11.766 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:11.766 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:10:11.766 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T15:10:11.766 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:10:11.766 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:11.766 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:10:11.766 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T15:10:11.767 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:10:11.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:11.767 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:10:11.767 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T15:10:11.767 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:10:11.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:11.786 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:10:11.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:10:11.790 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:10:11.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:10:11.791 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:10:11.792 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:10:11.796 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:10:11.796 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:10:11.839 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:10:11.839 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:11.843 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:10:11.844 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:11.845 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:10:11.845 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:11.850 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:10:11.850 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:11.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T15:10:11.964 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:10:11.965 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:10:11.968 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:10:11.973 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:10:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 Processor -- start 2024-09-13T15:10:12.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 -- start start 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0adfe0 0x7f388c1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f388c0cfc50 0x7f388c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c06af20 con 0x7f388c0ae9c0 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c15d2e0 con 0x7f388c0cfc50 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3894000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0d05d0 con 0x7f388c0adfe0 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3892000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f388c0ae9c0 0x7f388c15d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59150/0 (socket says 172.21.15.50:59150) 2024-09-13T15:10:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3892000700 1 -- 172.21.15.50:0/366933512 learned_addr learned my addr 172.21.15.50:0/366933512 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:12.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3891600700 1 --2- 172.21.15.50:0/366933512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0adfe0 0x7f388c1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:12.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3890c00700 1 --2- 172.21.15.50:0/366933512 >> v2:172.21.15.181:3300/0 conn(0x7f388c0cfc50 0x7f388c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:12.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f388be00700 1 -- 172.21.15.50:0/366933512 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344727568 0 0) 0x7f388c06af20 con 0x7f388c0ae9c0 2024-09-13T15:10:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f388be00700 1 -- 172.21.15.50:0/366933512 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38740035d0 con 0x7f388c0ae9c0 2024-09-13T15:10:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3891600700 1 -- 172.21.15.50:0/366933512 >> v2:172.21.15.181:3300/0 conn(0x7f388c0cfc50 msgr2=0x7f388c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.002+0000 7f3891600700 1 --2- 172.21.15.50:0/366933512 >> v2:172.21.15.181:3300/0 conn(0x7f388c0cfc50 0x7f388c0d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3891600700 1 -- 172.21.15.50:0/366933512 >> v1:172.21.15.50:6789/0 conn(0x7f388c0ae9c0 legacy=0x7f388c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3891600700 1 -- 172.21.15.50:0/366933512 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c06b150 con 0x7f388c0adfe0 2024-09-13T15:10:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3891600700 1 --2- 172.21.15.50:0/366933512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0adfe0 0x7f388c1608d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3880009850 tx=0x7f3880009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32a2d725f76449 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f388be00700 1 -- 172.21.15.50:0/366933512 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011830 con 0x7f388c0adfe0 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f388be00700 1 -- 172.21.15.50:0/366933512 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880011990 con 0x7f388c0adfe0 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f388be00700 1 -- 172.21.15.50:0/366933512 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011d40 con 0x7f388c0adfe0 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 -- 172.21.15.50:0/366933512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0adfe0 msgr2=0x7f388c1608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 --2- 172.21.15.50:0/366933512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0adfe0 0x7f388c1608d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3880009850 tx=0x7f3880009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 -- 172.21.15.50:0/366933512 shutdown_connections 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 --2- 172.21.15.50:0/366933512 >> v2:172.21.15.181:3300/0 conn(0x7f388c0cfc50 0x7f388c0d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:12.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 --2- 172.21.15.50:0/366933512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0adfe0 0x7f388c1608d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:12.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 -- 172.21.15.50:0/366933512 >> 172.21.15.50:0/366933512 conn(0x7f388c06ce30 msgr2=0x7f388c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:12.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 -- 172.21.15.50:0/366933512 shutdown_connections 2024-09-13T15:10:12.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 -- 172.21.15.50:0/366933512 wait complete. 2024-09-13T15:10:12.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.006+0000 7f3894000700 1 Processor -- start 2024-09-13T15:10:12.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 -- start start 2024-09-13T15:10:12.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 0x7f388c1e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:12.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c0ae9c0 0x7f388c1f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:12.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0cfc50 0x7f388c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:12.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1e6f10 con 0x7f388c0adfe0 2024-09-13T15:10:12.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c156690 con 0x7f388c0ae9c0 2024-09-13T15:10:12.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1e6300 con 0x7f388c0cfc50 2024-09-13T15:10:12.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 0x7f388c1e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:12.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 0x7f388c1e8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39638/0 (socket says 172.21.15.50:39638) 2024-09-13T15:10:12.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 -- 172.21.15.50:0/2153629474 learned_addr learned my addr 172.21.15.50:0/2153629474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:12.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3892000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0cfc50 0x7f388c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:12.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3890c00700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c0ae9c0 0x7f388c1f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 -- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0cfc50 msgr2=0x7f388c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0cfc50 0x7f388c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 -- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c0ae9c0 msgr2=0x7f388c1f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c0ae9c0 0x7f388c1f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 -- 172.21.15.50:0/2153629474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800094b0 con 0x7f388c0adfe0 2024-09-13T15:10:12.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3890c00700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c0ae9c0 0x7f388c1f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3891600700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 0x7f388c1e8bf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3880014040 tx=0x7f3880004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880004510 con 0x7f388c0adfe0 2024-09-13T15:10:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388001e070 con 0x7f388c0adfe0 2024-09-13T15:10:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880003900 con 0x7f388c0adfe0 2024-09-13T15:10:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.010+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c1e65e0 con 0x7f388c0adfe0 2024-09-13T15:10:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c1e6ba0 con 0x7f388c0adfe0 2024-09-13T15:10:12.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c0ae3c0 con 0x7f388c0adfe0 2024-09-13T15:10:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.014+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3880003a60 con 0x7f388c0adfe0 2024-09-13T15:10:12.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.018+0000 7f3889600700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f386c066760 0x7f386c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:12.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.018+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3880020070 con 0x7f388c0adfe0 2024-09-13T15:10:12.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.018+0000 7f3890c00700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f386c066760 0x7f386c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.018+0000 7f3890c00700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f386c066760 0x7f386c068c20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f388c1e9130 tx=0x7f3878009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:12.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.022+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38800b6db0 con 0x7f388c0adfe0 2024-09-13T15:10:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:12.218+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f388c073c90 con 0x7f388c0adfe0 2024-09-13T15:10:13.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.006+0000 7f3889600700 1 -- 172.21.15.50:0/2153629474 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3880015080 con 0x7f388c0adfe0 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f386c066760 msgr2=0x7f386c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f386c066760 0x7f386c068c20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f388c1e9130 tx=0x7f3878009240 comp rx=0 tx=0).stop 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 msgr2=0x7f388c1e8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 0x7f388c1e8bf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3880014040 tx=0x7f3880004770 comp rx=0 tx=0).stop 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 shutdown_connections 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f386c066760 0x7f386c068c20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f388c0cfc50 0x7f388c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f388c0ae9c0 0x7f388c1f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 --2- 172.21.15.50:0/2153629474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c0adfe0 0x7f388c1e8bf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 >> 172.21.15.50:0/2153629474 conn(0x7f388c06ce30 msgr2=0x7f388c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 shutdown_connections 2024-09-13T15:10:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.014+0000 7f3894000700 1 -- 172.21.15.50:0/2153629474 wait complete. 2024-09-13T15:10:13.022 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-13T15:10:13.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T15:10:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.234+0000 7fc3d2a00700 1 Processor -- start 2024-09-13T15:10:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.234+0000 7fc3d2a00700 1 -- start start 2024-09-13T15:10:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d2a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3cc0cb020 0x7fc3cc0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d2a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0b2ad0 con 0x7fc3cc06aaa0 2024-09-13T15:10:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d2a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc15b960 con 0x7fc3cc0cb020 2024-09-13T15:10:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d2a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc15bc40 con 0x7fc3cc15c2a0 2024-09-13T15:10:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3cc0cb020 0x7fc3cc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d0c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3cc0cb020 0x7fc3cc0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40420/0 (socket says 172.21.15.50:40420) 2024-09-13T15:10:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 -- 172.21.15.50:0/3042766801 learned_addr learned my addr 172.21.15.50:0/3042766801 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 -- 172.21.15.50:0/3042766801 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 msgr2=0x7fc3cc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 --2- 172.21.15.50:0/3042766801 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 -- 172.21.15.50:0/3042766801 >> v1:172.21.15.181:6789/0 conn(0x7fc3cc06aaa0 legacy=0x7fc3cc0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 -- 172.21.15.50:0/3042766801 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc15bf20 con 0x7fc3cc0cb020 2024-09-13T15:10:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3d1600700 1 --2- 172.21.15.50:0/3042766801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc0cc6f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009910 tx=0x7fc3c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a8373e00e600ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3cbe00700 1 -- 172.21.15.50:0/3042766801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011830 con 0x7fc3cc0cb020 2024-09-13T15:10:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3cbe00700 1 -- 172.21.15.50:0/3042766801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0011990 con 0x7fc3cc0cb020 2024-09-13T15:10:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.238+0000 7fc3cbe00700 1 -- 172.21.15.50:0/3042766801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011d40 con 0x7fc3cc0cb020 2024-09-13T15:10:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3042766801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 msgr2=0x7fc3cc0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3042766801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc0cc6f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009910 tx=0x7fc3c0009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3042766801 shutdown_connections 2024-09-13T15:10:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3042766801 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3042766801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc0cc6f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3042766801 >> 172.21.15.50:0/3042766801 conn(0x7fc3cc0b0c40 msgr2=0x7fc3cc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3042766801 shutdown_connections 2024-09-13T15:10:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.242+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3042766801 wait complete. 2024-09-13T15:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 Processor -- start 2024-09-13T15:10:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 -- start start 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3cc06aaa0 0x7fc3cc142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc1e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1e44d0 con 0x7fc3cc0cb020 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1434f0 con 0x7fc3cc06aaa0 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1437d0 con 0x7fc3cc15c2a0 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc1e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc1e3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40434/0 (socket says 172.21.15.50:40434) 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 -- 172.21.15.50:0/3125621747 learned_addr learned my addr 172.21.15.50:0/3125621747 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d1600700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3cc06aaa0 0x7fc3cc142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d2000700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 -- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 msgr2=0x7fc3cc140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 -- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3cc06aaa0 msgr2=0x7fc3cc142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3cc06aaa0 0x7fc3cc142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.246+0000 7fc3d0c00700 1 -- 172.21.15.50:0/3125621747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0009570 con 0x7fc3cc0cb020 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3d0c00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc1e3f90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800e7f0 tx=0x7fc3b800eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8009580 con 0x7fc3cc0cb020 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8004020 con 0x7fc3cc0cb020 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80043b0 con 0x7fc3cc0cb020 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc143ab0 con 0x7fc3cc0cb020 2024-09-13T15:10:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc140670 con 0x7fc3cc0cb020 2024-09-13T15:10:13.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.250+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc073050 con 0x7fc3cc0cb020 2024-09-13T15:10:13.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.254+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3b80036c0 con 0x7fc3cc0cb020 2024-09-13T15:10:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.254+0000 7fc3c9600700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3ac066760 0x7fc3ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.254+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc3b8083c90 con 0x7fc3cc0cb020 2024-09-13T15:10:13.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.254+0000 7fc3d1600700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3ac066760 0x7fc3ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.258+0000 7fc3d1600700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3ac066760 0x7fc3ac068c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0000c00 tx=0x7fc3c0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.262+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3b8051060 con 0x7fc3cc0cb020 2024-09-13T15:10:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.518+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3cc0cc6f0 con 0x7fc3cc0cb020 2024-09-13T15:10:13.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.518+0000 7fc3c9600700 1 -- 172.21.15.50:0/3125621747 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc3b8017090 con 0x7fc3cc0cb020 2024-09-13T15:10:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:13.523 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:10:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w==", 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ==", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw==", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ==", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw==", 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw==", 2024-09-13T15:10:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g==", 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg==", 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-13T15:10:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg==", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw==", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA==", 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-13T15:10:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g==", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg==", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-13T15:10:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A==", 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw==", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g==", 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORmfQGsHhAAoWi5rerqSyo7H67168RTZw==", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg==", 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-13T15:10:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w==", 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:10:13.537 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.518+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3ac066760 msgr2=0x7fc3ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.518+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3ac066760 0x7fc3ac068c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0000c00 tx=0x7fc3c0008030 comp rx=0 tx=0).stop 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 msgr2=0x7fc3cc1e3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc1e3f90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800e7f0 tx=0x7fc3b800eb00 comp rx=0 tx=0).stop 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 shutdown_connections 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3ac066760 0x7fc3ac068c20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3cc15c2a0 0x7fc3cc140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3cc0cb020 0x7fc3cc1e3f90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 --2- 172.21.15.50:0/3125621747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3cc06aaa0 0x7fc3cc142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 >> 172.21.15.50:0/3125621747 conn(0x7fc3cc0b0c40 msgr2=0x7fc3cc15dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 shutdown_connections 2024-09-13T15:10:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.522+0000 7fc3d2a00700 1 -- 172.21.15.50:0/3125621747 wait complete. 2024-09-13T15:10:13.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:13.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.718+0000 7fa3bea00700 1 Processor -- start 2024-09-13T15:10:13.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.718+0000 7fa3bea00700 1 -- start start 2024-09-13T15:10:13.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3bea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b806aaa0 0x7fa3b806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3bea00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b80ccb40 con 0x7fa3b80cb020 2024-09-13T15:10:13.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3bea00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b806b430 con 0x7fa3b80cc6f0 2024-09-13T15:10:13.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3bea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b2ad0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3bd600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3b80cb020 0x7fa3b815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60576/0 (socket says 172.21.15.50:60576) 2024-09-13T15:10:13.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3bd600700 1 -- 172.21.15.50:0/368400836 learned_addr learned my addr 172.21.15.50:0/368400836 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:13.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3be000700 1 --2- 172.21.15.50:0/368400836 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b806aaa0 0x7fa3b806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3be000700 1 -- 172.21.15.50:0/368400836 >> v1:172.21.15.181:6789/0 conn(0x7fa3b80cc6f0 legacy=0x7fa3b815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3be000700 1 -- 172.21.15.50:0/368400836 >> v1:172.21.15.50:6789/0 conn(0x7fa3b80cb020 legacy=0x7fa3b815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3be000700 1 -- 172.21.15.50:0/368400836 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b815b960 con 0x7fa3b806aaa0 2024-09-13T15:10:13.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.722+0000 7fa3be000700 1 --2- 172.21.15.50:0/368400836 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b806aaa0 0x7fa3b806aef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009dc0 tx=0x7fa3b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e2bcbbfa1ee934a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3b7e00700 1 -- 172.21.15.50:0/368400836 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000e070 con 0x7fa3b806aaa0 2024-09-13T15:10:13.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3b7e00700 1 -- 172.21.15.50:0/368400836 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b000bbd0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3b7e00700 1 -- 172.21.15.50:0/368400836 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0012430 con 0x7fa3b806aaa0 2024-09-13T15:10:13.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 -- 172.21.15.50:0/368400836 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b806aaa0 msgr2=0x7fa3b806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 --2- 172.21.15.50:0/368400836 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b806aaa0 0x7fa3b806aef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009dc0 tx=0x7fa3b000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 -- 172.21.15.50:0/368400836 shutdown_connections 2024-09-13T15:10:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 --2- 172.21.15.50:0/368400836 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b806aaa0 0x7fa3b806aef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 -- 172.21.15.50:0/368400836 >> 172.21.15.50:0/368400836 conn(0x7fa3b80b0c40 msgr2=0x7fa3b806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 -- 172.21.15.50:0/368400836 shutdown_connections 2024-09-13T15:10:13.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.726+0000 7fa3bea00700 1 -- 172.21.15.50:0/368400836 wait complete. 2024-09-13T15:10:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 Processor -- start 2024-09-13T15:10:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 -- start start 2024-09-13T15:10:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 0x7fa3b80c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b80cb020 0x7fa3b8142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b80cc6f0 0x7fa3b8157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8157a80 con 0x7fa3b806aaa0 2024-09-13T15:10:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80c7dc0 con 0x7fa3b80cb020 2024-09-13T15:10:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80c80a0 con 0x7fa3b80cc6f0 2024-09-13T15:10:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 0x7fa3b80c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 0x7fa3b80c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40450/0 (socket says 172.21.15.50:40450) 2024-09-13T15:10:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 -- 172.21.15.50:0/1849302283 learned_addr learned my addr 172.21.15.50:0/1849302283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3be000700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b80cc6f0 0x7fa3b8157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bcc00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b80cb020 0x7fa3b8142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 -- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b80cc6f0 msgr2=0x7fa3b8157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b80cc6f0 0x7fa3b8157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 -- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b80cb020 msgr2=0x7fa3b8142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b80cb020 0x7fa3b8142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 -- 172.21.15.50:0/1849302283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009a70 con 0x7fa3b806aaa0 2024-09-13T15:10:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bcc00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b80cb020 0x7fa3b8142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.730+0000 7fa3bd600700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 0x7fa3b80c88a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c700 tx=0x7fa3ac00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.734+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac005d90 con 0x7fa3b806aaa0 2024-09-13T15:10:13.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.734+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac0070d0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.734+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b80c8380 con 0x7fa3b806aaa0 2024-09-13T15:10:13.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.734+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac007440 con 0x7fa3b806aaa0 2024-09-13T15:10:13.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.734+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b8157650 con 0x7fa3b806aaa0 2024-09-13T15:10:13.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.734+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80b0380 con 0x7fa3b806aaa0 2024-09-13T15:10:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.738+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3ac0075a0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.738+0000 7fa3b5600700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa398066730 0x7fa398068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.738+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa3ac0832b0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.738+0000 7fa3bcc00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa398066730 0x7fa398068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.738+0000 7fa3bcc00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa398066730 0x7fa398068bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8155200 tx=0x7fa3a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.742+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3ac0508d0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.938+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3b806a780 con 0x7fa3b806aaa0 2024-09-13T15:10:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.938+0000 7fa3b5600700 1 -- 172.21.15.50:0/1849302283 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13050 (secure 0 0 0) 0x7fa3ac053ef0 con 0x7fa3b806aaa0 2024-09-13T15:10:13.944 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:13.945 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":61,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:13.000260+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:13.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa398066730 msgr2=0x7fa398068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa398066730 0x7fa398068bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8155200 tx=0x7fa3a4009040 comp rx=0 tx=0).stop 2024-09-13T15:10:13.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 msgr2=0x7fa3b80c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 0x7fa3b80c88a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c700 tx=0x7fa3ac00ca10 comp rx=0 tx=0).stop 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 shutdown_connections 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa398066730 0x7fa398068bf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3b80cc6f0 0x7fa3b8157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b80cb020 0x7fa3b8142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 --2- 172.21.15.50:0/1849302283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3b806aaa0 0x7fa3b80c88a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 >> 172.21.15.50:0/1849302283 conn(0x7fa3b80b0c40 msgr2=0x7fa3b806fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 shutdown_connections 2024-09-13T15:10:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:13.942+0000 7fa3bea00700 1 -- 172.21.15.50:0/1849302283 wait complete. 2024-09-13T15:10:13.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:13.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:14.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.154+0000 7f37c0000700 1 Processor -- start 2024-09-13T15:10:14.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.154+0000 7f37c0000700 1 -- start start 2024-09-13T15:10:14.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37c0000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b815e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37c0000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f37b80cf280 0x7f37b8071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37c0000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b8070670 con 0x7f37b806c4c0 2024-09-13T15:10:14.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37c0000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b8070950 con 0x7f37b80cf280 2024-09-13T15:10:14.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37c0000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8070c30 con 0x7f37b8146720 2024-09-13T15:10:14.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37be000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f37b80cf280 0x7f37b8071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37be000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f37b80cf280 0x7f37b8071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59418/0 (socket says 172.21.15.50:59418) 2024-09-13T15:10:14.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b815e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36388/0 (socket says 172.21.15.50:36388) 2024-09-13T15:10:14.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37be000700 1 -- 172.21.15.50:0/856553345 learned_addr learned my addr 172.21.15.50:0/856553345 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:14.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bcc00700 1 --1- 172.21.15.50:0/856553345 >> v1:172.21.15.181:6789/0 conn(0x7f37b806c4c0 0x7f37b80ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:56650/0 (socket says 172.21.15.50:56650) 2024-09-13T15:10:14.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 -- 172.21.15.50:0/856553345 >> v2:172.21.15.181:3300/0 conn(0x7f37b80cf280 msgr2=0x7f37b8071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:14.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 --2- 172.21.15.50:0/856553345 >> v2:172.21.15.181:3300/0 conn(0x7f37b80cf280 0x7f37b8071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 -- 172.21.15.50:0/856553345 >> v1:172.21.15.181:6789/0 conn(0x7f37b806c4c0 legacy=0x7f37b80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 -- 172.21.15.50:0/856553345 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8070f10 con 0x7f37b8146720 2024-09-13T15:10:14.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37b7e00700 1 -- 172.21.15.50:0/856553345 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167347431 0 0) 0x7f37b8070670 con 0x7f37b806c4c0 2024-09-13T15:10:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37bd600700 1 --2- 172.21.15.50:0/856553345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b815e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009d90 tx=0x7f37ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06c4231652d38f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.158+0000 7f37b7e00700 1 -- 172.21.15.50:0/856553345 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00e070 con 0x7f37b8146720 2024-09-13T15:10:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37b7e00700 1 -- 172.21.15.50:0/856553345 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00bb20 con 0x7f37b8146720 2024-09-13T15:10:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37b7e00700 1 -- 172.21.15.50:0/856553345 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac012430 con 0x7f37b8146720 2024-09-13T15:10:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 -- 172.21.15.50:0/856553345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 msgr2=0x7f37b815e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 --2- 172.21.15.50:0/856553345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b815e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009d90 tx=0x7f37ac00b330 comp rx=0 tx=0).stop 2024-09-13T15:10:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 -- 172.21.15.50:0/856553345 shutdown_connections 2024-09-13T15:10:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 --2- 172.21.15.50:0/856553345 >> v2:172.21.15.181:3300/0 conn(0x7f37b80cf280 0x7f37b8071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 --2- 172.21.15.50:0/856553345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b815e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 -- 172.21.15.50:0/856553345 >> 172.21.15.50:0/856553345 conn(0x7f37b806a570 msgr2=0x7f37b806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 -- 172.21.15.50:0/856553345 shutdown_connections 2024-09-13T15:10:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 -- 172.21.15.50:0/856553345 wait complete. 2024-09-13T15:10:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 Processor -- start 2024-09-13T15:10:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.162+0000 7f37c0000700 1 -- start start 2024-09-13T15:10:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 0x7f37b80c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b80cf280 0x7f37b813a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b81f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80b10a0 con 0x7f37b806c4c0 2024-09-13T15:10:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80af1a0 con 0x7f37b80cf280 2024-09-13T15:10:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80af480 con 0x7f37b8146720 2024-09-13T15:10:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 0x7f37b80c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 0x7f37b80c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40456/0 (socket says 172.21.15.50:40456) 2024-09-13T15:10:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 -- 172.21.15.50:0/3682392888 learned_addr learned my addr 172.21.15.50:0/3682392888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bcc00700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b80cf280 0x7f37b813a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37be000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b81f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 -- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 msgr2=0x7f37b81f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b81f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 -- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b80cf280 msgr2=0x7f37b813a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b80cf280 0x7f37b813a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 -- 172.21.15.50:0/3682392888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac009a70 con 0x7f37b806c4c0 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37bd600700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 0x7f37b80c3960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f37b80ce610 tx=0x7f37ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac012430 con 0x7f37b806c4c0 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac020070 con 0x7f37b806c4c0 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b80af760 con 0x7f37b806c4c0 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac004280 con 0x7f37b806c4c0 2024-09-13T15:10:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.166+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b80c3ea0 con 0x7f37b806c4c0 2024-09-13T15:10:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.170+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b806c8c0 con 0x7f37b806c4c0 2024-09-13T15:10:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.170+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37ac0043e0 con 0x7f37b806c4c0 2024-09-13T15:10:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.170+0000 7f37b5600700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3798066730 0x7f3798068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.170+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f37ac022070 con 0x7f37b806c4c0 2024-09-13T15:10:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.174+0000 7f37bcc00700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3798066730 0x7f3798068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.174+0000 7f37bcc00700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3798066730 0x7f3798068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f37b815f7a0 tx=0x7f37a4007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.178+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37ac053720 con 0x7f37b806c4c0 2024-09-13T15:10:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.366+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37b815f4f0 con 0x7f37b806c4c0 2024-09-13T15:10:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.366+0000 7f37b5600700 1 -- 172.21.15.50:0/3682392888 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37ac056d40 con 0x7f37b806c4c0 2024-09-13T15:10:14.372 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3798066730 msgr2=0x7f3798068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3798066730 0x7f3798068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f37b815f7a0 tx=0x7f37a4007c00 comp rx=0 tx=0).stop 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 msgr2=0x7f37b80c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 0x7f37b80c3960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f37b80ce610 tx=0x7f37ac004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 shutdown_connections 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3798066730 0x7f3798068bf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37b8146720 0x7f37b81f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37b80cf280 0x7f37b813a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 --2- 172.21.15.50:0/3682392888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b806c4c0 0x7f37b80c3960 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 >> 172.21.15.50:0/3682392888 conn(0x7f37b806a570 msgr2=0x7f37b80ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 shutdown_connections 2024-09-13T15:10:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.370+0000 7f37c0000700 1 -- 172.21.15.50:0/3682392888 wait complete. 2024-09-13T15:10:14.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:10:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.558+0000 7f9c35600700 1 Processor -- start 2024-09-13T15:10:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.558+0000 7f9c35600700 1 -- start start 2024-09-13T15:10:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c35600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3006aaa0 0x7f9c3015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c35600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3015e560 con 0x7f9c300b3980 2024-09-13T15:10:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c35600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3015d920 con 0x7f9c3015e9f0 2024-09-13T15:10:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c35600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300adf90 con 0x7f9c3006aaa0 2024-09-13T15:10:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c27400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c300b3980 0x7f9c3006ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60590/0 (socket says 172.21.15.50:60590) 2024-09-13T15:10:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c27400700 1 -- 172.21.15.50:0/3459522518 learned_addr learned my addr 172.21.15.50:0/3459522518 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2fe00700 1 --2- 172.21.15.50:0/3459522518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3006aaa0 0x7f9c3015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2fe00700 1 -- 172.21.15.50:0/3459522518 >> v1:172.21.15.181:6789/0 conn(0x7f9c3015e9f0 legacy=0x7f9c3015eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2fe00700 1 -- 172.21.15.50:0/3459522518 >> v1:172.21.15.50:6789/0 conn(0x7f9c300b3980 legacy=0x7f9c3006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2f400700 1 -- 172.21.15.50:0/3459522518 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971144472 0 0) 0x7f9c3015d920 con 0x7f9c3015e9f0 2024-09-13T15:10:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2fe00700 1 -- 172.21.15.50:0/3459522518 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3015dc00 con 0x7f9c3006aaa0 2024-09-13T15:10:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2fe00700 1 --2- 172.21.15.50:0/3459522518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3006aaa0 0x7f9c3015d310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009df0 tx=0x7f9c2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b31b3434b1ac027 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2f400700 1 -- 172.21.15.50:0/3459522518 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000e070 con 0x7f9c3006aaa0 2024-09-13T15:10:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2f400700 1 -- 172.21.15.50:0/3459522518 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000bad0 con 0x7f9c3006aaa0 2024-09-13T15:10:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.562+0000 7f9c2f400700 1 -- 172.21.15.50:0/3459522518 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000be60 con 0x7f9c3006aaa0 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 -- 172.21.15.50:0/3459522518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3006aaa0 msgr2=0x7f9c3015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 --2- 172.21.15.50:0/3459522518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3006aaa0 0x7f9c3015d310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009df0 tx=0x7f9c2000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 -- 172.21.15.50:0/3459522518 shutdown_connections 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 --2- 172.21.15.50:0/3459522518 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3006aaa0 0x7f9c3015d310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 -- 172.21.15.50:0/3459522518 >> 172.21.15.50:0/3459522518 conn(0x7f9c300b0c40 msgr2=0x7f9c3006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 -- 172.21.15.50:0/3459522518 shutdown_connections 2024-09-13T15:10:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.566+0000 7f9c35600700 1 -- 172.21.15.50:0/3459522518 wait complete. 2024-09-13T15:10:14.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 Processor -- start 2024-09-13T15:10:14.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 -- start start 2024-09-13T15:10:14.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c3006aaa0 0x7f9c3013a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 0x7f9c300ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3015e9f0 0x7f9c3015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30139970 con 0x7f9c300b3980 2024-09-13T15:10:14.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30139c50 con 0x7f9c3006aaa0 2024-09-13T15:10:14.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c35600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30139f30 con 0x7f9c3015e9f0 2024-09-13T15:10:14.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 0x7f9c300ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 0x7f9c300ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40470/0 (socket says 172.21.15.50:40470) 2024-09-13T15:10:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 -- 172.21.15.50:0/1165448178 learned_addr learned my addr 172.21.15.50:0/1165448178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c34c00700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3015e9f0 0x7f9c3015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c2fe00700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c3006aaa0 0x7f9c3013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 -- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3015e9f0 msgr2=0x7f9c3015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3015e9f0 0x7f9c3015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 -- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c3006aaa0 msgr2=0x7f9c3013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c3006aaa0 0x7f9c3013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 -- 172.21.15.50:0/1165448178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20009a70 con 0x7f9c300b3980 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c27400700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 0x7f9c300ccb90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c750 tx=0x7f9c1800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.570+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18004ca0 con 0x7f9c300b3980 2024-09-13T15:10:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.574+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18004e00 con 0x7f9c300b3980 2024-09-13T15:10:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.574+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3013a210 con 0x7f9c300b3980 2024-09-13T15:10:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.574+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18007310 con 0x7f9c300b3980 2024-09-13T15:10:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.574+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3015c760 con 0x7f9c300b3980 2024-09-13T15:10:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.574+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3013a450 con 0x7f9c300b3980 2024-09-13T15:10:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.574+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c18007470 con 0x7f9c300b3980 2024-09-13T15:10:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.578+0000 7f9c2cc00700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9c0c066730 0x7f9c0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.578+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9c18083d20 con 0x7f9c300b3980 2024-09-13T15:10:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.578+0000 7f9c2fe00700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9c0c066730 0x7f9c0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.578+0000 7f9c2fe00700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9c0c066730 0x7f9c0c068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009dc0 tx=0x7f9c20010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.582+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c3013a450 con 0x7f9c300b3980 2024-09-13T15:10:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.770+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c30139ab0 con 0x7f9c300b3980 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.770+0000 7f9c2cc00700 1 -- 172.21.15.50:0/1165448178 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c30139ab0 con 0x7f9c300b3980 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:10:14.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:14.779 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:10:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9c0c066730 msgr2=0x7f9c0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9c0c066730 0x7f9c0c068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009dc0 tx=0x7f9c20010000 comp rx=0 tx=0).stop 2024-09-13T15:10:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 msgr2=0x7f9c300ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 0x7f9c300ccb90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c750 tx=0x7f9c1800ca60 comp rx=0 tx=0).stop 2024-09-13T15:10:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 shutdown_connections 2024-09-13T15:10:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9c0c066730 0x7f9c0c068bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9c3015e9f0 0x7f9c3015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c300b3980 0x7f9c300ccb90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 --2- 172.21.15.50:0/1165448178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c3006aaa0 0x7f9c3013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 >> 172.21.15.50:0/1165448178 conn(0x7f9c300b0c40 msgr2=0x7f9c300af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 shutdown_connections 2024-09-13T15:10:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.778+0000 7f9c35600700 1 -- 172.21.15.50:0/1165448178 wait complete. 2024-09-13T15:10:14.805 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:10:14.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:10:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.974+0000 7f4f9b200700 1 Processor -- start 2024-09-13T15:10:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.974+0000 7f4f9b200700 1 -- start start 2024-09-13T15:10:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f9c0b3290 0x7f4f9c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9b200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f9c0ce390 0x7f4f9c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9b200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0b5a40 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9b200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0b2f30 con 0x7f4f9c0ce390 2024-09-13T15:10:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0b5480 con 0x7f4f9c0b3290 2024-09-13T15:10:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f99400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4f9c0b29e0 0x7f4f9c0cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60592/0 (socket says 172.21.15.50:60592) 2024-09-13T15:10:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f99400700 1 -- 172.21.15.50:0/3030231201 learned_addr learned my addr 172.21.15.50:0/3030231201 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9a800700 1 --2- 172.21.15.50:0/3030231201 >> v2:172.21.15.50:3300/0 conn(0x7f4f9c0ce390 0x7f4f9c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f99e00700 1 --2- 172.21.15.50:0/3030231201 >> v2:172.21.15.181:3300/0 conn(0x7f4f9c0b3290 0x7f4f9c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f98a00700 1 -- 172.21.15.50:0/3030231201 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471151464 0 0) 0x7f4f9c0b5a40 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f98a00700 1 -- 172.21.15.50:0/3030231201 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f800035d0 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9a800700 1 -- 172.21.15.50:0/3030231201 >> v2:172.21.15.181:3300/0 conn(0x7f4f9c0b3290 msgr2=0x7f4f9c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9a800700 1 --2- 172.21.15.50:0/3030231201 >> v2:172.21.15.181:3300/0 conn(0x7f4f9c0b3290 0x7f4f9c071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9a800700 1 -- 172.21.15.50:0/3030231201 >> v1:172.21.15.50:6789/0 conn(0x7f4f9c0b29e0 legacy=0x7f4f9c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.978+0000 7f4f9a800700 1 -- 172.21.15.50:0/3030231201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c0b5760 con 0x7f4f9c0ce390 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9a800700 1 --2- 172.21.15.50:0/3030231201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c072240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009d90 tx=0x7f4f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2185858b83efa282 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f98a00700 1 -- 172.21.15.50:0/3030231201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400e070 con 0x7f4f9c0ce390 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f98a00700 1 -- 172.21.15.50:0/3030231201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9400bae0 con 0x7f4f9c0ce390 2024-09-13T15:10:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f98a00700 1 -- 172.21.15.50:0/3030231201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400be50 con 0x7f4f9c0ce390 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 -- 172.21.15.50:0/3030231201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0ce390 msgr2=0x7f4f9c072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3030231201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c072240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009d90 tx=0x7f4f9400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 -- 172.21.15.50:0/3030231201 shutdown_connections 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3030231201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c072240 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3030231201 >> v2:172.21.15.181:3300/0 conn(0x7f4f9c0b3290 0x7f4f9c071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 -- 172.21.15.50:0/3030231201 >> 172.21.15.50:0/3030231201 conn(0x7f4f9c06d4b0 msgr2=0x7f4f9c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 -- 172.21.15.50:0/3030231201 shutdown_connections 2024-09-13T15:10:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 -- 172.21.15.50:0/3030231201 wait complete. 2024-09-13T15:10:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 Processor -- start 2024-09-13T15:10:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.982+0000 7f4f9b200700 1 -- start start 2024-09-13T15:10:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 0x7f4f9c13a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f9c0b3290 0x7f4f9c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c13bfe0 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0c5520 con 0x7f4f9c0ce390 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c13b920 con 0x7f4f9c0b3290 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 0x7f4f9c13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 0x7f4f9c13a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40490/0 (socket says 172.21.15.50:40490) 2024-09-13T15:10:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 -- 172.21.15.50:0/3485296510 learned_addr learned my addr 172.21.15.50:0/3485296510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99400700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f9c0b3290 0x7f4f9c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9a800700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 -- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f9c0b3290 msgr2=0x7f4f9c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f9c0b3290 0x7f4f9c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 -- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c0ce390 msgr2=0x7f4f9c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 -- 172.21.15.50:0/3485296510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94009a70 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f99e00700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 0x7f4f9c13a970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00e9d0 tx=0x7f4f8c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c009720 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00ee70 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00ca50 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c13bc00 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.986+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c1595e0 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.990+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c0cdc80 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.990+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f8c00cbb0 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.990+0000 7f4f92000700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f7c066730 0x7f4f7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.990+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4f8c083f60 con 0x7f4f9c0b29e0 2024-09-13T15:10:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.994+0000 7f4f99400700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f7c066730 0x7f4f7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.994+0000 7f4f99400700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f7c066730 0x7f4f7c068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0663e0 tx=0x7f4f88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:14.998+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f8c0514d0 con 0x7f4f9c0b29e0 2024-09-13T15:10:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.186+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4f9c066410 con 0x7f4f9c0b29e0 2024-09-13T15:10:15.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.670+0000 7f4f92000700 1 -- 172.21.15.50:0/3485296510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4f8c00ce60 con 0x7f4f9c0b29e0 2024-09-13T15:10:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f7c066730 msgr2=0x7f4f7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f7c066730 0x7f4f7c068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0663e0 tx=0x7f4f88009040 comp rx=0 tx=0).stop 2024-09-13T15:10:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 msgr2=0x7f4f9c13a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 0x7f4f9c13a970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00e9d0 tx=0x7f4f8c00ece0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 shutdown_connections 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4f7c066730 0x7f4f7c068bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f9c0ce390 0x7f4f9c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f9c0b3290 0x7f4f9c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 --2- 172.21.15.50:0/3485296510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f9c0b29e0 0x7f4f9c13a970 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 >> 172.21.15.50:0/3485296510 conn(0x7f4f9c06d4b0 msgr2=0x7f4f9c066930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 shutdown_connections 2024-09-13T15:10:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.678+0000 7f4f9b200700 1 -- 172.21.15.50:0/3485296510 wait complete. 2024-09-13T15:10:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:10:15.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:10:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.890+0000 7efc20200700 1 Processor -- start 2024-09-13T15:10:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.890+0000 7efc20200700 1 -- start start 2024-09-13T15:10:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.894+0000 7efc20200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc181444b0 0x7efc180cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.894+0000 7efc20200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1815b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.894+0000 7efc20200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1806bbd0 con 0x7efc1806a770 2024-09-13T15:10:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.894+0000 7efc20200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc18144890 con 0x7efc181444b0 2024-09-13T15:10:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.894+0000 7efc20200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1806afc0 con 0x7efc180b55e0 2024-09-13T15:10:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1ce00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efc1806a770 0x7efc180b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60608/0 (socket says 172.21.15.50:60608) 2024-09-13T15:10:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1ce00700 1 -- 172.21.15.50:0/3289056420 learned_addr learned my addr 172.21.15.50:0/3289056420 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1d800700 1 --2- 172.21.15.50:0/3289056420 >> v2:172.21.15.50:3300/0 conn(0x7efc181444b0 0x7efc180cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1e200700 1 --2- 172.21.15.50:0/3289056420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1d800700 1 -- 172.21.15.50:0/3289056420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 msgr2=0x7efc1815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1d800700 1 --2- 172.21.15.50:0/3289056420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1d800700 1 -- 172.21.15.50:0/3289056420 >> v1:172.21.15.50:6789/0 conn(0x7efc1806a770 legacy=0x7efc180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1d800700 1 -- 172.21.15.50:0/3289056420 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1806b2a0 con 0x7efc181444b0 2024-09-13T15:10:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc1d800700 1 --2- 172.21.15.50:0/3289056420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc180cf1c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009850 tx=0x7efc0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a889ce413c662c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc17e00700 1 -- 172.21.15.50:0/3289056420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011830 con 0x7efc181444b0 2024-09-13T15:10:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc17e00700 1 -- 172.21.15.50:0/3289056420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c011990 con 0x7efc181444b0 2024-09-13T15:10:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc17e00700 1 -- 172.21.15.50:0/3289056420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011d40 con 0x7efc181444b0 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 -- 172.21.15.50:0/3289056420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 msgr2=0x7efc180cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 --2- 172.21.15.50:0/3289056420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc180cf1c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009850 tx=0x7efc0c009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 -- 172.21.15.50:0/3289056420 shutdown_connections 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 --2- 172.21.15.50:0/3289056420 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 --2- 172.21.15.50:0/3289056420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc180cf1c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 -- 172.21.15.50:0/3289056420 >> 172.21.15.50:0/3289056420 conn(0x7efc1806e660 msgr2=0x7efc1806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.898+0000 7efc20200700 1 -- 172.21.15.50:0/3289056420 shutdown_connections 2024-09-13T15:10:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 -- 172.21.15.50:0/3289056420 wait complete. 2024-09-13T15:10:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 Processor -- start 2024-09-13T15:10:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 -- start start 2024-09-13T15:10:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1806a770 0x7efc180cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1812a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc181f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b5180 con 0x7efc181444b0 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc181f6c00 con 0x7efc1806a770 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc20200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b48e0 con 0x7efc180b55e0 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc1e200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc181f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc1e200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc181f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40518/0 (socket says 172.21.15.50:40518) 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc1e200700 1 -- 172.21.15.50:0/4046887116 learned_addr learned my addr 172.21.15.50:0/4046887116 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.902+0000 7efc1ce00700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1812a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1d800700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1806a770 0x7efc180cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1e200700 1 -- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 msgr2=0x7efc1812a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1e200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1812a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1e200700 1 -- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1806a770 msgr2=0x7efc180cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1e200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1806a770 0x7efc180cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1e200700 1 -- 172.21.15.50:0/4046887116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0094b0 con 0x7efc181444b0 2024-09-13T15:10:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc1e200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc181f7310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efc1000efc0 tx=0x7efc1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000cd40 con 0x7efc181444b0 2024-09-13T15:10:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1000f040 con 0x7efc181444b0 2024-09-13T15:10:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc180b4bc0 con 0x7efc181444b0 2024-09-13T15:10:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100146c0 con 0x7efc181444b0 2024-09-13T15:10:15.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc180cc2e0 con 0x7efc181444b0 2024-09-13T15:10:15.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.906+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc180cf1c0 con 0x7efc181444b0 2024-09-13T15:10:15.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.910+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc10014820 con 0x7efc181444b0 2024-09-13T15:10:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.910+0000 7efc15600700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbf8066730 0x7efbf8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.910+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5547+0+0 (secure 0 0 0) 0x7efc100852a0 con 0x7efc181444b0 2024-09-13T15:10:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.914+0000 7efc1d800700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbf8066730 0x7efbf8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:15.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.914+0000 7efc1d800700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbf8066730 0x7efbf8068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0090b0 tx=0x7efc0c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:15.918+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc10052690 con 0x7efc181444b0 2024-09-13T15:10:16.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.098+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efc180aeee0 con 0x7efc181444b0 2024-09-13T15:10:16.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.686+0000 7efc15600700 1 -- 172.21.15.50:0/4046887116 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7efc10009ca0 con 0x7efc181444b0 2024-09-13T15:10:16.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbf8066730 msgr2=0x7efbf8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbf8066730 0x7efbf8068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0090b0 tx=0x7efc0c008030 comp rx=0 tx=0).stop 2024-09-13T15:10:16.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 msgr2=0x7efc181f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc181f7310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efc1000efc0 tx=0x7efc1000c3a0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 shutdown_connections 2024-09-13T15:10:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efbf8066730 0x7efbf8068bf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc181444b0 0x7efc181f7310 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efc180b55e0 0x7efc1812a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 --2- 172.21.15.50:0/4046887116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc1806a770 0x7efc180cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 >> 172.21.15.50:0/4046887116 conn(0x7efc1806e660 msgr2=0x7efc180a90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:16.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 shutdown_connections 2024-09-13T15:10:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.694+0000 7efc20200700 1 -- 172.21.15.50:0/4046887116 wait complete. 2024-09-13T15:10:16.705 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:10:16.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:10:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.902+0000 7fc1b4e00700 1 Processor -- start 2024-09-13T15:10:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.902+0000 7fc1b4e00700 1 -- start start 2024-09-13T15:10:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1b4e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1b006c5a0 0x7fc1b015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1b4e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00b4680 con 0x7fc1b00cf830 2024-09-13T15:10:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1b4e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00b4960 con 0x7fc1b006c980 2024-09-13T15:10:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1b4e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b00b5dd0 con 0x7fc1b006c5a0 2024-09-13T15:10:16.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1af400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1b006c5a0 0x7fc1b015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1afe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc1b00cf830 0x7fc1b00cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60618/0 (socket says 172.21.15.50:60618) 2024-09-13T15:10:16.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1afe00700 1 -- 172.21.15.50:0/2305849428 learned_addr learned my addr 172.21.15.50:0/2305849428 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1af400700 1 -- 172.21.15.50:0/2305849428 >> v1:172.21.15.181:6789/0 conn(0x7fc1b006c980 legacy=0x7fc1b00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1af400700 1 -- 172.21.15.50:0/2305849428 >> v1:172.21.15.50:6789/0 conn(0x7fc1b00cf830 legacy=0x7fc1b00cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1af400700 1 -- 172.21.15.50:0/2305849428 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00cf030 con 0x7fc1b006c5a0 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1af400700 1 --2- 172.21.15.50:0/2305849428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b006c5a0 0x7fc1b015aa90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009850 tx=0x7fc1a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561e69aa7508fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1ae000700 1 -- 172.21.15.50:0/2305849428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0004230 con 0x7fc1b006c5a0 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1ae000700 1 -- 172.21.15.50:0/2305849428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0004390 con 0x7fc1b006c5a0 2024-09-13T15:10:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.906+0000 7fc1ae000700 1 -- 172.21.15.50:0/2305849428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00036c0 con 0x7fc1b006c5a0 2024-09-13T15:10:16.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 -- 172.21.15.50:0/2305849428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b006c5a0 msgr2=0x7fc1b015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/2305849428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b006c5a0 0x7fc1b015aa90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009850 tx=0x7fc1a0009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 -- 172.21.15.50:0/2305849428 shutdown_connections 2024-09-13T15:10:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/2305849428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b006c5a0 0x7fc1b015aa90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 -- 172.21.15.50:0/2305849428 >> 172.21.15.50:0/2305849428 conn(0x7fc1b0071d20 msgr2=0x7fc1b0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 -- 172.21.15.50:0/2305849428 shutdown_connections 2024-09-13T15:10:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 -- 172.21.15.50:0/2305849428 wait complete. 2024-09-13T15:10:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 Processor -- start 2024-09-13T15:10:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 -- start start 2024-09-13T15:10:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.910+0000 7fc1b4e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1b006c5a0 0x7fc1b014c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1b006c980 0x7fc1b013d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 0x7fc1b01569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b006c280 con 0x7fc1b00cf830 2024-09-13T15:10:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b014aa80 con 0x7fc1b006c5a0 2024-09-13T15:10:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b014ad60 con 0x7fc1b006c980 2024-09-13T15:10:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 0x7fc1b01569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1af400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1b006c5a0 0x7fc1b014c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1aea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1b006c980 0x7fc1b013d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 0x7fc1b01569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40530/0 (socket says 172.21.15.50:40530) 2024-09-13T15:10:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 -- 172.21.15.50:0/952497346 learned_addr learned my addr 172.21.15.50:0/952497346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 -- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1b006c980 msgr2=0x7fc1b013d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1b006c980 0x7fc1b013d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 -- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1b006c5a0 msgr2=0x7fc1b014c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1b006c5a0 0x7fc1b014c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 -- 172.21.15.50:0/952497346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00094b0 con 0x7fc1b00cf830 2024-09-13T15:10:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1afe00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 0x7fc1b01569a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800ca80 tx=0x7fc1a800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8007480 con 0x7fc1b00cf830 2024-09-13T15:10:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80075e0 con 0x7fc1b00cf830 2024-09-13T15:10:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8007950 con 0x7fc1b00cf830 2024-09-13T15:10:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b014b040 con 0x7fc1b00cf830 2024-09-13T15:10:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.914+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b014cae0 con 0x7fc1b00cf830 2024-09-13T15:10:16.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.918+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b00d16d0 con 0x7fc1b00cf830 2024-09-13T15:10:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.918+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1a801b3b0 con 0x7fc1b00cf830 2024-09-13T15:10:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.918+0000 7fc1a7400700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc190066730 0x7fc190068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.918+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fc1a80839e0 con 0x7fc1b00cf830 2024-09-13T15:10:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.918+0000 7fc1af400700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc190066730 0x7fc190068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.922+0000 7fc1af400700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc190066730 0x7fc190068bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009850 tx=0x7fc1a0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:16.930+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1a8050c80 con 0x7fc1b00cf830 2024-09-13T15:10:17.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.154+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc1b00cec70 con 0x7fc1b00cf830 2024-09-13T15:10:17.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.166+0000 7fc1a7400700 1 -- 172.21.15.50:0/952497346 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc1a8017020 con 0x7fc1b00cf830 2024-09-13T15:10:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.178+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc190066730 msgr2=0x7fc190068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.178+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc190066730 0x7fc190068bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009850 tx=0x7fc1a0008030 comp rx=0 tx=0).stop 2024-09-13T15:10:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.178+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 msgr2=0x7fc1b01569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.178+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 0x7fc1b01569a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800ca80 tx=0x7fc1a800cab0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 shutdown_connections 2024-09-13T15:10:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc190066730 0x7fc190068bf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b00cf830 0x7fc1b01569a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc1b006c980 0x7fc1b013d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 --2- 172.21.15.50:0/952497346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1b006c5a0 0x7fc1b014c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 >> 172.21.15.50:0/952497346 conn(0x7fc1b0071d20 msgr2=0x7fc1b01583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 shutdown_connections 2024-09-13T15:10:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.182+0000 7fc1b4e00700 1 -- 172.21.15.50:0/952497346 wait complete. 2024-09-13T15:10:17.196 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 9 and data pool 10 2024-09-13T15:10:17.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f719cc00700 1 Processor -- start 2024-09-13T15:10:17.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f719cc00700 1 -- start start 2024-09-13T15:10:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f719cc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f719806c460 0x7f719806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f719cc00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980cdd90 con 0x7f719806a5d0 2024-09-13T15:10:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f719cc00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719806ce10 con 0x7f719815b700 2024-09-13T15:10:17.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f719cc00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719806d7e0 con 0x7f719806c460 2024-09-13T15:10:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f7196800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f719806a5d0 0x7f71980b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60620/0 (socket says 172.21.15.50:60620) 2024-09-13T15:10:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f7196800700 1 -- 172.21.15.50:0/4129851243 learned_addr learned my addr 172.21.15.50:0/4129851243 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.378+0000 7f7195400700 1 --2- 172.21.15.50:0/4129851243 >> v2:172.21.15.181:3300/0 conn(0x7f719806c460 0x7f719806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7194a00700 1 -- 172.21.15.50:0/4129851243 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974617729 0 0) 0x7f71980cdd90 con 0x7f719806a5d0 2024-09-13T15:10:17.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7195400700 1 -- 172.21.15.50:0/4129851243 >> v1:172.21.15.181:6789/0 conn(0x7f719815b700 legacy=0x7f719815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7195400700 1 -- 172.21.15.50:0/4129851243 >> v1:172.21.15.50:6789/0 conn(0x7f719806a5d0 legacy=0x7f71980b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7195400700 1 -- 172.21.15.50:0/4129851243 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980cd4f0 con 0x7f719806c460 2024-09-13T15:10:17.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7195400700 1 --2- 172.21.15.50:0/4129851243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719806c460 0x7f719806d2a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7180009850 tx=0x7f7180009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a5ced7c4c75fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7194a00700 1 -- 172.21.15.50:0/4129851243 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180011830 con 0x7f719806c460 2024-09-13T15:10:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7194a00700 1 -- 172.21.15.50:0/4129851243 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7180011990 con 0x7f719806c460 2024-09-13T15:10:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f7194a00700 1 -- 172.21.15.50:0/4129851243 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180011d20 con 0x7f719806c460 2024-09-13T15:10:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 -- 172.21.15.50:0/4129851243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719806c460 msgr2=0x7f719806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 --2- 172.21.15.50:0/4129851243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719806c460 0x7f719806d2a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7180009850 tx=0x7f7180009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 -- 172.21.15.50:0/4129851243 shutdown_connections 2024-09-13T15:10:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 --2- 172.21.15.50:0/4129851243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719806c460 0x7f719806d2a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 -- 172.21.15.50:0/4129851243 >> 172.21.15.50:0/4129851243 conn(0x7f71980b08d0 msgr2=0x7f71980b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 -- 172.21.15.50:0/4129851243 shutdown_connections 2024-09-13T15:10:17.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.382+0000 7f719cc00700 1 -- 172.21.15.50:0/4129851243 wait complete. 2024-09-13T15:10:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 Processor -- start 2024-09-13T15:10:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 -- start start 2024-09-13T15:10:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 0x7f71981412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f719806c460 0x7f7198071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719815b700 0x7f719814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719815bb70 con 0x7f719806a5d0 2024-09-13T15:10:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7198070800 con 0x7f719815b700 2024-09-13T15:10:17.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.386+0000 7f719cc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7198141820 con 0x7f719806c460 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 0x7f71981412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 0x7f71981412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40544/0 (socket says 172.21.15.50:40544) 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 -- 172.21.15.50:0/3575162135 learned_addr learned my addr 172.21.15.50:0/3575162135 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195400700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f719806c460 0x7f7198071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7196800700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719815b700 0x7f719814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 -- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f719806c460 msgr2=0x7f7198071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f719806c460 0x7f7198071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 -- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719815b700 msgr2=0x7f719814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719815b700 0x7f719814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 -- 172.21.15.50:0/3575162135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800094b0 con 0x7f719806a5d0 2024-09-13T15:10:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f7195e00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 0x7f71981412e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f718800c500 tx=0x7f718800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880052d0 con 0x7f719806a5d0 2024-09-13T15:10:17.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188005430 con 0x7f719806a5d0 2024-09-13T15:10:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7198070a80 con 0x7f719806a5d0 2024-09-13T15:10:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880055a0 con 0x7f719806a5d0 2024-09-13T15:10:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7198071040 con 0x7f719806a5d0 2024-09-13T15:10:17.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.390+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719806ade0 con 0x7f719806a5d0 2024-09-13T15:10:17.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.394+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71880038e0 con 0x7f719806a5d0 2024-09-13T15:10:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.394+0000 7f718e000700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7174066730 0x7f7174068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.394+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7188083710 con 0x7f719806a5d0 2024-09-13T15:10:17.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.394+0000 7f7195400700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7174066730 0x7f7174068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.398+0000 7f7195400700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7174066730 0x7f7174068bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f71800090b0 tx=0x7f7180008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.402+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7188050930 con 0x7f719806a5d0 2024-09-13T15:10:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.598+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719806c240 con 0x7f719806a5d0 2024-09-13T15:10:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.598+0000 7f718e000700 1 -- 172.21.15.50:0/3575162135 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16717 (secure 0 0 0) 0x7f7188053f50 con 0x7f719806a5d0 2024-09-13T15:10:17.606 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:17.606 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":64,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:17.160697+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7174066730 msgr2=0x7f7174068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7174066730 0x7f7174068bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f71800090b0 tx=0x7f7180008030 comp rx=0 tx=0).stop 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 msgr2=0x7f71981412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 0x7f71981412e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f718800c500 tx=0x7f718800c8c0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 shutdown_connections 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7174066730 0x7f7174068bf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f719815b700 0x7f719814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f719806c460 0x7f7198071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 --2- 172.21.15.50:0/3575162135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f719806a5d0 0x7f71981412e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 >> 172.21.15.50:0/3575162135 conn(0x7f71980b08d0 msgr2=0x7f71980b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 shutdown_connections 2024-09-13T15:10:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.602+0000 7f719cc00700 1 -- 172.21.15.50:0/3575162135 wait complete. 2024-09-13T15:10:17.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a52000700 1 Processor -- start 2024-09-13T15:10:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a52000700 1 -- start start 2024-09-13T15:10:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a52000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2a4c06aaa0 0x7f2a4c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a52000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c0ccb40 con 0x7f2a4c0cb020 2024-09-13T15:10:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a52000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c06b430 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a52000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b2ad0 con 0x7f2a4c06aaa0 2024-09-13T15:10:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a50c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a4c0cb020 0x7f2a4c15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60626/0 (socket says 172.21.15.50:60626) 2024-09-13T15:10:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a50c00700 1 -- 172.21.15.50:0/1643816633 learned_addr learned my addr 172.21.15.50:0/1643816633 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a51600700 1 --2- 172.21.15.50:0/1643816633 >> v2:172.21.15.181:3300/0 conn(0x7f2a4c06aaa0 0x7f2a4c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782982217 0 0) 0x7f2a38001110 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.806+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a340035d0 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748921953 0 0) 0x7f2a4c0ccb40 con 0x7f2a4c0cb020 2024-09-13T15:10:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a38001110 con 0x7f2a4c0cb020 2024-09-13T15:10:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458198092 0 0) 0x7f2a340035d0 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a51600700 1 -- 172.21.15.50:0/1643816633 >> v1:172.21.15.181:6789/0 conn(0x7f2a4c0cc6f0 legacy=0x7f2a4c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a51600700 1 -- 172.21.15.50:0/1643816633 >> v1:172.21.15.50:6789/0 conn(0x7f2a4c0cb020 legacy=0x7f2a4c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a51600700 1 -- 172.21.15.50:0/1643816633 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c15b960 con 0x7f2a4c06aaa0 2024-09-13T15:10:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a51600700 1 --2- 172.21.15.50:0/1643816633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06aef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009d90 tx=0x7f2a4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4db7746b579d483 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400e070 con 0x7f2a4c06aaa0 2024-09-13T15:10:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44003a40 con 0x7f2a4c06aaa0 2024-09-13T15:10:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a4b400700 1 -- 172.21.15.50:0/1643816633 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38001800 con 0x7f2a4c06aaa0 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 -- 172.21.15.50:0/1643816633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 msgr2=0x7f2a4c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 --2- 172.21.15.50:0/1643816633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06aef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009d90 tx=0x7f2a4400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 -- 172.21.15.50:0/1643816633 shutdown_connections 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 --2- 172.21.15.50:0/1643816633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06aef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 -- 172.21.15.50:0/1643816633 >> 172.21.15.50:0/1643816633 conn(0x7f2a4c0b0c40 msgr2=0x7f2a4c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 -- 172.21.15.50:0/1643816633 shutdown_connections 2024-09-13T15:10:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.810+0000 7f2a52000700 1 -- 172.21.15.50:0/1643816633 wait complete. 2024-09-13T15:10:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.814+0000 7f2a52000700 1 Processor -- start 2024-09-13T15:10:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.814+0000 7f2a52000700 1 -- start start 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a4c0cb020 0x7f2a4c1e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 0x7f2a4c1414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c4260 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c44e0 con 0x7f2a4c06aaa0 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c47c0 con 0x7f2a4c0cb020 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 0x7f2a4c1414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 0x7f2a4c1414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40560/0 (socket says 172.21.15.50:40560) 2024-09-13T15:10:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 -- 172.21.15.50:0/2258007049 learned_addr learned my addr 172.21.15.50:0/2258007049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a50c00700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a4be00700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a4c0cb020 0x7f2a4c1e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 -- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a4c0cb020 msgr2=0x7f2a4c1e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a4c0cb020 0x7f2a4c1e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 -- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 msgr2=0x7f2a4c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 -- 172.21.15.50:0/2258007049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009a70 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a4be00700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a4c0cb020 0x7f2a4c1e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a51600700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 0x7f2a4c1414e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0b1690 tx=0x7f2a44004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440044c0 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44004620 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44012430 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c0c4aa0 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.818+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c0c5060 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.822+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c0c5280 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.822+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a44012590 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.822+0000 7f2a48c00700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a2c066730 0x7f2a2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.826+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a44085f40 con 0x7f2a4c0cc6f0 2024-09-13T15:10:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.826+0000 7f2a50c00700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a2c066730 0x7f2a2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:17.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.826+0000 7f2a50c00700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a2c066730 0x7f2a2c068bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2a40007fd0 tx=0x7f2a40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:17.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:17.830+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a44053160 con 0x7f2a4c0cc6f0 2024-09-13T15:10:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.026+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a4c15b610 con 0x7f2a4c0cc6f0 2024-09-13T15:10:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.030+0000 7f2a48c00700 1 -- 172.21.15.50:0/2258007049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16717 (secure 0 0 0) 0x7f2a44056780 con 0x7f2a4c0cc6f0 2024-09-13T15:10:18.036 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:18.036 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":64,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:17.160697+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a2c066730 msgr2=0x7f2a2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a2c066730 0x7f2a2c068bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2a40007fd0 tx=0x7f2a40009040 comp rx=0 tx=0).stop 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 msgr2=0x7f2a4c1414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 0x7f2a4c1414e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0b1690 tx=0x7f2a44004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 shutdown_connections 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2a2c066730 0x7f2a2c068bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a4c0cc6f0 0x7f2a4c1414e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2a4c0cb020 0x7f2a4c1e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 --2- 172.21.15.50:0/2258007049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a4c06aaa0 0x7f2a4c06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 >> 172.21.15.50:0/2258007049 conn(0x7f2a4c0b0c40 msgr2=0x7f2a4c158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 shutdown_connections 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.034+0000 7f2a52000700 1 -- 172.21.15.50:0/2258007049 wait complete. 2024-09-13T15:10:18.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:10:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 Processor -- start 2024-09-13T15:10:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 -- start start 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19b406f480 0x7f19b40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406a770 0x7f19b415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b406baf0 con 0x7f19b415aa60 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b406ac20 con 0x7f19b406f480 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.242+0000 7f19b9c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b406aee0 con 0x7f19b406a770 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19b406f480 0x7f19b40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19b406f480 0x7f19b40cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59528/0 (socket says 172.21.15.50:59528) 2024-09-13T15:10:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 -- 172.21.15.50:0/805569219 learned_addr learned my addr 172.21.15.50:0/805569219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b3400700 1 --2- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406a770 0x7f19b415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 -- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406a770 msgr2=0x7f19b415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 --2- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406a770 0x7f19b415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 -- 172.21.15.50:0/805569219 >> v1:172.21.15.181:6789/0 conn(0x7f19b415aa60 legacy=0x7f19b406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 -- 172.21.15.50:0/805569219 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b406b1c0 con 0x7f19b406f480 2024-09-13T15:10:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b2000700 1 --2- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b406f480 0x7f19b40cf480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009910 tx=0x7f19a0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38abed22dc0c328c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:18.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b1600700 1 -- 172.21.15.50:0/805569219 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011830 con 0x7f19b406f480 2024-09-13T15:10:18.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b1600700 1 -- 172.21.15.50:0/805569219 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0011990 con 0x7f19b406f480 2024-09-13T15:10:18.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.246+0000 7f19b1600700 1 -- 172.21.15.50:0/805569219 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011d40 con 0x7f19b406f480 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 -- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b406f480 msgr2=0x7f19b40cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 --2- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b406f480 0x7f19b40cf480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009910 tx=0x7f19a0009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 -- 172.21.15.50:0/805569219 shutdown_connections 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 --2- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406a770 0x7f19b415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 --2- 172.21.15.50:0/805569219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b406f480 0x7f19b40cf480 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 -- 172.21.15.50:0/805569219 >> 172.21.15.50:0/805569219 conn(0x7f19b406d530 msgr2=0x7f19b406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 -- 172.21.15.50:0/805569219 shutdown_connections 2024-09-13T15:10:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 -- 172.21.15.50:0/805569219 wait complete. 2024-09-13T15:10:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 Processor -- start 2024-09-13T15:10:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.250+0000 7f19b9c00700 1 -- start start 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 0x7f19b41e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406f480 0x7f19b40b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b415aa60 0x7f19b415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b415daf0 con 0x7f19b406a770 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b415e0d0 con 0x7f19b415aa60 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b41e3300 con 0x7f19b406f480 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 0x7f19b41e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 0x7f19b41e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40568/0 (socket says 172.21.15.50:40568) 2024-09-13T15:10:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 -- 172.21.15.50:0/1491259414 learned_addr learned my addr 172.21.15.50:0/1491259414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:18.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b3400700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b415aa60 0x7f19b415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2000700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406f480 0x7f19b40b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 -- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406f480 msgr2=0x7f19b40b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406f480 0x7f19b40b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 -- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b415aa60 msgr2=0x7f19b415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b415aa60 0x7f19b415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 -- 172.21.15.50:0/1491259414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009570 con 0x7f19b406a770 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2000700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406f480 0x7f19b40b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b2a00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 0x7f19b41e40c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c500 tx=0x7f19a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40052d0 con 0x7f19b406a770 2024-09-13T15:10:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005430 con 0x7f19b406a770 2024-09-13T15:10:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b41e35e0 con 0x7f19b406a770 2024-09-13T15:10:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40055a0 con 0x7f19b406a770 2024-09-13T15:10:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.254+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b41e3ba0 con 0x7f19b406a770 2024-09-13T15:10:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.258+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b40b5100 con 0x7f19b406a770 2024-09-13T15:10:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.258+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19a40038e0 con 0x7f19b406a770 2024-09-13T15:10:18.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.262+0000 7f19aaa00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1994066730 0x7f1994068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.262+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19a4083710 con 0x7f19b406a770 2024-09-13T15:10:18.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.262+0000 7f19b2000700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1994066730 0x7f1994068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.262+0000 7f19b2000700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1994066730 0x7f1994068bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009910 tx=0x7f19a0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.266+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19a40508a0 con 0x7f19b406a770 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:18.482+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f19b41e3d90 con 0x7f19b406a770 2024-09-13T15:10:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.174+0000 7f19aaa00700 1 -- 172.21.15.50:0/1491259414 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f19a4053ec0 con 0x7f19b406a770 2024-09-13T15:10:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1994066730 msgr2=0x7f1994068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1994066730 0x7f1994068bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009910 tx=0x7f19a0008030 comp rx=0 tx=0).stop 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 msgr2=0x7f19b41e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 0x7f19b41e40c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c500 tx=0x7f19a400c810 comp rx=0 tx=0).stop 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 shutdown_connections 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1994066730 0x7f1994068bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19b415aa60 0x7f19b415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19b406f480 0x7f19b40b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 --2- 172.21.15.50:0/1491259414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19b406a770 0x7f19b41e40c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 >> 172.21.15.50:0/1491259414 conn(0x7f19b406d530 msgr2=0x7f19b40cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 shutdown_connections 2024-09-13T15:10:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.182+0000 7f19b9c00700 1 -- 172.21.15.50:0/1491259414 wait complete. 2024-09-13T15:10:19.218 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:10:19.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:10:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.386+0000 7fb10f600700 1 Processor -- start 2024-09-13T15:10:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.386+0000 7fb10f600700 1 -- start start 2024-09-13T15:10:19.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10f600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 0x7fb1080b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10f600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10806bcf0 con 0x7fb108144710 2024-09-13T15:10:19.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10f600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10806cb50 con 0x7fb108144330 2024-09-13T15:10:19.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10f600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cce10 con 0x7fb10806d760 2024-09-13T15:10:19.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10d600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb108144710 0x7fb1080b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60628/0 (socket says 172.21.15.50:60628) 2024-09-13T15:10:19.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10d600700 1 -- 172.21.15.50:0/1772123184 learned_addr learned my addr 172.21.15.50:0/1772123184 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:19.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107e00700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 0x7fb1080b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933719489 0 0) 0x7fb10806bcf0 con 0x7fb108144710 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f00035d0 con 0x7fb108144710 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 24340726 0 0) 0x7fb0f00035d0 con 0x7fb108144710 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 msgr2=0x7fb1080b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 0x7fb1080b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 >> v1:172.21.15.181:6789/0 conn(0x7fb108144330 legacy=0x7fb1080cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10806bf40 con 0x7fb108144710 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fb1000019f0 con 0x7fb108144710 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 >> v1:172.21.15.50:6789/0 conn(0x7fb108144710 legacy=0x7fb1080b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0f0003a50 0x7fb0f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 0x7fb0f0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0f0004db0 0x7fb0f0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cce10 con 0x7fb0f0004db0 2024-09-13T15:10:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f000bae0 con 0x7fb0f0003a50 2024-09-13T15:10:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f000bca0 con 0x7fb10806d760 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10d600700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0f0004db0 0x7fb0f0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10cc00700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0f0003a50 0x7fb0f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb107e00700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 0x7fb0f0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.390+0000 7fb10cc00700 1 -- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 msgr2=0x7fb0f0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10cc00700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb10806d760 0x7fb0f0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10cc00700 1 -- 172.21.15.50:0/1772123184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0f0004db0 msgr2=0x7fb0f0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10cc00700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0f0004db0 0x7fb0f0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10cc00700 1 -- 172.21.15.50:0/1772123184 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f00035d0 con 0x7fb0f0003a50 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10d600700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0f0004db0 0x7fb0f0005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10cc00700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0f0003a50 0x7fb0f0003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0f00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c7f7e94faa34224 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:19.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0052d0 con 0x7fb0f0003a50 2024-09-13T15:10:19.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc005430 con 0x7fb0f0003a50 2024-09-13T15:10:19.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb107400700 1 -- 172.21.15.50:0/1772123184 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0055a0 con 0x7fb0f0003a50 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10f600700 1 -- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0f0003a50 msgr2=0x7fb0f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10f600700 1 --2- 172.21.15.50:0/1772123184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0f0003a50 0x7fb0f0003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0f00058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10d600700 1 -- 172.21.15.50:0/1772123184 reap_dead start 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10f600700 1 -- 172.21.15.50:0/1772123184 shutdown_connections 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10f600700 1 -- 172.21.15.50:0/1772123184 >> 172.21.15.50:0/1772123184 conn(0x7fb10806a570 msgr2=0x7fb10806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10f600700 1 -- 172.21.15.50:0/1772123184 shutdown_connections 2024-09-13T15:10:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.394+0000 7fb10f600700 1 -- 172.21.15.50:0/1772123184 wait complete. 2024-09-13T15:10:19.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 Processor -- start 2024-09-13T15:10:19.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 -- start start 2024-09-13T15:10:19.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0f0003a50 0x7fb108070530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10815d180 0x7fb1081392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 0x7fb1080a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108139c90 con 0x7fb108139800 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10815c170 con 0x7fb10815d180 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10f600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10815ccf0 con 0x7fb0f0003a50 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10d600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 0x7fb1080a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10d600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 0x7fb1080a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40580/0 (socket says 172.21.15.50:40580) 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10d600700 1 -- 172.21.15.50:0/3751140400 learned_addr learned my addr 172.21.15.50:0/3751140400 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb10cc00700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0f0003a50 0x7fb108070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.398+0000 7fb107e00700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10815d180 0x7fb1081392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10d600700 1 -- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0f0003a50 msgr2=0x7fb108070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10d600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0f0003a50 0x7fb108070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10d600700 1 -- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10815d180 msgr2=0x7fb1081392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10d600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10815d180 0x7fb1081392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10d600700 1 -- 172.21.15.50:0/3751140400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10815c3c0 con 0x7fb108139800 2024-09-13T15:10:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10d600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 0x7fb1080a85d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb10815b010 tx=0x7fb100007290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100001ea0 con 0x7fb108139800 2024-09-13T15:10:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100007a00 con 0x7fb108139800 2024-09-13T15:10:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000135f0 con 0x7fb108139800 2024-09-13T15:10:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10815c6a0 con 0x7fb108139800 2024-09-13T15:10:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb108070a70 con 0x7fb108139800 2024-09-13T15:10:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb108070c30 con 0x7fb108139800 2024-09-13T15:10:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.402+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb100013750 con 0x7fb108139800 2024-09-13T15:10:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.406+0000 7fb104c00700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0e8066730 0x7fb0e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.406+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1000847e0 con 0x7fb108139800 2024-09-13T15:10:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.406+0000 7fb10cc00700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0e8066730 0x7fb0e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.410+0000 7fb10cc00700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0e8066730 0x7fb0e8068bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc000ff0 tx=0x7fb0fc009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:19.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.414+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb100055400 con 0x7fb108139800 2024-09-13T15:10:19.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:19.634+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb10815ce80 con 0x7fb108139800 2024-09-13T15:10:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.178+0000 7fb104c00700 1 -- 172.21.15.50:0/3751140400 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb10000a450 con 0x7fb108139800 2024-09-13T15:10:20.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0e8066730 msgr2=0x7fb0e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0e8066730 0x7fb0e8068bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc000ff0 tx=0x7fb0fc009030 comp rx=0 tx=0).stop 2024-09-13T15:10:20.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 msgr2=0x7fb1080a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 0x7fb1080a85d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb10815b010 tx=0x7fb100007290 comp rx=0 tx=0).stop 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 shutdown_connections 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb0e8066730 0x7fb0e8068bf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb108139800 0x7fb1080a85d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10815d180 0x7fb1081392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 --2- 172.21.15.50:0/3751140400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0f0003a50 0x7fb108070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 >> 172.21.15.50:0/3751140400 conn(0x7fb10806a570 msgr2=0x7fb1080ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 shutdown_connections 2024-09-13T15:10:20.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.182+0000 7fb10f600700 1 -- 172.21.15.50:0/3751140400 wait complete. 2024-09-13T15:10:20.216 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:10:20.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.390+0000 7f1ca3e00700 1 Processor -- start 2024-09-13T15:10:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.390+0000 7f1ca3e00700 1 -- start start 2024-09-13T15:10:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c9c15a830 0x7f1c9c066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b3960 0x7f1c9c0665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca3e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c15e000 con 0x7f1c9c0b5300 2024-09-13T15:10:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca3e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c15ac10 con 0x7f1c9c15a830 2024-09-13T15:10:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c15d1e0 con 0x7f1c9c0b3960 2024-09-13T15:10:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c9c15a830 0x7f1c9c066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1c9c0b5300 0x7f1c9c0b5790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60644/0 (socket says 172.21.15.50:60644) 2024-09-13T15:10:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1e00700 1 -- 172.21.15.50:0/3564597411 learned_addr learned my addr 172.21.15.50:0/3564597411 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca0a00700 1 --2- 172.21.15.50:0/3564597411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b3960 0x7f1c9c0665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1400700 1 -- 172.21.15.50:0/3564597411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b3960 msgr2=0x7f1c9c0665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1400700 1 --2- 172.21.15.50:0/3564597411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b3960 0x7f1c9c0665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1400700 1 -- 172.21.15.50:0/3564597411 >> v1:172.21.15.50:6789/0 conn(0x7f1c9c0b5300 legacy=0x7f1c9c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.394+0000 7f1ca1400700 1 -- 172.21.15.50:0/3564597411 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c15d3f0 con 0x7f1c9c15a830 2024-09-13T15:10:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca1400700 1 --2- 172.21.15.50:0/3564597411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c066090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009d90 tx=0x7f1c9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2043aca1f4e72f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1c9be00700 1 -- 172.21.15.50:0/3564597411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000e070 con 0x7f1c9c15a830 2024-09-13T15:10:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1c9be00700 1 -- 172.21.15.50:0/3564597411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9000bb20 con 0x7f1c9c15a830 2024-09-13T15:10:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1c9be00700 1 -- 172.21.15.50:0/3564597411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90012430 con 0x7f1c9c15a830 2024-09-13T15:10:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 -- 172.21.15.50:0/3564597411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 msgr2=0x7f1c9c066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/3564597411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c066090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009d90 tx=0x7f1c9000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 -- 172.21.15.50:0/3564597411 shutdown_connections 2024-09-13T15:10:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/3564597411 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b3960 0x7f1c9c0665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/3564597411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c066090 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 -- 172.21.15.50:0/3564597411 >> 172.21.15.50:0/3564597411 conn(0x7f1c9c06e660 msgr2=0x7f1c9c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 -- 172.21.15.50:0/3564597411 shutdown_connections 2024-09-13T15:10:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.398+0000 7f1ca3e00700 1 -- 172.21.15.50:0/3564597411 wait complete. 2024-09-13T15:10:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 Processor -- start 2024-09-13T15:10:20.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 -- start start 2024-09-13T15:10:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c0b3960 0x7f1c9c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b5300 0x7f1c9c0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c158c00 con 0x7f1c9c15a830 2024-09-13T15:10:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c158ee0 con 0x7f1c9c0b3960 2024-09-13T15:10:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.402+0000 7f1ca3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c1591c0 con 0x7f1c9c0b5300 2024-09-13T15:10:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c0b3960 0x7f1c9c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c0b3960 0x7f1c9c140d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59562/0 (socket says 172.21.15.50:59562) 2024-09-13T15:10:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c0b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40610/0 (socket says 172.21.15.50:40610) 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca0a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b5300 0x7f1c9c0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1400700 1 -- 172.21.15.50:0/329707857 learned_addr learned my addr 172.21.15.50:0/329707857 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 -- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b5300 msgr2=0x7f1c9c0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b5300 0x7f1c9c0b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 -- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c0b3960 msgr2=0x7f1c9c140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c0b3960 0x7f1c9c140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 -- 172.21.15.50:0/329707857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009a70 con 0x7f1c9c15a830 2024-09-13T15:10:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca0a00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b5300 0x7f1c9c0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca1e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c0b48a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c400 tx=0x7f1c9400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94005d90 con 0x7f1c9c15a830 2024-09-13T15:10:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9400ce10 con 0x7f1c9c15a830 2024-09-13T15:10:20.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c1594a0 con 0x7f1c9c15a830 2024-09-13T15:10:20.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c940072f0 con 0x7f1c9c15a830 2024-09-13T15:10:20.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.406+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c159ca0 con 0x7f1c9c15a830 2024-09-13T15:10:20.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.410+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c0aca20 con 0x7f1c9c15a830 2024-09-13T15:10:20.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.410+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c94007450 con 0x7f1c9c15a830 2024-09-13T15:10:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.410+0000 7f1c99600700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c7c066730 0x7f1c7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.414+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1c94083600 con 0x7f1c9c15a830 2024-09-13T15:10:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.414+0000 7f1ca1400700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c7c066730 0x7f1c7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.414+0000 7f1ca1400700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c7c066730 0x7f1c7c068bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c90000f80 tx=0x7f1c90011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.418+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c9c0aca20 con 0x7f1c9c15a830 2024-09-13T15:10:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.646+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c9c1599c0 con 0x7f1c9c15a830 2024-09-13T15:10:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.650+0000 7f1c99600700 1 -- 172.21.15.50:0/329707857 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f1c9c1599c0 con 0x7f1c9c15a830 2024-09-13T15:10:20.655 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:20.655 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:17.161542+0000","modified":"2024-09-13T15:10:20.177482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4135812870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4135812870},{"type":"v1","addr":"172.21.15.50:6835","nonce":4135812870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T15:10:20.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c7c066730 msgr2=0x7f1c7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c7c066730 0x7f1c7c068bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c90000f80 tx=0x7f1c90011000 comp rx=0 tx=0).stop 2024-09-13T15:10:20.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 msgr2=0x7f1c9c0b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c0b48a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c400 tx=0x7f1c9400c710 comp rx=0 tx=0).stop 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 shutdown_connections 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1c7c066730 0x7f1c7c068bf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c15a830 0x7f1c9c0b48a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1c9c0b5300 0x7f1c9c0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 --2- 172.21.15.50:0/329707857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9c0b3960 0x7f1c9c140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 >> 172.21.15.50:0/329707857 conn(0x7f1c9c06e660 msgr2=0x7f1c9c0ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 shutdown_connections 2024-09-13T15:10:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.654+0000 7f1ca3e00700 1 -- 172.21.15.50:0/329707857 wait complete. 2024-09-13T15:10:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2024-09-13T15:10:20.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.854+0000 7f1dd3200700 1 Processor -- start 2024-09-13T15:10:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.854+0000 7f1dd3200700 1 -- start start 2024-09-13T15:10:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.854+0000 7f1dd3200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1dd406aaa0 0x7f1dd415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.854+0000 7f1dd3200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd415e560 con 0x7f1dd40b3980 2024-09-13T15:10:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.854+0000 7f1dd3200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd415d920 con 0x7f1dd415e9f0 2024-09-13T15:10:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.854+0000 7f1dd3200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40adf90 con 0x7f1dd406aaa0 2024-09-13T15:10:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dc9400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1dd40b3980 0x7f1dd406ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60658/0 (socket says 172.21.15.50:60658) 2024-09-13T15:10:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dc9400700 1 -- 172.21.15.50:0/1243437713 learned_addr learned my addr 172.21.15.50:0/1243437713 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1e00700 1 --2- 172.21.15.50:0/1243437713 >> v2:172.21.15.181:3300/0 conn(0x7f1dd406aaa0 0x7f1dd415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1400700 1 -- 172.21.15.50:0/1243437713 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468262648 0 0) 0x7f1dd415e560 con 0x7f1dd40b3980 2024-09-13T15:10:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1400700 1 -- 172.21.15.50:0/1243437713 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db80035d0 con 0x7f1dd40b3980 2024-09-13T15:10:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1e00700 1 -- 172.21.15.50:0/1243437713 >> v1:172.21.15.181:6789/0 conn(0x7f1dd415e9f0 legacy=0x7f1dd415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1e00700 1 -- 172.21.15.50:0/1243437713 >> v1:172.21.15.50:6789/0 conn(0x7f1dd40b3980 legacy=0x7f1dd406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1e00700 1 -- 172.21.15.50:0/1243437713 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd415dc00 con 0x7f1dd406aaa0 2024-09-13T15:10:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1e00700 1 --2- 172.21.15.50:0/1243437713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd415d310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009850 tx=0x7f1dc4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee8ae3ee06df2c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1400700 1 -- 172.21.15.50:0/1243437713 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011830 con 0x7f1dd406aaa0 2024-09-13T15:10:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1400700 1 -- 172.21.15.50:0/1243437713 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4011990 con 0x7f1dd406aaa0 2024-09-13T15:10:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd1400700 1 -- 172.21.15.50:0/1243437713 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011d40 con 0x7f1dd406aaa0 2024-09-13T15:10:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 -- 172.21.15.50:0/1243437713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 msgr2=0x7f1dd415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 --2- 172.21.15.50:0/1243437713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd415d310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009850 tx=0x7f1dc4009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 -- 172.21.15.50:0/1243437713 shutdown_connections 2024-09-13T15:10:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 --2- 172.21.15.50:0/1243437713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd415d310 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 -- 172.21.15.50:0/1243437713 >> 172.21.15.50:0/1243437713 conn(0x7f1dd40b0c40 msgr2=0x7f1dd406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 -- 172.21.15.50:0/1243437713 shutdown_connections 2024-09-13T15:10:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.858+0000 7f1dd3200700 1 -- 172.21.15.50:0/1243437713 wait complete. 2024-09-13T15:10:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.862+0000 7f1dd3200700 1 Processor -- start 2024-09-13T15:10:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.862+0000 7f1dd3200700 1 -- start start 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.862+0000 7f1dd3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd413a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.862+0000 7f1dd3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1dd40b3980 0x7f1dd41f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 0x7f1dd4138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd3200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd415cf20 con 0x7f1dd415e9f0 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41396e0 con 0x7f1dd406aaa0 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41399c0 con 0x7f1dd40b3980 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 0x7f1dd4138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd413a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 0x7f1dd4138de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40620/0 (socket says 172.21.15.50:40620) 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd413a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59582/0 (socket says 172.21.15.50:59582) 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd2800700 1 -- 172.21.15.50:0/2683516213 learned_addr learned my addr 172.21.15.50:0/2683516213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dc9400700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1dd40b3980 0x7f1dd41f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 -- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1dd40b3980 msgr2=0x7f1dd41f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1dd40b3980 0x7f1dd41f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 -- 172.21.15.50:0/2683516213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 msgr2=0x7f1dd4138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 0x7f1dd4138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 -- 172.21.15.50:0/2683516213 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40094b0 con 0x7f1dd406aaa0 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd2800700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 0x7f1dd4138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd1e00700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd413a4a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4016000 tx=0x7f1dc4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401a990 con 0x7f1dd406aaa0 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc401f070 con 0x7f1dd406aaa0 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41f6e10 con 0x7f1dd406aaa0 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401ad30 con 0x7f1dd406aaa0 2024-09-13T15:10:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.866+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd41f6a70 con 0x7f1dd406aaa0 2024-09-13T15:10:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.870+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd41f6c60 con 0x7f1dd406aaa0 2024-09-13T15:10:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.870+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dc402e450 con 0x7f1dd406aaa0 2024-09-13T15:10:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.870+0000 7f1dcaa00700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1db0066730 0x7f1db0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.870+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1dc4085800 con 0x7f1dd406aaa0 2024-09-13T15:10:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.874+0000 7f1dc9400700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1db0066730 0x7f1db0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.874+0000 7f1dc9400700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1db0066730 0x7f1db0068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ce4e0 tx=0x7f1dbc007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:20.882+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1dc4052a20 con 0x7f1dd406aaa0 2024-09-13T15:10:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.074+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dd4139820 con 0x7f1dd406aaa0 2024-09-13T15:10:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.078+0000 7f1dcaa00700 1 -- 172.21.15.50:0/2683516213 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16704 (secure 0 0 0) 0x7f1dd4139820 con 0x7f1dd406aaa0 2024-09-13T15:10:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:21.084 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:18.166138+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1db0066730 msgr2=0x7f1db0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1db0066730 0x7f1db0068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ce4e0 tx=0x7f1dbc007de0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 msgr2=0x7f1dd413a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd413a4a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4016000 tx=0x7f1dc4004770 comp rx=0 tx=0).stop 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 shutdown_connections 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1db0066730 0x7f1db0068bf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd415e9f0 0x7f1dd4138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1dd40b3980 0x7f1dd41f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 --2- 172.21.15.50:0/2683516213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dd406aaa0 0x7f1dd413a4a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 >> 172.21.15.50:0/2683516213 conn(0x7f1dd40b0c40 msgr2=0x7f1dd4142710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 shutdown_connections 2024-09-13T15:10:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.082+0000 7f1dd3200700 1 -- 172.21.15.50:0/2683516213 wait complete. 2024-09-13T15:10:21.115 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:10:21.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe00e200700 1 Processor -- start 2024-09-13T15:10:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe00e200700 1 -- start start 2024-09-13T15:10:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe00e200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fe00806fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe00e200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe008146a40 con 0x7fe0080d0a80 2024-09-13T15:10:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe00e200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080701a0 con 0x7fe0080cb4e0 2024-09-13T15:10:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe00e200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081629d0 con 0x7fe00806f880 2024-09-13T15:10:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe007e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe0080d0a80 0x7fe0080d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60674/0 (socket says 172.21.15.50:60674) 2024-09-13T15:10:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe007e00700 1 -- 172.21.15.50:0/4109614846 learned_addr learned my addr 172.21.15.50:0/4109614846 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe007400700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fe00806fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.286+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772605618 0 0) 0x7fe008146a40 con 0x7fe0080d0a80 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfec0035d0 con 0x7fe0080d0a80 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568776647 0 0) 0x7fe0080701a0 con 0x7fe0080cb4e0 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe008146a40 con 0x7fe0080cb4e0 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517856401 0 0) 0x7fdfec0035d0 con 0x7fe0080d0a80 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 msgr2=0x7fe00806fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fe00806fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 >> v1:172.21.15.181:6789/0 conn(0x7fe0080cb4e0 legacy=0x7fe0080cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008146cd0 con 0x7fe0080d0a80 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fe000001670 con 0x7fe0080d0a80 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fe00806fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 >> v1:172.21.15.50:6789/0 conn(0x7fe0080d0a80 legacy=0x7fe0080d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fdfec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec004870 0x7fdfec004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fdfec005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081629d0 con 0x7fdfec003be0 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec00bb10 con 0x7fdfec004870 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec00bcd0 con 0x7fe00806f880 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fdfec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007e00700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fdfec005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006a00700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec004870 0x7fdfec004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 -- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 msgr2=0x7fdfec005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe00806f880 0x7fdfec005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 -- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec004870 msgr2=0x7fdfec004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec004870 0x7fdfec004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 -- 172.21.15.50:0/4109614846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009a70 con 0x7fdfec003be0 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe007400700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fdfec003fe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdff800e320 tx=0x7fdfec0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9838607ad9ad3c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800ed60 con 0x7fdfec003be0 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800f040 con 0x7fdfec003be0 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.290+0000 7fe006000700 1 -- 172.21.15.50:0/4109614846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80146a0 con 0x7fdfec003be0 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 -- 172.21.15.50:0/4109614846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 msgr2=0x7fdfec003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 --2- 172.21.15.50:0/4109614846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fdfec003fe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdff800e320 tx=0x7fdfec0058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe007e00700 1 -- 172.21.15.50:0/4109614846 reap_dead start 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 -- 172.21.15.50:0/4109614846 shutdown_connections 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 -- 172.21.15.50:0/4109614846 >> 172.21.15.50:0/4109614846 conn(0x7fe0080726d0 msgr2=0x7fe00806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 -- 172.21.15.50:0/4109614846 shutdown_connections 2024-09-13T15:10:21.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 -- 172.21.15.50:0/4109614846 wait complete. 2024-09-13T15:10:21.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 Processor -- start 2024-09-13T15:10:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.294+0000 7fe00e200700 1 -- start start 2024-09-13T15:10:21.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fe008154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe008155440 0x7fe0080b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0080b4fc0 0x7fe008135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008147670 con 0x7fdfec003be0 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081558c0 con 0x7fe0080b4fc0 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081366e0 con 0x7fe008155440 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fe008154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fe008154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40652/0 (socket says 172.21.15.50:40652) 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 -- 172.21.15.50:0/3250764683 learned_addr learned my addr 172.21.15.50:0/3250764683 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007e00700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0080b4fc0 0x7fe008135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe006a00700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe008155440 0x7fe0080b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 -- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe008155440 msgr2=0x7fe0080b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe008155440 0x7fe0080b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 -- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0080b4fc0 msgr2=0x7fe008135980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0080b4fc0 0x7fe008135980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 -- 172.21.15.50:0/3250764683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080b5440 con 0x7fdfec003be0 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe007400700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fe008154f00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdff800e910 tx=0x7fdff8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8003a40 con 0x7fdfec003be0 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff8003bc0 con 0x7fdfec003be0 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8004030 con 0x7fdfec003be0 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0081324e0 con 0x7fdfec003be0 2024-09-13T15:10:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.298+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe008132a60 con 0x7fdfec003be0 2024-09-13T15:10:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.302+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00806fc60 con 0x7fdfec003be0 2024-09-13T15:10:21.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.302+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdff8004190 con 0x7fdfec003be0 2024-09-13T15:10:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.302+0000 7fdfff400700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdfe8066730 0x7fdfe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.302+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdff80864a0 con 0x7fdfec003be0 2024-09-13T15:10:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.302+0000 7fe006a00700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdfe8066730 0x7fdfe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.306+0000 7fe006a00700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdfe8066730 0x7fdfe8068bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe008164110 tx=0x7fdff4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:21.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.310+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdff80536c0 con 0x7fdfec003be0 2024-09-13T15:10:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.498+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe008147290 con 0x7fdfe8066730 2024-09-13T15:10:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.514+0000 7fdfff400700 1 -- 172.21.15.50:0/3250764683 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275656 (secure 0 0 0) 0x7fdff4006880 con 0x7fdfe8066730 2024-09-13T15:10:21.526 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdfe8066730 msgr2=0x7fdfe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdfe8066730 0x7fdfe8068bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe008164110 tx=0x7fdff4009040 comp rx=0 tx=0).stop 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 msgr2=0x7fe008154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fe008154f00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdff800e910 tx=0x7fdff8009750 comp rx=0 tx=0).stop 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 shutdown_connections 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdfe8066730 0x7fdfe8068bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0080b4fc0 0x7fe008135980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe008155440 0x7fe0080b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 --2- 172.21.15.50:0/3250764683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfec003be0 0x7fe008154f00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 >> 172.21.15.50:0/3250764683 conn(0x7fe0080726d0 msgr2=0x7fe008164fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 shutdown_connections 2024-09-13T15:10:21.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.522+0000 7fe00e200700 1 -- 172.21.15.50:0/3250764683 wait complete. 2024-09-13T15:10:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:21.549 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-13T15:10:20.065582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239484,"kb_used_data":6920,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735236,"statfs":{"total":773094113280,"available":772848881664,"internally_reserved":0,"allocated":7086080,"data_stored":3785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.391381"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.683796+0000","last_change":"2024-09-13T15:10:15.683796+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.683796+0000","last_undegraded":"2024-09-13T15:10:15.683796+0000","last_fullsized":"2024-09-13T15:10:15.683796+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691391+0000","last_change":"2024-09-13T15:10:15.691391+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691391+0000","last_undegraded":"2024-09-13T15:10:15.691391+0000","last_fullsized":"2024-09-13T15:10:15.691391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:46.057647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.692575+0000","last_change":"2024-09-13T15:10:15.692575+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.692575+0000","last_undegraded":"2024-09-13T15:10:15.692575+0000","last_fullsized":"2024-09-13T15:10:15.692575+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:00.677998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691465+0000","last_change":"2024-09-13T15:10:15.691465+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691465+0000","last_undegraded":"2024-09-13T15:10:15.691465+0000","last_fullsized":"2024-09-13T15:10:15.691465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.686835+0000","last_change":"2024-09-13T15:10:15.686835+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.686835+0000","last_undegraded":"2024-09-13T15:10:15.686835+0000","last_fullsized":"2024-09-13T15:10:15.686835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.687284+0000","last_change":"2024-09-13T15:10:15.687284+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.687284+0000","last_undegraded":"2024-09-13T15:10:15.687284+0000","last_fullsized":"2024-09-13T15:10:15.687284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:53.117052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.686129+0000","last_change":"2024-09-13T15:10:15.686129+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.686129+0000","last_undegraded":"2024-09-13T15:10:15.686129+0000","last_fullsized":"2024-09-13T15:10:15.686129+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.684995+0000","last_change":"2024-09-13T15:10:15.684995+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.684995+0000","last_undegraded":"2024-09-13T15:10:15.684995+0000","last_fullsized":"2024-09-13T15:10:15.684995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:37.686588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.680469+0000","last_change":"2024-09-13T15:10:15.680469+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.680469+0000","last_undegraded":"2024-09-13T15:10:15.680469+0000","last_fullsized":"2024-09-13T15:10:15.680469+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.684958+0000","last_change":"2024-09-13T15:10:15.684958+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.684958+0000","last_undegraded":"2024-09-13T15:10:15.684958+0000","last_fullsized":"2024-09-13T15:10:15.684958+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679117+0000","last_change":"2024-09-13T15:10:15.679117+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679117+0000","last_undegraded":"2024-09-13T15:10:15.679117+0000","last_fullsized":"2024-09-13T15:10:15.679117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685177+0000","last_change":"2024-09-13T15:10:15.685177+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685177+0000","last_undegraded":"2024-09-13T15:10:15.685177+0000","last_fullsized":"2024-09-13T15:10:15.685177+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679525+0000","last_change":"2024-09-13T15:10:15.679525+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679525+0000","last_undegraded":"2024-09-13T15:10:15.679525+0000","last_fullsized":"2024-09-13T15:10:15.679525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:10.062343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.680012+0000","last_change":"2024-09-13T15:10:15.680012+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.680012+0000","last_undegraded":"2024-09-13T15:10:15.680012+0000","last_fullsized":"2024-09-13T15:10:15.680012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678105+0000","last_change":"2024-09-13T15:10:15.678105+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678105+0000","last_undegraded":"2024-09-13T15:10:15.678105+0000","last_fullsized":"2024-09-13T15:10:15.678105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.684882+0000","last_change":"2024-09-13T15:10:15.684882+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.684882+0000","last_undegraded":"2024-09-13T15:10:15.684882+0000","last_fullsized":"2024-09-13T15:10:15.684882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:56.163813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679845+0000","last_change":"2024-09-13T15:10:15.679845+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679845+0000","last_undegraded":"2024-09-13T15:10:15.679845+0000","last_fullsized":"2024-09-13T15:10:15.679845+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678105+0000","last_change":"2024-09-13T15:10:15.678105+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678105+0000","last_undegraded":"2024-09-13T15:10:15.678105+0000","last_fullsized":"2024-09-13T15:10:15.678105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:18.080317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678529+0000","last_change":"2024-09-13T15:10:15.678529+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678529+0000","last_undegraded":"2024-09-13T15:10:15.678529+0000","last_fullsized":"2024-09-13T15:10:15.678529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.687540+0000","last_change":"2024-09-13T15:10:15.687540+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.687540+0000","last_undegraded":"2024-09-13T15:10:15.687540+0000","last_fullsized":"2024-09-13T15:10:15.687540+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:39.966872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691354+0000","last_change":"2024-09-13T15:10:15.691354+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691354+0000","last_undegraded":"2024-09-13T15:10:15.691354+0000","last_fullsized":"2024-09-13T15:10:15.691354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:55.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678264+0000","last_change":"2024-09-13T15:10:15.678264+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678264+0000","last_undegraded":"2024-09-13T15:10:15.678264+0000","last_fullsized":"2024-09-13T15:10:15.678264+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691251+0000","last_change":"2024-09-13T15:10:15.691251+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691251+0000","last_undegraded":"2024-09-13T15:10:15.691251+0000","last_fullsized":"2024-09-13T15:10:15.691251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:15.314017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678295+0000","last_change":"2024-09-13T15:10:15.678295+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678295+0000","last_undegraded":"2024-09-13T15:10:15.678295+0000","last_fullsized":"2024-09-13T15:10:15.678295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679150+0000","last_change":"2024-09-13T15:10:15.679150+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679150+0000","last_undegraded":"2024-09-13T15:10:15.679150+0000","last_fullsized":"2024-09-13T15:10:15.679150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.692092+0000","last_change":"2024-09-13T15:10:15.692092+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.692092+0000","last_undegraded":"2024-09-13T15:10:15.692092+0000","last_fullsized":"2024-09-13T15:10:15.692092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.683683+0000","last_change":"2024-09-13T15:10:15.683683+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.683683+0000","last_undegraded":"2024-09-13T15:10:15.683683+0000","last_fullsized":"2024-09-13T15:10:15.683683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678136+0000","last_change":"2024-09-13T15:10:15.678136+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678136+0000","last_undegraded":"2024-09-13T15:10:15.678136+0000","last_fullsized":"2024-09-13T15:10:15.678136+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:05.562203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685762+0000","last_change":"2024-09-13T15:10:15.685762+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685762+0000","last_undegraded":"2024-09-13T15:10:15.685762+0000","last_fullsized":"2024-09-13T15:10:15.685762+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:06.258415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685426+0000","last_change":"2024-09-13T15:10:15.685426+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685426+0000","last_undegraded":"2024-09-13T15:10:15.685426+0000","last_fullsized":"2024-09-13T15:10:15.685426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.520994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.683669+0000","last_change":"2024-09-13T15:10:15.683669+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.683669+0000","last_undegraded":"2024-09-13T15:10:15.683669+0000","last_fullsized":"2024-09-13T15:10:15.683669+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685320+0000","last_change":"2024-09-13T15:10:15.685320+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685320+0000","last_undegraded":"2024-09-13T15:10:15.685320+0000","last_fullsized":"2024-09-13T15:10:15.685320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:25.413033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T15:10:14.218079+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:14.218079+0000","last_peered":"2024-09-13T15:10:14.218079+0000","last_clean":"2024-09-13T15:10:14.218079+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:14.218079+0000","last_undegraded":"2024-09-13T15:10:14.218079+0000","last_fullsized":"2024-09-13T15:10:14.218079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":915366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.2150000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.036},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.339}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.256},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.129}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.276},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.381}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.399}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.528},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.163}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":318532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.93500000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.069},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":1.103}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.2},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":1.149}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.874},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.224},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":1.038},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.2969999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":331135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.367}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2170000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.115},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.284}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.603},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.3240000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.6519999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":331135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1120000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":1.5609999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.589}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.0529999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":2.0219999999999998},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9099999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":1.6599999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.677}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":720896,"data_stored":318532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.21}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.125},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.155}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.306},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.431}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.349}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.395},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.4870000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.454},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.52}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31852,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":749568,"data_stored":331135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":1.1140000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.357}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.304}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.248}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3280000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":737280,"data_stored":324998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.4610000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.669}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.5780000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.762}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.0800000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":0.92100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.113},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.222}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1327104,"data_stored":914347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.073},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.873},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":1.49}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.6559999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.012},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.246}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.399}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.454}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:21.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:21.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.754+0000 7f1834a00700 1 Processor -- start 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1834a00700 1 -- start start 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1834a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18300cb020 0x7f18300cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1834a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1834a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183006b430 con 0x7f183015c2a0 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1834a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300b2ad0 con 0x7f18300cb020 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1834a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183015b960 con 0x7f183006aaa0 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1825e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f183015c2a0 0x7f183015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60682/0 (socket says 172.21.15.50:60682) 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f1825e00700 1 -- 172.21.15.50:0/3865369472 learned_addr learned my addr 172.21.15.50:0/3865369472 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18300cb020 0x7f18300cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182f200700 1 --2- 172.21.15.50:0/3865369472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182f200700 1 -- 172.21.15.50:0/3865369472 >> v2:172.21.15.50:3300/0 conn(0x7f18300cb020 msgr2=0x7f18300cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182f200700 1 --2- 172.21.15.50:0/3865369472 >> v2:172.21.15.50:3300/0 conn(0x7f18300cb020 0x7f18300cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182f200700 1 -- 172.21.15.50:0/3865369472 >> v1:172.21.15.50:6789/0 conn(0x7f183015c2a0 legacy=0x7f183015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182f200700 1 -- 172.21.15.50:0/3865369472 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183015bc40 con 0x7f183006aaa0 2024-09-13T15:10:21.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.758+0000 7f182de00700 1 -- 172.21.15.50:0/3865369472 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276314242 0 0) 0x7f1818001110 con 0x7f183015c2a0 2024-09-13T15:10:21.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f182f200700 1 --2- 172.21.15.50:0/3865369472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183006aef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1828009d90 tx=0x7f182800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5230bc00324bb2e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:21.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f182de00700 1 -- 172.21.15.50:0/3865369472 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800e070 con 0x7f183006aaa0 2024-09-13T15:10:21.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f182de00700 1 -- 172.21.15.50:0/3865369472 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182800bb20 con 0x7f183006aaa0 2024-09-13T15:10:21.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f182de00700 1 -- 172.21.15.50:0/3865369472 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828012430 con 0x7f183006aaa0 2024-09-13T15:10:21.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 -- 172.21.15.50:0/3865369472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 msgr2=0x7f183006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 --2- 172.21.15.50:0/3865369472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183006aef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1828009d90 tx=0x7f182800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 -- 172.21.15.50:0/3865369472 shutdown_connections 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 --2- 172.21.15.50:0/3865369472 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183006aef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 --2- 172.21.15.50:0/3865369472 >> v2:172.21.15.50:3300/0 conn(0x7f18300cb020 0x7f18300cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 -- 172.21.15.50:0/3865369472 >> 172.21.15.50:0/3865369472 conn(0x7f18300b0c40 msgr2=0x7f183006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 -- 172.21.15.50:0/3865369472 shutdown_connections 2024-09-13T15:10:21.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.762+0000 7f1834a00700 1 -- 172.21.15.50:0/3865369472 wait complete. 2024-09-13T15:10:21.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 Processor -- start 2024-09-13T15:10:21.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 -- start start 2024-09-13T15:10:21.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18300cb020 0x7f183014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 0x7f18300c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183014e2c0 con 0x7f183015c2a0 2024-09-13T15:10:21.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183014ef30 con 0x7f18300cb020 2024-09-13T15:10:21.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1834a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183014d2a0 con 0x7f183006aaa0 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 0x7f18300c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 0x7f18300c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40674/0 (socket says 172.21.15.50:40674) 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 -- 172.21.15.50:0/2060136116 learned_addr learned my addr 172.21.15.50:0/2060136116 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182e800700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1825e00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18300cb020 0x7f183014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 -- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 msgr2=0x7f183014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 -- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18300cb020 msgr2=0x7f183014dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18300cb020 0x7f183014dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 -- 172.21.15.50:0/2060136116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009a70 con 0x7f183015c2a0 2024-09-13T15:10:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f1825e00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18300cb020 0x7f183014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.766+0000 7f182f200700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 0x7f18300c9390 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f183015baa0 tx=0x7f1828004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828012430 con 0x7f183015c2a0 2024-09-13T15:10:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1828020070 con 0x7f183015c2a0 2024-09-13T15:10:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828004280 con 0x7f183015c2a0 2024-09-13T15:10:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183014d580 con 0x7f183015c2a0 2024-09-13T15:10:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18300c98d0 con 0x7f183015c2a0 2024-09-13T15:10:21.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183014daa0 con 0x7f183015c2a0 2024-09-13T15:10:21.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.770+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18280043e0 con 0x7f183015c2a0 2024-09-13T15:10:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.774+0000 7f1827400700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f180c066760 0x7f180c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.774+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1828022070 con 0x7f183015c2a0 2024-09-13T15:10:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.774+0000 7f182e800700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f180c066760 0x7f180c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:21.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.774+0000 7f182e800700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f180c066760 0x7f180c068c20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1820009bf0 tx=0x7f1820009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.778+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f183014daa0 con 0x7f183015c2a0 2024-09-13T15:10:21.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.966+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18300cb400 con 0x7f180c066760 2024-09-13T15:10:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.982+0000 7f1827400700 1 -- 172.21.15.50:0/2060136116 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275656 (secure 0 0 0) 0x7f18200118c0 con 0x7f180c066760 2024-09-13T15:10:21.993 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f180c066760 msgr2=0x7f180c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f180c066760 0x7f180c068c20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1820009bf0 tx=0x7f1820009240 comp rx=0 tx=0).stop 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 msgr2=0x7f18300c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 0x7f18300c9390 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f183015baa0 tx=0x7f1828004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 shutdown_connections 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f180c066760 0x7f180c068c20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f183015c2a0 0x7f18300c9390 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18300cb020 0x7f183014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 --2- 172.21.15.50:0/2060136116 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f183006aaa0 0x7f183014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 >> 172.21.15.50:0/2060136116 conn(0x7f18300b0c40 msgr2=0x7f183014bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 shutdown_connections 2024-09-13T15:10:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:21.990+0000 7f1834a00700 1 -- 172.21.15.50:0/2060136116 wait complete. 2024-09-13T15:10:21.997 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:22.017 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-13T15:10:20.065582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239484,"kb_used_data":6920,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735236,"statfs":{"total":773094113280,"available":772848881664,"internally_reserved":0,"allocated":7086080,"data_stored":3785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.391381"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.683796+0000","last_change":"2024-09-13T15:10:15.683796+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.683796+0000","last_undegraded":"2024-09-13T15:10:15.683796+0000","last_fullsized":"2024-09-13T15:10:15.683796+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691391+0000","last_change":"2024-09-13T15:10:15.691391+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691391+0000","last_undegraded":"2024-09-13T15:10:15.691391+0000","last_fullsized":"2024-09-13T15:10:15.691391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:46.057647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.692575+0000","last_change":"2024-09-13T15:10:15.692575+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.692575+0000","last_undegraded":"2024-09-13T15:10:15.692575+0000","last_fullsized":"2024-09-13T15:10:15.692575+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:00.677998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691465+0000","last_change":"2024-09-13T15:10:15.691465+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691465+0000","last_undegraded":"2024-09-13T15:10:15.691465+0000","last_fullsized":"2024-09-13T15:10:15.691465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.686835+0000","last_change":"2024-09-13T15:10:15.686835+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.686835+0000","last_undegraded":"2024-09-13T15:10:15.686835+0000","last_fullsized":"2024-09-13T15:10:15.686835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.687284+0000","last_change":"2024-09-13T15:10:15.687284+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.687284+0000","last_undegraded":"2024-09-13T15:10:15.687284+0000","last_fullsized":"2024-09-13T15:10:15.687284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:53.117052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.686129+0000","last_change":"2024-09-13T15:10:15.686129+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.686129+0000","last_undegraded":"2024-09-13T15:10:15.686129+0000","last_fullsized":"2024-09-13T15:10:15.686129+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.684995+0000","last_change":"2024-09-13T15:10:15.684995+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.684995+0000","last_undegraded":"2024-09-13T15:10:15.684995+0000","last_fullsized":"2024-09-13T15:10:15.684995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:37.686588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.680469+0000","last_change":"2024-09-13T15:10:15.680469+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.680469+0000","last_undegraded":"2024-09-13T15:10:15.680469+0000","last_fullsized":"2024-09-13T15:10:15.680469+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.684958+0000","last_change":"2024-09-13T15:10:15.684958+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.684958+0000","last_undegraded":"2024-09-13T15:10:15.684958+0000","last_fullsized":"2024-09-13T15:10:15.684958+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679117+0000","last_change":"2024-09-13T15:10:15.679117+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679117+0000","last_undegraded":"2024-09-13T15:10:15.679117+0000","last_fullsized":"2024-09-13T15:10:15.679117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685177+0000","last_change":"2024-09-13T15:10:15.685177+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685177+0000","last_undegraded":"2024-09-13T15:10:15.685177+0000","last_fullsized":"2024-09-13T15:10:15.685177+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679525+0000","last_change":"2024-09-13T15:10:15.679525+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679525+0000","last_undegraded":"2024-09-13T15:10:15.679525+0000","last_fullsized":"2024-09-13T15:10:15.679525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:10.062343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.680012+0000","last_change":"2024-09-13T15:10:15.680012+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.680012+0000","last_undegraded":"2024-09-13T15:10:15.680012+0000","last_fullsized":"2024-09-13T15:10:15.680012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678105+0000","last_change":"2024-09-13T15:10:15.678105+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678105+0000","last_undegraded":"2024-09-13T15:10:15.678105+0000","last_fullsized":"2024-09-13T15:10:15.678105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.684882+0000","last_change":"2024-09-13T15:10:15.684882+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.684882+0000","last_undegraded":"2024-09-13T15:10:15.684882+0000","last_fullsized":"2024-09-13T15:10:15.684882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:56.163813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679845+0000","last_change":"2024-09-13T15:10:15.679845+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679845+0000","last_undegraded":"2024-09-13T15:10:15.679845+0000","last_fullsized":"2024-09-13T15:10:15.679845+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678105+0000","last_change":"2024-09-13T15:10:15.678105+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678105+0000","last_undegraded":"2024-09-13T15:10:15.678105+0000","last_fullsized":"2024-09-13T15:10:15.678105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:18.080317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678529+0000","last_change":"2024-09-13T15:10:15.678529+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678529+0000","last_undegraded":"2024-09-13T15:10:15.678529+0000","last_fullsized":"2024-09-13T15:10:15.678529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.687540+0000","last_change":"2024-09-13T15:10:15.687540+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.687540+0000","last_undegraded":"2024-09-13T15:10:15.687540+0000","last_fullsized":"2024-09-13T15:10:15.687540+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:39.966872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691354+0000","last_change":"2024-09-13T15:10:15.691354+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691354+0000","last_undegraded":"2024-09-13T15:10:15.691354+0000","last_fullsized":"2024-09-13T15:10:15.691354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:55.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678264+0000","last_change":"2024-09-13T15:10:15.678264+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678264+0000","last_undegraded":"2024-09-13T15:10:15.678264+0000","last_fullsized":"2024-09-13T15:10:15.678264+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.691251+0000","last_change":"2024-09-13T15:10:15.691251+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.691251+0000","last_undegraded":"2024-09-13T15:10:15.691251+0000","last_fullsized":"2024-09-13T15:10:15.691251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:15.314017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678295+0000","last_change":"2024-09-13T15:10:15.678295+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678295+0000","last_undegraded":"2024-09-13T15:10:15.678295+0000","last_fullsized":"2024-09-13T15:10:15.678295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.679150+0000","last_change":"2024-09-13T15:10:15.679150+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.679150+0000","last_undegraded":"2024-09-13T15:10:15.679150+0000","last_fullsized":"2024-09-13T15:10:15.679150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.692092+0000","last_change":"2024-09-13T15:10:15.692092+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.692092+0000","last_undegraded":"2024-09-13T15:10:15.692092+0000","last_fullsized":"2024-09-13T15:10:15.692092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.683683+0000","last_change":"2024-09-13T15:10:15.683683+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.683683+0000","last_undegraded":"2024-09-13T15:10:15.683683+0000","last_fullsized":"2024-09-13T15:10:15.683683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.678136+0000","last_change":"2024-09-13T15:10:15.678136+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.678136+0000","last_undegraded":"2024-09-13T15:10:15.678136+0000","last_fullsized":"2024-09-13T15:10:15.678136+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:05.562203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685762+0000","last_change":"2024-09-13T15:10:15.685762+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685762+0000","last_undegraded":"2024-09-13T15:10:15.685762+0000","last_fullsized":"2024-09-13T15:10:15.685762+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:06.258415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685426+0000","last_change":"2024-09-13T15:10:15.685426+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685426+0000","last_undegraded":"2024-09-13T15:10:15.685426+0000","last_fullsized":"2024-09-13T15:10:15.685426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.520994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.683669+0000","last_change":"2024-09-13T15:10:15.683669+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.683669+0000","last_undegraded":"2024-09-13T15:10:15.683669+0000","last_fullsized":"2024-09-13T15:10:15.683669+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:16.675788+0000","last_change":"2024-09-13T15:10:16.675788+0000","last_active":"2024-09-13T15:10:16.675788+0000","last_peered":"2024-09-13T15:10:16.675788+0000","last_clean":"2024-09-13T15:10:16.675788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:16.675788+0000","last_undegraded":"2024-09-13T15:10:16.675788+0000","last_fullsized":"2024-09-13T15:10:16.675788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-13T15:10:15.685320+0000","last_change":"2024-09-13T15:10:15.685320+0000","last_active":"2024-09-13T15:10:15.661199+0000","last_peered":"2024-09-13T15:10:15.661199+0000","last_clean":"2024-09-13T15:10:15.661199+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:15.685320+0000","last_undegraded":"2024-09-13T15:10:15.685320+0000","last_fullsized":"2024-09-13T15:10:15.685320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:25.413033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T15:10:14.218079+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:14.218079+0000","last_peered":"2024-09-13T15:10:14.218079+0000","last_clean":"2024-09-13T15:10:14.218079+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:14.218079+0000","last_undegraded":"2024-09-13T15:10:14.218079+0000","last_fullsized":"2024-09-13T15:10:14.218079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":915366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.2150000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.036},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.339}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.256},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.129}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.276},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.381}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.399}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.528},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.163}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":318532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.93500000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.069},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":1.103}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.2},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":1.149}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.874},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.224},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":1.038},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.2969999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":331135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.367}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2170000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.115},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.284}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.603},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.3240000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.6519999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":331135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1120000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":1.5609999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.589}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.0529999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":2.0219999999999998},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9099999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":1.6599999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.677}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":720896,"data_stored":318532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.21}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.125},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.155}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.306},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.431}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.349}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.395},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.4870000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.454},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.52}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31852,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":749568,"data_stored":331135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":1.1140000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.2190000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.357}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.304}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.248}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3280000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":737280,"data_stored":324998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.4610000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.669}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.5780000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.762}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.0800000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":0.92100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.113},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.222}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1327104,"data_stored":914347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.073},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.873},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":1.49}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.6559999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.012},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.246}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.399}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.454}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:22.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:22.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 Processor -- start 2024-09-13T15:10:22.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 -- start start 2024-09-13T15:10:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f22880cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f228806aaa0 0x7f228806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880b2ad0 con 0x7f228815c2a0 2024-09-13T15:10:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228806b450 con 0x7f228806aaa0 2024-09-13T15:10:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228815b960 con 0x7f22880cb020 2024-09-13T15:10:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.230+0000 7f228e400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f228806aaa0 0x7f228806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f228806aaa0 0x7f228806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40680/0 (socket says 172.21.15.50:40680) 2024-09-13T15:10:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 -- 172.21.15.50:0/3501518935 learned_addr learned my addr 172.21.15.50:0/3501518935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228da00700 1 --2- 172.21.15.50:0/3501518935 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f22880cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 -- 172.21.15.50:0/3501518935 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 msgr2=0x7f22880cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 --2- 172.21.15.50:0/3501518935 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f22880cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 -- 172.21.15.50:0/3501518935 >> v1:172.21.15.181:6789/0 conn(0x7f228815c2a0 legacy=0x7f228815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 -- 172.21.15.50:0/3501518935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228815bc40 con 0x7f228806aaa0 2024-09-13T15:10:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228e400700 1 --2- 172.21.15.50:0/3501518935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228806aaa0 0x7f228806af10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2280009e50 tx=0x7f228000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9681c5bce9b5458f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f2287e00700 1 -- 172.21.15.50:0/3501518935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000e070 con 0x7f228806aaa0 2024-09-13T15:10:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f2287e00700 1 -- 172.21.15.50:0/3501518935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000b9c0 con 0x7f228806aaa0 2024-09-13T15:10:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f2287e00700 1 -- 172.21.15.50:0/3501518935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000bd70 con 0x7f228806aaa0 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 -- 172.21.15.50:0/3501518935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228806aaa0 msgr2=0x7f228806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 --2- 172.21.15.50:0/3501518935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228806aaa0 0x7f228806af10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2280009e50 tx=0x7f228000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 -- 172.21.15.50:0/3501518935 shutdown_connections 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 --2- 172.21.15.50:0/3501518935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228806aaa0 0x7f228806af10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 --2- 172.21.15.50:0/3501518935 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f22880cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 -- 172.21.15.50:0/3501518935 >> 172.21.15.50:0/3501518935 conn(0x7f22880b0c40 msgr2=0x7f228806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 -- 172.21.15.50:0/3501518935 shutdown_connections 2024-09-13T15:10:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.234+0000 7f228ee00700 1 -- 172.21.15.50:0/3501518935 wait complete. 2024-09-13T15:10:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 Processor -- start 2024-09-13T15:10:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 -- start start 2024-09-13T15:10:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f228806aaa0 0x7f2288155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f2288132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 0x7f22881408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288155ca0 con 0x7f228815c2a0 2024-09-13T15:10:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228813fb90 con 0x7f228806aaa0 2024-09-13T15:10:22.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2288141c90 con 0x7f22880cb020 2024-09-13T15:10:22.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 0x7f22881408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.238+0000 7f228e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 0x7f22881408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40688/0 (socket says 172.21.15.50:40688) 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 -- 172.21.15.50:0/4215509231 learned_addr learned my addr 172.21.15.50:0/4215509231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228da00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f228806aaa0 0x7f2288155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228d000700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f2288132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 -- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 msgr2=0x7f2288132e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f2288132e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 -- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f228806aaa0 msgr2=0x7f2288155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f228806aaa0 0x7f2288155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 -- 172.21.15.50:0/4215509231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280009b30 con 0x7f228815c2a0 2024-09-13T15:10:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228e400700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 0x7f22881408c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f22880b1690 tx=0x7f2280004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280004800 con 0x7f228815c2a0 2024-09-13T15:10:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22800099b0 con 0x7f228815c2a0 2024-09-13T15:10:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228813fde0 con 0x7f228815c2a0 2024-09-13T15:10:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001c680 con 0x7f228815c2a0 2024-09-13T15:10:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22881403a0 con 0x7f228815c2a0 2024-09-13T15:10:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.242+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2288140590 con 0x7f228815c2a0 2024-09-13T15:10:22.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.246+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f228001c7e0 con 0x7f228815c2a0 2024-09-13T15:10:22.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.246+0000 7f2285600700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2268066760 0x7f2268068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.246+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2280085e30 con 0x7f228815c2a0 2024-09-13T15:10:22.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.250+0000 7f228da00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2268066760 0x7f2268068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.250+0000 7f228da00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2268066760 0x7f2268068c20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f227c009a00 tx=0x7f227c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:22.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.250+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2280053050 con 0x7f228815c2a0 2024-09-13T15:10:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.442+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22880cc050 con 0x7f2268066760 2024-09-13T15:10:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.458+0000 7f2285600700 1 -- 172.21.15.50:0/4215509231 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286546 (secure 0 0 0) 0x7f22880cc050 con 0x7f2268066760 2024-09-13T15:10:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2268066760 msgr2=0x7f2268068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2268066760 0x7f2268068c20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f227c009a00 tx=0x7f227c008040 comp rx=0 tx=0).stop 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 msgr2=0x7f22881408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 0x7f22881408c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f22880b1690 tx=0x7f2280004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 shutdown_connections 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2268066760 0x7f2268068c20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228815c2a0 0x7f22881408c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f22880cb020 0x7f2288132e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 --2- 172.21.15.50:0/4215509231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f228806aaa0 0x7f2288155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 >> 172.21.15.50:0/4215509231 conn(0x7f22880b0c40 msgr2=0x7f228815b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 shutdown_connections 2024-09-13T15:10:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.466+0000 7f228ee00700 1 -- 172.21.15.50:0/4215509231 wait complete. 2024-09-13T15:10:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:22.495 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-13T15:10:22.067582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239952,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734768,"statfs":{"total":773094113280,"available":772848402432,"internally_reserved":0,"allocated":7532544,"data_stored":3993899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.003204"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180961+0000","last_change":"2024-09-13T15:10:17.191018+0000","last_active":"2024-09-13T15:10:18.180961+0000","last_peered":"2024-09-13T15:10:18.180961+0000","last_clean":"2024-09-13T15:10:18.180961+0000","last_became_active":"2024-09-13T15:10:17.190112+0000","last_became_peered":"2024-09-13T15:10:17.190112+0000","last_unstale":"2024-09-13T15:10:18.180961+0000","last_undegraded":"2024-09-13T15:10:18.180961+0000","last_fullsized":"2024-09-13T15:10:18.180961+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180798+0000","last_change":"2024-09-13T15:10:17.193381+0000","last_active":"2024-09-13T15:10:18.180798+0000","last_peered":"2024-09-13T15:10:18.180798+0000","last_clean":"2024-09-13T15:10:18.180798+0000","last_became_active":"2024-09-13T15:10:17.193146+0000","last_became_peered":"2024-09-13T15:10:17.193146+0000","last_unstale":"2024-09-13T15:10:18.180798+0000","last_undegraded":"2024-09-13T15:10:18.180798+0000","last_fullsized":"2024-09-13T15:10:18.180798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:25.507760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536338+0000","last_change":"2024-09-13T15:10:17.194055+0000","last_active":"2024-09-13T15:10:18.536338+0000","last_peered":"2024-09-13T15:10:18.536338+0000","last_clean":"2024-09-13T15:10:18.536338+0000","last_became_active":"2024-09-13T15:10:17.193816+0000","last_became_peered":"2024-09-13T15:10:17.193816+0000","last_unstale":"2024-09-13T15:10:18.536338+0000","last_undegraded":"2024-09-13T15:10:18.536338+0000","last_fullsized":"2024-09-13T15:10:18.536338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177721+0000","last_change":"2024-09-13T15:10:17.203227+0000","last_active":"2024-09-13T15:10:18.177721+0000","last_peered":"2024-09-13T15:10:18.177721+0000","last_clean":"2024-09-13T15:10:18.177721+0000","last_became_active":"2024-09-13T15:10:17.190454+0000","last_became_peered":"2024-09-13T15:10:17.190454+0000","last_unstale":"2024-09-13T15:10:18.177721+0000","last_undegraded":"2024-09-13T15:10:18.177721+0000","last_fullsized":"2024-09-13T15:10:18.177721+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:13.993446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535314+0000","last_change":"2024-09-13T15:10:17.200628+0000","last_active":"2024-09-13T15:10:18.535314+0000","last_peered":"2024-09-13T15:10:18.535314+0000","last_clean":"2024-09-13T15:10:18.535314+0000","last_became_active":"2024-09-13T15:10:17.200246+0000","last_became_peered":"2024-09-13T15:10:17.200246+0000","last_unstale":"2024-09-13T15:10:18.535314+0000","last_undegraded":"2024-09-13T15:10:18.535314+0000","last_fullsized":"2024-09-13T15:10:18.535314+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:02.121949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178437+0000","last_change":"2024-09-13T15:10:17.199455+0000","last_active":"2024-09-13T15:10:18.178437+0000","last_peered":"2024-09-13T15:10:18.178437+0000","last_clean":"2024-09-13T15:10:18.178437+0000","last_became_active":"2024-09-13T15:10:17.198918+0000","last_became_peered":"2024-09-13T15:10:17.198918+0000","last_unstale":"2024-09-13T15:10:18.178437+0000","last_undegraded":"2024-09-13T15:10:18.178437+0000","last_fullsized":"2024-09-13T15:10:18.178437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:23.725734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538325+0000","last_change":"2024-09-13T15:10:17.197839+0000","last_active":"2024-09-13T15:10:18.538325+0000","last_peered":"2024-09-13T15:10:18.538325+0000","last_clean":"2024-09-13T15:10:18.538325+0000","last_became_active":"2024-09-13T15:10:17.197605+0000","last_became_peered":"2024-09-13T15:10:17.197605+0000","last_unstale":"2024-09-13T15:10:18.538325+0000","last_undegraded":"2024-09-13T15:10:18.538325+0000","last_fullsized":"2024-09-13T15:10:18.538325+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:44.589350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536861+0000","last_change":"2024-09-13T15:10:17.195877+0000","last_active":"2024-09-13T15:10:18.536861+0000","last_peered":"2024-09-13T15:10:18.536861+0000","last_clean":"2024-09-13T15:10:18.536861+0000","last_became_active":"2024-09-13T15:10:17.195416+0000","last_became_peered":"2024-09-13T15:10:17.195416+0000","last_unstale":"2024-09-13T15:10:18.536861+0000","last_undegraded":"2024-09-13T15:10:18.536861+0000","last_fullsized":"2024-09-13T15:10:18.536861+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537069+0000","last_change":"2024-09-13T15:10:17.188990+0000","last_active":"2024-09-13T15:10:18.537069+0000","last_peered":"2024-09-13T15:10:18.537069+0000","last_clean":"2024-09-13T15:10:18.537069+0000","last_became_active":"2024-09-13T15:10:17.188726+0000","last_became_peered":"2024-09-13T15:10:17.188726+0000","last_unstale":"2024-09-13T15:10:18.537069+0000","last_undegraded":"2024-09-13T15:10:18.537069+0000","last_fullsized":"2024-09-13T15:10:18.537069+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:35.298381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536589+0000","last_change":"2024-09-13T15:10:17.187840+0000","last_active":"2024-09-13T15:10:18.536589+0000","last_peered":"2024-09-13T15:10:18.536589+0000","last_clean":"2024-09-13T15:10:18.536589+0000","last_became_active":"2024-09-13T15:10:17.187522+0000","last_became_peered":"2024-09-13T15:10:17.187522+0000","last_unstale":"2024-09-13T15:10:18.536589+0000","last_undegraded":"2024-09-13T15:10:18.536589+0000","last_fullsized":"2024-09-13T15:10:18.536589+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:09.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177855+0000","last_change":"2024-09-13T15:10:17.188709+0000","last_active":"2024-09-13T15:10:18.177855+0000","last_peered":"2024-09-13T15:10:18.177855+0000","last_clean":"2024-09-13T15:10:18.177855+0000","last_became_active":"2024-09-13T15:10:17.188198+0000","last_became_peered":"2024-09-13T15:10:17.188198+0000","last_unstale":"2024-09-13T15:10:18.177855+0000","last_undegraded":"2024-09-13T15:10:18.177855+0000","last_fullsized":"2024-09-13T15:10:18.177855+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535876+0000","last_change":"2024-09-13T15:10:17.199667+0000","last_active":"2024-09-13T15:10:18.535876+0000","last_peered":"2024-09-13T15:10:18.535876+0000","last_clean":"2024-09-13T15:10:18.535876+0000","last_became_active":"2024-09-13T15:10:17.199404+0000","last_became_peered":"2024-09-13T15:10:17.199404+0000","last_unstale":"2024-09-13T15:10:18.535876+0000","last_undegraded":"2024-09-13T15:10:18.535876+0000","last_fullsized":"2024-09-13T15:10:18.535876+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:09.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537060+0000","last_change":"2024-09-13T15:10:17.187672+0000","last_active":"2024-09-13T15:10:18.537060+0000","last_peered":"2024-09-13T15:10:18.537060+0000","last_clean":"2024-09-13T15:10:18.537060+0000","last_became_active":"2024-09-13T15:10:17.187361+0000","last_became_peered":"2024-09-13T15:10:17.187361+0000","last_unstale":"2024-09-13T15:10:18.537060+0000","last_undegraded":"2024-09-13T15:10:18.537060+0000","last_fullsized":"2024-09-13T15:10:18.537060+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536420+0000","last_change":"2024-09-13T15:10:17.193361+0000","last_active":"2024-09-13T15:10:18.536420+0000","last_peered":"2024-09-13T15:10:18.536420+0000","last_clean":"2024-09-13T15:10:18.536420+0000","last_became_active":"2024-09-13T15:10:17.193093+0000","last_became_peered":"2024-09-13T15:10:17.193093+0000","last_unstale":"2024-09-13T15:10:18.536420+0000","last_undegraded":"2024-09-13T15:10:18.536420+0000","last_fullsized":"2024-09-13T15:10:18.536420+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537652+0000","last_change":"2024-09-13T15:10:17.192179+0000","last_active":"2024-09-13T15:10:18.537652+0000","last_peered":"2024-09-13T15:10:18.537652+0000","last_clean":"2024-09-13T15:10:18.537652+0000","last_became_active":"2024-09-13T15:10:17.191941+0000","last_became_peered":"2024-09-13T15:10:17.191941+0000","last_unstale":"2024-09-13T15:10:18.537652+0000","last_undegraded":"2024-09-13T15:10:18.537652+0000","last_fullsized":"2024-09-13T15:10:18.537652+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:26.770391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537926+0000","last_change":"2024-09-13T15:10:17.192915+0000","last_active":"2024-09-13T15:10:18.537926+0000","last_peered":"2024-09-13T15:10:18.537926+0000","last_clean":"2024-09-13T15:10:18.537926+0000","last_became_active":"2024-09-13T15:10:17.190889+0000","last_became_peered":"2024-09-13T15:10:17.190889+0000","last_unstale":"2024-09-13T15:10:18.537926+0000","last_undegraded":"2024-09-13T15:10:18.537926+0000","last_fullsized":"2024-09-13T15:10:18.537926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:13.258712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180991+0000","last_change":"2024-09-13T15:10:17.191793+0000","last_active":"2024-09-13T15:10:18.180991+0000","last_peered":"2024-09-13T15:10:18.180991+0000","last_clean":"2024-09-13T15:10:18.180991+0000","last_became_active":"2024-09-13T15:10:17.191530+0000","last_became_peered":"2024-09-13T15:10:17.191530+0000","last_unstale":"2024-09-13T15:10:18.180991+0000","last_undegraded":"2024-09-13T15:10:18.180991+0000","last_fullsized":"2024-09-13T15:10:18.180991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178031+0000","last_change":"2024-09-13T15:10:17.186406+0000","last_active":"2024-09-13T15:10:18.178031+0000","last_peered":"2024-09-13T15:10:18.178031+0000","last_clean":"2024-09-13T15:10:18.178031+0000","last_became_active":"2024-09-13T15:10:17.186142+0000","last_became_peered":"2024-09-13T15:10:17.186142+0000","last_unstale":"2024-09-13T15:10:18.178031+0000","last_undegraded":"2024-09-13T15:10:18.178031+0000","last_fullsized":"2024-09-13T15:10:18.178031+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:32.544997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536997+0000","last_change":"2024-09-13T15:10:17.197611+0000","last_active":"2024-09-13T15:10:18.536997+0000","last_peered":"2024-09-13T15:10:18.536997+0000","last_clean":"2024-09-13T15:10:18.536997+0000","last_became_active":"2024-09-13T15:10:17.193825+0000","last_became_peered":"2024-09-13T15:10:17.193825+0000","last_unstale":"2024-09-13T15:10:18.536997+0000","last_undegraded":"2024-09-13T15:10:18.536997+0000","last_fullsized":"2024-09-13T15:10:18.536997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:05.539046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537839+0000","last_change":"2024-09-13T15:10:17.202035+0000","last_active":"2024-09-13T15:10:18.537839+0000","last_peered":"2024-09-13T15:10:18.537839+0000","last_clean":"2024-09-13T15:10:18.537839+0000","last_became_active":"2024-09-13T15:10:17.201739+0000","last_became_peered":"2024-09-13T15:10:17.201739+0000","last_unstale":"2024-09-13T15:10:18.537839+0000","last_undegraded":"2024-09-13T15:10:18.537839+0000","last_fullsized":"2024-09-13T15:10:18.537839+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537169+0000","last_change":"2024-09-13T15:10:17.197262+0000","last_active":"2024-09-13T15:10:18.537169+0000","last_peered":"2024-09-13T15:10:18.537169+0000","last_clean":"2024-09-13T15:10:18.537169+0000","last_became_active":"2024-09-13T15:10:17.192009+0000","last_became_peered":"2024-09-13T15:10:17.192009+0000","last_unstale":"2024-09-13T15:10:18.537169+0000","last_undegraded":"2024-09-13T15:10:18.537169+0000","last_fullsized":"2024-09-13T15:10:18.537169+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:31.641260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537403+0000","last_change":"2024-09-13T15:10:17.182131+0000","last_active":"2024-09-13T15:10:18.537403+0000","last_peered":"2024-09-13T15:10:18.537403+0000","last_clean":"2024-09-13T15:10:18.537403+0000","last_became_active":"2024-09-13T15:10:17.181882+0000","last_became_peered":"2024-09-13T15:10:17.181882+0000","last_unstale":"2024-09-13T15:10:18.537403+0000","last_undegraded":"2024-09-13T15:10:18.537403+0000","last_fullsized":"2024-09-13T15:10:18.537403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:13.460857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537258+0000","last_change":"2024-09-13T15:10:17.183417+0000","last_active":"2024-09-13T15:10:18.537258+0000","last_peered":"2024-09-13T15:10:18.537258+0000","last_clean":"2024-09-13T15:10:18.537258+0000","last_became_active":"2024-09-13T15:10:17.183143+0000","last_became_peered":"2024-09-13T15:10:17.183143+0000","last_unstale":"2024-09-13T15:10:18.537258+0000","last_undegraded":"2024-09-13T15:10:18.537258+0000","last_fullsized":"2024-09-13T15:10:18.537258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:58.938786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535630+0000","last_change":"2024-09-13T15:10:17.193630+0000","last_active":"2024-09-13T15:10:18.535630+0000","last_peered":"2024-09-13T15:10:18.535630+0000","last_clean":"2024-09-13T15:10:18.535630+0000","last_became_active":"2024-09-13T15:10:17.193262+0000","last_became_peered":"2024-09-13T15:10:17.193262+0000","last_unstale":"2024-09-13T15:10:18.535630+0000","last_undegraded":"2024-09-13T15:10:18.535630+0000","last_fullsized":"2024-09-13T15:10:18.535630+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536086+0000","last_change":"2024-09-13T15:10:17.190224+0000","last_active":"2024-09-13T15:10:18.536086+0000","last_peered":"2024-09-13T15:10:18.536086+0000","last_clean":"2024-09-13T15:10:18.536086+0000","last_became_active":"2024-09-13T15:10:17.189965+0000","last_became_peered":"2024-09-13T15:10:17.189965+0000","last_unstale":"2024-09-13T15:10:18.536086+0000","last_undegraded":"2024-09-13T15:10:18.536086+0000","last_fullsized":"2024-09-13T15:10:18.536086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536096+0000","last_change":"2024-09-13T15:10:17.193166+0000","last_active":"2024-09-13T15:10:18.536096+0000","last_peered":"2024-09-13T15:10:18.536096+0000","last_clean":"2024-09-13T15:10:18.536096+0000","last_became_active":"2024-09-13T15:10:17.192894+0000","last_became_peered":"2024-09-13T15:10:17.192894+0000","last_unstale":"2024-09-13T15:10:18.536096+0000","last_undegraded":"2024-09-13T15:10:18.536096+0000","last_fullsized":"2024-09-13T15:10:18.536096+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177912+0000","last_change":"2024-09-13T15:10:17.188450+0000","last_active":"2024-09-13T15:10:18.177912+0000","last_peered":"2024-09-13T15:10:18.177912+0000","last_clean":"2024-09-13T15:10:18.177912+0000","last_became_active":"2024-09-13T15:10:17.187741+0000","last_became_peered":"2024-09-13T15:10:17.187741+0000","last_unstale":"2024-09-13T15:10:18.177912+0000","last_undegraded":"2024-09-13T15:10:18.177912+0000","last_fullsized":"2024-09-13T15:10:18.177912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180508+0000","last_change":"2024-09-13T15:10:17.206071+0000","last_active":"2024-09-13T15:10:18.180508+0000","last_peered":"2024-09-13T15:10:18.180508+0000","last_clean":"2024-09-13T15:10:18.180508+0000","last_became_active":"2024-09-13T15:10:17.205546+0000","last_became_peered":"2024-09-13T15:10:17.205546+0000","last_unstale":"2024-09-13T15:10:18.180508+0000","last_undegraded":"2024-09-13T15:10:18.180508+0000","last_fullsized":"2024-09-13T15:10:18.180508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536491+0000","last_change":"2024-09-13T15:10:17.188795+0000","last_active":"2024-09-13T15:10:18.536491+0000","last_peered":"2024-09-13T15:10:18.536491+0000","last_clean":"2024-09-13T15:10:18.536491+0000","last_became_active":"2024-09-13T15:10:17.188513+0000","last_became_peered":"2024-09-13T15:10:17.188513+0000","last_unstale":"2024-09-13T15:10:18.536491+0000","last_undegraded":"2024-09-13T15:10:18.536491+0000","last_fullsized":"2024-09-13T15:10:18.536491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536876+0000","last_change":"2024-09-13T15:10:17.199032+0000","last_active":"2024-09-13T15:10:18.536876+0000","last_peered":"2024-09-13T15:10:18.536876+0000","last_clean":"2024-09-13T15:10:18.536876+0000","last_became_active":"2024-09-13T15:10:17.198807+0000","last_became_peered":"2024-09-13T15:10:17.198807+0000","last_unstale":"2024-09-13T15:10:18.536876+0000","last_undegraded":"2024-09-13T15:10:18.536876+0000","last_fullsized":"2024-09-13T15:10:18.536876+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:35.298381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177272+0000","last_change":"2024-09-13T15:10:17.198443+0000","last_active":"2024-09-13T15:10:18.177272+0000","last_peered":"2024-09-13T15:10:18.177272+0000","last_clean":"2024-09-13T15:10:18.177272+0000","last_became_active":"2024-09-13T15:10:17.198170+0000","last_became_peered":"2024-09-13T15:10:17.198170+0000","last_unstale":"2024-09-13T15:10:18.177272+0000","last_undegraded":"2024-09-13T15:10:18.177272+0000","last_fullsized":"2024-09-13T15:10:18.177272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:36.024595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178026+0000","last_change":"2024-09-13T15:10:17.195629+0000","last_active":"2024-09-13T15:10:18.178026+0000","last_peered":"2024-09-13T15:10:18.178026+0000","last_clean":"2024-09-13T15:10:18.178026+0000","last_became_active":"2024-09-13T15:10:17.195294+0000","last_became_peered":"2024-09-13T15:10:17.195294+0000","last_unstale":"2024-09-13T15:10:18.178026+0000","last_undegraded":"2024-09-13T15:10:18.178026+0000","last_fullsized":"2024-09-13T15:10:18.178026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:03.489256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535368+0000","last_change":"2024-09-13T15:10:17.201819+0000","last_active":"2024-09-13T15:10:18.535368+0000","last_peered":"2024-09-13T15:10:18.535368+0000","last_clean":"2024-09-13T15:10:18.535368+0000","last_became_active":"2024-09-13T15:10:17.199216+0000","last_became_peered":"2024-09-13T15:10:17.199216+0000","last_unstale":"2024-09-13T15:10:18.535368+0000","last_undegraded":"2024-09-13T15:10:18.535368+0000","last_fullsized":"2024-09-13T15:10:18.535368+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:25.158826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.201896+0000","last_change":"2024-09-13T15:10:16.721705+0000","last_active":"2024-09-13T15:10:17.201896+0000","last_peered":"2024-09-13T15:10:17.201896+0000","last_clean":"2024-09-13T15:10:17.201896+0000","last_became_active":"2024-09-13T15:10:16.721281+0000","last_became_peered":"2024-09-13T15:10:16.721281+0000","last_unstale":"2024-09-13T15:10:17.201896+0000","last_undegraded":"2024-09-13T15:10:17.201896+0000","last_fullsized":"2024-09-13T15:10:17.201896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177989+0000","last_change":"2024-09-13T15:10:17.203733+0000","last_active":"2024-09-13T15:10:18.177989+0000","last_peered":"2024-09-13T15:10:18.177989+0000","last_clean":"2024-09-13T15:10:18.177989+0000","last_became_active":"2024-09-13T15:10:17.203429+0000","last_became_peered":"2024-09-13T15:10:17.203429+0000","last_unstale":"2024-09-13T15:10:18.177989+0000","last_undegraded":"2024-09-13T15:10:18.177989+0000","last_fullsized":"2024-09-13T15:10:18.177989+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:25.507760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.205092+0000","last_change":"2024-09-13T15:10:16.717228+0000","last_active":"2024-09-13T15:10:17.205092+0000","last_peered":"2024-09-13T15:10:17.205092+0000","last_clean":"2024-09-13T15:10:17.205092+0000","last_became_active":"2024-09-13T15:10:16.715990+0000","last_became_peered":"2024-09-13T15:10:16.715990+0000","last_unstale":"2024-09-13T15:10:17.205092+0000","last_undegraded":"2024-09-13T15:10:17.205092+0000","last_fullsized":"2024-09-13T15:10:17.205092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:46.057647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178674+0000","last_change":"2024-09-13T15:10:17.187045+0000","last_active":"2024-09-13T15:10:18.178674+0000","last_peered":"2024-09-13T15:10:18.178674+0000","last_clean":"2024-09-13T15:10:18.178674+0000","last_became_active":"2024-09-13T15:10:17.186573+0000","last_became_peered":"2024-09-13T15:10:17.186573+0000","last_unstale":"2024-09-13T15:10:18.178674+0000","last_undegraded":"2024-09-13T15:10:18.178674+0000","last_fullsized":"2024-09-13T15:10:18.178674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.200786+0000","last_change":"2024-09-13T15:10:16.719972+0000","last_active":"2024-09-13T15:10:17.200786+0000","last_peered":"2024-09-13T15:10:17.200786+0000","last_clean":"2024-09-13T15:10:17.200786+0000","last_became_active":"2024-09-13T15:10:16.719471+0000","last_became_peered":"2024-09-13T15:10:16.719471+0000","last_unstale":"2024-09-13T15:10:17.200786+0000","last_undegraded":"2024-09-13T15:10:17.200786+0000","last_fullsized":"2024-09-13T15:10:17.200786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:00.677998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536910+0000","last_change":"2024-09-13T15:10:17.191538+0000","last_active":"2024-09-13T15:10:18.536910+0000","last_peered":"2024-09-13T15:10:18.536910+0000","last_clean":"2024-09-13T15:10:18.536910+0000","last_became_active":"2024-09-13T15:10:17.191303+0000","last_became_peered":"2024-09-13T15:10:17.191303+0000","last_unstale":"2024-09-13T15:10:18.536910+0000","last_undegraded":"2024-09-13T15:10:18.536910+0000","last_fullsized":"2024-09-13T15:10:18.536910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:31.641260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.199926+0000","last_change":"2024-09-13T15:10:16.718704+0000","last_active":"2024-09-13T15:10:17.199926+0000","last_peered":"2024-09-13T15:10:17.199926+0000","last_clean":"2024-09-13T15:10:17.199926+0000","last_became_active":"2024-09-13T15:10:16.718439+0000","last_became_peered":"2024-09-13T15:10:16.718439+0000","last_unstale":"2024-09-13T15:10:17.199926+0000","last_undegraded":"2024-09-13T15:10:17.199926+0000","last_fullsized":"2024-09-13T15:10:17.199926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537925+0000","last_change":"2024-09-13T15:10:17.193314+0000","last_active":"2024-09-13T15:10:18.537925+0000","last_peered":"2024-09-13T15:10:18.537925+0000","last_clean":"2024-09-13T15:10:18.537925+0000","last_became_active":"2024-09-13T15:10:17.192270+0000","last_became_peered":"2024-09-13T15:10:17.192270+0000","last_unstale":"2024-09-13T15:10:18.537925+0000","last_undegraded":"2024-09-13T15:10:18.537925+0000","last_fullsized":"2024-09-13T15:10:18.537925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:54.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.192364+0000","last_change":"2024-09-13T15:10:16.712118+0000","last_active":"2024-09-13T15:10:17.192364+0000","last_peered":"2024-09-13T15:10:17.192364+0000","last_clean":"2024-09-13T15:10:17.192364+0000","last_became_active":"2024-09-13T15:10:16.711865+0000","last_became_peered":"2024-09-13T15:10:16.711865+0000","last_unstale":"2024-09-13T15:10:17.192364+0000","last_undegraded":"2024-09-13T15:10:17.192364+0000","last_fullsized":"2024-09-13T15:10:17.192364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180307+0000","last_change":"2024-09-13T15:10:17.189438+0000","last_active":"2024-09-13T15:10:18.180307+0000","last_peered":"2024-09-13T15:10:18.180307+0000","last_clean":"2024-09-13T15:10:18.180307+0000","last_became_active":"2024-09-13T15:10:17.189194+0000","last_became_peered":"2024-09-13T15:10:17.189194+0000","last_unstale":"2024-09-13T15:10:18.180307+0000","last_undegraded":"2024-09-13T15:10:18.180307+0000","last_fullsized":"2024-09-13T15:10:18.180307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.192805+0000","last_change":"2024-09-13T15:10:16.705759+0000","last_active":"2024-09-13T15:10:17.192805+0000","last_peered":"2024-09-13T15:10:17.192805+0000","last_clean":"2024-09-13T15:10:17.192805+0000","last_became_active":"2024-09-13T15:10:16.705510+0000","last_became_peered":"2024-09-13T15:10:16.705510+0000","last_unstale":"2024-09-13T15:10:17.192805+0000","last_undegraded":"2024-09-13T15:10:17.192805+0000","last_fullsized":"2024-09-13T15:10:17.192805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:53.117052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.534970+0000","last_change":"2024-09-13T15:10:17.204609+0000","last_active":"2024-09-13T15:10:18.534970+0000","last_peered":"2024-09-13T15:10:18.534970+0000","last_clean":"2024-09-13T15:10:18.534970+0000","last_became_active":"2024-09-13T15:10:17.202396+0000","last_became_peered":"2024-09-13T15:10:17.202396+0000","last_unstale":"2024-09-13T15:10:18.534970+0000","last_undegraded":"2024-09-13T15:10:18.534970+0000","last_fullsized":"2024-09-13T15:10:18.534970+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.170456+0000","last_change":"2024-09-13T15:10:16.719164+0000","last_active":"2024-09-13T15:10:17.170456+0000","last_peered":"2024-09-13T15:10:17.170456+0000","last_clean":"2024-09-13T15:10:17.170456+0000","last_became_active":"2024-09-13T15:10:16.718753+0000","last_became_peered":"2024-09-13T15:10:16.718753+0000","last_unstale":"2024-09-13T15:10:17.170456+0000","last_undegraded":"2024-09-13T15:10:17.170456+0000","last_fullsized":"2024-09-13T15:10:17.170456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537506+0000","last_change":"2024-09-13T15:10:17.184382+0000","last_active":"2024-09-13T15:10:18.537506+0000","last_peered":"2024-09-13T15:10:18.537506+0000","last_clean":"2024-09-13T15:10:18.537506+0000","last_became_active":"2024-09-13T15:10:17.184204+0000","last_became_peered":"2024-09-13T15:10:17.184204+0000","last_unstale":"2024-09-13T15:10:18.537506+0000","last_undegraded":"2024-09-13T15:10:18.537506+0000","last_fullsized":"2024-09-13T15:10:18.537506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:28.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.188605+0000","last_change":"2024-09-13T15:10:16.723061+0000","last_active":"2024-09-13T15:10:17.188605+0000","last_peered":"2024-09-13T15:10:17.188605+0000","last_clean":"2024-09-13T15:10:17.188605+0000","last_became_active":"2024-09-13T15:10:16.722791+0000","last_became_peered":"2024-09-13T15:10:16.722791+0000","last_unstale":"2024-09-13T15:10:17.188605+0000","last_undegraded":"2024-09-13T15:10:17.188605+0000","last_fullsized":"2024-09-13T15:10:17.188605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:37.686588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180719+0000","last_change":"2024-09-13T15:10:17.193939+0000","last_active":"2024-09-13T15:10:18.180719+0000","last_peered":"2024-09-13T15:10:18.180719+0000","last_clean":"2024-09-13T15:10:18.180719+0000","last_became_active":"2024-09-13T15:10:17.193516+0000","last_became_peered":"2024-09-13T15:10:17.193516+0000","last_unstale":"2024-09-13T15:10:18.180719+0000","last_undegraded":"2024-09-13T15:10:18.180719+0000","last_fullsized":"2024-09-13T15:10:18.180719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:13.993446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175902+0000","last_change":"2024-09-13T15:10:16.720368+0000","last_active":"2024-09-13T15:10:17.175902+0000","last_peered":"2024-09-13T15:10:17.175902+0000","last_clean":"2024-09-13T15:10:17.175902+0000","last_became_active":"2024-09-13T15:10:16.719736+0000","last_became_peered":"2024-09-13T15:10:16.719736+0000","last_unstale":"2024-09-13T15:10:17.175902+0000","last_undegraded":"2024-09-13T15:10:17.175902+0000","last_fullsized":"2024-09-13T15:10:17.175902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537525+0000","last_change":"2024-09-13T15:10:17.189476+0000","last_active":"2024-09-13T15:10:18.537525+0000","last_peered":"2024-09-13T15:10:18.537525+0000","last_clean":"2024-09-13T15:10:18.537525+0000","last_became_active":"2024-09-13T15:10:17.189249+0000","last_became_peered":"2024-09-13T15:10:17.189249+0000","last_unstale":"2024-09-13T15:10:18.537525+0000","last_undegraded":"2024-09-13T15:10:18.537525+0000","last_fullsized":"2024-09-13T15:10:18.537525+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:59.772701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.171738+0000","last_change":"2024-09-13T15:10:16.714357+0000","last_active":"2024-09-13T15:10:17.171738+0000","last_peered":"2024-09-13T15:10:17.171738+0000","last_clean":"2024-09-13T15:10:17.171738+0000","last_became_active":"2024-09-13T15:10:16.714025+0000","last_became_peered":"2024-09-13T15:10:16.714025+0000","last_unstale":"2024-09-13T15:10:17.171738+0000","last_undegraded":"2024-09-13T15:10:17.171738+0000","last_fullsized":"2024-09-13T15:10:17.171738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535367+0000","last_change":"2024-09-13T15:10:17.193088+0000","last_active":"2024-09-13T15:10:18.535367+0000","last_peered":"2024-09-13T15:10:18.535367+0000","last_clean":"2024-09-13T15:10:18.535367+0000","last_became_active":"2024-09-13T15:10:17.192846+0000","last_became_peered":"2024-09-13T15:10:17.192846+0000","last_unstale":"2024-09-13T15:10:18.535367+0000","last_undegraded":"2024-09-13T15:10:18.535367+0000","last_fullsized":"2024-09-13T15:10:18.535367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:11.076932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.200614+0000","last_change":"2024-09-13T15:10:16.719888+0000","last_active":"2024-09-13T15:10:17.200614+0000","last_peered":"2024-09-13T15:10:17.200614+0000","last_clean":"2024-09-13T15:10:17.200614+0000","last_became_active":"2024-09-13T15:10:16.719466+0000","last_became_peered":"2024-09-13T15:10:16.719466+0000","last_unstale":"2024-09-13T15:10:17.200614+0000","last_undegraded":"2024-09-13T15:10:17.200614+0000","last_fullsized":"2024-09-13T15:10:17.200614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178144+0000","last_change":"2024-09-13T15:10:17.183352+0000","last_active":"2024-09-13T15:10:18.178144+0000","last_peered":"2024-09-13T15:10:18.178144+0000","last_clean":"2024-09-13T15:10:18.178144+0000","last_became_active":"2024-09-13T15:10:17.183093+0000","last_became_peered":"2024-09-13T15:10:17.183093+0000","last_unstale":"2024-09-13T15:10:18.178144+0000","last_undegraded":"2024-09-13T15:10:18.178144+0000","last_fullsized":"2024-09-13T15:10:18.178144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.215151+0000","last_change":"2024-09-13T15:10:16.724357+0000","last_active":"2024-09-13T15:10:17.215151+0000","last_peered":"2024-09-13T15:10:17.215151+0000","last_clean":"2024-09-13T15:10:17.215151+0000","last_became_active":"2024-09-13T15:10:16.724028+0000","last_became_peered":"2024-09-13T15:10:16.724028+0000","last_unstale":"2024-09-13T15:10:17.215151+0000","last_undegraded":"2024-09-13T15:10:17.215151+0000","last_fullsized":"2024-09-13T15:10:17.215151+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177197+0000","last_change":"2024-09-13T15:10:17.202982+0000","last_active":"2024-09-13T15:10:18.177197+0000","last_peered":"2024-09-13T15:10:18.177197+0000","last_clean":"2024-09-13T15:10:18.177197+0000","last_became_active":"2024-09-13T15:10:17.200848+0000","last_became_peered":"2024-09-13T15:10:17.200848+0000","last_unstale":"2024-09-13T15:10:18.177197+0000","last_undegraded":"2024-09-13T15:10:18.177197+0000","last_fullsized":"2024-09-13T15:10:18.177197+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.210221+0000","last_change":"2024-09-13T15:10:16.717794+0000","last_active":"2024-09-13T15:10:17.210221+0000","last_peered":"2024-09-13T15:10:17.210221+0000","last_clean":"2024-09-13T15:10:17.210221+0000","last_became_active":"2024-09-13T15:10:16.716747+0000","last_became_peered":"2024-09-13T15:10:16.716747+0000","last_unstale":"2024-09-13T15:10:17.210221+0000","last_undegraded":"2024-09-13T15:10:17.210221+0000","last_fullsized":"2024-09-13T15:10:17.210221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:10.062343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535814+0000","last_change":"2024-09-13T15:10:17.187593+0000","last_active":"2024-09-13T15:10:18.535814+0000","last_peered":"2024-09-13T15:10:18.535814+0000","last_clean":"2024-09-13T15:10:18.535814+0000","last_became_active":"2024-09-13T15:10:17.187306+0000","last_became_peered":"2024-09-13T15:10:17.187306+0000","last_unstale":"2024-09-13T15:10:18.535814+0000","last_undegraded":"2024-09-13T15:10:18.535814+0000","last_fullsized":"2024-09-13T15:10:18.535814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180887+0000","last_change":"2024-09-13T15:10:16.723590+0000","last_active":"2024-09-13T15:10:17.180887+0000","last_peered":"2024-09-13T15:10:17.180887+0000","last_clean":"2024-09-13T15:10:17.180887+0000","last_became_active":"2024-09-13T15:10:16.723308+0000","last_became_peered":"2024-09-13T15:10:16.723308+0000","last_unstale":"2024-09-13T15:10:17.180887+0000","last_undegraded":"2024-09-13T15:10:17.180887+0000","last_fullsized":"2024-09-13T15:10:17.180887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535023+0000","last_change":"2024-09-13T15:10:17.198296+0000","last_active":"2024-09-13T15:10:18.535023+0000","last_peered":"2024-09-13T15:10:18.535023+0000","last_clean":"2024-09-13T15:10:18.535023+0000","last_became_active":"2024-09-13T15:10:17.195215+0000","last_became_peered":"2024-09-13T15:10:17.195215+0000","last_unstale":"2024-09-13T15:10:18.535023+0000","last_undegraded":"2024-09-13T15:10:18.535023+0000","last_fullsized":"2024-09-13T15:10:18.535023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:02.612333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175297+0000","last_change":"2024-09-13T15:10:16.715229+0000","last_active":"2024-09-13T15:10:17.175297+0000","last_peered":"2024-09-13T15:10:17.175297+0000","last_clean":"2024-09-13T15:10:17.175297+0000","last_became_active":"2024-09-13T15:10:16.714554+0000","last_became_peered":"2024-09-13T15:10:16.714554+0000","last_unstale":"2024-09-13T15:10:17.175297+0000","last_undegraded":"2024-09-13T15:10:17.175297+0000","last_fullsized":"2024-09-13T15:10:17.175297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180515+0000","last_change":"2024-09-13T15:10:17.186836+0000","last_active":"2024-09-13T15:10:18.180515+0000","last_peered":"2024-09-13T15:10:18.180515+0000","last_clean":"2024-09-13T15:10:18.180515+0000","last_became_active":"2024-09-13T15:10:17.186559+0000","last_became_peered":"2024-09-13T15:10:17.186559+0000","last_unstale":"2024-09-13T15:10:18.180515+0000","last_undegraded":"2024-09-13T15:10:18.180515+0000","last_fullsized":"2024-09-13T15:10:18.180515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.213605+0000","last_change":"2024-09-13T15:10:16.721963+0000","last_active":"2024-09-13T15:10:17.213605+0000","last_peered":"2024-09-13T15:10:17.213605+0000","last_clean":"2024-09-13T15:10:17.213605+0000","last_became_active":"2024-09-13T15:10:16.721638+0000","last_became_peered":"2024-09-13T15:10:16.721638+0000","last_unstale":"2024-09-13T15:10:17.213605+0000","last_undegraded":"2024-09-13T15:10:17.213605+0000","last_fullsized":"2024-09-13T15:10:17.213605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:56.163813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536255+0000","last_change":"2024-09-13T15:10:17.191603+0000","last_active":"2024-09-13T15:10:18.536255+0000","last_peered":"2024-09-13T15:10:18.536255+0000","last_clean":"2024-09-13T15:10:18.536255+0000","last_became_active":"2024-09-13T15:10:17.190675+0000","last_became_peered":"2024-09-13T15:10:17.190675+0000","last_unstale":"2024-09-13T15:10:18.536255+0000","last_undegraded":"2024-09-13T15:10:18.536255+0000","last_fullsized":"2024-09-13T15:10:18.536255+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.197780+0000","last_change":"2024-09-13T15:10:16.720250+0000","last_active":"2024-09-13T15:10:17.197780+0000","last_peered":"2024-09-13T15:10:17.197780+0000","last_clean":"2024-09-13T15:10:17.197780+0000","last_became_active":"2024-09-13T15:10:16.719967+0000","last_became_peered":"2024-09-13T15:10:16.719967+0000","last_unstale":"2024-09-13T15:10:17.197780+0000","last_undegraded":"2024-09-13T15:10:17.197780+0000","last_fullsized":"2024-09-13T15:10:17.197780+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535871+0000","last_change":"2024-09-13T15:10:17.199556+0000","last_active":"2024-09-13T15:10:18.535871+0000","last_peered":"2024-09-13T15:10:18.535871+0000","last_clean":"2024-09-13T15:10:18.535871+0000","last_became_active":"2024-09-13T15:10:17.199326+0000","last_became_peered":"2024-09-13T15:10:17.199326+0000","last_unstale":"2024-09-13T15:10:18.535871+0000","last_undegraded":"2024-09-13T15:10:18.535871+0000","last_fullsized":"2024-09-13T15:10:18.535871+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.467817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.208469+0000","last_change":"2024-09-13T15:10:16.718824+0000","last_active":"2024-09-13T15:10:17.208469+0000","last_peered":"2024-09-13T15:10:17.208469+0000","last_clean":"2024-09-13T15:10:17.208469+0000","last_became_active":"2024-09-13T15:10:16.718512+0000","last_became_peered":"2024-09-13T15:10:16.718512+0000","last_unstale":"2024-09-13T15:10:17.208469+0000","last_undegraded":"2024-09-13T15:10:17.208469+0000","last_fullsized":"2024-09-13T15:10:17.208469+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:18.080317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177997+0000","last_change":"2024-09-13T15:10:17.205793+0000","last_active":"2024-09-13T15:10:18.177997+0000","last_peered":"2024-09-13T15:10:18.177997+0000","last_clean":"2024-09-13T15:10:18.177997+0000","last_became_active":"2024-09-13T15:10:17.205525+0000","last_became_peered":"2024-09-13T15:10:17.205525+0000","last_unstale":"2024-09-13T15:10:18.177997+0000","last_undegraded":"2024-09-13T15:10:18.177997+0000","last_fullsized":"2024-09-13T15:10:18.177997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.202940+0000","last_change":"2024-09-13T15:10:16.719630+0000","last_active":"2024-09-13T15:10:17.202940+0000","last_peered":"2024-09-13T15:10:17.202940+0000","last_clean":"2024-09-13T15:10:17.202940+0000","last_became_active":"2024-09-13T15:10:16.719389+0000","last_became_peered":"2024-09-13T15:10:16.719389+0000","last_unstale":"2024-09-13T15:10:17.202940+0000","last_undegraded":"2024-09-13T15:10:17.202940+0000","last_fullsized":"2024-09-13T15:10:17.202940+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535306+0000","last_change":"2024-09-13T15:10:17.194843+0000","last_active":"2024-09-13T15:10:18.535306+0000","last_peered":"2024-09-13T15:10:18.535306+0000","last_clean":"2024-09-13T15:10:18.535306+0000","last_became_active":"2024-09-13T15:10:17.194557+0000","last_became_peered":"2024-09-13T15:10:17.194557+0000","last_unstale":"2024-09-13T15:10:18.535306+0000","last_undegraded":"2024-09-13T15:10:18.535306+0000","last_fullsized":"2024-09-13T15:10:18.535306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:19.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.172239+0000","last_change":"2024-09-13T15:10:16.715308+0000","last_active":"2024-09-13T15:10:17.172239+0000","last_peered":"2024-09-13T15:10:17.172239+0000","last_clean":"2024-09-13T15:10:17.172239+0000","last_became_active":"2024-09-13T15:10:16.715012+0000","last_became_peered":"2024-09-13T15:10:16.715012+0000","last_unstale":"2024-09-13T15:10:17.172239+0000","last_undegraded":"2024-09-13T15:10:17.172239+0000","last_fullsized":"2024-09-13T15:10:17.172239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:39.966872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178164+0000","last_change":"2024-09-13T15:10:17.194739+0000","last_active":"2024-09-13T15:10:18.178164+0000","last_peered":"2024-09-13T15:10:18.178164+0000","last_clean":"2024-09-13T15:10:18.178164+0000","last_became_active":"2024-09-13T15:10:17.194456+0000","last_became_peered":"2024-09-13T15:10:17.194456+0000","last_unstale":"2024-09-13T15:10:18.178164+0000","last_undegraded":"2024-09-13T15:10:18.178164+0000","last_fullsized":"2024-09-13T15:10:18.178164+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:29.330066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.203298+0000","last_change":"2024-09-13T15:10:16.720073+0000","last_active":"2024-09-13T15:10:17.203298+0000","last_peered":"2024-09-13T15:10:17.203298+0000","last_clean":"2024-09-13T15:10:17.203298+0000","last_became_active":"2024-09-13T15:10:16.719809+0000","last_became_peered":"2024-09-13T15:10:16.719809+0000","last_unstale":"2024-09-13T15:10:17.203298+0000","last_undegraded":"2024-09-13T15:10:17.203298+0000","last_fullsized":"2024-09-13T15:10:17.203298+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:55.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535965+0000","last_change":"2024-09-13T15:10:17.191688+0000","last_active":"2024-09-13T15:10:18.535965+0000","last_peered":"2024-09-13T15:10:18.535965+0000","last_clean":"2024-09-13T15:10:18.535965+0000","last_became_active":"2024-09-13T15:10:17.191454+0000","last_became_peered":"2024-09-13T15:10:17.191454+0000","last_unstale":"2024-09-13T15:10:18.535965+0000","last_undegraded":"2024-09-13T15:10:18.535965+0000","last_fullsized":"2024-09-13T15:10:18.535965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180973+0000","last_change":"2024-09-13T15:10:16.725604+0000","last_active":"2024-09-13T15:10:17.180973+0000","last_peered":"2024-09-13T15:10:17.180973+0000","last_clean":"2024-09-13T15:10:17.180973+0000","last_became_active":"2024-09-13T15:10:16.723039+0000","last_became_peered":"2024-09-13T15:10:16.723039+0000","last_unstale":"2024-09-13T15:10:17.180973+0000","last_undegraded":"2024-09-13T15:10:17.180973+0000","last_fullsized":"2024-09-13T15:10:17.180973+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535127+0000","last_change":"2024-09-13T15:10:17.190028+0000","last_active":"2024-09-13T15:10:18.535127+0000","last_peered":"2024-09-13T15:10:18.535127+0000","last_clean":"2024-09-13T15:10:18.535127+0000","last_became_active":"2024-09-13T15:10:17.189538+0000","last_became_peered":"2024-09-13T15:10:17.189538+0000","last_unstale":"2024-09-13T15:10:18.535127+0000","last_undegraded":"2024-09-13T15:10:18.535127+0000","last_fullsized":"2024-09-13T15:10:18.535127+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:39.166189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175370+0000","last_change":"2024-09-13T15:10:16.715235+0000","last_active":"2024-09-13T15:10:17.175370+0000","last_peered":"2024-09-13T15:10:17.175370+0000","last_clean":"2024-09-13T15:10:17.175370+0000","last_became_active":"2024-09-13T15:10:16.714938+0000","last_became_peered":"2024-09-13T15:10:16.714938+0000","last_unstale":"2024-09-13T15:10:17.175370+0000","last_undegraded":"2024-09-13T15:10:17.175370+0000","last_fullsized":"2024-09-13T15:10:17.175370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:15.314017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178817+0000","last_change":"2024-09-13T15:10:17.188715+0000","last_active":"2024-09-13T15:10:18.178817+0000","last_peered":"2024-09-13T15:10:18.178817+0000","last_clean":"2024-09-13T15:10:18.178817+0000","last_became_active":"2024-09-13T15:10:17.188432+0000","last_became_peered":"2024-09-13T15:10:17.188432+0000","last_unstale":"2024-09-13T15:10:18.178817+0000","last_undegraded":"2024-09-13T15:10:18.178817+0000","last_fullsized":"2024-09-13T15:10:18.178817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:27.549247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.199504+0000","last_change":"2024-09-13T15:10:16.722014+0000","last_active":"2024-09-13T15:10:17.199504+0000","last_peered":"2024-09-13T15:10:17.199504+0000","last_clean":"2024-09-13T15:10:17.199504+0000","last_became_active":"2024-09-13T15:10:16.721762+0000","last_became_peered":"2024-09-13T15:10:16.721762+0000","last_unstale":"2024-09-13T15:10:17.199504+0000","last_undegraded":"2024-09-13T15:10:17.199504+0000","last_fullsized":"2024-09-13T15:10:17.199504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538473+0000","last_change":"2024-09-13T15:10:17.193040+0000","last_active":"2024-09-13T15:10:18.538473+0000","last_peered":"2024-09-13T15:10:18.538473+0000","last_clean":"2024-09-13T15:10:18.538473+0000","last_became_active":"2024-09-13T15:10:17.192576+0000","last_became_peered":"2024-09-13T15:10:17.192576+0000","last_unstale":"2024-09-13T15:10:18.538473+0000","last_undegraded":"2024-09-13T15:10:18.538473+0000","last_fullsized":"2024-09-13T15:10:18.538473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:44.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.182114+0000","last_change":"2024-09-13T15:10:16.717345+0000","last_active":"2024-09-13T15:10:17.182114+0000","last_peered":"2024-09-13T15:10:17.182114+0000","last_clean":"2024-09-13T15:10:17.182114+0000","last_became_active":"2024-09-13T15:10:16.716789+0000","last_became_peered":"2024-09-13T15:10:16.716789+0000","last_unstale":"2024-09-13T15:10:17.182114+0000","last_undegraded":"2024-09-13T15:10:17.182114+0000","last_fullsized":"2024-09-13T15:10:17.182114+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536780+0000","last_change":"2024-09-13T15:10:17.190911+0000","last_active":"2024-09-13T15:10:18.536780+0000","last_peered":"2024-09-13T15:10:18.536780+0000","last_clean":"2024-09-13T15:10:18.536780+0000","last_became_active":"2024-09-13T15:10:17.190628+0000","last_became_peered":"2024-09-13T15:10:17.190628+0000","last_unstale":"2024-09-13T15:10:18.536780+0000","last_undegraded":"2024-09-13T15:10:18.536780+0000","last_fullsized":"2024-09-13T15:10:18.536780+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.177766+0000","last_change":"2024-09-13T15:10:16.710257+0000","last_active":"2024-09-13T15:10:17.177766+0000","last_peered":"2024-09-13T15:10:17.177766+0000","last_clean":"2024-09-13T15:10:17.177766+0000","last_became_active":"2024-09-13T15:10:16.709898+0000","last_became_peered":"2024-09-13T15:10:16.709898+0000","last_unstale":"2024-09-13T15:10:17.177766+0000","last_undegraded":"2024-09-13T15:10:17.177766+0000","last_fullsized":"2024-09-13T15:10:17.177766+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535565+0000","last_change":"2024-09-13T15:10:17.194810+0000","last_active":"2024-09-13T15:10:18.535565+0000","last_peered":"2024-09-13T15:10:18.535565+0000","last_clean":"2024-09-13T15:10:18.535565+0000","last_became_active":"2024-09-13T15:10:17.194539+0000","last_became_peered":"2024-09-13T15:10:17.194539+0000","last_unstale":"2024-09-13T15:10:18.535565+0000","last_undegraded":"2024-09-13T15:10:18.535565+0000","last_fullsized":"2024-09-13T15:10:18.535565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:07.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180919+0000","last_change":"2024-09-13T15:10:16.721152+0000","last_active":"2024-09-13T15:10:17.180919+0000","last_peered":"2024-09-13T15:10:17.180919+0000","last_clean":"2024-09-13T15:10:17.180919+0000","last_became_active":"2024-09-13T15:10:16.720893+0000","last_became_peered":"2024-09-13T15:10:16.720893+0000","last_unstale":"2024-09-13T15:10:17.180919+0000","last_undegraded":"2024-09-13T15:10:17.180919+0000","last_fullsized":"2024-09-13T15:10:17.180919+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.534666+0000","last_change":"2024-09-13T15:10:17.201530+0000","last_active":"2024-09-13T15:10:18.534666+0000","last_peered":"2024-09-13T15:10:18.534666+0000","last_clean":"2024-09-13T15:10:18.534666+0000","last_became_active":"2024-09-13T15:10:17.201299+0000","last_became_peered":"2024-09-13T15:10:17.201299+0000","last_unstale":"2024-09-13T15:10:18.534666+0000","last_undegraded":"2024-09-13T15:10:18.534666+0000","last_fullsized":"2024-09-13T15:10:18.534666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:16.793342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175183+0000","last_change":"2024-09-13T15:10:16.718475+0000","last_active":"2024-09-13T15:10:17.175183+0000","last_peered":"2024-09-13T15:10:17.175183+0000","last_clean":"2024-09-13T15:10:17.175183+0000","last_became_active":"2024-09-13T15:10:16.717304+0000","last_became_peered":"2024-09-13T15:10:16.717304+0000","last_unstale":"2024-09-13T15:10:17.175183+0000","last_undegraded":"2024-09-13T15:10:17.175183+0000","last_fullsized":"2024-09-13T15:10:17.175183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:05.562203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177450+0000","last_change":"2024-09-13T15:10:17.182350+0000","last_active":"2024-09-13T15:10:18.177450+0000","last_peered":"2024-09-13T15:10:18.177450+0000","last_clean":"2024-09-13T15:10:18.177450+0000","last_became_active":"2024-09-13T15:10:17.182038+0000","last_became_peered":"2024-09-13T15:10:17.182038+0000","last_unstale":"2024-09-13T15:10:18.177450+0000","last_undegraded":"2024-09-13T15:10:18.177450+0000","last_fullsized":"2024-09-13T15:10:18.177450+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.170015+0000","last_change":"2024-09-13T15:10:16.723122+0000","last_active":"2024-09-13T15:10:17.170015+0000","last_peered":"2024-09-13T15:10:17.170015+0000","last_clean":"2024-09-13T15:10:17.170015+0000","last_became_active":"2024-09-13T15:10:16.722801+0000","last_became_peered":"2024-09-13T15:10:16.722801+0000","last_unstale":"2024-09-13T15:10:17.170015+0000","last_undegraded":"2024-09-13T15:10:17.170015+0000","last_fullsized":"2024-09-13T15:10:17.170015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:06.258415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180249+0000","last_change":"2024-09-13T15:10:17.190914+0000","last_active":"2024-09-13T15:10:18.180249+0000","last_peered":"2024-09-13T15:10:18.180249+0000","last_clean":"2024-09-13T15:10:18.180249+0000","last_became_active":"2024-09-13T15:10:17.189763+0000","last_became_peered":"2024-09-13T15:10:17.189763+0000","last_unstale":"2024-09-13T15:10:18.180249+0000","last_undegraded":"2024-09-13T15:10:18.180249+0000","last_fullsized":"2024-09-13T15:10:18.180249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.169265+0000","last_change":"2024-09-13T15:10:16.718984+0000","last_active":"2024-09-13T15:10:17.169265+0000","last_peered":"2024-09-13T15:10:17.169265+0000","last_clean":"2024-09-13T15:10:17.169265+0000","last_became_active":"2024-09-13T15:10:16.718277+0000","last_became_peered":"2024-09-13T15:10:16.718277+0000","last_unstale":"2024-09-13T15:10:17.169265+0000","last_undegraded":"2024-09-13T15:10:17.169265+0000","last_fullsized":"2024-09-13T15:10:17.169265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.520994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538251+0000","last_change":"2024-09-13T15:10:17.196409+0000","last_active":"2024-09-13T15:10:18.538251+0000","last_peered":"2024-09-13T15:10:18.538251+0000","last_clean":"2024-09-13T15:10:18.538251+0000","last_became_active":"2024-09-13T15:10:17.195448+0000","last_became_peered":"2024-09-13T15:10:17.195448+0000","last_unstale":"2024-09-13T15:10:18.538251+0000","last_undegraded":"2024-09-13T15:10:18.538251+0000","last_fullsized":"2024-09-13T15:10:18.538251+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:26.389420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.178440+0000","last_change":"2024-09-13T15:10:16.723730+0000","last_active":"2024-09-13T15:10:17.178440+0000","last_peered":"2024-09-13T15:10:17.178440+0000","last_clean":"2024-09-13T15:10:17.178440+0000","last_became_active":"2024-09-13T15:10:16.723462+0000","last_became_peered":"2024-09-13T15:10:16.723462+0000","last_unstale":"2024-09-13T15:10:17.178440+0000","last_undegraded":"2024-09-13T15:10:17.178440+0000","last_fullsized":"2024-09-13T15:10:17.178440+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535484+0000","last_change":"2024-09-13T15:10:17.200483+0000","last_active":"2024-09-13T15:10:18.535484+0000","last_peered":"2024-09-13T15:10:18.535484+0000","last_clean":"2024-09-13T15:10:18.535484+0000","last_became_active":"2024-09-13T15:10:17.199997+0000","last_became_peered":"2024-09-13T15:10:17.199997+0000","last_unstale":"2024-09-13T15:10:18.535484+0000","last_undegraded":"2024-09-13T15:10:18.535484+0000","last_fullsized":"2024-09-13T15:10:18.535484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:00.119884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.168663+0000","last_change":"2024-09-13T15:10:16.705139+0000","last_active":"2024-09-13T15:10:17.168663+0000","last_peered":"2024-09-13T15:10:17.168663+0000","last_clean":"2024-09-13T15:10:17.168663+0000","last_became_active":"2024-09-13T15:10:16.704815+0000","last_became_peered":"2024-09-13T15:10:16.704815+0000","last_unstale":"2024-09-13T15:10:17.168663+0000","last_undegraded":"2024-09-13T15:10:17.168663+0000","last_fullsized":"2024-09-13T15:10:17.168663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:25.413033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175308+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:17.175308+0000","last_peered":"2024-09-13T15:10:17.175308+0000","last_clean":"2024-09-13T15:10:17.175308+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:17.175308+0000","last_undegraded":"2024-09-13T15:10:17.175308+0000","last_fullsized":"2024-09-13T15:10:17.175308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1396736,"data_stored":942581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.123}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":1.357}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.377},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.4790000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.27},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.171}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.304}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.22},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.427}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":350452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.157}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":1.1839999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.238},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":1.2170000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.284}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.258}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.1220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":351459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.153},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.3120000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.544},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.5900000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.181}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":353001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1739999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.411},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":1.272}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.341}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.218},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.524}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.462}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":1.472}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.381},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.601}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":350418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.012}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.88600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.151},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.3600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.2},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.226}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.4810000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":786432,"data_stored":351437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":1.042},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":1.127}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.276},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2270000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.097},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.026},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.175}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.2470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":815104,"data_stored":353765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.94399999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":1.321},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":1.0680000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.389}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.157},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":1.4279999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.363},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.4610000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1376256,"data_stored":940786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.232}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.036},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.139}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":1.528}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.627}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.331},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.2769999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.708},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.4359999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.651},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.181}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:22.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T15:10:22.652 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-13T15:10:22.646+0000 7f6916c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:10:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.706+0000 7f837a000700 1 Processor -- start 2024-09-13T15:10:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.706+0000 7f837a000700 1 -- start start 2024-09-13T15:10:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f837a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f83740cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f837a000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740b1980 con 0x7f837406d070 2024-09-13T15:10:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f837a000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740b2500 con 0x7f837406d620 2024-09-13T15:10:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f837a000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740b1bd0 con 0x7f8374143b70 2024-09-13T15:10:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8379600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f837406d070 0x7f83740b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60698/0 (socket says 172.21.15.50:60698) 2024-09-13T15:10:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8379600700 1 -- 172.21.15.50:0/2294997829 learned_addr learned my addr 172.21.15.50:0/2294997829 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8378c00700 1 --2- 172.21.15.50:0/2294997829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f83740cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219247235 0 0) 0x7f83740b1980 con 0x7f837406d070 2024-09-13T15:10:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83580035d0 con 0x7f837406d070 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166916557 0 0) 0x7f83740b2500 con 0x7f837406d620 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83740b1980 con 0x7f837406d620 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8378c00700 1 -- 172.21.15.50:0/2294997829 >> v1:172.21.15.181:6789/0 conn(0x7f837406d620 legacy=0x7f837406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628064877 0 0) 0x7f83580035d0 con 0x7f837406d070 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8378c00700 1 -- 172.21.15.50:0/2294997829 >> v1:172.21.15.50:6789/0 conn(0x7f837406d070 legacy=0x7f83740b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.710+0000 7f8378c00700 1 -- 172.21.15.50:0/2294997829 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740b1eb0 con 0x7f8374143b70 2024-09-13T15:10:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f8378c00700 1 --2- 172.21.15.50:0/2294997829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f83740cde20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8364009880 tx=0x7f8364009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39eefc1c0a17f2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0019f0 con 0x7f8374143b70 2024-09-13T15:10:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364004030 con 0x7f8374143b70 2024-09-13T15:10:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f8373e00700 1 -- 172.21.15.50:0/2294997829 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640043c0 con 0x7f8374143b70 2024-09-13T15:10:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 -- 172.21.15.50:0/2294997829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 msgr2=0x7f83740cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 --2- 172.21.15.50:0/2294997829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f83740cde20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8364009880 tx=0x7f8364009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 -- 172.21.15.50:0/2294997829 shutdown_connections 2024-09-13T15:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 --2- 172.21.15.50:0/2294997829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f83740cde20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 -- 172.21.15.50:0/2294997829 >> 172.21.15.50:0/2294997829 conn(0x7f837406a390 msgr2=0x7f837406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 -- 172.21.15.50:0/2294997829 shutdown_connections 2024-09-13T15:10:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.714+0000 7f837a000700 1 -- 172.21.15.50:0/2294997829 wait complete. 2024-09-13T15:10:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 Processor -- start 2024-09-13T15:10:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 -- start start 2024-09-13T15:10:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 0x7f83740706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f837406d620 0x7f837413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f8374141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374157800 con 0x7f837406d070 2024-09-13T15:10:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374070bf0 con 0x7f837406d620 2024-09-13T15:10:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.718+0000 7f837a000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83741568c0 con 0x7f8374143b70 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 0x7f83740706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 0x7f83740706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40692/0 (socket says 172.21.15.50:40692) 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 -- 172.21.15.50:0/2204719502 learned_addr learned my addr 172.21.15.50:0/2204719502 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8379600700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f8374141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f836be00700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f837406d620 0x7f837413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 -- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 msgr2=0x7f8374141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f8374141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 -- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f837406d620 msgr2=0x7f837413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f837406d620 0x7f837413f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 -- 172.21.15.50:0/2204719502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640094b0 con 0x7f837406d070 2024-09-13T15:10:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8378c00700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 0x7f83740706b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83640090b0 tx=0x7f8364004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364003bf0 con 0x7f837406d070 2024-09-13T15:10:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364003d50 con 0x7f837406d070 2024-09-13T15:10:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364011870 con 0x7f837406d070 2024-09-13T15:10:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8374156b80 con 0x7f837406d070 2024-09-13T15:10:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8374157140 con 0x7f837406d070 2024-09-13T15:10:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.722+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83740cde20 con 0x7f837406d070 2024-09-13T15:10:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.726+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83640119d0 con 0x7f837406d070 2024-09-13T15:10:22.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.726+0000 7f8371600700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8350066730 0x7f8350068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:22.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.726+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8364085060 con 0x7f837406d070 2024-09-13T15:10:22.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.726+0000 7f836be00700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8350066730 0x7f8350068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:22.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.730+0000 7f836be00700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8350066730 0x7f8350068bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f835c007fd0 tx=0x7f835c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:22.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.734+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83640b6db0 con 0x7f837406d070 2024-09-13T15:10:22.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.978+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8374071f60 con 0x7f837406d070 2024-09-13T15:10:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.978+0000 7f8371600700 1 -- 172.21.15.50:0/2204719502 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f8364052280 con 0x7f837406d070 2024-09-13T15:10:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:22.983 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":189,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1726240045,"num_in_osds":8,"osd_in_since":1726240036,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":245710848,"bytes_avail":772848402432,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6111}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-13T15:08:44.033719+0000","services":{}},"progress_events":{}} 2024-09-13T15:10:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.978+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8350066730 msgr2=0x7f8350068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.978+0000 7f837a000700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8350066730 0x7f8350068bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f835c007fd0 tx=0x7f835c009040 comp rx=0 tx=0).stop 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 msgr2=0x7f83740706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 0x7f83740706b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83640090b0 tx=0x7f8364004770 comp rx=0 tx=0).stop 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 shutdown_connections 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8350066730 0x7f8350068bf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8374143b70 0x7f8374141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f837406d620 0x7f837413f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 --2- 172.21.15.50:0/2204719502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f837406d070 0x7f83740706b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 >> 172.21.15.50:0/2204719502 conn(0x7f837406a390 msgr2=0x7f8374140170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 shutdown_connections 2024-09-13T15:10:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:22.982+0000 7f837a000700 1 -- 172.21.15.50:0/2204719502 wait complete. 2024-09-13T15:10:23.009 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T15:10:23.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.186+0000 7f064ea00700 1 Processor -- start 2024-09-13T15:10:23.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.186+0000 7f064ea00700 1 -- start start 2024-09-13T15:10:23.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f064ea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06480cf1c0 0x7f06480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:23.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f064ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480b5410 0x7f064815b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:23.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f064ea00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064806bbd0 con 0x7f06481444b0 2024-09-13T15:10:23.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f064ea00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0648144890 con 0x7f06480cf1c0 2024-09-13T15:10:23.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f064ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06480b58a0 con 0x7f06480b5410 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06481444b0 0x7f064806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42162/0 (socket says 172.21.15.50:42162) 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647e00700 1 -- 172.21.15.50:0/3121695105 learned_addr learned my addr 172.21.15.50:0/3121695105 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647400700 1 --2- 172.21.15.50:0/3121695105 >> v2:172.21.15.181:3300/0 conn(0x7f06480cf1c0 0x7f06480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f064ca00700 1 --2- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480b5410 0x7f064815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0646a00700 1 -- 172.21.15.50:0/3121695105 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234652218 0 0) 0x7f064806bbd0 con 0x7f06481444b0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0646a00700 1 -- 172.21.15.50:0/3121695105 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c0035d0 con 0x7f06481444b0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647400700 1 -- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480b5410 msgr2=0x7f064815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647400700 1 --2- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480b5410 0x7f064815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647400700 1 -- 172.21.15.50:0/3121695105 >> v1:172.21.15.50:6789/0 conn(0x7f06481444b0 legacy=0x7f064806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647400700 1 -- 172.21.15.50:0/3121695105 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064806afc0 con 0x7f06480cf1c0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0647400700 1 --2- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480cf1c0 0x7f06480b4ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0634009850 tx=0x7f0634009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c69589d3ed4151 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0646a00700 1 -- 172.21.15.50:0/3121695105 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011830 con 0x7f06480cf1c0 2024-09-13T15:10:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0646a00700 1 -- 172.21.15.50:0/3121695105 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634011990 con 0x7f06480cf1c0 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.190+0000 7f0646a00700 1 -- 172.21.15.50:0/3121695105 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011d40 con 0x7f06480cf1c0 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 -- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480cf1c0 msgr2=0x7f06480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 --2- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480cf1c0 0x7f06480b4ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0634009850 tx=0x7f0634009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 -- 172.21.15.50:0/3121695105 shutdown_connections 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 --2- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480b5410 0x7f064815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 --2- 172.21.15.50:0/3121695105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480cf1c0 0x7f06480b4ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 -- 172.21.15.50:0/3121695105 >> 172.21.15.50:0/3121695105 conn(0x7f064806e660 msgr2=0x7f064806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 -- 172.21.15.50:0/3121695105 shutdown_connections 2024-09-13T15:10:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.194+0000 7f064ea00700 1 -- 172.21.15.50:0/3121695105 wait complete. 2024-09-13T15:10:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 Processor -- start 2024-09-13T15:10:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 -- start start 2024-09-13T15:10:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 0x7f0648140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480cf1c0 0x7f064813cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06481444b0 0x7f064813d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064813ebd0 con 0x7f06481444b0 2024-09-13T15:10:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064813eeb0 con 0x7f06480b5410 2024-09-13T15:10:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064813f190 con 0x7f06480cf1c0 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f0647e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 0x7f0648140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f0647e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 0x7f0648140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:51524/0 (socket says 172.21.15.50:51524) 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f0647e00700 1 -- 172.21.15.50:0/2880563949 learned_addr learned my addr 172.21.15.50:0/2880563949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f0647400700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480cf1c0 0x7f064813cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.198+0000 7f064ca00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06481444b0 0x7f064813d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647e00700 1 -- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480cf1c0 msgr2=0x7f064813cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647e00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480cf1c0 0x7f064813cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647e00700 1 -- 172.21.15.50:0/2880563949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06481444b0 msgr2=0x7f064813d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647e00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06481444b0 0x7f064813d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647e00700 1 -- 172.21.15.50:0/2880563949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340094b0 con 0x7f06480b5410 2024-09-13T15:10:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f064ca00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06481444b0 0x7f064813d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647400700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480cf1c0 0x7f064813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f0647e00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 0x7f0648140a70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f063800c4d0 tx=0x7f063800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638005d90 con 0x7f06480b5410 2024-09-13T15:10:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380070d0 con 0x7f06480b5410 2024-09-13T15:10:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064813f470 con 0x7f06480b5410 2024-09-13T15:10:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638007480 con 0x7f06480b5410 2024-09-13T15:10:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064813fa30 con 0x7f06480b5410 2024-09-13T15:10:23.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.202+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064815b680 con 0x7f06480b5410 2024-09-13T15:10:23.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.206+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06380075e0 con 0x7f06480b5410 2024-09-13T15:10:23.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.206+0000 7f063fe00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0628066780 0x7f0628068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:23.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.206+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0638083730 con 0x7f06480b5410 2024-09-13T15:10:23.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.206+0000 7f0647400700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0628066780 0x7f0628068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:23.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.206+0000 7f0647400700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0628066780 0x7f0628068c40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f06340090b0 tx=0x7f0634008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:23.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.214+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0638050940 con 0x7f06480b5410 2024-09-13T15:10:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.406+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0648071b80 con 0x7f0628066780 2024-09-13T15:10:23.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.426+0000 7f063fe00700 1 -- 172.21.15.50:0/2880563949 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286546 (secure 0 0 0) 0x7f0648071b80 con 0x7f0628066780 2024-09-13T15:10:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0628066780 msgr2=0x7f0628068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0628066780 0x7f0628068c40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f06340090b0 tx=0x7f0634008030 comp rx=0 tx=0).stop 2024-09-13T15:10:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 msgr2=0x7f0648140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 0x7f0648140a70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f063800c4d0 tx=0x7f063800c7e0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 shutdown_connections 2024-09-13T15:10:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0628066780 0x7f0628068c40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06481444b0 0x7f064813d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06480cf1c0 0x7f064813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 --2- 172.21.15.50:0/2880563949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06480b5410 0x7f0648140a70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 >> 172.21.15.50:0/2880563949 conn(0x7f064806e660 msgr2=0x7f064815ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 shutdown_connections 2024-09-13T15:10:23.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:23.430+0000 7f064ea00700 1 -- 172.21.15.50:0/2880563949 wait complete. 2024-09-13T15:10:23.443 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:23.458 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-13T15:10:22.067582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239952,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734768,"statfs":{"total":773094113280,"available":772848402432,"internally_reserved":0,"allocated":7532544,"data_stored":3993899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.003204"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180961+0000","last_change":"2024-09-13T15:10:17.191018+0000","last_active":"2024-09-13T15:10:18.180961+0000","last_peered":"2024-09-13T15:10:18.180961+0000","last_clean":"2024-09-13T15:10:18.180961+0000","last_became_active":"2024-09-13T15:10:17.190112+0000","last_became_peered":"2024-09-13T15:10:17.190112+0000","last_unstale":"2024-09-13T15:10:18.180961+0000","last_undegraded":"2024-09-13T15:10:18.180961+0000","last_fullsized":"2024-09-13T15:10:18.180961+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180798+0000","last_change":"2024-09-13T15:10:17.193381+0000","last_active":"2024-09-13T15:10:18.180798+0000","last_peered":"2024-09-13T15:10:18.180798+0000","last_clean":"2024-09-13T15:10:18.180798+0000","last_became_active":"2024-09-13T15:10:17.193146+0000","last_became_peered":"2024-09-13T15:10:17.193146+0000","last_unstale":"2024-09-13T15:10:18.180798+0000","last_undegraded":"2024-09-13T15:10:18.180798+0000","last_fullsized":"2024-09-13T15:10:18.180798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:25.507760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536338+0000","last_change":"2024-09-13T15:10:17.194055+0000","last_active":"2024-09-13T15:10:18.536338+0000","last_peered":"2024-09-13T15:10:18.536338+0000","last_clean":"2024-09-13T15:10:18.536338+0000","last_became_active":"2024-09-13T15:10:17.193816+0000","last_became_peered":"2024-09-13T15:10:17.193816+0000","last_unstale":"2024-09-13T15:10:18.536338+0000","last_undegraded":"2024-09-13T15:10:18.536338+0000","last_fullsized":"2024-09-13T15:10:18.536338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177721+0000","last_change":"2024-09-13T15:10:17.203227+0000","last_active":"2024-09-13T15:10:18.177721+0000","last_peered":"2024-09-13T15:10:18.177721+0000","last_clean":"2024-09-13T15:10:18.177721+0000","last_became_active":"2024-09-13T15:10:17.190454+0000","last_became_peered":"2024-09-13T15:10:17.190454+0000","last_unstale":"2024-09-13T15:10:18.177721+0000","last_undegraded":"2024-09-13T15:10:18.177721+0000","last_fullsized":"2024-09-13T15:10:18.177721+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:13.993446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535314+0000","last_change":"2024-09-13T15:10:17.200628+0000","last_active":"2024-09-13T15:10:18.535314+0000","last_peered":"2024-09-13T15:10:18.535314+0000","last_clean":"2024-09-13T15:10:18.535314+0000","last_became_active":"2024-09-13T15:10:17.200246+0000","last_became_peered":"2024-09-13T15:10:17.200246+0000","last_unstale":"2024-09-13T15:10:18.535314+0000","last_undegraded":"2024-09-13T15:10:18.535314+0000","last_fullsized":"2024-09-13T15:10:18.535314+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:02.121949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178437+0000","last_change":"2024-09-13T15:10:17.199455+0000","last_active":"2024-09-13T15:10:18.178437+0000","last_peered":"2024-09-13T15:10:18.178437+0000","last_clean":"2024-09-13T15:10:18.178437+0000","last_became_active":"2024-09-13T15:10:17.198918+0000","last_became_peered":"2024-09-13T15:10:17.198918+0000","last_unstale":"2024-09-13T15:10:18.178437+0000","last_undegraded":"2024-09-13T15:10:18.178437+0000","last_fullsized":"2024-09-13T15:10:18.178437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:23.725734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538325+0000","last_change":"2024-09-13T15:10:17.197839+0000","last_active":"2024-09-13T15:10:18.538325+0000","last_peered":"2024-09-13T15:10:18.538325+0000","last_clean":"2024-09-13T15:10:18.538325+0000","last_became_active":"2024-09-13T15:10:17.197605+0000","last_became_peered":"2024-09-13T15:10:17.197605+0000","last_unstale":"2024-09-13T15:10:18.538325+0000","last_undegraded":"2024-09-13T15:10:18.538325+0000","last_fullsized":"2024-09-13T15:10:18.538325+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:44.589350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536861+0000","last_change":"2024-09-13T15:10:17.195877+0000","last_active":"2024-09-13T15:10:18.536861+0000","last_peered":"2024-09-13T15:10:18.536861+0000","last_clean":"2024-09-13T15:10:18.536861+0000","last_became_active":"2024-09-13T15:10:17.195416+0000","last_became_peered":"2024-09-13T15:10:17.195416+0000","last_unstale":"2024-09-13T15:10:18.536861+0000","last_undegraded":"2024-09-13T15:10:18.536861+0000","last_fullsized":"2024-09-13T15:10:18.536861+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537069+0000","last_change":"2024-09-13T15:10:17.188990+0000","last_active":"2024-09-13T15:10:18.537069+0000","last_peered":"2024-09-13T15:10:18.537069+0000","last_clean":"2024-09-13T15:10:18.537069+0000","last_became_active":"2024-09-13T15:10:17.188726+0000","last_became_peered":"2024-09-13T15:10:17.188726+0000","last_unstale":"2024-09-13T15:10:18.537069+0000","last_undegraded":"2024-09-13T15:10:18.537069+0000","last_fullsized":"2024-09-13T15:10:18.537069+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:35.298381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536589+0000","last_change":"2024-09-13T15:10:17.187840+0000","last_active":"2024-09-13T15:10:18.536589+0000","last_peered":"2024-09-13T15:10:18.536589+0000","last_clean":"2024-09-13T15:10:18.536589+0000","last_became_active":"2024-09-13T15:10:17.187522+0000","last_became_peered":"2024-09-13T15:10:17.187522+0000","last_unstale":"2024-09-13T15:10:18.536589+0000","last_undegraded":"2024-09-13T15:10:18.536589+0000","last_fullsized":"2024-09-13T15:10:18.536589+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:09.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177855+0000","last_change":"2024-09-13T15:10:17.188709+0000","last_active":"2024-09-13T15:10:18.177855+0000","last_peered":"2024-09-13T15:10:18.177855+0000","last_clean":"2024-09-13T15:10:18.177855+0000","last_became_active":"2024-09-13T15:10:17.188198+0000","last_became_peered":"2024-09-13T15:10:17.188198+0000","last_unstale":"2024-09-13T15:10:18.177855+0000","last_undegraded":"2024-09-13T15:10:18.177855+0000","last_fullsized":"2024-09-13T15:10:18.177855+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535876+0000","last_change":"2024-09-13T15:10:17.199667+0000","last_active":"2024-09-13T15:10:18.535876+0000","last_peered":"2024-09-13T15:10:18.535876+0000","last_clean":"2024-09-13T15:10:18.535876+0000","last_became_active":"2024-09-13T15:10:17.199404+0000","last_became_peered":"2024-09-13T15:10:17.199404+0000","last_unstale":"2024-09-13T15:10:18.535876+0000","last_undegraded":"2024-09-13T15:10:18.535876+0000","last_fullsized":"2024-09-13T15:10:18.535876+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:09.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537060+0000","last_change":"2024-09-13T15:10:17.187672+0000","last_active":"2024-09-13T15:10:18.537060+0000","last_peered":"2024-09-13T15:10:18.537060+0000","last_clean":"2024-09-13T15:10:18.537060+0000","last_became_active":"2024-09-13T15:10:17.187361+0000","last_became_peered":"2024-09-13T15:10:17.187361+0000","last_unstale":"2024-09-13T15:10:18.537060+0000","last_undegraded":"2024-09-13T15:10:18.537060+0000","last_fullsized":"2024-09-13T15:10:18.537060+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536420+0000","last_change":"2024-09-13T15:10:17.193361+0000","last_active":"2024-09-13T15:10:18.536420+0000","last_peered":"2024-09-13T15:10:18.536420+0000","last_clean":"2024-09-13T15:10:18.536420+0000","last_became_active":"2024-09-13T15:10:17.193093+0000","last_became_peered":"2024-09-13T15:10:17.193093+0000","last_unstale":"2024-09-13T15:10:18.536420+0000","last_undegraded":"2024-09-13T15:10:18.536420+0000","last_fullsized":"2024-09-13T15:10:18.536420+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537652+0000","last_change":"2024-09-13T15:10:17.192179+0000","last_active":"2024-09-13T15:10:18.537652+0000","last_peered":"2024-09-13T15:10:18.537652+0000","last_clean":"2024-09-13T15:10:18.537652+0000","last_became_active":"2024-09-13T15:10:17.191941+0000","last_became_peered":"2024-09-13T15:10:17.191941+0000","last_unstale":"2024-09-13T15:10:18.537652+0000","last_undegraded":"2024-09-13T15:10:18.537652+0000","last_fullsized":"2024-09-13T15:10:18.537652+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:26.770391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537926+0000","last_change":"2024-09-13T15:10:17.192915+0000","last_active":"2024-09-13T15:10:18.537926+0000","last_peered":"2024-09-13T15:10:18.537926+0000","last_clean":"2024-09-13T15:10:18.537926+0000","last_became_active":"2024-09-13T15:10:17.190889+0000","last_became_peered":"2024-09-13T15:10:17.190889+0000","last_unstale":"2024-09-13T15:10:18.537926+0000","last_undegraded":"2024-09-13T15:10:18.537926+0000","last_fullsized":"2024-09-13T15:10:18.537926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:13.258712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180991+0000","last_change":"2024-09-13T15:10:17.191793+0000","last_active":"2024-09-13T15:10:18.180991+0000","last_peered":"2024-09-13T15:10:18.180991+0000","last_clean":"2024-09-13T15:10:18.180991+0000","last_became_active":"2024-09-13T15:10:17.191530+0000","last_became_peered":"2024-09-13T15:10:17.191530+0000","last_unstale":"2024-09-13T15:10:18.180991+0000","last_undegraded":"2024-09-13T15:10:18.180991+0000","last_fullsized":"2024-09-13T15:10:18.180991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178031+0000","last_change":"2024-09-13T15:10:17.186406+0000","last_active":"2024-09-13T15:10:18.178031+0000","last_peered":"2024-09-13T15:10:18.178031+0000","last_clean":"2024-09-13T15:10:18.178031+0000","last_became_active":"2024-09-13T15:10:17.186142+0000","last_became_peered":"2024-09-13T15:10:17.186142+0000","last_unstale":"2024-09-13T15:10:18.178031+0000","last_undegraded":"2024-09-13T15:10:18.178031+0000","last_fullsized":"2024-09-13T15:10:18.178031+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:32.544997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536997+0000","last_change":"2024-09-13T15:10:17.197611+0000","last_active":"2024-09-13T15:10:18.536997+0000","last_peered":"2024-09-13T15:10:18.536997+0000","last_clean":"2024-09-13T15:10:18.536997+0000","last_became_active":"2024-09-13T15:10:17.193825+0000","last_became_peered":"2024-09-13T15:10:17.193825+0000","last_unstale":"2024-09-13T15:10:18.536997+0000","last_undegraded":"2024-09-13T15:10:18.536997+0000","last_fullsized":"2024-09-13T15:10:18.536997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:05.539046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537839+0000","last_change":"2024-09-13T15:10:17.202035+0000","last_active":"2024-09-13T15:10:18.537839+0000","last_peered":"2024-09-13T15:10:18.537839+0000","last_clean":"2024-09-13T15:10:18.537839+0000","last_became_active":"2024-09-13T15:10:17.201739+0000","last_became_peered":"2024-09-13T15:10:17.201739+0000","last_unstale":"2024-09-13T15:10:18.537839+0000","last_undegraded":"2024-09-13T15:10:18.537839+0000","last_fullsized":"2024-09-13T15:10:18.537839+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537169+0000","last_change":"2024-09-13T15:10:17.197262+0000","last_active":"2024-09-13T15:10:18.537169+0000","last_peered":"2024-09-13T15:10:18.537169+0000","last_clean":"2024-09-13T15:10:18.537169+0000","last_became_active":"2024-09-13T15:10:17.192009+0000","last_became_peered":"2024-09-13T15:10:17.192009+0000","last_unstale":"2024-09-13T15:10:18.537169+0000","last_undegraded":"2024-09-13T15:10:18.537169+0000","last_fullsized":"2024-09-13T15:10:18.537169+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:31.641260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537403+0000","last_change":"2024-09-13T15:10:17.182131+0000","last_active":"2024-09-13T15:10:18.537403+0000","last_peered":"2024-09-13T15:10:18.537403+0000","last_clean":"2024-09-13T15:10:18.537403+0000","last_became_active":"2024-09-13T15:10:17.181882+0000","last_became_peered":"2024-09-13T15:10:17.181882+0000","last_unstale":"2024-09-13T15:10:18.537403+0000","last_undegraded":"2024-09-13T15:10:18.537403+0000","last_fullsized":"2024-09-13T15:10:18.537403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:13.460857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537258+0000","last_change":"2024-09-13T15:10:17.183417+0000","last_active":"2024-09-13T15:10:18.537258+0000","last_peered":"2024-09-13T15:10:18.537258+0000","last_clean":"2024-09-13T15:10:18.537258+0000","last_became_active":"2024-09-13T15:10:17.183143+0000","last_became_peered":"2024-09-13T15:10:17.183143+0000","last_unstale":"2024-09-13T15:10:18.537258+0000","last_undegraded":"2024-09-13T15:10:18.537258+0000","last_fullsized":"2024-09-13T15:10:18.537258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:58.938786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535630+0000","last_change":"2024-09-13T15:10:17.193630+0000","last_active":"2024-09-13T15:10:18.535630+0000","last_peered":"2024-09-13T15:10:18.535630+0000","last_clean":"2024-09-13T15:10:18.535630+0000","last_became_active":"2024-09-13T15:10:17.193262+0000","last_became_peered":"2024-09-13T15:10:17.193262+0000","last_unstale":"2024-09-13T15:10:18.535630+0000","last_undegraded":"2024-09-13T15:10:18.535630+0000","last_fullsized":"2024-09-13T15:10:18.535630+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536086+0000","last_change":"2024-09-13T15:10:17.190224+0000","last_active":"2024-09-13T15:10:18.536086+0000","last_peered":"2024-09-13T15:10:18.536086+0000","last_clean":"2024-09-13T15:10:18.536086+0000","last_became_active":"2024-09-13T15:10:17.189965+0000","last_became_peered":"2024-09-13T15:10:17.189965+0000","last_unstale":"2024-09-13T15:10:18.536086+0000","last_undegraded":"2024-09-13T15:10:18.536086+0000","last_fullsized":"2024-09-13T15:10:18.536086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536096+0000","last_change":"2024-09-13T15:10:17.193166+0000","last_active":"2024-09-13T15:10:18.536096+0000","last_peered":"2024-09-13T15:10:18.536096+0000","last_clean":"2024-09-13T15:10:18.536096+0000","last_became_active":"2024-09-13T15:10:17.192894+0000","last_became_peered":"2024-09-13T15:10:17.192894+0000","last_unstale":"2024-09-13T15:10:18.536096+0000","last_undegraded":"2024-09-13T15:10:18.536096+0000","last_fullsized":"2024-09-13T15:10:18.536096+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177912+0000","last_change":"2024-09-13T15:10:17.188450+0000","last_active":"2024-09-13T15:10:18.177912+0000","last_peered":"2024-09-13T15:10:18.177912+0000","last_clean":"2024-09-13T15:10:18.177912+0000","last_became_active":"2024-09-13T15:10:17.187741+0000","last_became_peered":"2024-09-13T15:10:17.187741+0000","last_unstale":"2024-09-13T15:10:18.177912+0000","last_undegraded":"2024-09-13T15:10:18.177912+0000","last_fullsized":"2024-09-13T15:10:18.177912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180508+0000","last_change":"2024-09-13T15:10:17.206071+0000","last_active":"2024-09-13T15:10:18.180508+0000","last_peered":"2024-09-13T15:10:18.180508+0000","last_clean":"2024-09-13T15:10:18.180508+0000","last_became_active":"2024-09-13T15:10:17.205546+0000","last_became_peered":"2024-09-13T15:10:17.205546+0000","last_unstale":"2024-09-13T15:10:18.180508+0000","last_undegraded":"2024-09-13T15:10:18.180508+0000","last_fullsized":"2024-09-13T15:10:18.180508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536491+0000","last_change":"2024-09-13T15:10:17.188795+0000","last_active":"2024-09-13T15:10:18.536491+0000","last_peered":"2024-09-13T15:10:18.536491+0000","last_clean":"2024-09-13T15:10:18.536491+0000","last_became_active":"2024-09-13T15:10:17.188513+0000","last_became_peered":"2024-09-13T15:10:17.188513+0000","last_unstale":"2024-09-13T15:10:18.536491+0000","last_undegraded":"2024-09-13T15:10:18.536491+0000","last_fullsized":"2024-09-13T15:10:18.536491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536876+0000","last_change":"2024-09-13T15:10:17.199032+0000","last_active":"2024-09-13T15:10:18.536876+0000","last_peered":"2024-09-13T15:10:18.536876+0000","last_clean":"2024-09-13T15:10:18.536876+0000","last_became_active":"2024-09-13T15:10:17.198807+0000","last_became_peered":"2024-09-13T15:10:17.198807+0000","last_unstale":"2024-09-13T15:10:18.536876+0000","last_undegraded":"2024-09-13T15:10:18.536876+0000","last_fullsized":"2024-09-13T15:10:18.536876+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:35.298381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177272+0000","last_change":"2024-09-13T15:10:17.198443+0000","last_active":"2024-09-13T15:10:18.177272+0000","last_peered":"2024-09-13T15:10:18.177272+0000","last_clean":"2024-09-13T15:10:18.177272+0000","last_became_active":"2024-09-13T15:10:17.198170+0000","last_became_peered":"2024-09-13T15:10:17.198170+0000","last_unstale":"2024-09-13T15:10:18.177272+0000","last_undegraded":"2024-09-13T15:10:18.177272+0000","last_fullsized":"2024-09-13T15:10:18.177272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:36.024595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178026+0000","last_change":"2024-09-13T15:10:17.195629+0000","last_active":"2024-09-13T15:10:18.178026+0000","last_peered":"2024-09-13T15:10:18.178026+0000","last_clean":"2024-09-13T15:10:18.178026+0000","last_became_active":"2024-09-13T15:10:17.195294+0000","last_became_peered":"2024-09-13T15:10:17.195294+0000","last_unstale":"2024-09-13T15:10:18.178026+0000","last_undegraded":"2024-09-13T15:10:18.178026+0000","last_fullsized":"2024-09-13T15:10:18.178026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:03.489256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535368+0000","last_change":"2024-09-13T15:10:17.201819+0000","last_active":"2024-09-13T15:10:18.535368+0000","last_peered":"2024-09-13T15:10:18.535368+0000","last_clean":"2024-09-13T15:10:18.535368+0000","last_became_active":"2024-09-13T15:10:17.199216+0000","last_became_peered":"2024-09-13T15:10:17.199216+0000","last_unstale":"2024-09-13T15:10:18.535368+0000","last_undegraded":"2024-09-13T15:10:18.535368+0000","last_fullsized":"2024-09-13T15:10:18.535368+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:25.158826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.201896+0000","last_change":"2024-09-13T15:10:16.721705+0000","last_active":"2024-09-13T15:10:17.201896+0000","last_peered":"2024-09-13T15:10:17.201896+0000","last_clean":"2024-09-13T15:10:17.201896+0000","last_became_active":"2024-09-13T15:10:16.721281+0000","last_became_peered":"2024-09-13T15:10:16.721281+0000","last_unstale":"2024-09-13T15:10:17.201896+0000","last_undegraded":"2024-09-13T15:10:17.201896+0000","last_fullsized":"2024-09-13T15:10:17.201896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177989+0000","last_change":"2024-09-13T15:10:17.203733+0000","last_active":"2024-09-13T15:10:18.177989+0000","last_peered":"2024-09-13T15:10:18.177989+0000","last_clean":"2024-09-13T15:10:18.177989+0000","last_became_active":"2024-09-13T15:10:17.203429+0000","last_became_peered":"2024-09-13T15:10:17.203429+0000","last_unstale":"2024-09-13T15:10:18.177989+0000","last_undegraded":"2024-09-13T15:10:18.177989+0000","last_fullsized":"2024-09-13T15:10:18.177989+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:25.507760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.205092+0000","last_change":"2024-09-13T15:10:16.717228+0000","last_active":"2024-09-13T15:10:17.205092+0000","last_peered":"2024-09-13T15:10:17.205092+0000","last_clean":"2024-09-13T15:10:17.205092+0000","last_became_active":"2024-09-13T15:10:16.715990+0000","last_became_peered":"2024-09-13T15:10:16.715990+0000","last_unstale":"2024-09-13T15:10:17.205092+0000","last_undegraded":"2024-09-13T15:10:17.205092+0000","last_fullsized":"2024-09-13T15:10:17.205092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:46.057647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178674+0000","last_change":"2024-09-13T15:10:17.187045+0000","last_active":"2024-09-13T15:10:18.178674+0000","last_peered":"2024-09-13T15:10:18.178674+0000","last_clean":"2024-09-13T15:10:18.178674+0000","last_became_active":"2024-09-13T15:10:17.186573+0000","last_became_peered":"2024-09-13T15:10:17.186573+0000","last_unstale":"2024-09-13T15:10:18.178674+0000","last_undegraded":"2024-09-13T15:10:18.178674+0000","last_fullsized":"2024-09-13T15:10:18.178674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.200786+0000","last_change":"2024-09-13T15:10:16.719972+0000","last_active":"2024-09-13T15:10:17.200786+0000","last_peered":"2024-09-13T15:10:17.200786+0000","last_clean":"2024-09-13T15:10:17.200786+0000","last_became_active":"2024-09-13T15:10:16.719471+0000","last_became_peered":"2024-09-13T15:10:16.719471+0000","last_unstale":"2024-09-13T15:10:17.200786+0000","last_undegraded":"2024-09-13T15:10:17.200786+0000","last_fullsized":"2024-09-13T15:10:17.200786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:00.677998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536910+0000","last_change":"2024-09-13T15:10:17.191538+0000","last_active":"2024-09-13T15:10:18.536910+0000","last_peered":"2024-09-13T15:10:18.536910+0000","last_clean":"2024-09-13T15:10:18.536910+0000","last_became_active":"2024-09-13T15:10:17.191303+0000","last_became_peered":"2024-09-13T15:10:17.191303+0000","last_unstale":"2024-09-13T15:10:18.536910+0000","last_undegraded":"2024-09-13T15:10:18.536910+0000","last_fullsized":"2024-09-13T15:10:18.536910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:31.641260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.199926+0000","last_change":"2024-09-13T15:10:16.718704+0000","last_active":"2024-09-13T15:10:17.199926+0000","last_peered":"2024-09-13T15:10:17.199926+0000","last_clean":"2024-09-13T15:10:17.199926+0000","last_became_active":"2024-09-13T15:10:16.718439+0000","last_became_peered":"2024-09-13T15:10:16.718439+0000","last_unstale":"2024-09-13T15:10:17.199926+0000","last_undegraded":"2024-09-13T15:10:17.199926+0000","last_fullsized":"2024-09-13T15:10:17.199926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537925+0000","last_change":"2024-09-13T15:10:17.193314+0000","last_active":"2024-09-13T15:10:18.537925+0000","last_peered":"2024-09-13T15:10:18.537925+0000","last_clean":"2024-09-13T15:10:18.537925+0000","last_became_active":"2024-09-13T15:10:17.192270+0000","last_became_peered":"2024-09-13T15:10:17.192270+0000","last_unstale":"2024-09-13T15:10:18.537925+0000","last_undegraded":"2024-09-13T15:10:18.537925+0000","last_fullsized":"2024-09-13T15:10:18.537925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:54.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.192364+0000","last_change":"2024-09-13T15:10:16.712118+0000","last_active":"2024-09-13T15:10:17.192364+0000","last_peered":"2024-09-13T15:10:17.192364+0000","last_clean":"2024-09-13T15:10:17.192364+0000","last_became_active":"2024-09-13T15:10:16.711865+0000","last_became_peered":"2024-09-13T15:10:16.711865+0000","last_unstale":"2024-09-13T15:10:17.192364+0000","last_undegraded":"2024-09-13T15:10:17.192364+0000","last_fullsized":"2024-09-13T15:10:17.192364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180307+0000","last_change":"2024-09-13T15:10:17.189438+0000","last_active":"2024-09-13T15:10:18.180307+0000","last_peered":"2024-09-13T15:10:18.180307+0000","last_clean":"2024-09-13T15:10:18.180307+0000","last_became_active":"2024-09-13T15:10:17.189194+0000","last_became_peered":"2024-09-13T15:10:17.189194+0000","last_unstale":"2024-09-13T15:10:18.180307+0000","last_undegraded":"2024-09-13T15:10:18.180307+0000","last_fullsized":"2024-09-13T15:10:18.180307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.192805+0000","last_change":"2024-09-13T15:10:16.705759+0000","last_active":"2024-09-13T15:10:17.192805+0000","last_peered":"2024-09-13T15:10:17.192805+0000","last_clean":"2024-09-13T15:10:17.192805+0000","last_became_active":"2024-09-13T15:10:16.705510+0000","last_became_peered":"2024-09-13T15:10:16.705510+0000","last_unstale":"2024-09-13T15:10:17.192805+0000","last_undegraded":"2024-09-13T15:10:17.192805+0000","last_fullsized":"2024-09-13T15:10:17.192805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:53.117052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.534970+0000","last_change":"2024-09-13T15:10:17.204609+0000","last_active":"2024-09-13T15:10:18.534970+0000","last_peered":"2024-09-13T15:10:18.534970+0000","last_clean":"2024-09-13T15:10:18.534970+0000","last_became_active":"2024-09-13T15:10:17.202396+0000","last_became_peered":"2024-09-13T15:10:17.202396+0000","last_unstale":"2024-09-13T15:10:18.534970+0000","last_undegraded":"2024-09-13T15:10:18.534970+0000","last_fullsized":"2024-09-13T15:10:18.534970+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.170456+0000","last_change":"2024-09-13T15:10:16.719164+0000","last_active":"2024-09-13T15:10:17.170456+0000","last_peered":"2024-09-13T15:10:17.170456+0000","last_clean":"2024-09-13T15:10:17.170456+0000","last_became_active":"2024-09-13T15:10:16.718753+0000","last_became_peered":"2024-09-13T15:10:16.718753+0000","last_unstale":"2024-09-13T15:10:17.170456+0000","last_undegraded":"2024-09-13T15:10:17.170456+0000","last_fullsized":"2024-09-13T15:10:17.170456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537506+0000","last_change":"2024-09-13T15:10:17.184382+0000","last_active":"2024-09-13T15:10:18.537506+0000","last_peered":"2024-09-13T15:10:18.537506+0000","last_clean":"2024-09-13T15:10:18.537506+0000","last_became_active":"2024-09-13T15:10:17.184204+0000","last_became_peered":"2024-09-13T15:10:17.184204+0000","last_unstale":"2024-09-13T15:10:18.537506+0000","last_undegraded":"2024-09-13T15:10:18.537506+0000","last_fullsized":"2024-09-13T15:10:18.537506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:28.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.188605+0000","last_change":"2024-09-13T15:10:16.723061+0000","last_active":"2024-09-13T15:10:17.188605+0000","last_peered":"2024-09-13T15:10:17.188605+0000","last_clean":"2024-09-13T15:10:17.188605+0000","last_became_active":"2024-09-13T15:10:16.722791+0000","last_became_peered":"2024-09-13T15:10:16.722791+0000","last_unstale":"2024-09-13T15:10:17.188605+0000","last_undegraded":"2024-09-13T15:10:17.188605+0000","last_fullsized":"2024-09-13T15:10:17.188605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:37.686588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180719+0000","last_change":"2024-09-13T15:10:17.193939+0000","last_active":"2024-09-13T15:10:18.180719+0000","last_peered":"2024-09-13T15:10:18.180719+0000","last_clean":"2024-09-13T15:10:18.180719+0000","last_became_active":"2024-09-13T15:10:17.193516+0000","last_became_peered":"2024-09-13T15:10:17.193516+0000","last_unstale":"2024-09-13T15:10:18.180719+0000","last_undegraded":"2024-09-13T15:10:18.180719+0000","last_fullsized":"2024-09-13T15:10:18.180719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:13.993446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175902+0000","last_change":"2024-09-13T15:10:16.720368+0000","last_active":"2024-09-13T15:10:17.175902+0000","last_peered":"2024-09-13T15:10:17.175902+0000","last_clean":"2024-09-13T15:10:17.175902+0000","last_became_active":"2024-09-13T15:10:16.719736+0000","last_became_peered":"2024-09-13T15:10:16.719736+0000","last_unstale":"2024-09-13T15:10:17.175902+0000","last_undegraded":"2024-09-13T15:10:17.175902+0000","last_fullsized":"2024-09-13T15:10:17.175902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537525+0000","last_change":"2024-09-13T15:10:17.189476+0000","last_active":"2024-09-13T15:10:18.537525+0000","last_peered":"2024-09-13T15:10:18.537525+0000","last_clean":"2024-09-13T15:10:18.537525+0000","last_became_active":"2024-09-13T15:10:17.189249+0000","last_became_peered":"2024-09-13T15:10:17.189249+0000","last_unstale":"2024-09-13T15:10:18.537525+0000","last_undegraded":"2024-09-13T15:10:18.537525+0000","last_fullsized":"2024-09-13T15:10:18.537525+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:59.772701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.171738+0000","last_change":"2024-09-13T15:10:16.714357+0000","last_active":"2024-09-13T15:10:17.171738+0000","last_peered":"2024-09-13T15:10:17.171738+0000","last_clean":"2024-09-13T15:10:17.171738+0000","last_became_active":"2024-09-13T15:10:16.714025+0000","last_became_peered":"2024-09-13T15:10:16.714025+0000","last_unstale":"2024-09-13T15:10:17.171738+0000","last_undegraded":"2024-09-13T15:10:17.171738+0000","last_fullsized":"2024-09-13T15:10:17.171738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535367+0000","last_change":"2024-09-13T15:10:17.193088+0000","last_active":"2024-09-13T15:10:18.535367+0000","last_peered":"2024-09-13T15:10:18.535367+0000","last_clean":"2024-09-13T15:10:18.535367+0000","last_became_active":"2024-09-13T15:10:17.192846+0000","last_became_peered":"2024-09-13T15:10:17.192846+0000","last_unstale":"2024-09-13T15:10:18.535367+0000","last_undegraded":"2024-09-13T15:10:18.535367+0000","last_fullsized":"2024-09-13T15:10:18.535367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:11.076932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.200614+0000","last_change":"2024-09-13T15:10:16.719888+0000","last_active":"2024-09-13T15:10:17.200614+0000","last_peered":"2024-09-13T15:10:17.200614+0000","last_clean":"2024-09-13T15:10:17.200614+0000","last_became_active":"2024-09-13T15:10:16.719466+0000","last_became_peered":"2024-09-13T15:10:16.719466+0000","last_unstale":"2024-09-13T15:10:17.200614+0000","last_undegraded":"2024-09-13T15:10:17.200614+0000","last_fullsized":"2024-09-13T15:10:17.200614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178144+0000","last_change":"2024-09-13T15:10:17.183352+0000","last_active":"2024-09-13T15:10:18.178144+0000","last_peered":"2024-09-13T15:10:18.178144+0000","last_clean":"2024-09-13T15:10:18.178144+0000","last_became_active":"2024-09-13T15:10:17.183093+0000","last_became_peered":"2024-09-13T15:10:17.183093+0000","last_unstale":"2024-09-13T15:10:18.178144+0000","last_undegraded":"2024-09-13T15:10:18.178144+0000","last_fullsized":"2024-09-13T15:10:18.178144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.215151+0000","last_change":"2024-09-13T15:10:16.724357+0000","last_active":"2024-09-13T15:10:17.215151+0000","last_peered":"2024-09-13T15:10:17.215151+0000","last_clean":"2024-09-13T15:10:17.215151+0000","last_became_active":"2024-09-13T15:10:16.724028+0000","last_became_peered":"2024-09-13T15:10:16.724028+0000","last_unstale":"2024-09-13T15:10:17.215151+0000","last_undegraded":"2024-09-13T15:10:17.215151+0000","last_fullsized":"2024-09-13T15:10:17.215151+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177197+0000","last_change":"2024-09-13T15:10:17.202982+0000","last_active":"2024-09-13T15:10:18.177197+0000","last_peered":"2024-09-13T15:10:18.177197+0000","last_clean":"2024-09-13T15:10:18.177197+0000","last_became_active":"2024-09-13T15:10:17.200848+0000","last_became_peered":"2024-09-13T15:10:17.200848+0000","last_unstale":"2024-09-13T15:10:18.177197+0000","last_undegraded":"2024-09-13T15:10:18.177197+0000","last_fullsized":"2024-09-13T15:10:18.177197+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.210221+0000","last_change":"2024-09-13T15:10:16.717794+0000","last_active":"2024-09-13T15:10:17.210221+0000","last_peered":"2024-09-13T15:10:17.210221+0000","last_clean":"2024-09-13T15:10:17.210221+0000","last_became_active":"2024-09-13T15:10:16.716747+0000","last_became_peered":"2024-09-13T15:10:16.716747+0000","last_unstale":"2024-09-13T15:10:17.210221+0000","last_undegraded":"2024-09-13T15:10:17.210221+0000","last_fullsized":"2024-09-13T15:10:17.210221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:10.062343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535814+0000","last_change":"2024-09-13T15:10:17.187593+0000","last_active":"2024-09-13T15:10:18.535814+0000","last_peered":"2024-09-13T15:10:18.535814+0000","last_clean":"2024-09-13T15:10:18.535814+0000","last_became_active":"2024-09-13T15:10:17.187306+0000","last_became_peered":"2024-09-13T15:10:17.187306+0000","last_unstale":"2024-09-13T15:10:18.535814+0000","last_undegraded":"2024-09-13T15:10:18.535814+0000","last_fullsized":"2024-09-13T15:10:18.535814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180887+0000","last_change":"2024-09-13T15:10:16.723590+0000","last_active":"2024-09-13T15:10:17.180887+0000","last_peered":"2024-09-13T15:10:17.180887+0000","last_clean":"2024-09-13T15:10:17.180887+0000","last_became_active":"2024-09-13T15:10:16.723308+0000","last_became_peered":"2024-09-13T15:10:16.723308+0000","last_unstale":"2024-09-13T15:10:17.180887+0000","last_undegraded":"2024-09-13T15:10:17.180887+0000","last_fullsized":"2024-09-13T15:10:17.180887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535023+0000","last_change":"2024-09-13T15:10:17.198296+0000","last_active":"2024-09-13T15:10:18.535023+0000","last_peered":"2024-09-13T15:10:18.535023+0000","last_clean":"2024-09-13T15:10:18.535023+0000","last_became_active":"2024-09-13T15:10:17.195215+0000","last_became_peered":"2024-09-13T15:10:17.195215+0000","last_unstale":"2024-09-13T15:10:18.535023+0000","last_undegraded":"2024-09-13T15:10:18.535023+0000","last_fullsized":"2024-09-13T15:10:18.535023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:02.612333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175297+0000","last_change":"2024-09-13T15:10:16.715229+0000","last_active":"2024-09-13T15:10:17.175297+0000","last_peered":"2024-09-13T15:10:17.175297+0000","last_clean":"2024-09-13T15:10:17.175297+0000","last_became_active":"2024-09-13T15:10:16.714554+0000","last_became_peered":"2024-09-13T15:10:16.714554+0000","last_unstale":"2024-09-13T15:10:17.175297+0000","last_undegraded":"2024-09-13T15:10:17.175297+0000","last_fullsized":"2024-09-13T15:10:17.175297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180515+0000","last_change":"2024-09-13T15:10:17.186836+0000","last_active":"2024-09-13T15:10:18.180515+0000","last_peered":"2024-09-13T15:10:18.180515+0000","last_clean":"2024-09-13T15:10:18.180515+0000","last_became_active":"2024-09-13T15:10:17.186559+0000","last_became_peered":"2024-09-13T15:10:17.186559+0000","last_unstale":"2024-09-13T15:10:18.180515+0000","last_undegraded":"2024-09-13T15:10:18.180515+0000","last_fullsized":"2024-09-13T15:10:18.180515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.213605+0000","last_change":"2024-09-13T15:10:16.721963+0000","last_active":"2024-09-13T15:10:17.213605+0000","last_peered":"2024-09-13T15:10:17.213605+0000","last_clean":"2024-09-13T15:10:17.213605+0000","last_became_active":"2024-09-13T15:10:16.721638+0000","last_became_peered":"2024-09-13T15:10:16.721638+0000","last_unstale":"2024-09-13T15:10:17.213605+0000","last_undegraded":"2024-09-13T15:10:17.213605+0000","last_fullsized":"2024-09-13T15:10:17.213605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:56.163813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536255+0000","last_change":"2024-09-13T15:10:17.191603+0000","last_active":"2024-09-13T15:10:18.536255+0000","last_peered":"2024-09-13T15:10:18.536255+0000","last_clean":"2024-09-13T15:10:18.536255+0000","last_became_active":"2024-09-13T15:10:17.190675+0000","last_became_peered":"2024-09-13T15:10:17.190675+0000","last_unstale":"2024-09-13T15:10:18.536255+0000","last_undegraded":"2024-09-13T15:10:18.536255+0000","last_fullsized":"2024-09-13T15:10:18.536255+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.197780+0000","last_change":"2024-09-13T15:10:16.720250+0000","last_active":"2024-09-13T15:10:17.197780+0000","last_peered":"2024-09-13T15:10:17.197780+0000","last_clean":"2024-09-13T15:10:17.197780+0000","last_became_active":"2024-09-13T15:10:16.719967+0000","last_became_peered":"2024-09-13T15:10:16.719967+0000","last_unstale":"2024-09-13T15:10:17.197780+0000","last_undegraded":"2024-09-13T15:10:17.197780+0000","last_fullsized":"2024-09-13T15:10:17.197780+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535871+0000","last_change":"2024-09-13T15:10:17.199556+0000","last_active":"2024-09-13T15:10:18.535871+0000","last_peered":"2024-09-13T15:10:18.535871+0000","last_clean":"2024-09-13T15:10:18.535871+0000","last_became_active":"2024-09-13T15:10:17.199326+0000","last_became_peered":"2024-09-13T15:10:17.199326+0000","last_unstale":"2024-09-13T15:10:18.535871+0000","last_undegraded":"2024-09-13T15:10:18.535871+0000","last_fullsized":"2024-09-13T15:10:18.535871+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.467817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.208469+0000","last_change":"2024-09-13T15:10:16.718824+0000","last_active":"2024-09-13T15:10:17.208469+0000","last_peered":"2024-09-13T15:10:17.208469+0000","last_clean":"2024-09-13T15:10:17.208469+0000","last_became_active":"2024-09-13T15:10:16.718512+0000","last_became_peered":"2024-09-13T15:10:16.718512+0000","last_unstale":"2024-09-13T15:10:17.208469+0000","last_undegraded":"2024-09-13T15:10:17.208469+0000","last_fullsized":"2024-09-13T15:10:17.208469+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:18.080317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177997+0000","last_change":"2024-09-13T15:10:17.205793+0000","last_active":"2024-09-13T15:10:18.177997+0000","last_peered":"2024-09-13T15:10:18.177997+0000","last_clean":"2024-09-13T15:10:18.177997+0000","last_became_active":"2024-09-13T15:10:17.205525+0000","last_became_peered":"2024-09-13T15:10:17.205525+0000","last_unstale":"2024-09-13T15:10:18.177997+0000","last_undegraded":"2024-09-13T15:10:18.177997+0000","last_fullsized":"2024-09-13T15:10:18.177997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.202940+0000","last_change":"2024-09-13T15:10:16.719630+0000","last_active":"2024-09-13T15:10:17.202940+0000","last_peered":"2024-09-13T15:10:17.202940+0000","last_clean":"2024-09-13T15:10:17.202940+0000","last_became_active":"2024-09-13T15:10:16.719389+0000","last_became_peered":"2024-09-13T15:10:16.719389+0000","last_unstale":"2024-09-13T15:10:17.202940+0000","last_undegraded":"2024-09-13T15:10:17.202940+0000","last_fullsized":"2024-09-13T15:10:17.202940+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535306+0000","last_change":"2024-09-13T15:10:17.194843+0000","last_active":"2024-09-13T15:10:18.535306+0000","last_peered":"2024-09-13T15:10:18.535306+0000","last_clean":"2024-09-13T15:10:18.535306+0000","last_became_active":"2024-09-13T15:10:17.194557+0000","last_became_peered":"2024-09-13T15:10:17.194557+0000","last_unstale":"2024-09-13T15:10:18.535306+0000","last_undegraded":"2024-09-13T15:10:18.535306+0000","last_fullsized":"2024-09-13T15:10:18.535306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:19.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.172239+0000","last_change":"2024-09-13T15:10:16.715308+0000","last_active":"2024-09-13T15:10:17.172239+0000","last_peered":"2024-09-13T15:10:17.172239+0000","last_clean":"2024-09-13T15:10:17.172239+0000","last_became_active":"2024-09-13T15:10:16.715012+0000","last_became_peered":"2024-09-13T15:10:16.715012+0000","last_unstale":"2024-09-13T15:10:17.172239+0000","last_undegraded":"2024-09-13T15:10:17.172239+0000","last_fullsized":"2024-09-13T15:10:17.172239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:39.966872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178164+0000","last_change":"2024-09-13T15:10:17.194739+0000","last_active":"2024-09-13T15:10:18.178164+0000","last_peered":"2024-09-13T15:10:18.178164+0000","last_clean":"2024-09-13T15:10:18.178164+0000","last_became_active":"2024-09-13T15:10:17.194456+0000","last_became_peered":"2024-09-13T15:10:17.194456+0000","last_unstale":"2024-09-13T15:10:18.178164+0000","last_undegraded":"2024-09-13T15:10:18.178164+0000","last_fullsized":"2024-09-13T15:10:18.178164+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:29.330066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.203298+0000","last_change":"2024-09-13T15:10:16.720073+0000","last_active":"2024-09-13T15:10:17.203298+0000","last_peered":"2024-09-13T15:10:17.203298+0000","last_clean":"2024-09-13T15:10:17.203298+0000","last_became_active":"2024-09-13T15:10:16.719809+0000","last_became_peered":"2024-09-13T15:10:16.719809+0000","last_unstale":"2024-09-13T15:10:17.203298+0000","last_undegraded":"2024-09-13T15:10:17.203298+0000","last_fullsized":"2024-09-13T15:10:17.203298+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:55.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535965+0000","last_change":"2024-09-13T15:10:17.191688+0000","last_active":"2024-09-13T15:10:18.535965+0000","last_peered":"2024-09-13T15:10:18.535965+0000","last_clean":"2024-09-13T15:10:18.535965+0000","last_became_active":"2024-09-13T15:10:17.191454+0000","last_became_peered":"2024-09-13T15:10:17.191454+0000","last_unstale":"2024-09-13T15:10:18.535965+0000","last_undegraded":"2024-09-13T15:10:18.535965+0000","last_fullsized":"2024-09-13T15:10:18.535965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180973+0000","last_change":"2024-09-13T15:10:16.725604+0000","last_active":"2024-09-13T15:10:17.180973+0000","last_peered":"2024-09-13T15:10:17.180973+0000","last_clean":"2024-09-13T15:10:17.180973+0000","last_became_active":"2024-09-13T15:10:16.723039+0000","last_became_peered":"2024-09-13T15:10:16.723039+0000","last_unstale":"2024-09-13T15:10:17.180973+0000","last_undegraded":"2024-09-13T15:10:17.180973+0000","last_fullsized":"2024-09-13T15:10:17.180973+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535127+0000","last_change":"2024-09-13T15:10:17.190028+0000","last_active":"2024-09-13T15:10:18.535127+0000","last_peered":"2024-09-13T15:10:18.535127+0000","last_clean":"2024-09-13T15:10:18.535127+0000","last_became_active":"2024-09-13T15:10:17.189538+0000","last_became_peered":"2024-09-13T15:10:17.189538+0000","last_unstale":"2024-09-13T15:10:18.535127+0000","last_undegraded":"2024-09-13T15:10:18.535127+0000","last_fullsized":"2024-09-13T15:10:18.535127+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:39.166189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175370+0000","last_change":"2024-09-13T15:10:16.715235+0000","last_active":"2024-09-13T15:10:17.175370+0000","last_peered":"2024-09-13T15:10:17.175370+0000","last_clean":"2024-09-13T15:10:17.175370+0000","last_became_active":"2024-09-13T15:10:16.714938+0000","last_became_peered":"2024-09-13T15:10:16.714938+0000","last_unstale":"2024-09-13T15:10:17.175370+0000","last_undegraded":"2024-09-13T15:10:17.175370+0000","last_fullsized":"2024-09-13T15:10:17.175370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:15.314017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178817+0000","last_change":"2024-09-13T15:10:17.188715+0000","last_active":"2024-09-13T15:10:18.178817+0000","last_peered":"2024-09-13T15:10:18.178817+0000","last_clean":"2024-09-13T15:10:18.178817+0000","last_became_active":"2024-09-13T15:10:17.188432+0000","last_became_peered":"2024-09-13T15:10:17.188432+0000","last_unstale":"2024-09-13T15:10:18.178817+0000","last_undegraded":"2024-09-13T15:10:18.178817+0000","last_fullsized":"2024-09-13T15:10:18.178817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:27.549247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.199504+0000","last_change":"2024-09-13T15:10:16.722014+0000","last_active":"2024-09-13T15:10:17.199504+0000","last_peered":"2024-09-13T15:10:17.199504+0000","last_clean":"2024-09-13T15:10:17.199504+0000","last_became_active":"2024-09-13T15:10:16.721762+0000","last_became_peered":"2024-09-13T15:10:16.721762+0000","last_unstale":"2024-09-13T15:10:17.199504+0000","last_undegraded":"2024-09-13T15:10:17.199504+0000","last_fullsized":"2024-09-13T15:10:17.199504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538473+0000","last_change":"2024-09-13T15:10:17.193040+0000","last_active":"2024-09-13T15:10:18.538473+0000","last_peered":"2024-09-13T15:10:18.538473+0000","last_clean":"2024-09-13T15:10:18.538473+0000","last_became_active":"2024-09-13T15:10:17.192576+0000","last_became_peered":"2024-09-13T15:10:17.192576+0000","last_unstale":"2024-09-13T15:10:18.538473+0000","last_undegraded":"2024-09-13T15:10:18.538473+0000","last_fullsized":"2024-09-13T15:10:18.538473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:44.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.182114+0000","last_change":"2024-09-13T15:10:16.717345+0000","last_active":"2024-09-13T15:10:17.182114+0000","last_peered":"2024-09-13T15:10:17.182114+0000","last_clean":"2024-09-13T15:10:17.182114+0000","last_became_active":"2024-09-13T15:10:16.716789+0000","last_became_peered":"2024-09-13T15:10:16.716789+0000","last_unstale":"2024-09-13T15:10:17.182114+0000","last_undegraded":"2024-09-13T15:10:17.182114+0000","last_fullsized":"2024-09-13T15:10:17.182114+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536780+0000","last_change":"2024-09-13T15:10:17.190911+0000","last_active":"2024-09-13T15:10:18.536780+0000","last_peered":"2024-09-13T15:10:18.536780+0000","last_clean":"2024-09-13T15:10:18.536780+0000","last_became_active":"2024-09-13T15:10:17.190628+0000","last_became_peered":"2024-09-13T15:10:17.190628+0000","last_unstale":"2024-09-13T15:10:18.536780+0000","last_undegraded":"2024-09-13T15:10:18.536780+0000","last_fullsized":"2024-09-13T15:10:18.536780+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.177766+0000","last_change":"2024-09-13T15:10:16.710257+0000","last_active":"2024-09-13T15:10:17.177766+0000","last_peered":"2024-09-13T15:10:17.177766+0000","last_clean":"2024-09-13T15:10:17.177766+0000","last_became_active":"2024-09-13T15:10:16.709898+0000","last_became_peered":"2024-09-13T15:10:16.709898+0000","last_unstale":"2024-09-13T15:10:17.177766+0000","last_undegraded":"2024-09-13T15:10:17.177766+0000","last_fullsized":"2024-09-13T15:10:17.177766+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535565+0000","last_change":"2024-09-13T15:10:17.194810+0000","last_active":"2024-09-13T15:10:18.535565+0000","last_peered":"2024-09-13T15:10:18.535565+0000","last_clean":"2024-09-13T15:10:18.535565+0000","last_became_active":"2024-09-13T15:10:17.194539+0000","last_became_peered":"2024-09-13T15:10:17.194539+0000","last_unstale":"2024-09-13T15:10:18.535565+0000","last_undegraded":"2024-09-13T15:10:18.535565+0000","last_fullsized":"2024-09-13T15:10:18.535565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:07.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180919+0000","last_change":"2024-09-13T15:10:16.721152+0000","last_active":"2024-09-13T15:10:17.180919+0000","last_peered":"2024-09-13T15:10:17.180919+0000","last_clean":"2024-09-13T15:10:17.180919+0000","last_became_active":"2024-09-13T15:10:16.720893+0000","last_became_peered":"2024-09-13T15:10:16.720893+0000","last_unstale":"2024-09-13T15:10:17.180919+0000","last_undegraded":"2024-09-13T15:10:17.180919+0000","last_fullsized":"2024-09-13T15:10:17.180919+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.534666+0000","last_change":"2024-09-13T15:10:17.201530+0000","last_active":"2024-09-13T15:10:18.534666+0000","last_peered":"2024-09-13T15:10:18.534666+0000","last_clean":"2024-09-13T15:10:18.534666+0000","last_became_active":"2024-09-13T15:10:17.201299+0000","last_became_peered":"2024-09-13T15:10:17.201299+0000","last_unstale":"2024-09-13T15:10:18.534666+0000","last_undegraded":"2024-09-13T15:10:18.534666+0000","last_fullsized":"2024-09-13T15:10:18.534666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:16.793342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175183+0000","last_change":"2024-09-13T15:10:16.718475+0000","last_active":"2024-09-13T15:10:17.175183+0000","last_peered":"2024-09-13T15:10:17.175183+0000","last_clean":"2024-09-13T15:10:17.175183+0000","last_became_active":"2024-09-13T15:10:16.717304+0000","last_became_peered":"2024-09-13T15:10:16.717304+0000","last_unstale":"2024-09-13T15:10:17.175183+0000","last_undegraded":"2024-09-13T15:10:17.175183+0000","last_fullsized":"2024-09-13T15:10:17.175183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:05.562203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177450+0000","last_change":"2024-09-13T15:10:17.182350+0000","last_active":"2024-09-13T15:10:18.177450+0000","last_peered":"2024-09-13T15:10:18.177450+0000","last_clean":"2024-09-13T15:10:18.177450+0000","last_became_active":"2024-09-13T15:10:17.182038+0000","last_became_peered":"2024-09-13T15:10:17.182038+0000","last_unstale":"2024-09-13T15:10:18.177450+0000","last_undegraded":"2024-09-13T15:10:18.177450+0000","last_fullsized":"2024-09-13T15:10:18.177450+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.170015+0000","last_change":"2024-09-13T15:10:16.723122+0000","last_active":"2024-09-13T15:10:17.170015+0000","last_peered":"2024-09-13T15:10:17.170015+0000","last_clean":"2024-09-13T15:10:17.170015+0000","last_became_active":"2024-09-13T15:10:16.722801+0000","last_became_peered":"2024-09-13T15:10:16.722801+0000","last_unstale":"2024-09-13T15:10:17.170015+0000","last_undegraded":"2024-09-13T15:10:17.170015+0000","last_fullsized":"2024-09-13T15:10:17.170015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:06.258415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180249+0000","last_change":"2024-09-13T15:10:17.190914+0000","last_active":"2024-09-13T15:10:18.180249+0000","last_peered":"2024-09-13T15:10:18.180249+0000","last_clean":"2024-09-13T15:10:18.180249+0000","last_became_active":"2024-09-13T15:10:17.189763+0000","last_became_peered":"2024-09-13T15:10:17.189763+0000","last_unstale":"2024-09-13T15:10:18.180249+0000","last_undegraded":"2024-09-13T15:10:18.180249+0000","last_fullsized":"2024-09-13T15:10:18.180249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.169265+0000","last_change":"2024-09-13T15:10:16.718984+0000","last_active":"2024-09-13T15:10:17.169265+0000","last_peered":"2024-09-13T15:10:17.169265+0000","last_clean":"2024-09-13T15:10:17.169265+0000","last_became_active":"2024-09-13T15:10:16.718277+0000","last_became_peered":"2024-09-13T15:10:16.718277+0000","last_unstale":"2024-09-13T15:10:17.169265+0000","last_undegraded":"2024-09-13T15:10:17.169265+0000","last_fullsized":"2024-09-13T15:10:17.169265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.520994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538251+0000","last_change":"2024-09-13T15:10:17.196409+0000","last_active":"2024-09-13T15:10:18.538251+0000","last_peered":"2024-09-13T15:10:18.538251+0000","last_clean":"2024-09-13T15:10:18.538251+0000","last_became_active":"2024-09-13T15:10:17.195448+0000","last_became_peered":"2024-09-13T15:10:17.195448+0000","last_unstale":"2024-09-13T15:10:18.538251+0000","last_undegraded":"2024-09-13T15:10:18.538251+0000","last_fullsized":"2024-09-13T15:10:18.538251+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:26.389420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.178440+0000","last_change":"2024-09-13T15:10:16.723730+0000","last_active":"2024-09-13T15:10:17.178440+0000","last_peered":"2024-09-13T15:10:17.178440+0000","last_clean":"2024-09-13T15:10:17.178440+0000","last_became_active":"2024-09-13T15:10:16.723462+0000","last_became_peered":"2024-09-13T15:10:16.723462+0000","last_unstale":"2024-09-13T15:10:17.178440+0000","last_undegraded":"2024-09-13T15:10:17.178440+0000","last_fullsized":"2024-09-13T15:10:17.178440+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535484+0000","last_change":"2024-09-13T15:10:17.200483+0000","last_active":"2024-09-13T15:10:18.535484+0000","last_peered":"2024-09-13T15:10:18.535484+0000","last_clean":"2024-09-13T15:10:18.535484+0000","last_became_active":"2024-09-13T15:10:17.199997+0000","last_became_peered":"2024-09-13T15:10:17.199997+0000","last_unstale":"2024-09-13T15:10:18.535484+0000","last_undegraded":"2024-09-13T15:10:18.535484+0000","last_fullsized":"2024-09-13T15:10:18.535484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:00.119884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.168663+0000","last_change":"2024-09-13T15:10:16.705139+0000","last_active":"2024-09-13T15:10:17.168663+0000","last_peered":"2024-09-13T15:10:17.168663+0000","last_clean":"2024-09-13T15:10:17.168663+0000","last_became_active":"2024-09-13T15:10:16.704815+0000","last_became_peered":"2024-09-13T15:10:16.704815+0000","last_unstale":"2024-09-13T15:10:17.168663+0000","last_undegraded":"2024-09-13T15:10:17.168663+0000","last_fullsized":"2024-09-13T15:10:17.168663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:25.413033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175308+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:17.175308+0000","last_peered":"2024-09-13T15:10:17.175308+0000","last_clean":"2024-09-13T15:10:17.175308+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:17.175308+0000","last_undegraded":"2024-09-13T15:10:17.175308+0000","last_fullsized":"2024-09-13T15:10:17.175308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1396736,"data_stored":942581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.123}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":1.357}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.377},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.4790000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.27},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.171}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.304}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.22},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.427}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":350452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.157}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":1.1839999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.238},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":1.2170000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.284}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.258}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.1220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":351459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.153},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.3120000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.544},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.5900000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.181}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":353001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1739999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.411},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":1.272}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.341}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.218},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.524}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.462}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":1.472}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.381},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.601}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":350418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.012}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.88600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.151},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.3600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.2},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.226}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.4810000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":786432,"data_stored":351437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":1.042},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":1.127}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.276},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2270000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.097},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.026},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.175}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.2470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":815104,"data_stored":353765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.94399999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":1.321},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":1.0680000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.389}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.157},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":1.4279999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.363},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.4610000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1376256,"data_stored":940786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.232}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.036},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.139}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":1.528}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.627}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.331},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.2769999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.708},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.4359999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.651},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.181}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:26.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.634+0000 7fc7a1400700 1 Processor -- start 2024-09-13T15:10:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.634+0000 7fc7a1400700 1 -- start start 2024-09-13T15:10:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a1400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c06aaa0 0x7fc79c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc79c0b2670 0x7fc79c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a1400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0b3040 con 0x7fc79c1610b0 2024-09-13T15:10:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a1400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c070b30 con 0x7fc79c0b2670 2024-09-13T15:10:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a1400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0b3560 con 0x7fc79c06aaa0 2024-09-13T15:10:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc79be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc79c1610b0 0x7fc79c0719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42166/0 (socket says 172.21.15.50:42166) 2024-09-13T15:10:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc79be00700 1 -- 172.21.15.50:0/4074835566 learned_addr learned my addr 172.21.15.50:0/4074835566 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc79b400700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c06aaa0 0x7fc79c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a0a00700 1 --2- 172.21.15.50:0/4074835566 >> v2:172.21.15.50:3300/0 conn(0x7fc79c0b2670 0x7fc79c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc79aa00700 1 -- 172.21.15.50:0/4074835566 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403158592 0 0) 0x7fc78c001110 con 0x7fc79c1610b0 2024-09-13T15:10:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a0a00700 1 -- 172.21.15.50:0/4074835566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c06aaa0 msgr2=0x7fc79c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a0a00700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c06aaa0 0x7fc79c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a0a00700 1 -- 172.21.15.50:0/4074835566 >> v1:172.21.15.50:6789/0 conn(0x7fc79c1610b0 legacy=0x7fc79c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc7a0a00700 1 -- 172.21.15.50:0/4074835566 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c06b420 con 0x7fc79c0b2670 2024-09-13T15:10:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.638+0000 7fc79b400700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c06aaa0 0x7fc79c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a0a00700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c0b2b00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc794009d90 tx=0x7fc79400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9e92a068e1453a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc79aa00700 1 -- 172.21.15.50:0/4074835566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400e070 con 0x7fc79c0b2670 2024-09-13T15:10:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc79aa00700 1 -- 172.21.15.50:0/4074835566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400bb20 con 0x7fc79c0b2670 2024-09-13T15:10:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc79aa00700 1 -- 172.21.15.50:0/4074835566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794012430 con 0x7fc79c0b2670 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 -- 172.21.15.50:0/4074835566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 msgr2=0x7fc79c0b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c0b2b00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc794009d90 tx=0x7fc79400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 -- 172.21.15.50:0/4074835566 shutdown_connections 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c0b2b00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 --2- 172.21.15.50:0/4074835566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c06aaa0 0x7fc79c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 -- 172.21.15.50:0/4074835566 >> 172.21.15.50:0/4074835566 conn(0x7fc79c0b0c40 msgr2=0x7fc79c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 -- 172.21.15.50:0/4074835566 shutdown_connections 2024-09-13T15:10:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.642+0000 7fc7a1400700 1 -- 172.21.15.50:0/4074835566 wait complete. 2024-09-13T15:10:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 Processor -- start 2024-09-13T15:10:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 -- start start 2024-09-13T15:10:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc79c06aaa0 0x7fc79c164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c1610b0 0x7fc79c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0cd680 con 0x7fc79c0b2670 2024-09-13T15:10:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0cc780 con 0x7fc79c06aaa0 2024-09-13T15:10:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a1400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0cca00 con 0x7fc79c1610b0 2024-09-13T15:10:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c14c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42220/0 (socket says 172.21.15.50:42220) 2024-09-13T15:10:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 -- 172.21.15.50:0/3065644672 learned_addr learned my addr 172.21.15.50:0/3065644672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:26.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79be00700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc79c06aaa0 0x7fc79c164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:26.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc7a0a00700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c1610b0 0x7fc79c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 -- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c1610b0 msgr2=0x7fc79c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c1610b0 0x7fc79c158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 -- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc79c06aaa0 msgr2=0x7fc79c164410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc79c06aaa0 0x7fc79c164410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.646+0000 7fc79b400700 1 -- 172.21.15.50:0/3065644672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880094b0 con 0x7fc79c0b2670 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc79b400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c14c940 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc78800ec10 tx=0x7fc78800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800c850 con 0x7fc79c0b2670 2024-09-13T15:10:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800c9b0 con 0x7fc79c0b2670 2024-09-13T15:10:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc794009a70 con 0x7fc79c0b2670 2024-09-13T15:10:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800cd40 con 0x7fc79c0b2670 2024-09-13T15:10:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c0ccfc0 con 0x7fc79c0b2670 2024-09-13T15:10:26.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.650+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c161490 con 0x7fc79c0b2670 2024-09-13T15:10:26.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.654+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc788013470 con 0x7fc79c0b2670 2024-09-13T15:10:26.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.654+0000 7fc793e00700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc77c066730 0x7fc77c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:26.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.654+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc7880846e0 con 0x7fc79c0b2670 2024-09-13T15:10:26.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.654+0000 7fc79be00700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc77c066730 0x7fc77c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:26.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.658+0000 7fc79be00700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc77c066730 0x7fc77c068bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000f60 tx=0x7fc78c007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.658+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc788051870 con 0x7fc79c0b2670 2024-09-13T15:10:26.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.846+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc79c0cd7c0 con 0x7fc77c066730 2024-09-13T15:10:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.866+0000 7fc793e00700 1 -- 172.21.15.50:0/3065644672 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286546 (secure 0 0 0) 0x7fc79c0cd7c0 con 0x7fc77c066730 2024-09-13T15:10:26.875 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc77c066730 msgr2=0x7fc77c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc77c066730 0x7fc77c068bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000f60 tx=0x7fc78c007e90 comp rx=0 tx=0).stop 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 msgr2=0x7fc79c14c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c14c940 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc78800ec10 tx=0x7fc78800ef20 comp rx=0 tx=0).stop 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 shutdown_connections 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc77c066730 0x7fc77c068bf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc79c1610b0 0x7fc79c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc79c0b2670 0x7fc79c14c940 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 --2- 172.21.15.50:0/3065644672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc79c06aaa0 0x7fc79c164410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 >> 172.21.15.50:0/3065644672 conn(0x7fc79c0b0c40 msgr2=0x7fc79c06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 shutdown_connections 2024-09-13T15:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:26.870+0000 7fc7a1400700 1 -- 172.21.15.50:0/3065644672 wait complete. 2024-09-13T15:10:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:26.897 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-13T15:10:26.069233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239952,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734768,"statfs":{"total":773094113280,"available":772848402432,"internally_reserved":0,"allocated":7532544,"data_stored":3993899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.903347"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180961+0000","last_change":"2024-09-13T15:10:17.191018+0000","last_active":"2024-09-13T15:10:18.180961+0000","last_peered":"2024-09-13T15:10:18.180961+0000","last_clean":"2024-09-13T15:10:18.180961+0000","last_became_active":"2024-09-13T15:10:17.190112+0000","last_became_peered":"2024-09-13T15:10:17.190112+0000","last_unstale":"2024-09-13T15:10:18.180961+0000","last_undegraded":"2024-09-13T15:10:18.180961+0000","last_fullsized":"2024-09-13T15:10:18.180961+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180798+0000","last_change":"2024-09-13T15:10:17.193381+0000","last_active":"2024-09-13T15:10:18.180798+0000","last_peered":"2024-09-13T15:10:18.180798+0000","last_clean":"2024-09-13T15:10:18.180798+0000","last_became_active":"2024-09-13T15:10:17.193146+0000","last_became_peered":"2024-09-13T15:10:17.193146+0000","last_unstale":"2024-09-13T15:10:18.180798+0000","last_undegraded":"2024-09-13T15:10:18.180798+0000","last_fullsized":"2024-09-13T15:10:18.180798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:25.507760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536338+0000","last_change":"2024-09-13T15:10:17.194055+0000","last_active":"2024-09-13T15:10:18.536338+0000","last_peered":"2024-09-13T15:10:18.536338+0000","last_clean":"2024-09-13T15:10:18.536338+0000","last_became_active":"2024-09-13T15:10:17.193816+0000","last_became_peered":"2024-09-13T15:10:17.193816+0000","last_unstale":"2024-09-13T15:10:18.536338+0000","last_undegraded":"2024-09-13T15:10:18.536338+0000","last_fullsized":"2024-09-13T15:10:18.536338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177721+0000","last_change":"2024-09-13T15:10:17.203227+0000","last_active":"2024-09-13T15:10:18.177721+0000","last_peered":"2024-09-13T15:10:18.177721+0000","last_clean":"2024-09-13T15:10:18.177721+0000","last_became_active":"2024-09-13T15:10:17.190454+0000","last_became_peered":"2024-09-13T15:10:17.190454+0000","last_unstale":"2024-09-13T15:10:18.177721+0000","last_undegraded":"2024-09-13T15:10:18.177721+0000","last_fullsized":"2024-09-13T15:10:18.177721+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:13.993446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535314+0000","last_change":"2024-09-13T15:10:17.200628+0000","last_active":"2024-09-13T15:10:18.535314+0000","last_peered":"2024-09-13T15:10:18.535314+0000","last_clean":"2024-09-13T15:10:18.535314+0000","last_became_active":"2024-09-13T15:10:17.200246+0000","last_became_peered":"2024-09-13T15:10:17.200246+0000","last_unstale":"2024-09-13T15:10:18.535314+0000","last_undegraded":"2024-09-13T15:10:18.535314+0000","last_fullsized":"2024-09-13T15:10:18.535314+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:02.121949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178437+0000","last_change":"2024-09-13T15:10:17.199455+0000","last_active":"2024-09-13T15:10:18.178437+0000","last_peered":"2024-09-13T15:10:18.178437+0000","last_clean":"2024-09-13T15:10:18.178437+0000","last_became_active":"2024-09-13T15:10:17.198918+0000","last_became_peered":"2024-09-13T15:10:17.198918+0000","last_unstale":"2024-09-13T15:10:18.178437+0000","last_undegraded":"2024-09-13T15:10:18.178437+0000","last_fullsized":"2024-09-13T15:10:18.178437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:23.725734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538325+0000","last_change":"2024-09-13T15:10:17.197839+0000","last_active":"2024-09-13T15:10:18.538325+0000","last_peered":"2024-09-13T15:10:18.538325+0000","last_clean":"2024-09-13T15:10:18.538325+0000","last_became_active":"2024-09-13T15:10:17.197605+0000","last_became_peered":"2024-09-13T15:10:17.197605+0000","last_unstale":"2024-09-13T15:10:18.538325+0000","last_undegraded":"2024-09-13T15:10:18.538325+0000","last_fullsized":"2024-09-13T15:10:18.538325+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:44.589350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536861+0000","last_change":"2024-09-13T15:10:17.195877+0000","last_active":"2024-09-13T15:10:18.536861+0000","last_peered":"2024-09-13T15:10:18.536861+0000","last_clean":"2024-09-13T15:10:18.536861+0000","last_became_active":"2024-09-13T15:10:17.195416+0000","last_became_peered":"2024-09-13T15:10:17.195416+0000","last_unstale":"2024-09-13T15:10:18.536861+0000","last_undegraded":"2024-09-13T15:10:18.536861+0000","last_fullsized":"2024-09-13T15:10:18.536861+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537069+0000","last_change":"2024-09-13T15:10:17.188990+0000","last_active":"2024-09-13T15:10:18.537069+0000","last_peered":"2024-09-13T15:10:18.537069+0000","last_clean":"2024-09-13T15:10:18.537069+0000","last_became_active":"2024-09-13T15:10:17.188726+0000","last_became_peered":"2024-09-13T15:10:17.188726+0000","last_unstale":"2024-09-13T15:10:18.537069+0000","last_undegraded":"2024-09-13T15:10:18.537069+0000","last_fullsized":"2024-09-13T15:10:18.537069+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:35.298381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536589+0000","last_change":"2024-09-13T15:10:17.187840+0000","last_active":"2024-09-13T15:10:18.536589+0000","last_peered":"2024-09-13T15:10:18.536589+0000","last_clean":"2024-09-13T15:10:18.536589+0000","last_became_active":"2024-09-13T15:10:17.187522+0000","last_became_peered":"2024-09-13T15:10:17.187522+0000","last_unstale":"2024-09-13T15:10:18.536589+0000","last_undegraded":"2024-09-13T15:10:18.536589+0000","last_fullsized":"2024-09-13T15:10:18.536589+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:09.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177855+0000","last_change":"2024-09-13T15:10:17.188709+0000","last_active":"2024-09-13T15:10:18.177855+0000","last_peered":"2024-09-13T15:10:18.177855+0000","last_clean":"2024-09-13T15:10:18.177855+0000","last_became_active":"2024-09-13T15:10:17.188198+0000","last_became_peered":"2024-09-13T15:10:17.188198+0000","last_unstale":"2024-09-13T15:10:18.177855+0000","last_undegraded":"2024-09-13T15:10:18.177855+0000","last_fullsized":"2024-09-13T15:10:18.177855+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535876+0000","last_change":"2024-09-13T15:10:17.199667+0000","last_active":"2024-09-13T15:10:18.535876+0000","last_peered":"2024-09-13T15:10:18.535876+0000","last_clean":"2024-09-13T15:10:18.535876+0000","last_became_active":"2024-09-13T15:10:17.199404+0000","last_became_peered":"2024-09-13T15:10:17.199404+0000","last_unstale":"2024-09-13T15:10:18.535876+0000","last_undegraded":"2024-09-13T15:10:18.535876+0000","last_fullsized":"2024-09-13T15:10:18.535876+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:09.421829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537060+0000","last_change":"2024-09-13T15:10:17.187672+0000","last_active":"2024-09-13T15:10:18.537060+0000","last_peered":"2024-09-13T15:10:18.537060+0000","last_clean":"2024-09-13T15:10:18.537060+0000","last_became_active":"2024-09-13T15:10:17.187361+0000","last_became_peered":"2024-09-13T15:10:17.187361+0000","last_unstale":"2024-09-13T15:10:18.537060+0000","last_undegraded":"2024-09-13T15:10:18.537060+0000","last_fullsized":"2024-09-13T15:10:18.537060+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536420+0000","last_change":"2024-09-13T15:10:17.193361+0000","last_active":"2024-09-13T15:10:18.536420+0000","last_peered":"2024-09-13T15:10:18.536420+0000","last_clean":"2024-09-13T15:10:18.536420+0000","last_became_active":"2024-09-13T15:10:17.193093+0000","last_became_peered":"2024-09-13T15:10:17.193093+0000","last_unstale":"2024-09-13T15:10:18.536420+0000","last_undegraded":"2024-09-13T15:10:18.536420+0000","last_fullsized":"2024-09-13T15:10:18.536420+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537652+0000","last_change":"2024-09-13T15:10:17.192179+0000","last_active":"2024-09-13T15:10:18.537652+0000","last_peered":"2024-09-13T15:10:18.537652+0000","last_clean":"2024-09-13T15:10:18.537652+0000","last_became_active":"2024-09-13T15:10:17.191941+0000","last_became_peered":"2024-09-13T15:10:17.191941+0000","last_unstale":"2024-09-13T15:10:18.537652+0000","last_undegraded":"2024-09-13T15:10:18.537652+0000","last_fullsized":"2024-09-13T15:10:18.537652+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:26.770391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537926+0000","last_change":"2024-09-13T15:10:17.192915+0000","last_active":"2024-09-13T15:10:18.537926+0000","last_peered":"2024-09-13T15:10:18.537926+0000","last_clean":"2024-09-13T15:10:18.537926+0000","last_became_active":"2024-09-13T15:10:17.190889+0000","last_became_peered":"2024-09-13T15:10:17.190889+0000","last_unstale":"2024-09-13T15:10:18.537926+0000","last_undegraded":"2024-09-13T15:10:18.537926+0000","last_fullsized":"2024-09-13T15:10:18.537926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:13.258712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180991+0000","last_change":"2024-09-13T15:10:17.191793+0000","last_active":"2024-09-13T15:10:18.180991+0000","last_peered":"2024-09-13T15:10:18.180991+0000","last_clean":"2024-09-13T15:10:18.180991+0000","last_became_active":"2024-09-13T15:10:17.191530+0000","last_became_peered":"2024-09-13T15:10:17.191530+0000","last_unstale":"2024-09-13T15:10:18.180991+0000","last_undegraded":"2024-09-13T15:10:18.180991+0000","last_fullsized":"2024-09-13T15:10:18.180991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178031+0000","last_change":"2024-09-13T15:10:17.186406+0000","last_active":"2024-09-13T15:10:18.178031+0000","last_peered":"2024-09-13T15:10:18.178031+0000","last_clean":"2024-09-13T15:10:18.178031+0000","last_became_active":"2024-09-13T15:10:17.186142+0000","last_became_peered":"2024-09-13T15:10:17.186142+0000","last_unstale":"2024-09-13T15:10:18.178031+0000","last_undegraded":"2024-09-13T15:10:18.178031+0000","last_fullsized":"2024-09-13T15:10:18.178031+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:32.544997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536997+0000","last_change":"2024-09-13T15:10:17.197611+0000","last_active":"2024-09-13T15:10:18.536997+0000","last_peered":"2024-09-13T15:10:18.536997+0000","last_clean":"2024-09-13T15:10:18.536997+0000","last_became_active":"2024-09-13T15:10:17.193825+0000","last_became_peered":"2024-09-13T15:10:17.193825+0000","last_unstale":"2024-09-13T15:10:18.536997+0000","last_undegraded":"2024-09-13T15:10:18.536997+0000","last_fullsized":"2024-09-13T15:10:18.536997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:05.539046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537839+0000","last_change":"2024-09-13T15:10:17.202035+0000","last_active":"2024-09-13T15:10:18.537839+0000","last_peered":"2024-09-13T15:10:18.537839+0000","last_clean":"2024-09-13T15:10:18.537839+0000","last_became_active":"2024-09-13T15:10:17.201739+0000","last_became_peered":"2024-09-13T15:10:17.201739+0000","last_unstale":"2024-09-13T15:10:18.537839+0000","last_undegraded":"2024-09-13T15:10:18.537839+0000","last_fullsized":"2024-09-13T15:10:18.537839+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537169+0000","last_change":"2024-09-13T15:10:17.197262+0000","last_active":"2024-09-13T15:10:18.537169+0000","last_peered":"2024-09-13T15:10:18.537169+0000","last_clean":"2024-09-13T15:10:18.537169+0000","last_became_active":"2024-09-13T15:10:17.192009+0000","last_became_peered":"2024-09-13T15:10:17.192009+0000","last_unstale":"2024-09-13T15:10:18.537169+0000","last_undegraded":"2024-09-13T15:10:18.537169+0000","last_fullsized":"2024-09-13T15:10:18.537169+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:31.641260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537403+0000","last_change":"2024-09-13T15:10:17.182131+0000","last_active":"2024-09-13T15:10:18.537403+0000","last_peered":"2024-09-13T15:10:18.537403+0000","last_clean":"2024-09-13T15:10:18.537403+0000","last_became_active":"2024-09-13T15:10:17.181882+0000","last_became_peered":"2024-09-13T15:10:17.181882+0000","last_unstale":"2024-09-13T15:10:18.537403+0000","last_undegraded":"2024-09-13T15:10:18.537403+0000","last_fullsized":"2024-09-13T15:10:18.537403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:13.460857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537258+0000","last_change":"2024-09-13T15:10:17.183417+0000","last_active":"2024-09-13T15:10:18.537258+0000","last_peered":"2024-09-13T15:10:18.537258+0000","last_clean":"2024-09-13T15:10:18.537258+0000","last_became_active":"2024-09-13T15:10:17.183143+0000","last_became_peered":"2024-09-13T15:10:17.183143+0000","last_unstale":"2024-09-13T15:10:18.537258+0000","last_undegraded":"2024-09-13T15:10:18.537258+0000","last_fullsized":"2024-09-13T15:10:18.537258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:58.938786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535630+0000","last_change":"2024-09-13T15:10:17.193630+0000","last_active":"2024-09-13T15:10:18.535630+0000","last_peered":"2024-09-13T15:10:18.535630+0000","last_clean":"2024-09-13T15:10:18.535630+0000","last_became_active":"2024-09-13T15:10:17.193262+0000","last_became_peered":"2024-09-13T15:10:17.193262+0000","last_unstale":"2024-09-13T15:10:18.535630+0000","last_undegraded":"2024-09-13T15:10:18.535630+0000","last_fullsized":"2024-09-13T15:10:18.535630+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.050905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536086+0000","last_change":"2024-09-13T15:10:17.190224+0000","last_active":"2024-09-13T15:10:18.536086+0000","last_peered":"2024-09-13T15:10:18.536086+0000","last_clean":"2024-09-13T15:10:18.536086+0000","last_became_active":"2024-09-13T15:10:17.189965+0000","last_became_peered":"2024-09-13T15:10:17.189965+0000","last_unstale":"2024-09-13T15:10:18.536086+0000","last_undegraded":"2024-09-13T15:10:18.536086+0000","last_fullsized":"2024-09-13T15:10:18.536086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536096+0000","last_change":"2024-09-13T15:10:17.193166+0000","last_active":"2024-09-13T15:10:18.536096+0000","last_peered":"2024-09-13T15:10:18.536096+0000","last_clean":"2024-09-13T15:10:18.536096+0000","last_became_active":"2024-09-13T15:10:17.192894+0000","last_became_peered":"2024-09-13T15:10:17.192894+0000","last_unstale":"2024-09-13T15:10:18.536096+0000","last_undegraded":"2024-09-13T15:10:18.536096+0000","last_fullsized":"2024-09-13T15:10:18.536096+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:03.629800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177912+0000","last_change":"2024-09-13T15:10:17.188450+0000","last_active":"2024-09-13T15:10:18.177912+0000","last_peered":"2024-09-13T15:10:18.177912+0000","last_clean":"2024-09-13T15:10:18.177912+0000","last_became_active":"2024-09-13T15:10:17.187741+0000","last_became_peered":"2024-09-13T15:10:17.187741+0000","last_unstale":"2024-09-13T15:10:18.177912+0000","last_undegraded":"2024-09-13T15:10:18.177912+0000","last_fullsized":"2024-09-13T15:10:18.177912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180508+0000","last_change":"2024-09-13T15:10:17.206071+0000","last_active":"2024-09-13T15:10:18.180508+0000","last_peered":"2024-09-13T15:10:18.180508+0000","last_clean":"2024-09-13T15:10:18.180508+0000","last_became_active":"2024-09-13T15:10:17.205546+0000","last_became_peered":"2024-09-13T15:10:17.205546+0000","last_unstale":"2024-09-13T15:10:18.180508+0000","last_undegraded":"2024-09-13T15:10:18.180508+0000","last_fullsized":"2024-09-13T15:10:18.180508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536491+0000","last_change":"2024-09-13T15:10:17.188795+0000","last_active":"2024-09-13T15:10:18.536491+0000","last_peered":"2024-09-13T15:10:18.536491+0000","last_clean":"2024-09-13T15:10:18.536491+0000","last_became_active":"2024-09-13T15:10:17.188513+0000","last_became_peered":"2024-09-13T15:10:17.188513+0000","last_unstale":"2024-09-13T15:10:18.536491+0000","last_undegraded":"2024-09-13T15:10:18.536491+0000","last_fullsized":"2024-09-13T15:10:18.536491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:35.740378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536876+0000","last_change":"2024-09-13T15:10:17.199032+0000","last_active":"2024-09-13T15:10:18.536876+0000","last_peered":"2024-09-13T15:10:18.536876+0000","last_clean":"2024-09-13T15:10:18.536876+0000","last_became_active":"2024-09-13T15:10:17.198807+0000","last_became_peered":"2024-09-13T15:10:17.198807+0000","last_unstale":"2024-09-13T15:10:18.536876+0000","last_undegraded":"2024-09-13T15:10:18.536876+0000","last_fullsized":"2024-09-13T15:10:18.536876+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:35.298381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177272+0000","last_change":"2024-09-13T15:10:17.198443+0000","last_active":"2024-09-13T15:10:18.177272+0000","last_peered":"2024-09-13T15:10:18.177272+0000","last_clean":"2024-09-13T15:10:18.177272+0000","last_became_active":"2024-09-13T15:10:17.198170+0000","last_became_peered":"2024-09-13T15:10:17.198170+0000","last_unstale":"2024-09-13T15:10:18.177272+0000","last_undegraded":"2024-09-13T15:10:18.177272+0000","last_fullsized":"2024-09-13T15:10:18.177272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:36.024595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178026+0000","last_change":"2024-09-13T15:10:17.195629+0000","last_active":"2024-09-13T15:10:18.178026+0000","last_peered":"2024-09-13T15:10:18.178026+0000","last_clean":"2024-09-13T15:10:18.178026+0000","last_became_active":"2024-09-13T15:10:17.195294+0000","last_became_peered":"2024-09-13T15:10:17.195294+0000","last_unstale":"2024-09-13T15:10:18.178026+0000","last_undegraded":"2024-09-13T15:10:18.178026+0000","last_fullsized":"2024-09-13T15:10:18.178026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:03.489256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535368+0000","last_change":"2024-09-13T15:10:17.201819+0000","last_active":"2024-09-13T15:10:18.535368+0000","last_peered":"2024-09-13T15:10:18.535368+0000","last_clean":"2024-09-13T15:10:18.535368+0000","last_became_active":"2024-09-13T15:10:17.199216+0000","last_became_peered":"2024-09-13T15:10:17.199216+0000","last_unstale":"2024-09-13T15:10:18.535368+0000","last_undegraded":"2024-09-13T15:10:18.535368+0000","last_fullsized":"2024-09-13T15:10:18.535368+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:25.158826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.201896+0000","last_change":"2024-09-13T15:10:16.721705+0000","last_active":"2024-09-13T15:10:17.201896+0000","last_peered":"2024-09-13T15:10:17.201896+0000","last_clean":"2024-09-13T15:10:17.201896+0000","last_became_active":"2024-09-13T15:10:16.721281+0000","last_became_peered":"2024-09-13T15:10:16.721281+0000","last_unstale":"2024-09-13T15:10:17.201896+0000","last_undegraded":"2024-09-13T15:10:17.201896+0000","last_fullsized":"2024-09-13T15:10:17.201896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177989+0000","last_change":"2024-09-13T15:10:17.203733+0000","last_active":"2024-09-13T15:10:18.177989+0000","last_peered":"2024-09-13T15:10:18.177989+0000","last_clean":"2024-09-13T15:10:18.177989+0000","last_became_active":"2024-09-13T15:10:17.203429+0000","last_became_peered":"2024-09-13T15:10:17.203429+0000","last_unstale":"2024-09-13T15:10:18.177989+0000","last_undegraded":"2024-09-13T15:10:18.177989+0000","last_fullsized":"2024-09-13T15:10:18.177989+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:25.507760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.205092+0000","last_change":"2024-09-13T15:10:16.717228+0000","last_active":"2024-09-13T15:10:17.205092+0000","last_peered":"2024-09-13T15:10:17.205092+0000","last_clean":"2024-09-13T15:10:17.205092+0000","last_became_active":"2024-09-13T15:10:16.715990+0000","last_became_peered":"2024-09-13T15:10:16.715990+0000","last_unstale":"2024-09-13T15:10:17.205092+0000","last_undegraded":"2024-09-13T15:10:17.205092+0000","last_fullsized":"2024-09-13T15:10:17.205092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:46.057647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178674+0000","last_change":"2024-09-13T15:10:17.187045+0000","last_active":"2024-09-13T15:10:18.178674+0000","last_peered":"2024-09-13T15:10:18.178674+0000","last_clean":"2024-09-13T15:10:18.178674+0000","last_became_active":"2024-09-13T15:10:17.186573+0000","last_became_peered":"2024-09-13T15:10:17.186573+0000","last_unstale":"2024-09-13T15:10:18.178674+0000","last_undegraded":"2024-09-13T15:10:18.178674+0000","last_fullsized":"2024-09-13T15:10:18.178674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.200786+0000","last_change":"2024-09-13T15:10:16.719972+0000","last_active":"2024-09-13T15:10:17.200786+0000","last_peered":"2024-09-13T15:10:17.200786+0000","last_clean":"2024-09-13T15:10:17.200786+0000","last_became_active":"2024-09-13T15:10:16.719471+0000","last_became_peered":"2024-09-13T15:10:16.719471+0000","last_unstale":"2024-09-13T15:10:17.200786+0000","last_undegraded":"2024-09-13T15:10:17.200786+0000","last_fullsized":"2024-09-13T15:10:17.200786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:00.677998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536910+0000","last_change":"2024-09-13T15:10:17.191538+0000","last_active":"2024-09-13T15:10:18.536910+0000","last_peered":"2024-09-13T15:10:18.536910+0000","last_clean":"2024-09-13T15:10:18.536910+0000","last_became_active":"2024-09-13T15:10:17.191303+0000","last_became_peered":"2024-09-13T15:10:17.191303+0000","last_unstale":"2024-09-13T15:10:18.536910+0000","last_undegraded":"2024-09-13T15:10:18.536910+0000","last_fullsized":"2024-09-13T15:10:18.536910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:03:31.641260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.199926+0000","last_change":"2024-09-13T15:10:16.718704+0000","last_active":"2024-09-13T15:10:17.199926+0000","last_peered":"2024-09-13T15:10:17.199926+0000","last_clean":"2024-09-13T15:10:17.199926+0000","last_became_active":"2024-09-13T15:10:16.718439+0000","last_became_peered":"2024-09-13T15:10:16.718439+0000","last_unstale":"2024-09-13T15:10:17.199926+0000","last_undegraded":"2024-09-13T15:10:17.199926+0000","last_fullsized":"2024-09-13T15:10:17.199926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537925+0000","last_change":"2024-09-13T15:10:17.193314+0000","last_active":"2024-09-13T15:10:18.537925+0000","last_peered":"2024-09-13T15:10:18.537925+0000","last_clean":"2024-09-13T15:10:18.537925+0000","last_became_active":"2024-09-13T15:10:17.192270+0000","last_became_peered":"2024-09-13T15:10:17.192270+0000","last_unstale":"2024-09-13T15:10:18.537925+0000","last_undegraded":"2024-09-13T15:10:18.537925+0000","last_fullsized":"2024-09-13T15:10:18.537925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:54.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.192364+0000","last_change":"2024-09-13T15:10:16.712118+0000","last_active":"2024-09-13T15:10:17.192364+0000","last_peered":"2024-09-13T15:10:17.192364+0000","last_clean":"2024-09-13T15:10:17.192364+0000","last_became_active":"2024-09-13T15:10:16.711865+0000","last_became_peered":"2024-09-13T15:10:16.711865+0000","last_unstale":"2024-09-13T15:10:17.192364+0000","last_undegraded":"2024-09-13T15:10:17.192364+0000","last_fullsized":"2024-09-13T15:10:17.192364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180307+0000","last_change":"2024-09-13T15:10:17.189438+0000","last_active":"2024-09-13T15:10:18.180307+0000","last_peered":"2024-09-13T15:10:18.180307+0000","last_clean":"2024-09-13T15:10:18.180307+0000","last_became_active":"2024-09-13T15:10:17.189194+0000","last_became_peered":"2024-09-13T15:10:17.189194+0000","last_unstale":"2024-09-13T15:10:18.180307+0000","last_undegraded":"2024-09-13T15:10:18.180307+0000","last_fullsized":"2024-09-13T15:10:18.180307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.192805+0000","last_change":"2024-09-13T15:10:16.705759+0000","last_active":"2024-09-13T15:10:17.192805+0000","last_peered":"2024-09-13T15:10:17.192805+0000","last_clean":"2024-09-13T15:10:17.192805+0000","last_became_active":"2024-09-13T15:10:16.705510+0000","last_became_peered":"2024-09-13T15:10:16.705510+0000","last_unstale":"2024-09-13T15:10:17.192805+0000","last_undegraded":"2024-09-13T15:10:17.192805+0000","last_fullsized":"2024-09-13T15:10:17.192805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:53.117052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.534970+0000","last_change":"2024-09-13T15:10:17.204609+0000","last_active":"2024-09-13T15:10:18.534970+0000","last_peered":"2024-09-13T15:10:18.534970+0000","last_clean":"2024-09-13T15:10:18.534970+0000","last_became_active":"2024-09-13T15:10:17.202396+0000","last_became_peered":"2024-09-13T15:10:17.202396+0000","last_unstale":"2024-09-13T15:10:18.534970+0000","last_undegraded":"2024-09-13T15:10:18.534970+0000","last_fullsized":"2024-09-13T15:10:18.534970+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.170456+0000","last_change":"2024-09-13T15:10:16.719164+0000","last_active":"2024-09-13T15:10:17.170456+0000","last_peered":"2024-09-13T15:10:17.170456+0000","last_clean":"2024-09-13T15:10:17.170456+0000","last_became_active":"2024-09-13T15:10:16.718753+0000","last_became_peered":"2024-09-13T15:10:16.718753+0000","last_unstale":"2024-09-13T15:10:17.170456+0000","last_undegraded":"2024-09-13T15:10:17.170456+0000","last_fullsized":"2024-09-13T15:10:17.170456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:14.741453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537506+0000","last_change":"2024-09-13T15:10:17.184382+0000","last_active":"2024-09-13T15:10:18.537506+0000","last_peered":"2024-09-13T15:10:18.537506+0000","last_clean":"2024-09-13T15:10:18.537506+0000","last_became_active":"2024-09-13T15:10:17.184204+0000","last_became_peered":"2024-09-13T15:10:17.184204+0000","last_unstale":"2024-09-13T15:10:18.537506+0000","last_undegraded":"2024-09-13T15:10:18.537506+0000","last_fullsized":"2024-09-13T15:10:18.537506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:28.703678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.188605+0000","last_change":"2024-09-13T15:10:16.723061+0000","last_active":"2024-09-13T15:10:17.188605+0000","last_peered":"2024-09-13T15:10:17.188605+0000","last_clean":"2024-09-13T15:10:17.188605+0000","last_became_active":"2024-09-13T15:10:16.722791+0000","last_became_peered":"2024-09-13T15:10:16.722791+0000","last_unstale":"2024-09-13T15:10:17.188605+0000","last_undegraded":"2024-09-13T15:10:17.188605+0000","last_fullsized":"2024-09-13T15:10:17.188605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:37.686588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180719+0000","last_change":"2024-09-13T15:10:17.193939+0000","last_active":"2024-09-13T15:10:18.180719+0000","last_peered":"2024-09-13T15:10:18.180719+0000","last_clean":"2024-09-13T15:10:18.180719+0000","last_became_active":"2024-09-13T15:10:17.193516+0000","last_became_peered":"2024-09-13T15:10:17.193516+0000","last_unstale":"2024-09-13T15:10:18.180719+0000","last_undegraded":"2024-09-13T15:10:18.180719+0000","last_fullsized":"2024-09-13T15:10:18.180719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:13.993446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175902+0000","last_change":"2024-09-13T15:10:16.720368+0000","last_active":"2024-09-13T15:10:17.175902+0000","last_peered":"2024-09-13T15:10:17.175902+0000","last_clean":"2024-09-13T15:10:17.175902+0000","last_became_active":"2024-09-13T15:10:16.719736+0000","last_became_peered":"2024-09-13T15:10:16.719736+0000","last_unstale":"2024-09-13T15:10:17.175902+0000","last_undegraded":"2024-09-13T15:10:17.175902+0000","last_fullsized":"2024-09-13T15:10:17.175902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.537525+0000","last_change":"2024-09-13T15:10:17.189476+0000","last_active":"2024-09-13T15:10:18.537525+0000","last_peered":"2024-09-13T15:10:18.537525+0000","last_clean":"2024-09-13T15:10:18.537525+0000","last_became_active":"2024-09-13T15:10:17.189249+0000","last_became_peered":"2024-09-13T15:10:17.189249+0000","last_unstale":"2024-09-13T15:10:18.537525+0000","last_undegraded":"2024-09-13T15:10:18.537525+0000","last_fullsized":"2024-09-13T15:10:18.537525+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:59.772701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.171738+0000","last_change":"2024-09-13T15:10:16.714357+0000","last_active":"2024-09-13T15:10:17.171738+0000","last_peered":"2024-09-13T15:10:17.171738+0000","last_clean":"2024-09-13T15:10:17.171738+0000","last_became_active":"2024-09-13T15:10:16.714025+0000","last_became_peered":"2024-09-13T15:10:16.714025+0000","last_unstale":"2024-09-13T15:10:17.171738+0000","last_undegraded":"2024-09-13T15:10:17.171738+0000","last_fullsized":"2024-09-13T15:10:17.171738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535367+0000","last_change":"2024-09-13T15:10:17.193088+0000","last_active":"2024-09-13T15:10:18.535367+0000","last_peered":"2024-09-13T15:10:18.535367+0000","last_clean":"2024-09-13T15:10:18.535367+0000","last_became_active":"2024-09-13T15:10:17.192846+0000","last_became_peered":"2024-09-13T15:10:17.192846+0000","last_unstale":"2024-09-13T15:10:18.535367+0000","last_undegraded":"2024-09-13T15:10:18.535367+0000","last_fullsized":"2024-09-13T15:10:18.535367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:11.076932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.200614+0000","last_change":"2024-09-13T15:10:16.719888+0000","last_active":"2024-09-13T15:10:17.200614+0000","last_peered":"2024-09-13T15:10:17.200614+0000","last_clean":"2024-09-13T15:10:17.200614+0000","last_became_active":"2024-09-13T15:10:16.719466+0000","last_became_peered":"2024-09-13T15:10:16.719466+0000","last_unstale":"2024-09-13T15:10:17.200614+0000","last_undegraded":"2024-09-13T15:10:17.200614+0000","last_fullsized":"2024-09-13T15:10:17.200614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178144+0000","last_change":"2024-09-13T15:10:17.183352+0000","last_active":"2024-09-13T15:10:18.178144+0000","last_peered":"2024-09-13T15:10:18.178144+0000","last_clean":"2024-09-13T15:10:18.178144+0000","last_became_active":"2024-09-13T15:10:17.183093+0000","last_became_peered":"2024-09-13T15:10:17.183093+0000","last_unstale":"2024-09-13T15:10:18.178144+0000","last_undegraded":"2024-09-13T15:10:18.178144+0000","last_fullsized":"2024-09-13T15:10:18.178144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.215151+0000","last_change":"2024-09-13T15:10:16.724357+0000","last_active":"2024-09-13T15:10:17.215151+0000","last_peered":"2024-09-13T15:10:17.215151+0000","last_clean":"2024-09-13T15:10:17.215151+0000","last_became_active":"2024-09-13T15:10:16.724028+0000","last_became_peered":"2024-09-13T15:10:16.724028+0000","last_unstale":"2024-09-13T15:10:17.215151+0000","last_undegraded":"2024-09-13T15:10:17.215151+0000","last_fullsized":"2024-09-13T15:10:17.215151+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177197+0000","last_change":"2024-09-13T15:10:17.202982+0000","last_active":"2024-09-13T15:10:18.177197+0000","last_peered":"2024-09-13T15:10:18.177197+0000","last_clean":"2024-09-13T15:10:18.177197+0000","last_became_active":"2024-09-13T15:10:17.200848+0000","last_became_peered":"2024-09-13T15:10:17.200848+0000","last_unstale":"2024-09-13T15:10:18.177197+0000","last_undegraded":"2024-09-13T15:10:18.177197+0000","last_fullsized":"2024-09-13T15:10:18.177197+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.210221+0000","last_change":"2024-09-13T15:10:16.717794+0000","last_active":"2024-09-13T15:10:17.210221+0000","last_peered":"2024-09-13T15:10:17.210221+0000","last_clean":"2024-09-13T15:10:17.210221+0000","last_became_active":"2024-09-13T15:10:16.716747+0000","last_became_peered":"2024-09-13T15:10:16.716747+0000","last_unstale":"2024-09-13T15:10:17.210221+0000","last_undegraded":"2024-09-13T15:10:17.210221+0000","last_fullsized":"2024-09-13T15:10:17.210221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:10.062343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535814+0000","last_change":"2024-09-13T15:10:17.187593+0000","last_active":"2024-09-13T15:10:18.535814+0000","last_peered":"2024-09-13T15:10:18.535814+0000","last_clean":"2024-09-13T15:10:18.535814+0000","last_became_active":"2024-09-13T15:10:17.187306+0000","last_became_peered":"2024-09-13T15:10:17.187306+0000","last_unstale":"2024-09-13T15:10:18.535814+0000","last_undegraded":"2024-09-13T15:10:18.535814+0000","last_fullsized":"2024-09-13T15:10:18.535814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180887+0000","last_change":"2024-09-13T15:10:16.723590+0000","last_active":"2024-09-13T15:10:17.180887+0000","last_peered":"2024-09-13T15:10:17.180887+0000","last_clean":"2024-09-13T15:10:17.180887+0000","last_became_active":"2024-09-13T15:10:16.723308+0000","last_became_peered":"2024-09-13T15:10:16.723308+0000","last_unstale":"2024-09-13T15:10:17.180887+0000","last_undegraded":"2024-09-13T15:10:17.180887+0000","last_fullsized":"2024-09-13T15:10:17.180887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535023+0000","last_change":"2024-09-13T15:10:17.198296+0000","last_active":"2024-09-13T15:10:18.535023+0000","last_peered":"2024-09-13T15:10:18.535023+0000","last_clean":"2024-09-13T15:10:18.535023+0000","last_became_active":"2024-09-13T15:10:17.195215+0000","last_became_peered":"2024-09-13T15:10:17.195215+0000","last_unstale":"2024-09-13T15:10:18.535023+0000","last_undegraded":"2024-09-13T15:10:18.535023+0000","last_fullsized":"2024-09-13T15:10:18.535023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:02.612333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175297+0000","last_change":"2024-09-13T15:10:16.715229+0000","last_active":"2024-09-13T15:10:17.175297+0000","last_peered":"2024-09-13T15:10:17.175297+0000","last_clean":"2024-09-13T15:10:17.175297+0000","last_became_active":"2024-09-13T15:10:16.714554+0000","last_became_peered":"2024-09-13T15:10:16.714554+0000","last_unstale":"2024-09-13T15:10:17.175297+0000","last_undegraded":"2024-09-13T15:10:17.175297+0000","last_fullsized":"2024-09-13T15:10:17.175297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180515+0000","last_change":"2024-09-13T15:10:17.186836+0000","last_active":"2024-09-13T15:10:18.180515+0000","last_peered":"2024-09-13T15:10:18.180515+0000","last_clean":"2024-09-13T15:10:18.180515+0000","last_became_active":"2024-09-13T15:10:17.186559+0000","last_became_peered":"2024-09-13T15:10:17.186559+0000","last_unstale":"2024-09-13T15:10:18.180515+0000","last_undegraded":"2024-09-13T15:10:18.180515+0000","last_fullsized":"2024-09-13T15:10:18.180515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.213605+0000","last_change":"2024-09-13T15:10:16.721963+0000","last_active":"2024-09-13T15:10:17.213605+0000","last_peered":"2024-09-13T15:10:17.213605+0000","last_clean":"2024-09-13T15:10:17.213605+0000","last_became_active":"2024-09-13T15:10:16.721638+0000","last_became_peered":"2024-09-13T15:10:16.721638+0000","last_unstale":"2024-09-13T15:10:17.213605+0000","last_undegraded":"2024-09-13T15:10:17.213605+0000","last_fullsized":"2024-09-13T15:10:17.213605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:56.163813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536255+0000","last_change":"2024-09-13T15:10:17.191603+0000","last_active":"2024-09-13T15:10:18.536255+0000","last_peered":"2024-09-13T15:10:18.536255+0000","last_clean":"2024-09-13T15:10:18.536255+0000","last_became_active":"2024-09-13T15:10:17.190675+0000","last_became_peered":"2024-09-13T15:10:17.190675+0000","last_unstale":"2024-09-13T15:10:18.536255+0000","last_undegraded":"2024-09-13T15:10:18.536255+0000","last_fullsized":"2024-09-13T15:10:18.536255+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.197780+0000","last_change":"2024-09-13T15:10:16.720250+0000","last_active":"2024-09-13T15:10:17.197780+0000","last_peered":"2024-09-13T15:10:17.197780+0000","last_clean":"2024-09-13T15:10:17.197780+0000","last_became_active":"2024-09-13T15:10:16.719967+0000","last_became_peered":"2024-09-13T15:10:16.719967+0000","last_unstale":"2024-09-13T15:10:17.197780+0000","last_undegraded":"2024-09-13T15:10:17.197780+0000","last_fullsized":"2024-09-13T15:10:17.197780+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:01.597744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535871+0000","last_change":"2024-09-13T15:10:17.199556+0000","last_active":"2024-09-13T15:10:18.535871+0000","last_peered":"2024-09-13T15:10:18.535871+0000","last_clean":"2024-09-13T15:10:18.535871+0000","last_became_active":"2024-09-13T15:10:17.199326+0000","last_became_peered":"2024-09-13T15:10:17.199326+0000","last_unstale":"2024-09-13T15:10:18.535871+0000","last_undegraded":"2024-09-13T15:10:18.535871+0000","last_fullsized":"2024-09-13T15:10:18.535871+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.467817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.208469+0000","last_change":"2024-09-13T15:10:16.718824+0000","last_active":"2024-09-13T15:10:17.208469+0000","last_peered":"2024-09-13T15:10:17.208469+0000","last_clean":"2024-09-13T15:10:17.208469+0000","last_became_active":"2024-09-13T15:10:16.718512+0000","last_became_peered":"2024-09-13T15:10:16.718512+0000","last_unstale":"2024-09-13T15:10:17.208469+0000","last_undegraded":"2024-09-13T15:10:17.208469+0000","last_fullsized":"2024-09-13T15:10:17.208469+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:18.080317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177997+0000","last_change":"2024-09-13T15:10:17.205793+0000","last_active":"2024-09-13T15:10:18.177997+0000","last_peered":"2024-09-13T15:10:18.177997+0000","last_clean":"2024-09-13T15:10:18.177997+0000","last_became_active":"2024-09-13T15:10:17.205525+0000","last_became_peered":"2024-09-13T15:10:17.205525+0000","last_unstale":"2024-09-13T15:10:18.177997+0000","last_undegraded":"2024-09-13T15:10:18.177997+0000","last_fullsized":"2024-09-13T15:10:18.177997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:51.461386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.202940+0000","last_change":"2024-09-13T15:10:16.719630+0000","last_active":"2024-09-13T15:10:17.202940+0000","last_peered":"2024-09-13T15:10:17.202940+0000","last_clean":"2024-09-13T15:10:17.202940+0000","last_became_active":"2024-09-13T15:10:16.719389+0000","last_became_peered":"2024-09-13T15:10:16.719389+0000","last_unstale":"2024-09-13T15:10:17.202940+0000","last_undegraded":"2024-09-13T15:10:17.202940+0000","last_fullsized":"2024-09-13T15:10:17.202940+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535306+0000","last_change":"2024-09-13T15:10:17.194843+0000","last_active":"2024-09-13T15:10:18.535306+0000","last_peered":"2024-09-13T15:10:18.535306+0000","last_clean":"2024-09-13T15:10:18.535306+0000","last_became_active":"2024-09-13T15:10:17.194557+0000","last_became_peered":"2024-09-13T15:10:17.194557+0000","last_unstale":"2024-09-13T15:10:18.535306+0000","last_undegraded":"2024-09-13T15:10:18.535306+0000","last_fullsized":"2024-09-13T15:10:18.535306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:01:19.094906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.172239+0000","last_change":"2024-09-13T15:10:16.715308+0000","last_active":"2024-09-13T15:10:17.172239+0000","last_peered":"2024-09-13T15:10:17.172239+0000","last_clean":"2024-09-13T15:10:17.172239+0000","last_became_active":"2024-09-13T15:10:16.715012+0000","last_became_peered":"2024-09-13T15:10:16.715012+0000","last_unstale":"2024-09-13T15:10:17.172239+0000","last_undegraded":"2024-09-13T15:10:17.172239+0000","last_fullsized":"2024-09-13T15:10:17.172239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:39.966872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178164+0000","last_change":"2024-09-13T15:10:17.194739+0000","last_active":"2024-09-13T15:10:18.178164+0000","last_peered":"2024-09-13T15:10:18.178164+0000","last_clean":"2024-09-13T15:10:18.178164+0000","last_became_active":"2024-09-13T15:10:17.194456+0000","last_became_peered":"2024-09-13T15:10:17.194456+0000","last_unstale":"2024-09-13T15:10:18.178164+0000","last_undegraded":"2024-09-13T15:10:18.178164+0000","last_fullsized":"2024-09-13T15:10:18.178164+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:29.330066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.203298+0000","last_change":"2024-09-13T15:10:16.720073+0000","last_active":"2024-09-13T15:10:17.203298+0000","last_peered":"2024-09-13T15:10:17.203298+0000","last_clean":"2024-09-13T15:10:17.203298+0000","last_became_active":"2024-09-13T15:10:16.719809+0000","last_became_peered":"2024-09-13T15:10:16.719809+0000","last_unstale":"2024-09-13T15:10:17.203298+0000","last_undegraded":"2024-09-13T15:10:17.203298+0000","last_fullsized":"2024-09-13T15:10:17.203298+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:55.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535965+0000","last_change":"2024-09-13T15:10:17.191688+0000","last_active":"2024-09-13T15:10:18.535965+0000","last_peered":"2024-09-13T15:10:18.535965+0000","last_clean":"2024-09-13T15:10:18.535965+0000","last_became_active":"2024-09-13T15:10:17.191454+0000","last_became_peered":"2024-09-13T15:10:17.191454+0000","last_unstale":"2024-09-13T15:10:18.535965+0000","last_undegraded":"2024-09-13T15:10:18.535965+0000","last_fullsized":"2024-09-13T15:10:18.535965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180973+0000","last_change":"2024-09-13T15:10:16.725604+0000","last_active":"2024-09-13T15:10:17.180973+0000","last_peered":"2024-09-13T15:10:17.180973+0000","last_clean":"2024-09-13T15:10:17.180973+0000","last_became_active":"2024-09-13T15:10:16.723039+0000","last_became_peered":"2024-09-13T15:10:16.723039+0000","last_unstale":"2024-09-13T15:10:17.180973+0000","last_undegraded":"2024-09-13T15:10:17.180973+0000","last_fullsized":"2024-09-13T15:10:17.180973+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:01.107360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535127+0000","last_change":"2024-09-13T15:10:17.190028+0000","last_active":"2024-09-13T15:10:18.535127+0000","last_peered":"2024-09-13T15:10:18.535127+0000","last_clean":"2024-09-13T15:10:18.535127+0000","last_became_active":"2024-09-13T15:10:17.189538+0000","last_became_peered":"2024-09-13T15:10:17.189538+0000","last_unstale":"2024-09-13T15:10:18.535127+0000","last_undegraded":"2024-09-13T15:10:18.535127+0000","last_fullsized":"2024-09-13T15:10:18.535127+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:39.166189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175370+0000","last_change":"2024-09-13T15:10:16.715235+0000","last_active":"2024-09-13T15:10:17.175370+0000","last_peered":"2024-09-13T15:10:17.175370+0000","last_clean":"2024-09-13T15:10:17.175370+0000","last_became_active":"2024-09-13T15:10:16.714938+0000","last_became_peered":"2024-09-13T15:10:16.714938+0000","last_unstale":"2024-09-13T15:10:17.175370+0000","last_undegraded":"2024-09-13T15:10:17.175370+0000","last_fullsized":"2024-09-13T15:10:17.175370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:15.314017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.178817+0000","last_change":"2024-09-13T15:10:17.188715+0000","last_active":"2024-09-13T15:10:18.178817+0000","last_peered":"2024-09-13T15:10:18.178817+0000","last_clean":"2024-09-13T15:10:18.178817+0000","last_became_active":"2024-09-13T15:10:17.188432+0000","last_became_peered":"2024-09-13T15:10:17.188432+0000","last_unstale":"2024-09-13T15:10:18.178817+0000","last_undegraded":"2024-09-13T15:10:18.178817+0000","last_fullsized":"2024-09-13T15:10:18.178817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:27.549247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.199504+0000","last_change":"2024-09-13T15:10:16.722014+0000","last_active":"2024-09-13T15:10:17.199504+0000","last_peered":"2024-09-13T15:10:17.199504+0000","last_clean":"2024-09-13T15:10:17.199504+0000","last_became_active":"2024-09-13T15:10:16.721762+0000","last_became_peered":"2024-09-13T15:10:16.721762+0000","last_unstale":"2024-09-13T15:10:17.199504+0000","last_undegraded":"2024-09-13T15:10:17.199504+0000","last_fullsized":"2024-09-13T15:10:17.199504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538473+0000","last_change":"2024-09-13T15:10:17.193040+0000","last_active":"2024-09-13T15:10:18.538473+0000","last_peered":"2024-09-13T15:10:18.538473+0000","last_clean":"2024-09-13T15:10:18.538473+0000","last_became_active":"2024-09-13T15:10:17.192576+0000","last_became_peered":"2024-09-13T15:10:17.192576+0000","last_unstale":"2024-09-13T15:10:18.538473+0000","last_undegraded":"2024-09-13T15:10:18.538473+0000","last_fullsized":"2024-09-13T15:10:18.538473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:44.656212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.182114+0000","last_change":"2024-09-13T15:10:16.717345+0000","last_active":"2024-09-13T15:10:17.182114+0000","last_peered":"2024-09-13T15:10:17.182114+0000","last_clean":"2024-09-13T15:10:17.182114+0000","last_became_active":"2024-09-13T15:10:16.716789+0000","last_became_peered":"2024-09-13T15:10:16.716789+0000","last_unstale":"2024-09-13T15:10:17.182114+0000","last_undegraded":"2024-09-13T15:10:17.182114+0000","last_fullsized":"2024-09-13T15:10:17.182114+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:06.065142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.536780+0000","last_change":"2024-09-13T15:10:17.190911+0000","last_active":"2024-09-13T15:10:18.536780+0000","last_peered":"2024-09-13T15:10:18.536780+0000","last_clean":"2024-09-13T15:10:18.536780+0000","last_became_active":"2024-09-13T15:10:17.190628+0000","last_became_peered":"2024-09-13T15:10:17.190628+0000","last_unstale":"2024-09-13T15:10:18.536780+0000","last_undegraded":"2024-09-13T15:10:18.536780+0000","last_fullsized":"2024-09-13T15:10:18.536780+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:32.630744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.177766+0000","last_change":"2024-09-13T15:10:16.710257+0000","last_active":"2024-09-13T15:10:17.177766+0000","last_peered":"2024-09-13T15:10:17.177766+0000","last_clean":"2024-09-13T15:10:17.177766+0000","last_became_active":"2024-09-13T15:10:16.709898+0000","last_became_peered":"2024-09-13T15:10:16.709898+0000","last_unstale":"2024-09-13T15:10:17.177766+0000","last_undegraded":"2024-09-13T15:10:17.177766+0000","last_fullsized":"2024-09-13T15:10:17.177766+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:43.638529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535565+0000","last_change":"2024-09-13T15:10:17.194810+0000","last_active":"2024-09-13T15:10:18.535565+0000","last_peered":"2024-09-13T15:10:18.535565+0000","last_clean":"2024-09-13T15:10:18.535565+0000","last_became_active":"2024-09-13T15:10:17.194539+0000","last_became_peered":"2024-09-13T15:10:17.194539+0000","last_unstale":"2024-09-13T15:10:18.535565+0000","last_undegraded":"2024-09-13T15:10:18.535565+0000","last_fullsized":"2024-09-13T15:10:18.535565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:07.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.180919+0000","last_change":"2024-09-13T15:10:16.721152+0000","last_active":"2024-09-13T15:10:17.180919+0000","last_peered":"2024-09-13T15:10:17.180919+0000","last_clean":"2024-09-13T15:10:17.180919+0000","last_became_active":"2024-09-13T15:10:16.720893+0000","last_became_peered":"2024-09-13T15:10:16.720893+0000","last_unstale":"2024-09-13T15:10:17.180919+0000","last_undegraded":"2024-09-13T15:10:17.180919+0000","last_fullsized":"2024-09-13T15:10:17.180919+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:24.144237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.534666+0000","last_change":"2024-09-13T15:10:17.201530+0000","last_active":"2024-09-13T15:10:18.534666+0000","last_peered":"2024-09-13T15:10:18.534666+0000","last_clean":"2024-09-13T15:10:18.534666+0000","last_became_active":"2024-09-13T15:10:17.201299+0000","last_became_peered":"2024-09-13T15:10:17.201299+0000","last_unstale":"2024-09-13T15:10:18.534666+0000","last_undegraded":"2024-09-13T15:10:18.534666+0000","last_fullsized":"2024-09-13T15:10:18.534666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:16.793342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175183+0000","last_change":"2024-09-13T15:10:16.718475+0000","last_active":"2024-09-13T15:10:17.175183+0000","last_peered":"2024-09-13T15:10:17.175183+0000","last_clean":"2024-09-13T15:10:17.175183+0000","last_became_active":"2024-09-13T15:10:16.717304+0000","last_became_peered":"2024-09-13T15:10:16.717304+0000","last_unstale":"2024-09-13T15:10:17.175183+0000","last_undegraded":"2024-09-13T15:10:17.175183+0000","last_fullsized":"2024-09-13T15:10:17.175183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:05.562203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.177450+0000","last_change":"2024-09-13T15:10:17.182350+0000","last_active":"2024-09-13T15:10:18.177450+0000","last_peered":"2024-09-13T15:10:18.177450+0000","last_clean":"2024-09-13T15:10:18.177450+0000","last_became_active":"2024-09-13T15:10:17.182038+0000","last_became_peered":"2024-09-13T15:10:17.182038+0000","last_unstale":"2024-09-13T15:10:18.177450+0000","last_undegraded":"2024-09-13T15:10:18.177450+0000","last_fullsized":"2024-09-13T15:10:18.177450+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:14.894989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.170015+0000","last_change":"2024-09-13T15:10:16.723122+0000","last_active":"2024-09-13T15:10:17.170015+0000","last_peered":"2024-09-13T15:10:17.170015+0000","last_clean":"2024-09-13T15:10:17.170015+0000","last_became_active":"2024-09-13T15:10:16.722801+0000","last_became_peered":"2024-09-13T15:10:16.722801+0000","last_unstale":"2024-09-13T15:10:17.170015+0000","last_undegraded":"2024-09-13T15:10:17.170015+0000","last_fullsized":"2024-09-13T15:10:17.170015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:06.258415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.180249+0000","last_change":"2024-09-13T15:10:17.190914+0000","last_active":"2024-09-13T15:10:18.180249+0000","last_peered":"2024-09-13T15:10:18.180249+0000","last_clean":"2024-09-13T15:10:18.180249+0000","last_became_active":"2024-09-13T15:10:17.189763+0000","last_became_peered":"2024-09-13T15:10:17.189763+0000","last_unstale":"2024-09-13T15:10:18.180249+0000","last_undegraded":"2024-09-13T15:10:18.180249+0000","last_fullsized":"2024-09-13T15:10:18.180249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:46.650926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.169265+0000","last_change":"2024-09-13T15:10:16.718984+0000","last_active":"2024-09-13T15:10:17.169265+0000","last_peered":"2024-09-13T15:10:17.169265+0000","last_clean":"2024-09-13T15:10:17.169265+0000","last_became_active":"2024-09-13T15:10:16.718277+0000","last_became_peered":"2024-09-13T15:10:16.718277+0000","last_unstale":"2024-09-13T15:10:17.169265+0000","last_undegraded":"2024-09-13T15:10:17.169265+0000","last_fullsized":"2024-09-13T15:10:17.169265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.520994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.538251+0000","last_change":"2024-09-13T15:10:17.196409+0000","last_active":"2024-09-13T15:10:18.538251+0000","last_peered":"2024-09-13T15:10:18.538251+0000","last_clean":"2024-09-13T15:10:18.538251+0000","last_became_active":"2024-09-13T15:10:17.195448+0000","last_became_peered":"2024-09-13T15:10:17.195448+0000","last_unstale":"2024-09-13T15:10:18.538251+0000","last_undegraded":"2024-09-13T15:10:18.538251+0000","last_fullsized":"2024-09-13T15:10:18.538251+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:26.389420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.178440+0000","last_change":"2024-09-13T15:10:16.723730+0000","last_active":"2024-09-13T15:10:17.178440+0000","last_peered":"2024-09-13T15:10:17.178440+0000","last_clean":"2024-09-13T15:10:17.178440+0000","last_became_active":"2024-09-13T15:10:16.723462+0000","last_became_peered":"2024-09-13T15:10:16.723462+0000","last_unstale":"2024-09-13T15:10:17.178440+0000","last_undegraded":"2024-09-13T15:10:17.178440+0000","last_fullsized":"2024-09-13T15:10:17.178440+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:15.778753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T15:10:18.535484+0000","last_change":"2024-09-13T15:10:17.200483+0000","last_active":"2024-09-13T15:10:18.535484+0000","last_peered":"2024-09-13T15:10:18.535484+0000","last_clean":"2024-09-13T15:10:18.535484+0000","last_became_active":"2024-09-13T15:10:17.199997+0000","last_became_peered":"2024-09-13T15:10:17.199997+0000","last_unstale":"2024-09-13T15:10:18.535484+0000","last_undegraded":"2024-09-13T15:10:18.535484+0000","last_fullsized":"2024-09-13T15:10:18.535484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:16.675788+0000","last_clean_scrub_stamp":"2024-09-13T15:10:16.675788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:00.119884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.168663+0000","last_change":"2024-09-13T15:10:16.705139+0000","last_active":"2024-09-13T15:10:17.168663+0000","last_peered":"2024-09-13T15:10:17.168663+0000","last_clean":"2024-09-13T15:10:17.168663+0000","last_became_active":"2024-09-13T15:10:16.704815+0000","last_became_peered":"2024-09-13T15:10:16.704815+0000","last_unstale":"2024-09-13T15:10:17.168663+0000","last_undegraded":"2024-09-13T15:10:17.168663+0000","last_fullsized":"2024-09-13T15:10:17.168663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:15.661199+0000","last_clean_scrub_stamp":"2024-09-13T15:10:15.661199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:25.413033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-13T15:10:17.175308+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:17.175308+0000","last_peered":"2024-09-13T15:10:17.175308+0000","last_clean":"2024-09-13T15:10:17.175308+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:17.175308+0000","last_undegraded":"2024-09-13T15:10:17.175308+0000","last_fullsized":"2024-09-13T15:10:17.175308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":1396736,"data_stored":942581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2849999999999999,"15min":1.292},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.53,"5min":1.839,"15min":1.839},"last":1.123}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.3580000000000001,"15min":1.3779999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8480000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.2390000000000001,"15min":1.2669999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.571,"5min":1.577,"15min":1.577},"last":1.357}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.367,"15min":1.403},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.4530000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.377},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3500000000000001,"15min":1.371},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.905,"5min":1.95,"15min":1.95},"last":1.4790000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.429,"15min":1.448},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.704,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.27},{"interface":"front","average":{"1min":1.347,"5min":1.5229999999999999,"15min":1.5529999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7350000000000001,"5min":2.081,"15min":2.081},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3600000000000001,"15min":1.393},"min":{"1min":0.81699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4630000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.802,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.171}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.5720000000000001,"15min":1.6100000000000001},"min":{"1min":1.0589999999999999,"5min":0.995,"15min":0.995},"max":{"1min":1.657,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.4770000000000001,"15min":1.522},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.657,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.304}]},{"osd":6,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.571,"15min":1.623},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.647,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.22},{"interface":"front","average":{"1min":1.462,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1359999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9099999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.427}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":350452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7889999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.165,"15min":1.171},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4399999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.157}]},{"osd":1,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.153,"15min":1.143},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.764,"5min":2.282,"15min":2.282},"last":1.1839999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2989999999999999,"15min":1.3089999999999999},"min":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5109999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.238},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8700000000000001,"5min":1.986,"15min":1.986},"last":1.2170000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.321,"15min":1.3260000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.853,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.373,"15min":1.401},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.639,"5min":2.371,"15min":2.371},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.399},"min":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.649,"5min":2.835,"15min":2.835},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.377,"15min":1.401},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.762,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.284}]},{"osd":5,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.337,"15min":1.3240000000000001},"min":{"1min":0.95899999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.9410000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.5980000000000001,"15min":1.6240000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":1.929,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.258}]},{"osd":7,"last update":"Fri Sep 13 15:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.458,"15min":1.46},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.0270000000000001,"5min":2.444,"15min":2.444},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.528,"5min":1.5629999999999999,"15min":1.569},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0419999999999998,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.1220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":351459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2769999999999999,"15min":1.3169999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2849999999999999,"5min":1.766,"15min":1.766},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.347,"15min":1.395},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1}]},{"osd":1,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2789999999999999,"15min":1.2949999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5700000000000001,"5min":1.976,"15min":1.976},"last":1.153},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.244,"15min":1.2689999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.2969999999999999,"5min":2.665,"15min":2.665},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5449999999999999,"5min":2.347,"15min":2.347},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.224,"5min":1.3660000000000001,"15min":1.3899999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5089999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.3120000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.331,"15min":1.3580000000000001},"min":{"1min":0.85099999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5129999999999999,"5min":2.524,"15min":2.524},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4890000000000001,"15min":1.5209999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.675,"5min":1.96,"15min":1.96},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.373,"15min":1.407},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.49,"5min":2.012,"15min":2.012},"last":1.544},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.472,"15min":1.51},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.911,"5min":3.117,"15min":3.117},"last":1.5900000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.5229999999999999,"15min":1.569},"min":{"1min":0.71799999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7509999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.5629999999999999,"15min":1.611},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8129999999999999,"5min":2.411,"15min":2.411},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:09:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.542,"15min":1.583},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.786,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.6639999999999999,"15min":1.71},"min":{"1min":0.996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.8620000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.181}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":353001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.159,"15min":1.173},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5069999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.1739999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2470000000000001,"15min":1.2629999999999999},"min":{"1min":0.85599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.474,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.411},{"interface":"front","average":{"1min":1.167,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.86299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6439999999999999,"5min":1.794,"15min":1.794},"last":1.272}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1879999999999999,"15min":1.1919999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3360000000000001,"15min":1.3480000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6619999999999999,"5min":1.867,"15min":1.867},"last":1.341}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.266,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.702,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.218},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.524}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3720000000000001,"15min":1.3879999999999999},"min":{"1min":0.96699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8169999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.4039999999999999,"15min":1.409},"min":{"1min":0.98699999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0070000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.462}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6859999999999999,"5min":2.214,"15min":2.214},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.4350000000000001,"15min":1.4550000000000001},"min":{"1min":0.89400000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.873,"5min":2.089,"15min":2.089},"last":1.472}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4359999999999999,"15min":1.458},"min":{"1min":0.81999999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.9199999999999999,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.381},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.488,"15min":1.5089999999999999},"min":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.792,"5min":2.524,"15min":2.524},"last":1.601}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":782336,"data_stored":350418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.052,"15min":1.0720000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4790000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0840000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4690000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.385,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.2,"15min":1.228},"min":{"1min":0.63300000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.76,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.012}]},{"osd":2,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1819999999999999,"15min":1.22},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6990000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.3480000000000001,"15min":1.3779999999999999},"min":{"1min":0.66600000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.768,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.88600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3620000000000001,"15min":1.391},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7450000000000001,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.151},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.423,"15min":1.45},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.1080000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.496,"15min":1.532},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.2200000000000002,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.6499999999999999,"15min":1.6970000000000001},"min":{"1min":1.0669999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.962,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.3600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":1.0840000000000001,"5min":0.998,"15min":0.998},"max":{"1min":1.8400000000000001,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.2},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.546,"15min":1.5820000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.3090000000000002,"5min":3.786,"15min":3.786},"last":1.226}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7649999999999999,"15min":1.8089999999999999},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1880000000000002,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6459999999999999,"15min":1.6870000000000001},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.96,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.4810000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":786432,"data_stored":351437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3799999999999999,"5min":1.393,"15min":1.393},"last":1.042},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.0289999999999999,"15min":1.056},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.349,"5min":1.643,"15min":1.643},"last":1.127}]},{"osd":1,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92800000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.5049999999999999,"5min":1.599,"15min":1.599},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.2310000000000001,"15min":1.2629999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.6240000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0920000000000001,"15min":1.121},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3089999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.546,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.385,"15min":1.3979999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.929,"5min":2.657,"15min":2.657},"last":1.276},{"interface":"front","average":{"1min":1.446,"5min":1.51,"15min":1.52},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":5.3940000000000001,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2270000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.319,"15min":1.3200000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.855,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.097},{"interface":"front","average":{"1min":1.421,"5min":1.4039999999999999,"15min":1.401},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.9950000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.486,"15min":1.5},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.992,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.026},{"interface":"front","average":{"1min":1.393,"5min":1.466,"15min":1.478},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.857,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.175}]},{"osd":7,"last update":"Fri Sep 13 15:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5569999999999999,"15min":1.569},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8680000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.494,"5min":1.5569999999999999,"15min":1.5669999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.964,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.2470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":815104,"data_stored":353765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.52600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.94399999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":1.502,"15min":1.502},"last":1.321},{"interface":"front","average":{"1min":0.998,"5min":1.046,"15min":1.054},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5209999999999999,"5min":3.254,"15min":3.254},"last":1.0680000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.526,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3640000000000001,"15min":1.379},"min":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.8300000000000001,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.389}]},{"osd":5,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.419,"15min":1.4510000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.845,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.3520000000000001,"15min":1.3759999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.877,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.157},{"interface":"front","average":{"1min":1.345,"5min":1.5509999999999999,"15min":1.585},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":4.843,"15min":4.843},"last":1.4279999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:26 2024","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.6819999999999999,"15min":1.7290000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.792,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.363},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.488,"15min":1.512},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.8899999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.4610000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1376256,"data_stored":940786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.214,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90100000000000002},"min":{"1min":0.60899999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.232}]},{"osd":2,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.284,"15min":1.3300000000000001},"min":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.716,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.036},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.2889999999999999,"15min":1.353},"min":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3480000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.139}]},{"osd":3,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1579999999999999,"15min":1.1719999999999999},"min":{"1min":0.65200000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4870000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3169999999999999,"15min":1.3089999999999999},"min":{"1min":0.88800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.732,"5min":2.157,"15min":2.157},"last":1.528}]},{"osd":4,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.97599999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.55,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3779999999999999,"15min":1.3759999999999999},"min":{"1min":1.163,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.6830000000000001,"5min":1.827,"15min":1.827},"last":1.627}]},{"osd":5,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.3999999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9419999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.331},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3919999999999999,"15min":1.399},"min":{"1min":1.147,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.617,"5min":2.367,"15min":2.367},"last":1.2769999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.48,"15min":1.49},"min":{"1min":1.099,"5min":1.071,"15min":1.071},"max":{"1min":1.738,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.708},{"interface":"front","average":{"1min":1.367,"5min":1.476,"15min":1.494},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.1070000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.4359999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:09:28 2024","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.54,"15min":1.554},"min":{"1min":1.1850000000000001,"5min":1.04,"15min":1.04},"max":{"1min":2.1920000000000002,"5min":3.302,"15min":3.302},"last":1.651},{"interface":"front","average":{"1min":1.387,"5min":1.466,"15min":1.4790000000000001},"min":{"1min":0.92700000000000005,"5min":0.874,"15min":0.874},"max":{"1min":1.673,"5min":2.266,"15min":2.266},"last":1.181}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:26.902 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:10:26.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T15:10:27.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f6745600700 1 Processor -- start 2024-09-13T15:10:27.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f6745600700 1 -- start start 2024-09-13T15:10:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f6745600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f674006b490 0x7f674015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f6745600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400b4b80 con 0x7f6740160040 2024-09-13T15:10:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f6745600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674006cf60 con 0x7f674015e260 2024-09-13T15:10:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f6745600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674015e010 con 0x7f674006b490 2024-09-13T15:10:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6740160040 0x7f674006ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42174/0 (socket says 172.21.15.50:42174) 2024-09-13T15:10:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673fe00700 1 -- 172.21.15.50:0/2578659288 learned_addr learned my addr 172.21.15.50:0/2578659288 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673f400700 1 --2- 172.21.15.50:0/2578659288 >> v2:172.21.15.50:3300/0 conn(0x7f674006b490 0x7f674015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156152884 0 0) 0x7f67400b4b80 con 0x7f6740160040 2024-09-13T15:10:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67240035d0 con 0x7f6740160040 2024-09-13T15:10:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790354177 0 0) 0x7f674006cf60 con 0x7f674015e260 2024-09-13T15:10:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67400b4b80 con 0x7f674015e260 2024-09-13T15:10:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673f400700 1 -- 172.21.15.50:0/2578659288 >> v1:172.21.15.181:6789/0 conn(0x7f674015e260 legacy=0x7f67400b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284982066 0 0) 0x7f67240035d0 con 0x7f6740160040 2024-09-13T15:10:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673f400700 1 -- 172.21.15.50:0/2578659288 >> v1:172.21.15.50:6789/0 conn(0x7f6740160040 legacy=0x7f674006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.134+0000 7f673f400700 1 -- 172.21.15.50:0/2578659288 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674015dd30 con 0x7f674006b490 2024-09-13T15:10:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f673f400700 1 --2- 172.21.15.50:0/2578659288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006b490 0x7f674015d150 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f672c009850 tx=0x7f672c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dce849e8bb7704 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730001670 con 0x7f674006b490 2024-09-13T15:10:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c004030 con 0x7f674006b490 2024-09-13T15:10:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f673ea00700 1 -- 172.21.15.50:0/2578659288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0043c0 con 0x7f674006b490 2024-09-13T15:10:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 -- 172.21.15.50:0/2578659288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006b490 msgr2=0x7f674015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 --2- 172.21.15.50:0/2578659288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006b490 0x7f674015d150 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f672c009850 tx=0x7f672c009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 -- 172.21.15.50:0/2578659288 shutdown_connections 2024-09-13T15:10:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 --2- 172.21.15.50:0/2578659288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674006b490 0x7f674015d150 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 -- 172.21.15.50:0/2578659288 >> 172.21.15.50:0/2578659288 conn(0x7f6740066270 msgr2=0x7f6740071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 -- 172.21.15.50:0/2578659288 shutdown_connections 2024-09-13T15:10:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.138+0000 7f6745600700 1 -- 172.21.15.50:0/2578659288 wait complete. 2024-09-13T15:10:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 Processor -- start 2024-09-13T15:10:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 -- start start 2024-09-13T15:10:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f674006b490 0x7f674015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 0x7f674014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6740160040 0x7f67400c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674014fe60 con 0x7f674015e260 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c5ef0 con 0x7f674006b490 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f6745600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c61c0 con 0x7f6740160040 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f673f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 0x7f674014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f673f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 0x7f674014f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42228/0 (socket says 172.21.15.50:42228) 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.142+0000 7f673f400700 1 -- 172.21.15.50:0/3450626225 learned_addr learned my addr 172.21.15.50:0/3450626225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673fe00700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f674006b490 0x7f674015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6744c00700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6740160040 0x7f67400c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673f400700 1 -- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6740160040 msgr2=0x7f67400c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673f400700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6740160040 0x7f67400c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673f400700 1 -- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f674006b490 msgr2=0x7f674015d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673f400700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f674006b490 0x7f674015d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673f400700 1 -- 172.21.15.50:0/3450626225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0094b0 con 0x7f674015e260 2024-09-13T15:10:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673fe00700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f674006b490 0x7f674015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f673f400700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 0x7f674014f920 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f67400b3470 tx=0x7f672c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c003d90 con 0x7f674015e260 2024-09-13T15:10:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c01f070 con 0x7f674015e260 2024-09-13T15:10:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c011870 con 0x7f674015e260 2024-09-13T15:10:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400c64a0 con 0x7f674015e260 2024-09-13T15:10:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67400c7ee0 con 0x7f674015e260 2024-09-13T15:10:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.146+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67400c7d20 con 0x7f674015e260 2024-09-13T15:10:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.150+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f672c021030 con 0x7f674015e260 2024-09-13T15:10:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.150+0000 7f6737e00700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6720066760 0x7f6720068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.150+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f672c085590 con 0x7f674015e260 2024-09-13T15:10:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.150+0000 7f673fe00700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6720066760 0x7f6720068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.150+0000 7f673fe00700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6720066760 0x7f6720068c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6730001eb0 tx=0x7f6730001650 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.154+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f672c0527b0 con 0x7f674015e260 2024-09-13T15:10:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.398+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f674015d640 con 0x7f674015e260 2024-09-13T15:10:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.402+0000 7f6737e00700 1 -- 172.21.15.50:0/3450626225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f672c055dd0 con 0x7f674015e260 2024-09-13T15:10:27.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.406+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6720066760 msgr2=0x7f6720068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.406+0000 7f6745600700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6720066760 0x7f6720068c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6730001eb0 tx=0x7f6730001650 comp rx=0 tx=0).stop 2024-09-13T15:10:27.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.406+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 msgr2=0x7f674014f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.406+0000 7f6745600700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 0x7f674014f920 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f67400b3470 tx=0x7f672c004770 comp rx=0 tx=0).stop 2024-09-13T15:10:27.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 shutdown_connections 2024-09-13T15:10:27.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6720066760 0x7f6720068c20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6740160040 0x7f67400c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f674015e260 0x7f674014f920 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 --2- 172.21.15.50:0/3450626225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f674006b490 0x7f674015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 >> 172.21.15.50:0/3450626225 conn(0x7f6740066270 msgr2=0x7f67401605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 shutdown_connections 2024-09-13T15:10:27.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.410+0000 7f6745600700 1 -- 172.21.15.50:0/3450626225 wait complete. 2024-09-13T15:10:27.416 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-13T15:10:27.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 Processor -- start 2024-09-13T15:10:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 -- start start 2024-09-13T15:10:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 0x7fd70015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 0x7fd70006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000b2ad0 con 0x7fd7000cb020 2024-09-13T15:10:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70006b450 con 0x7fd70006aaa0 2024-09-13T15:10:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.606+0000 7fd705200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000ccb10 con 0x7fd7000cc6f0 2024-09-13T15:10:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6ffe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 0x7fd70006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 0x7fd70015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6ff400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd7000cb020 0x7fd70015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:60384/0 (socket says 172.21.15.50:60384) 2024-09-13T15:10:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 0x7fd70015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:57956/0 (socket says 172.21.15.50:57956) 2024-09-13T15:10:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6ffe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 0x7fd70006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:51556/0 (socket says 172.21.15.50:51556) 2024-09-13T15:10:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6ff400700 1 -- 172.21.15.50:0/3812991628 learned_addr learned my addr 172.21.15.50:0/3812991628 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6fea00700 1 -- 172.21.15.50:0/3812991628 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149737838 0 0) 0x7fd7000b2ad0 con 0x7fd7000cb020 2024-09-13T15:10:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6fea00700 1 -- 172.21.15.50:0/3812991628 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e40035d0 con 0x7fd7000cb020 2024-09-13T15:10:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 -- 172.21.15.50:0/3812991628 >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 msgr2=0x7fd70006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 --2- 172.21.15.50:0/3812991628 >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 0x7fd70006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 -- 172.21.15.50:0/3812991628 >> v1:172.21.15.181:6789/0 conn(0x7fd7000cb020 legacy=0x7fd70015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 -- 172.21.15.50:0/3812991628 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70015b960 con 0x7fd7000cc6f0 2024-09-13T15:10:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6ffe00700 1 --2- 172.21.15.50:0/3812991628 >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 0x7fd70006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6f7e00700 1 --2- 172.21.15.50:0/3812991628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 0x7fd70015b0e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009850 tx=0x7fd6e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426e2cbc94beaeba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6fea00700 1 -- 172.21.15.50:0/3812991628 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8011830 con 0x7fd7000cc6f0 2024-09-13T15:10:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6fea00700 1 -- 172.21.15.50:0/3812991628 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8011990 con 0x7fd7000cc6f0 2024-09-13T15:10:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd6fea00700 1 -- 172.21.15.50:0/3812991628 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8011d40 con 0x7fd7000cc6f0 2024-09-13T15:10:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd705200700 1 -- 172.21.15.50:0/3812991628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 msgr2=0x7fd70015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.610+0000 7fd705200700 1 --2- 172.21.15.50:0/3812991628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 0x7fd70015b0e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009850 tx=0x7fd6e8009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 -- 172.21.15.50:0/3812991628 shutdown_connections 2024-09-13T15:10:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 --2- 172.21.15.50:0/3812991628 >> v2:172.21.15.181:3300/0 conn(0x7fd70006aaa0 0x7fd70006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 --2- 172.21.15.50:0/3812991628 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cc6f0 0x7fd70015b0e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 -- 172.21.15.50:0/3812991628 >> 172.21.15.50:0/3812991628 conn(0x7fd7000b0c40 msgr2=0x7fd70006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 -- 172.21.15.50:0/3812991628 shutdown_connections 2024-09-13T15:10:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 -- 172.21.15.50:0/3812991628 wait complete. 2024-09-13T15:10:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 Processor -- start 2024-09-13T15:10:27.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.614+0000 7fd705200700 1 -- start start 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 0x7fd700070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cb020 0x7fd700143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7000cc6f0 0x7fd7000af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001f3660 con 0x7fd70006aaa0 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000c8e60 con 0x7fd7000cc6f0 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000c9140 con 0x7fd7000cb020 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 0x7fd700070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 0x7fd700070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42236/0 (socket says 172.21.15.50:42236) 2024-09-13T15:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 -- 172.21.15.50:0/702201202 learned_addr learned my addr 172.21.15.50:0/702201202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6f7e00700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cb020 0x7fd700143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ffe00700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7000cc6f0 0x7fd7000af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 -- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cb020 msgr2=0x7fd700143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cb020 0x7fd700143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 -- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7000cc6f0 msgr2=0x7fd7000af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7000cc6f0 0x7fd7000af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 -- 172.21.15.50:0/702201202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8009a70 con 0x7fd70006aaa0 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ffe00700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7000cc6f0 0x7fd7000af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:27.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6ff400700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 0x7fd700070050 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000c700 tx=0x7fd6f000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0005d90 con 0x7fd70006aaa0 2024-09-13T15:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00070d0 con 0x7fd70006aaa0 2024-09-13T15:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0007480 con 0x7fd70006aaa0 2024-09-13T15:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e80094b0 con 0x7fd70006aaa0 2024-09-13T15:10:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.618+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd700143960 con 0x7fd70006aaa0 2024-09-13T15:10:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.622+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7000c9660 con 0x7fd70006aaa0 2024-09-13T15:10:27.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.622+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6f00075e0 con 0x7fd70006aaa0 2024-09-13T15:10:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.626+0000 7fd6f7400700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.626+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd6f0083880 con 0x7fd70006aaa0 2024-09-13T15:10:27.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.626+0000 7fd6f7e00700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.626+0000 7fd6f7e00700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009850 tx=0x7fd6e801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:27.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.634+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7000c9660 con 0x7fd70006aaa0 2024-09-13T15:10:27.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.862+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7000c9660 con 0x7fd70006aaa0 2024-09-13T15:10:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.862+0000 7fd6f7400700 1 -- 172.21.15.50:0/702201202 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4738 (secure 0 0 0) 0x7fd7000c9660 con 0x7fd70006aaa0 2024-09-13T15:10:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:27.866 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:17.161542+0000","modified":"2024-09-13T15:10:20.177482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4135812870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4135812870},{"type":"v1","addr":"172.21.15.50:6835","nonce":4135812870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 msgr2=0x7fd6dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009850 tx=0x7fd6e801c040 comp rx=0 tx=0).stop 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 msgr2=0x7fd700070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 0x7fd700070050 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000c700 tx=0x7fd6f000ca10 comp rx=0 tx=0).stop 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 shutdown_connections 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6dc066730 0x7fd6dc068bf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7000cc6f0 0x7fd7000af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7000cb020 0x7fd700143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 --2- 172.21.15.50:0/702201202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70006aaa0 0x7fd700070050 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 >> 172.21.15.50:0/702201202 conn(0x7fd7000b0c40 msgr2=0x7fd70006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 shutdown_connections 2024-09-13T15:10:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:27.866+0000 7fd705200700 1 -- 172.21.15.50:0/702201202 wait complete. 2024-09-13T15:10:27.871 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2024-09-13T15:10:28.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:10:17.161542+0000', 'modified': '2024-09-13T15:10:20.177482+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6111}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6111': {'gid': 6111, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/4135812870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 4135812870}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 4135812870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:10:28.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:10:28.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T15:10:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.466+0000 7f7458a00700 1 Processor -- start 2024-09-13T15:10:28.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.466+0000 7f7458a00700 1 -- start start 2024-09-13T15:10:28.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7458a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f745406aaa0 0x7f745406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7458a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540ccb40 con 0x7f74540cc6f0 2024-09-13T15:10:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7458a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745406b430 con 0x7f74540cb020 2024-09-13T15:10:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7458a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74540b2ad0 con 0x7f745406aaa0 2024-09-13T15:10:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74540cc6f0 0x7f745415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42188/0 (socket says 172.21.15.50:42188) 2024-09-13T15:10:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451e00700 1 -- 172.21.15.50:0/2137849630 learned_addr learned my addr 172.21.15.50:0/2137849630 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7453200700 1 --2- 172.21.15.50:0/2137849630 >> v2:172.21.15.181:3300/0 conn(0x7f745406aaa0 0x7f745406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025343331 0 0) 0x7f74540ccb40 con 0x7f74540cc6f0 2024-09-13T15:10:28.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74380035d0 con 0x7f74540cc6f0 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 783246779 0 0) 0x7f74380035d0 con 0x7f74540cc6f0 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 >> v2:172.21.15.181:3300/0 conn(0x7f745406aaa0 msgr2=0x7f745406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 --2- 172.21.15.50:0/2137849630 >> v2:172.21.15.181:3300/0 conn(0x7f745406aaa0 0x7f745406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 >> v1:172.21.15.181:6789/0 conn(0x7f74540cb020 legacy=0x7f745415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745415b960 con 0x7f74540cc6f0 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f7440001670 con 0x7f74540cc6f0 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 >> v1:172.21.15.50:6789/0 conn(0x7f74540cc6f0 legacy=0x7f745415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7438003a90 0x7f7438003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438004870 0x7f7438004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7438005230 0x7f743800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.470+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b2ad0 con 0x7f7438005230 2024-09-13T15:10:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743800c160 con 0x7f7438004870 2024-09-13T15:10:28.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743800c320 con 0x7f7438003a90 2024-09-13T15:10:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7438005230 0x7f743800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7451e00700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438004870 0x7f7438004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7452800700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7438003a90 0x7f7438003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 -- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7438003a90 msgr2=0x7f7438003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7438003a90 0x7f7438003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 -- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438004870 msgr2=0x7f7438004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438004870 0x7f7438004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 -- 172.21.15.50:0/2137849630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380035d0 con 0x7f7438005230 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 -- 172.21.15.50:0/2137849630 reap_dead start 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7453200700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7438005230 0x7f743800ba30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f744c009b70 tx=0x7f74380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6e7015bb4b1af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c004020 con 0x7f7438005230 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c004180 con 0x7f7438005230 2024-09-13T15:10:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7451400700 1 -- 172.21.15.50:0/2137849630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c004530 con 0x7f7438005230 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 -- 172.21.15.50:0/2137849630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7438005230 msgr2=0x7f743800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7438005230 0x7f743800ba30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f744c009b70 tx=0x7f74380058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 -- 172.21.15.50:0/2137849630 shutdown_connections 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 --2- 172.21.15.50:0/2137849630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7438005230 0x7f743800ba30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 -- 172.21.15.50:0/2137849630 >> 172.21.15.50:0/2137849630 conn(0x7f74540b0c40 msgr2=0x7f745406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 -- 172.21.15.50:0/2137849630 shutdown_connections 2024-09-13T15:10:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.474+0000 7f7458a00700 1 -- 172.21.15.50:0/2137849630 wait complete. 2024-09-13T15:10:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 Processor -- start 2024-09-13T15:10:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 -- start start 2024-09-13T15:10:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438005230 0x7f74541577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74541f9d30 0x7f7454071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 0x7f74540703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541476e0 con 0x7f745414b250 2024-09-13T15:10:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541fa1b0 con 0x7f7438005230 2024-09-13T15:10:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7458a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7454071dd0 con 0x7f74541f9d30 2024-09-13T15:10:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7453200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 0x7f74540703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7453200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 0x7f74540703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42266/0 (socket says 172.21.15.50:42266) 2024-09-13T15:10:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7453200700 1 -- 172.21.15.50:0/459275041 learned_addr learned my addr 172.21.15.50:0/459275041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7452800700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438005230 0x7f74541577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.478+0000 7f7451e00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74541f9d30 0x7f7454071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7453200700 1 -- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74541f9d30 msgr2=0x7f7454071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7453200700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74541f9d30 0x7f7454071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7453200700 1 -- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438005230 msgr2=0x7f74541577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7453200700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438005230 0x7f74541577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7453200700 1 -- 172.21.15.50:0/459275041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454157dc0 con 0x7f745414b250 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7452800700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438005230 0x7f74541577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7453200700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 0x7f74540703e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f744c00e4b0 tx=0x7f744c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f744aa00700 1 -- 172.21.15.50:0/459275041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c004020 con 0x7f745414b250 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f744aa00700 1 -- 172.21.15.50:0/459275041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00eaf0 con 0x7f745414b250 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f744aa00700 1 -- 172.21.15.50:0/459275041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00eea0 con 0x7f745414b250 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74541580a0 con 0x7f745414b250 2024-09-13T15:10:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.482+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745406fec0 con 0x7f745414b250 2024-09-13T15:10:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.486+0000 7f744aa00700 1 -- 172.21.15.50:0/459275041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f744c013470 con 0x7f745414b250 2024-09-13T15:10:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.486+0000 7f744aa00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7434066730 0x7f7434068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.486+0000 7f744aa00700 1 -- 172.21.15.50:0/459275041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f744c084ef0 con 0x7f745414b250 2024-09-13T15:10:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.486+0000 7f7452800700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7434066730 0x7f7434068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f7452800700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7434066730 0x7f7434068bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7444000f80 tx=0x7f7444009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 Processor -- start 2024-09-13T15:10:28.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 -- start start 2024-09-13T15:10:28.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a94610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 0x17a5c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a94b50 0x17a5cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x179bbd80 con 0x17a72e90 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x179b9510 con 0x17a94b50 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x179b4e00 con 0x17a94230 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f7451e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 0x17a5c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f7451e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 0x17a5c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42276/0 (socket says 172.21.15.50:42276) 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f7451e00700 1 -- 172.21.15.50:0/2227964023 learned_addr learned my addr 172.21.15.50:0/2227964023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f7452800700 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a94610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.490+0000 7f7453200700 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a94b50 0x17a5cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f7451e00700 1 -- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 msgr2=0x17a94610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f7451e00700 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a94610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f7451e00700 1 -- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a94b50 msgr2=0x17a5cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f7451e00700 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a94b50 0x17a5cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f7451e00700 1 -- 172.21.15.50:0/2227964023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17827960 con 0x17a72e90 2024-09-13T15:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f7451e00700 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 0x17a5c890 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7440007fa0 tx=0x7f7440001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70031815f67115f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f743f000700 1 -- 172.21.15.50:0/2227964023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400070c0 con 0x17a72e90 2024-09-13T15:10:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f743f000700 1 -- 172.21.15.50:0/2227964023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440007220 con 0x17a72e90 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f743f000700 1 -- 172.21.15.50:0/2227964023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440007590 con 0x17a72e90 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 -- 172.21.15.50:0/2227964023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 msgr2=0x17a5c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 0x17a5c890 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7440007fa0 tx=0x7f7440001690 comp rx=0 tx=0).stop 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 -- 172.21.15.50:0/2227964023 shutdown_connections 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a94b50 0x17a5cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a72e90 0x17a5c890 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 --2- 172.21.15.50:0/2227964023 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a94610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 -- 172.21.15.50:0/2227964023 >> 172.21.15.50:0/2227964023 conn(0x177dc4d0 msgr2=0x17a75e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 -- 172.21.15.50:0/2227964023 shutdown_connections 2024-09-13T15:10:28.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 -- 172.21.15.50:0/2227964023 wait complete. 2024-09-13T15:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 -- start start 2024-09-13T15:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.494+0000 7f745c78a740 1 Processor -- start 2024-09-13T15:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a74780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x17972730 con 0x17a94b50 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x179785b0 con 0x17a72e90 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x17860aa0 con 0x17a94230 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 10 client.0 _ll_register_callbacks cb 0x179ae610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a74780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a74780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42286/0 (socket says 172.21.15.50:42286) 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 -- 172.21.15.50:0/4089293107 learned_addr learned my addr 172.21.15.50:0/4089293107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7452800700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7451e00700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 -- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 msgr2=0x17a723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 -- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 msgr2=0x17a4e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 -- 172.21.15.50:0/4089293107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745415b960 con 0x17a94b50 2024-09-13T15:10:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7453200700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a74780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f744c0523f0 tx=0x7f744c003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8191b35f0323fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7433400700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7433400700 1 -- 172.21.15.50:0/4089293107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c059d20 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f7433400700 1 -- 172.21.15.50:0/4089293107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f744c05e2e0 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.498+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x177e91e0 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7433400700 1 -- 172.21.15.50:0/4089293107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f744c056150 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 10 client.6270 fetch_fsmap learned FSMap version 31 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1797b220 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7433400700 1 -- 172.21.15.50:0/4089293107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x177e91e0 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7433400700 1 -- 172.21.15.50:0/4089293107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f744c05fd20 con 0x17a94b50 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 10 client.6270 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 10 client.6270 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:10:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 20 client.6270 populate_metadata read hostname 'smithi050' 2024-09-13T15:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a4cbf0 0x17a4cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 4 client.6270 mds_command: new command op to 6111 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 --> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17833460 con 0x17a4cbf0 2024-09-13T15:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7452800700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a4cbf0 0x17a4cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7452800700 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a4cbf0 0x17a4cfd0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9634153191e8da6c server_cookie=3afa319693b318cc in_seq=0 out_seq=0 2024-09-13T15:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7433400700 10 client.6270 ms_handle_connect on v2:172.21.15.50:6833/4135812870 2024-09-13T15:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7433400700 1 -- 172.21.15.50:0/4089293107 <== mds.0 v2:172.21.15.50:6833/4135812870 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x17833460 con 0x17a4cbf0 2024-09-13T15:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f7433400700 10 client.6270 handle_command_reply: tid=0 2024-09-13T15:10:28.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.502+0000 7f745c78a740 1 client.6270 shutdown 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 msgr2=0x17a74780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a74780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f744c0523f0 tx=0x7f744c003ea0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 shutdown_connections 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a74780 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a4cbf0 0x17a4cfd0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 --2- 172.21.15.50:0/4089293107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f7433400700 0 client.6270 ms_handle_reset on v2:172.21.15.50:6833/4135812870 2024-09-13T15:10:28.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 >> 172.21.15.50:0/4089293107 conn(0x177dc4d0 msgr2=0x17a48700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 shutdown_connections 2024-09-13T15:10:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 1 -- 172.21.15.50:0/4089293107 wait complete. 2024-09-13T15:10:28.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.506+0000 7f745c78a740 20 client.6270 trim_cache size 0 max 16384 2024-09-13T15:10:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 Processor -- start 2024-09-13T15:10:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 -- start start 2024-09-13T15:10:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a4be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a4a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x179ad440 con 0x17a94b50 2024-09-13T15:10:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a44320 con 0x17a72e90 2024-09-13T15:10:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x17968e10 con 0x17a94230 2024-09-13T15:10:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a4a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a4a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42302/0 (socket says 172.21.15.50:42302) 2024-09-13T15:10:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 -- 172.21.15.50:0/3422031421 learned_addr learned my addr 172.21.15.50:0/3422031421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7451e00700 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a4be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7452800700 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 -- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 msgr2=0x17a4be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a4be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 -- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 msgr2=0x17a4b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.530+0000 7f7453200700 1 -- 172.21.15.50:0/3422031421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17961450 con 0x17a94b50 2024-09-13T15:10:28.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f7453200700 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a4a710 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a010 tx=0x7f744c027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d04dd51c0aa03a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f743fa00700 1 -- 172.21.15.50:0/3422031421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c056150 con 0x17a94b50 2024-09-13T15:10:28.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f743fa00700 1 -- 172.21.15.50:0/3422031421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c056300 con 0x17a94b50 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f743fa00700 1 -- 172.21.15.50:0/3422031421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c059d20 con 0x17a94b50 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- 172.21.15.50:0/3422031421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 msgr2=0x17a4a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a4a710 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a010 tx=0x7f744c027000 comp rx=0 tx=0).stop 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- 172.21.15.50:0/3422031421 shutdown_connections 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94b50 0x17a4a710 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94230 0x17a4be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- 172.21.15.50:0/3422031421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17a4b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- 172.21.15.50:0/3422031421 >> 172.21.15.50:0/3422031421 conn(0x177dc4d0 msgr2=0x17a8f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- 172.21.15.50:0/3422031421 shutdown_connections 2024-09-13T15:10:28.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- 172.21.15.50:0/3422031421 wait complete. 2024-09-13T15:10:28.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- start start 2024-09-13T15:10:28.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 Processor -- start 2024-09-13T15:10:28.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17af50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 0x17a4b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94b50 0x17a4bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x17ab3a80 con 0x17a94230 2024-09-13T15:10:28.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a98300 con 0x17a72e90 2024-09-13T15:10:28.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x17a98ff0 con 0x17a94b50 2024-09-13T15:10:28.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.534+0000 7f745c78a740 10 client.0 _ll_register_callbacks cb 0x17966ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 0x17a4b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 0x17a4b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42318/0 (socket says 172.21.15.50:42318) 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 -- 172.21.15.50:0/197896126 learned_addr learned my addr 172.21.15.50:0/197896126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7453200700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94b50 0x17a4bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7452800700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17af50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 -- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94b50 msgr2=0x17a4bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94b50 0x17a4bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 -- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 msgr2=0x17af50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17af50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 -- 172.21.15.50:0/197896126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1797b220 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7452800700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17af50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7451e00700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 0x17a4b760 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7440017040 tx=0x7f7440001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbb28a173e5b87d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7433400700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7433400700 1 -- 172.21.15.50:0/197896126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440015640 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7433400700 1 -- 172.21.15.50:0/197896126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74400157a0 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7440007220 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7433400700 1 -- 172.21.15.50:0/197896126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74400159a0 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 10 client.6276 fetch_fsmap learned FSMap version 31 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x17955720 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7433400700 1 -- 172.21.15.50:0/197896126 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440007220 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7433400700 1 -- 172.21.15.50:0/197896126 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7440012050 con 0x17a94230 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 10 client.6276 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T15:10:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 10 client.6276 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:10:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 20 client.6276 populate_metadata read hostname 'smithi050' 2024-09-13T15:10:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a970b0 0x17a97490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 4 client.6276 mds_command: new command op to 6111 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:10:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 --> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] -- command(tid 0: {"prefix": "status"}) v1 -- 0x178581e0 con 0x17a970b0 2024-09-13T15:10:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.538+0000 7f7452800700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a970b0 0x17a97490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7452800700 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a970b0 0x17a97490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ac72f1e0ab14bf9 server_cookie=c74299ee2e08a5ad in_seq=0 out_seq=0 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7433400700 10 client.6276 ms_handle_connect on v2:172.21.15.50:6833/4135812870 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7433400700 1 -- 172.21.15.50:0/197896126 <== mds.0 v2:172.21.15.50:6833/4135812870 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x178581e0 con 0x17a970b0 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7433400700 10 client.6276 handle_command_reply: tid=0 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 client.6276 shutdown 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 msgr2=0x17a4b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 0x17a4b760 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7440017040 tx=0x7f7440001a00 comp rx=0 tx=0).stop 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 shutdown_connections 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:6833/4135812870,v1:172.21.15.50:6835/4135812870] conn(0x17a970b0 0x17a97490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x17a94b50 0x17a4bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x17a94230 0x17a4b760 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7433400700 0 client.6276 ms_handle_reset on v2:172.21.15.50:6833/4135812870 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 --2- 172.21.15.50:0/197896126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x17a72e90 0x17af50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 >> 172.21.15.50:0/197896126 conn(0x177dc4d0 msgr2=0x17aa37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 shutdown_connections 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 1 -- 172.21.15.50:0/197896126 wait complete. 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f745c78a740 20 client.6276 trim_cache size 0 max 16384 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6111, 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:10:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:10:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.376178416, 2024-09-13T15:10:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 31, 2024-09-13T15:10:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 65, 2024-09-13T15:10:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 65, 2024-09-13T15:10:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 16.573023766999999 2024-09-13T15:10:28.548 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:10:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7434066730 msgr2=0x7f7434068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7434066730 0x7f7434068bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7444000f80 tx=0x7f7444009040 comp rx=0 tx=0).stop 2024-09-13T15:10:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 msgr2=0x7f74540703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 0x7f74540703e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f744c00e4b0 tx=0x7f744c0047e0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 shutdown_connections 2024-09-13T15:10:28.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7434066730 0x7f7434068bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745414b250 0x7f74540703e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f74541f9d30 0x7f7454071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 --2- 172.21.15.50:0/459275041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7438005230 0x7f74541577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 >> 172.21.15.50:0/459275041 conn(0x7f74540b0c40 msgr2=0x7f745406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 shutdown_connections 2024-09-13T15:10:28.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.542+0000 7f7458a00700 1 -- 172.21.15.50:0/459275041 wait complete. 2024-09-13T15:10:28.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:10:28.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 Processor -- start 2024-09-13T15:10:28.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 -- start start 2024-09-13T15:10:28.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff38806aaa0 0x7ff38815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff38815e9f0 0x7ff38815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38815e560 con 0x7ff3880b3980 2024-09-13T15:10:28.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3880adf90 con 0x7ff38815e9f0 2024-09-13T15:10:28.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff38ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38815d920 con 0x7ff38806aaa0 2024-09-13T15:10:28.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff38815e9f0 0x7ff38815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff38815e9f0 0x7ff38815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42324/0 (socket says 172.21.15.50:42324) 2024-09-13T15:10:28.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 -- 172.21.15.50:0/518457589 learned_addr learned my addr 172.21.15.50:0/518457589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387400700 1 --2- 172.21.15.50:0/518457589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff38806aaa0 0x7ff38815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 -- 172.21.15.50:0/518457589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff38806aaa0 msgr2=0x7ff38815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 --2- 172.21.15.50:0/518457589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff38806aaa0 0x7ff38815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 -- 172.21.15.50:0/518457589 >> v1:172.21.15.181:6789/0 conn(0x7ff3880b3980 legacy=0x7ff38806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.758+0000 7ff387e00700 1 -- 172.21.15.50:0/518457589 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38815dc00 con 0x7ff38815e9f0 2024-09-13T15:10:28.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff387e00700 1 --2- 172.21.15.50:0/518457589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38815e9f0 0x7ff38815eea0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff380009e80 tx=0x7ff38000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a9415b535fc568 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff386a00700 1 -- 172.21.15.50:0/518457589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000e070 con 0x7ff38815e9f0 2024-09-13T15:10:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff386a00700 1 -- 172.21.15.50:0/518457589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000b8d0 con 0x7ff38815e9f0 2024-09-13T15:10:28.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff386a00700 1 -- 172.21.15.50:0/518457589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000bc80 con 0x7ff38815e9f0 2024-09-13T15:10:28.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 -- 172.21.15.50:0/518457589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38815e9f0 msgr2=0x7ff38815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 --2- 172.21.15.50:0/518457589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38815e9f0 0x7ff38815eea0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff380009e80 tx=0x7ff38000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:28.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 -- 172.21.15.50:0/518457589 shutdown_connections 2024-09-13T15:10:28.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 --2- 172.21.15.50:0/518457589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38815e9f0 0x7ff38815eea0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 --2- 172.21.15.50:0/518457589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff38806aaa0 0x7ff38815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 -- 172.21.15.50:0/518457589 >> 172.21.15.50:0/518457589 conn(0x7ff3880b0c40 msgr2=0x7ff38806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 -- 172.21.15.50:0/518457589 shutdown_connections 2024-09-13T15:10:28.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.762+0000 7ff38ce00700 1 -- 172.21.15.50:0/518457589 wait complete. 2024-09-13T15:10:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 Processor -- start 2024-09-13T15:10:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 -- start start 2024-09-13T15:10:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 0x7ff388140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3880b3980 0x7ff3880cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff38815e9f0 0x7ff38813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880ce2a0 con 0x7ff38806aaa0 2024-09-13T15:10:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388140fc0 con 0x7ff38815e9f0 2024-09-13T15:10:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff38ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff388141e00 con 0x7ff3880b3980 2024-09-13T15:10:28.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.766+0000 7ff387400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 0x7ff388140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 0x7ff388140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42332/0 (socket says 172.21.15.50:42332) 2024-09-13T15:10:28.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 -- 172.21.15.50:0/2200637934 learned_addr learned my addr 172.21.15.50:0/2200637934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:28.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff37ea00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3880b3980 0x7ff3880cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387e00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff38815e9f0 0x7ff38813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 -- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3880b3980 msgr2=0x7ff3880cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3880b3980 0x7ff3880cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 -- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff38815e9f0 msgr2=0x7ff38813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff38815e9f0 0x7ff38813ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 -- 172.21.15.50:0/2200637934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009b30 con 0x7ff38806aaa0 2024-09-13T15:10:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff387400700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 0x7ff388140a80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff37800e870 tx=0x7ff37800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780095a0 con 0x7ff38806aaa0 2024-09-13T15:10:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378013680 con 0x7ff38806aaa0 2024-09-13T15:10:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3881411f0 con 0x7ff38806aaa0 2024-09-13T15:10:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780139f0 con 0x7ff38806aaa0 2024-09-13T15:10:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.770+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3881417b0 con 0x7ff38806aaa0 2024-09-13T15:10:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.774+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38815d310 con 0x7ff38806aaa0 2024-09-13T15:10:28.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.774+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff378013b50 con 0x7ff38806aaa0 2024-09-13T15:10:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.774+0000 7ff37fe00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff364066760 0x7ff364068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.774+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff378084140 con 0x7ff38806aaa0 2024-09-13T15:10:28.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.778+0000 7ff37ea00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff364066760 0x7ff364068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.778+0000 7ff37ea00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff364066760 0x7ff364068c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff388142ed0 tx=0x7ff370009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:28.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:28.782+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3780512d0 con 0x7ff38806aaa0 2024-09-13T15:10:29.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.018+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3880aecc0 con 0x7ff38806aaa0 2024-09-13T15:10:29.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.018+0000 7ff37fe00700 1 -- 172.21.15.50:0/2200637934 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff3780548f0 con 0x7ff38806aaa0 2024-09-13T15:10:29.021 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff364066760 msgr2=0x7ff364068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff364066760 0x7ff364068c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff388142ed0 tx=0x7ff370009040 comp rx=0 tx=0).stop 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 msgr2=0x7ff388140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 0x7ff388140a80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff37800e870 tx=0x7ff37800eb80 comp rx=0 tx=0).stop 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 shutdown_connections 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff364066760 0x7ff364068c20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff38815e9f0 0x7ff38813ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3880b3980 0x7ff3880cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 --2- 172.21.15.50:0/2200637934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff38806aaa0 0x7ff388140a80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 >> 172.21.15.50:0/2200637934 conn(0x7ff3880b0c40 msgr2=0x7ff3880ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 shutdown_connections 2024-09-13T15:10:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:29.022+0000 7ff38ce00700 1 -- 172.21.15.50:0/2200637934 wait complete. 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:10:29.047 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:10:29.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.048 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:10:29.063 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:10:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:10:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:10:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:29.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.068 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:10:29.140 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:10:29.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.144 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:10:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:10:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:10:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:10:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:10:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:10:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:10:29.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.206 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:10:29.206 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:10:29.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:10:29.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:10:29.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:10:29.207 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:10:29.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.347 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:10:29.365 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:10:29.365 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:10:29.366 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:10:29.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:10:29.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:10:29.443 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:10:29.509 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:10:29.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:10:29.510 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:10:29.573 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:10:29.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:10:29.703 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:10:29.703 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:10:29.731 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:10:29.732 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:10:29.732 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:10:29.732 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:10:29.732 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:10:29.740 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:10:29.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:10:29.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:29.775 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:10:29.854 INFO:teuthology.orchestra.run.smithi050.stdout:client6285 2024-09-13T15:10:29.855 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:29.855 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:29.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:10:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.138+0000 7f6fde800700 1 Processor -- start 2024-09-13T15:10:30.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.138+0000 7f6fde800700 1 -- start start 2024-09-13T15:10:30.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fde800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd80b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:30.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fde800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fd815e9f0 0x7f6fd815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:30.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fde800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd815e560 con 0x7f6fd806aaa0 2024-09-13T15:10:30.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fde800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80b3ec0 con 0x7f6fd815e9f0 2024-09-13T15:10:30.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fde800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80adf90 con 0x7f6fd815d310 2024-09-13T15:10:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fd815e9f0 0x7f6fd815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fd815e9f0 0x7f6fd815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42334/0 (socket says 172.21.15.50:42334) 2024-09-13T15:10:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd80b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:30.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 -- 172.21.15.50:0/3395416058 learned_addr learned my addr 172.21.15.50:0/3395416058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 -- 172.21.15.50:0/3395416058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 msgr2=0x7f6fd80b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 --2- 172.21.15.50:0/3395416058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd80b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 -- 172.21.15.50:0/3395416058 >> v1:172.21.15.181:6789/0 conn(0x7f6fd806aaa0 legacy=0x7f6fd806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.142+0000 7f6fdde00700 1 -- 172.21.15.50:0/3395416058 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd815d920 con 0x7f6fd815e9f0 2024-09-13T15:10:30.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fdde00700 1 --2- 172.21.15.50:0/3395416058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd815eea0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009e50 tx=0x7f6fd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e37f815604e398 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fd7e00700 1 -- 172.21.15.50:0/3395416058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000e070 con 0x7f6fd815e9f0 2024-09-13T15:10:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fd7e00700 1 -- 172.21.15.50:0/3395416058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000b910 con 0x7f6fd815e9f0 2024-09-13T15:10:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fd7e00700 1 -- 172.21.15.50:0/3395416058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000bcc0 con 0x7f6fd815e9f0 2024-09-13T15:10:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 -- 172.21.15.50:0/3395416058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 msgr2=0x7f6fd815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:30.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 --2- 172.21.15.50:0/3395416058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd815eea0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009e50 tx=0x7f6fd000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 -- 172.21.15.50:0/3395416058 shutdown_connections 2024-09-13T15:10:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 --2- 172.21.15.50:0/3395416058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd815eea0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 --2- 172.21.15.50:0/3395416058 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd80b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 -- 172.21.15.50:0/3395416058 >> 172.21.15.50:0/3395416058 conn(0x7f6fd80b0c40 msgr2=0x7f6fd806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 -- 172.21.15.50:0/3395416058 shutdown_connections 2024-09-13T15:10:30.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.146+0000 7f6fde800700 1 -- 172.21.15.50:0/3395416058 wait complete. 2024-09-13T15:10:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 Processor -- start 2024-09-13T15:10:30.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 -- start start 2024-09-13T15:10:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806aaa0 0x7f6fd813b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd813a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd81385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8138af0 con 0x7f6fd815e9f0 2024-09-13T15:10:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8143a90 con 0x7f6fd806aaa0 2024-09-13T15:10:30.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fde800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8143d70 con 0x7f6fd815d310 2024-09-13T15:10:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd81385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd81385b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42350/0 (socket says 172.21.15.50:42350) 2024-09-13T15:10:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 -- 172.21.15.50:0/2056532773 learned_addr learned my addr 172.21.15.50:0/2056532773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdd400700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806aaa0 0x7f6fd813b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdca00700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd813a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 -- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 msgr2=0x7f6fd813a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd813a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 -- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806aaa0 msgr2=0x7f6fd813b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806aaa0 0x7f6fd813b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.150+0000 7f6fdde00700 1 -- 172.21.15.50:0/2056532773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009b30 con 0x7f6fd815e9f0 2024-09-13T15:10:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fdde00700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd81385b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80b1690 tx=0x7f6fd0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00048c0 con 0x7f6fd815e9f0 2024-09-13T15:10:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd00099b0 con 0x7f6fd815e9f0 2024-09-13T15:10:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd001c680 con 0x7f6fd815e9f0 2024-09-13T15:10:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd8144050 con 0x7f6fd815e9f0 2024-09-13T15:10:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd8144610 con 0x7f6fd815e9f0 2024-09-13T15:10:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.154+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd80b3980 con 0x7f6fd815e9f0 2024-09-13T15:10:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.158+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fd001c7e0 con 0x7f6fd815e9f0 2024-09-13T15:10:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.158+0000 7f6fd5600700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066730 0x7f6fb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.158+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6fd0085e10 con 0x7f6fd815e9f0 2024-09-13T15:10:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.158+0000 7f6fdd400700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066730 0x7f6fb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.158+0000 7f6fdd400700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066730 0x7f6fb8068bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80cadc0 tx=0x7f6fcc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.162+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fd0089030 con 0x7f6fd815e9f0 2024-09-13T15:10:30.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.394+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fd8142d40 con 0x7f6fd815e9f0 2024-09-13T15:10:30.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.394+0000 7f6fd5600700 1 -- 172.21.15.50:0/2056532773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6fd0053030 con 0x7f6fd815e9f0 2024-09-13T15:10:30.396 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066730 msgr2=0x7f6fb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066730 0x7f6fb8068bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80cadc0 tx=0x7f6fcc009040 comp rx=0 tx=0).stop 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 msgr2=0x7f6fd81385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd81385b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80b1690 tx=0x7f6fd0004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 shutdown_connections 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fb8066730 0x7f6fb8068bf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd815e9f0 0x7f6fd81385b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fd815d310 0x7f6fd813a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 --2- 172.21.15.50:0/2056532773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fd806aaa0 0x7f6fd813b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 >> 172.21.15.50:0/2056532773 conn(0x7f6fd80b0c40 msgr2=0x7f6fd8142630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 shutdown_connections 2024-09-13T15:10:30.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:30.398+0000 7f6fde800700 1 -- 172.21.15.50:0/2056532773 wait complete. 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:10:30.421 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:10:30.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.422 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:10:30.439 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:10:30.439 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:10:30.439 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:10:30.439 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.439 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:10:30.440 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42266sec preferred_lft 42266sec 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:10:30.441 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.442 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:10:30.442 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:10:30.442 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:10:30.442 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.443 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:10:30.443 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:10:30.443 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:10:30.443 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:10:30.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.443 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:10:30.522 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:10:30.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.525 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:10:30.589 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:10:30.589 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:10:30.589 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:10:30.589 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:10:30.590 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:10:30.590 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:10:30.590 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:10:30.590 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:10:30.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.590 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:10:30.590 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:10:30.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:10:30.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:10:30.591 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:10:30.591 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:10:30.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.715 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:10:30.732 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:10:30.732 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:10:30.733 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:10:30.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.734 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:10:30.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:10:30.808 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:10:30.870 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:10:30.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:10:30.870 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:10:30.929 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:10:30.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:30.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:10:31.054 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:10:31.054 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:10:31.082 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:10:31.082 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:10:31.082 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:10:31.082 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:10:31.082 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:10:31.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:10:31.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:31.092 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:10:31.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:31.124 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:10:31.195 INFO:teuthology.orchestra.run.smithi181.stdout:client5759 2024-09-13T15:10:31.196 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:31.196 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:31.259 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:10:31.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:10:31.303 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:10:31.346 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:10:31.346 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:31.346 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:31.362 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:31.362 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:31.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f466aa00700 1 Processor -- start 2024-09-13T15:10:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f466aa00700 1 -- start start 2024-09-13T15:10:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f466aa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f466406ace0 0x7f46641679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f466aa00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640ad480 con 0x7f46640ce4c0 2024-09-13T15:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f466aa00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4664157790 con 0x7f46641573b0 2024-09-13T15:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f466aa00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640ad6d0 con 0x7f466406ace0 2024-09-13T15:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f4663400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46640ce4c0 0x7f466406a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42202/0 (socket says 172.21.15.50:42202) 2024-09-13T15:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f4663400700 1 -- 172.21.15.50:0/2498257760 learned_addr learned my addr 172.21.15.50:0/2498257760 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.658+0000 7f4668a00700 1 --2- 172.21.15.50:0/2498257760 >> v2:172.21.15.181:3300/0 conn(0x7f466406ace0 0x7f46641679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:31.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4662a00700 1 -- 172.21.15.50:0/2498257760 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578358411 0 0) 0x7f46640ad480 con 0x7f46640ce4c0 2024-09-13T15:10:31.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4662a00700 1 -- 172.21.15.50:0/2498257760 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46480035d0 con 0x7f46640ce4c0 2024-09-13T15:10:31.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4662a00700 1 -- 172.21.15.50:0/2498257760 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774199420 0 0) 0x7f4664157790 con 0x7f46641573b0 2024-09-13T15:10:31.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4668a00700 1 -- 172.21.15.50:0/2498257760 >> v1:172.21.15.181:6789/0 conn(0x7f46641573b0 legacy=0x7f46640cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4668a00700 1 -- 172.21.15.50:0/2498257760 >> v1:172.21.15.50:6789/0 conn(0x7f46640ce4c0 legacy=0x7f466406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4668a00700 1 -- 172.21.15.50:0/2498257760 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640ad9b0 con 0x7f466406ace0 2024-09-13T15:10:31.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4668a00700 1 --2- 172.21.15.50:0/2498257760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641679f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f465c009d90 tx=0x7f465c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e16dd758611b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:31.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4662a00700 1 -- 172.21.15.50:0/2498257760 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c00e070 con 0x7f466406ace0 2024-09-13T15:10:31.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4662a00700 1 -- 172.21.15.50:0/2498257760 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c00bb20 con 0x7f466406ace0 2024-09-13T15:10:31.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f4662a00700 1 -- 172.21.15.50:0/2498257760 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c00bed0 con 0x7f466406ace0 2024-09-13T15:10:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 -- 172.21.15.50:0/2498257760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 msgr2=0x7f46641679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 --2- 172.21.15.50:0/2498257760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641679f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f465c009d90 tx=0x7f465c00b330 comp rx=0 tx=0).stop 2024-09-13T15:10:31.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 -- 172.21.15.50:0/2498257760 shutdown_connections 2024-09-13T15:10:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 --2- 172.21.15.50:0/2498257760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641679f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 -- 172.21.15.50:0/2498257760 >> 172.21.15.50:0/2498257760 conn(0x7f46640b08d0 msgr2=0x7f46640b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 -- 172.21.15.50:0/2498257760 shutdown_connections 2024-09-13T15:10:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.662+0000 7f466aa00700 1 -- 172.21.15.50:0/2498257760 wait complete. 2024-09-13T15:10:31.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.666+0000 7f466aa00700 1 Processor -- start 2024-09-13T15:10:31.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.666+0000 7f466aa00700 1 -- start start 2024-09-13T15:10:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46640ce4c0 0x7f46641f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 0x7f46641526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46641f2ba0 con 0x7f46641573b0 2024-09-13T15:10:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46641f2e80 con 0x7f466406ace0 2024-09-13T15:10:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46641f3160 con 0x7f46640ce4c0 2024-09-13T15:10:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 0x7f46641526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 0x7f46641526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42354/0 (socket says 172.21.15.50:42354) 2024-09-13T15:10:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 -- 172.21.15.50:0/868068787 learned_addr learned my addr 172.21.15.50:0/868068787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4663e00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4663400700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46640ce4c0 0x7f46641f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 -- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46640ce4c0 msgr2=0x7f46641f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46640ce4c0 0x7f46641f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 -- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 msgr2=0x7f46641f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 -- 172.21.15.50:0/868068787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c009a70 con 0x7f46641573b0 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4663400700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46640ce4c0 0x7f46641f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f4668a00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 0x7f46641526e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f465c014040 tx=0x7f465c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c01b810 con 0x7f46641573b0 2024-09-13T15:10:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c020070 con 0x7f46641573b0 2024-09-13T15:10:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640b1a90 con 0x7f46641573b0 2024-09-13T15:10:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c01bbd0 con 0x7f46641573b0 2024-09-13T15:10:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.670+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4664152c20 con 0x7f46641573b0 2024-09-13T15:10:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.674+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4664152e10 con 0x7f46641573b0 2024-09-13T15:10:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.674+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f465c01bd30 con 0x7f46641573b0 2024-09-13T15:10:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.674+0000 7f465be00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4644066760 0x7f4644068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.674+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f465c022070 con 0x7f46641573b0 2024-09-13T15:10:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.678+0000 7f4663e00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4644066760 0x7f4644068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.678+0000 7f4663e00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4644066760 0x7f4644068c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4654000f60 tx=0x7f4654009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.682+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f465c057400 con 0x7f46641573b0 2024-09-13T15:10:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.866+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46640b1c80 con 0x7f46641573b0 2024-09-13T15:10:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.870+0000 7f465be00700 1 -- 172.21.15.50:0/868068787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16704 (secure 0 0 0) 0x7f465c056f90 con 0x7f46641573b0 2024-09-13T15:10:31.872 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:31.872 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:18.166138+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4644066760 msgr2=0x7f4644068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4644066760 0x7f4644068c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4654000f60 tx=0x7f4654009040 comp rx=0 tx=0).stop 2024-09-13T15:10:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 msgr2=0x7f46641526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 0x7f46641526e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f465c014040 tx=0x7f465c004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 shutdown_connections 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4644066760 0x7f4644068c20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46641573b0 0x7f46641526e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46640ce4c0 0x7f46641f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 --2- 172.21.15.50:0/868068787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466406ace0 0x7f46641f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 >> 172.21.15.50:0/868068787 conn(0x7f46640b08d0 msgr2=0x7f46640b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 shutdown_connections 2024-09-13T15:10:31.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:31.874+0000 7f466aa00700 1 -- 172.21.15.50:0/868068787 wait complete. 2024-09-13T15:10:31.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:10:15.256899+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:10:16.172392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:31.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:32.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.078+0000 7fbcee200700 1 Processor -- start 2024-09-13T15:10:32.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.082+0000 7fbcee200700 1 -- start start 2024-09-13T15:10:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.082+0000 7fbcee200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbce80cd850 0x7fbce80ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.082+0000 7fbcee200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80b57e0 con 0x7fbce815e030 2024-09-13T15:10:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.082+0000 7fbcee200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80b3b80 con 0x7fbce8157500 2024-09-13T15:10:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.082+0000 7fbcee200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80b5a80 con 0x7fbce80cd850 2024-09-13T15:10:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce6a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbce815e030 0x7fbce80cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42208/0 (socket says 172.21.15.50:42208) 2024-09-13T15:10:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce6a00700 1 -- 172.21.15.50:0/2601431591 learned_addr learned my addr 172.21.15.50:0/2601431591 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce7e00700 1 --2- 172.21.15.50:0/2601431591 >> v2:172.21.15.50:3300/0 conn(0x7fbce80cd850 0x7fbce80ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce7e00700 1 -- 172.21.15.50:0/2601431591 >> v1:172.21.15.181:6789/0 conn(0x7fbce8157500 legacy=0x7fbce8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce7e00700 1 -- 172.21.15.50:0/2601431591 >> v1:172.21.15.50:6789/0 conn(0x7fbce815e030 legacy=0x7fbce80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce7e00700 1 -- 172.21.15.50:0/2601431591 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80b5d60 con 0x7fbce80cd850 2024-09-13T15:10:32.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce7e00700 1 --2- 172.21.15.50:0/2601431591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce80ce700 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009dc0 tx=0x7fbce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424bbbc36afa59f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce6000700 1 -- 172.21.15.50:0/2601431591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000e070 con 0x7fbce80cd850 2024-09-13T15:10:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce6000700 1 -- 172.21.15.50:0/2601431591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce000bb90 con 0x7fbce80cd850 2024-09-13T15:10:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbce6000700 1 -- 172.21.15.50:0/2601431591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0012430 con 0x7fbce80cd850 2024-09-13T15:10:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 -- 172.21.15.50:0/2601431591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 msgr2=0x7fbce80ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 --2- 172.21.15.50:0/2601431591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce80ce700 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009dc0 tx=0x7fbce000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 -- 172.21.15.50:0/2601431591 shutdown_connections 2024-09-13T15:10:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 --2- 172.21.15.50:0/2601431591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce80ce700 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 -- 172.21.15.50:0/2601431591 >> 172.21.15.50:0/2601431591 conn(0x7fbce806e660 msgr2=0x7fbce806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 -- 172.21.15.50:0/2601431591 shutdown_connections 2024-09-13T15:10:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.086+0000 7fbcee200700 1 -- 172.21.15.50:0/2601431591 wait complete. 2024-09-13T15:10:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.090+0000 7fbcee200700 1 Processor -- start 2024-09-13T15:10:32.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.090+0000 7fbcee200700 1 -- start start 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.090+0000 7fbcee200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.090+0000 7fbcee200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce8157500 0x7fbce813f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.090+0000 7fbcee200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce815e030 0x7fbce813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.090+0000 7fbcee200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce806abd0 con 0x7fbce80cd850 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcee200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81565d0 con 0x7fbce815e030 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcee200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce806ade0 con 0x7fbce8157500 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce81519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42376/0 (socket says 172.21.15.50:42376) 2024-09-13T15:10:32.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 -- 172.21.15.50:0/2263708007 learned_addr learned my addr 172.21.15.50:0/2263708007 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7e00700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce815e030 0x7fbce813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce6a00700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce8157500 0x7fbce813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 -- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce8157500 msgr2=0x7fbce813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce8157500 0x7fbce813f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 -- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce815e030 msgr2=0x7fbce813f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce815e030 0x7fbce813f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 -- 172.21.15.50:0/2263708007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009a70 con 0x7fbce80cd850 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7e00700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce815e030 0x7fbce813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbce7400700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce81519d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800c500 tx=0x7fbcd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80052d0 con 0x7fbce80cd850 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd8005430 con 0x7fbce80cd850 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce806b0c0 con 0x7fbce80cd850 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80055a0 con 0x7fbce80cd850 2024-09-13T15:10:32.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.094+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce8151f10 con 0x7fbce80cd850 2024-09-13T15:10:32.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.098+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce806b5e0 con 0x7fbce80cd850 2024-09-13T15:10:32.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.098+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbcd80038e0 con 0x7fbce80cd850 2024-09-13T15:10:32.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.098+0000 7fbcdf400700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc8066730 0x7fbcc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.098+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbcd8083810 con 0x7fbce80cd850 2024-09-13T15:10:32.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.102+0000 7fbce6a00700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc8066730 0x7fbcc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.102+0000 7fbce6a00700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc8066730 0x7fbcc8068bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbce8156ca0 tx=0x7fbcd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.106+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbce806b5e0 con 0x7fbce80cd850 2024-09-13T15:10:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.286+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbce806b5e0 con 0x7fbce80cd850 2024-09-13T15:10:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.286+0000 7fbcdf400700 1 -- 172.21.15.50:0/2263708007 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbce806b5e0 con 0x7fbce80cd850 2024-09-13T15:10:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc8066730 msgr2=0x7fbcc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc8066730 0x7fbcc8068bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbce8156ca0 tx=0x7fbcd4009040 comp rx=0 tx=0).stop 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 msgr2=0x7fbce81519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce81519d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800c500 tx=0x7fbcd800c8c0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 shutdown_connections 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbcc8066730 0x7fbcc8068bf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbce815e030 0x7fbce813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbce8157500 0x7fbce813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 --2- 172.21.15.50:0/2263708007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce80cd850 0x7fbce81519d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 >> 172.21.15.50:0/2263708007 conn(0x7fbce806e660 msgr2=0x7fbce815f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 shutdown_connections 2024-09-13T15:10:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.290+0000 7fbcee200700 1 -- 172.21.15.50:0/2263708007 wait complete. 2024-09-13T15:10:32.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:10:32.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 Processor -- start 2024-09-13T15:10:32.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 -- start start 2024-09-13T15:10:32.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa1740cf5c0 0x7fa17406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa17415da60 0x7fa17413f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1740b2e10 con 0x7fa17406a390 2024-09-13T15:10:32.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17413fdd0 con 0x7fa17415da60 2024-09-13T15:10:32.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.498+0000 7fa173200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17406b4a0 con 0x7fa1740cf5c0 2024-09-13T15:10:32.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa1740cf5c0 0x7fa17406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa1740cf5c0 0x7fa17406b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:51678/0 (socket says 172.21.15.50:51678) 2024-09-13T15:10:32.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 -- 172.21.15.50:0/2549082980 learned_addr learned my addr 172.21.15.50:0/2549082980 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:32.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171400700 1 --1- 172.21.15.50:0/2549082980 >> v1:172.21.15.181:6789/0 conn(0x7fa17406a390 0x7fa17415d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:60414/0 (socket says 172.21.15.50:60414) 2024-09-13T15:10:32.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa172800700 1 --2- 172.21.15.50:0/2549082980 >> v2:172.21.15.50:3300/0 conn(0x7fa17415da60 0x7fa17413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 -- 172.21.15.50:0/2549082980 >> v2:172.21.15.50:3300/0 conn(0x7fa17415da60 msgr2=0x7fa17413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:32.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 --2- 172.21.15.50:0/2549082980 >> v2:172.21.15.50:3300/0 conn(0x7fa17415da60 0x7fa17413f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 -- 172.21.15.50:0/2549082980 >> v1:172.21.15.181:6789/0 conn(0x7fa17406a390 legacy=0x7fa17415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 -- 172.21.15.50:0/2549082980 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17406a890 con 0x7fa1740cf5c0 2024-09-13T15:10:32.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa170a00700 1 -- 172.21.15.50:0/2549082980 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888648372 0 0) 0x7fa1740b2e10 con 0x7fa17406a390 2024-09-13T15:10:32.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa171e00700 1 --2- 172.21.15.50:0/2549082980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1740cf5c0 0x7fa17406b930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa17406bf60 tx=0x7fa164009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a69983aa36c2c538 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa170a00700 1 -- 172.21.15.50:0/2549082980 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164011830 con 0x7fa1740cf5c0 2024-09-13T15:10:32.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa170a00700 1 -- 172.21.15.50:0/2549082980 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164011990 con 0x7fa1740cf5c0 2024-09-13T15:10:32.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa170a00700 1 -- 172.21.15.50:0/2549082980 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164011d20 con 0x7fa1740cf5c0 2024-09-13T15:10:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 -- 172.21.15.50:0/2549082980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1740cf5c0 msgr2=0x7fa17406b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 --2- 172.21.15.50:0/2549082980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1740cf5c0 0x7fa17406b930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa17406bf60 tx=0x7fa164009bf0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 -- 172.21.15.50:0/2549082980 shutdown_connections 2024-09-13T15:10:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 --2- 172.21.15.50:0/2549082980 >> v2:172.21.15.50:3300/0 conn(0x7fa17415da60 0x7fa17413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 --2- 172.21.15.50:0/2549082980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1740cf5c0 0x7fa17406b930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 -- 172.21.15.50:0/2549082980 >> 172.21.15.50:0/2549082980 conn(0x7fa174070d10 msgr2=0x7fa1740710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 -- 172.21.15.50:0/2549082980 shutdown_connections 2024-09-13T15:10:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.502+0000 7fa173200700 1 -- 172.21.15.50:0/2549082980 wait complete. 2024-09-13T15:10:32.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.506+0000 7fa173200700 1 Processor -- start 2024-09-13T15:10:32.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.506+0000 7fa173200700 1 -- start start 2024-09-13T15:10:32.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa17406a390 0x7fa17413c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 0x7fa1740b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa17415da60 0x7fa174152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17413ae90 con 0x7fa1740cf5c0 2024-09-13T15:10:32.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174151e40 con 0x7fa17415da60 2024-09-13T15:10:32.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17413a5f0 con 0x7fa17406a390 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 0x7fa1740b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 0x7fa1740b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42392/0 (socket says 172.21.15.50:42392) 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 -- 172.21.15.50:0/1822617087 learned_addr learned my addr 172.21.15.50:0/1822617087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa172800700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa17415da60 0x7fa174152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171e00700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa17406a390 0x7fa17413c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 -- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa17406a390 msgr2=0x7fa17413c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa17406a390 0x7fa17413c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 -- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa17415da60 msgr2=0x7fa174152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa17415da60 0x7fa174152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 -- 172.21.15.50:0/1822617087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa164009570 con 0x7fa1740cf5c0 2024-09-13T15:10:32.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa171400700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 0x7fa1740b4690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa1600011e0 tx=0x7fa16000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160005cd0 con 0x7fa1740cf5c0 2024-09-13T15:10:32.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160005e30 con 0x7fa1740cf5c0 2024-09-13T15:10:32.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600072f0 con 0x7fa1740cf5c0 2024-09-13T15:10:32.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17413a8d0 con 0x7fa1740cf5c0 2024-09-13T15:10:32.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.510+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17413ac60 con 0x7fa1740cf5c0 2024-09-13T15:10:32.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.514+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa174138880 con 0x7fa1740cf5c0 2024-09-13T15:10:32.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.514+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa160007450 con 0x7fa1740cf5c0 2024-09-13T15:10:32.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.514+0000 7fa16a000700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa154066730 0x7fa154068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.514+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa160083740 con 0x7fa1740cf5c0 2024-09-13T15:10:32.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.518+0000 7fa171e00700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa154066730 0x7fa154068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.518+0000 7fa171e00700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa154066730 0x7fa154068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa164000c00 tx=0x7fa164008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.522+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1600508d0 con 0x7fa1740cf5c0 2024-09-13T15:10:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.698+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa174152230 con 0x7fa1740cf5c0 2024-09-13T15:10:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.698+0000 7fa16a000700 1 -- 172.21.15.50:0/1822617087 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa160053ef0 con 0x7fa1740cf5c0 2024-09-13T15:10:32.700 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa154066730 msgr2=0x7fa154068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa154066730 0x7fa154068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa164000c00 tx=0x7fa164008030 comp rx=0 tx=0).stop 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 msgr2=0x7fa1740b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 0x7fa1740b4690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa1600011e0 tx=0x7fa16000ca30 comp rx=0 tx=0).stop 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 shutdown_connections 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa154066730 0x7fa154068bf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa17415da60 0x7fa174152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1740cf5c0 0x7fa1740b4690 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 --2- 172.21.15.50:0/1822617087 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa17406a390 0x7fa17413c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 >> 172.21.15.50:0/1822617087 conn(0x7fa174070d10 msgr2=0x7fa174159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 shutdown_connections 2024-09-13T15:10:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.702+0000 7fa173200700 1 -- 172.21.15.50:0/1822617087 wait complete. 2024-09-13T15:10:32.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:10:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.910+0000 7f4f24000700 1 Processor -- start 2024-09-13T15:10:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.910+0000 7f4f24000700 1 -- start start 2024-09-13T15:10:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f24000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c1612c0 0x7f4f1c0d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f24000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f1c06bba0 0x7f4f1c070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f24000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c070880 con 0x7f4f1c06ff00 2024-09-13T15:10:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f24000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b3c20 con 0x7f4f1c06bba0 2024-09-13T15:10:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f24000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b3f00 con 0x7f4f1c1612c0 2024-09-13T15:10:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f21600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c1612c0 0x7f4f1c0d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f22000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f1c06bba0 0x7f4f1c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f21600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c1612c0 0x7f4f1c0d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:58086/0 (socket says 172.21.15.50:58086) 2024-09-13T15:10:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f21600700 1 -- 172.21.15.50:0/119812705 learned_addr learned my addr 172.21.15.50:0/119812705 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f22000700 1 -- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c1612c0 msgr2=0x7f4f1c0d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f22000700 1 --2- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c1612c0 0x7f4f1c0d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f22000700 1 -- 172.21.15.50:0/119812705 >> v1:172.21.15.181:6789/0 conn(0x7f4f1c06ff00 legacy=0x7f4f1c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f22000700 1 -- 172.21.15.50:0/119812705 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c0b41e0 con 0x7f4f1c06bba0 2024-09-13T15:10:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.914+0000 7f4f22000700 1 --2- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c070340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009d90 tx=0x7f4f1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2e7fc740d41adf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f1be00700 1 -- 172.21.15.50:0/119812705 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400e070 con 0x7f4f1c06bba0 2024-09-13T15:10:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f1be00700 1 -- 172.21.15.50:0/119812705 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400bb20 con 0x7f4f1c06bba0 2024-09-13T15:10:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f1be00700 1 -- 172.21.15.50:0/119812705 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14012430 con 0x7f4f1c06bba0 2024-09-13T15:10:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 -- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c06bba0 msgr2=0x7f4f1c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 --2- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c070340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009d90 tx=0x7f4f1400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 -- 172.21.15.50:0/119812705 shutdown_connections 2024-09-13T15:10:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 --2- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c070340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 --2- 172.21.15.50:0/119812705 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c1612c0 0x7f4f1c0d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 -- 172.21.15.50:0/119812705 >> 172.21.15.50:0/119812705 conn(0x7f4f1c06e660 msgr2=0x7f4f1c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 -- 172.21.15.50:0/119812705 shutdown_connections 2024-09-13T15:10:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.918+0000 7f4f24000700 1 -- 172.21.15.50:0/119812705 wait complete. 2024-09-13T15:10:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 Processor -- start 2024-09-13T15:10:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 -- start start 2024-09-13T15:10:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c06ff00 0x7f4f1c163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c1612c0 0x7f4f1c1f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c161ea0 con 0x7f4f1c06bba0 2024-09-13T15:10:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c161a30 con 0x7f4f1c1612c0 2024-09-13T15:10:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f24000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c1eb860 con 0x7f4f1c06ff00 2024-09-13T15:10:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f21600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f21600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42408/0 (socket says 172.21.15.50:42408) 2024-09-13T15:10:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f21600700 1 -- 172.21.15.50:0/18318578 learned_addr learned my addr 172.21.15.50:0/18318578 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f20c00700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c06ff00 0x7f4f1c163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.922+0000 7f4f22000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c1612c0 0x7f4f1c1f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f21600700 1 -- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c06ff00 msgr2=0x7f4f1c163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f21600700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c06ff00 0x7f4f1c163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f21600700 1 -- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c1612c0 msgr2=0x7f4f1c1f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f21600700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c1612c0 0x7f4f1c1f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f21600700 1 -- 172.21.15.50:0/18318578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14009a70 con 0x7f4f1c06bba0 2024-09-13T15:10:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f21600700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c1548c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000e890 tx=0x7f4f1000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10009620 con 0x7f4f1c06bba0 2024-09-13T15:10:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10013680 con 0x7f4f1c06bba0 2024-09-13T15:10:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10013a30 con 0x7f4f1c06bba0 2024-09-13T15:10:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c1ebb40 con 0x7f4f1c06bba0 2024-09-13T15:10:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c1ec3e0 con 0x7f4f1c06bba0 2024-09-13T15:10:32.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.926+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c070340 con 0x7f4f1c06bba0 2024-09-13T15:10:32.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.930+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f10013b90 con 0x7f4f1c06bba0 2024-09-13T15:10:32.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.930+0000 7f4f19600700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4efc066730 0x7f4efc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:32.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.930+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f10084140 con 0x7f4f1c06bba0 2024-09-13T15:10:32.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.930+0000 7f4f20c00700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4efc066730 0x7f4efc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:32.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.934+0000 7f4f20c00700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4efc066730 0x7f4efc068bf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c1eaae0 tx=0x7f4f08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:32.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:32.938+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f100512d0 con 0x7f4f1c06bba0 2024-09-13T15:10:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.130+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f1c15e500 con 0x7f4f1c06bba0 2024-09-13T15:10:33.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.130+0000 7f4f19600700 1 -- 172.21.15.50:0/18318578 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f100548f0 con 0x7f4f1c06bba0 2024-09-13T15:10:33.131 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:10:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.130+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4efc066730 msgr2=0x7f4efc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.130+0000 7f4f24000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4efc066730 0x7f4efc068bf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c1eaae0 tx=0x7f4f08009040 comp rx=0 tx=0).stop 2024-09-13T15:10:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.130+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 msgr2=0x7f4f1c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.130+0000 7f4f24000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c1548c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000e890 tx=0x7f4f1000eba0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 shutdown_connections 2024-09-13T15:10:33.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4efc066730 0x7f4efc068bf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1c1612c0 0x7f4f1c1f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4f1c06ff00 0x7f4f1c163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 --2- 172.21.15.50:0/18318578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f1c06bba0 0x7f4f1c1548c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 >> 172.21.15.50:0/18318578 conn(0x7f4f1c06e660 msgr2=0x7f4f1c06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 shutdown_connections 2024-09-13T15:10:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.134+0000 7f4f24000700 1 -- 172.21.15.50:0/18318578 wait complete. 2024-09-13T15:10:33.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:10:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.330+0000 7f3c90400700 1 Processor -- start 2024-09-13T15:10:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.330+0000 7f3c90400700 1 -- start start 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c90400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 0x7f3c8806a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c90400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880ad480 con 0x7f3c881573b0 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c90400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c88157790 con 0x7f3c8806ab10 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c90400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8806af30 con 0x7f3c880ce4c0 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c8da00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c881573b0 0x7f3c880cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58094/0 (socket says 172.21.15.50:58094) 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c8da00700 1 -- 172.21.15.50:0/2796359475 learned_addr learned my addr 172.21.15.50:0/2796359475 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c8d000700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 0x7f3c8806a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193151953 0 0) 0x7f3c880ad480 con 0x7f3c881573b0 2024-09-13T15:10:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c700035d0 con 0x7f3c881573b0 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 185117010 0 0) 0x7f3c700035d0 con 0x7f3c881573b0 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 msgr2=0x7f3c8806a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 0x7f3c8806a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 >> v1:172.21.15.181:6789/0 conn(0x7f3c8806ab10 legacy=0x7f3c8806ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880ad6d0 con 0x7f3c881573b0 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f3c7c001670 con 0x7f3c881573b0 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 >> v1:172.21.15.50:6789/0 conn(0x7f3c881573b0 legacy=0x7f3c880cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c70003a50 0x7f3c70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c70004870 0x7f3c70004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 0x7f3c70005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8806af30 con 0x7f3c70003a50 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7000bb90 con 0x7f3c70004870 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.334+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7000bd50 con 0x7f3c880ce4c0 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c70003a50 0x7f3c70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8d000700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c70004870 0x7f3c70004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8e400700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 0x7f3c70005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 -- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 msgr2=0x7f3c70005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c880ce4c0 0x7f3c70005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 -- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c70004870 msgr2=0x7f3c70004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c70004870 0x7f3c70004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 -- 172.21.15.50:0/2796359475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700035d0 con 0x7f3c70003a50 2024-09-13T15:10:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8d000700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c70004870 0x7f3c70004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8da00700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c70003a50 0x7f3c70003e70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c320 tx=0x7f3c700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e4ff71b0eca421 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c007c30 con 0x7f3c70003a50 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c00ce80 con 0x7f3c70003a50 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c87e00700 1 -- 172.21.15.50:0/2796359475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c005bc0 con 0x7f3c70003a50 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c90400700 1 -- 172.21.15.50:0/2796359475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c70003a50 msgr2=0x7f3c70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c90400700 1 --2- 172.21.15.50:0/2796359475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c70003a50 0x7f3c70003e70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c320 tx=0x7f3c700058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c8e400700 1 -- 172.21.15.50:0/2796359475 reap_dead start 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c90400700 1 -- 172.21.15.50:0/2796359475 shutdown_connections 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c90400700 1 -- 172.21.15.50:0/2796359475 >> 172.21.15.50:0/2796359475 conn(0x7f3c880b08d0 msgr2=0x7f3c880b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c90400700 1 -- 172.21.15.50:0/2796359475 shutdown_connections 2024-09-13T15:10:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.338+0000 7f3c90400700 1 -- 172.21.15.50:0/2796359475 wait complete. 2024-09-13T15:10:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 Processor -- start 2024-09-13T15:10:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 -- start start 2024-09-13T15:10:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c70003a50 0x7f3c88157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 0x7f3c880b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8814d4a0 0x7f3c881559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8815b5f0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8815b780 con 0x7f3c8814d4a0 2024-09-13T15:10:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c90400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880b3b80 con 0x7f3c70003a50 2024-09-13T15:10:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 0x7f3c880b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 0x7f3c880b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48398/0 (socket says 172.21.15.50:48398) 2024-09-13T15:10:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 -- 172.21.15.50:0/3370042483 learned_addr learned my addr 172.21.15.50:0/3370042483 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:33.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8da00700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c70003a50 0x7f3c88157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8e400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8814d4a0 0x7f3c881559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 -- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c70003a50 msgr2=0x7f3c88157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c70003a50 0x7f3c88157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 -- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8814d4a0 msgr2=0x7f3c881559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8814d4a0 0x7f3c881559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 -- 172.21.15.50:0/3370042483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88157fd0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8e400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8814d4a0 0x7f3c881559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:33.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.342+0000 7f3c8d000700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 0x7f3c880b3640 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3c740118d0 tx=0x7f3c74011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74004220 con 0x7f3c881f2bc0 2024-09-13T15:10:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74004380 con 0x7f3c881f2bc0 2024-09-13T15:10:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c881582b0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c740036c0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c88158870 con 0x7f3c881f2bc0 2024-09-13T15:10:33.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8806a5d0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.346+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c74003820 con 0x7f3c881f2bc0 2024-09-13T15:10:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.350+0000 7f3c85600700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3c68066730 0x7f3c68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.350+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3c74084760 con 0x7f3c881f2bc0 2024-09-13T15:10:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.350+0000 7f3c8da00700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3c68066730 0x7f3c68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.350+0000 7f3c8da00700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3c68066730 0x7f3c68068bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.358+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c740518f0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.558+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c881615c0 con 0x7f3c881f2bc0 2024-09-13T15:10:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.558+0000 7f3c85600700 1 -- 172.21.15.50:0/3370042483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c74054f10 con 0x7f3c881f2bc0 2024-09-13T15:10:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3c68066730 msgr2=0x7f3c68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3c68066730 0x7f3c68068bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c007000 comp rx=0 tx=0).stop 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 msgr2=0x7f3c880b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 0x7f3c880b3640 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3c740118d0 tx=0x7f3c74011c90 comp rx=0 tx=0).stop 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 shutdown_connections 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3c68066730 0x7f3c68068bf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c8814d4a0 0x7f3c881559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c881f2bc0 0x7f3c880b3640 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 --2- 172.21.15.50:0/3370042483 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3c70003a50 0x7f3c88157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 >> 172.21.15.50:0/3370042483 conn(0x7f3c880b08d0 msgr2=0x7f3c8815d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 shutdown_connections 2024-09-13T15:10:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.562+0000 7f3c90400700 1 -- 172.21.15.50:0/3370042483 wait complete. 2024-09-13T15:10:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:10:33.587 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:10:33.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:33.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:10:33.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:10:33.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:33.631 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:10:33.692 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:33.692 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:33.710 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:33.710 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:33.769 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:33.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.974+0000 7f46aa600700 1 Processor -- start 2024-09-13T15:10:33.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46aa600700 1 -- start start 2024-09-13T15:10:33.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46aa600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46a406aaa0 0x7f46a406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46aa600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a40b2670 0x7f46a40b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46aa600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40b3040 con 0x7f46a41610b0 2024-09-13T15:10:33.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46aa600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a4070b30 con 0x7f46a406aaa0 2024-09-13T15:10:33.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46aa600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a406b450 con 0x7f46a40b2670 2024-09-13T15:10:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46a9200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46a41610b0 0x7f46a40719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58100/0 (socket says 172.21.15.50:58100) 2024-09-13T15:10:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46a9200700 1 -- 172.21.15.50:0/3870717475 learned_addr learned my addr 172.21.15.50:0/3870717475 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46a3e00700 1 --2- 172.21.15.50:0/3870717475 >> v2:172.21.15.50:3300/0 conn(0x7f46a406aaa0 0x7f46a406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46a9c00700 1 --2- 172.21.15.50:0/3870717475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a40b2670 0x7f46a40b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46a3400700 1 -- 172.21.15.50:0/3870717475 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674770193 0 0) 0x7f4698001490 con 0x7f46a41610b0 2024-09-13T15:10:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.978+0000 7f46a3400700 1 -- 172.21.15.50:0/3870717475 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c0035d0 con 0x7f46a41610b0 2024-09-13T15:10:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3e00700 1 -- 172.21.15.50:0/3870717475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a40b2670 msgr2=0x7f46a40b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3e00700 1 --2- 172.21.15.50:0/3870717475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a40b2670 0x7f46a40b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3e00700 1 -- 172.21.15.50:0/3870717475 >> v1:172.21.15.50:6789/0 conn(0x7f46a41610b0 legacy=0x7f46a40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3e00700 1 -- 172.21.15.50:0/3870717475 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40b3560 con 0x7f46a406aaa0 2024-09-13T15:10:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3e00700 1 --2- 172.21.15.50:0/3870717475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a406aaa0 0x7f46a406af10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4690009880 tx=0x7f4690009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1a454bbd10f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3400700 1 -- 172.21.15.50:0/3870717475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690011830 con 0x7f46a406aaa0 2024-09-13T15:10:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3400700 1 -- 172.21.15.50:0/3870717475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690011990 con 0x7f46a406aaa0 2024-09-13T15:10:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46a3400700 1 -- 172.21.15.50:0/3870717475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690011d20 con 0x7f46a406aaa0 2024-09-13T15:10:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 -- 172.21.15.50:0/3870717475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a406aaa0 msgr2=0x7f46a406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 --2- 172.21.15.50:0/3870717475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a406aaa0 0x7f46a406af10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4690009880 tx=0x7f4690009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 -- 172.21.15.50:0/3870717475 shutdown_connections 2024-09-13T15:10:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 --2- 172.21.15.50:0/3870717475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a40b2670 0x7f46a40b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 --2- 172.21.15.50:0/3870717475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a406aaa0 0x7f46a406af10 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 -- 172.21.15.50:0/3870717475 >> 172.21.15.50:0/3870717475 conn(0x7f46a40b0c40 msgr2=0x7f46a406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 -- 172.21.15.50:0/3870717475 shutdown_connections 2024-09-13T15:10:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.982+0000 7f46aa600700 1 -- 172.21.15.50:0/3870717475 wait complete. 2024-09-13T15:10:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 Processor -- start 2024-09-13T15:10:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 -- start start 2024-09-13T15:10:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a406aaa0 0x7f46a41f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 0x7f46a4158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a41610b0 0x7f46a4164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a41f68e0 con 0x7f46a40b2670 2024-09-13T15:10:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4158950 con 0x7f46a41610b0 2024-09-13T15:10:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46aa600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a41635a0 con 0x7f46a406aaa0 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 0x7f46a4158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 0x7f46a4158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48420/0 (socket says 172.21.15.50:48420) 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 -- 172.21.15.50:0/1719917906 learned_addr learned my addr 172.21.15.50:0/1719917906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a9200700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a406aaa0 0x7f46a41f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a9c00700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a41610b0 0x7f46a4164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 -- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a406aaa0 msgr2=0x7f46a41f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a406aaa0 0x7f46a41f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 -- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a41610b0 msgr2=0x7f46a4164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a41610b0 0x7f46a4164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a3e00700 1 -- 172.21.15.50:0/1719917906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46900094b0 con 0x7f46a40b2670 2024-09-13T15:10:33.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.986+0000 7f46a9c00700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a41610b0 0x7f46a4164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46a3e00700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 0x7f46a4158410 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f46900090b0 tx=0x7f4690004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690004480 con 0x7f46a40b2670 2024-09-13T15:10:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469001f070 con 0x7f46a40b2670 2024-09-13T15:10:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900038e0 con 0x7f46a40b2670 2024-09-13T15:10:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a4162a20 con 0x7f46a40b2670 2024-09-13T15:10:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a4162fe0 con 0x7f46a40b2670 2024-09-13T15:10:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.990+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a4161490 con 0x7f46a40b2670 2024-09-13T15:10:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.994+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4690021030 con 0x7f46a40b2670 2024-09-13T15:10:33.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.994+0000 7f46a0c00700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4684066730 0x7f4684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:33.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.994+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f46900855f0 con 0x7f46a40b2670 2024-09-13T15:10:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.994+0000 7f46a9200700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4684066730 0x7f4684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:33.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:33.994+0000 7f46a9200700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4684066730 0x7f4684068bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46980015f0 tx=0x7f4698001a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.002+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4690052930 con 0x7f46a40b2670 2024-09-13T15:10:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.194+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a41f6a20 con 0x7f46a40b2670 2024-09-13T15:10:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.198+0000 7f46a0c00700 1 -- 172.21.15.50:0/1719917906 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16704 (secure 0 0 0) 0x7f4690055f50 con 0x7f46a40b2670 2024-09-13T15:10:34.199 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:34.200 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:18.166138+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.198+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4684066730 msgr2=0x7f4684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.198+0000 7f46aa600700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4684066730 0x7f4684068bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46980015f0 tx=0x7f4698001a00 comp rx=0 tx=0).stop 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.198+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 msgr2=0x7f46a4158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.198+0000 7f46aa600700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 0x7f46a4158410 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f46900090b0 tx=0x7f4690004770 comp rx=0 tx=0).stop 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 shutdown_connections 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4684066730 0x7f4684068bf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46a41610b0 0x7f46a4164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a40b2670 0x7f46a4158410 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 --2- 172.21.15.50:0/1719917906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46a406aaa0 0x7f46a41f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 >> 172.21.15.50:0/1719917906 conn(0x7f46a40b0c40 msgr2=0x7f46a415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 shutdown_connections 2024-09-13T15:10:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.202+0000 7f46aa600700 1 -- 172.21.15.50:0/1719917906 wait complete. 2024-09-13T15:10:34.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:10:15.256899+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:10:16.172392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:34.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.394+0000 7f6ceb800700 1 Processor -- start 2024-09-13T15:10:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.398+0000 7f6ceb800700 1 -- start start 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.398+0000 7f6ceb800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ce40cfac0 0x7f6ce40d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.398+0000 7f6ceb800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6ce415e720 0x7f6ce415eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.398+0000 7f6ceb800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40d0780 con 0x7f6ce4143b60 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.398+0000 7f6ceb800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce415f710 con 0x7f6ce40cfac0 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.398+0000 7f6ceb800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40d19e0 con 0x7f6ce415e720 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ce40cfac0 0x7f6ce40d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ce40cfac0 0x7f6ce40d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48422/0 (socket says 172.21.15.50:48422) 2024-09-13T15:10:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 -- 172.21.15.50:0/2586522352 learned_addr learned my addr 172.21.15.50:0/2586522352 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce9800700 1 --2- 172.21.15.50:0/2586522352 >> v2:172.21.15.181:3300/0 conn(0x7f6ce415e720 0x7f6ce415eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 -- 172.21.15.50:0/2586522352 >> v2:172.21.15.181:3300/0 conn(0x7f6ce415e720 msgr2=0x7f6ce415eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 --2- 172.21.15.50:0/2586522352 >> v2:172.21.15.181:3300/0 conn(0x7f6ce415e720 0x7f6ce415eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 -- 172.21.15.50:0/2586522352 >> v1:172.21.15.181:6789/0 conn(0x7f6ce4143b60 legacy=0x7f6ce40cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 -- 172.21.15.50:0/2586522352 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4143f40 con 0x7f6ce40cfac0 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3e00700 1 --2- 172.21.15.50:0/2586522352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce40cfac0 0x7f6ce40d14a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40ceb50 tx=0x7f6cd0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6566323c9b412b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3400700 1 -- 172.21.15.50:0/2586522352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd000ba20 con 0x7f6ce40cfac0 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3400700 1 -- 172.21.15.50:0/2586522352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd000bb80 con 0x7f6ce40cfac0 2024-09-13T15:10:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ce3400700 1 -- 172.21.15.50:0/2586522352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0009e60 con 0x7f6ce40cfac0 2024-09-13T15:10:34.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 -- 172.21.15.50:0/2586522352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce40cfac0 msgr2=0x7f6ce40d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 --2- 172.21.15.50:0/2586522352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce40cfac0 0x7f6ce40d14a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40ceb50 tx=0x7f6cd0009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:34.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 -- 172.21.15.50:0/2586522352 shutdown_connections 2024-09-13T15:10:34.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 --2- 172.21.15.50:0/2586522352 >> v2:172.21.15.181:3300/0 conn(0x7f6ce415e720 0x7f6ce415eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 --2- 172.21.15.50:0/2586522352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce40cfac0 0x7f6ce40d14a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 -- 172.21.15.50:0/2586522352 >> 172.21.15.50:0/2586522352 conn(0x7f6ce406e660 msgr2=0x7f6ce406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:34.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 -- 172.21.15.50:0/2586522352 shutdown_connections 2024-09-13T15:10:34.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.402+0000 7f6ceb800700 1 -- 172.21.15.50:0/2586522352 wait complete. 2024-09-13T15:10:34.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.406+0000 7f6ceb800700 1 Processor -- start 2024-09-13T15:10:34.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.406+0000 7f6ceb800700 1 -- start start 2024-09-13T15:10:34.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ce40cfac0 0x7f6ce413fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ce4143b60 0x7f6ce413f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 0x7f6ce4141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41405d0 con 0x7f6ce415e720 2024-09-13T15:10:34.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41408b0 con 0x7f6ce40cfac0 2024-09-13T15:10:34.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4140b90 con 0x7f6ce4143b60 2024-09-13T15:10:34.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 0x7f6ce4141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 0x7f6ce4141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48426/0 (socket says 172.21.15.50:48426) 2024-09-13T15:10:34.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 -- 172.21.15.50:0/3990836132 learned_addr learned my addr 172.21.15.50:0/3990836132 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:34.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce8e00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ce40cfac0 0x7f6ce413fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce3e00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ce4143b60 0x7f6ce413f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 -- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ce4143b60 msgr2=0x7f6ce413f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ce4143b60 0x7f6ce413f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 -- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ce40cfac0 msgr2=0x7f6ce413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ce40cfac0 0x7f6ce413fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 -- 172.21.15.50:0/3990836132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009570 con 0x7f6ce415e720 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce3e00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ce4143b60 0x7f6ce413f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce8e00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ce40cfac0 0x7f6ce413fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce9800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 0x7f6ce4141670 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc007e40 tx=0x7f6cdc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00eea0 con 0x7f6ce415e720 2024-09-13T15:10:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc014420 con 0x7f6ce415e720 2024-09-13T15:10:34.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce4140e70 con 0x7f6ce415e720 2024-09-13T15:10:34.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0147b0 con 0x7f6ce415e720 2024-09-13T15:10:34.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.410+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce41402c0 con 0x7f6ce415e720 2024-09-13T15:10:34.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.414+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4141390 con 0x7f6ce415e720 2024-09-13T15:10:34.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.414+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6cdc014910 con 0x7f6ce415e720 2024-09-13T15:10:34.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.418+0000 7f6ce0c00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cc4066730 0x7f6cc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.418+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6cdc084b70 con 0x7f6ce415e720 2024-09-13T15:10:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.418+0000 7f6ce8e00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cc4066730 0x7f6cc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.418+0000 7f6ce8e00700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cc4066730 0x7f6cc4068bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8000f60 tx=0x7f6cd8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.426+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ce4141390 con 0x7f6ce415e720 2024-09-13T15:10:34.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.610+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ce4141390 con 0x7f6ce415e720 2024-09-13T15:10:34.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.610+0000 7f6ce0c00700 1 -- 172.21.15.50:0/3990836132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ce4141390 con 0x7f6ce415e720 2024-09-13T15:10:34.614 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cc4066730 msgr2=0x7f6cc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cc4066730 0x7f6cc4068bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8000f60 tx=0x7f6cd8009040 comp rx=0 tx=0).stop 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 msgr2=0x7f6ce4141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 0x7f6ce4141670 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc007e40 tx=0x7f6cdc00e3c0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 shutdown_connections 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cc4066730 0x7f6cc4068bf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce415e720 0x7f6ce4141670 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6ce4143b60 0x7f6ce413f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 --2- 172.21.15.50:0/3990836132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ce40cfac0 0x7f6ce413fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 >> 172.21.15.50:0/3990836132 conn(0x7f6ce406e660 msgr2=0x7f6ce40b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 shutdown_connections 2024-09-13T15:10:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.614+0000 7f6ceb800700 1 -- 172.21.15.50:0/3990836132 wait complete. 2024-09-13T15:10:34.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:10:34.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.818+0000 7fc31f200700 1 Processor -- start 2024-09-13T15:10:34.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.818+0000 7fc31f200700 1 -- start start 2024-09-13T15:10:34.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31f200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc32006c5a0 0x7fc32015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc3200b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3200b2540 0x7fc3200b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31f200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3200b4680 con 0x7fc3200b2540 2024-09-13T15:10:34.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31f200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3200b4960 con 0x7fc32006c5a0 2024-09-13T15:10:34.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200cf030 con 0x7fc32006c980 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3200b2540 0x7fc3200b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3200b2540 0x7fc3200b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48432/0 (socket says 172.21.15.50:48432) 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 -- 172.21.15.50:0/1534593001 learned_addr learned my addr 172.21.15.50:0/1534593001 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31de00700 1 --2- 172.21.15.50:0/1534593001 >> v2:172.21.15.181:3300/0 conn(0x7fc32006c5a0 0x7fc32015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31d400700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc3200b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 -- 172.21.15.50:0/1534593001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 msgr2=0x7fc3200b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc3200b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 -- 172.21.15.50:0/1534593001 >> v2:172.21.15.181:3300/0 conn(0x7fc32006c5a0 msgr2=0x7fc32015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 --2- 172.21.15.50:0/1534593001 >> v2:172.21.15.181:3300/0 conn(0x7fc32006c5a0 0x7fc32015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 -- 172.21.15.50:0/1534593001 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200cf310 con 0x7fc3200b2540 2024-09-13T15:10:34.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31d400700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc3200b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:34.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.822+0000 7fc31e800700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc3200b2970 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b3650 tx=0x7fc31800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ddd49815e9f67d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31ca00700 1 -- 172.21.15.50:0/1534593001 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800e070 con 0x7fc3200b2540 2024-09-13T15:10:34.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31ca00700 1 -- 172.21.15.50:0/1534593001 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800b910 con 0x7fc3200b2540 2024-09-13T15:10:34.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31ca00700 1 -- 172.21.15.50:0/1534593001 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800bcc0 con 0x7fc3200b2540 2024-09-13T15:10:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 -- 172.21.15.50:0/1534593001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 msgr2=0x7fc3200b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc3200b2970 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b3650 tx=0x7fc31800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 -- 172.21.15.50:0/1534593001 shutdown_connections 2024-09-13T15:10:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc3200b2970 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 --2- 172.21.15.50:0/1534593001 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc3200b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 --2- 172.21.15.50:0/1534593001 >> v2:172.21.15.181:3300/0 conn(0x7fc32006c5a0 0x7fc32015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 -- 172.21.15.50:0/1534593001 >> 172.21.15.50:0/1534593001 conn(0x7fc320071d20 msgr2=0x7fc320072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 -- 172.21.15.50:0/1534593001 shutdown_connections 2024-09-13T15:10:34.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.826+0000 7fc31f200700 1 -- 172.21.15.50:0/1534593001 wait complete. 2024-09-13T15:10:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 Processor -- start 2024-09-13T15:10:34.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 -- start start 2024-09-13T15:10:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc32006c5a0 0x7fc32013d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc320157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc320158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32015bbf0 con 0x7fc3200b2540 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3201589a0 con 0x7fc32006c5a0 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc320158c80 con 0x7fc32006c980 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc320158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc320158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48436/0 (socket says 172.21.15.50:48436) 2024-09-13T15:10:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 -- 172.21.15.50:0/2439495811 learned_addr learned my addr 172.21.15.50:0/2439495811 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31de00700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc32006c5a0 0x7fc32013d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31d400700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc320157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 -- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 msgr2=0x7fc320157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc320157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 -- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc32006c5a0 msgr2=0x7fc32013d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc32006c5a0 0x7fc32013d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31e800700 1 -- 172.21.15.50:0/2439495811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009b30 con 0x7fc3200b2540 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.830+0000 7fc31d400700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc320157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc31e800700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc320158320 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b5fa0 tx=0x7fc318004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180099b0 con 0x7fc3200b2540 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318004250 con 0x7fc3200b2540 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32015be40 con 0x7fc3200b2540 2024-09-13T15:10:34.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318004600 con 0x7fc3200b2540 2024-09-13T15:10:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32014e260 con 0x7fc3200b2540 2024-09-13T15:10:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc320158e40 con 0x7fc3200b2540 2024-09-13T15:10:34.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.834+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc318004760 con 0x7fc3200b2540 2024-09-13T15:10:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.838+0000 7fc316000700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc300066730 0x7fc300068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.838+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3180853c0 con 0x7fc3200b2540 2024-09-13T15:10:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.838+0000 7fc31de00700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc300066730 0x7fc300068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.838+0000 7fc31de00700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc300066730 0x7fc300068bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc310009b70 tx=0x7fc310009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:34.842+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc320158e40 con 0x7fc3200b2540 2024-09-13T15:10:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.026+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc320158e40 con 0x7fc3200b2540 2024-09-13T15:10:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.030+0000 7fc316000700 1 -- 172.21.15.50:0/2439495811 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc320158e40 con 0x7fc3200b2540 2024-09-13T15:10:35.030 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:10:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc300066730 msgr2=0x7fc300068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc300066730 0x7fc300068bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc310009b70 tx=0x7fc310009240 comp rx=0 tx=0).stop 2024-09-13T15:10:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 msgr2=0x7fc320158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc320158320 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b5fa0 tx=0x7fc318004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 shutdown_connections 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc300066730 0x7fc300068bf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3200b2540 0x7fc320158320 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc32006c980 0x7fc320157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 --2- 172.21.15.50:0/2439495811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc32006c5a0 0x7fc32013d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 >> 172.21.15.50:0/2439495811 conn(0x7fc320071d20 msgr2=0x7fc3200cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 shutdown_connections 2024-09-13T15:10:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.034+0000 7fc31f200700 1 -- 172.21.15.50:0/2439495811 wait complete. 2024-09-13T15:10:35.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:10:35.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.234+0000 7f4463200700 1 Processor -- start 2024-09-13T15:10:35.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.234+0000 7f4463200700 1 -- start start 2024-09-13T15:10:35.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4463200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640c3e30 0x7f44640ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4463200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44640c5030 0x7f44640c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4463200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44640c5490 con 0x7f44640ca6f0 2024-09-13T15:10:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4463200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44640c4a70 con 0x7f44640c5030 2024-09-13T15:10:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4463200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640c4d50 con 0x7f44640c3e30 2024-09-13T15:10:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44640c5030 0x7f44640c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44640c5030 0x7f44640c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48442/0 (socket says 172.21.15.50:48442) 2024-09-13T15:10:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 -- 172.21.15.50:0/2531032634 learned_addr learned my addr 172.21.15.50:0/2531032634 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461e00700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640c3e30 0x7f44640ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 -- 172.21.15.50:0/2531032634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640c3e30 msgr2=0x7f44640ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640c3e30 0x7f44640ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 -- 172.21.15.50:0/2531032634 >> v1:172.21.15.181:6789/0 conn(0x7f44640ca6f0 legacy=0x7f446406c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461400700 1 -- 172.21.15.50:0/2531032634 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44640c5880 con 0x7f44640c5030 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.238+0000 7f4461e00700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640c3e30 0x7f44640ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4461400700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c5030 0x7f44640c4210 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4450009940 tx=0x7f4450009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e586ebae63b0a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4460a00700 1 -- 172.21.15.50:0/2531032634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450004230 con 0x7f44640c5030 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4460a00700 1 -- 172.21.15.50:0/2531032634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450009e90 con 0x7f44640c5030 2024-09-13T15:10:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4460a00700 1 -- 172.21.15.50:0/2531032634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500045b0 con 0x7f44640c5030 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 -- 172.21.15.50:0/2531032634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c5030 msgr2=0x7f44640c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c5030 0x7f44640c4210 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4450009940 tx=0x7f4450009c50 comp rx=0 tx=0).stop 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 -- 172.21.15.50:0/2531032634 shutdown_connections 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c5030 0x7f44640c4210 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 --2- 172.21.15.50:0/2531032634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640c3e30 0x7f44640ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 -- 172.21.15.50:0/2531032634 >> 172.21.15.50:0/2531032634 conn(0x7f44640cef90 msgr2=0x7f44640cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 -- 172.21.15.50:0/2531032634 shutdown_connections 2024-09-13T15:10:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 -- 172.21.15.50:0/2531032634 wait complete. 2024-09-13T15:10:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 Processor -- start 2024-09-13T15:10:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.242+0000 7f4463200700 1 -- start start 2024-09-13T15:10:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 0x7f4464154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44640c5030 0x7f44640c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640ca6f0 0x7f44641e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446415c130 con 0x7f44640c3e30 2024-09-13T15:10:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44641e6600 con 0x7f44640c5030 2024-09-13T15:10:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44641e68e0 con 0x7f44640ca6f0 2024-09-13T15:10:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 0x7f4464154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4462800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640ca6f0 0x7f44641e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 0x7f4464154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48454/0 (socket says 172.21.15.50:48454) 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 -- 172.21.15.50:0/2933638079 learned_addr learned my addr 172.21.15.50:0/2933638079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461400700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44640c5030 0x7f44640c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 -- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640ca6f0 msgr2=0x7f44641e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640ca6f0 0x7f44641e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 -- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44640c5030 msgr2=0x7f44640c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44640c5030 0x7f44640c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 -- 172.21.15.50:0/2933638079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009570 con 0x7f44640c3e30 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461400700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44640c5030 0x7f44640c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4461e00700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 0x7f4464154850 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f445400c7c0 tx=0x7f445400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4454011800 con 0x7f44640c3e30 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4454011960 con 0x7f44640c3e30 2024-09-13T15:10:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4464155890 con 0x7f44640c3e30 2024-09-13T15:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4454011cf0 con 0x7f44640c3e30 2024-09-13T15:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.246+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4464155e50 con 0x7f44640c3e30 2024-09-13T15:10:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.250+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44640caba0 con 0x7f44640c3e30 2024-09-13T15:10:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.250+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4454021350 con 0x7f44640c3e30 2024-09-13T15:10:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.250+0000 7f445a000700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4444066800 0x7f4444068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.250+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44540841a0 con 0x7f44640c3e30 2024-09-13T15:10:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.254+0000 7f4461400700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4444066800 0x7f4444068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.254+0000 7f4461400700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4444066800 0x7f4444068cc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4450009940 tx=0x7f4450008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:35.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.258+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44540513c0 con 0x7f44640c3e30 2024-09-13T15:10:35.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.449+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44640c44c0 con 0x7f44640c3e30 2024-09-13T15:10:35.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.453+0000 7f445a000700 1 -- 172.21.15.50:0/2933638079 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44540549e0 con 0x7f44640c3e30 2024-09-13T15:10:35.456 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:10:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4444066800 msgr2=0x7f4444068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4444066800 0x7f4444068cc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4450009940 tx=0x7f4450008030 comp rx=0 tx=0).stop 2024-09-13T15:10:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 msgr2=0x7f4464154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 0x7f4464154850 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f445400c7c0 tx=0x7f445400cad0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 shutdown_connections 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4444066800 0x7f4444068cc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44640ca6f0 0x7f44641e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44640c5030 0x7f44640c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 --2- 172.21.15.50:0/2933638079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44640c3e30 0x7f4464154850 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 >> 172.21.15.50:0/2933638079 conn(0x7f44640cef90 msgr2=0x7f44640b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 shutdown_connections 2024-09-13T15:10:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.457+0000 7f4463200700 1 -- 172.21.15.50:0/2933638079 wait complete. 2024-09-13T15:10:35.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:10:35.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:35.659 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:35.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.657+0000 7f28a5a00700 1 Processor -- start 2024-09-13T15:10:35.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.657+0000 7f28a5a00700 1 -- start start 2024-09-13T15:10:35.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28a006bab0 0x7f28a0071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28a01584e0 0x7f28a006b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58110/0 (socket says 172.21.15.50:58110) 2024-09-13T15:10:35.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289fe00700 1 -- 172.21.15.50:0/496672461 learned_addr learned my addr 172.21.15.50:0/496672461 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:35.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a015bbc0 con 0x7f28a01584e0 2024-09-13T15:10:35.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a015ade0 con 0x7f28a006bab0 2024-09-13T15:10:35.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a015aff0 con 0x7f28a00ccd20 2024-09-13T15:10:35.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f2897400700 1 --2- 172.21.15.50:0/496672461 >> v2:172.21.15.50:3300/0 conn(0x7f28a006bab0 0x7f28a0071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289f400700 1 -- 172.21.15.50:0/496672461 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041810626 0 0) 0x7f28a015bbc0 con 0x7f28a01584e0 2024-09-13T15:10:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5000700 1 --2- 172.21.15.50:0/496672461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289f400700 1 -- 172.21.15.50:0/496672461 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28840035d0 con 0x7f28a01584e0 2024-09-13T15:10:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f2897400700 1 -- 172.21.15.50:0/496672461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 msgr2=0x7f28a00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f2897400700 1 --2- 172.21.15.50:0/496672461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f2897400700 1 -- 172.21.15.50:0/496672461 >> v1:172.21.15.50:6789/0 conn(0x7f28a01584e0 legacy=0x7f28a006b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f2897400700 1 -- 172.21.15.50:0/496672461 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a015b290 con 0x7f28a006bab0 2024-09-13T15:10:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f2897400700 1 --2- 172.21.15.50:0/496672461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a006bab0 0x7f28a0071300 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2890009850 tx=0x7f2890009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf51ab2b786c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289f400700 1 -- 172.21.15.50:0/496672461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890011830 con 0x7f28a006bab0 2024-09-13T15:10:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289f400700 1 -- 172.21.15.50:0/496672461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890011990 con 0x7f28a006bab0 2024-09-13T15:10:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f289f400700 1 -- 172.21.15.50:0/496672461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890011d40 con 0x7f28a006bab0 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a006bab0 msgr2=0x7f28a0071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 --2- 172.21.15.50:0/496672461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a006bab0 0x7f28a0071300 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2890009850 tx=0x7f2890009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 shutdown_connections 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 --2- 172.21.15.50:0/496672461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 --2- 172.21.15.50:0/496672461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a006bab0 0x7f28a0071300 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.661+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 >> 172.21.15.50:0/496672461 conn(0x7f28a00b1600 msgr2=0x7f28a00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 shutdown_connections 2024-09-13T15:10:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 -- 172.21.15.50:0/496672461 wait complete. 2024-09-13T15:10:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 Processor -- start 2024-09-13T15:10:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 -- start start 2024-09-13T15:10:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28a006bab0 0x7f28a01564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 0x7f28a00c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00c5060 con 0x7f28a01584e0 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0156a00 con 0x7f28a006bab0 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.665+0000 7f28a5a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00c6880 con 0x7f28a00ccd20 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 0x7f28a00c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 0x7f28a00c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48470/0 (socket says 172.21.15.50:48470) 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 -- 172.21.15.50:0/1353060341 learned_addr learned my addr 172.21.15.50:0/1353060341 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f289fe00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28a006bab0 0x7f28a01564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f2897400700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 -- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 msgr2=0x7f28a00c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 -- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28a006bab0 msgr2=0x7f28a01564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28a006bab0 0x7f28a01564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 -- 172.21.15.50:0/1353060341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900094b0 con 0x7f28a01584e0 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5000700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 0x7f28a00c54f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2898007e40 tx=0x7f289800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289800ed30 con 0x7f28a01584e0 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898014420 con 0x7f28a01584e0 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980147d0 con 0x7f28a01584e0 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a00c4a10 con 0x7f28a01584e0 2024-09-13T15:10:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a00c64a0 con 0x7f28a01584e0 2024-09-13T15:10:35.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.669+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a00c4870 con 0x7f28a01584e0 2024-09-13T15:10:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.673+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2898014930 con 0x7f28a01584e0 2024-09-13T15:10:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.673+0000 7f289cc00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f287c066730 0x7f287c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.673+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2898084990 con 0x7f28a01584e0 2024-09-13T15:10:35.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.673+0000 7f289fe00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f287c066730 0x7f287c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.677+0000 7f289fe00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f287c066730 0x7f287c068bf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2888007fd0 tx=0x7f2888007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:35.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.681+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28a00c4870 con 0x7f28a01584e0 2024-09-13T15:10:35.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.877+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28a00c4870 con 0x7f28a01584e0 2024-09-13T15:10:35.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f289cc00700 1 -- 172.21.15.50:0/1353060341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28a00c4870 con 0x7f28a01584e0 2024-09-13T15:10:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f287c066730 msgr2=0x7f287c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f287c066730 0x7f287c068bf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2888007fd0 tx=0x7f2888007de0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 msgr2=0x7f28a00c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 0x7f28a00c54f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2898007e40 tx=0x7f289800e3c0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 shutdown_connections 2024-09-13T15:10:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f287c066730 0x7f287c068bf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28a01584e0 0x7f28a00c54f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28a00ccd20 0x7f28a00c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 --2- 172.21.15.50:0/1353060341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28a006bab0 0x7f28a01564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 >> 172.21.15.50:0/1353060341 conn(0x7f28a00b1600 msgr2=0x7f28a00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 shutdown_connections 2024-09-13T15:10:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:35.881+0000 7f28a5a00700 1 -- 172.21.15.50:0/1353060341 wait complete. 2024-09-13T15:10:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:10:35.908 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:10:35.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:35.908 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:10:35.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:10:35.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:10:35.954 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:10:36.014 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:36.015 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:36.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:10:36.033 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:36.033 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:36.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:10:36.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b8800700 1 Processor -- start 2024-09-13T15:10:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b8800700 1 -- start start 2024-09-13T15:10:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b8800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72b006f880 0x7f72b006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b8800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b0146a40 con 0x7f72b00d0a80 2024-09-13T15:10:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b8800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00701a0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b8800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b01629d0 con 0x7f72b006f880 2024-09-13T15:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b6800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72b00d0a80 0x7f72b00d0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58120/0 (socket says 172.21.15.50:58120) 2024-09-13T15:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b6800700 1 -- 172.21.15.50:0/1351166328 learned_addr learned my addr 172.21.15.50:0/1351166328 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.261+0000 7f72b5e00700 1 --2- 172.21.15.50:0/1351166328 >> v2:172.21.15.50:3300/0 conn(0x7f72b006f880 0x7f72b006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b4a00700 1 -- 172.21.15.50:0/1351166328 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876948474 0 0) 0x7f72b0146a40 con 0x7f72b00d0a80 2024-09-13T15:10:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b4a00700 1 -- 172.21.15.50:0/1351166328 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72980035d0 con 0x7f72b00d0a80 2024-09-13T15:10:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b5e00700 1 -- 172.21.15.50:0/1351166328 >> v1:172.21.15.181:6789/0 conn(0x7f72b00cb4e0 legacy=0x7f72b00cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b5e00700 1 -- 172.21.15.50:0/1351166328 >> v1:172.21.15.50:6789/0 conn(0x7f72b00d0a80 legacy=0x7f72b00d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b5e00700 1 -- 172.21.15.50:0/1351166328 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0146cd0 con 0x7f72b006f880 2024-09-13T15:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b5e00700 1 --2- 172.21.15.50:0/1351166328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b006f880 0x7f72b006fc60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009850 tx=0x7f72a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e450a42943542b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b4a00700 1 -- 172.21.15.50:0/1351166328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011830 con 0x7f72b006f880 2024-09-13T15:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b4a00700 1 -- 172.21.15.50:0/1351166328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4011990 con 0x7f72b006f880 2024-09-13T15:10:36.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b4a00700 1 -- 172.21.15.50:0/1351166328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011d40 con 0x7f72b006f880 2024-09-13T15:10:36.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 -- 172.21.15.50:0/1351166328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b006f880 msgr2=0x7f72b006fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 --2- 172.21.15.50:0/1351166328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b006f880 0x7f72b006fc60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009850 tx=0x7f72a4009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:36.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 -- 172.21.15.50:0/1351166328 shutdown_connections 2024-09-13T15:10:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 --2- 172.21.15.50:0/1351166328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b006f880 0x7f72b006fc60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 -- 172.21.15.50:0/1351166328 >> 172.21.15.50:0/1351166328 conn(0x7f72b00726d0 msgr2=0x7f72b006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 -- 172.21.15.50:0/1351166328 shutdown_connections 2024-09-13T15:10:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.265+0000 7f72b8800700 1 -- 172.21.15.50:0/1351166328 wait complete. 2024-09-13T15:10:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.269+0000 7f72b8800700 1 Processor -- start 2024-09-13T15:10:36.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.269+0000 7f72b8800700 1 -- start start 2024-09-13T15:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72b006f880 0x7f72b0143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 0x7f72b00c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b00d0a80 0x7f72b006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00d15a0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0147670 con 0x7f72b00d0a80 2024-09-13T15:10:36.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b006cfc0 con 0x7f72b006f880 2024-09-13T15:10:36.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 0x7f72b00c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 0x7f72b00c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48498/0 (socket says 172.21.15.50:48498) 2024-09-13T15:10:36.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 -- 172.21.15.50:0/62374602 learned_addr learned my addr 172.21.15.50:0/62374602 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:36.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5e00700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72b006f880 0x7f72b0143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b6800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b00d0a80 0x7f72b006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 -- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72b006f880 msgr2=0x7f72b0143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72b006f880 0x7f72b0143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 -- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b00d0a80 msgr2=0x7f72b006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b00d0a80 0x7f72b006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 -- 172.21.15.50:0/62374602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40094b0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b6800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b00d0a80 0x7f72b006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b5400700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 0x7f72b00c63f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c500 tx=0x7f72a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00052d0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a0005430 con 0x7f72b00cb4e0 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00c6a40 con 0x7f72b00cb4e0 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00055a0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b006a830 con 0x7f72b00cb4e0 2024-09-13T15:10:36.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.273+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b006a390 con 0x7f72b00cb4e0 2024-09-13T15:10:36.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.277+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72a00038e0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.277+0000 7f72aa000700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7294066760 0x7f7294068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.277+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f72a0083840 con 0x7f72b00cb4e0 2024-09-13T15:10:36.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.277+0000 7f72b5e00700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7294066760 0x7f7294068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.281+0000 7f72b5e00700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7294066760 0x7f7294068c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f72a40090b0 tx=0x7f72a4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:36.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.285+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72a00509d0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72b006fc60 con 0x7f72b00cb4e0 2024-09-13T15:10:36.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72aa000700 1 -- 172.21.15.50:0/62374602 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f72a0053ff0 con 0x7f72b00cb4e0 2024-09-13T15:10:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:36.519 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:17.161542+0000","modified":"2024-09-13T15:10:20.177482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4135812870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4135812870},{"type":"v1","addr":"172.21.15.50:6835","nonce":4135812870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T15:10:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7294066760 msgr2=0x7f7294068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7294066760 0x7f7294068c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f72a40090b0 tx=0x7f72a4008030 comp rx=0 tx=0).stop 2024-09-13T15:10:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 msgr2=0x7f72b00c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 0x7f72b00c63f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c500 tx=0x7f72a000c8c0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 shutdown_connections 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7294066760 0x7f7294068c20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b00d0a80 0x7f72b006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00cb4e0 0x7f72b00c63f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 --2- 172.21.15.50:0/62374602 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f72b006f880 0x7f72b0143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.517+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 >> 172.21.15.50:0/62374602 conn(0x7f72b00726d0 msgr2=0x7f72b0162b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.521+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 shutdown_connections 2024-09-13T15:10:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.521+0000 7f72b8800700 1 -- 172.21.15.50:0/62374602 wait complete. 2024-09-13T15:10:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2024-09-13T15:10:36.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:36.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.717+0000 7fc2a7e00700 1 Processor -- start 2024-09-13T15:10:36.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.717+0000 7fc2a7e00700 1 -- start start 2024-09-13T15:10:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 0x7fc2a80719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2a80b2d80 0x7fc2a806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80b3560 con 0x7fc2a806aaa0 2024-09-13T15:10:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a8070b30 con 0x7fc2a81610b0 2024-09-13T15:10:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a806b450 con 0x7fc2a80b2d80 2024-09-13T15:10:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a6a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 0x7fc2a80719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2a80b2d80 0x7fc2a806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a6a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 0x7fc2a80719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48508/0 (socket says 172.21.15.50:48508) 2024-09-13T15:10:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a6a00700 1 -- 172.21.15.50:0/3137304410 learned_addr learned my addr 172.21.15.50:0/3137304410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7400700 1 -- 172.21.15.50:0/3137304410 >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 msgr2=0x7fc2a80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7400700 1 --2- 172.21.15.50:0/3137304410 >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 0x7fc2a80719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7400700 1 -- 172.21.15.50:0/3137304410 >> v1:172.21.15.181:6789/0 conn(0x7fc2a806aaa0 legacy=0x7fc2a80b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7400700 1 -- 172.21.15.50:0/3137304410 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80b3280 con 0x7fc2a80b2d80 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a6a00700 1 --2- 172.21.15.50:0/3137304410 >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 0x7fc2a80719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a5600700 1 -- 172.21.15.50:0/3137304410 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811462940 0 0) 0x7fc2a80b3560 con 0x7fc2a806aaa0 2024-09-13T15:10:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.721+0000 7fc2a7400700 1 --2- 172.21.15.50:0/3137304410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a80b2d80 0x7fc2a806af10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009d90 tx=0x7fc2a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c431a2fd9cc42f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a5600700 1 -- 172.21.15.50:0/3137304410 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000e070 con 0x7fc2a80b2d80 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a5600700 1 -- 172.21.15.50:0/3137304410 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000bae0 con 0x7fc2a80b2d80 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a5600700 1 -- 172.21.15.50:0/3137304410 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000be90 con 0x7fc2a80b2d80 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 -- 172.21.15.50:0/3137304410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a80b2d80 msgr2=0x7fc2a806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/3137304410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a80b2d80 0x7fc2a806af10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009d90 tx=0x7fc2a000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 -- 172.21.15.50:0/3137304410 shutdown_connections 2024-09-13T15:10:36.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/3137304410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a80b2d80 0x7fc2a806af10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/3137304410 >> v2:172.21.15.50:3300/0 conn(0x7fc2a81610b0 0x7fc2a80719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 -- 172.21.15.50:0/3137304410 >> 172.21.15.50:0/3137304410 conn(0x7fc2a80b0c40 msgr2=0x7fc2a806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 -- 172.21.15.50:0/3137304410 shutdown_connections 2024-09-13T15:10:36.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.725+0000 7fc2a7e00700 1 -- 172.21.15.50:0/3137304410 wait complete. 2024-09-13T15:10:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 Processor -- start 2024-09-13T15:10:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 -- start start 2024-09-13T15:10:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a806aaa0 0x7fc2a80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2a80b2d80 0x7fc2a80ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 0x7fc2a80aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80ab6a0 con 0x7fc2a81610b0 2024-09-13T15:10:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80cbda0 con 0x7fc2a806aaa0 2024-09-13T15:10:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80cc080 con 0x7fc2a80b2d80 2024-09-13T15:10:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 0x7fc2a80aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 0x7fc2a80aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48510/0 (socket says 172.21.15.50:48510) 2024-09-13T15:10:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 -- 172.21.15.50:0/2738326532 learned_addr learned my addr 172.21.15.50:0/2738326532 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a6a00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a806aaa0 0x7fc2a80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a6000700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2a80b2d80 0x7fc2a80ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 -- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2a80b2d80 msgr2=0x7fc2a80ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2a80b2d80 0x7fc2a80ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 -- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a806aaa0 msgr2=0x7fc2a80a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a806aaa0 0x7fc2a80a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 -- 172.21.15.50:0/2738326532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009570 con 0x7fc2a81610b0 2024-09-13T15:10:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a6000700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2a80b2d80 0x7fc2a80ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.729+0000 7fc2a7400700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 0x7fc2a80aacc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009f00 tx=0x7fc2a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:36.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0027480 con 0x7fc2a81610b0 2024-09-13T15:10:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0020070 con 0x7fc2a81610b0 2024-09-13T15:10:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a0009a70 con 0x7fc2a81610b0 2024-09-13T15:10:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0027840 con 0x7fc2a81610b0 2024-09-13T15:10:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a80cc640 con 0x7fc2a81610b0 2024-09-13T15:10:36.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a8070950 con 0x7fc2a81610b0 2024-09-13T15:10:36.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.733+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2a001b400 con 0x7fc2a81610b0 2024-09-13T15:10:36.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.737+0000 7fc29ea00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc288066730 0x7fc288068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:36.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.737+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc2a0022070 con 0x7fc2a81610b0 2024-09-13T15:10:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.737+0000 7fc2a6a00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc288066730 0x7fc288068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:36.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.737+0000 7fc2a6a00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc288066730 0x7fc288068bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2a806bc20 tx=0x7fc2980092e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:36.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.745+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2a0089030 con 0x7fc2a81610b0 2024-09-13T15:10:36.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.929+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2a8161490 con 0x7fc2a81610b0 2024-09-13T15:10:36.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.929+0000 7fc29ea00700 1 -- 172.21.15.50:0/2738326532 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16704 (secure 0 0 0) 0x7fc2a002c090 con 0x7fc2a81610b0 2024-09-13T15:10:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:36.934 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:18.166138+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:36.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc288066730 msgr2=0x7fc288068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc288066730 0x7fc288068bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2a806bc20 tx=0x7fc2980092e0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 msgr2=0x7fc2a80aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 0x7fc2a80aacc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009f00 tx=0x7fc2a0004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 shutdown_connections 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc288066730 0x7fc288068bf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2a81610b0 0x7fc2a80aacc0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2a80b2d80 0x7fc2a80ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 --2- 172.21.15.50:0/2738326532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a806aaa0 0x7fc2a80a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 >> 172.21.15.50:0/2738326532 conn(0x7fc2a80b0c40 msgr2=0x7fc2a806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 shutdown_connections 2024-09-13T15:10:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:36.933+0000 7fc2a7e00700 1 -- 172.21.15.50:0/2738326532 wait complete. 2024-09-13T15:10:36.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:10:15.256899+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:10:16.172392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:36.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:37.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 Processor -- start 2024-09-13T15:10:37.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 -- start start 2024-09-13T15:10:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf3006be10 0x7fcf300ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf300cf0b0 0x7fcf301618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3006d000 con 0x7fcf30160fc0 2024-09-13T15:10:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300cf520 con 0x7fcf3006be10 2024-09-13T15:10:37.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf36400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3006c3f0 con 0x7fcf300cf0b0 2024-09-13T15:10:37.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf2ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf3006be10 0x7fcf300ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf2f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcf30160fc0 0x7fcf300b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58124/0 (socket says 172.21.15.50:58124) 2024-09-13T15:10:37.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf2ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf3006be10 0x7fcf300ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48522/0 (socket says 172.21.15.50:48522) 2024-09-13T15:10:37.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.153+0000 7fcf2f400700 1 -- 172.21.15.50:0/2539725346 learned_addr learned my addr 172.21.15.50:0/2539725346 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2fe00700 1 --2- 172.21.15.50:0/2539725346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf300cf0b0 0x7fcf301618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2ea00700 1 -- 172.21.15.50:0/2539725346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf300cf0b0 msgr2=0x7fcf301618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2ea00700 1 --2- 172.21.15.50:0/2539725346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf300cf0b0 0x7fcf301618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2ea00700 1 -- 172.21.15.50:0/2539725346 >> v1:172.21.15.50:6789/0 conn(0x7fcf30160fc0 legacy=0x7fcf300b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2ea00700 1 -- 172.21.15.50:0/2539725346 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3006c6d0 con 0x7fcf3006be10 2024-09-13T15:10:37.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2e000700 1 -- 172.21.15.50:0/2539725346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70835202 0 0) 0x7fcf3006d000 con 0x7fcf30160fc0 2024-09-13T15:10:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2ea00700 1 --2- 172.21.15.50:0/2539725346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300ceb70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009850 tx=0x7fcf1c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd520d42568fca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2e000700 1 -- 172.21.15.50:0/2539725346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c011830 con 0x7fcf3006be10 2024-09-13T15:10:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2e000700 1 -- 172.21.15.50:0/2539725346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c011990 con 0x7fcf3006be10 2024-09-13T15:10:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf2e000700 1 -- 172.21.15.50:0/2539725346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c011d40 con 0x7fcf3006be10 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 -- 172.21.15.50:0/2539725346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 msgr2=0x7fcf300ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 --2- 172.21.15.50:0/2539725346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300ceb70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009850 tx=0x7fcf1c009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 -- 172.21.15.50:0/2539725346 shutdown_connections 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 --2- 172.21.15.50:0/2539725346 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf300cf0b0 0x7fcf301618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 --2- 172.21.15.50:0/2539725346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300ceb70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 -- 172.21.15.50:0/2539725346 >> 172.21.15.50:0/2539725346 conn(0x7fcf3006a570 msgr2=0x7fcf3006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 -- 172.21.15.50:0/2539725346 shutdown_connections 2024-09-13T15:10:37.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.157+0000 7fcf36400700 1 -- 172.21.15.50:0/2539725346 wait complete. 2024-09-13T15:10:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 Processor -- start 2024-09-13T15:10:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 -- start start 2024-09-13T15:10:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf300cf0b0 0x7fcf3015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf30160fc0 0x7fcf30163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300acda0 con 0x7fcf3006be10 2024-09-13T15:10:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300a9eb0 con 0x7fcf300cf0b0 2024-09-13T15:10:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf36400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300ac220 con 0x7fcf30160fc0 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48534/0 (socket says 172.21.15.50:48534) 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 -- 172.21.15.50:0/1659463132 learned_addr learned my addr 172.21.15.50:0/1659463132 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2ea00700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf300cf0b0 0x7fcf3015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 -- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf30160fc0 msgr2=0x7fcf30163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf30160fc0 0x7fcf30163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 -- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf300cf0b0 msgr2=0x7fcf3015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf300cf0b0 0x7fcf3015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 -- 172.21.15.50:0/1659463132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0094b0 con 0x7fcf3006be10 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2ea00700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf300cf0b0 0x7fcf3015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf2f400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300a8e90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c460 tx=0x7fcf2000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.161+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20004ca0 con 0x7fcf3006be10 2024-09-13T15:10:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.165+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf300ac500 con 0x7fcf3006be10 2024-09-13T15:10:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.165+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20004e20 con 0x7fcf3006be10 2024-09-13T15:10:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.165+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20007310 con 0x7fcf3006be10 2024-09-13T15:10:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.165+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf300acac0 con 0x7fcf3006be10 2024-09-13T15:10:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.165+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf300aa020 con 0x7fcf3006be10 2024-09-13T15:10:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.165+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf20007470 con 0x7fcf3006be10 2024-09-13T15:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.169+0000 7fcf27400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf10066730 0x7fcf10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.169+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf20083fb0 con 0x7fcf3006be10 2024-09-13T15:10:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.169+0000 7fcf2ea00700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf10066730 0x7fcf10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.169+0000 7fcf2ea00700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf10066730 0x7fcf10068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0090b0 tx=0x7fcf1c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.173+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf300aa020 con 0x7fcf3006be10 2024-09-13T15:10:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.353+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf300aa020 con 0x7fcf3006be10 2024-09-13T15:10:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf27400700 1 -- 172.21.15.50:0/1659463132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf300aa020 con 0x7fcf3006be10 2024-09-13T15:10:37.358 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf10066730 msgr2=0x7fcf10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf10066730 0x7fcf10068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0090b0 tx=0x7fcf1c008030 comp rx=0 tx=0).stop 2024-09-13T15:10:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 msgr2=0x7fcf300a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300a8e90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c460 tx=0x7fcf2000c820 comp rx=0 tx=0).stop 2024-09-13T15:10:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 shutdown_connections 2024-09-13T15:10:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf10066730 0x7fcf10068bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf30160fc0 0x7fcf30163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf300cf0b0 0x7fcf3015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 --2- 172.21.15.50:0/1659463132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf3006be10 0x7fcf300a8e90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 >> 172.21.15.50:0/1659463132 conn(0x7fcf3006a570 msgr2=0x7fcf301633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 shutdown_connections 2024-09-13T15:10:37.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.357+0000 7fcf36400700 1 -- 172.21.15.50:0/1659463132 wait complete. 2024-09-13T15:10:37.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:10:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.565+0000 7f957f200700 1 Processor -- start 2024-09-13T15:10:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.565+0000 7f957f200700 1 -- start start 2024-09-13T15:10:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f957f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f957806be10 0x7f95780ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f957f200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957806d000 con 0x7f95780cf0b0 2024-09-13T15:10:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f957f200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957806c3f0 con 0x7f9578160fc0 2024-09-13T15:10:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f957f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780cf560 con 0x7f957806be10 2024-09-13T15:10:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9577400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f957806be10 0x7f95780ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f957d200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95780cf0b0 0x7f95781618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58138/0 (socket says 172.21.15.50:58138) 2024-09-13T15:10:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f957d200700 1 -- 172.21.15.50:0/952832815 learned_addr learned my addr 172.21.15.50:0/952832815 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9577400700 1 -- 172.21.15.50:0/952832815 >> v1:172.21.15.181:6789/0 conn(0x7f9578160fc0 legacy=0x7f95780b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9577400700 1 -- 172.21.15.50:0/952832815 >> v1:172.21.15.50:6789/0 conn(0x7f95780cf0b0 legacy=0x7f95781618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9577400700 1 -- 172.21.15.50:0/952832815 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957806c6d0 con 0x7f957806be10 2024-09-13T15:10:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9576a00700 1 -- 172.21.15.50:0/952832815 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950670276 0 0) 0x7f957806d000 con 0x7f95780cf0b0 2024-09-13T15:10:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9577400700 1 --2- 172.21.15.50:0/952832815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f957806be10 0x7f95780ceb70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9564009880 tx=0x7f9564009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2b2441ee09b261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9576a00700 1 -- 172.21.15.50:0/952832815 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011830 con 0x7f957806be10 2024-09-13T15:10:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9576a00700 1 -- 172.21.15.50:0/952832815 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011990 con 0x7f957806be10 2024-09-13T15:10:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.569+0000 7f9576a00700 1 -- 172.21.15.50:0/952832815 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011d20 con 0x7f957806be10 2024-09-13T15:10:37.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 -- 172.21.15.50:0/952832815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f957806be10 msgr2=0x7f95780ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 --2- 172.21.15.50:0/952832815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f957806be10 0x7f95780ceb70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9564009880 tx=0x7f9564009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:37.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 -- 172.21.15.50:0/952832815 shutdown_connections 2024-09-13T15:10:37.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 --2- 172.21.15.50:0/952832815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f957806be10 0x7f95780ceb70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 -- 172.21.15.50:0/952832815 >> 172.21.15.50:0/952832815 conn(0x7f957806a570 msgr2=0x7f957806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:37.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 -- 172.21.15.50:0/952832815 shutdown_connections 2024-09-13T15:10:37.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.573+0000 7f957f200700 1 -- 172.21.15.50:0/952832815 wait complete. 2024-09-13T15:10:37.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 Processor -- start 2024-09-13T15:10:37.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 -- start start 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f957806be10 0x7f95780ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95780cf0b0 0x7f95780cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 0x7f95780ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780cc8f0 con 0x7f9578160fc0 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780cc2c0 con 0x7f957806be10 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780cdee0 con 0x7f95780cf0b0 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 0x7f95780ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 0x7f95780ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48538/0 (socket says 172.21.15.50:48538) 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 -- 172.21.15.50:0/3527120680 learned_addr learned my addr 172.21.15.50:0/3527120680 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:37.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f9577400700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95780cf0b0 0x7f95780cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f9577e00700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f957806be10 0x7f95780ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 -- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95780cf0b0 msgr2=0x7f95780cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95780cf0b0 0x7f95780cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 -- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f957806be10 msgr2=0x7f95780ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f957806be10 0x7f95780ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 -- 172.21.15.50:0/3527120680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95640094b0 con 0x7f9578160fc0 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f9577e00700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f957806be10 0x7f95780ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.577+0000 7f957d200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 0x7f95780ccd10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f957000cbc0 tx=0x7f957000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000aac0 con 0x7f9578160fc0 2024-09-13T15:10:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000ac40 con 0x7f9578160fc0 2024-09-13T15:10:37.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700070d0 con 0x7f9578160fc0 2024-09-13T15:10:37.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95780ce180 con 0x7f9578160fc0 2024-09-13T15:10:37.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95780cc510 con 0x7f9578160fc0 2024-09-13T15:10:37.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95780ceb70 con 0x7f9578160fc0 2024-09-13T15:10:37.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.581+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9570007250 con 0x7f9578160fc0 2024-09-13T15:10:37.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.585+0000 7f956fe00700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9558066730 0x7f9558068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.585+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9570083d10 con 0x7f9578160fc0 2024-09-13T15:10:37.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.585+0000 7f9577e00700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9558066730 0x7f9558068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.585+0000 7f9577e00700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9558066730 0x7f9558068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9568000f60 tx=0x7f9568009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.593+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9570089020 con 0x7f9578160fc0 2024-09-13T15:10:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.781+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9578071be0 con 0x7f9578160fc0 2024-09-13T15:10:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.781+0000 7f956fe00700 1 -- 172.21.15.50:0/3527120680 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95700180a0 con 0x7f9578160fc0 2024-09-13T15:10:37.784 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9558066730 msgr2=0x7f9558068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9558066730 0x7f9558068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9568000f60 tx=0x7f9568009040 comp rx=0 tx=0).stop 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 msgr2=0x7f95780ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 0x7f95780ccd10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f957000cbc0 tx=0x7f957000ced0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 shutdown_connections 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9558066730 0x7f9558068bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9578160fc0 0x7f95780ccd10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f95780cf0b0 0x7f95780cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 --2- 172.21.15.50:0/3527120680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f957806be10 0x7f95780ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 >> 172.21.15.50:0/3527120680 conn(0x7f957806a570 msgr2=0x7f95780afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 shutdown_connections 2024-09-13T15:10:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.785+0000 7f957f200700 1 -- 172.21.15.50:0/3527120680 wait complete. 2024-09-13T15:10:37.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:10:37.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 Processor -- start 2024-09-13T15:10:37.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 -- start start 2024-09-13T15:10:37.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcbe806cd80 0x7fcbe80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbe806ada0 0x7fcbe806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:37.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe806b710 con 0x7fcbe815ca20 2024-09-13T15:10:37.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe8160680 con 0x7fcbe806ada0 2024-09-13T15:10:37.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.989+0000 7fcbecc00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe815d670 con 0x7fcbe806cd80 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbe806ada0 0x7fcbe806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbe806ada0 0x7fcbe806b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48544/0 (socket says 172.21.15.50:48544) 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 -- 172.21.15.50:0/3320891658 learned_addr learned my addr 172.21.15.50:0/3320891658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe6a00700 1 --2- 172.21.15.50:0/3320891658 >> v2:172.21.15.181:3300/0 conn(0x7fcbe806cd80 0x7fcbe80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 -- 172.21.15.50:0/3320891658 >> v2:172.21.15.181:3300/0 conn(0x7fcbe806cd80 msgr2=0x7fcbe80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 --2- 172.21.15.50:0/3320891658 >> v2:172.21.15.181:3300/0 conn(0x7fcbe806cd80 0x7fcbe80b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 -- 172.21.15.50:0/3320891658 >> v1:172.21.15.181:6789/0 conn(0x7fcbe815ca20 legacy=0x7fcbe815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 -- 172.21.15.50:0/3320891658 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe815d950 con 0x7fcbe806ada0 2024-09-13T15:10:37.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe6a00700 1 --2- 172.21.15.50:0/3320891658 >> v2:172.21.15.181:3300/0 conn(0x7fcbe806cd80 0x7fcbe80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:37.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe7e00700 1 --2- 172.21.15.50:0/3320891658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe806ada0 0x7fcbe806b1d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80b5db0 tx=0x7fcbe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f08c89ff7364cec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:37.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe6000700 1 -- 172.21.15.50:0/3320891658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000e070 con 0x7fcbe806ada0 2024-09-13T15:10:37.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe6000700 1 -- 172.21.15.50:0/3320891658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0003a40 con 0x7fcbe806ada0 2024-09-13T15:10:37.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbe6000700 1 -- 172.21.15.50:0/3320891658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0003df0 con 0x7fcbe806ada0 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 -- 172.21.15.50:0/3320891658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe806ada0 msgr2=0x7fcbe806b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 --2- 172.21.15.50:0/3320891658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe806ada0 0x7fcbe806b1d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80b5db0 tx=0x7fcbe000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 -- 172.21.15.50:0/3320891658 shutdown_connections 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 --2- 172.21.15.50:0/3320891658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe806ada0 0x7fcbe806b1d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 --2- 172.21.15.50:0/3320891658 >> v2:172.21.15.181:3300/0 conn(0x7fcbe806cd80 0x7fcbe80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 -- 172.21.15.50:0/3320891658 >> 172.21.15.50:0/3320891658 conn(0x7fcbe8071d20 msgr2=0x7fcbe8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 -- 172.21.15.50:0/3320891658 shutdown_connections 2024-09-13T15:10:37.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.993+0000 7fcbecc00700 1 -- 172.21.15.50:0/3320891658 wait complete. 2024-09-13T15:10:38.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.997+0000 7fcbecc00700 1 Processor -- start 2024-09-13T15:10:38.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:37.997+0000 7fcbecc00700 1 -- start start 2024-09-13T15:10:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbe806ada0 0x7fcbe81517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbe806cd80 0x7fcbe8152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 0x7fcbe80b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8153210 con 0x7fcbe815ca20 2024-09-13T15:10:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8158230 con 0x7fcbe806cd80 2024-09-13T15:10:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8158510 con 0x7fcbe806ada0 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 0x7fcbe80b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 0x7fcbe80b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48554/0 (socket says 172.21.15.50:48554) 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 -- 172.21.15.50:0/4045447441 learned_addr learned my addr 172.21.15.50:0/4045447441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7400700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbe806ada0 0x7fcbe81517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe6a00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbe806cd80 0x7fcbe8152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 -- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbe806ada0 msgr2=0x7fcbe81517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbe806ada0 0x7fcbe81517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 -- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbe806cd80 msgr2=0x7fcbe8152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbe806cd80 0x7fcbe8152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 -- 172.21.15.50:0/4045447441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0009b30 con 0x7fcbe815ca20 2024-09-13T15:10:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbe7e00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 0x7fcbe80b5140 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0015040 tx=0x7fcbe0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004440 con 0x7fcbe815ca20 2024-09-13T15:10:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00045a0 con 0x7fcbe815ca20 2024-09-13T15:10:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004950 con 0x7fcbe815ca20 2024-09-13T15:10:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe81587f0 con 0x7fcbe815ca20 2024-09-13T15:10:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.001+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe8151d10 con 0x7fcbe815ca20 2024-09-13T15:10:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.005+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8158cb0 con 0x7fcbe815ca20 2024-09-13T15:10:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.005+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbe0012430 con 0x7fcbe815ca20 2024-09-13T15:10:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.009+0000 7fcbdf400700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcbc8066730 0x7fcbc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.009+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcbe00858d0 con 0x7fcbe815ca20 2024-09-13T15:10:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.009+0000 7fcbe7400700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcbc8066730 0x7fcbc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.009+0000 7fcbe7400700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcbc8066730 0x7fcbc8068bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009890 tx=0x7fcbd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.013+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbe0052a70 con 0x7fcbe815ca20 2024-09-13T15:10:38.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.201+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbe806d1c0 con 0x7fcbe815ca20 2024-09-13T15:10:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.201+0000 7fcbdf400700 1 -- 172.21.15.50:0/4045447441 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbe0017020 con 0x7fcbe815ca20 2024-09-13T15:10:38.204 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcbc8066730 msgr2=0x7fcbc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcbc8066730 0x7fcbc8068bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009890 tx=0x7fcbd8008040 comp rx=0 tx=0).stop 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 msgr2=0x7fcbe80b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 0x7fcbe80b5140 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0015040 tx=0x7fcbe0004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 shutdown_connections 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcbc8066730 0x7fcbc8068bf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe815ca20 0x7fcbe80b5140 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbe806cd80 0x7fcbe8152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 --2- 172.21.15.50:0/4045447441 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcbe806ada0 0x7fcbe81517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 >> 172.21.15.50:0/4045447441 conn(0x7fcbe8071d20 msgr2=0x7fcbe8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 shutdown_connections 2024-09-13T15:10:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.205+0000 7fcbecc00700 1 -- 172.21.15.50:0/4045447441 wait complete. 2024-09-13T15:10:38.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:38.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.397+0000 7f4a5f200700 1 Processor -- start 2024-09-13T15:10:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.397+0000 7f4a5f200700 1 -- start start 2024-09-13T15:10:38.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5f200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4a6006aaa0 0x7f4a6006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a600b2670 0x7f4a600b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5f200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a600b3040 con 0x7f4a601610b0 2024-09-13T15:10:38.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5f200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a60070b30 con 0x7f4a6006aaa0 2024-09-13T15:10:38.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6006b450 con 0x7f4a600b2670 2024-09-13T15:10:38.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a57e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4a6006aaa0 0x7f4a6006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5de00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4a601610b0 0x7f4a600719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:45264/0 (socket says 172.21.15.50:45264) 2024-09-13T15:10:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5de00700 1 -- 172.21.15.50:0/3710791217 learned_addr learned my addr 172.21.15.50:0/3710791217 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a5e800700 1 --2- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a600b2670 0x7f4a600b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a57e00700 1 -- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a600b2670 msgr2=0x7f4a600b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a57e00700 1 --2- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a600b2670 0x7f4a600b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a57e00700 1 -- 172.21.15.50:0/3710791217 >> v1:172.21.15.181:6789/0 conn(0x7f4a601610b0 legacy=0x7f4a600719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.401+0000 7f4a57e00700 1 -- 172.21.15.50:0/3710791217 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a600b3560 con 0x7f4a6006aaa0 2024-09-13T15:10:38.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a57e00700 1 --2- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a6006aaa0 0x7f4a6006af10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009880 tx=0x7f4a48009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9da6ba31e5697b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5d400700 1 -- 172.21.15.50:0/3710791217 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011830 con 0x7f4a6006aaa0 2024-09-13T15:10:38.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5d400700 1 -- 172.21.15.50:0/3710791217 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48011990 con 0x7f4a6006aaa0 2024-09-13T15:10:38.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5d400700 1 -- 172.21.15.50:0/3710791217 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011d20 con 0x7f4a6006aaa0 2024-09-13T15:10:38.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 -- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a6006aaa0 msgr2=0x7f4a6006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a6006aaa0 0x7f4a6006af10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009880 tx=0x7f4a48009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 -- 172.21.15.50:0/3710791217 shutdown_connections 2024-09-13T15:10:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a600b2670 0x7f4a600b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3710791217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a6006aaa0 0x7f4a6006af10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 -- 172.21.15.50:0/3710791217 >> 172.21.15.50:0/3710791217 conn(0x7f4a600b0c40 msgr2=0x7f4a6006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 -- 172.21.15.50:0/3710791217 shutdown_connections 2024-09-13T15:10:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.405+0000 7f4a5f200700 1 -- 172.21.15.50:0/3710791217 wait complete. 2024-09-13T15:10:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 Processor -- start 2024-09-13T15:10:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 -- start start 2024-09-13T15:10:38.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a6006aaa0 0x7f4a60150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 0x7f4a600acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a601610b0 0x7f4a60162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60150fc0 con 0x7f4a600b2670 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600ad090 con 0x7f4a601610b0 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601f6db0 con 0x7f4a6006aaa0 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a57e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 0x7f4a600acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a57e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 0x7f4a600acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48566/0 (socket says 172.21.15.50:48566) 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a57e00700 1 -- 172.21.15.50:0/3801380117 learned_addr learned my addr 172.21.15.50:0/3801380117 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5de00700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a6006aaa0 0x7f4a60150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.409+0000 7f4a5e800700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a601610b0 0x7f4a60162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a57e00700 1 -- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a6006aaa0 msgr2=0x7f4a60150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a57e00700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a6006aaa0 0x7f4a60150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a57e00700 1 -- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a601610b0 msgr2=0x7f4a60162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a57e00700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a601610b0 0x7f4a60162fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a57e00700 1 -- 172.21.15.50:0/3801380117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480094b0 con 0x7f4a600b2670 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a57e00700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 0x7f4a600acb50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009bd0 tx=0x7f4a48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480036c0 con 0x7f4a600b2670 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48003820 con 0x7f4a600b2670 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48003bd0 con 0x7f4a600b2670 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a601f7090 con 0x7f4a600b2670 2024-09-13T15:10:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a601f7650 con 0x7f4a600b2670 2024-09-13T15:10:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.413+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6015e370 con 0x7f4a600b2670 2024-09-13T15:10:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.417+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a48003d30 con 0x7f4a600b2670 2024-09-13T15:10:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.417+0000 7f4a56000700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a3c066730 0x7f4a3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.417+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a48021030 con 0x7f4a600b2670 2024-09-13T15:10:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.417+0000 7f4a5de00700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a3c066730 0x7f4a3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.421+0000 7f4a5de00700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a3c066730 0x7f4a3c068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005930 tx=0x7f4a50009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.421+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a48052b30 con 0x7f4a600b2670 2024-09-13T15:10:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.653+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a60161490 con 0x7f4a600b2670 2024-09-13T15:10:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.653+0000 7f4a56000700 1 -- 172.21.15.50:0/3801380117 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f4a48015090 con 0x7f4a600b2670 2024-09-13T15:10:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:38.657 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:17.161542+0000","modified":"2024-09-13T15:10:20.177482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4135812870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4135812870},{"type":"v1","addr":"172.21.15.50:6835","nonce":4135812870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.657+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a3c066730 msgr2=0x7f4a3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.657+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a3c066730 0x7f4a3c068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005930 tx=0x7f4a50009040 comp rx=0 tx=0).stop 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.657+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 msgr2=0x7f4a600acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.657+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 0x7f4a600acb50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009bd0 tx=0x7f4a48004770 comp rx=0 tx=0).stop 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 shutdown_connections 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4a3c066730 0x7f4a3c068bf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a601610b0 0x7f4a60162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a600b2670 0x7f4a600acb50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 --2- 172.21.15.50:0/3801380117 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4a6006aaa0 0x7f4a60150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 >> 172.21.15.50:0/3801380117 conn(0x7f4a600b0c40 msgr2=0x7f4a6015f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 shutdown_connections 2024-09-13T15:10:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.661+0000 7f4a5f200700 1 -- 172.21.15.50:0/3801380117 wait complete. 2024-09-13T15:10:38.664 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2024-09-13T15:10:38.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.857+0000 7fede1400700 1 Processor -- start 2024-09-13T15:10:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.857+0000 7fede1400700 1 -- start start 2024-09-13T15:10:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede1400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc0cb020 0x7feddc0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede1400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feddc15c2a0 0x7feddc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede1400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0b2ad0 con 0x7feddc06aaa0 2024-09-13T15:10:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede1400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc15b960 con 0x7feddc15c2a0 2024-09-13T15:10:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede1400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc15bc40 con 0x7feddc0cb020 2024-09-13T15:10:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fedd3e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feddc15c2a0 0x7feddc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede0a00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feddc06aaa0 0x7feddc0b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:45272/0 (socket says 172.21.15.50:45272) 2024-09-13T15:10:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fede0a00700 1 -- 172.21.15.50:0/2277056415 learned_addr learned my addr 172.21.15.50:0/2277056415 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7feddbe00700 1 --2- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc0cb020 0x7feddc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fedd3e00700 1 -- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc0cb020 msgr2=0x7feddc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fedd3e00700 1 --2- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc0cb020 0x7feddc0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fedd3e00700 1 -- 172.21.15.50:0/2277056415 >> v1:172.21.15.181:6789/0 conn(0x7feddc06aaa0 legacy=0x7feddc0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fedd3e00700 1 -- 172.21.15.50:0/2277056415 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc15bf20 con 0x7feddc15c2a0 2024-09-13T15:10:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7fedd3e00700 1 --2- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc15c2a0 0x7feddc15b0e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009850 tx=0x7fedc4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee1c976775d47ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7feddb400700 1 -- 172.21.15.50:0/2277056415 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011830 con 0x7feddc15c2a0 2024-09-13T15:10:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7feddb400700 1 -- 172.21.15.50:0/2277056415 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4011990 con 0x7feddc15c2a0 2024-09-13T15:10:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.861+0000 7feddb400700 1 -- 172.21.15.50:0/2277056415 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011d40 con 0x7feddc15c2a0 2024-09-13T15:10:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 -- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc15c2a0 msgr2=0x7feddc15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 --2- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc15c2a0 0x7feddc15b0e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009850 tx=0x7fedc4009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 -- 172.21.15.50:0/2277056415 shutdown_connections 2024-09-13T15:10:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 --2- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc15c2a0 0x7feddc15b0e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 --2- 172.21.15.50:0/2277056415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc0cb020 0x7feddc0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 -- 172.21.15.50:0/2277056415 >> 172.21.15.50:0/2277056415 conn(0x7feddc0b0c40 msgr2=0x7feddc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 -- 172.21.15.50:0/2277056415 shutdown_connections 2024-09-13T15:10:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 -- 172.21.15.50:0/2277056415 wait complete. 2024-09-13T15:10:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 Processor -- start 2024-09-13T15:10:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.865+0000 7fede1400700 1 -- start start 2024-09-13T15:10:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 0x7feddc13f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc0cb020 0x7feddc0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc15c2a0 0x7feddc157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc13f7e0 con 0x7feddc06aaa0 2024-09-13T15:10:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c5910 con 0x7feddc0cb020 2024-09-13T15:10:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c5bf0 con 0x7feddc15c2a0 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 0x7feddc13f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fedd3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc0cb020 0x7feddc0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 0x7feddc13f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48578/0 (socket says 172.21.15.50:48578) 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 -- 172.21.15.50:0/3085374390 learned_addr learned my addr 172.21.15.50:0/3085374390 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede0a00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc15c2a0 0x7feddc157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 -- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc15c2a0 msgr2=0x7feddc157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc15c2a0 0x7feddc157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 -- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc0cb020 msgr2=0x7feddc0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc0cb020 0x7feddc0c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 -- 172.21.15.50:0/3085374390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40094b0 con 0x7feddc06aaa0 2024-09-13T15:10:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7feddbe00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 0x7feddc13f2a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00e9d0 tx=0x7fedcc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc009720 con 0x7feddc06aaa0 2024-09-13T15:10:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00c850 con 0x7feddc06aaa0 2024-09-13T15:10:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00cbc0 con 0x7feddc06aaa0 2024-09-13T15:10:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc0c5ed0 con 0x7feddc06aaa0 2024-09-13T15:10:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.869+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc1557a0 con 0x7feddc06aaa0 2024-09-13T15:10:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.873+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0cc6f0 con 0x7feddc06aaa0 2024-09-13T15:10:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.873+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fedcc00cd20 con 0x7feddc06aaa0 2024-09-13T15:10:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.877+0000 7fedd8c00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fedb8066760 0x7fedb8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.877+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fedcc0843a0 con 0x7feddc06aaa0 2024-09-13T15:10:38.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.877+0000 7fedd3e00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fedb8066760 0x7fedb8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:38.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.877+0000 7fedd3e00700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fedb8066760 0x7fedb8068c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009850 tx=0x7fedc401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:38.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:38.881+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fedcc051530 con 0x7feddc06aaa0 2024-09-13T15:10:39.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.069+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feddc0b21e0 con 0x7feddc06aaa0 2024-09-13T15:10:39.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fedd8c00700 1 -- 172.21.15.50:0/3085374390 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16704 (secure 0 0 0) 0x7fedcc054b50 con 0x7feddc06aaa0 2024-09-13T15:10:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:39.075 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:18.166138+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fedb8066760 msgr2=0x7fedb8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fedb8066760 0x7fedb8068c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009850 tx=0x7fedc401c040 comp rx=0 tx=0).stop 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 msgr2=0x7feddc13f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 0x7feddc13f2a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00e9d0 tx=0x7fedcc00ece0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 shutdown_connections 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fedb8066760 0x7fedb8068c20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feddc15c2a0 0x7feddc157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feddc0cb020 0x7feddc0c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 --2- 172.21.15.50:0/3085374390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feddc06aaa0 0x7feddc13f2a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.073+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 >> 172.21.15.50:0/3085374390 conn(0x7feddc0b0c40 msgr2=0x7feddc06ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.077+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 shutdown_connections 2024-09-13T15:10:39.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.077+0000 7fede1400700 1 -- 172.21.15.50:0/3085374390 wait complete. 2024-09-13T15:10:39.104 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:10:39.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:39.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e2400700 1 Processor -- start 2024-09-13T15:10:39.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e2400700 1 -- start start 2024-09-13T15:10:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e2400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29dc0b3980 0x7f29dc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e2400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc15e560 con 0x7f29dc15d310 2024-09-13T15:10:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e2400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0b3e10 con 0x7f29dc06aaa0 2024-09-13T15:10:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e2400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0adf90 con 0x7f29dc0b3980 2024-09-13T15:10:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e1a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29dc0b3980 0x7f29dc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e1a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29dc0b3980 0x7f29dc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59418/0 (socket says 172.21.15.50:59418) 2024-09-13T15:10:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29dbe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29dc15d310 0x7f29dc15e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58148/0 (socket says 172.21.15.50:58148) 2024-09-13T15:10:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e1a00700 1 -- 172.21.15.50:0/4289144795 learned_addr learned my addr 172.21.15.50:0/4289144795 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.269+0000 7f29e1000700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f29dc06aaa0 0x7f29dc06ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:45276/0 (socket says 172.21.15.50:45276) 2024-09-13T15:10:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e1a00700 1 -- 172.21.15.50:0/4289144795 >> v1:172.21.15.181:6789/0 conn(0x7f29dc06aaa0 legacy=0x7f29dc06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e1a00700 1 -- 172.21.15.50:0/4289144795 >> v1:172.21.15.50:6789/0 conn(0x7f29dc15d310 legacy=0x7f29dc15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e1a00700 1 -- 172.21.15.50:0/4289144795 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc15d920 con 0x7f29dc0b3980 2024-09-13T15:10:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e1a00700 1 --2- 172.21.15.50:0/4289144795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc15f100 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009e50 tx=0x7f29d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f79df08565e30ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29db400700 1 -- 172.21.15.50:0/4289144795 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400e070 con 0x7f29dc0b3980 2024-09-13T15:10:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29db400700 1 -- 172.21.15.50:0/4289144795 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400b9c0 con 0x7f29dc0b3980 2024-09-13T15:10:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29db400700 1 -- 172.21.15.50:0/4289144795 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400bd70 con 0x7f29dc0b3980 2024-09-13T15:10:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 -- 172.21.15.50:0/4289144795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 msgr2=0x7f29dc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 --2- 172.21.15.50:0/4289144795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc15f100 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009e50 tx=0x7f29d400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 -- 172.21.15.50:0/4289144795 shutdown_connections 2024-09-13T15:10:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 --2- 172.21.15.50:0/4289144795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc15f100 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 -- 172.21.15.50:0/4289144795 >> 172.21.15.50:0/4289144795 conn(0x7f29dc0b0c40 msgr2=0x7f29dc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 -- 172.21.15.50:0/4289144795 shutdown_connections 2024-09-13T15:10:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.273+0000 7f29e2400700 1 -- 172.21.15.50:0/4289144795 wait complete. 2024-09-13T15:10:39.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 Processor -- start 2024-09-13T15:10:39.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 -- start start 2024-09-13T15:10:39.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 0x7f29dc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29dc15d310 0x7f29dc0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc130480 con 0x7f29dc06aaa0 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0cac70 con 0x7f29dc0b3980 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e2400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc12fe50 con 0x7f29dc15d310 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 0x7f29dc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 0x7f29dc0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48584/0 (socket says 172.21.15.50:48584) 2024-09-13T15:10:39.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 -- 172.21.15.50:0/3650423438 learned_addr learned my addr 172.21.15.50:0/3650423438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1a00700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29dc15d310 0x7f29dc0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29dbe00700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 -- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29dc15d310 msgr2=0x7f29dc0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29dc15d310 0x7f29dc0cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 -- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 msgr2=0x7f29dc0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc0cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29e1000700 1 -- 172.21.15.50:0/3650423438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d4009b30 con 0x7f29dc06aaa0 2024-09-13T15:10:39.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.277+0000 7f29dbe00700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:39.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29e1000700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 0x7f29dc0ca730 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c730 tx=0x7f29d000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:39.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0005cd0 con 0x7f29dc06aaa0 2024-09-13T15:10:39.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0005e30 con 0x7f29dc06aaa0 2024-09-13T15:10:39.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc146500 con 0x7f29dc06aaa0 2024-09-13T15:10:39.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00072d0 con 0x7f29dc06aaa0 2024-09-13T15:10:39.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc1300a0 con 0x7f29dc06aaa0 2024-09-13T15:10:39.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.281+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc06ae80 con 0x7f29dc06aaa0 2024-09-13T15:10:39.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.285+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29d0007430 con 0x7f29dc06aaa0 2024-09-13T15:10:39.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.285+0000 7f29d8c00700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29bc066730 0x7f29bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.285+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29d00836d0 con 0x7f29dc06aaa0 2024-09-13T15:10:39.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.285+0000 7f29dbe00700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29bc066730 0x7f29bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.289+0000 7f29dbe00700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29bc066730 0x7f29bc068bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29dc1f5fb0 tx=0x7f29c8007df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:39.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.293+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29d0050910 con 0x7f29dc06aaa0 2024-09-13T15:10:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.525+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29dc141880 con 0x7f29dc06aaa0 2024-09-13T15:10:39.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.525+0000 7f29d8c00700 1 -- 172.21.15.50:0/3650423438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f29d0017090 con 0x7f29dc06aaa0 2024-09-13T15:10:39.528 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:39.529 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:17.161542+0000","modified":"2024-09-13T15:10:20.177482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4135812870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4135812870},{"type":"v1","addr":"172.21.15.50:6835","nonce":4135812870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T15:10:39.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29bc066730 msgr2=0x7f29bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29bc066730 0x7f29bc068bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29dc1f5fb0 tx=0x7f29c8007df0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 msgr2=0x7f29dc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 0x7f29dc0ca730 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c730 tx=0x7f29d000caf0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 shutdown_connections 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f29bc066730 0x7f29bc068bf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29dc15d310 0x7f29dc0cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29dc0b3980 0x7f29dc0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 --2- 172.21.15.50:0/3650423438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc06aaa0 0x7f29dc0ca730 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 >> 172.21.15.50:0/3650423438 conn(0x7f29dc0b0c40 msgr2=0x7f29dc0ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 shutdown_connections 2024-09-13T15:10:39.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.529+0000 7f29e2400700 1 -- 172.21.15.50:0/3650423438 wait complete. 2024-09-13T15:10:39.534 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2024-09-13T15:10:39.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 Processor -- start 2024-09-13T15:10:39.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 -- start start 2024-09-13T15:10:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5b415b700 0x7fe5b415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b40cdd90 con 0x7fe5b406c460 2024-09-13T15:10:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b406afa0 con 0x7fe5b415b700 2024-09-13T15:10:39.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5bb600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b406ce10 con 0x7fe5b406a5d0 2024-09-13T15:10:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5b3e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5b406c460 0x7fe5b406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58164/0 (socket says 172.21.15.50:58164) 2024-09-13T15:10:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5b3e00700 1 -- 172.21.15.50:0/284444792 learned_addr learned my addr 172.21.15.50:0/284444792 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.729+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/284444792 >> v2:172.21.15.50:3300/0 conn(0x7fe5b415b700 0x7fe5b415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b9600700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b8c00700 1 -- 172.21.15.50:0/284444792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 msgr2=0x7fe5b406aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b406aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b8c00700 1 -- 172.21.15.50:0/284444792 >> v1:172.21.15.50:6789/0 conn(0x7fe5b406c460 legacy=0x7fe5b406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b8c00700 1 -- 172.21.15.50:0/284444792 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b415c020 con 0x7fe5b415b700 2024-09-13T15:10:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b3400700 1 -- 172.21.15.50:0/284444792 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423188046 0 0) 0x7fe5b40cdd90 con 0x7fe5b406c460 2024-09-13T15:10:39.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b9600700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b415bae0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009850 tx=0x7fe5a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9afdbd68a614cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b3400700 1 -- 172.21.15.50:0/284444792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011830 con 0x7fe5b415b700 2024-09-13T15:10:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b3400700 1 -- 172.21.15.50:0/284444792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8011990 con 0x7fe5b415b700 2024-09-13T15:10:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5b3400700 1 -- 172.21.15.50:0/284444792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011d40 con 0x7fe5b415b700 2024-09-13T15:10:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 -- 172.21.15.50:0/284444792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 msgr2=0x7fe5b415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b415bae0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009850 tx=0x7fe5a8009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 -- 172.21.15.50:0/284444792 shutdown_connections 2024-09-13T15:10:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 --2- 172.21.15.50:0/284444792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b415bae0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 -- 172.21.15.50:0/284444792 >> 172.21.15.50:0/284444792 conn(0x7fe5b40b08d0 msgr2=0x7fe5b40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:39.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 -- 172.21.15.50:0/284444792 shutdown_connections 2024-09-13T15:10:39.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.733+0000 7fe5bb600700 1 -- 172.21.15.50:0/284444792 wait complete. 2024-09-13T15:10:39.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 Processor -- start 2024-09-13T15:10:39.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 -- start start 2024-09-13T15:10:39.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b4149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5b406c460 0x7fe5b4159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b4159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40ace00 con 0x7fe5b415b700 2024-09-13T15:10:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40ad0e0 con 0x7fe5b406c460 2024-09-13T15:10:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5bb600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40ad3c0 con 0x7fe5b406a5d0 2024-09-13T15:10:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5b9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b4159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5b9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b4159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48600/0 (socket says 172.21.15.50:48600) 2024-09-13T15:10:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5b9600700 1 -- 172.21.15.50:0/2565488272 learned_addr learned my addr 172.21.15.50:0/2565488272 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:39.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b4149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.737+0000 7fe5b3e00700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5b406c460 0x7fe5b4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b9600700 1 -- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 msgr2=0x7fe5b4149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b9600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b4149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b9600700 1 -- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5b406c460 msgr2=0x7fe5b4159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b9600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5b406c460 0x7fe5b4159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b9600700 1 -- 172.21.15.50:0/2565488272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009a70 con 0x7fe5b415b700 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b4149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b9600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b4159b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00efc0 tx=0x7fe5ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac009d70 con 0x7fe5b415b700 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00f040 con 0x7fe5b415b700 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a80094b0 con 0x7fe5b415b700 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00ce00 con 0x7fe5b415b700 2024-09-13T15:10:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b40ad980 con 0x7fe5b415b700 2024-09-13T15:10:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.741+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b41520c0 con 0x7fe5b415b700 2024-09-13T15:10:39.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.745+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5ac014480 con 0x7fe5b415b700 2024-09-13T15:10:39.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.745+0000 7fe5b0c00700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe594066760 0x7fe594068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:39.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.745+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe5ac0849f0 con 0x7fe5b415b700 2024-09-13T15:10:39.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.745+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe594066760 0x7fe594068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:39.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.745+0000 7fe5b8c00700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe594066760 0x7fe594068c20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80090b0 tx=0x7fe5a801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:39.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.749+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5ac051c10 con 0x7fe5b415b700 2024-09-13T15:10:39.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.981+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5b40adba0 con 0x7fe5b415b700 2024-09-13T15:10:39.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.981+0000 7fe5b0c00700 1 -- 172.21.15.50:0/2565488272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4738 (secure 0 0 0) 0x7fe5ac055230 con 0x7fe5b415b700 2024-09-13T15:10:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:39.986 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:17.161542+0000","modified":"2024-09-13T15:10:20.177482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4135812870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4135812870},{"type":"v1","addr":"172.21.15.50:6835","nonce":4135812870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe594066760 msgr2=0x7fe594068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe594066760 0x7fe594068c20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80090b0 tx=0x7fe5a801c040 comp rx=0 tx=0).stop 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 msgr2=0x7fe5b4159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b4159b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00efc0 tx=0x7fe5ac00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 shutdown_connections 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe594066760 0x7fe594068c20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5b415b700 0x7fe5b4159b40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5b406c460 0x7fe5b4159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 --2- 172.21.15.50:0/2565488272 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5b406a5d0 0x7fe5b4149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 >> 172.21.15.50:0/2565488272 conn(0x7fe5b40b08d0 msgr2=0x7fe5b40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 shutdown_connections 2024-09-13T15:10:39.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:39.985+0000 7fe5bb600700 1 -- 172.21.15.50:0/2565488272 wait complete. 2024-09-13T15:10:39.991 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2024-09-13T15:10:40.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.189+0000 7f7b4be00700 1 Processor -- start 2024-09-13T15:10:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.189+0000 7f7b4be00700 1 -- start start 2024-09-13T15:10:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 0x7f7b4c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b4c066090 0x7f7b4c066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4be00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c06b4d0 con 0x7f7b4c144440 2024-09-13T15:10:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4be00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c066a60 con 0x7f7b4c066090 2024-09-13T15:10:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c06a8c0 con 0x7f7b4c06a390 2024-09-13T15:10:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4b400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b4c066090 0x7f7b4c066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 0x7f7b4c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4aa00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7b4c144440 0x7f7b4c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:45288/0 (socket says 172.21.15.50:45288) 2024-09-13T15:10:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 0x7f7b4c06b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36942/0 (socket says 172.21.15.50:36942) 2024-09-13T15:10:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4aa00700 1 -- 172.21.15.50:0/1288453804 learned_addr learned my addr 172.21.15.50:0/1288453804 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 -- 172.21.15.50:0/1288453804 >> v2:172.21.15.50:3300/0 conn(0x7f7b4c066090 msgr2=0x7f7b4c066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 --2- 172.21.15.50:0/1288453804 >> v2:172.21.15.50:3300/0 conn(0x7f7b4c066090 0x7f7b4c066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 -- 172.21.15.50:0/1288453804 >> v1:172.21.15.181:6789/0 conn(0x7f7b4c144440 legacy=0x7f7b4c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 -- 172.21.15.50:0/1288453804 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c06aba0 con 0x7f7b4c06a390 2024-09-13T15:10:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.193+0000 7f7b4a000700 1 --2- 172.21.15.50:0/1288453804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 0x7f7b4c06b960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009850 tx=0x7f7b38009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cf2cf9f1eaac21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b49600700 1 -- 172.21.15.50:0/1288453804 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38011830 con 0x7f7b4c06a390 2024-09-13T15:10:40.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b49600700 1 -- 172.21.15.50:0/1288453804 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38011990 con 0x7f7b4c06a390 2024-09-13T15:10:40.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b49600700 1 -- 172.21.15.50:0/1288453804 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38011d40 con 0x7f7b4c06a390 2024-09-13T15:10:40.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 -- 172.21.15.50:0/1288453804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 msgr2=0x7f7b4c06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 --2- 172.21.15.50:0/1288453804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 0x7f7b4c06b960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009850 tx=0x7f7b38009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 -- 172.21.15.50:0/1288453804 shutdown_connections 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 --2- 172.21.15.50:0/1288453804 >> v2:172.21.15.50:3300/0 conn(0x7f7b4c066090 0x7f7b4c066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 --2- 172.21.15.50:0/1288453804 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c06a390 0x7f7b4c06b960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 -- 172.21.15.50:0/1288453804 >> 172.21.15.50:0/1288453804 conn(0x7f7b4c06e660 msgr2=0x7f7b4c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 -- 172.21.15.50:0/1288453804 shutdown_connections 2024-09-13T15:10:40.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.197+0000 7f7b4be00700 1 -- 172.21.15.50:0/1288453804 wait complete. 2024-09-13T15:10:40.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 Processor -- start 2024-09-13T15:10:40.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 -- start start 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 0x7f7b4c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b4c06a390 0x7f7b4c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c144440 0x7f7b4c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1f6870 con 0x7f7b4c066090 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1f6b50 con 0x7f7b4c06a390 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1e4f60 con 0x7f7b4c144440 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 0x7f7b4c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 0x7f7b4c15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48616/0 (socket says 172.21.15.50:48616) 2024-09-13T15:10:40.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4aa00700 1 -- 172.21.15.50:0/4089642730 learned_addr learned my addr 172.21.15.50:0/4089642730 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:40.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4b400700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c144440 0x7f7b4c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4a000700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b4c06a390 0x7f7b4c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4aa00700 1 -- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c144440 msgr2=0x7f7b4c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.201+0000 7f7b4aa00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c144440 0x7f7b4c0b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4aa00700 1 -- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b4c06a390 msgr2=0x7f7b4c1f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4aa00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b4c06a390 0x7f7b4c1f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4aa00700 1 -- 172.21.15.50:0/4089642730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380094b0 con 0x7f7b4c066090 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4a000700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b4c06a390 0x7f7b4c1f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4aa00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 0x7f7b4c15a350 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00cbc0 tx=0x7f7b3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007480 con 0x7f7b4c066090 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0075e0 con 0x7f7b4c066090 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007950 con 0x7f7b4c066090 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c1e5240 con 0x7f7b4c066090 2024-09-13T15:10:40.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c1426a0 con 0x7f7b4c066090 2024-09-13T15:10:40.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.205+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c1f6d70 con 0x7f7b4c066090 2024-09-13T15:10:40.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.209+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b3c01b3b0 con 0x7f7b4c066090 2024-09-13T15:10:40.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.209+0000 7f7b42a00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7b2c066730 0x7f7b2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.209+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7b3c083bb0 con 0x7f7b4c066090 2024-09-13T15:10:40.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.209+0000 7f7b4a000700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7b2c066730 0x7f7b2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.213+0000 7f7b4a000700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7b2c066730 0x7f7b2c068bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009850 tx=0x7f7b38008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:40.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.217+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b3c050df0 con 0x7f7b4c066090 2024-09-13T15:10:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.417+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b4c1e5430 con 0x7f7b4c066090 2024-09-13T15:10:40.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.421+0000 7f7b42a00700 1 -- 172.21.15.50:0/4089642730 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16704 (secure 0 0 0) 0x7f7b3c017090 con 0x7f7b4c066090 2024-09-13T15:10:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:40.424 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:18.166138+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:15.256899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:16.172392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:40.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7b2c066730 msgr2=0x7f7b2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7b2c066730 0x7f7b2c068bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009850 tx=0x7f7b38008030 comp rx=0 tx=0).stop 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 msgr2=0x7f7b4c15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 0x7f7b4c15a350 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00cbc0 tx=0x7f7b3c00cbf0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 shutdown_connections 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7b2c066730 0x7f7b2c068bf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b4c144440 0x7f7b4c0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b4c06a390 0x7f7b4c1f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 --2- 172.21.15.50:0/4089642730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b4c066090 0x7f7b4c15a350 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 >> 172.21.15.50:0/4089642730 conn(0x7f7b4c06e660 msgr2=0x7f7b4c06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 shutdown_connections 2024-09-13T15:10:40.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.425+0000 7f7b4be00700 1 -- 172.21.15.50:0/4089642730 wait complete. 2024-09-13T15:10:40.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:10:40.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.625+0000 7fd05da00700 1 Processor -- start 2024-09-13T15:10:40.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.625+0000 7fd05da00700 1 -- start start 2024-09-13T15:10:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.625+0000 7fd05da00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0580cb700 0x7fd05806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.625+0000 7fd05da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd05806afe0 0x7fd0581636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580707d0 con 0x7fd058159bd0 2024-09-13T15:10:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05806b470 con 0x7fd0580cb700 2024-09-13T15:10:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580720a0 con 0x7fd05806afe0 2024-09-13T15:10:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0580cb700 0x7fd05806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd058159bd0 0x7fd058071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:45300/0 (socket says 172.21.15.50:45300) 2024-09-13T15:10:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057e00700 1 -- 172.21.15.50:0/564545055 learned_addr learned my addr 172.21.15.50:0/564545055 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05d000700 1 --2- 172.21.15.50:0/564545055 >> v2:172.21.15.181:3300/0 conn(0x7fd05806afe0 0x7fd0581636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057400700 1 -- 172.21.15.50:0/564545055 >> v2:172.21.15.181:3300/0 conn(0x7fd05806afe0 msgr2=0x7fd0581636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057400700 1 --2- 172.21.15.50:0/564545055 >> v2:172.21.15.181:3300/0 conn(0x7fd05806afe0 0x7fd0581636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057400700 1 -- 172.21.15.50:0/564545055 >> v1:172.21.15.181:6789/0 conn(0x7fd058159bd0 legacy=0x7fd058071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057400700 1 -- 172.21.15.50:0/564545055 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05806fee0 con 0x7fd0580cb700 2024-09-13T15:10:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd057400700 1 --2- 172.21.15.50:0/564545055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580cb700 0x7fd05806aaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd0580cb260 tx=0x7fd044009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328119c6a982bdfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd056a00700 1 -- 172.21.15.50:0/564545055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011830 con 0x7fd0580cb700 2024-09-13T15:10:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd056a00700 1 -- 172.21.15.50:0/564545055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044011990 con 0x7fd0580cb700 2024-09-13T15:10:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd056a00700 1 -- 172.21.15.50:0/564545055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011d20 con 0x7fd0580cb700 2024-09-13T15:10:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- 172.21.15.50:0/564545055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580cb700 msgr2=0x7fd05806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 --2- 172.21.15.50:0/564545055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580cb700 0x7fd05806aaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd0580cb260 tx=0x7fd044009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- 172.21.15.50:0/564545055 shutdown_connections 2024-09-13T15:10:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 --2- 172.21.15.50:0/564545055 >> v2:172.21.15.181:3300/0 conn(0x7fd05806afe0 0x7fd0581636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 --2- 172.21.15.50:0/564545055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580cb700 0x7fd05806aaa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- 172.21.15.50:0/564545055 >> 172.21.15.50:0/564545055 conn(0x7fd0580b0c40 msgr2=0x7fd05806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- 172.21.15.50:0/564545055 shutdown_connections 2024-09-13T15:10:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.629+0000 7fd05da00700 1 -- 172.21.15.50:0/564545055 wait complete. 2024-09-13T15:10:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 Processor -- start 2024-09-13T15:10:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 -- start start 2024-09-13T15:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 0x7fd05814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0580cb700 0x7fd0581515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd058159bd0 0x7fd058150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05806c520 con 0x7fd05806afe0 2024-09-13T15:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05806bbf0 con 0x7fd058159bd0 2024-09-13T15:10:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd05da00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05806bed0 con 0x7fd0580cb700 2024-09-13T15:10:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.633+0000 7fd057e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 0x7fd05814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 0x7fd05814f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48630/0 (socket says 172.21.15.50:48630) 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 -- 172.21.15.50:0/1954364287 learned_addr learned my addr 172.21.15.50:0/1954364287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057400700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0580cb700 0x7fd0581515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd05d000700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd058159bd0 0x7fd058150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 -- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0580cb700 msgr2=0x7fd0581515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0580cb700 0x7fd0581515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 -- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd058159bd0 msgr2=0x7fd058150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd058159bd0 0x7fd058150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 -- 172.21.15.50:0/1954364287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440094b0 con 0x7fd05806afe0 2024-09-13T15:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd057e00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 0x7fd05814f2d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd048001eb0 tx=0x7fd04800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048005d90 con 0x7fd05806afe0 2024-09-13T15:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0480070d0 con 0x7fd05806afe0 2024-09-13T15:10:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048007440 con 0x7fd05806afe0 2024-09-13T15:10:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05806c1b0 con 0x7fd05806afe0 2024-09-13T15:10:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd058151b20 con 0x7fd05806afe0 2024-09-13T15:10:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.637+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05806aaa0 con 0x7fd05806afe0 2024-09-13T15:10:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.641+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd0480075a0 con 0x7fd05806afe0 2024-09-13T15:10:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.641+0000 7fd04fe00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd038066730 0x7fd038068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.641+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd048083570 con 0x7fd05806afe0 2024-09-13T15:10:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.641+0000 7fd057400700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd038066730 0x7fd038068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.645+0000 7fd057400700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd038066730 0x7fd038068bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd044009ba0 tx=0x7fd044008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.649+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd048050840 con 0x7fd05806afe0 2024-09-13T15:10:40.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.869+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd0580ce4b0 con 0x7fd05806afe0 2024-09-13T15:10:40.874 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:10:40.869+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:10:40.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.881+0000 7fd04fe00700 1 -- 172.21.15.50:0/1954364287 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd048053e60 con 0x7fd05806afe0 2024-09-13T15:10:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd038066730 msgr2=0x7fd038068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd038066730 0x7fd038068bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd044009ba0 tx=0x7fd044008030 comp rx=0 tx=0).stop 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 msgr2=0x7fd05814f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 0x7fd05814f2d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd048001eb0 tx=0x7fd04800c7b0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 shutdown_connections 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd038066730 0x7fd038068bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd058159bd0 0x7fd058150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd0580cb700 0x7fd0581515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 --2- 172.21.15.50:0/1954364287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd05806afe0 0x7fd05814f2d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 >> 172.21.15.50:0/1954364287 conn(0x7fd0580b0c40 msgr2=0x7fd058156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 shutdown_connections 2024-09-13T15:10:40.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:40.885+0000 7fd05da00700 1 -- 172.21.15.50:0/1954364287 wait complete. 2024-09-13T15:10:40.890 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:10:40.895 INFO:tasks.ceph.mds.c.smithi050.stderr: -2052> 2024-09-13T15:10:22.646+0000 7f6916c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:10:40.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:10:40.953 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:10:41.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4ddb200700 1 Processor -- start 2024-09-13T15:10:41.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4ddb200700 1 -- start start 2024-09-13T15:10:41.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4ddb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd41464c0 0x7f4dd4071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:41.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4ddb200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd4070da0 con 0x7f4dd40b1980 2024-09-13T15:10:41.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4ddb200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd40b2440 con 0x7f4dd406d070 2024-09-13T15:10:41.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4ddb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40b2720 con 0x7f4dd41464c0 2024-09-13T15:10:41.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4dd9400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4dd40b1980 0x7f4dd406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58180/0 (socket says 172.21.15.50:58180) 2024-09-13T15:10:41.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4dd9400700 1 -- 172.21.15.50:0/126903876 learned_addr learned my addr 172.21.15.50:0/126903876 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:41.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.089+0000 7f4dd9e00700 1 --2- 172.21.15.50:0/126903876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd41464c0 0x7f4dd4071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:41.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd8a00700 1 -- 172.21.15.50:0/126903876 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802840459 0 0) 0x7f4dd4070da0 con 0x7f4dd40b1980 2024-09-13T15:10:41.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd8a00700 1 -- 172.21.15.50:0/126903876 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dbc0035d0 con 0x7f4dd40b1980 2024-09-13T15:10:41.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd9e00700 1 -- 172.21.15.50:0/126903876 >> v1:172.21.15.181:6789/0 conn(0x7f4dd406d070 legacy=0x7f4dd40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd9e00700 1 -- 172.21.15.50:0/126903876 >> v1:172.21.15.50:6789/0 conn(0x7f4dd40b1980 legacy=0x7f4dd406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd9e00700 1 -- 172.21.15.50:0/126903876 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4071060 con 0x7f4dd41464c0 2024-09-13T15:10:41.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd9e00700 1 --2- 172.21.15.50:0/126903876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd41464c0 0x7f4dd4071860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009880 tx=0x7f4dc8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f2786d1fb84960 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:41.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd8a00700 1 -- 172.21.15.50:0/126903876 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8011830 con 0x7f4dd41464c0 2024-09-13T15:10:41.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd8a00700 1 -- 172.21.15.50:0/126903876 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc8011990 con 0x7f4dd41464c0 2024-09-13T15:10:41.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4dd8a00700 1 -- 172.21.15.50:0/126903876 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8011d20 con 0x7f4dd41464c0 2024-09-13T15:10:41.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 -- 172.21.15.50:0/126903876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd41464c0 msgr2=0x7f4dd4071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 --2- 172.21.15.50:0/126903876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd41464c0 0x7f4dd4071860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009880 tx=0x7f4dc8009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:41.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 -- 172.21.15.50:0/126903876 shutdown_connections 2024-09-13T15:10:41.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 --2- 172.21.15.50:0/126903876 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd41464c0 0x7f4dd4071860 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 -- 172.21.15.50:0/126903876 >> 172.21.15.50:0/126903876 conn(0x7f4dd406a390 msgr2=0x7f4dd406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:41.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 -- 172.21.15.50:0/126903876 shutdown_connections 2024-09-13T15:10:41.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.093+0000 7f4ddb200700 1 -- 172.21.15.50:0/126903876 wait complete. 2024-09-13T15:10:41.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 Processor -- start 2024-09-13T15:10:41.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 -- start start 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 0x7f4dd41fab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40b1980 0x7f4dd415f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd41464c0 0x7f4dd40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41ece00 con 0x7f4dd406d070 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40cad40 con 0x7f4dd41464c0 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4ddb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41fa030 con 0x7f4dd40b1980 2024-09-13T15:10:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4dd9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 0x7f4dd41fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:41.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4dd9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 0x7f4dd41fab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48662/0 (socket says 172.21.15.50:48662) 2024-09-13T15:10:41.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4dd9e00700 1 -- 172.21.15.50:0/2937504260 learned_addr learned my addr 172.21.15.50:0/2937504260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:41.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4dd9400700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40b1980 0x7f4dd415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.097+0000 7f4dda800700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd41464c0 0x7f4dd40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9e00700 1 -- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40b1980 msgr2=0x7f4dd415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9e00700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40b1980 0x7f4dd415f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9e00700 1 -- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd41464c0 msgr2=0x7f4dd40ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9e00700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd41464c0 0x7f4dd40ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9e00700 1 -- 172.21.15.50:0/2937504260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80094b0 con 0x7f4dd406d070 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9400700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40b1980 0x7f4dd415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:41.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dd9e00700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 0x7f4dd41fab10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8013040 tx=0x7f4dc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8004610 con 0x7f4dd406d070 2024-09-13T15:10:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc80036c0 con 0x7f4dd406d070 2024-09-13T15:10:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd41fa310 con 0x7f4dd406d070 2024-09-13T15:10:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8003a50 con 0x7f4dd406d070 2024-09-13T15:10:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd40cb020 con 0x7f4dd406d070 2024-09-13T15:10:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.101+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd41fa830 con 0x7f4dd406d070 2024-09-13T15:10:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.105+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4dc8003bb0 con 0x7f4dd406d070 2024-09-13T15:10:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.105+0000 7f4dce000700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db8066730 0x7f4db8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.105+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f4dc8085850 con 0x7f4dd406d070 2024-09-13T15:10:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.105+0000 7f4dd9400700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db8066730 0x7f4db8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.109+0000 7f4dd9400700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db8066730 0x7f4db8068bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4dd41f9ef0 tx=0x7f4dc4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.113+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4dc8052a10 con 0x7f4dd406d070 2024-09-13T15:10:41.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.341+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4dd4071860 con 0x7f4dd406d070 2024-09-13T15:10:41.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.889+0000 7f4dce000700 1 -- 172.21.15.50:0/2937504260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4dc8003e60 con 0x7f4dd406d070 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db8066730 msgr2=0x7f4db8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db8066730 0x7f4db8068bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4dd41f9ef0 tx=0x7f4dc4007de0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 msgr2=0x7f4dd41fab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 0x7f4dd41fab10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8013040 tx=0x7f4dc8004770 comp rx=0 tx=0).stop 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 shutdown_connections 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4db8066730 0x7f4db8068bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4dd41464c0 0x7f4dd40ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4dd40b1980 0x7f4dd415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 --2- 172.21.15.50:0/2937504260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd406d070 0x7f4dd41fab10 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 >> 172.21.15.50:0/2937504260 conn(0x7f4dd406a390 msgr2=0x7f4dd40ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 shutdown_connections 2024-09-13T15:10:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:41.893+0000 7f4ddb200700 1 -- 172.21.15.50:0/2937504260 wait complete. 2024-09-13T15:10:41.916 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:10:42.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.133+0000 7f1fff200700 1 Processor -- start 2024-09-13T15:10:42.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.133+0000 7f1fff200700 1 -- start start 2024-09-13T15:10:42.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1fff200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f200015a930 0x7f20000cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:42.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1fff200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200006a780 con 0x7f20000cf4e0 2024-09-13T15:10:42.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1fff200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200006aa20 con 0x7f20000b55e0 2024-09-13T15:10:42.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1fff200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000cf930 con 0x7f200015a930 2024-09-13T15:10:42.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffd400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f20000cf4e0 0x7f20000b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58184/0 (socket says 172.21.15.50:58184) 2024-09-13T15:10:42.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffd400700 1 -- 172.21.15.50:0/1531951804 learned_addr learned my addr 172.21.15.50:0/1531951804 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:42.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffde00700 1 --2- 172.21.15.50:0/1531951804 >> v2:172.21.15.181:3300/0 conn(0x7f200015a930 0x7f20000cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:42.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffca00700 1 -- 172.21.15.50:0/1531951804 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633438257 0 0) 0x7f200006a780 con 0x7f20000cf4e0 2024-09-13T15:10:42.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffca00700 1 -- 172.21.15.50:0/1531951804 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe40035d0 con 0x7f20000cf4e0 2024-09-13T15:10:42.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffde00700 1 -- 172.21.15.50:0/1531951804 >> v1:172.21.15.181:6789/0 conn(0x7f20000b55e0 legacy=0x7f200015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffde00700 1 -- 172.21.15.50:0/1531951804 >> v1:172.21.15.50:6789/0 conn(0x7f20000cf4e0 legacy=0x7f20000b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.137+0000 7f1ffde00700 1 -- 172.21.15.50:0/1531951804 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200006ad00 con 0x7f200015a930 2024-09-13T15:10:42.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1ffde00700 1 --2- 172.21.15.50:0/1531951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f200015a930 0x7f20000cefa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009850 tx=0x7f1ff0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e997b7ada8dca265 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:42.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1ffca00700 1 -- 172.21.15.50:0/1531951804 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0011830 con 0x7f200015a930 2024-09-13T15:10:42.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1ffca00700 1 -- 172.21.15.50:0/1531951804 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0011990 con 0x7f200015a930 2024-09-13T15:10:42.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1ffca00700 1 -- 172.21.15.50:0/1531951804 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0011d40 con 0x7f200015a930 2024-09-13T15:10:42.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 -- 172.21.15.50:0/1531951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f200015a930 msgr2=0x7f20000cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 --2- 172.21.15.50:0/1531951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f200015a930 0x7f20000cefa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009850 tx=0x7f1ff0009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:42.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 -- 172.21.15.50:0/1531951804 shutdown_connections 2024-09-13T15:10:42.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 --2- 172.21.15.50:0/1531951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f200015a930 0x7f20000cefa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 -- 172.21.15.50:0/1531951804 >> 172.21.15.50:0/1531951804 conn(0x7f2000070cd0 msgr2=0x7f20000710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:42.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 -- 172.21.15.50:0/1531951804 shutdown_connections 2024-09-13T15:10:42.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.141+0000 7f1fff200700 1 -- 172.21.15.50:0/1531951804 wait complete. 2024-09-13T15:10:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 Processor -- start 2024-09-13T15:10:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 -- start start 2024-09-13T15:10:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20000b55e0 0x7f20000cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 0x7f20001471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f200015a930 0x7f2000147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000c9450 con 0x7f20000cf4e0 2024-09-13T15:10:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000cbac0 con 0x7f20000b55e0 2024-09-13T15:10:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1fff200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20001512b0 con 0x7f200015a930 2024-09-13T15:10:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1ffd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 0x7f20001471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1ffd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 0x7f20001471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48678/0 (socket says 172.21.15.50:48678) 2024-09-13T15:10:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1ffd400700 1 -- 172.21.15.50:0/1965055908 learned_addr learned my addr 172.21.15.50:0/1965055908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1ffde00700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20000b55e0 0x7f20000cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.145+0000 7f1ffe800700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f200015a930 0x7f2000147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffd400700 1 -- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f200015a930 msgr2=0x7f2000147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffd400700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f200015a930 0x7f2000147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffd400700 1 -- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20000b55e0 msgr2=0x7f20000cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffd400700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20000b55e0 0x7f20000cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffd400700 1 -- 172.21.15.50:0/1965055908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00094b0 con 0x7f20000cf4e0 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffe800700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f200015a930 0x7f2000147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ffd400700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 0x7f20001471d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c700 tx=0x7f1fec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec005d90 con 0x7f20000cf4e0 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec0070d0 con 0x7f20000cf4e0 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2000151590 con 0x7f20000cf4e0 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec007480 con 0x7f20000cf4e0 2024-09-13T15:10:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000150530 con 0x7f20000cf4e0 2024-09-13T15:10:42.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.149+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20001517d0 con 0x7f20000cf4e0 2024-09-13T15:10:42.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.153+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1fec0075e0 con 0x7f20000cf4e0 2024-09-13T15:10:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.153+0000 7f1ff6000700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1fe0066730 0x7f1fe0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.153+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f1fec0838a0 con 0x7f20000cf4e0 2024-09-13T15:10:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.153+0000 7f1ffde00700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1fe0066730 0x7f1fe0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.157+0000 7f1ffde00700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1fe0066730 0x7f1fe0068bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00090b0 tx=0x7f1ff001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.161+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20001517d0 con 0x7f20000cf4e0 2024-09-13T15:10:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.349+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20000c8f40 con 0x7f20000cf4e0 2024-09-13T15:10:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.897+0000 7f1ff6000700 1 -- 172.21.15.50:0/1965055908 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7f20000c8f40 con 0x7f20000cf4e0 2024-09-13T15:10:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.901+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1fe0066730 msgr2=0x7f1fe0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.901+0000 7f1fff200700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1fe0066730 0x7f1fe0068bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00090b0 tx=0x7f1ff001c040 comp rx=0 tx=0).stop 2024-09-13T15:10:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 msgr2=0x7f20001471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 0x7f20001471d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c700 tx=0x7f1fec00ca10 comp rx=0 tx=0).stop 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 shutdown_connections 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1fe0066730 0x7f1fe0068bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f200015a930 0x7f2000147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20000cf4e0 0x7f20001471d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 --2- 172.21.15.50:0/1965055908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20000b55e0 0x7f20000cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 >> 172.21.15.50:0/1965055908 conn(0x7f2000070cd0 msgr2=0x7f20000b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 shutdown_connections 2024-09-13T15:10:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:42.905+0000 7f1fff200700 1 -- 172.21.15.50:0/1965055908 wait complete. 2024-09-13T15:10:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:10:42.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:10:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.109+0000 7fc2c7400700 1 Processor -- start 2024-09-13T15:10:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.109+0000 7fc2c7400700 1 -- start start 2024-09-13T15:10:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c00b3580 0x7fc2c00b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c7400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2c0070dc0 0x7fc2c00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c7400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c00cdfe0 con 0x7fc2c0159900 2024-09-13T15:10:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c7400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c0071730 con 0x7fc2c00b3580 2024-09-13T15:10:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c7400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c00ce210 con 0x7fc2c0070dc0 2024-09-13T15:10:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2bfe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2c00b3580 0x7fc2c00b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c5400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2c0070dc0 0x7fc2c00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c4a00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc2c0159900 0x7fc2c00cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:48984/0 (socket says 172.21.15.50:48984) 2024-09-13T15:10:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.113+0000 7fc2c4a00700 1 -- 172.21.15.50:0/2782731603 learned_addr learned my addr 172.21.15.50:0/2782731603 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2bf400700 1 -- 172.21.15.50:0/2782731603 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606171037 0 0) 0x7fc2c00cdfe0 con 0x7fc2c0159900 2024-09-13T15:10:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c5400700 1 -- 172.21.15.50:0/2782731603 >> v2:172.21.15.50:3300/0 conn(0x7fc2c00b3580 msgr2=0x7fc2c00b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c5400700 1 --2- 172.21.15.50:0/2782731603 >> v2:172.21.15.50:3300/0 conn(0x7fc2c00b3580 0x7fc2c00b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c5400700 1 -- 172.21.15.50:0/2782731603 >> v1:172.21.15.181:6789/0 conn(0x7fc2c0159900 legacy=0x7fc2c00cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c5400700 1 -- 172.21.15.50:0/2782731603 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c00ce4f0 con 0x7fc2c0070dc0 2024-09-13T15:10:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2bfe00700 1 --2- 172.21.15.50:0/2782731603 >> v2:172.21.15.50:3300/0 conn(0x7fc2c00b3580 0x7fc2c00b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:43.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c5400700 1 --2- 172.21.15.50:0/2782731603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c0070dc0 0x7fc2c00711f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00b3f60 tx=0x7fc2b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c780494a5276e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:43.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2bf400700 1 -- 172.21.15.50:0/2782731603 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800e070 con 0x7fc2c0070dc0 2024-09-13T15:10:43.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2bf400700 1 -- 172.21.15.50:0/2782731603 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b800bb20 con 0x7fc2c0070dc0 2024-09-13T15:10:43.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2bf400700 1 -- 172.21.15.50:0/2782731603 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8012430 con 0x7fc2c0070dc0 2024-09-13T15:10:43.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 -- 172.21.15.50:0/2782731603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c0070dc0 msgr2=0x7fc2c00711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:43.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 --2- 172.21.15.50:0/2782731603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c0070dc0 0x7fc2c00711f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00b3f60 tx=0x7fc2b800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:43.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 -- 172.21.15.50:0/2782731603 shutdown_connections 2024-09-13T15:10:43.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 --2- 172.21.15.50:0/2782731603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c0070dc0 0x7fc2c00711f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 --2- 172.21.15.50:0/2782731603 >> v2:172.21.15.50:3300/0 conn(0x7fc2c00b3580 0x7fc2c00b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 -- 172.21.15.50:0/2782731603 >> 172.21.15.50:0/2782731603 conn(0x7fc2c00b18c0 msgr2=0x7fc2c00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:43.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 -- 172.21.15.50:0/2782731603 shutdown_connections 2024-09-13T15:10:43.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.117+0000 7fc2c7400700 1 -- 172.21.15.50:0/2782731603 wait complete. 2024-09-13T15:10:43.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.121+0000 7fc2c7400700 1 Processor -- start 2024-09-13T15:10:43.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.121+0000 7fc2c7400700 1 -- start start 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c0070dc0 0x7fc2c0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c00b3580 0x7fc2c015b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 0x7fc2c014a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0151400 con 0x7fc2c0159900 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0151610 con 0x7fc2c00b3580 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c01518f0 con 0x7fc2c0070dc0 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 0x7fc2c014a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 0x7fc2c014a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51306/0 (socket says 172.21.15.50:51306) 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 -- 172.21.15.50:0/333842971 learned_addr learned my addr 172.21.15.50:0/333842971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:43.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c4a00700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c0070dc0 0x7fc2c0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:43.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2bfe00700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c00b3580 0x7fc2c015b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:43.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 -- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c0070dc0 msgr2=0x7fc2c0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:43.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c0070dc0 0x7fc2c0152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 -- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c00b3580 msgr2=0x7fc2c015b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:43.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c00b3580 0x7fc2c015b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 -- 172.21.15.50:0/333842971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac0094b0 con 0x7fc2c0159900 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2bfe00700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c00b3580 0x7fc2c015b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c5400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 0x7fc2c014a000 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8014040 tx=0x7fc2b8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8012430 con 0x7fc2c0159900 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8020070 con 0x7fc2c0159900 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8009a70 con 0x7fc2c0159900 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8004280 con 0x7fc2c0159900 2024-09-13T15:10:43.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.125+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c0151eb0 con 0x7fc2c0159900 2024-09-13T15:10:43.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.129+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c00cf170 con 0x7fc2c0159900 2024-09-13T15:10:43.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.129+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2b80043e0 con 0x7fc2c0159900 2024-09-13T15:10:43.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.133+0000 7fc2bcc00700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2a0066730 0x7fc2a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.133+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5677+0+0 (secure 0 0 0) 0x7fc2b8022070 con 0x7fc2c0159900 2024-09-13T15:10:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.133+0000 7fc2c4a00700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2a0066730 0x7fc2a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.133+0000 7fc2c4a00700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2a0066730 0x7fc2a0068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000f60 tx=0x7fc2b4004a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.137+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2b8053610 con 0x7fc2c0159900 2024-09-13T15:10:43.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.317+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2c00711f0 con 0x7fc2c0159900 2024-09-13T15:10:43.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.905+0000 7fc2bcc00700 1 -- 172.21.15.50:0/333842971 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2b8056c30 con 0x7fc2c0159900 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2a0066730 msgr2=0x7fc2a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2a0066730 0x7fc2a0068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000f60 tx=0x7fc2b4004a70 comp rx=0 tx=0).stop 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 msgr2=0x7fc2c014a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 0x7fc2c014a000 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8014040 tx=0x7fc2b8004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 shutdown_connections 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2a0066730 0x7fc2a0068bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0159900 0x7fc2c014a000 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2c00b3580 0x7fc2c015b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 --2- 172.21.15.50:0/333842971 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2c0070dc0 0x7fc2c0152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 >> 172.21.15.50:0/333842971 conn(0x7fc2c00b18c0 msgr2=0x7fc2c0155e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 shutdown_connections 2024-09-13T15:10:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:43.909+0000 7fc2c7400700 1 -- 172.21.15.50:0/333842971 wait complete. 2024-09-13T15:10:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:10:43.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T15:10:44.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.101+0000 7f2bc1200700 1 Processor -- start 2024-09-13T15:10:44.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.101+0000 7f2bc1200700 1 -- start start 2024-09-13T15:10:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bc1200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2bbc0cd850 0x7f2bbc0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bc1200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc0b57e0 con 0x7f2bbc15e030 2024-09-13T15:10:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bc1200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc0b3b80 con 0x7f2bbc157500 2024-09-13T15:10:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bc1200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc0b5a80 con 0x7f2bbc0cd850 2024-09-13T15:10:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb9400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2bbc15e030 0x7f2bbc0cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54436/0 (socket says 172.21.15.50:54436) 2024-09-13T15:10:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb9400700 1 -- 172.21.15.50:0/3195705017 learned_addr learned my addr 172.21.15.50:0/3195705017 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bba800700 1 --2- 172.21.15.50:0/3195705017 >> v2:172.21.15.50:3300/0 conn(0x7f2bbc0cd850 0x7f2bbc0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100066604 0 0) 0x7f2bbc0b57e0 con 0x7f2bbc15e030 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba00035d0 con 0x7f2bbc15e030 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129501730 0 0) 0x7f2bbc0b3b80 con 0x7f2bbc157500 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bbc0b57e0 con 0x7f2bbc157500 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668247208 0 0) 0x7f2ba00035d0 con 0x7f2bbc15e030 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 >> v2:172.21.15.50:3300/0 conn(0x7f2bbc0cd850 msgr2=0x7f2bbc0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 --2- 172.21.15.50:0/3195705017 >> v2:172.21.15.50:3300/0 conn(0x7f2bbc0cd850 0x7f2bbc0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 >> v1:172.21.15.181:6789/0 conn(0x7f2bbc157500 legacy=0x7f2bbc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0b5d60 con 0x7f2bbc15e030 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f2ba8001670 con 0x7f2bbc15e030 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bba800700 1 --2- 172.21.15.50:0/3195705017 >> v2:172.21.15.50:3300/0 conn(0x7f2bbc0cd850 0x7f2bbc0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 >> v1:172.21.15.50:6789/0 conn(0x7f2bbc15e030 legacy=0x7f2bbc0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0003bb0 0x7f2ba0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba0004870 0x7f2ba0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba0005230 0x7f2ba000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0b5a80 con 0x7f2ba0004870 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba000c0d0 con 0x7f2ba0003bb0 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba000c290 con 0x7f2ba0005230 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb9400700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba0004870 0x7f2ba0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.105+0000 7f2bb9e00700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0003bb0 0x7f2ba0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bba800700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba0005230 0x7f2ba000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb9400700 1 -- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba0005230 msgr2=0x7f2ba000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb9400700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ba0005230 0x7f2ba000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb9400700 1 -- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0003bb0 msgr2=0x7f2ba0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb9400700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0003bb0 0x7f2ba0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb9400700 1 -- 172.21.15.50:0/3195705017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00035d0 con 0x7f2ba0004870 2024-09-13T15:10:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bba800700 1 -- 172.21.15.50:0/3195705017 reap_dead start 2024-09-13T15:10:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb9400700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba0004870 0x7f2ba0004cf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800c210 tx=0x7f2ba00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd99c0d3bc5daed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800cd10 con 0x7f2ba0004870 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba800ce70 con 0x7f2ba0004870 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bb8a00700 1 -- 172.21.15.50:0/3195705017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8005ba0 con 0x7f2ba0004870 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 -- 172.21.15.50:0/3195705017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba0004870 msgr2=0x7f2ba0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba0004870 0x7f2ba0004cf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800c210 tx=0x7f2ba00058a0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 -- 172.21.15.50:0/3195705017 shutdown_connections 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 --2- 172.21.15.50:0/3195705017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ba0004870 0x7f2ba0004cf0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 -- 172.21.15.50:0/3195705017 >> 172.21.15.50:0/3195705017 conn(0x7f2bbc06e660 msgr2=0x7f2bbc06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:44.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 -- 172.21.15.50:0/3195705017 shutdown_connections 2024-09-13T15:10:44.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.109+0000 7f2bc1200700 1 -- 172.21.15.50:0/3195705017 wait complete. 2024-09-13T15:10:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 Processor -- start 2024-09-13T15:10:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 -- start start 2024-09-13T15:10:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0004870 0x7f2bbc0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bbc147320 0x7f2bbc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 0x7f2bbc0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc06bf80 con 0x7f2bbc147780 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc06c540 con 0x7f2ba0004870 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bc1200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc1f7460 con 0x7f2bbc147320 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bba800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 0x7f2bbc0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bba800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 0x7f2bbc0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51332/0 (socket says 172.21.15.50:51332) 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bba800700 1 -- 172.21.15.50:0/1597197781 learned_addr learned my addr 172.21.15.50:0/1597197781 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bb9e00700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0004870 0x7f2bbc0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.113+0000 7f2bb9400700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bbc147320 0x7f2bbc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bba800700 1 -- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bbc147320 msgr2=0x7f2bbc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bba800700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bbc147320 0x7f2bbc06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bba800700 1 -- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0004870 msgr2=0x7f2bbc0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bba800700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0004870 0x7f2bbc0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bba800700 1 -- 172.21.15.50:0/1597197781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc06c1d0 con 0x7f2bbc147780 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bba800700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 0x7f2bbc0c9f00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc071d90 tx=0x7f2bb400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb401c070 con 0x7f2bbc147780 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb400f040 con 0x7f2bbc147780 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc1f7150 con 0x7f2bbc147780 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400e040 con 0x7f2bbc147780 2024-09-13T15:10:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc06cf10 con 0x7f2bbc147780 2024-09-13T15:10:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.117+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc06c6d0 con 0x7f2bbc147780 2024-09-13T15:10:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.121+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2bb4015430 con 0x7f2bbc147780 2024-09-13T15:10:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.121+0000 7f2bb2000700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b9c066760 0x7f2b9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.121+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2bb4083d30 con 0x7f2bbc147780 2024-09-13T15:10:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.121+0000 7f2bb9e00700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b9c066760 0x7f2b9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.125+0000 7f2bb9e00700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b9c066760 0x7f2b9c068c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc067950 tx=0x7f2bac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:44.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.125+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bb40511c0 con 0x7f2bbc147780 2024-09-13T15:10:44.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.317+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2bbc06d1f0 con 0x7f2bbc147780 2024-09-13T15:10:44.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bb2000700 1 -- 172.21.15.50:0/1597197781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2bb40547e0 con 0x7f2bbc147780 2024-09-13T15:10:44.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b9c066760 msgr2=0x7f2b9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b9c066760 0x7f2b9c068c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc067950 tx=0x7f2bac009040 comp rx=0 tx=0).stop 2024-09-13T15:10:44.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 msgr2=0x7f2bbc0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 0x7f2bbc0c9f00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc071d90 tx=0x7f2bb400f490 comp rx=0 tx=0).stop 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 shutdown_connections 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b9c066760 0x7f2b9c068c20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2bbc147780 0x7f2bbc0c9f00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2bbc147320 0x7f2bbc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 --2- 172.21.15.50:0/1597197781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ba0004870 0x7f2bbc0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 >> 172.21.15.50:0/1597197781 conn(0x7f2bbc06e660 msgr2=0x7f2bbc15f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 shutdown_connections 2024-09-13T15:10:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.325+0000 7f2bc1200700 1 -- 172.21.15.50:0/1597197781 wait complete. 2024-09-13T15:10:44.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-13T15:10:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.525+0000 7f4e98800700 1 Processor -- start 2024-09-13T15:10:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.525+0000 7f4e98800700 1 -- start start 2024-09-13T15:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e98800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e90071f20 0x7f4e900724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e98800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e98800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e90071a90 con 0x7f4e9015cb50 2024-09-13T15:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e98800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e90066a40 con 0x7f4e90071f20 2024-09-13T15:10:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e98800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900b29e0 con 0x7f4e90066090 2024-09-13T15:10:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e95e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e9015cb50 0x7f4e900b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54450/0 (socket says 172.21.15.50:54450) 2024-09-13T15:10:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e95e00700 1 -- 172.21.15.50:0/929897336 learned_addr learned my addr 172.21.15.50:0/929897336 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e96800700 1 --2- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e95400700 1 --2- 172.21.15.50:0/929897336 >> v2:172.21.15.181:3300/0 conn(0x7f4e90071f20 0x7f4e900724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e94a00700 1 -- 172.21.15.50:0/929897336 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359483806 0 0) 0x7f4e90071a90 con 0x7f4e9015cb50 2024-09-13T15:10:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e94a00700 1 -- 172.21.15.50:0/929897336 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e780035d0 con 0x7f4e9015cb50 2024-09-13T15:10:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e95400700 1 -- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 msgr2=0x7f4e90066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e95400700 1 --2- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90066500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.529+0000 7f4e95400700 1 -- 172.21.15.50:0/929897336 >> v1:172.21.15.50:6789/0 conn(0x7f4e9015cb50 legacy=0x7f4e900b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e95400700 1 -- 172.21.15.50:0/929897336 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900b2cc0 con 0x7f4e90071f20 2024-09-13T15:10:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e95400700 1 --2- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e90071f20 0x7f4e900724c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4e80009850 tx=0x7f4e80009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8b07f4e5430ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e94a00700 1 -- 172.21.15.50:0/929897336 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80011830 con 0x7f4e90071f20 2024-09-13T15:10:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e94a00700 1 -- 172.21.15.50:0/929897336 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80011990 con 0x7f4e90071f20 2024-09-13T15:10:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e94a00700 1 -- 172.21.15.50:0/929897336 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80011d40 con 0x7f4e90071f20 2024-09-13T15:10:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 -- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e90071f20 msgr2=0x7f4e900724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 --2- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e90071f20 0x7f4e900724c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4e80009850 tx=0x7f4e80009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 -- 172.21.15.50:0/929897336 shutdown_connections 2024-09-13T15:10:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 --2- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90066500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 --2- 172.21.15.50:0/929897336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e90071f20 0x7f4e900724c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 -- 172.21.15.50:0/929897336 >> 172.21.15.50:0/929897336 conn(0x7f4e900b1e00 msgr2=0x7f4e900cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 -- 172.21.15.50:0/929897336 shutdown_connections 2024-09-13T15:10:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.533+0000 7f4e98800700 1 -- 172.21.15.50:0/929897336 wait complete. 2024-09-13T15:10:44.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.537+0000 7f4e98800700 1 Processor -- start 2024-09-13T15:10:44.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.537+0000 7f4e98800700 1 -- start start 2024-09-13T15:10:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 0x7f4e90158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e9015cb50 0x7f4e9015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90158ba0 con 0x7f4e90071f20 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90152ae0 con 0x7f4e9015cb50 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90159670 con 0x7f4e90066090 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 0x7f4e90158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 0x7f4e90158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51348/0 (socket says 172.21.15.50:51348) 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 -- 172.21.15.50:0/855893493 learned_addr learned my addr 172.21.15.50:0/855893493 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95e00700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e96800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e9015cb50 0x7f4e9015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 -- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 msgr2=0x7f4e90158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 -- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e9015cb50 msgr2=0x7f4e9015e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e9015cb50 0x7f4e9015e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 -- 172.21.15.50:0/855893493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800094b0 con 0x7f4e90071f20 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e95400700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 0x7f4e90158660 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4e800090b0 tx=0x7f4e80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80004380 con 0x7f4e90071f20 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8001f070 con 0x7f4e90071f20 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800036c0 con 0x7f4e90071f20 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e90158dd0 con 0x7f4e90071f20 2024-09-13T15:10:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.541+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e90159390 con 0x7f4e90071f20 2024-09-13T15:10:44.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.545+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90066500 con 0x7f4e90071f20 2024-09-13T15:10:44.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.545+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e80021030 con 0x7f4e90071f20 2024-09-13T15:10:44.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.545+0000 7f4e8a000700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4e74066730 0x7f4e74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:44.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.549+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4e80085250 con 0x7f4e90071f20 2024-09-13T15:10:44.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.549+0000 7f4e95e00700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4e74066730 0x7f4e74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:44.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.549+0000 7f4e95e00700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4e74066730 0x7f4e74068bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4e84007fd0 tx=0x7f4e84007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:44.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.553+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e80052890 con 0x7f4e90071f20 2024-09-13T15:10:44.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.825+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7f4e90067730 con 0x7f4e90071f20 2024-09-13T15:10:44.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.909+0000 7f4e8a000700 1 -- 172.21.15.50:0/855893493 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v198) v1 ==== 142+0+0 (secure 0 0 0) 0x7f4e80006ce0 con 0x7f4e90071f20 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4e74066730 msgr2=0x7f4e74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4e74066730 0x7f4e74068bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4e84007fd0 tx=0x7f4e84007de0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 msgr2=0x7f4e90158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 0x7f4e90158660 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4e800090b0 tx=0x7f4e80004770 comp rx=0 tx=0).stop 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 shutdown_connections 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4e74066730 0x7f4e74068bf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e9015cb50 0x7f4e9015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e90071f20 0x7f4e90158660 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 --2- 172.21.15.50:0/855893493 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e90066090 0x7f4e90158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.913+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 >> 172.21.15.50:0/855893493 conn(0x7f4e900b1e00 msgr2=0x7f4e900b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.917+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 shutdown_connections 2024-09-13T15:10:44.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:44.917+0000 7f4e98800700 1 -- 172.21.15.50:0/855893493 wait complete. 2024-09-13T15:10:44.940 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... skipped 'Requires FUSE client to inject client metadata' 2024-09-13T15:10:44.941 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-13T15:10:44.941 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T15:10:44.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:45.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.109+0000 7f8e3a600700 1 Processor -- start 2024-09-13T15:10:45.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.109+0000 7f8e3a600700 1 -- start start 2024-09-13T15:10:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e3a600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8e341460c0 0x7f8e3406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e3a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e34146570 0x7f8e34066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e3a600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e340ad130 con 0x7f8e340665d0 2024-09-13T15:10:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e3a600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e34066a80 con 0x7f8e341460c0 2024-09-13T15:10:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e3a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3406b380 con 0x7f8e34146570 2024-09-13T15:10:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e39c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8e340665d0 0x7f8e34070dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54452/0 (socket says 172.21.15.50:54452) 2024-09-13T15:10:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e39c00700 1 -- 172.21.15.50:0/741740941 learned_addr learned my addr 172.21.15.50:0/741740941 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e2be00700 1 --2- 172.21.15.50:0/741740941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e34146570 0x7f8e34066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e39200700 1 --2- 172.21.15.50:0/741740941 >> v2:172.21.15.181:3300/0 conn(0x7f8e341460c0 0x7f8e3406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e33e00700 1 -- 172.21.15.50:0/741740941 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126247836 0 0) 0x7f8e340ad130 con 0x7f8e340665d0 2024-09-13T15:10:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e33e00700 1 -- 172.21.15.50:0/741740941 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e180035d0 con 0x7f8e340665d0 2024-09-13T15:10:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e2be00700 1 -- 172.21.15.50:0/741740941 >> v2:172.21.15.181:3300/0 conn(0x7f8e341460c0 msgr2=0x7f8e3406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e2be00700 1 --2- 172.21.15.50:0/741740941 >> v2:172.21.15.181:3300/0 conn(0x7f8e341460c0 0x7f8e3406aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e2be00700 1 -- 172.21.15.50:0/741740941 >> v1:172.21.15.50:6789/0 conn(0x7f8e340665d0 legacy=0x7f8e34070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e2be00700 1 -- 172.21.15.50:0/741740941 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3406b660 con 0x7f8e34146570 2024-09-13T15:10:45.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e2be00700 1 --2- 172.21.15.50:0/741740941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e34146570 0x7f8e34066090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009880 tx=0x7f8e1c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbb10c925adcf33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.113+0000 7f8e33e00700 1 -- 172.21.15.50:0/741740941 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011830 con 0x7f8e34146570 2024-09-13T15:10:45.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e33e00700 1 -- 172.21.15.50:0/741740941 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c011990 con 0x7f8e34146570 2024-09-13T15:10:45.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e33e00700 1 -- 172.21.15.50:0/741740941 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011d20 con 0x7f8e34146570 2024-09-13T15:10:45.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 -- 172.21.15.50:0/741740941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e34146570 msgr2=0x7f8e34066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 --2- 172.21.15.50:0/741740941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e34146570 0x7f8e34066090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009880 tx=0x7f8e1c009b90 comp rx=0 tx=0).stop 2024-09-13T15:10:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 -- 172.21.15.50:0/741740941 shutdown_connections 2024-09-13T15:10:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 --2- 172.21.15.50:0/741740941 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e34146570 0x7f8e34066090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 --2- 172.21.15.50:0/741740941 >> v2:172.21.15.181:3300/0 conn(0x7f8e341460c0 0x7f8e3406aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 -- 172.21.15.50:0/741740941 >> 172.21.15.50:0/741740941 conn(0x7f8e3406e660 msgr2=0x7f8e3406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 -- 172.21.15.50:0/741740941 shutdown_connections 2024-09-13T15:10:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.117+0000 7f8e3a600700 1 -- 172.21.15.50:0/741740941 wait complete. 2024-09-13T15:10:45.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 Processor -- start 2024-09-13T15:10:45.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 -- start start 2024-09-13T15:10:45.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e340665d0 0x7f8e340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 0x7f8e34133d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e34146570 0x7f8e341342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3415cd60 con 0x7f8e341460c0 2024-09-13T15:10:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341329b0 con 0x7f8e34146570 2024-09-13T15:10:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e3a600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34132c90 con 0x7f8e340665d0 2024-09-13T15:10:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 0x7f8e34133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 0x7f8e34133d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51360/0 (socket says 172.21.15.50:51360) 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 -- 172.21.15.50:0/2428970709 learned_addr learned my addr 172.21.15.50:0/2428970709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e39c00700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e34146570 0x7f8e341342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e39200700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e340665d0 0x7f8e340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 -- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e340665d0 msgr2=0x7f8e340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e340665d0 0x7f8e340ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 -- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e34146570 msgr2=0x7f8e341342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e34146570 0x7f8e341342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 -- 172.21.15.50:0/2428970709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0094b0 con 0x7f8e341460c0 2024-09-13T15:10:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.121+0000 7f8e2be00700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 0x7f8e34133d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0090b0 tx=0x7f8e1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004480 con 0x7f8e341460c0 2024-09-13T15:10:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c01f070 con 0x7f8e341460c0 2024-09-13T15:10:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c003900 con 0x7f8e341460c0 2024-09-13T15:10:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e34132f70 con 0x7f8e341460c0 2024-09-13T15:10:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e34133530 con 0x7f8e341460c0 2024-09-13T15:10:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e340ae960 con 0x7f8e341460c0 2024-09-13T15:10:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.125+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e1c021030 con 0x7f8e341460c0 2024-09-13T15:10:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.129+0000 7f8e31600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e10066730 0x7f8e10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.129+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8e1c0852a0 con 0x7f8e341460c0 2024-09-13T15:10:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.129+0000 7f8e39200700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e10066730 0x7f8e10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.129+0000 7f8e39200700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e10066730 0x7f8e10068bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e240073f0 tx=0x7f8e2400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.137+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e1c0528e0 con 0x7f8e341460c0 2024-09-13T15:10:45.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.325+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e3406a860 con 0x7f8e341460c0 2024-09-13T15:10:45.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.329+0000 7f8e31600700 1 -- 172.21.15.50:0/2428970709 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f8e1c055f00 con 0x7f8e341460c0 2024-09-13T15:10:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:45.333 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:43.897956+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/4135812870":"2024-09-14T15:10:40.873382+0000","172.21.15.50:6833/4135812870":"2024-09-14T15:10:40.873382+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.329+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e10066730 msgr2=0x7f8e10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.329+0000 7f8e3a600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e10066730 0x7f8e10068bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e240073f0 tx=0x7f8e2400b040 comp rx=0 tx=0).stop 2024-09-13T15:10:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.329+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 msgr2=0x7f8e34133d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.329+0000 7f8e3a600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 0x7f8e34133d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0090b0 tx=0x7f8e1c004770 comp rx=0 tx=0).stop 2024-09-13T15:10:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 shutdown_connections 2024-09-13T15:10:45.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e10066730 0x7f8e10068bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e34146570 0x7f8e341342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e341460c0 0x7f8e34133d80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 --2- 172.21.15.50:0/2428970709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e340665d0 0x7f8e340ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 >> 172.21.15.50:0/2428970709 conn(0x7f8e3406e660 msgr2=0x7f8e340ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 shutdown_connections 2024-09-13T15:10:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.333+0000 7f8e3a600700 1 -- 172.21.15.50:0/2428970709 wait complete. 2024-09-13T15:10:45.357 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:45.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:45.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.537+0000 7fb005600700 1 Processor -- start 2024-09-13T15:10:45.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.541+0000 7fb005600700 1 -- start start 2024-09-13T15:10:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb005600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb00015d120 0x7fb0000b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb005600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0000b1d80 0x7fb0000ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb005600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0000b21e0 con 0x7fb00015dac0 2024-09-13T15:10:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb005600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb000072610 con 0x7fb0000b1d80 2024-09-13T15:10:45.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb005600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00006b370 con 0x7fb00015d120 2024-09-13T15:10:45.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0000b1d80 0x7fb0000ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0000b1d80 0x7fb0000ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51376/0 (socket says 172.21.15.50:51376) 2024-09-13T15:10:45.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 -- 172.21.15.50:0/3224545250 learned_addr learned my addr 172.21.15.50:0/3224545250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:45.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fafffe00700 1 --1- 172.21.15.50:0/3224545250 >> v1:172.21.15.181:6789/0 conn(0x7fb00015dac0 0x7fb0000b4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:48998/0 (socket says 172.21.15.50:48998) 2024-09-13T15:10:45.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fafff400700 1 --2- 172.21.15.50:0/3224545250 >> v2:172.21.15.181:3300/0 conn(0x7fb00015d120 0x7fb0000b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 -- 172.21.15.50:0/3224545250 >> v2:172.21.15.181:3300/0 conn(0x7fb00015d120 msgr2=0x7fb0000b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 --2- 172.21.15.50:0/3224545250 >> v2:172.21.15.181:3300/0 conn(0x7fb00015d120 0x7fb0000b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 -- 172.21.15.50:0/3224545250 >> v1:172.21.15.181:6789/0 conn(0x7fb00015dac0 legacy=0x7fb0000b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 -- 172.21.15.50:0/3224545250 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000b29a0 con 0x7fb0000b1d80 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fafff400700 1 --2- 172.21.15.50:0/3224545250 >> v2:172.21.15.181:3300/0 conn(0x7fb00015d120 0x7fb0000b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7faffea00700 1 -- 172.21.15.50:0/3224545250 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477198146 0 0) 0x7fb0000b21e0 con 0x7fb00015dac0 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7fb004c00700 1 --2- 172.21.15.50:0/3224545250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0000b1d80 0x7fb0000ae680 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb0000ae440 tx=0x7faff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf01e88490b27d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7faffea00700 1 -- 172.21.15.50:0/3224545250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800e070 con 0x7fb0000b1d80 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7faffea00700 1 -- 172.21.15.50:0/3224545250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff800b9c0 con 0x7fb0000b1d80 2024-09-13T15:10:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.545+0000 7faffea00700 1 -- 172.21.15.50:0/3224545250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800bd70 con 0x7fb0000b1d80 2024-09-13T15:10:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 -- 172.21.15.50:0/3224545250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0000b1d80 msgr2=0x7fb0000ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 --2- 172.21.15.50:0/3224545250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0000b1d80 0x7fb0000ae680 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb0000ae440 tx=0x7faff800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 -- 172.21.15.50:0/3224545250 shutdown_connections 2024-09-13T15:10:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 --2- 172.21.15.50:0/3224545250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0000b1d80 0x7fb0000ae680 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 --2- 172.21.15.50:0/3224545250 >> v2:172.21.15.181:3300/0 conn(0x7fb00015d120 0x7fb0000b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 -- 172.21.15.50:0/3224545250 >> 172.21.15.50:0/3224545250 conn(0x7fb00006cb90 msgr2=0x7fb00006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 -- 172.21.15.50:0/3224545250 shutdown_connections 2024-09-13T15:10:45.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.549+0000 7fb005600700 1 -- 172.21.15.50:0/3224545250 wait complete. 2024-09-13T15:10:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 Processor -- start 2024-09-13T15:10:45.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 -- start start 2024-09-13T15:10:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0000b1d80 0x7fb000158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 0x7fb000147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb00015dac0 0x7fb0000b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000148180 con 0x7fb00015d120 2024-09-13T15:10:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000157770 con 0x7fb0000b1d80 2024-09-13T15:10:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb005600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0001579c0 con 0x7fb00015dac0 2024-09-13T15:10:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 0x7fb000147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 0x7fb000147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51384/0 (socket says 172.21.15.50:51384) 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 -- 172.21.15.50:0/3154715364 learned_addr learned my addr 172.21.15.50:0/3154715364 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafffe00700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0000b1d80 0x7fb000158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb004c00700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb00015dac0 0x7fb0000b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 -- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb00015dac0 msgr2=0x7fb0000b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb00015dac0 0x7fb0000b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 -- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0000b1d80 msgr2=0x7fb000158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0000b1d80 0x7fb000158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 -- 172.21.15.50:0/3154715364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8009b30 con 0x7fb00015d120 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fb004c00700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb00015dac0 0x7fb0000b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.553+0000 7fafff400700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 0x7fb000147c40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fafec00e810 tx=0x7fafec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.557+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec004230 con 0x7fb00015d120 2024-09-13T15:10:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.557+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec0043b0 con 0x7fb00015d120 2024-09-13T15:10:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.557+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0036c0 con 0x7fb00015d120 2024-09-13T15:10:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.557+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb000157ca0 con 0x7fb00015d120 2024-09-13T15:10:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.557+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb000158260 con 0x7fb00015d120 2024-09-13T15:10:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.557+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00015dea0 con 0x7fb00015d120 2024-09-13T15:10:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.561+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafec003820 con 0x7fb00015d120 2024-09-13T15:10:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.561+0000 7faff7e00700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafe0066730 0x7fafe0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.561+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fafec083950 con 0x7fb00015d120 2024-09-13T15:10:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.561+0000 7fafffe00700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafe0066730 0x7fafe0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.565+0000 7fafffe00700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafe0066730 0x7fafe0068bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faff0000f60 tx=0x7faff0007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.569+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafec050e70 con 0x7fb00015d120 2024-09-13T15:10:45.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.749+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0000cf100 con 0x7fb00015d120 2024-09-13T15:10:45.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.749+0000 7faff7e00700 1 -- 172.21.15.50:0/3154715364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafec0200a0 con 0x7fb00015d120 2024-09-13T15:10:45.752 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafe0066730 msgr2=0x7fafe0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafe0066730 0x7fafe0068bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faff0000f60 tx=0x7faff0007e90 comp rx=0 tx=0).stop 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 msgr2=0x7fb000147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 0x7fb000147c40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fafec00e810 tx=0x7fafec00eb20 comp rx=0 tx=0).stop 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 shutdown_connections 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fafe0066730 0x7fafe0068bf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb00015dac0 0x7fb0000b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb00015d120 0x7fb000147c40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 --2- 172.21.15.50:0/3154715364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0000b1d80 0x7fb000158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 >> 172.21.15.50:0/3154715364 conn(0x7fb00006cb90 msgr2=0x7fb0000cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 shutdown_connections 2024-09-13T15:10:45.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.753+0000 7fb005600700 1 -- 172.21.15.50:0/3154715364 wait complete. 2024-09-13T15:10:45.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-13T15:10:45.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 Processor -- start 2024-09-13T15:10:45.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 -- start start 2024-09-13T15:10:45.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 0x7f6c0815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6c0806c460 0x7f6c0806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c0806a5d0 0x7f6c0806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0806afa0 con 0x7f6c0806a5d0 2024-09-13T15:10:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c080cdd90 con 0x7f6c0806c460 2024-09-13T15:10:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0806ce10 con 0x7f6c0815b700 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c07e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 0x7f6c0815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c0ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c0806a5d0 0x7f6c0806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c07e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 0x7f6c0815bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:34576/0 (socket says 172.21.15.50:34576) 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c07e00700 1 -- 172.21.15.50:0/3281032761 learned_addr learned my addr 172.21.15.50:0/3281032761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.953+0000 7f6c07400700 1 --2- 172.21.15.50:0/3281032761 >> v2:172.21.15.181:3300/0 conn(0x7f6c0806c460 0x7f6c0806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c07e00700 1 -- 172.21.15.50:0/3281032761 >> v2:172.21.15.181:3300/0 conn(0x7f6c0806c460 msgr2=0x7f6c0806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c07e00700 1 --2- 172.21.15.50:0/3281032761 >> v2:172.21.15.181:3300/0 conn(0x7f6c0806c460 0x7f6c0806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c07e00700 1 -- 172.21.15.50:0/3281032761 >> v2:172.21.15.50:3300/0 conn(0x7f6c0806a5d0 msgr2=0x7f6c0806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c07e00700 1 --2- 172.21.15.50:0/3281032761 >> v2:172.21.15.50:3300/0 conn(0x7f6c0806a5d0 0x7f6c0806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c07e00700 1 -- 172.21.15.50:0/3281032761 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0815c020 con 0x7f6c0815b700 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ce00700 1 --2- 172.21.15.50:0/3281032761 >> v2:172.21.15.50:3300/0 conn(0x7f6c0806a5d0 0x7f6c0806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c07e00700 1 --2- 172.21.15.50:0/3281032761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 0x7f6c0815bae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c080cc590 tx=0x7f6bf8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d230ffc6d5102c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c06a00700 1 -- 172.21.15.50:0/3281032761 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8011830 con 0x7f6c0815b700 2024-09-13T15:10:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c06a00700 1 -- 172.21.15.50:0/3281032761 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8011990 con 0x7f6c0815b700 2024-09-13T15:10:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c06a00700 1 -- 172.21.15.50:0/3281032761 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8011d20 con 0x7f6c0815b700 2024-09-13T15:10:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 -- 172.21.15.50:0/3281032761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 msgr2=0x7f6c0815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/3281032761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 0x7f6c0815bae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c080cc590 tx=0x7f6bf8009bf0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 -- 172.21.15.50:0/3281032761 shutdown_connections 2024-09-13T15:10:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/3281032761 >> v2:172.21.15.50:3300/0 conn(0x7f6c0806a5d0 0x7f6c0806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/3281032761 >> v2:172.21.15.181:3300/0 conn(0x7f6c0806c460 0x7f6c0806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/3281032761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0815b700 0x7f6c0815bae0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 -- 172.21.15.50:0/3281032761 >> 172.21.15.50:0/3281032761 conn(0x7f6c080b08d0 msgr2=0x7f6c080b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 -- 172.21.15.50:0/3281032761 shutdown_connections 2024-09-13T15:10:45.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.957+0000 7f6c0ee00700 1 -- 172.21.15.50:0/3281032761 wait complete. 2024-09-13T15:10:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.961+0000 7f6c0ee00700 1 Processor -- start 2024-09-13T15:10:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.961+0000 7f6c0ee00700 1 -- start start 2024-09-13T15:10:45.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0806a5d0 0x7f6c08146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c0806c460 0x7f6c08153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 0x7f6c081528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08154a00 con 0x7f6c0815b700 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08158e40 con 0x7f6c0806c460 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08154160 con 0x7f6c0806a5d0 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 0x7f6c081528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 0x7f6c081528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51402/0 (socket says 172.21.15.50:51402) 2024-09-13T15:10:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 -- 172.21.15.50:0/898033198 learned_addr learned my addr 172.21.15.50:0/898033198 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c07e00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0806a5d0 0x7f6c08146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c07400700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c0806c460 0x7f6c08153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 -- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0806a5d0 msgr2=0x7f6c08146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0806a5d0 0x7f6c08146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 -- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c0806c460 msgr2=0x7f6c08153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c0806c460 0x7f6c08153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 -- 172.21.15.50:0/898033198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009a70 con 0x7f6c0815b700 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ce00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 0x7f6c081528a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000eed0 tx=0x7f6c0000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00010040 con 0x7f6c0815b700 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000bb30 con 0x7f6c0815b700 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8009570 con 0x7f6c0815b700 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00003a40 con 0x7f6c0815b700 2024-09-13T15:10:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.965+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c08154720 con 0x7f6c0815b700 2024-09-13T15:10:45.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.969+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08158c80 con 0x7f6c0815b700 2024-09-13T15:10:45.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.969+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c0001d410 con 0x7f6c0815b700 2024-09-13T15:10:45.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.973+0000 7f6bffe00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6be8066730 0x7f6be8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:45.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.973+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6c000843c0 con 0x7f6c0815b700 2024-09-13T15:10:45.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.973+0000 7f6c07e00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6be8066730 0x7f6be8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:45.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.973+0000 7f6c07e00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6be8066730 0x7f6be8068bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8000c00 tx=0x7f6bf8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:45.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:45.977+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6c00051980 con 0x7f6c0815b700 2024-09-13T15:10:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.241+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7f6c080ce5a0 con 0x7f6c0815b700 2024-09-13T15:10:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.925+0000 7f6bffe00700 1 -- 172.21.15.50:0/898033198 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v200) v1 ==== 146+0+0 (secure 0 0 0) 0x7f6c00054fa0 con 0x7f6c0815b700 2024-09-13T15:10:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.925+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6be8066730 msgr2=0x7f6be8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.925+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6be8066730 0x7f6be8068bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8000c00 tx=0x7f6bf8008030 comp rx=0 tx=0).stop 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 msgr2=0x7f6c081528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 0x7f6c081528a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000eed0 tx=0x7f6c0000b390 comp rx=0 tx=0).stop 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 shutdown_connections 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6be8066730 0x7f6be8068bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c0815b700 0x7f6c081528a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c0806c460 0x7f6c08153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 --2- 172.21.15.50:0/898033198 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c0806a5d0 0x7f6c08146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 >> 172.21.15.50:0/898033198 conn(0x7f6c080b08d0 msgr2=0x7f6c080af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 shutdown_connections 2024-09-13T15:10:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:46.929+0000 7f6c0ee00700 1 -- 172.21.15.50:0/898033198 wait complete. 2024-09-13T15:10:46.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T15:10:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 Processor -- start 2024-09-13T15:10:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 -- start start 2024-09-13T15:10:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d94160fc0 0x7f3d9406be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d940b3990 0x7f3d940ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9406d000 con 0x7f3d940cf0b0 2024-09-13T15:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940cf4c0 con 0x7f3d94160fc0 2024-09-13T15:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d9b000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9406c3f0 con 0x7f3d940b3990 2024-09-13T15:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d93e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d94160fc0 0x7f3d9406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d93e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d94160fc0 0x7f3d9406be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51408/0 (socket says 172.21.15.50:51408) 2024-09-13T15:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.125+0000 7f3d93e00700 1 -- 172.21.15.50:0/512194580 learned_addr learned my addr 172.21.15.50:0/512194580 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d8b400700 1 --2- 172.21.15.50:0/512194580 >> v2:172.21.15.181:3300/0 conn(0x7f3d940b3990 0x7f3d940ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93e00700 1 -- 172.21.15.50:0/512194580 >> v2:172.21.15.181:3300/0 conn(0x7f3d940b3990 msgr2=0x7f3d940ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93e00700 1 --2- 172.21.15.50:0/512194580 >> v2:172.21.15.181:3300/0 conn(0x7f3d940b3990 0x7f3d940ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93e00700 1 -- 172.21.15.50:0/512194580 >> v1:172.21.15.50:6789/0 conn(0x7f3d940cf0b0 legacy=0x7f3d9406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93e00700 1 -- 172.21.15.50:0/512194580 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9406c6d0 con 0x7f3d94160fc0 2024-09-13T15:10:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93e00700 1 --2- 172.21.15.50:0/512194580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d94160fc0 0x7f3d9406be10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3d940cb240 tx=0x7f3d84009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fce5ef14c3f75c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93400700 1 -- 172.21.15.50:0/512194580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400b8a0 con 0x7f3d94160fc0 2024-09-13T15:10:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93400700 1 -- 172.21.15.50:0/512194580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400ba00 con 0x7f3d94160fc0 2024-09-13T15:10:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d93400700 1 -- 172.21.15.50:0/512194580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400bd90 con 0x7f3d94160fc0 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 -- 172.21.15.50:0/512194580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d94160fc0 msgr2=0x7f3d9406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 --2- 172.21.15.50:0/512194580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d94160fc0 0x7f3d9406be10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3d940cb240 tx=0x7f3d84009bf0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 -- 172.21.15.50:0/512194580 shutdown_connections 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 --2- 172.21.15.50:0/512194580 >> v2:172.21.15.181:3300/0 conn(0x7f3d940b3990 0x7f3d940ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 --2- 172.21.15.50:0/512194580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d94160fc0 0x7f3d9406be10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 -- 172.21.15.50:0/512194580 >> 172.21.15.50:0/512194580 conn(0x7f3d9406a570 msgr2=0x7f3d9406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 -- 172.21.15.50:0/512194580 shutdown_connections 2024-09-13T15:10:47.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.129+0000 7f3d9b000700 1 -- 172.21.15.50:0/512194580 wait complete. 2024-09-13T15:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.133+0000 7f3d9b000700 1 Processor -- start 2024-09-13T15:10:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.133+0000 7f3d9b000700 1 -- start start 2024-09-13T15:10:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d940b3990 0x7f3d9415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 0x7f3d940ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d94160fc0 0x7f3d940abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9415ae50 con 0x7f3d940cf0b0 2024-09-13T15:10:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9415b880 con 0x7f3d94160fc0 2024-09-13T15:10:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940aa8c0 con 0x7f3d940b3990 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 0x7f3d940ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 0x7f3d940ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51422/0 (socket says 172.21.15.50:51422) 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 -- 172.21.15.50:0/292571204 learned_addr learned my addr 172.21.15.50:0/292571204 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d93e00700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d940b3990 0x7f3d9415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d99000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d94160fc0 0x7f3d940abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 -- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d940b3990 msgr2=0x7f3d9415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d940b3990 0x7f3d9415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 -- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d94160fc0 msgr2=0x7f3d940abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d94160fc0 0x7f3d940abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 -- 172.21.15.50:0/292571204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009570 con 0x7f3d940cf0b0 2024-09-13T15:10:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d99000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d94160fc0 0x7f3d940abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d8b400700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 0x7f3d940ab640 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c007e40 tx=0x7f3d7c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00ede0 con 0x7f3d940cf0b0 2024-09-13T15:10:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c014420 con 0x7f3d940cf0b0 2024-09-13T15:10:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0147d0 con 0x7f3d940cf0b0 2024-09-13T15:10:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.137+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d940adc20 con 0x7f3d940cf0b0 2024-09-13T15:10:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.141+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940aae40 con 0x7f3d940cf0b0 2024-09-13T15:10:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.141+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d940b3390 con 0x7f3d940cf0b0 2024-09-13T15:10:47.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.141+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d7c014930 con 0x7f3d940cf0b0 2024-09-13T15:10:47.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.145+0000 7f3d90c00700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3d70066730 0x7f3d70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.145+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3d7c0846f0 con 0x7f3d940cf0b0 2024-09-13T15:10:47.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.145+0000 7f3d93e00700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3d70066730 0x7f3d70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.145+0000 7f3d93e00700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3d70066730 0x7f3d70068bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3d84000c00 tx=0x7f3d84008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.149+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d7c051c10 con 0x7f3d940cf0b0 2024-09-13T15:10:47.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.333+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d940ceb70 con 0x7f3d940cf0b0 2024-09-13T15:10:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.337+0000 7f3d90c00700 1 -- 172.21.15.50:0/292571204 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d7c055230 con 0x7f3d940cf0b0 2024-09-13T15:10:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3d70066730 msgr2=0x7f3d70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3d70066730 0x7f3d70068bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3d84000c00 tx=0x7f3d84008030 comp rx=0 tx=0).stop 2024-09-13T15:10:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 msgr2=0x7f3d940ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 0x7f3d940ab640 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c007e40 tx=0x7f3d7c00e3c0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 shutdown_connections 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3d70066730 0x7f3d70068bf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d94160fc0 0x7f3d940abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d940cf0b0 0x7f3d940ab640 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 --2- 172.21.15.50:0/292571204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d940b3990 0x7f3d9415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 >> 172.21.15.50:0/292571204 conn(0x7f3d9406a570 msgr2=0x7f3d9406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 shutdown_connections 2024-09-13T15:10:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.341+0000 7f3d9b000700 1 -- 172.21.15.50:0/292571204 wait complete. 2024-09-13T15:10:47.368 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:10:47.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:10:47.410 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:10:47.451 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:10:47.451 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:47.451 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:47.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:10:47.474 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:47.474 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:47.510 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:10:47.510 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:10:47.511 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:47.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:10:47.534 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:10:47.534 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:10:47.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:10:47.563 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T15:10:47.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.757+0000 7fed12a00700 1 Processor -- start 2024-09-13T15:10:47.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 -- start start 2024-09-13T15:10:47.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c15cd90 0x7fed0c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed0c15d170 0x7fed0c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed0c0cde10 0x7fed0c0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0b2530 con 0x7fed0c0cde10 2024-09-13T15:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0d3a80 con 0x7fed0c15d170 2024-09-13T15:10:47.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0ce7e0 con 0x7fed0c15cd90 2024-09-13T15:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed0c0cde10 0x7fed0c0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed11600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c15cd90 0x7fed0c0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed0c0cde10 0x7fed0c0ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51426/0 (socket says 172.21.15.50:51426) 2024-09-13T15:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 -- 172.21.15.50:0/1378451924 learned_addr learned my addr 172.21.15.50:0/1378451924 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:47.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed10c00700 1 --2- 172.21.15.50:0/1378451924 >> v2:172.21.15.181:3300/0 conn(0x7fed0c15d170 0x7fed0c0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 -- 172.21.15.50:0/1378451924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c15cd90 msgr2=0x7fed0c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 --2- 172.21.15.50:0/1378451924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c15cd90 0x7fed0c0b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 -- 172.21.15.50:0/1378451924 >> v2:172.21.15.181:3300/0 conn(0x7fed0c15d170 msgr2=0x7fed0c0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 --2- 172.21.15.50:0/1378451924 >> v2:172.21.15.181:3300/0 conn(0x7fed0c15d170 0x7fed0c0cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.761+0000 7fed12000700 1 -- 172.21.15.50:0/1378451924 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0d1390 con 0x7fed0c0cde10 2024-09-13T15:10:47.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12000700 1 --2- 172.21.15.50:0/1378451924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c0cde10 0x7fed0c0ce2a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fed0c08b3d0 tx=0x7fed04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfdcf83ac8ef8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:47.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed0be00700 1 -- 172.21.15.50:0/1378451924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04011830 con 0x7fed0c0cde10 2024-09-13T15:10:47.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed0be00700 1 -- 172.21.15.50:0/1378451924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04011990 con 0x7fed0c0cde10 2024-09-13T15:10:47.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed0be00700 1 -- 172.21.15.50:0/1378451924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04011d20 con 0x7fed0c0cde10 2024-09-13T15:10:47.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 -- 172.21.15.50:0/1378451924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c0cde10 msgr2=0x7fed0c0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 --2- 172.21.15.50:0/1378451924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c0cde10 0x7fed0c0ce2a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fed0c08b3d0 tx=0x7fed04009bf0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 -- 172.21.15.50:0/1378451924 shutdown_connections 2024-09-13T15:10:47.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 --2- 172.21.15.50:0/1378451924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c0cde10 0x7fed0c0ce2a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 --2- 172.21.15.50:0/1378451924 >> v2:172.21.15.181:3300/0 conn(0x7fed0c15d170 0x7fed0c0cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 --2- 172.21.15.50:0/1378451924 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c15cd90 0x7fed0c0b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 -- 172.21.15.50:0/1378451924 >> 172.21.15.50:0/1378451924 conn(0x7fed0c0d2c10 msgr2=0x7fed0c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:47.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 -- 172.21.15.50:0/1378451924 shutdown_connections 2024-09-13T15:10:47.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.765+0000 7fed12a00700 1 -- 172.21.15.50:0/1378451924 wait complete. 2024-09-13T15:10:47.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 Processor -- start 2024-09-13T15:10:47.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 -- start start 2024-09-13T15:10:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c0cde10 0x7fed0c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 0x7fed0c1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed0c15d170 0x7fed0c1f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c1597e0 con 0x7fed0c15cd90 2024-09-13T15:10:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b3970 con 0x7fed0c15d170 2024-09-13T15:10:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b5510 con 0x7fed0c0cde10 2024-09-13T15:10:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed10c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 0x7fed0c1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed10c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 0x7fed0c1592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51432/0 (socket says 172.21.15.50:51432) 2024-09-13T15:10:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed10c00700 1 -- 172.21.15.50:0/1927511517 learned_addr learned my addr 172.21.15.50:0/1927511517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed11600700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c0cde10 0x7fed0c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.769+0000 7fed12000700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed0c15d170 0x7fed0c1f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed10c00700 1 -- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c0cde10 msgr2=0x7fed0c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed10c00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c0cde10 0x7fed0c0b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed10c00700 1 -- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed0c15d170 msgr2=0x7fed0c1f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed10c00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed0c15d170 0x7fed0c1f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed10c00700 1 -- 172.21.15.50:0/1927511517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04009570 con 0x7fed0c15cd90 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed10c00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 0x7fed0c1592a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fecf800e840 tx=0x7fecf800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8013680 con 0x7fed0c15cd90 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80137e0 con 0x7fed0c15cd90 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c0c71d0 con 0x7fed0c15cd90 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8013b50 con 0x7fed0c15cd90 2024-09-13T15:10:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c0b7540 con 0x7fed0c15cd90 2024-09-13T15:10:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.773+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c06cc30 con 0x7fed0c15cd90 2024-09-13T15:10:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.777+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fecf8013cb0 con 0x7fed0c15cd90 2024-09-13T15:10:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.777+0000 7fed09600700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fecec066730 0x7fecec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.777+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fecf80841b0 con 0x7fed0c15cd90 2024-09-13T15:10:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.777+0000 7fed11600700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fecec066730 0x7fecec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:47.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.781+0000 7fed11600700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fecec066730 0x7fecec068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed00011360 tx=0x7fed0000d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:47.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:47.785+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fecf8051650 con 0x7fed0c15cd90 2024-09-13T15:10:48.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.017+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed0c067d40 con 0x7fed0c15cd90 2024-09-13T15:10:48.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.017+0000 7fed09600700 1 -- 172.21.15.50:0/1927511517 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fecf8017de0 con 0x7fed0c15cd90 2024-09-13T15:10:48.022 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:48.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3723469980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3723469980},{"type":"v1","addr":"172.21.15.181:6835","nonce":3723469980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/219345449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":219345449},{"type":"v1","addr":"172.21.15.50:6834","nonce":219345449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2265298103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2265298103},{"type":"v1","addr":"172.21.15.181:6837","nonce":2265298103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6432,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/802967458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":802967458},{"type":"v1","addr":"172.21.15.50:6835","nonce":802967458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2024-09-13T15:10:48.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fecec066730 msgr2=0x7fecec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:48.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fecec066730 0x7fecec068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed00011360 tx=0x7fed0000d040 comp rx=0 tx=0).stop 2024-09-13T15:10:48.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 msgr2=0x7fed0c1592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:48.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 0x7fed0c1592a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fecf800e840 tx=0x7fecf800eb50 comp rx=0 tx=0).stop 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 shutdown_connections 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fecec066730 0x7fecec068bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed0c15d170 0x7fed0c1f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0c15cd90 0x7fed0c1592a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 --2- 172.21.15.50:0/1927511517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fed0c0cde10 0x7fed0c0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 >> 172.21.15.50:0/1927511517 conn(0x7fed0c0d2c10 msgr2=0x7fed0c159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 shutdown_connections 2024-09-13T15:10:48.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.025+0000 7fed12a00700 1 -- 172.21.15.50:0/1927511517 wait complete. 2024-09-13T15:10:48.028 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-09-13T15:10:48.047 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:10:48.047 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T15:10:48.047 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:10:48.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:48.048 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:10:48.048 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T15:10:48.048 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:10:48.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:48.048 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:10:48.048 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T15:10:48.049 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:10:48.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:48.049 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:10:48.049 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T15:10:48.049 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:10:48.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:10:48.070 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:10:48.071 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:10:48.072 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:10:48.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:10:48.073 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:10:48.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:10:48.075 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:10:48.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:10:48.121 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:10:48.121 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:48.122 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:10:48.122 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:48.125 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:10:48.125 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:48.126 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:10:48.126 DEBUG:teuthology.parallel:result is None 2024-09-13T15:10:48.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T15:10:48.241 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:10:48.244 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:10:48.245 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:10:48.245 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:10:48.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.309+0000 7f3e83800700 1 Processor -- start 2024-09-13T15:10:48.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.309+0000 7f3e83800700 1 -- start start 2024-09-13T15:10:48.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.309+0000 7f3e83800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e7c146390 0x7f3e7c0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.309+0000 7f3e83800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3e7c0cc2c0 0x7f3e7c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.309+0000 7f3e83800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c15e5c0 con 0x7f3e7c146390 2024-09-13T15:10:48.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c15e000 con 0x7f3e7c0cc2c0 2024-09-13T15:10:48.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c15e2e0 con 0x7f3e7c15daf0 2024-09-13T15:10:48.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e7c146390 0x7f3e7c0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e7c146390 0x7f3e7c0cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51476/0 (socket says 172.21.15.50:51476) 2024-09-13T15:10:48.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 -- 172.21.15.50:0/1620175566 learned_addr learned my addr 172.21.15.50:0/1620175566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:48.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e81800700 1 --2- 172.21.15.50:0/1620175566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e7be00700 1 --2- 172.21.15.50:0/1620175566 >> v2:172.21.15.181:3300/0 conn(0x7f3e7c0cc2c0 0x7f3e7c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 -- 172.21.15.50:0/1620175566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 msgr2=0x7f3e7c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:48.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 --2- 172.21.15.50:0/1620175566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 -- 172.21.15.50:0/1620175566 >> v2:172.21.15.181:3300/0 conn(0x7f3e7c0cc2c0 msgr2=0x7f3e7c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:48.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 --2- 172.21.15.50:0/1620175566 >> v2:172.21.15.181:3300/0 conn(0x7f3e7c0cc2c0 0x7f3e7c15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 -- 172.21.15.50:0/1620175566 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0c9f90 con 0x7f3e7c146390 2024-09-13T15:10:48.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e80e00700 1 --2- 172.21.15.50:0/1620175566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c0cbd80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0d09f0 tx=0x7f3e70009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b696080b8da0130 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:48.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e7b400700 1 -- 172.21.15.50:0/1620175566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000b8a0 con 0x7f3e7c146390 2024-09-13T15:10:48.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e7b400700 1 -- 172.21.15.50:0/1620175566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000ba00 con 0x7f3e7c146390 2024-09-13T15:10:48.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e7b400700 1 -- 172.21.15.50:0/1620175566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000bd90 con 0x7f3e7c146390 2024-09-13T15:10:48.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- 172.21.15.50:0/1620175566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 msgr2=0x7f3e7c0cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:48.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 --2- 172.21.15.50:0/1620175566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c0cbd80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0d09f0 tx=0x7f3e70009bf0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- 172.21.15.50:0/1620175566 shutdown_connections 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 --2- 172.21.15.50:0/1620175566 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 --2- 172.21.15.50:0/1620175566 >> v2:172.21.15.181:3300/0 conn(0x7f3e7c0cc2c0 0x7f3e7c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 --2- 172.21.15.50:0/1620175566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c0cbd80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- 172.21.15.50:0/1620175566 >> 172.21.15.50:0/1620175566 conn(0x7f3e7c0726d0 msgr2=0x7f3e7c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- 172.21.15.50:0/1620175566 shutdown_connections 2024-09-13T15:10:48.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.313+0000 7f3e83800700 1 -- 172.21.15.50:0/1620175566 wait complete. 2024-09-13T15:10:48.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.317+0000 7f3e83800700 1 Processor -- start 2024-09-13T15:10:48.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.317+0000 7f3e83800700 1 -- start start 2024-09-13T15:10:48.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e7c0cc2c0 0x7f3e7c1f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c13e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c13dd00 con 0x7f3e7c146390 2024-09-13T15:10:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0b18e0 con 0x7f3e7c0cc2c0 2024-09-13T15:10:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0b1bc0 con 0x7f3e7c15daf0 2024-09-13T15:10:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c13e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51480/0 (socket says 172.21.15.50:51480) 2024-09-13T15:10:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 -- 172.21.15.50:0/2632536830 learned_addr learned my addr 172.21.15.50:0/2632536830 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e80e00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e7c0cc2c0 0x7f3e7c1f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e81800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 -- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 msgr2=0x7f3e7c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 -- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e7c0cc2c0 msgr2=0x7f3e7c1f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e7c0cc2c0 0x7f3e7c1f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 -- 172.21.15.50:0/2632536830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70009570 con 0x7f3e7c146390 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e7be00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c13e980 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800e810 tx=0x7f3e6800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800c070 con 0x7f3e7c146390 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68013610 con 0x7f3e7c146390 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c0b1ea0 con 0x7f3e7c146390 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680139a0 con 0x7f3e7c146390 2024-09-13T15:10:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.321+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c0b2460 con 0x7f3e7c146390 2024-09-13T15:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.325+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c15b5c0 con 0x7f3e7c146390 2024-09-13T15:10:48.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.325+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e68013b00 con 0x7f3e7c146390 2024-09-13T15:10:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.329+0000 7f3e78c00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e5c066760 0x7f3e5c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.329+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3e68083d10 con 0x7f3e7c146390 2024-09-13T15:10:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.329+0000 7f3e80e00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e5c066760 0x7f3e5c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.329+0000 7f3e80e00700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e5c066760 0x7f3e5c068c20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e70000c00 tx=0x7f3e70008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:48.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.333+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e68089020 con 0x7f3e7c146390 2024-09-13T15:10:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:48.529+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3e7c0d1360 con 0x7f3e7c146390 2024-09-13T15:10:49.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.281+0000 7f3e78c00700 1 -- 172.21.15.50:0/2632536830 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e680511a0 con 0x7f3e7c146390 2024-09-13T15:10:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e5c066760 msgr2=0x7f3e5c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e5c066760 0x7f3e5c068c20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e70000c00 tx=0x7f3e70008030 comp rx=0 tx=0).stop 2024-09-13T15:10:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 msgr2=0x7f3e7c13e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c13e980 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800e810 tx=0x7f3e6800eb20 comp rx=0 tx=0).stop 2024-09-13T15:10:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 shutdown_connections 2024-09-13T15:10:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3e5c066760 0x7f3e5c068c20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3e7c15daf0 0x7f3e7c0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e7c146390 0x7f3e7c13e980 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 --2- 172.21.15.50:0/2632536830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e7c0cc2c0 0x7f3e7c1f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 >> 172.21.15.50:0/2632536830 conn(0x7f3e7c0726d0 msgr2=0x7f3e7c144bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 shutdown_connections 2024-09-13T15:10:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.285+0000 7f3e83800700 1 -- 172.21.15.50:0/2632536830 wait complete. 2024-09-13T15:10:49.291 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-13T15:10:49.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T15:10:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 Processor -- start 2024-09-13T15:10:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 -- start start 2024-09-13T15:10:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 0x7fec240cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fec2406aaa0 0x7fec2406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2406b450 con 0x7fec240cb020 2024-09-13T15:10:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240b2ad0 con 0x7fec2406aaa0 2024-09-13T15:10:49.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.489+0000 7fec28e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2415b960 con 0x7fec2415c2a0 2024-09-13T15:10:49.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec23400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 0x7fec240cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec23400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 0x7fec240cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51492/0 (socket says 172.21.15.50:51492) 2024-09-13T15:10:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec23400700 1 -- 172.21.15.50:0/3639132453 learned_addr learned my addr 172.21.15.50:0/3639132453 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec23e00700 1 --2- 172.21.15.50:0/3639132453 >> v2:172.21.15.181:3300/0 conn(0x7fec2406aaa0 0x7fec2406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 -- 172.21.15.50:0/3639132453 >> v2:172.21.15.181:3300/0 conn(0x7fec2406aaa0 msgr2=0x7fec2406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 --2- 172.21.15.50:0/3639132453 >> v2:172.21.15.181:3300/0 conn(0x7fec2406aaa0 0x7fec2406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 -- 172.21.15.50:0/3639132453 >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 msgr2=0x7fec240cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 --2- 172.21.15.50:0/3639132453 >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 0x7fec240cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 -- 172.21.15.50:0/3639132453 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2415bc40 con 0x7fec2415c2a0 2024-09-13T15:10:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec23400700 1 --2- 172.21.15.50:0/3639132453 >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 0x7fec240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22a00700 1 --2- 172.21.15.50:0/3639132453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2415b0e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fec24158cb0 tx=0x7fec10009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ee2fab973febe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22000700 1 -- 172.21.15.50:0/3639132453 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10011830 con 0x7fec2415c2a0 2024-09-13T15:10:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22000700 1 -- 172.21.15.50:0/3639132453 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10011990 con 0x7fec2415c2a0 2024-09-13T15:10:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec22000700 1 -- 172.21.15.50:0/3639132453 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10011d20 con 0x7fec2415c2a0 2024-09-13T15:10:49.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec28e00700 1 -- 172.21.15.50:0/3639132453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 msgr2=0x7fec2415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.493+0000 7fec28e00700 1 --2- 172.21.15.50:0/3639132453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2415b0e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fec24158cb0 tx=0x7fec10009b30 comp rx=0 tx=0).stop 2024-09-13T15:10:49.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 -- 172.21.15.50:0/3639132453 shutdown_connections 2024-09-13T15:10:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 --2- 172.21.15.50:0/3639132453 >> v2:172.21.15.181:3300/0 conn(0x7fec2406aaa0 0x7fec2406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 --2- 172.21.15.50:0/3639132453 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2415b0e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 --2- 172.21.15.50:0/3639132453 >> v2:172.21.15.50:3300/0 conn(0x7fec240cb020 0x7fec240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 -- 172.21.15.50:0/3639132453 >> 172.21.15.50:0/3639132453 conn(0x7fec240b0c40 msgr2=0x7fec2406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 -- 172.21.15.50:0/3639132453 shutdown_connections 2024-09-13T15:10:49.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 -- 172.21.15.50:0/3639132453 wait complete. 2024-09-13T15:10:49.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 Processor -- start 2024-09-13T15:10:49.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.497+0000 7fec28e00700 1 -- start start 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 0x7fec241f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec240cb020 0x7fec24154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2413b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240717d0 con 0x7fec2406aaa0 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec241f6fa0 con 0x7fec240cb020 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2413a170 con 0x7fec2415c2a0 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 0x7fec241f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 0x7fec241f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51496/0 (socket says 172.21.15.50:51496) 2024-09-13T15:10:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 -- 172.21.15.50:0/3143771379 learned_addr learned my addr 172.21.15.50:0/3143771379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec22a00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec240cb020 0x7fec24154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 -- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 msgr2=0x7fec2413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2413b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 -- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec240cb020 msgr2=0x7fec24154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec240cb020 0x7fec24154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 -- 172.21.15.50:0/3143771379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009570 con 0x7fec2406aaa0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec22a00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec240cb020 0x7fec24154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec23400700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 0x7fec241f6a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fec1400ebe0 tx=0x7fec14009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400c910 con 0x7fec2406aaa0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400ca70 con 0x7fec2406aaa0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec100094b0 con 0x7fec2406aaa0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.501+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400cde0 con 0x7fec2406aaa0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.505+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2413a730 con 0x7fec2406aaa0 2024-09-13T15:10:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.505+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2415c6c0 con 0x7fec2406aaa0 2024-09-13T15:10:49.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.505+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec14013470 con 0x7fec2406aaa0 2024-09-13T15:10:49.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.509+0000 7fec1b400700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fec04066730 0x7fec04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.509+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fec14084210 con 0x7fec2406aaa0 2024-09-13T15:10:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.509+0000 7fec22a00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fec04066730 0x7fec04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.509+0000 7fec22a00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fec04066730 0x7fec04068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec24158cb0 tx=0x7fec10008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:49.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.517+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec140516f0 con 0x7fec2406aaa0 2024-09-13T15:10:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.769+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fec240ce310 con 0x7fec2406aaa0 2024-09-13T15:10:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.769+0000 7fec1b400700 1 -- 172.21.15.50:0/3143771379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fec14054d10 con 0x7fec2406aaa0 2024-09-13T15:10:49.772 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w==", 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ==", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw==", 2024-09-13T15:10:49.774 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ==", 2024-09-13T15:10:49.775 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw==", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw==", 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g==", 2024-09-13T15:10:49.777 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg==", 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg==", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw==", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA==", 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g==", 2024-09-13T15:10:49.780 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg==", 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A==", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw==", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:10:49.782 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g==", 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORmfQGsHhAAoWi5rerqSyo7H67168RTZw==", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg==", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:10:49.784 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w==", 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:10:49.785 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:10:49.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fec04066730 msgr2=0x7fec04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fec04066730 0x7fec04068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec24158cb0 tx=0x7fec10008030 comp rx=0 tx=0).stop 2024-09-13T15:10:49.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 msgr2=0x7fec241f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 0x7fec241f6a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fec1400ebe0 tx=0x7fec14009e90 comp rx=0 tx=0).stop 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 shutdown_connections 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fec04066730 0x7fec04068bf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fec2415c2a0 0x7fec2413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec240cb020 0x7fec24154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 --2- 172.21.15.50:0/3143771379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec2406aaa0 0x7fec241f6a60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 >> 172.21.15.50:0/3143771379 conn(0x7fec240b0c40 msgr2=0x7fec2415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 shutdown_connections 2024-09-13T15:10:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.773+0000 7fec28e00700 1 -- 172.21.15.50:0/3143771379 wait complete. 2024-09-13T15:10:49.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:49.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 Processor -- start 2024-09-13T15:10:49.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 -- start start 2024-09-13T15:10:49.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f564815e070 0x7f56480cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56480d10f0 0x7f56480b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480cd970 con 0x7f56480d1540 2024-09-13T15:10:49.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564815e450 con 0x7f56480d10f0 2024-09-13T15:10:49.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5647200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56480d0050 con 0x7f564815e070 2024-09-13T15:10:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5645400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56480d10f0 0x7f56480b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5645e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f564815e070 0x7f56480cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5646800700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f56480d1540 0x7f56480b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:49018/0 (socket says 172.21.15.50:49018) 2024-09-13T15:10:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5646800700 1 -- 172.21.15.50:0/2887316186 learned_addr learned my addr 172.21.15.50:0/2887316186 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.981+0000 7f5645400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56480d10f0 0x7f56480b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51512/0 (socket says 172.21.15.50:51512) 2024-09-13T15:10:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5645400700 1 -- 172.21.15.50:0/2887316186 >> v2:172.21.15.181:3300/0 conn(0x7f564815e070 msgr2=0x7f56480cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5645400700 1 --2- 172.21.15.50:0/2887316186 >> v2:172.21.15.181:3300/0 conn(0x7f564815e070 0x7f56480cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5644a00700 1 -- 172.21.15.50:0/2887316186 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090869242 0 0) 0x7f5640001490 con 0x7f56480d1540 2024-09-13T15:10:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5645400700 1 -- 172.21.15.50:0/2887316186 >> v1:172.21.15.181:6789/0 conn(0x7f56480d1540 legacy=0x7f56480b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5645400700 1 -- 172.21.15.50:0/2887316186 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480d0330 con 0x7f56480d10f0 2024-09-13T15:10:49.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5645400700 1 --2- 172.21.15.50:0/2887316186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f56480b2540 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f56480d1ac0 tx=0x7f5630009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3a1f1cc6baef1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:49.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5644a00700 1 -- 172.21.15.50:0/2887316186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011830 con 0x7f56480d10f0 2024-09-13T15:10:49.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5644a00700 1 -- 172.21.15.50:0/2887316186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630011990 con 0x7f56480d10f0 2024-09-13T15:10:49.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5644a00700 1 -- 172.21.15.50:0/2887316186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011d20 con 0x7f56480d10f0 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 -- 172.21.15.50:0/2887316186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 msgr2=0x7f56480b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 --2- 172.21.15.50:0/2887316186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f56480b2540 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f56480d1ac0 tx=0x7f5630009b30 comp rx=0 tx=0).stop 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 -- 172.21.15.50:0/2887316186 shutdown_connections 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 --2- 172.21.15.50:0/2887316186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f56480b2540 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 --2- 172.21.15.50:0/2887316186 >> v2:172.21.15.181:3300/0 conn(0x7f564815e070 0x7f56480cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 -- 172.21.15.50:0/2887316186 >> 172.21.15.50:0/2887316186 conn(0x7f5648071f00 msgr2=0x7f56480722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 -- 172.21.15.50:0/2887316186 shutdown_connections 2024-09-13T15:10:49.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.985+0000 7f5647200700 1 -- 172.21.15.50:0/2887316186 wait complete. 2024-09-13T15:10:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 Processor -- start 2024-09-13T15:10:49.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 -- start start 2024-09-13T15:10:49.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f564815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56480d1540 0x7f564815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f564815e070 0x7f5648152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480c7af0 con 0x7f56480d10f0 2024-09-13T15:10:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480c80b0 con 0x7f564815e070 2024-09-13T15:10:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.989+0000 7f5647200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564815cb20 con 0x7f56480d1540 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f564815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f564815a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51516/0 (socket says 172.21.15.50:51516) 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 -- 172.21.15.50:0/1004662765 learned_addr learned my addr 172.21.15.50:0/1004662765 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5646800700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f564815e070 0x7f5648152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645400700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56480d1540 0x7f564815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 -- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56480d1540 msgr2=0x7f564815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56480d1540 0x7f564815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 -- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f564815e070 msgr2=0x7f5648152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f564815e070 0x7f5648152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 -- 172.21.15.50:0/1004662765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300094b0 con 0x7f56480d10f0 2024-09-13T15:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5645e00700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f564815a280 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f563800e840 tx=0x7f563800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380095a0 con 0x7f56480d10f0 2024-09-13T15:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638013680 con 0x7f56480d10f0 2024-09-13T15:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380139f0 con 0x7f56480d10f0 2024-09-13T15:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56480b43f0 con 0x7f56480d10f0 2024-09-13T15:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.993+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56480c7d40 con 0x7f56480d10f0 2024-09-13T15:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.997+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56480afdc0 con 0x7f56480d10f0 2024-09-13T15:10:49.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.997+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5638013b50 con 0x7f56480d10f0 2024-09-13T15:10:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.997+0000 7f563e000700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5624066760 0x7f5624068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.997+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f56380841d0 con 0x7f56480d10f0 2024-09-13T15:10:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:49.997+0000 7f5645400700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5624066760 0x7f5624068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.001+0000 7f5645400700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5624066760 0x7f5624068c20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5630009fd0 tx=0x7f5630008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.009+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56380516c0 con 0x7f56480d10f0 2024-09-13T15:10:50.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.205+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56480b40a0 con 0x7f56480d10f0 2024-09-13T15:10:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.209+0000 7f563e000700 1 -- 172.21.15.50:0/1004662765 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13051 (secure 0 0 0) 0x7f5638054ce0 con 0x7f56480d10f0 2024-09-13T15:10:50.211 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:50.211 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":73,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:49.275713+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:50.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5624066760 msgr2=0x7f5624068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5624066760 0x7f5624068c20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5630009fd0 tx=0x7f5630008030 comp rx=0 tx=0).stop 2024-09-13T15:10:50.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 msgr2=0x7f564815a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f564815a280 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f563800e840 tx=0x7f563800eb50 comp rx=0 tx=0).stop 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 shutdown_connections 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5624066760 0x7f5624068c20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f564815e070 0x7f5648152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56480d1540 0x7f564815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 --2- 172.21.15.50:0/1004662765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56480d10f0 0x7f564815a280 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 >> 172.21.15.50:0/1004662765 conn(0x7f5648071f00 msgr2=0x7f56480b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 shutdown_connections 2024-09-13T15:10:50.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.213+0000 7f5647200700 1 -- 172.21.15.50:0/1004662765 wait complete. 2024-09-13T15:10:50.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:10:50.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:10:50.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.413+0000 7f1605e00700 1 Processor -- start 2024-09-13T15:10:50.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.413+0000 7f1605e00700 1 -- start start 2024-09-13T15:10:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f160015ca20 0x7f160015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f160006cd80 0x7f16000b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1600160680 con 0x7f160006ada0 2024-09-13T15:10:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160015d670 con 0x7f160006cd80 2024-09-13T15:10:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160015d950 con 0x7f160015ca20 2024-09-13T15:10:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f160006ada0 0x7f1600160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54470/0 (socket says 172.21.15.50:54470) 2024-09-13T15:10:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ffe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f160006cd80 0x7f16000b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1605400700 1 -- 172.21.15.50:0/486755211 learned_addr learned my addr 172.21.15.50:0/486755211 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f1604a00700 1 --2- 172.21.15.50:0/486755211 >> v2:172.21.15.181:3300/0 conn(0x7f160015ca20 0x7f160015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ff400700 1 -- 172.21.15.50:0/486755211 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203350096 0 0) 0x7f1600160680 con 0x7f160006ada0 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ff400700 1 -- 172.21.15.50:0/486755211 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e80035d0 con 0x7f160006ada0 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ffe00700 1 -- 172.21.15.50:0/486755211 >> v2:172.21.15.181:3300/0 conn(0x7f160015ca20 msgr2=0x7f160015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ffe00700 1 --2- 172.21.15.50:0/486755211 >> v2:172.21.15.181:3300/0 conn(0x7f160015ca20 0x7f160015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ffe00700 1 -- 172.21.15.50:0/486755211 >> v1:172.21.15.50:6789/0 conn(0x7f160006ada0 legacy=0x7f1600160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ff400700 1 -- 172.21.15.50:0/486755211 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 818484971 0 0) 0x7f15e80035d0 con 0x7f160006ada0 2024-09-13T15:10:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ffe00700 1 -- 172.21.15.50:0/486755211 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160015dc30 con 0x7f160006cd80 2024-09-13T15:10:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ffe00700 1 --2- 172.21.15.50:0/486755211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f16000b4310 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1600073c60 tx=0x7f15ec009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6efc528335935a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ff400700 1 -- 172.21.15.50:0/486755211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f80019f0 con 0x7f160006cd80 2024-09-13T15:10:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ff400700 1 -- 172.21.15.50:0/486755211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec004030 con 0x7f160006cd80 2024-09-13T15:10:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.417+0000 7f15ff400700 1 -- 172.21.15.50:0/486755211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec0043a0 con 0x7f160006cd80 2024-09-13T15:10:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 -- 172.21.15.50:0/486755211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 msgr2=0x7f16000b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 --2- 172.21.15.50:0/486755211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f16000b4310 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1600073c60 tx=0x7f15ec009b30 comp rx=0 tx=0).stop 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 -- 172.21.15.50:0/486755211 shutdown_connections 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 --2- 172.21.15.50:0/486755211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f16000b4310 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 --2- 172.21.15.50:0/486755211 >> v2:172.21.15.181:3300/0 conn(0x7f160015ca20 0x7f160015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 -- 172.21.15.50:0/486755211 >> 172.21.15.50:0/486755211 conn(0x7f1600071d20 msgr2=0x7f1600072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 -- 172.21.15.50:0/486755211 shutdown_connections 2024-09-13T15:10:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.421+0000 7f1605e00700 1 -- 172.21.15.50:0/486755211 wait complete. 2024-09-13T15:10:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 Processor -- start 2024-09-13T15:10:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 -- start start 2024-09-13T15:10:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f160006ada0 0x7f16000cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f1600155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160015ca20 0x7f1600154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001f3780 con 0x7f160006cd80 2024-09-13T15:10:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001f34a0 con 0x7f160015ca20 2024-09-13T15:10:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16000cd500 con 0x7f160006ada0 2024-09-13T15:10:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f1600155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f1600155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51532/0 (socket says 172.21.15.50:51532) 2024-09-13T15:10:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 -- 172.21.15.50:0/3803087072 learned_addr learned my addr 172.21.15.50:0/3803087072 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1605400700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160015ca20 0x7f1600154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f1604a00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f160006ada0 0x7f16000cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 -- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f160006ada0 msgr2=0x7f16000cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f160006ada0 0x7f16000cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 -- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160015ca20 msgr2=0x7f1600154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160015ca20 0x7f1600154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.425+0000 7f15ffe00700 1 -- 172.21.15.50:0/3803087072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0094b0 con 0x7f160006cd80 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f1604a00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f160006ada0 0x7f16000cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f15ffe00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f1600155a00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0090b0 tx=0x7f15ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec003d00 con 0x7f160006cd80 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec01f070 con 0x7f160006cd80 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16000cd7e0 con 0x7f160006cd80 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011870 con 0x7f160006cd80 2024-09-13T15:10:50.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1600155f40 con 0x7f160006cd80 2024-09-13T15:10:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16000cdd00 con 0x7f160006cd80 2024-09-13T15:10:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.429+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15ec0119d0 con 0x7f160006cd80 2024-09-13T15:10:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.433+0000 7f15fcc00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15e0066730 0x7f15e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.433+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f15ec021070 con 0x7f160006cd80 2024-09-13T15:10:50.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.433+0000 7f1604a00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15e0066730 0x7f15e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.433+0000 7f1604a00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15e0066730 0x7f15e0068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f16000ccf40 tx=0x7f15f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.437+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16000cdd00 con 0x7f160006cd80 2024-09-13T15:10:50.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.625+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16000cdd00 con 0x7f160006cd80 2024-09-13T15:10:50.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.625+0000 7f15fcc00700 1 -- 172.21.15.50:0/3803087072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16000cdd00 con 0x7f160006cd80 2024-09-13T15:10:50.630 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15e0066730 msgr2=0x7f15e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15e0066730 0x7f15e0068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f16000ccf40 tx=0x7f15f4008040 comp rx=0 tx=0).stop 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 msgr2=0x7f1600155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f1600155a00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0090b0 tx=0x7f15ec004770 comp rx=0 tx=0).stop 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 shutdown_connections 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f15e0066730 0x7f15e0068bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160015ca20 0x7f1600154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f160006cd80 0x7f1600155a00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 --2- 172.21.15.50:0/3803087072 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f160006ada0 0x7f16000cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 >> 172.21.15.50:0/3803087072 conn(0x7f1600071d20 msgr2=0x7f160015f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 shutdown_connections 2024-09-13T15:10:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.633+0000 7f1605e00700 1 -- 172.21.15.50:0/3803087072 wait complete. 2024-09-13T15:10:50.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:10:50.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 Processor -- start 2024-09-13T15:10:50.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 -- start start 2024-09-13T15:10:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c06aaa0 0x7f0c5c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0c5c0b2670 0x7f0c5c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c0b3040 con 0x7f0c5c1610b0 2024-09-13T15:10:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c070b30 con 0x7f0c5c0b2670 2024-09-13T15:10:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0b3560 con 0x7f0c5c06aaa0 2024-09-13T15:10:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c5be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c5c1610b0 0x7f0c5c0719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54486/0 (socket says 172.21.15.50:54486) 2024-09-13T15:10:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c5be00700 1 -- 172.21.15.50:0/265004297 learned_addr learned my addr 172.21.15.50:0/265004297 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c61200700 1 --2- 172.21.15.50:0/265004297 >> v2:172.21.15.181:3300/0 conn(0x7f0c5c0b2670 0x7f0c5c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c53400700 1 --2- 172.21.15.50:0/265004297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c06aaa0 0x7f0c5c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c5b400700 1 -- 172.21.15.50:0/265004297 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779784707 0 0) 0x7f0c4c001490 con 0x7f0c5c1610b0 2024-09-13T15:10:50.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c5b400700 1 -- 172.21.15.50:0/265004297 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c400035d0 con 0x7f0c5c1610b0 2024-09-13T15:10:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c53400700 1 -- 172.21.15.50:0/265004297 >> v2:172.21.15.181:3300/0 conn(0x7f0c5c0b2670 msgr2=0x7f0c5c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c53400700 1 --2- 172.21.15.50:0/265004297 >> v2:172.21.15.181:3300/0 conn(0x7f0c5c0b2670 0x7f0c5c0b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c53400700 1 -- 172.21.15.50:0/265004297 >> v1:172.21.15.50:6789/0 conn(0x7f0c5c1610b0 legacy=0x7f0c5c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.825+0000 7f0c53400700 1 -- 172.21.15.50:0/265004297 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c06b420 con 0x7f0c5c06aaa0 2024-09-13T15:10:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c53400700 1 --2- 172.21.15.50:0/265004297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c06aaa0 0x7f0c5c06aee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009850 tx=0x7f0c44009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51d665845e3a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c5b400700 1 -- 172.21.15.50:0/265004297 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44011830 con 0x7f0c5c06aaa0 2024-09-13T15:10:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c5b400700 1 -- 172.21.15.50:0/265004297 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44011990 con 0x7f0c5c06aaa0 2024-09-13T15:10:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c5b400700 1 -- 172.21.15.50:0/265004297 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44011d40 con 0x7f0c5c06aaa0 2024-09-13T15:10:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 -- 172.21.15.50:0/265004297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c06aaa0 msgr2=0x7f0c5c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 --2- 172.21.15.50:0/265004297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c06aaa0 0x7f0c5c06aee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009850 tx=0x7f0c44009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 -- 172.21.15.50:0/265004297 shutdown_connections 2024-09-13T15:10:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 --2- 172.21.15.50:0/265004297 >> v2:172.21.15.181:3300/0 conn(0x7f0c5c0b2670 0x7f0c5c0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 --2- 172.21.15.50:0/265004297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c06aaa0 0x7f0c5c06aee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 -- 172.21.15.50:0/265004297 >> 172.21.15.50:0/265004297 conn(0x7f0c5c0b0c40 msgr2=0x7f0c5c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 -- 172.21.15.50:0/265004297 shutdown_connections 2024-09-13T15:10:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 -- 172.21.15.50:0/265004297 wait complete. 2024-09-13T15:10:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 Processor -- start 2024-09-13T15:10:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.829+0000 7f0c61c00700 1 -- start start 2024-09-13T15:10:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c5c06aaa0 0x7f0c5c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 0x7f0c5c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c1610b0 0x7f0c5c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c159ea0 con 0x7f0c5c0b2670 2024-09-13T15:10:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c159820 con 0x7f0c5c06aaa0 2024-09-13T15:10:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c159260 con 0x7f0c5c1610b0 2024-09-13T15:10:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 0x7f0c5c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 0x7f0c5c1569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51538/0 (socket says 172.21.15.50:51538) 2024-09-13T15:10:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 -- 172.21.15.50:0/1945823625 learned_addr learned my addr 172.21.15.50:0/1945823625 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61200700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c1610b0 0x7f0c5c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c5be00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c5c06aaa0 0x7f0c5c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 -- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c1610b0 msgr2=0x7f0c5c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c1610b0 0x7f0c5c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 -- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c5c06aaa0 msgr2=0x7f0c5c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c5c06aaa0 0x7f0c5c156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 -- 172.21.15.50:0/1945823625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440094b0 con 0x7f0c5c0b2670 2024-09-13T15:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c53400700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 0x7f0c5c1569c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0c440090b0 tx=0x7f0c44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44004380 con 0x7f0c5c0b2670 2024-09-13T15:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4401f070 con 0x7f0c5c0b2670 2024-09-13T15:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440036c0 con 0x7f0c5c0b2670 2024-09-13T15:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c159540 con 0x7f0c5c0b2670 2024-09-13T15:10:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.833+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c1465d0 con 0x7f0c5c0b2670 2024-09-13T15:10:50.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.837+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c15a010 con 0x7f0c5c0b2670 2024-09-13T15:10:50.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.837+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c44021030 con 0x7f0c5c0b2670 2024-09-13T15:10:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.841+0000 7f0c58c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0c38066730 0x7f0c38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:50.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.841+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0c44085310 con 0x7f0c5c0b2670 2024-09-13T15:10:50.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.841+0000 7f0c5be00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0c38066730 0x7f0c38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:50.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.841+0000 7f0c5be00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0c38066730 0x7f0c38068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0015f0 tx=0x7f0c4c001a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:50.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:50.845+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c440529a0 con 0x7f0c5c0b2670 2024-09-13T15:10:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.037+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0c5c161490 con 0x7f0c5c0b2670 2024-09-13T15:10:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c58c00700 1 -- 172.21.15.50:0/1945823625 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0c44006ce0 con 0x7f0c5c0b2670 2024-09-13T15:10:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:51.042 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:10:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:10:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:10:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:10:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:10:51.043 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0c38066730 msgr2=0x7f0c38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0c38066730 0x7f0c38068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0015f0 tx=0x7f0c4c001a00 comp rx=0 tx=0).stop 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 msgr2=0x7f0c5c1569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 0x7f0c5c1569c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0c440090b0 tx=0x7f0c44004770 comp rx=0 tx=0).stop 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 shutdown_connections 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0c38066730 0x7f0c38068bf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0c5c1610b0 0x7f0c5c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0b2670 0x7f0c5c1569c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 --2- 172.21.15.50:0/1945823625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c5c06aaa0 0x7f0c5c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 >> 172.21.15.50:0/1945823625 conn(0x7f0c5c0b0c40 msgr2=0x7f0c5c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 shutdown_connections 2024-09-13T15:10:51.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.041+0000 7f0c61c00700 1 -- 172.21.15.50:0/1945823625 wait complete. 2024-09-13T15:10:51.065 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:10:51.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:10:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.241+0000 7f40d2c00700 1 Processor -- start 2024-09-13T15:10:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.241+0000 7f40d2c00700 1 -- start start 2024-09-13T15:10:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ae100 0x7f40cc0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d2c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc06d4b0 con 0x7f40cc0ce360 2024-09-13T15:10:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d2c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc06d790 con 0x7f40cc06c2b0 2024-09-13T15:10:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc06dd50 con 0x7f40cc0ae100 2024-09-13T15:10:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d0e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f40cc0ce360 0x7f40cc06bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54502/0 (socket says 172.21.15.50:54502) 2024-09-13T15:10:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d0e00700 1 -- 172.21.15.50:0/2715693665 learned_addr learned my addr 172.21.15.50:0/2715693665 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d1800700 1 --2- 172.21.15.50:0/2715693665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ae100 0x7f40cc0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d1800700 1 -- 172.21.15.50:0/2715693665 >> v1:172.21.15.181:6789/0 conn(0x7f40cc06c2b0 legacy=0x7f40cc160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40cbe00700 1 -- 172.21.15.50:0/2715693665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611391974 0 0) 0x7f40cc06d4b0 con 0x7f40cc0ce360 2024-09-13T15:10:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d1800700 1 -- 172.21.15.50:0/2715693665 >> v1:172.21.15.50:6789/0 conn(0x7f40cc0ce360 legacy=0x7f40cc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.245+0000 7f40d1800700 1 -- 172.21.15.50:0/2715693665 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc06da70 con 0x7f40cc0ae100 2024-09-13T15:10:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d1800700 1 --2- 172.21.15.50:0/2715693665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ae100 0x7f40cc0b23b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f40c00098b0 tx=0x7f40c0009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84336c76876050e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40cbe00700 1 -- 172.21.15.50:0/2715693665 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011830 con 0x7f40cc0ae100 2024-09-13T15:10:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40cbe00700 1 -- 172.21.15.50:0/2715693665 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0011990 con 0x7f40cc0ae100 2024-09-13T15:10:51.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40cbe00700 1 -- 172.21.15.50:0/2715693665 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011d20 con 0x7f40cc0ae100 2024-09-13T15:10:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 -- 172.21.15.50:0/2715693665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ae100 msgr2=0x7f40cc0b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2715693665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ae100 0x7f40cc0b23b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f40c00098b0 tx=0x7f40c0009bc0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 -- 172.21.15.50:0/2715693665 shutdown_connections 2024-09-13T15:10:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2715693665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ae100 0x7f40cc0b23b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 -- 172.21.15.50:0/2715693665 >> 172.21.15.50:0/2715693665 conn(0x7f40cc0b05a0 msgr2=0x7f40cc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 -- 172.21.15.50:0/2715693665 shutdown_connections 2024-09-13T15:10:51.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.249+0000 7f40d2c00700 1 -- 172.21.15.50:0/2715693665 wait complete. 2024-09-13T15:10:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 Processor -- start 2024-09-13T15:10:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 -- start start 2024-09-13T15:10:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 0x7f40cc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ce360 0x7f40cc158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40cc1f5a80 0x7f40cc1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15bf50 con 0x7f40cc0ae100 2024-09-13T15:10:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15b940 con 0x7f40cc1f5a80 2024-09-13T15:10:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1f6540 con 0x7f40cc0ce360 2024-09-13T15:10:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d1800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 0x7f40cc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d1800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 0x7f40cc15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51550/0 (socket says 172.21.15.50:51550) 2024-09-13T15:10:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.253+0000 7f40d1800700 1 -- 172.21.15.50:0/2462865508 learned_addr learned my addr 172.21.15.50:0/2462865508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d0e00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ce360 0x7f40cc158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d2200700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40cc1f5a80 0x7f40cc1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d1800700 1 -- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ce360 msgr2=0x7f40cc158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d1800700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ce360 0x7f40cc158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d1800700 1 -- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40cc1f5a80 msgr2=0x7f40cc1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d1800700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40cc1f5a80 0x7f40cc1f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d1800700 1 -- 172.21.15.50:0/2462865508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00094b0 con 0x7f40cc0ae100 2024-09-13T15:10:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d1800700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 0x7f40cc15c3e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009880 tx=0x7f40c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00036c0 con 0x7f40cc0ae100 2024-09-13T15:10:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0003820 con 0x7f40cc0ae100 2024-09-13T15:10:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc1f6820 con 0x7f40cc0ae100 2024-09-13T15:10:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0003bb0 con 0x7f40cc0ae100 2024-09-13T15:10:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc15c920 con 0x7f40cc0ae100 2024-09-13T15:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.257+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc159e30 con 0x7f40cc0ae100 2024-09-13T15:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.261+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40c0003d10 con 0x7f40cc0ae100 2024-09-13T15:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.261+0000 7f40c9600700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40ac066730 0x7f40ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.261+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f40c0085530 con 0x7f40cc0ae100 2024-09-13T15:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.261+0000 7f40d0e00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40ac066730 0x7f40ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.261+0000 7f40d0e00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40ac066730 0x7f40ac068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40cc159e00 tx=0x7f40b8007cb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:51.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.269+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40c0052a10 con 0x7f40cc0ae100 2024-09-13T15:10:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.457+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f40cc1f69b0 con 0x7f40cc0ae100 2024-09-13T15:10:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.961+0000 7f40c9600700 1 -- 172.21.15.50:0/2462865508 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) v1 ==== 138+0+0 (secure 0 0 0) 0x7f40c0056030 con 0x7f40cc0ae100 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40ac066730 msgr2=0x7f40ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40ac066730 0x7f40ac068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40cc159e00 tx=0x7f40b8007cb0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 msgr2=0x7f40cc15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 0x7f40cc15c3e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009880 tx=0x7f40c0004770 comp rx=0 tx=0).stop 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 shutdown_connections 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f40ac066730 0x7f40ac068bf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40cc1f5a80 0x7f40cc1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f40cc0ce360 0x7f40cc158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 --2- 172.21.15.50:0/2462865508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40cc0ae100 0x7f40cc15c3e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 >> 172.21.15.50:0/2462865508 conn(0x7f40cc0b05a0 msgr2=0x7f40cc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 shutdown_connections 2024-09-13T15:10:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:51.969+0000 7f40d2c00700 1 -- 172.21.15.50:0/2462865508 wait complete. 2024-09-13T15:10:51.975 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:10:51.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.185+0000 7f46b3200700 1 Processor -- start 2024-09-13T15:10:52.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.185+0000 7f46b3200700 1 -- start start 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.185+0000 7f46b3200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46ac0d0f00 0x7f46ac0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.185+0000 7f46b3200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac070940 con 0x7f46ac0cd5d0 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.185+0000 7f46b3200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac0b4c20 con 0x7f46ac15aab0 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.185+0000 7f46b3200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0b5940 con 0x7f46ac0d0f00 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46b1200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46ac0cd5d0 0x7f46ac0cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54504/0 (socket says 172.21.15.50:54504) 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46ab400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f46ac0d0f00 0x7f46ac0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:52.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46b1200700 1 -- 172.21.15.50:0/2639558186 learned_addr learned my addr 172.21.15.50:0/2639558186 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46ab400700 1 -- 172.21.15.50:0/2639558186 >> v1:172.21.15.181:6789/0 conn(0x7f46ac15aab0 legacy=0x7f46ac0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46ab400700 1 -- 172.21.15.50:0/2639558186 >> v1:172.21.15.50:6789/0 conn(0x7f46ac0cd5d0 legacy=0x7f46ac0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46aaa00700 1 -- 172.21.15.50:0/2639558186 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675175729 0 0) 0x7f46ac070940 con 0x7f46ac0cd5d0 2024-09-13T15:10:52.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46ab400700 1 -- 172.21.15.50:0/2639558186 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0b5c20 con 0x7f46ac0d0f00 2024-09-13T15:10:52.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46ab400700 1 --2- 172.21.15.50:0/2639558186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac0d0f00 0x7f46ac0b45b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4698009850 tx=0x7f4698009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e64f870f466052 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46aaa00700 1 -- 172.21.15.50:0/2639558186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698011830 con 0x7f46ac0d0f00 2024-09-13T15:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46aaa00700 1 -- 172.21.15.50:0/2639558186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4698011990 con 0x7f46ac0d0f00 2024-09-13T15:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46aaa00700 1 -- 172.21.15.50:0/2639558186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698011d20 con 0x7f46ac0d0f00 2024-09-13T15:10:52.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46b3200700 1 -- 172.21.15.50:0/2639558186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac0d0f00 msgr2=0x7f46ac0b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.189+0000 7f46b3200700 1 --2- 172.21.15.50:0/2639558186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac0d0f00 0x7f46ac0b45b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4698009850 tx=0x7f4698009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.193+0000 7f46b3200700 1 -- 172.21.15.50:0/2639558186 shutdown_connections 2024-09-13T15:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.193+0000 7f46b3200700 1 --2- 172.21.15.50:0/2639558186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac0d0f00 0x7f46ac0b45b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.193+0000 7f46b3200700 1 -- 172.21.15.50:0/2639558186 >> 172.21.15.50:0/2639558186 conn(0x7f46ac06e660 msgr2=0x7f46ac06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:52.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.193+0000 7f46b3200700 1 -- 172.21.15.50:0/2639558186 shutdown_connections 2024-09-13T15:10:52.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.193+0000 7f46b3200700 1 -- 172.21.15.50:0/2639558186 wait complete. 2024-09-13T15:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 Processor -- start 2024-09-13T15:10:52.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 -- start start 2024-09-13T15:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46ac0cd5d0 0x7f46ac1f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46ac0d0f00 0x7f46ac1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 0x7f46ac151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:52.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1f74f0 con 0x7f46ac15aab0 2024-09-13T15:10:52.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac14ac80 con 0x7f46ac0d0f00 2024-09-13T15:10:52.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac15cf70 con 0x7f46ac0cd5d0 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 0x7f46ac151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 0x7f46ac151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51566/0 (socket says 172.21.15.50:51566) 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 -- 172.21.15.50:0/683439848 learned_addr learned my addr 172.21.15.50:0/683439848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46ab400700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46ac0d0f00 0x7f46ac1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46abe00700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46ac0cd5d0 0x7f46ac1f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 -- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46ac0cd5d0 msgr2=0x7f46ac1f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46ac0cd5d0 0x7f46ac1f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 -- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46ac0d0f00 msgr2=0x7f46ac1f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46ac0d0f00 0x7f46ac1f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 -- 172.21.15.50:0/683439848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980094b0 con 0x7f46ac15aab0 2024-09-13T15:10:52.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b1200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 0x7f46ac151700 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f46a400cb30 tx=0x7f46a400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:52.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400aaa0 con 0x7f46ac15aab0 2024-09-13T15:10:52.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400ac00 con 0x7f46ac15aab0 2024-09-13T15:10:52.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac15d250 con 0x7f46ac15aab0 2024-09-13T15:10:52.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40070d0 con 0x7f46ac15aab0 2024-09-13T15:10:52.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.197+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac15d810 con 0x7f46ac15aab0 2024-09-13T15:10:52.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.201+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac14f0c0 con 0x7f46ac15aab0 2024-09-13T15:10:52.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.201+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46a4007230 con 0x7f46ac15aab0 2024-09-13T15:10:52.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.205+0000 7f46a3e00700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f468c066730 0x7f468c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:52.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.205+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f46a4083b20 con 0x7f46ac15aab0 2024-09-13T15:10:52.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.205+0000 7f46abe00700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f468c066730 0x7f468c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:52.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.205+0000 7f46abe00700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f468c066730 0x7f468c068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f469c000f60 tx=0x7f469c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:52.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.209+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f46a4050f20 con 0x7f46ac15aab0 2024-09-13T15:10:52.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.393+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f46ac0b45b0 con 0x7f46ac15aab0 2024-09-13T15:10:52.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.965+0000 7f46a3e00700 1 -- 172.21.15.50:0/683439848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) v1 ==== 170+0+0 (secure 0 0 0) 0x7f46a4018020 con 0x7f46ac15aab0 2024-09-13T15:10:52.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f468c066730 msgr2=0x7f468c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f468c066730 0x7f468c068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f469c000f60 tx=0x7f469c009040 comp rx=0 tx=0).stop 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 msgr2=0x7f46ac151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 0x7f46ac151700 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f46a400cb30 tx=0x7f46a400ce40 comp rx=0 tx=0).stop 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 shutdown_connections 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f468c066730 0x7f468c068bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46ac15aab0 0x7f46ac151700 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46ac0d0f00 0x7f46ac1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 --2- 172.21.15.50:0/683439848 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f46ac0cd5d0 0x7f46ac1f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:52.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.973+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 >> 172.21.15.50:0/683439848 conn(0x7f46ac06e660 msgr2=0x7f46ac0b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.977+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 shutdown_connections 2024-09-13T15:10:52.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:52.981+0000 7f46b3200700 1 -- 172.21.15.50:0/683439848 wait complete. 2024-09-13T15:10:52.993 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:10:53.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:10:53.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.197+0000 7f29a4a00700 1 Processor -- start 2024-09-13T15:10:53.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.197+0000 7f29a4a00700 1 -- start start 2024-09-13T15:10:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.201+0000 7f29a4a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29a006cd80 0x7f29a00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.201+0000 7f29a4a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a006ada0 0x7f29a006b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.201+0000 7f29a4a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a0160680 con 0x7f29a015ca20 2024-09-13T15:10:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.201+0000 7f29a4a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a006b750 con 0x7f29a006cd80 2024-09-13T15:10:53.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.201+0000 7f29a4a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a015d670 con 0x7f29a006ada0 2024-09-13T15:10:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299de00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29a006cd80 0x7f29a00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299e800700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f29a015ca20 0x7f29a015ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47638/0 (socket says 172.21.15.50:47638) 2024-09-13T15:10:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a006ada0 0x7f29a006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299e800700 1 -- 172.21.15.50:0/2435348575 learned_addr learned my addr 172.21.15.50:0/2435348575 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299d400700 1 -- 172.21.15.50:0/2435348575 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003120659 0 0) 0x7f29a0160680 con 0x7f29a015ca20 2024-09-13T15:10:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299d400700 1 -- 172.21.15.50:0/2435348575 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29840035d0 con 0x7f29a015ca20 2024-09-13T15:10:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299f200700 1 -- 172.21.15.50:0/2435348575 >> v2:172.21.15.181:3300/0 conn(0x7f29a006cd80 msgr2=0x7f29a00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299f200700 1 --2- 172.21.15.50:0/2435348575 >> v2:172.21.15.181:3300/0 conn(0x7f29a006cd80 0x7f29a00b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299f200700 1 -- 172.21.15.50:0/2435348575 >> v1:172.21.15.181:6789/0 conn(0x7f29a015ca20 legacy=0x7f29a015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299f200700 1 -- 172.21.15.50:0/2435348575 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a015d950 con 0x7f29a006ada0 2024-09-13T15:10:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299f200700 1 --2- 172.21.15.50:0/2435348575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a006ada0 0x7f29a006b210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2998009d90 tx=0x7f299800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32e47a6fa10c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299d400700 1 -- 172.21.15.50:0/2435348575 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800e070 con 0x7f29a006ada0 2024-09-13T15:10:53.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299d400700 1 -- 172.21.15.50:0/2435348575 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800bb20 con 0x7f29a006ada0 2024-09-13T15:10:53.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f299d400700 1 -- 172.21.15.50:0/2435348575 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800be90 con 0x7f29a006ada0 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f29a4a00700 1 -- 172.21.15.50:0/2435348575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a006ada0 msgr2=0x7f29a006b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.205+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2435348575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a006ada0 0x7f29a006b210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2998009d90 tx=0x7f299800b330 comp rx=0 tx=0).stop 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 -- 172.21.15.50:0/2435348575 shutdown_connections 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2435348575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a006ada0 0x7f29a006b210 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2435348575 >> v2:172.21.15.181:3300/0 conn(0x7f29a006cd80 0x7f29a00b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 -- 172.21.15.50:0/2435348575 >> 172.21.15.50:0/2435348575 conn(0x7f29a0071d20 msgr2=0x7f29a0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 -- 172.21.15.50:0/2435348575 shutdown_connections 2024-09-13T15:10:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 -- 172.21.15.50:0/2435348575 wait complete. 2024-09-13T15:10:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.209+0000 7f29a4a00700 1 Processor -- start 2024-09-13T15:10:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 -- start start 2024-09-13T15:10:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29a006ada0 0x7f29a0152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 0x7f29a00cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a015ca20 0x7f29a00cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a0152a90 con 0x7f29a006cd80 2024-09-13T15:10:53.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00ccc70 con 0x7f29a006ada0 2024-09-13T15:10:53.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f29a4a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00cb690 con 0x7f29a015ca20 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 0x7f29a00cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 0x7f29a00cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58586/0 (socket says 172.21.15.50:58586) 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 -- 172.21.15.50:0/2488674561 learned_addr learned my addr 172.21.15.50:0/2488674561 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299e800700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29a006ada0 0x7f29a0152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299f200700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a015ca20 0x7f29a00cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 -- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a015ca20 msgr2=0x7f29a00cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a015ca20 0x7f29a00cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 -- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29a006ada0 msgr2=0x7f29a0152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29a006ada0 0x7f29a0152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 -- 172.21.15.50:0/2488674561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009a70 con 0x7f29a006cd80 2024-09-13T15:10:53.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.213+0000 7f299de00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 0x7f29a00cc730 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e9d0 tx=0x7f298c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:53.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.217+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c009720 con 0x7f29a006cd80 2024-09-13T15:10:53.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.217+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00ee70 con 0x7f29a006cd80 2024-09-13T15:10:53.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.217+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a00cb970 con 0x7f29a006cd80 2024-09-13T15:10:53.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.217+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00ca50 con 0x7f29a006cd80 2024-09-13T15:10:53.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.217+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a00cbf30 con 0x7f29a006cd80 2024-09-13T15:10:53.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.217+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a006d1c0 con 0x7f29a006cd80 2024-09-13T15:10:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.221+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f298c00cbb0 con 0x7f29a006cd80 2024-09-13T15:10:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.221+0000 7f2996a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2980066730 0x7f2980068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.221+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f298c0845b0 con 0x7f29a006cd80 2024-09-13T15:10:53.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.221+0000 7f299e800700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2980066730 0x7f2980068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.225+0000 7f299e800700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2980066730 0x7f2980068bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2990007fd0 tx=0x7f2990009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.225+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f298c051830 con 0x7f29a006cd80 2024-09-13T15:10:53.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.453+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f29a006ab80 con 0x7f29a006cd80 2024-09-13T15:10:53.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.469+0000 7f2996a00700 1 -- 172.21.15.50:0/2488674561 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f298c00ce60 con 0x7f29a006cd80 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.477+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2980066730 msgr2=0x7f2980068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.477+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2980066730 0x7f2980068bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2990007fd0 tx=0x7f2990009040 comp rx=0 tx=0).stop 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.477+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 msgr2=0x7f29a00cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.477+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 0x7f29a00cc730 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e9d0 tx=0x7f298c00ece0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.481+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 shutdown_connections 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.481+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2980066730 0x7f2980068bf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.481+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29a015ca20 0x7f29a00cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.481+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29a006cd80 0x7f29a00cc730 secure :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e9d0 tx=0x7f298c00ece0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.481+0000 7f29a4a00700 1 --2- 172.21.15.50:0/2488674561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29a006ada0 0x7f29a0152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.481+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 >> 172.21.15.50:0/2488674561 conn(0x7f29a0071d20 msgr2=0x7f29a015b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.485+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 shutdown_connections 2024-09-13T15:10:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.485+0000 7f29a4a00700 1 -- 172.21.15.50:0/2488674561 wait complete. 2024-09-13T15:10:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 11 and data pool 12 2024-09-13T15:10:53.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 Processor -- start 2024-09-13T15:10:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 -- start start 2024-09-13T15:10:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f970c15b700 0x7f970c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f970c06a5d0 0x7f970c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c06afa0 con 0x7f970c06a5d0 2024-09-13T15:10:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c0cdd90 con 0x7f970c15b700 2024-09-13T15:10:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9712800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c06ce10 con 0x7f970c06c460 2024-09-13T15:10:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f970c06a5d0 0x7f970c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f970c06a5d0 0x7f970c06aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58602/0 (socket says 172.21.15.50:58602) 2024-09-13T15:10:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 -- 172.21.15.50:0/571317470 learned_addr learned my addr 172.21.15.50:0/571317470 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9703e00700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970b400700 1 --2- 172.21.15.50:0/571317470 >> v2:172.21.15.181:3300/0 conn(0x7f970c15b700 0x7f970c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 -- 172.21.15.50:0/571317470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 msgr2=0x7f970c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 -- 172.21.15.50:0/571317470 >> v2:172.21.15.181:3300/0 conn(0x7f970c15b700 msgr2=0x7f970c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 --2- 172.21.15.50:0/571317470 >> v2:172.21.15.181:3300/0 conn(0x7f970c15b700 0x7f970c15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f970be00700 1 -- 172.21.15.50:0/571317470 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c15c020 con 0x7f970c06a5d0 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.689+0000 7f9703e00700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f970be00700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c06aa60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f970c06def0 tx=0x7f970400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351866a55595161a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f970aa00700 1 -- 172.21.15.50:0/571317470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400e070 con 0x7f970c06a5d0 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f970aa00700 1 -- 172.21.15.50:0/571317470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400b9c0 con 0x7f970c06a5d0 2024-09-13T15:10:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f970aa00700 1 -- 172.21.15.50:0/571317470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400bd70 con 0x7f970c06a5d0 2024-09-13T15:10:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 -- 172.21.15.50:0/571317470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 msgr2=0x7f970c06aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c06aa60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f970c06def0 tx=0x7f970400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 -- 172.21.15.50:0/571317470 shutdown_connections 2024-09-13T15:10:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c06aa60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 --2- 172.21.15.50:0/571317470 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 --2- 172.21.15.50:0/571317470 >> v2:172.21.15.181:3300/0 conn(0x7f970c15b700 0x7f970c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 -- 172.21.15.50:0/571317470 >> 172.21.15.50:0/571317470 conn(0x7f970c0b08d0 msgr2=0x7f970c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 -- 172.21.15.50:0/571317470 shutdown_connections 2024-09-13T15:10:53.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.693+0000 7f9712800700 1 -- 172.21.15.50:0/571317470 wait complete. 2024-09-13T15:10:53.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 Processor -- start 2024-09-13T15:10:53.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 -- start start 2024-09-13T15:10:53.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c1f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f970c15b700 0x7f970c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c153800 con 0x7f970c06a5d0 2024-09-13T15:10:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c153ae0 con 0x7f970c15b700 2024-09-13T15:10:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9712800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c153dc0 con 0x7f970c06c460 2024-09-13T15:10:53.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f970b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c1f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f970b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c1f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58612/0 (socket says 172.21.15.50:58612) 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f970b400700 1 -- 172.21.15.50:0/2687008383 learned_addr learned my addr 172.21.15.50:0/2687008383 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f9703e00700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.697+0000 7f970be00700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f970c15b700 0x7f970c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970b400700 1 -- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 msgr2=0x7f970c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970b400700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970b400700 1 -- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f970c15b700 msgr2=0x7f970c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970b400700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f970c15b700 0x7f970c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970b400700 1 -- 172.21.15.50:0/2687008383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009b30 con 0x7f970c06a5d0 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970be00700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f970c15b700 0x7f970c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9703e00700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f970b400700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c1f2a00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00d800 tx=0x7f96fc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0125f0 con 0x7f970c06a5d0 2024-09-13T15:10:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc012750 con 0x7f970c06a5d0 2024-09-13T15:10:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc012ac0 con 0x7f970c06a5d0 2024-09-13T15:10:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c1540a0 con 0x7f970c06a5d0 2024-09-13T15:10:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c1f2f40 con 0x7f970c06a5d0 2024-09-13T15:10:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.701+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c06caa0 con 0x7f970c06a5d0 2024-09-13T15:10:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.705+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96fc012c20 con 0x7f970c06a5d0 2024-09-13T15:10:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.705+0000 7f9703400700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f96e8066730 0x7f96e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.705+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f96fc084680 con 0x7f970c06a5d0 2024-09-13T15:10:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.705+0000 7f9703e00700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f96e8066730 0x7f96e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:53.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.709+0000 7f9703e00700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f96e8066730 0x7f96e8068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f970c15b110 tx=0x7f96f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.713+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96fc051810 con 0x7f970c06a5d0 2024-09-13T15:10:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.905+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f970c06c240 con 0x7f970c06a5d0 2024-09-13T15:10:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.905+0000 7f9703400700 1 -- 172.21.15.50:0/2687008383 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16778 (secure 0 0 0) 0x7f96fc012ed0 con 0x7f970c06a5d0 2024-09-13T15:10:53.910 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:53.910 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:53.458717+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f96e8066730 msgr2=0x7f96e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f96e8066730 0x7f96e8068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f970c15b110 tx=0x7f96f4008040 comp rx=0 tx=0).stop 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 msgr2=0x7f970c1f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c1f2a00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00d800 tx=0x7f96fc00dbc0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 shutdown_connections 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f96e8066730 0x7f96e8068bf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f970c15b700 0x7f970c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f970c06c460 0x7f970c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 --2- 172.21.15.50:0/2687008383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f970c06a5d0 0x7f970c1f2a00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 >> 172.21.15.50:0/2687008383 conn(0x7f970c0b08d0 msgr2=0x7f970c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 shutdown_connections 2024-09-13T15:10:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:53.909+0000 7f9712800700 1 -- 172.21.15.50:0/2687008383 wait complete. 2024-09-13T15:10:53.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.109+0000 7f5f23600700 1 Processor -- start 2024-09-13T15:10:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.109+0000 7f5f23600700 1 -- start start 2024-09-13T15:10:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f23600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5f1c0cf1b0 0x7f5f1c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f23600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f23600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c0b2c50 con 0x7f5f1c15ac60 2024-09-13T15:10:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f23600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0b2f30 con 0x7f5f1c0cf1b0 2024-09-13T15:10:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f23600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0b3210 con 0x7f5f1c0b3a10 2024-09-13T15:10:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f20c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f1c15ac60 0x7f5f1c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59842/0 (socket says 172.21.15.50:59842) 2024-09-13T15:10:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f20c00700 1 -- 172.21.15.50:0/3075891699 learned_addr learned my addr 172.21.15.50:0/3075891699 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f13e00700 1 --2- 172.21.15.50:0/3075891699 >> v2:172.21.15.181:3300/0 conn(0x7f5f1c0cf1b0 0x7f5f1c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f21600700 1 --2- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f1be00700 1 -- 172.21.15.50:0/3075891699 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956616345 0 0) 0x7f5f1c0b2c50 con 0x7f5f1c15ac60 2024-09-13T15:10:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f1be00700 1 -- 172.21.15.50:0/3075891699 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f000035d0 con 0x7f5f1c15ac60 2024-09-13T15:10:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f13e00700 1 -- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 msgr2=0x7f5f1c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f13e00700 1 --2- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f13e00700 1 -- 172.21.15.50:0/3075891699 >> v1:172.21.15.50:6789/0 conn(0x7f5f1c15ac60 legacy=0x7f5f1c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.113+0000 7f5f13e00700 1 -- 172.21.15.50:0/3075891699 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0b34f0 con 0x7f5f1c0cf1b0 2024-09-13T15:10:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f13e00700 1 --2- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c0cb830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009850 tx=0x7f5f04009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e8363710df9630 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:54.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f1be00700 1 -- 172.21.15.50:0/3075891699 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04011830 con 0x7f5f1c0cf1b0 2024-09-13T15:10:54.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f1be00700 1 -- 172.21.15.50:0/3075891699 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04011990 con 0x7f5f1c0cf1b0 2024-09-13T15:10:54.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f1be00700 1 -- 172.21.15.50:0/3075891699 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04011d40 con 0x7f5f1c0cf1b0 2024-09-13T15:10:54.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 -- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 msgr2=0x7f5f1c0cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 --2- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c0cb830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009850 tx=0x7f5f04009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:54.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 -- 172.21.15.50:0/3075891699 shutdown_connections 2024-09-13T15:10:54.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 --2- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 --2- 172.21.15.50:0/3075891699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c0cb830 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 -- 172.21.15.50:0/3075891699 >> 172.21.15.50:0/3075891699 conn(0x7f5f1c0b0a40 msgr2=0x7f5f1c0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:54.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 -- 172.21.15.50:0/3075891699 shutdown_connections 2024-09-13T15:10:54.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.117+0000 7f5f23600700 1 -- 172.21.15.50:0/3075891699 wait complete. 2024-09-13T15:10:54.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.121+0000 7f5f23600700 1 Processor -- start 2024-09-13T15:10:54.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.121+0000 7f5f23600700 1 -- start start 2024-09-13T15:10:54.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.121+0000 7f5f23600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 0x7f5f1c147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c147db0 con 0x7f5f1c15ac60 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c148090 con 0x7f5f1c0cf1b0 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c148370 con 0x7f5f1c0b3a10 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 0x7f5f1c147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f13e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f20c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 0x7f5f1c147780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58626/0 (socket says 172.21.15.50:58626) 2024-09-13T15:10:54.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 -- 172.21.15.50:0/2609365697 learned_addr learned my addr 172.21.15.50:0/2609365697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:54.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 -- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 msgr2=0x7f5f1c0a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 -- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 msgr2=0x7f5f1c147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 -- 172.21.15.50:0/2609365697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040094b0 con 0x7f5f1c15ac60 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f21600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 0x7f5f1c147780 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400efc0 tx=0x7f5f1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14009ea0 con 0x7f5f1c15ac60 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c148650 con 0x7f5f1c15ac60 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1400f040 con 0x7f5f1c15ac60 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400ced0 con 0x7f5f1c15ac60 2024-09-13T15:10:54.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.125+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0a9280 con 0x7f5f1c15ac60 2024-09-13T15:10:54.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.129+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c148b70 con 0x7f5f1c15ac60 2024-09-13T15:10:54.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.129+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f14014480 con 0x7f5f1c15ac60 2024-09-13T15:10:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.133+0000 7f5f19600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef8066730 0x7f5ef8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.133+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5f14084bf0 con 0x7f5f1c15ac60 2024-09-13T15:10:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.133+0000 7f5f20c00700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef8066730 0x7f5ef8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.133+0000 7f5f20c00700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef8066730 0x7f5ef8068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c007fd0 tx=0x7f5f0c007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.137+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f1c148b70 con 0x7f5f1c15ac60 2024-09-13T15:10:54.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.329+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f1c148b70 con 0x7f5f1c15ac60 2024-09-13T15:10:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.333+0000 7f5f19600700 1 -- 172.21.15.50:0/2609365697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16778 (secure 0 0 0) 0x7f5f1c148b70 con 0x7f5f1c15ac60 2024-09-13T15:10:54.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:54.336 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:53.458717+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef8066730 msgr2=0x7f5ef8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef8066730 0x7f5ef8068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c007fd0 tx=0x7f5f0c007de0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 msgr2=0x7f5f1c147780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 0x7f5f1c147780 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400efc0 tx=0x7f5f1400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 shutdown_connections 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ef8066730 0x7f5ef8068bf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f1c15ac60 0x7f5f1c147780 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f1c0cf1b0 0x7f5f1c147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 --2- 172.21.15.50:0/2609365697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f1c0b3a10 0x7f5f1c0a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 >> 172.21.15.50:0/2609365697 conn(0x7f5f1c0b0a40 msgr2=0x7f5f1c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 shutdown_connections 2024-09-13T15:10:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.337+0000 7f5f23600700 1 -- 172.21.15.50:0/2609365697 wait complete. 2024-09-13T15:10:54.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:10:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.541+0000 7fdedce00700 1 Processor -- start 2024-09-13T15:10:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.541+0000 7fdedce00700 1 -- start start 2024-09-13T15:10:54.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.541+0000 7fdedce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded815aa90 0x7fded80b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fded80cf830 0x7fded80cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded80b4680 con 0x7fded806c5a0 2024-09-13T15:10:54.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded815aeb0 con 0x7fded80cf830 2024-09-13T15:10:54.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded80b4960 con 0x7fded815aa90 2024-09-13T15:10:54.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fded80cf830 0x7fded80cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fded80cf830 0x7fded80cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58640/0 (socket says 172.21.15.50:58640) 2024-09-13T15:10:54.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded815aa90 0x7fded80b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 -- 172.21.15.50:0/3383165514 learned_addr learned my addr 172.21.15.50:0/3383165514 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:54.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 -- 172.21.15.50:0/3383165514 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded815aa90 msgr2=0x7fded80b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:54.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 --2- 172.21.15.50:0/3383165514 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded815aa90 0x7fded80b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 -- 172.21.15.50:0/3383165514 >> v1:172.21.15.181:6789/0 conn(0x7fded806c5a0 legacy=0x7fded806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 -- 172.21.15.50:0/3383165514 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80cf030 con 0x7fded80cf830 2024-09-13T15:10:54.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded7e00700 1 --2- 172.21.15.50:0/3383165514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded80cfc80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fded0009e50 tx=0x7fded000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33613f2f9dae8da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:54.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded6000700 1 -- 172.21.15.50:0/3383165514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000e070 con 0x7fded80cf830 2024-09-13T15:10:54.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded6000700 1 -- 172.21.15.50:0/3383165514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded000b910 con 0x7fded80cf830 2024-09-13T15:10:54.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fded6000700 1 -- 172.21.15.50:0/3383165514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000bcc0 con 0x7fded80cf830 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- 172.21.15.50:0/3383165514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 msgr2=0x7fded80cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 --2- 172.21.15.50:0/3383165514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded80cfc80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fded0009e50 tx=0x7fded000b330 comp rx=0 tx=0).stop 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- 172.21.15.50:0/3383165514 shutdown_connections 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 --2- 172.21.15.50:0/3383165514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded80cfc80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 --2- 172.21.15.50:0/3383165514 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded815aa90 0x7fded80b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- 172.21.15.50:0/3383165514 >> 172.21.15.50:0/3383165514 conn(0x7fded8071d20 msgr2=0x7fded8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.545+0000 7fdedce00700 1 -- 172.21.15.50:0/3383165514 shutdown_connections 2024-09-13T15:10:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.549+0000 7fdedce00700 1 -- 172.21.15.50:0/3383165514 wait complete. 2024-09-13T15:10:54.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.549+0000 7fdedce00700 1 Processor -- start 2024-09-13T15:10:54.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.549+0000 7fdedce00700 1 -- start start 2024-09-13T15:10:54.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded806c5a0 0x7fded814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fded815aa90 0x7fded806e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded8151390 con 0x7fded80cf830 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded81f46a0 con 0x7fded815aa90 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded815d060 con 0x7fded806c5a0 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded81508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58650/0 (socket says 172.21.15.50:58650) 2024-09-13T15:10:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 -- 172.21.15.50:0/4021229392 learned_addr learned my addr 172.21.15.50:0/4021229392 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:54.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded7e00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fded815aa90 0x7fded806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 -- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded806c5a0 msgr2=0x7fded814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded7400700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded806c5a0 0x7fded814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded806c5a0 0x7fded814c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 -- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fded815aa90 msgr2=0x7fded806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fded815aa90 0x7fded806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 -- 172.21.15.50:0/4021229392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0009b30 con 0x7fded80cf830 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded7e00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fded815aa90 0x7fded806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded7400700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded806c5a0 0x7fded814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fded6a00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded81508a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fdec400e840 tx=0x7fdec400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec40095a0 con 0x7fded80cf830 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400c690 con 0x7fded80cf830 2024-09-13T15:10:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400ca00 con 0x7fded80cf830 2024-09-13T15:10:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded815d340 con 0x7fded80cf830 2024-09-13T15:10:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.553+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded815d900 con 0x7fded80cf830 2024-09-13T15:10:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.557+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded806c980 con 0x7fded80cf830 2024-09-13T15:10:54.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.557+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdec400cb60 con 0x7fded80cf830 2024-09-13T15:10:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.561+0000 7fdecf400700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdeb8066730 0x7fdeb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.561+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdec4084260 con 0x7fded80cf830 2024-09-13T15:10:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.561+0000 7fded7400700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdeb8066730 0x7fdeb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.561+0000 7fded7400700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdeb8066730 0x7fdeb8068bf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000f60 tx=0x7fdec8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.565+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdec4051480 con 0x7fded80cf830 2024-09-13T15:10:54.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:54.789+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fded8157940 con 0x7fded80cf830 2024-09-13T15:10:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.481+0000 7fdecf400700 1 -- 172.21.15.50:0/4021229392 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdec4054aa0 con 0x7fded80cf830 2024-09-13T15:10:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdeb8066730 msgr2=0x7fdeb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdeb8066730 0x7fdeb8068bf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000f60 tx=0x7fdec8009040 comp rx=0 tx=0).stop 2024-09-13T15:10:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 msgr2=0x7fded81508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded81508a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fdec400e840 tx=0x7fdec400ec00 comp rx=0 tx=0).stop 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 shutdown_connections 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdeb8066730 0x7fdeb8068bf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fded815aa90 0x7fded806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded80cf830 0x7fded81508a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 --2- 172.21.15.50:0/4021229392 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fded806c5a0 0x7fded814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 >> 172.21.15.50:0/4021229392 conn(0x7fded8071d20 msgr2=0x7fded81545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 shutdown_connections 2024-09-13T15:10:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.485+0000 7fdedce00700 1 -- 172.21.15.50:0/4021229392 wait complete. 2024-09-13T15:10:55.515 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:10:55.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:10:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.701+0000 7fb19be00700 1 Processor -- start 2024-09-13T15:10:55.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.705+0000 7fb19be00700 1 -- start start 2024-09-13T15:10:55.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.705+0000 7fb19be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb19c15aa90 0x7fb19c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.705+0000 7fb19be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0b4680 con 0x7fb19c0cf830 2024-09-13T15:10:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.705+0000 7fb19be00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0b4960 con 0x7fb19c06c5a0 2024-09-13T15:10:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.705+0000 7fb19be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c15aee0 con 0x7fb19c15aa90 2024-09-13T15:10:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19aa00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb19c06c5a0 0x7fb19c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47666/0 (socket says 172.21.15.50:47666) 2024-09-13T15:10:55.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19aa00700 1 -- 172.21.15.50:0/2312415703 learned_addr learned my addr 172.21.15.50:0/2312415703 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:55.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19a000700 1 --2- 172.21.15.50:0/2312415703 >> v2:172.21.15.181:3300/0 conn(0x7fb19c15aa90 0x7fb19c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:55.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838260354 0 0) 0x7fb19c0b4960 con 0x7fb19c06c5a0 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1800035d0 con 0x7fb19c06c5a0 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981868398 0 0) 0x7fb19c0b4680 con 0x7fb19c0cf830 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb19c0b4960 con 0x7fb19c0cf830 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19a000700 1 -- 172.21.15.50:0/2312415703 >> v1:172.21.15.181:6789/0 conn(0x7fb19c06c5a0 legacy=0x7fb19c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1325192951 0 0) 0x7fb19c0b4960 con 0x7fb19c0cf830 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19a000700 1 -- 172.21.15.50:0/2312415703 >> v1:172.21.15.50:6789/0 conn(0x7fb19c0cf830 legacy=0x7fb19c0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19a000700 1 -- 172.21.15.50:0/2312415703 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0cf030 con 0x7fb19c15aa90 2024-09-13T15:10:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb19a000700 1 --2- 172.21.15.50:0/2312415703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c15aa90 0x7fb19c0b56c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb188009850 tx=0x7fb188009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7784c8f77f9e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940019f0 con 0x7fb19c15aa90 2024-09-13T15:10:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188004030 con 0x7fb19c15aa90 2024-09-13T15:10:55.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.709+0000 7fb199600700 1 -- 172.21.15.50:0/2312415703 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880043a0 con 0x7fb19c15aa90 2024-09-13T15:10:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 -- 172.21.15.50:0/2312415703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c15aa90 msgr2=0x7fb19c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 --2- 172.21.15.50:0/2312415703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c15aa90 0x7fb19c0b56c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb188009850 tx=0x7fb188009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 -- 172.21.15.50:0/2312415703 shutdown_connections 2024-09-13T15:10:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 --2- 172.21.15.50:0/2312415703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c15aa90 0x7fb19c0b56c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 -- 172.21.15.50:0/2312415703 >> 172.21.15.50:0/2312415703 conn(0x7fb19c071d20 msgr2=0x7fb19c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 -- 172.21.15.50:0/2312415703 shutdown_connections 2024-09-13T15:10:55.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 -- 172.21.15.50:0/2312415703 wait complete. 2024-09-13T15:10:55.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 Processor -- start 2024-09-13T15:10:55.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.713+0000 7fb19be00700 1 -- start start 2024-09-13T15:10:55.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb19c06c5a0 0x7fb19c14fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c0cf830 0x7fb19c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 0x7fb19c1f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c15c9c0 con 0x7fb19c15aa90 2024-09-13T15:10:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c15c0f0 con 0x7fb19c0cf830 2024-09-13T15:10:55.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1f2db0 con 0x7fb19c06c5a0 2024-09-13T15:10:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 0x7fb19c1f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 0x7fb19c1f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58654/0 (socket says 172.21.15.50:58654) 2024-09-13T15:10:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 -- 172.21.15.50:0/3823674802 learned_addr learned my addr 172.21.15.50:0/3823674802 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19a000700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c0cf830 0x7fb19c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19aa00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb19c06c5a0 0x7fb19c14fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 -- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb19c06c5a0 msgr2=0x7fb19c14fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb19c06c5a0 0x7fb19c14fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 -- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c0cf830 msgr2=0x7fb19c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c0cf830 0x7fb19c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 -- 172.21.15.50:0/3823674802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880094b0 con 0x7fb19c15aa90 2024-09-13T15:10:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19b400700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 0x7fb19c1f2050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c8c0 tx=0x7fb19400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194003e30 con 0x7fb19c15aa90 2024-09-13T15:10:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194005070 con 0x7fb19c15aa90 2024-09-13T15:10:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194005420 con 0x7fb19c15aa90 2024-09-13T15:10:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c15c300 con 0x7fb19c15aa90 2024-09-13T15:10:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c155430 con 0x7fb19c15aa90 2024-09-13T15:10:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.717+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c06c980 con 0x7fb19c15aa90 2024-09-13T15:10:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.721+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb194005580 con 0x7fb19c15aa90 2024-09-13T15:10:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.721+0000 7fb193400700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb17c066730 0x7fb17c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.721+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1940839a0 con 0x7fb19c15aa90 2024-09-13T15:10:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.721+0000 7fb19aa00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb17c066730 0x7fb17c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:55.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.725+0000 7fb19aa00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb17c066730 0x7fb17c068bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007fd0 tx=0x7fb18c007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:55.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.729+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb194050bc0 con 0x7fb19c15aa90 2024-09-13T15:10:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:55.961+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb19c0cc880 con 0x7fb19c15aa90 2024-09-13T15:10:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.481+0000 7fb193400700 1 -- 172.21.15.50:0/3823674802 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1940170c0 con 0x7fb19c15aa90 2024-09-13T15:10:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb17c066730 msgr2=0x7fb17c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb17c066730 0x7fb17c068bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007fd0 tx=0x7fb18c007de0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 msgr2=0x7fb19c1f2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 0x7fb19c1f2050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c8c0 tx=0x7fb19400cbd0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 shutdown_connections 2024-09-13T15:10:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb17c066730 0x7fb17c068bf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb19c15aa90 0x7fb19c1f2050 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb19c0cf830 0x7fb19c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 --2- 172.21.15.50:0/3823674802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb19c06c5a0 0x7fb19c14fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 >> 172.21.15.50:0/3823674802 conn(0x7fb19c071d20 msgr2=0x7fb19c0cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 shutdown_connections 2024-09-13T15:10:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.489+0000 7fb19be00700 1 -- 172.21.15.50:0/3823674802 wait complete. 2024-09-13T15:10:56.517 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:10:56.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:56.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 Processor -- start 2024-09-13T15:10:56.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 -- start start 2024-09-13T15:10:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff64015cfd0 0x7ff6400ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6400d0cc0 0x7ff6400d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400b2e40 con 0x7ff6400d1950 2024-09-13T15:10:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400cee50 con 0x7ff64015cfd0 2024-09-13T15:10:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.697+0000 7ff646200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400d1e00 con 0x7ff6400d0cc0 2024-09-13T15:10:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff64015cfd0 0x7ff6400ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6400d1950 0x7ff6400cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59856/0 (socket says 172.21.15.50:59856) 2024-09-13T15:10:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63fe00700 1 -- 172.21.15.50:0/1890704134 learned_addr learned my addr 172.21.15.50:0/1890704134 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63ea00700 1 --2- 172.21.15.50:0/1890704134 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6400d0cc0 0x7ff6400d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63f400700 1 -- 172.21.15.50:0/1890704134 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6400d0cc0 msgr2=0x7ff6400d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63f400700 1 --2- 172.21.15.50:0/1890704134 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6400d0cc0 0x7ff6400d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63f400700 1 -- 172.21.15.50:0/1890704134 >> v1:172.21.15.50:6789/0 conn(0x7ff6400d1950 legacy=0x7ff6400cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63f400700 1 -- 172.21.15.50:0/1890704134 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400ceb70 con 0x7ff64015cfd0 2024-09-13T15:10:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63e000700 1 -- 172.21.15.50:0/1890704134 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757754883 0 0) 0x7ff6400b2e40 con 0x7ff6400d1950 2024-09-13T15:10:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63f400700 1 --2- 172.21.15.50:0/1890704134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64015cfd0 0x7ff6400ce500 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff630009850 tx=0x7ff630009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19097a53167f79c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63e000700 1 -- 172.21.15.50:0/1890704134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011830 con 0x7ff64015cfd0 2024-09-13T15:10:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63e000700 1 -- 172.21.15.50:0/1890704134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630011990 con 0x7ff64015cfd0 2024-09-13T15:10:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff63e000700 1 -- 172.21.15.50:0/1890704134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011d40 con 0x7ff64015cfd0 2024-09-13T15:10:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 -- 172.21.15.50:0/1890704134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64015cfd0 msgr2=0x7ff6400ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 --2- 172.21.15.50:0/1890704134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64015cfd0 0x7ff6400ce500 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff630009850 tx=0x7ff630009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 -- 172.21.15.50:0/1890704134 shutdown_connections 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 --2- 172.21.15.50:0/1890704134 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6400d0cc0 0x7ff6400d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 --2- 172.21.15.50:0/1890704134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64015cfd0 0x7ff6400ce500 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 -- 172.21.15.50:0/1890704134 >> 172.21.15.50:0/1890704134 conn(0x7ff64009c0e0 msgr2=0x7ff6400d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.701+0000 7ff646200700 1 -- 172.21.15.50:0/1890704134 shutdown_connections 2024-09-13T15:10:56.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 -- 172.21.15.50:0/1890704134 wait complete. 2024-09-13T15:10:56.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 Processor -- start 2024-09-13T15:10:56.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 -- start start 2024-09-13T15:10:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 0x7ff640157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6400d1950 0x7ff6400c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff64015cfd0 0x7ff6400b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400b7400 con 0x7ff6400d0cc0 2024-09-13T15:10:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400b67c0 con 0x7ff6400d1950 2024-09-13T15:10:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.705+0000 7ff646200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400b6a60 con 0x7ff64015cfd0 2024-09-13T15:10:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 0x7ff640157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:56.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 0x7ff640157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58682/0 (socket says 172.21.15.50:58682) 2024-09-13T15:10:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 -- 172.21.15.50:0/123080937 learned_addr learned my addr 172.21.15.50:0/123080937 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63ea00700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6400d1950 0x7ff6400c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63fe00700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff64015cfd0 0x7ff6400b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 -- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff64015cfd0 msgr2=0x7ff6400b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff64015cfd0 0x7ff6400b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 -- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6400d1950 msgr2=0x7ff6400c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6400d1950 0x7ff6400c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 -- 172.21.15.50:0/123080937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6300094b0 con 0x7ff6400d0cc0 2024-09-13T15:10:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff63f400700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 0x7ff640157200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff6300090b0 tx=0x7ff630004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63001a990 con 0x7ff6400d0cc0 2024-09-13T15:10:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63001f070 con 0x7ff6400d0cc0 2024-09-13T15:10:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63001ad30 con 0x7ff6400d0cc0 2024-09-13T15:10:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6400d1260 con 0x7ff6400d0cc0 2024-09-13T15:10:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.709+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6400b7020 con 0x7ff6400d0cc0 2024-09-13T15:10:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.713+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6400b7670 con 0x7ff6400d0cc0 2024-09-13T15:10:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.713+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff63001b430 con 0x7ff6400d0cc0 2024-09-13T15:10:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.717+0000 7ff637400700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff620066730 0x7ff620068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.717+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff630085380 con 0x7ff6400d0cc0 2024-09-13T15:10:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.717+0000 7ff63ea00700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff620066730 0x7ff620068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:56.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.717+0000 7ff63ea00700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff620066730 0x7ff620068bf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff6400c79c0 tx=0x7ff62c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.721+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff630052520 con 0x7ff6400d0cc0 2024-09-13T15:10:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.949+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6400d2380 con 0x7ff6400d0cc0 2024-09-13T15:10:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.949+0000 7ff637400700 1 -- 172.21.15.50:0/123080937 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7ff630006ce0 con 0x7ff6400d0cc0 2024-09-13T15:10:56.952 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:56.952 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:10:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff620066730 msgr2=0x7ff620068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff620066730 0x7ff620068bf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff6400c79c0 tx=0x7ff62c009240 comp rx=0 tx=0).stop 2024-09-13T15:10:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 msgr2=0x7ff640157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 0x7ff640157200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff6300090b0 tx=0x7ff630004770 comp rx=0 tx=0).stop 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 shutdown_connections 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff620066730 0x7ff620068bf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff64015cfd0 0x7ff6400b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6400d1950 0x7ff6400c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 --2- 172.21.15.50:0/123080937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6400d0cc0 0x7ff640157200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 >> 172.21.15.50:0/123080937 conn(0x7ff64009c0e0 msgr2=0x7ff6400b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 shutdown_connections 2024-09-13T15:10:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:56.953+0000 7ff646200700 1 -- 172.21.15.50:0/123080937 wait complete. 2024-09-13T15:10:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:10:56.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:10:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 Processor -- start 2024-09-13T15:10:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 -- start start 2024-09-13T15:10:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc15d310 0x7fa8bc0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa8bc15e9f0 0x7fa8bc15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc15e560 con 0x7fa8bc06aaa0 2024-09-13T15:10:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc0b3ec0 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8bb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0adf90 con 0x7fa8bc15d310 2024-09-13T15:10:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8ba800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa8bc15e9f0 0x7fa8bc15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8b9400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc15d310 0x7fa8bc0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8b9e00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa8bc06aaa0 0x7fa8bc06ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47680/0 (socket says 172.21.15.50:47680) 2024-09-13T15:10:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.157+0000 7fa8b9e00700 1 -- 172.21.15.50:0/342730569 learned_addr learned my addr 172.21.15.50:0/342730569 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8ba800700 1 -- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc15d310 msgr2=0x7fa8bc0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8ba800700 1 --2- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc15d310 0x7fa8bc0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8ba800700 1 -- 172.21.15.50:0/342730569 >> v1:172.21.15.181:6789/0 conn(0x7fa8bc06aaa0 legacy=0x7fa8bc06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8ba800700 1 -- 172.21.15.50:0/342730569 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc15d920 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8ba800700 1 --2- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc15eea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009d90 tx=0x7fa8b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7fcfb6123c6589a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8b8a00700 1 -- 172.21.15.50:0/342730569 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400e070 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8b8a00700 1 -- 172.21.15.50:0/342730569 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b400bb20 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8b8a00700 1 -- 172.21.15.50:0/342730569 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4012430 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 -- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15e9f0 msgr2=0x7fa8bc15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 --2- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc15eea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009d90 tx=0x7fa8b400b330 comp rx=0 tx=0).stop 2024-09-13T15:10:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 -- 172.21.15.50:0/342730569 shutdown_connections 2024-09-13T15:10:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 --2- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc15eea0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 --2- 172.21.15.50:0/342730569 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc15d310 0x7fa8bc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 -- 172.21.15.50:0/342730569 >> 172.21.15.50:0/342730569 conn(0x7fa8bc0b0c40 msgr2=0x7fa8bc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 -- 172.21.15.50:0/342730569 shutdown_connections 2024-09-13T15:10:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.161+0000 7fa8bb200700 1 -- 172.21.15.50:0/342730569 wait complete. 2024-09-13T15:10:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.165+0000 7fa8bb200700 1 Processor -- start 2024-09-13T15:10:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.165+0000 7fa8bb200700 1 -- start start 2024-09-13T15:10:57.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc06aaa0 0x7fa8bc146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15d310 0x7fa8bc1f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc1f5fc0 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc144410 con 0x7fa8bc15d310 2024-09-13T15:10:57.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc1446f0 con 0x7fa8bc06aaa0 2024-09-13T15:10:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc1f6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58688/0 (socket says 172.21.15.50:58688) 2024-09-13T15:10:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 -- 172.21.15.50:0/2560794541 learned_addr learned my addr 172.21.15.50:0/2560794541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8b9e00700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc06aaa0 0x7fa8bc146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8b9400700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15d310 0x7fa8bc1f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 -- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc06aaa0 msgr2=0x7fa8bc146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc06aaa0 0x7fa8bc146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 -- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15d310 msgr2=0x7fa8bc1f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15d310 0x7fa8bc1f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 -- 172.21.15.50:0/2560794541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009a70 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8ba800700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc1f6260 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4014040 tx=0x7fa8b4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4012430 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b4020070 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40098f0 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc1449d0 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.169+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc144f90 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.173+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc0b3980 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.173+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8b4004040 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.173+0000 7fa8b2000700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa89c066730 0x7fa89c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.173+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa8b4022070 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.173+0000 7fa8b9e00700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa89c066730 0x7fa89c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.177+0000 7fa8b9e00700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa89c066730 0x7fa89c068bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac005930 tx=0x7fa8ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.177+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8b4053130 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.365+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8bc15c310 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.369+0000 7fa8b2000700 1 -- 172.21.15.50:0/2560794541 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16765 (secure 0 0 0) 0x7fa8b4056750 con 0x7fa8bc15e9f0 2024-09-13T15:10:57.372 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:57.373 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:54.464580+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa89c066730 msgr2=0x7fa89c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa89c066730 0x7fa89c068bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac005930 tx=0x7fa8ac009040 comp rx=0 tx=0).stop 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 msgr2=0x7fa8bc1f6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc1f6260 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4014040 tx=0x7fa8b4004af0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 shutdown_connections 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa89c066730 0x7fa89c068bf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8bc15e9f0 0x7fa8bc1f6260 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8bc15d310 0x7fa8bc1f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 --2- 172.21.15.50:0/2560794541 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa8bc06aaa0 0x7fa8bc146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 >> 172.21.15.50:0/2560794541 conn(0x7fa8bc0b0c40 msgr2=0x7fa8bc15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 shutdown_connections 2024-09-13T15:10:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.373+0000 7fa8bb200700 1 -- 172.21.15.50:0/2560794541 wait complete. 2024-09-13T15:10:57.401 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:10:57.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.569+0000 7f74ff200700 1 Processor -- start 2024-09-13T15:10:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.569+0000 7f74ff200700 1 -- start start 2024-09-13T15:10:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74ff200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f750015d310 0x7f75000b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74ff200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750015e560 con 0x7f750015e9f0 2024-09-13T15:10:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74ff200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750015d920 con 0x7f750006aaa0 2024-09-13T15:10:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74ff200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000b3ec0 con 0x7f750015d310 2024-09-13T15:10:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fe800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f750015e9f0 0x7f750015ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59860/0 (socket says 172.21.15.50:59860) 2024-09-13T15:10:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fe800700 1 -- 172.21.15.50:0/2618133550 learned_addr learned my addr 172.21.15.50:0/2618133550 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74f5400700 1 --2- 172.21.15.50:0/2618133550 >> v2:172.21.15.181:3300/0 conn(0x7f750015d310 0x7f75000b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378386697 0 0) 0x7f750015e560 con 0x7f750015e9f0 2024-09-13T15:10:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e40035d0 con 0x7f750015e9f0 2024-09-13T15:10:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416033152 0 0) 0x7f750015d920 con 0x7f750006aaa0 2024-09-13T15:10:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f750015e560 con 0x7f750006aaa0 2024-09-13T15:10:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74f5400700 1 -- 172.21.15.50:0/2618133550 >> v1:172.21.15.181:6789/0 conn(0x7f750006aaa0 legacy=0x7f750006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74f5400700 1 -- 172.21.15.50:0/2618133550 >> v1:172.21.15.50:6789/0 conn(0x7f750015e9f0 legacy=0x7f750015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74f5400700 1 -- 172.21.15.50:0/2618133550 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750015dc00 con 0x7f750015d310 2024-09-13T15:10:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74f5400700 1 --2- 172.21.15.50:0/2618133550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015d310 0x7f75000b3980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009850 tx=0x7f74e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c804bb523d48453 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011830 con 0x7f750015d310 2024-09-13T15:10:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8011990 con 0x7f750015d310 2024-09-13T15:10:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.573+0000 7f74fd400700 1 -- 172.21.15.50:0/2618133550 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011d40 con 0x7f750015d310 2024-09-13T15:10:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 -- 172.21.15.50:0/2618133550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015d310 msgr2=0x7f75000b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 --2- 172.21.15.50:0/2618133550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015d310 0x7f75000b3980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009850 tx=0x7f74e8009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 -- 172.21.15.50:0/2618133550 shutdown_connections 2024-09-13T15:10:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 --2- 172.21.15.50:0/2618133550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015d310 0x7f75000b3980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 -- 172.21.15.50:0/2618133550 >> 172.21.15.50:0/2618133550 conn(0x7f75000b0c40 msgr2=0x7f750006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 -- 172.21.15.50:0/2618133550 shutdown_connections 2024-09-13T15:10:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.577+0000 7f74ff200700 1 -- 172.21.15.50:0/2618133550 wait complete. 2024-09-13T15:10:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 Processor -- start 2024-09-13T15:10:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 -- start start 2024-09-13T15:10:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 0x7f750015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f750015d310 0x7f75001f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015e9f0 0x7f75001456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75001f34e0 con 0x7f750006aaa0 2024-09-13T15:10:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750013f670 con 0x7f750015e9f0 2024-09-13T15:10:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74ff200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750013a7c0 con 0x7f750015d310 2024-09-13T15:10:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 0x7f750015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74f5400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f750015d310 0x7f75001f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 0x7f750015bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58698/0 (socket says 172.21.15.50:58698) 2024-09-13T15:10:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 -- 172.21.15.50:0/3034420158 learned_addr learned my addr 172.21.15.50:0/3034420158 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fe800700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015e9f0 0x7f75001456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 -- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f750015d310 msgr2=0x7f75001f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f750015d310 0x7f75001f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 -- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015e9f0 msgr2=0x7f75001456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015e9f0 0x7f75001456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.581+0000 7f74fde00700 1 -- 172.21.15.50:0/3034420158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e80094b0 con 0x7f750006aaa0 2024-09-13T15:10:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74fde00700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 0x7f750015bd40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f74f0001ee0 tx=0x7f74f00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0003c20 con 0x7f750006aaa0 2024-09-13T15:10:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0003da0 con 0x7f750006aaa0 2024-09-13T15:10:57.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f000ab00 con 0x7f750006aaa0 2024-09-13T15:10:57.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750013aaa0 con 0x7f750006aaa0 2024-09-13T15:10:57.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750013b060 con 0x7f750006aaa0 2024-09-13T15:10:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.585+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000ad4c0 con 0x7f750006aaa0 2024-09-13T15:10:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.589+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74f000ac60 con 0x7f750006aaa0 2024-09-13T15:10:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.589+0000 7f74f6a00700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74dc066730 0x7f74dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.589+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74f0084330 con 0x7f750006aaa0 2024-09-13T15:10:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.589+0000 7f74f5400700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74dc066730 0x7f74dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.593+0000 7f74f5400700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74dc066730 0x7f74dc068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74e80090b0 tx=0x7f74e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:57.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.593+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74f0051550 con 0x7f750006aaa0 2024-09-13T15:10:57.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.793+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f750015e1c0 con 0x7f74dc066730 2024-09-13T15:10:57.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.813+0000 7f74f6a00700 1 -- 172.21.15.50:0/3034420158 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272355 (secure 0 0 0) 0x7f74e8011b00 con 0x7f74dc066730 2024-09-13T15:10:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:57.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74dc066730 msgr2=0x7f74dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74dc066730 0x7f74dc068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74e80090b0 tx=0x7f74e8008030 comp rx=0 tx=0).stop 2024-09-13T15:10:57.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 msgr2=0x7f750015bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:57.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 0x7f750015bd40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f74f0001ee0 tx=0x7f74f00021f0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 shutdown_connections 2024-09-13T15:10:57.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f74dc066730 0x7f74dc068bf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f750015e9f0 0x7f75001456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f750015d310 0x7f75001f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 --2- 172.21.15.50:0/3034420158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750006aaa0 0x7f750015bd40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 >> 172.21.15.50:0/3034420158 conn(0x7f75000b0c40 msgr2=0x7f7500142520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 shutdown_connections 2024-09-13T15:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:57.821+0000 7f74ff200700 1 -- 172.21.15.50:0/3034420158 wait complete. 2024-09-13T15:10:57.826 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:57.848 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-09-13T15:10:56.079885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":240680,"kb_used_data":8124,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734040,"statfs":{"total":773094113280,"available":772847656960,"internally_reserved":0,"allocated":8318976,"data_stored":4356439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.124920"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:52.954301+0000","last_change":"2024-09-13T15:10:52.954301+0000","last_active":"2024-09-13T15:10:52.954301+0000","last_peered":"2024-09-13T15:10:52.954301+0000","last_clean":"2024-09-13T15:10:52.954301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:52.954301+0000","last_undegraded":"2024-09-13T15:10:52.954301+0000","last_fullsized":"2024-09-13T15:10:52.954301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:10:51.949113+0000","last_change":"2024-09-13T15:10:51.949113+0000","last_active":"2024-09-13T15:10:51.949113+0000","last_peered":"2024-09-13T15:10:51.949113+0000","last_clean":"2024-09-13T15:10:51.949113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:10:51.949113+0000","last_undegraded":"2024-09-13T15:10:51.949113+0000","last_fullsized":"2024-09-13T15:10:51.949113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T15:10:48.348300+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:48.348300+0000","last_peered":"2024-09-13T15:10:48.348300+0000","last_clean":"2024-09-13T15:10:48.348300+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:48.348300+0000","last_undegraded":"2024-09-13T15:10:48.348300+0000","last_fullsized":"2024-09-13T15:10:48.348300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28472,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343368,"statfs":{"total":96636764160,"available":96607608832,"internally_reserved":0,"allocated":1486848,"data_stored":987713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.159,"15min":1.1830000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6180000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.73099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5369999999999999,"5min":1.839,"15min":1.839},"last":1.081}]},{"osd":1,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.3009999999999999,"15min":1.359},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4059999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.198},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.212,"15min":1.258},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.577,"15min":1.577},"last":1.1619999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.329,"15min":1.391},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3260000000000001,"15min":1.363},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3999999999999999,"15min":1.4379999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.46,"15min":1.532},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.681,"5min":2.081,"15min":2.081},"last":1.2589999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.29,"15min":1.3700000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5580000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.3680000000000001,"15min":1.4370000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6180000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.109}]},{"osd":5,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5049999999999999,"15min":1.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.917,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.288}]},{"osd":6,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5129999999999999,"15min":1.6040000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.236},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.5669999999999999,"15min":1.6499999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7190000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.4239999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":396326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.157,"15min":1.1970000000000001},"min":{"1min":0.751,"5min":0.749,"15min":0.749},"max":{"1min":1.3979999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.8480000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3819999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1839999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.534,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.407},{"interface":"front","average":{"1min":1.159,"5min":1.2849999999999999,"15min":1.345},"min":{"1min":0.86899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.619,"5min":2.282,"15min":2.282},"last":2.145}]},{"osd":2,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2589999999999999,"15min":1.2949999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.5069999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.353,"15min":1.395},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.484,"5min":1.986,"15min":1.986},"last":1.7709999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2969999999999999,"15min":1.3180000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6140000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.232},{"interface":"front","average":{"1min":1.258,"5min":1.341,"15min":1.391},"min":{"1min":0.96099999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.6180000000000001,"5min":2.371,"15min":2.371},"last":2.3180000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.325,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4630000000000001,"5min":2.835,"15min":2.835},"last":1.9730000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.3180000000000001,"15min":1.381},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5800000000000001,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.88800000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6699999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.5389999999999999,"15min":1.605},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.74,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":2.0600000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.413,"15min":1.4450000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.538,"5min":2.444,"15min":2.444},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.5109999999999999,"15min":1.5509999999999999},"min":{"1min":0.92000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.7909999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.9199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":397345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2390000000000001,"15min":1.304},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.2729999999999999,"15min":1.3700000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2450000000000001,"15min":1.2829999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.488,"5min":1.976,"15min":1.976},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.224,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.587,"5min":2.665,"15min":2.665},"last":0.96299999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.236,"15min":1.27},"min":{"1min":0.79300000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.556,"5min":2.347,"15min":2.347},"last":1.2},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3320000000000001,"15min":1.3779999999999999},"min":{"1min":0.73899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6759999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.177}]},{"osd":3,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":0.86399999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.593,"5min":2.524,"15min":2.524},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4359999999999999,"15min":1.504},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":0.88300000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3959999999999999},"min":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6919999999999999,"5min":2.012,"15min":2.012},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.29,"5min":1.4239999999999999,"15min":1.494},"min":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7569999999999999,"5min":3.117,"15min":3.117},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.444,"15min":1.5429999999999999},"min":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.603,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4930000000000001,"15min":1.5880000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6479999999999999,"5min":2.411,"15min":2.411},"last":1.016}]},{"osd":7,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4790000000000001,"15min":1.5620000000000001},"min":{"1min":0.80800000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.671,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.579,"15min":1.681},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.694,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":0.94699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":397345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.139,"15min":1.167},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.597,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1830000000000001,"15min":1.2030000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.23,"15min":1.2569999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.651,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.2090000000000001,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.794,"15min":1.794},"last":1.234}]},{"osd":2,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.85699999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5269999999999999,"5min":1.621,"15min":1.621},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3320000000000001,"15min":1.347},"min":{"1min":1.0549999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.2569999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.244,"15min":1.2649999999999999},"min":{"1min":0.77500000000000002,"5min":0.754,"15min":0.754},"max":{"1min":1.498,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2989999999999999,"15min":1.341},"min":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.524,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.212}]},{"osd":5,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3480000000000001,"15min":1.3799999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.0219999999999998,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.155},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.375,"15min":1.399},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.9099999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.0960000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.268,"15min":1.304},"min":{"1min":0.77400000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7,"5min":2.214,"15min":2.214},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.4159999999999999,"15min":1.4490000000000001},"min":{"1min":0.89000000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.88800000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.95999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7390000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.139},{"interface":"front","average":{"1min":1.325,"5min":1.4490000000000001,"15min":1.496},"min":{"1min":0.98099999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.677,"5min":2.524,"15min":2.524},"last":1.109}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31988,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":888832,"data_stored":396326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0589999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.419,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0549999999999999,"15min":1.079},"min":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3959999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.395}]},{"osd":1,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.02,"15min":1.073},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9379999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.2130000000000001},"min":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.306,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.2030000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.133,"15min":1.2030000000000001},"min":{"1min":0.71599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.603,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.069},{"interface":"front","average":{"1min":1.085,"5min":1.286,"15min":1.3580000000000001},"min":{"1min":0.70299999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5069999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.8009999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.337,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7529999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.3859999999999999,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1669999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.2809999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4390000000000001,"15min":1.5129999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.802,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.51},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.581,"15min":1.6739999999999999},"min":{"1min":1.0660000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.55,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.71}]},{"osd":6,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4399999999999999,"15min":1.4970000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.605,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.5029999999999999,"15min":1.5669999999999999},"min":{"1min":0.90300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0800000000000001,"5min":3.786,"15min":3.786},"last":1.359}]},{"osd":7,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.6859999999999999,"15min":1.7829999999999999},"min":{"1min":1.1890000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7529999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.597},{"interface":"front","average":{"1min":1.47,"5min":1.5980000000000001,"15min":1.671},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.782,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.7410000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31988,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":892928,"data_stored":397345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.5,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":1.393,"15min":1.393},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.028,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.73699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4630000000000001,"5min":1.643,"15min":1.643},"last":0.999}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.54200000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":0.87},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.1559999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.069,"15min":1.113},"min":{"1min":0.78600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4319999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.081},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.302,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.194}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.343,"15min":1.3839999999999999},"min":{"1min":0.93700000000000006,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.494,"5min":2.657,"15min":2.657},"last":1.238},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.4490000000000001,"15min":1.5},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5569999999999999,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.3160000000000001},"min":{"1min":0.95999999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.456},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.385,"15min":1.395},"min":{"1min":1.0089999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.609,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.125}]},{"osd":6,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.446,"15min":1.486},"min":{"1min":0.95499999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0459999999999998,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.4359999999999999,"15min":1.468},"min":{"1min":1.0369999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.849,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.7170000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5589999999999999},"min":{"1min":1.1359999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.1480000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5580000000000001},"min":{"1min":1.2310000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7689999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.627}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31988,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":892928,"data_stored":397345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88300000000000001,"15min":0.86099999999999999},"min":{"1min":0.50900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99099999999999999,"15min":1.0109999999999999},"min":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.722,"15min":1.722},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.875,"15min":0.89200000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.321,"5min":1.502,"15min":1.502},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.042,"15min":1.0529999999999999},"min":{"1min":0.71699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5780000000000001,"5min":1.764,"15min":1.764},"last":1.081},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0900000000000001,"15min":1.143},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.242,"5min":3.254,"15min":3.254},"last":1.2430000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1759999999999999,"15min":1.1930000000000001},"min":{"1min":0.877,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5229999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3540000000000001,"15min":1.3759999999999999},"min":{"1min":1.0660000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.762,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.1299999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.377,"15min":1.4370000000000001},"min":{"1min":0.91200000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6639999999999999,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.325,"15min":1.367},"min":{"1min":0.92000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5960000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.319}]},{"osd":6,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4790000000000001,"15min":1.5169999999999999},"min":{"1min":0.98599999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.9410000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.389},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4950000000000001,"15min":1.5669999999999999},"min":{"1min":0.92100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7270000000000001,"5min":4.843,"15min":4.843},"last":1.5249999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.6040000000000001,"15min":1.7030000000000001},"min":{"1min":1.113,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.6399999999999999,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.605},{"interface":"front","average":{"1min":1.335,"5min":1.45,"15min":1.5},"min":{"1min":0.93700000000000006,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.768,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.2190000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1482752,"data_stored":986694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91800000000000004,"15min":0.90400000000000003},"min":{"1min":0.56599999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.3959999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2210000000000001,"15min":1.3089999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.371,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.1899999999999999,"15min":1.3200000000000001},"min":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2649999999999999,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.119,"15min":1.159},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4430000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3029999999999999,"15min":1.3049999999999999},"min":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.724,"5min":2.157,"15min":2.157},"last":1.2450000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.95499999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.8260000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.661,"5min":1.827,"15min":1.827},"last":1.133}]},{"osd":5,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.345,"15min":1.3859999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.54,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3700000000000001,"15min":1.3919999999999999},"min":{"1min":0.98099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.7330000000000001,"5min":2.367,"15min":2.367},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.472,"15min":1.488},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.8690000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.478},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.752,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.294}]},{"osd":7,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.49,"15min":1.538},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8879999999999999,"5min":3.302,"15min":3.302},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.4399999999999999,"15min":1.47},"min":{"1min":1.0409999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.788,"5min":2.266,"15min":2.266},"last":1.1040000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:57.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:10:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 Processor -- start 2024-09-13T15:10:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 -- start start 2024-09-13T15:10:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d0c15cfd0 0x7f6d0c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6d0c0d0cc0 0x7f6d0c0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c0b2e40 con 0x7f6d0c0d1950 2024-09-13T15:10:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c0cee50 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d12a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c0d1dc0 con 0x7f6d0c0d0cc0 2024-09-13T15:10:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d0be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d0c15cfd0 0x7f6d0c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d0be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d0c15cfd0 0x7f6d0c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58710/0 (socket says 172.21.15.50:58710) 2024-09-13T15:10:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.069+0000 7f6d0be00700 1 -- 172.21.15.50:0/4192533410 learned_addr learned my addr 172.21.15.50:0/4192533410 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0b400700 1 --2- 172.21.15.50:0/4192533410 >> v2:172.21.15.181:3300/0 conn(0x7f6d0c0d0cc0 0x7f6d0c0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0be00700 1 -- 172.21.15.50:0/4192533410 >> v2:172.21.15.181:3300/0 conn(0x7f6d0c0d0cc0 msgr2=0x7f6d0c0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0be00700 1 --2- 172.21.15.50:0/4192533410 >> v2:172.21.15.181:3300/0 conn(0x7f6d0c0d0cc0 0x7f6d0c0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0aa00700 1 -- 172.21.15.50:0/4192533410 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637452708 0 0) 0x7f6d0c0b2e40 con 0x7f6d0c0d1950 2024-09-13T15:10:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0be00700 1 -- 172.21.15.50:0/4192533410 >> v1:172.21.15.181:6789/0 conn(0x7f6d0c0d1950 legacy=0x7f6d0c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0be00700 1 -- 172.21.15.50:0/4192533410 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0ceb70 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0be00700 1 --2- 172.21.15.50:0/4192533410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0ce500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0b8f00 tx=0x7f6cfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5e2c1a21cd72b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0aa00700 1 -- 172.21.15.50:0/4192533410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc011830 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0aa00700 1 -- 172.21.15.50:0/4192533410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc011990 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d0aa00700 1 -- 172.21.15.50:0/4192533410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc011d40 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 -- 172.21.15.50:0/4192533410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 msgr2=0x7f6d0c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 --2- 172.21.15.50:0/4192533410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0ce500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0b8f00 tx=0x7f6cfc009c20 comp rx=0 tx=0).stop 2024-09-13T15:10:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 -- 172.21.15.50:0/4192533410 shutdown_connections 2024-09-13T15:10:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 --2- 172.21.15.50:0/4192533410 >> v2:172.21.15.181:3300/0 conn(0x7f6d0c0d0cc0 0x7f6d0c0d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 --2- 172.21.15.50:0/4192533410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0ce500 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 -- 172.21.15.50:0/4192533410 >> 172.21.15.50:0/4192533410 conn(0x7f6d0c09c0e0 msgr2=0x7f6d0c0d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 -- 172.21.15.50:0/4192533410 shutdown_connections 2024-09-13T15:10:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.073+0000 7f6d12a00700 1 -- 172.21.15.50:0/4192533410 wait complete. 2024-09-13T15:10:58.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 Processor -- start 2024-09-13T15:10:58.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 -- start start 2024-09-13T15:10:58.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d0c0d0cc0 0x7f6d0c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d0c0d1950 0x7f6d0c1f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c1605d0 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c160010 con 0x7f6d0c0d0cc0 2024-09-13T15:10:58.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d12a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c1602f0 con 0x7f6d0c0d1950 2024-09-13T15:10:58.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d10a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d10a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0b7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58726/0 (socket says 172.21.15.50:58726) 2024-09-13T15:10:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d10a00700 1 -- 172.21.15.50:0/3886248288 learned_addr learned my addr 172.21.15.50:0/3886248288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d0be00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d0c0d0cc0 0x7f6d0c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.077+0000 7f6d0b400700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d0c0d1950 0x7f6d0c1f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d10a00700 1 -- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d0c0d1950 msgr2=0x7f6d0c1f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d10a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d0c0d1950 0x7f6d0c1f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d10a00700 1 -- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d0c0d0cc0 msgr2=0x7f6d0c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d10a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d0c0d0cc0 0x7f6d0c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d10a00700 1 -- 172.21.15.50:0/3886248288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc009570 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d10a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0b7a40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400cc10 tx=0x7f6d0400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04003e50 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400a690 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c15d810 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400aa20 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c1f3620 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.081+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c0d1410 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.085+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d0400ab80 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.085+0000 7f6d03e00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cec066730 0x7f6cec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.085+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6d04083bc0 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.085+0000 7f6d0be00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cec066730 0x7f6cec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.089+0000 7f6d0be00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cec066730 0x7f6cec068bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000c00 tx=0x7f6cfc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.093+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d04050de0 con 0x7f6d0c15cfd0 2024-09-13T15:10:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.277+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d0c0b4e80 con 0x7f6cec066730 2024-09-13T15:10:58.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.293+0000 7f6d03e00700 1 -- 172.21.15.50:0/3886248288 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287139 (secure 0 0 0) 0x7f6d0c0b4e80 con 0x7f6cec066730 2024-09-13T15:10:58.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cec066730 msgr2=0x7f6cec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cec066730 0x7f6cec068bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000c00 tx=0x7f6cfc008030 comp rx=0 tx=0).stop 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 msgr2=0x7f6d0c0b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0b7a40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400cc10 tx=0x7f6d0400cf20 comp rx=0 tx=0).stop 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 shutdown_connections 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6cec066730 0x7f6cec068bf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c15cfd0 0x7f6d0c0b7a40 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d0c0d1950 0x7f6d0c1f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 --2- 172.21.15.50:0/3886248288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d0c0d0cc0 0x7f6d0c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 >> 172.21.15.50:0/3886248288 conn(0x7f6d0c09c0e0 msgr2=0x7f6d0c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 shutdown_connections 2024-09-13T15:10:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.301+0000 7f6d12a00700 1 -- 172.21.15.50:0/3886248288 wait complete. 2024-09-13T15:10:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:10:58.327 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-13T15:10:58.080438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245272,"kb_used_data":8572,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754729448,"statfs":{"total":773094113280,"available":772842954752,"internally_reserved":0,"allocated":8777728,"data_stored":4572739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001835"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872578+0000","last_change":"2024-09-13T15:10:53.494777+0000","last_active":"2024-09-13T15:10:54.872578+0000","last_peered":"2024-09-13T15:10:54.872578+0000","last_clean":"2024-09-13T15:10:54.872578+0000","last_became_active":"2024-09-13T15:10:53.490504+0000","last_became_peered":"2024-09-13T15:10:53.490504+0000","last_unstale":"2024-09-13T15:10:54.872578+0000","last_undegraded":"2024-09-13T15:10:54.872578+0000","last_fullsized":"2024-09-13T15:10:54.872578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:26.796030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743570+0000","last_change":"2024-09-13T15:10:53.503228+0000","last_active":"2024-09-13T15:10:54.743570+0000","last_peered":"2024-09-13T15:10:54.743570+0000","last_clean":"2024-09-13T15:10:54.743570+0000","last_became_active":"2024-09-13T15:10:53.502998+0000","last_became_peered":"2024-09-13T15:10:53.502998+0000","last_unstale":"2024-09-13T15:10:54.743570+0000","last_undegraded":"2024-09-13T15:10:54.743570+0000","last_fullsized":"2024-09-13T15:10:54.743570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:38.734576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.875499+0000","last_change":"2024-09-13T15:10:53.485492+0000","last_active":"2024-09-13T15:10:54.875499+0000","last_peered":"2024-09-13T15:10:54.875499+0000","last_clean":"2024-09-13T15:10:54.875499+0000","last_became_active":"2024-09-13T15:10:53.485059+0000","last_became_peered":"2024-09-13T15:10:53.485059+0000","last_unstale":"2024-09-13T15:10:54.875499+0000","last_undegraded":"2024-09-13T15:10:54.875499+0000","last_fullsized":"2024-09-13T15:10:54.875499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:58.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477708+0000","last_change":"2024-09-13T15:10:53.481494+0000","last_active":"2024-09-13T15:10:54.477708+0000","last_peered":"2024-09-13T15:10:54.477708+0000","last_clean":"2024-09-13T15:10:54.477708+0000","last_became_active":"2024-09-13T15:10:53.481223+0000","last_became_peered":"2024-09-13T15:10:53.481223+0000","last_unstale":"2024-09-13T15:10:54.477708+0000","last_undegraded":"2024-09-13T15:10:54.477708+0000","last_fullsized":"2024-09-13T15:10:54.477708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:05.349953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477518+0000","last_change":"2024-09-13T15:10:53.502279+0000","last_active":"2024-09-13T15:10:54.477518+0000","last_peered":"2024-09-13T15:10:54.477518+0000","last_clean":"2024-09-13T15:10:54.477518+0000","last_became_active":"2024-09-13T15:10:53.501967+0000","last_became_peered":"2024-09-13T15:10:53.501967+0000","last_unstale":"2024-09-13T15:10:54.477518+0000","last_undegraded":"2024-09-13T15:10:54.477518+0000","last_fullsized":"2024-09-13T15:10:54.477518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:44.049271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874551+0000","last_change":"2024-09-13T15:10:53.489273+0000","last_active":"2024-09-13T15:10:54.874551+0000","last_peered":"2024-09-13T15:10:54.874551+0000","last_clean":"2024-09-13T15:10:54.874551+0000","last_became_active":"2024-09-13T15:10:53.488921+0000","last_became_peered":"2024-09-13T15:10:53.488921+0000","last_unstale":"2024-09-13T15:10:54.874551+0000","last_undegraded":"2024-09-13T15:10:54.874551+0000","last_fullsized":"2024-09-13T15:10:54.874551+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:42.596051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872533+0000","last_change":"2024-09-13T15:10:53.507527+0000","last_active":"2024-09-13T15:10:54.872533+0000","last_peered":"2024-09-13T15:10:54.872533+0000","last_clean":"2024-09-13T15:10:54.872533+0000","last_became_active":"2024-09-13T15:10:53.507259+0000","last_became_peered":"2024-09-13T15:10:53.507259+0000","last_unstale":"2024-09-13T15:10:54.872533+0000","last_undegraded":"2024-09-13T15:10:54.872533+0000","last_fullsized":"2024-09-13T15:10:54.872533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:12.808732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477031+0000","last_change":"2024-09-13T15:10:53.503257+0000","last_active":"2024-09-13T15:10:54.477031+0000","last_peered":"2024-09-13T15:10:54.477031+0000","last_clean":"2024-09-13T15:10:54.477031+0000","last_became_active":"2024-09-13T15:10:53.503042+0000","last_became_peered":"2024-09-13T15:10:53.503042+0000","last_unstale":"2024-09-13T15:10:54.477031+0000","last_undegraded":"2024-09-13T15:10:54.477031+0000","last_fullsized":"2024-09-13T15:10:54.477031+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:00.004246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.478309+0000","last_change":"2024-09-13T15:10:53.495483+0000","last_active":"2024-09-13T15:10:54.478309+0000","last_peered":"2024-09-13T15:10:54.478309+0000","last_clean":"2024-09-13T15:10:54.478309+0000","last_became_active":"2024-09-13T15:10:53.495194+0000","last_became_peered":"2024-09-13T15:10:53.495194+0000","last_unstale":"2024-09-13T15:10:54.478309+0000","last_undegraded":"2024-09-13T15:10:54.478309+0000","last_fullsized":"2024-09-13T15:10:54.478309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:48.858119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477587+0000","last_change":"2024-09-13T15:10:53.496716+0000","last_active":"2024-09-13T15:10:54.477587+0000","last_peered":"2024-09-13T15:10:54.477587+0000","last_clean":"2024-09-13T15:10:54.477587+0000","last_became_active":"2024-09-13T15:10:53.496437+0000","last_became_peered":"2024-09-13T15:10:53.496437+0000","last_unstale":"2024-09-13T15:10:54.477587+0000","last_undegraded":"2024-09-13T15:10:54.477587+0000","last_fullsized":"2024-09-13T15:10:54.477587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:05.423367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743104+0000","last_change":"2024-09-13T15:10:53.507548+0000","last_active":"2024-09-13T15:10:54.743104+0000","last_peered":"2024-09-13T15:10:54.743104+0000","last_clean":"2024-09-13T15:10:54.743104+0000","last_became_active":"2024-09-13T15:10:53.506962+0000","last_became_peered":"2024-09-13T15:10:53.506962+0000","last_unstale":"2024-09-13T15:10:54.743104+0000","last_undegraded":"2024-09-13T15:10:54.743104+0000","last_fullsized":"2024-09-13T15:10:54.743104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:15.509696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477784+0000","last_change":"2024-09-13T15:10:53.478841+0000","last_active":"2024-09-13T15:10:54.477784+0000","last_peered":"2024-09-13T15:10:54.477784+0000","last_clean":"2024-09-13T15:10:54.477784+0000","last_became_active":"2024-09-13T15:10:53.477945+0000","last_became_peered":"2024-09-13T15:10:53.477945+0000","last_unstale":"2024-09-13T15:10:54.477784+0000","last_undegraded":"2024-09-13T15:10:54.477784+0000","last_fullsized":"2024-09-13T15:10:54.477784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:50.939833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477690+0000","last_change":"2024-09-13T15:10:53.505746+0000","last_active":"2024-09-13T15:10:54.477690+0000","last_peered":"2024-09-13T15:10:54.477690+0000","last_clean":"2024-09-13T15:10:54.477690+0000","last_became_active":"2024-09-13T15:10:53.505422+0000","last_became_peered":"2024-09-13T15:10:53.505422+0000","last_unstale":"2024-09-13T15:10:54.477690+0000","last_undegraded":"2024-09-13T15:10:54.477690+0000","last_fullsized":"2024-09-13T15:10:54.477690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:05.608579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874437+0000","last_change":"2024-09-13T15:10:53.489142+0000","last_active":"2024-09-13T15:10:54.874437+0000","last_peered":"2024-09-13T15:10:54.874437+0000","last_clean":"2024-09-13T15:10:54.874437+0000","last_became_active":"2024-09-13T15:10:53.488743+0000","last_became_peered":"2024-09-13T15:10:53.488743+0000","last_unstale":"2024-09-13T15:10:54.874437+0000","last_undegraded":"2024-09-13T15:10:54.874437+0000","last_fullsized":"2024-09-13T15:10:54.874437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:29.240139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742544+0000","last_change":"2024-09-13T15:10:53.480071+0000","last_active":"2024-09-13T15:10:54.742544+0000","last_peered":"2024-09-13T15:10:54.742544+0000","last_clean":"2024-09-13T15:10:54.742544+0000","last_became_active":"2024-09-13T15:10:53.479810+0000","last_became_peered":"2024-09-13T15:10:53.479810+0000","last_unstale":"2024-09-13T15:10:54.742544+0000","last_undegraded":"2024-09-13T15:10:54.742544+0000","last_fullsized":"2024-09-13T15:10:54.742544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:48.262746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.871864+0000","last_change":"2024-09-13T15:10:53.492995+0000","last_active":"2024-09-13T15:10:54.871864+0000","last_peered":"2024-09-13T15:10:54.871864+0000","last_clean":"2024-09-13T15:10:54.871864+0000","last_became_active":"2024-09-13T15:10:53.492741+0000","last_became_peered":"2024-09-13T15:10:53.492741+0000","last_unstale":"2024-09-13T15:10:54.871864+0000","last_undegraded":"2024-09-13T15:10:54.871864+0000","last_fullsized":"2024-09-13T15:10:54.871864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:05.349953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477924+0000","last_change":"2024-09-13T15:10:53.508415+0000","last_active":"2024-09-13T15:10:54.477924+0000","last_peered":"2024-09-13T15:10:54.477924+0000","last_clean":"2024-09-13T15:10:54.477924+0000","last_became_active":"2024-09-13T15:10:53.508189+0000","last_became_peered":"2024-09-13T15:10:53.508189+0000","last_unstale":"2024-09-13T15:10:54.477924+0000","last_undegraded":"2024-09-13T15:10:54.477924+0000","last_fullsized":"2024-09-13T15:10:54.477924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:50.781772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.875432+0000","last_change":"2024-09-13T15:10:53.484967+0000","last_active":"2024-09-13T15:10:54.875432+0000","last_peered":"2024-09-13T15:10:54.875432+0000","last_clean":"2024-09-13T15:10:54.875432+0000","last_became_active":"2024-09-13T15:10:53.484041+0000","last_became_peered":"2024-09-13T15:10:53.484041+0000","last_unstale":"2024-09-13T15:10:54.875432+0000","last_undegraded":"2024-09-13T15:10:54.875432+0000","last_fullsized":"2024-09-13T15:10:54.875432+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:49.012405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874814+0000","last_change":"2024-09-13T15:10:53.508528+0000","last_active":"2024-09-13T15:10:54.874814+0000","last_peered":"2024-09-13T15:10:54.874814+0000","last_clean":"2024-09-13T15:10:54.874814+0000","last_became_active":"2024-09-13T15:10:53.508288+0000","last_became_peered":"2024-09-13T15:10:53.508288+0000","last_unstale":"2024-09-13T15:10:54.874814+0000","last_undegraded":"2024-09-13T15:10:54.874814+0000","last_fullsized":"2024-09-13T15:10:54.874814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:20.497760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477647+0000","last_change":"2024-09-13T15:10:53.512120+0000","last_active":"2024-09-13T15:10:54.477647+0000","last_peered":"2024-09-13T15:10:54.477647+0000","last_clean":"2024-09-13T15:10:54.477647+0000","last_became_active":"2024-09-13T15:10:53.510455+0000","last_became_peered":"2024-09-13T15:10:53.510455+0000","last_unstale":"2024-09-13T15:10:54.477647+0000","last_undegraded":"2024-09-13T15:10:54.477647+0000","last_fullsized":"2024-09-13T15:10:54.477647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:29.979365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477264+0000","last_change":"2024-09-13T15:10:53.483304+0000","last_active":"2024-09-13T15:10:54.477264+0000","last_peered":"2024-09-13T15:10:54.477264+0000","last_clean":"2024-09-13T15:10:54.477264+0000","last_became_active":"2024-09-13T15:10:53.482618+0000","last_became_peered":"2024-09-13T15:10:53.482618+0000","last_unstale":"2024-09-13T15:10:54.477264+0000","last_undegraded":"2024-09-13T15:10:54.477264+0000","last_fullsized":"2024-09-13T15:10:54.477264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:58.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477340+0000","last_change":"2024-09-13T15:10:53.506817+0000","last_active":"2024-09-13T15:10:54.477340+0000","last_peered":"2024-09-13T15:10:54.477340+0000","last_clean":"2024-09-13T15:10:54.477340+0000","last_became_active":"2024-09-13T15:10:53.506530+0000","last_became_peered":"2024-09-13T15:10:53.506530+0000","last_unstale":"2024-09-13T15:10:54.477340+0000","last_undegraded":"2024-09-13T15:10:54.477340+0000","last_fullsized":"2024-09-13T15:10:54.477340+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:03.827760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.476809+0000","last_change":"2024-09-13T15:10:53.488368+0000","last_active":"2024-09-13T15:10:54.476809+0000","last_peered":"2024-09-13T15:10:54.476809+0000","last_clean":"2024-09-13T15:10:54.476809+0000","last_became_active":"2024-09-13T15:10:53.487125+0000","last_became_peered":"2024-09-13T15:10:53.487125+0000","last_unstale":"2024-09-13T15:10:54.476809+0000","last_undegraded":"2024-09-13T15:10:54.476809+0000","last_fullsized":"2024-09-13T15:10:54.476809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:16.185379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742597+0000","last_change":"2024-09-13T15:10:53.494160+0000","last_active":"2024-09-13T15:10:54.742597+0000","last_peered":"2024-09-13T15:10:54.742597+0000","last_clean":"2024-09-13T15:10:54.742597+0000","last_became_active":"2024-09-13T15:10:53.493116+0000","last_became_peered":"2024-09-13T15:10:53.493116+0000","last_unstale":"2024-09-13T15:10:54.742597+0000","last_undegraded":"2024-09-13T15:10:54.742597+0000","last_fullsized":"2024-09-13T15:10:54.742597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:13.869857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743682+0000","last_change":"2024-09-13T15:10:53.493393+0000","last_active":"2024-09-13T15:10:54.743682+0000","last_peered":"2024-09-13T15:10:54.743682+0000","last_clean":"2024-09-13T15:10:54.743682+0000","last_became_active":"2024-09-13T15:10:53.493131+0000","last_became_peered":"2024-09-13T15:10:53.493131+0000","last_unstale":"2024-09-13T15:10:54.743682+0000","last_undegraded":"2024-09-13T15:10:54.743682+0000","last_fullsized":"2024-09-13T15:10:54.743682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:22:51.795826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477802+0000","last_change":"2024-09-13T15:10:53.475574+0000","last_active":"2024-09-13T15:10:54.477802+0000","last_peered":"2024-09-13T15:10:54.477802+0000","last_clean":"2024-09-13T15:10:54.477802+0000","last_became_active":"2024-09-13T15:10:53.475180+0000","last_became_peered":"2024-09-13T15:10:53.475180+0000","last_unstale":"2024-09-13T15:10:54.477802+0000","last_undegraded":"2024-09-13T15:10:54.477802+0000","last_fullsized":"2024-09-13T15:10:54.477802+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:46.359522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872261+0000","last_change":"2024-09-13T15:10:53.493911+0000","last_active":"2024-09-13T15:10:54.872261+0000","last_peered":"2024-09-13T15:10:54.872261+0000","last_clean":"2024-09-13T15:10:54.872261+0000","last_became_active":"2024-09-13T15:10:53.493641+0000","last_became_peered":"2024-09-13T15:10:53.493641+0000","last_unstale":"2024-09-13T15:10:54.872261+0000","last_undegraded":"2024-09-13T15:10:54.872261+0000","last_fullsized":"2024-09-13T15:10:54.872261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:46.359522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477774+0000","last_change":"2024-09-13T15:10:53.504893+0000","last_active":"2024-09-13T15:10:54.477774+0000","last_peered":"2024-09-13T15:10:54.477774+0000","last_clean":"2024-09-13T15:10:54.477774+0000","last_became_active":"2024-09-13T15:10:53.504669+0000","last_became_peered":"2024-09-13T15:10:53.504669+0000","last_unstale":"2024-09-13T15:10:54.477774+0000","last_undegraded":"2024-09-13T15:10:54.477774+0000","last_fullsized":"2024-09-13T15:10:54.477774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:58.832359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742974+0000","last_change":"2024-09-13T15:10:53.493652+0000","last_active":"2024-09-13T15:10:54.742974+0000","last_peered":"2024-09-13T15:10:54.742974+0000","last_clean":"2024-09-13T15:10:54.742974+0000","last_became_active":"2024-09-13T15:10:53.493340+0000","last_became_peered":"2024-09-13T15:10:53.493340+0000","last_unstale":"2024-09-13T15:10:54.742974+0000","last_undegraded":"2024-09-13T15:10:54.742974+0000","last_fullsized":"2024-09-13T15:10:54.742974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:20.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.871776+0000","last_change":"2024-09-13T15:10:53.485291+0000","last_active":"2024-09-13T15:10:54.871776+0000","last_peered":"2024-09-13T15:10:54.871776+0000","last_clean":"2024-09-13T15:10:54.871776+0000","last_became_active":"2024-09-13T15:10:53.485007+0000","last_became_peered":"2024-09-13T15:10:53.485007+0000","last_unstale":"2024-09-13T15:10:54.871776+0000","last_undegraded":"2024-09-13T15:10:54.871776+0000","last_fullsized":"2024-09-13T15:10:54.871776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:24.919017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873883+0000","last_change":"2024-09-13T15:10:53.496810+0000","last_active":"2024-09-13T15:10:54.873883+0000","last_peered":"2024-09-13T15:10:54.873883+0000","last_clean":"2024-09-13T15:10:54.873883+0000","last_became_active":"2024-09-13T15:10:53.496379+0000","last_became_peered":"2024-09-13T15:10:53.496379+0000","last_unstale":"2024-09-13T15:10:54.873883+0000","last_undegraded":"2024-09-13T15:10:54.873883+0000","last_fullsized":"2024-09-13T15:10:54.873883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:48.858119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.871902+0000","last_change":"2024-09-13T15:10:53.495169+0000","last_active":"2024-09-13T15:10:54.871902+0000","last_peered":"2024-09-13T15:10:54.871902+0000","last_clean":"2024-09-13T15:10:54.871902+0000","last_became_active":"2024-09-13T15:10:53.490362+0000","last_became_peered":"2024-09-13T15:10:53.490362+0000","last_unstale":"2024-09-13T15:10:54.871902+0000","last_undegraded":"2024-09-13T15:10:54.871902+0000","last_fullsized":"2024-09-13T15:10:54.871902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:05.423367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873591+0000","last_change":"2024-09-13T15:10:53.486923+0000","last_active":"2024-09-13T15:10:54.873591+0000","last_peered":"2024-09-13T15:10:54.873591+0000","last_clean":"2024-09-13T15:10:54.873591+0000","last_became_active":"2024-09-13T15:10:53.486651+0000","last_became_peered":"2024-09-13T15:10:53.486651+0000","last_unstale":"2024-09-13T15:10:54.873591+0000","last_undegraded":"2024-09-13T15:10:54.873591+0000","last_fullsized":"2024-09-13T15:10:54.873591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:23.491576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477985+0000","last_change":"2024-09-13T15:10:52.993503+0000","last_active":"2024-09-13T15:10:54.477985+0000","last_peered":"2024-09-13T15:10:54.477985+0000","last_clean":"2024-09-13T15:10:54.477985+0000","last_became_active":"2024-09-13T15:10:52.991567+0000","last_became_peered":"2024-09-13T15:10:52.991567+0000","last_unstale":"2024-09-13T15:10:54.477985+0000","last_undegraded":"2024-09-13T15:10:54.477985+0000","last_fullsized":"2024-09-13T15:10:54.477985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:01.700946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742654+0000","last_change":"2024-09-13T15:10:53.475678+0000","last_active":"2024-09-13T15:10:54.742654+0000","last_peered":"2024-09-13T15:10:54.742654+0000","last_clean":"2024-09-13T15:10:54.742654+0000","last_became_active":"2024-09-13T15:10:53.475409+0000","last_became_peered":"2024-09-13T15:10:53.475409+0000","last_unstale":"2024-09-13T15:10:54.742654+0000","last_undegraded":"2024-09-13T15:10:54.742654+0000","last_fullsized":"2024-09-13T15:10:54.742654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:41.667987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872524+0000","last_change":"2024-09-13T15:10:52.992545+0000","last_active":"2024-09-13T15:10:54.872524+0000","last_peered":"2024-09-13T15:10:54.872524+0000","last_clean":"2024-09-13T15:10:54.872524+0000","last_became_active":"2024-09-13T15:10:52.992062+0000","last_became_peered":"2024-09-13T15:10:52.992062+0000","last_unstale":"2024-09-13T15:10:54.872524+0000","last_undegraded":"2024-09-13T15:10:54.872524+0000","last_fullsized":"2024-09-13T15:10:54.872524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:59.606213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477046+0000","last_change":"2024-09-13T15:10:53.483225+0000","last_active":"2024-09-13T15:10:54.477046+0000","last_peered":"2024-09-13T15:10:54.477046+0000","last_clean":"2024-09-13T15:10:54.477046+0000","last_became_active":"2024-09-13T15:10:53.482933+0000","last_became_peered":"2024-09-13T15:10:53.482933+0000","last_unstale":"2024-09-13T15:10:54.477046+0000","last_undegraded":"2024-09-13T15:10:54.477046+0000","last_fullsized":"2024-09-13T15:10:54.477046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:29.710223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872412+0000","last_change":"2024-09-13T15:10:52.986879+0000","last_active":"2024-09-13T15:10:54.872412+0000","last_peered":"2024-09-13T15:10:54.872412+0000","last_clean":"2024-09-13T15:10:54.872412+0000","last_became_active":"2024-09-13T15:10:52.986608+0000","last_became_peered":"2024-09-13T15:10:52.986608+0000","last_unstale":"2024-09-13T15:10:54.872412+0000","last_undegraded":"2024-09-13T15:10:54.872412+0000","last_fullsized":"2024-09-13T15:10:54.872412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:25.355135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477191+0000","last_change":"2024-09-13T15:10:53.483108+0000","last_active":"2024-09-13T15:10:54.477191+0000","last_peered":"2024-09-13T15:10:54.477191+0000","last_clean":"2024-09-13T15:10:54.477191+0000","last_became_active":"2024-09-13T15:10:53.482328+0000","last_became_peered":"2024-09-13T15:10:53.482328+0000","last_unstale":"2024-09-13T15:10:54.477191+0000","last_undegraded":"2024-09-13T15:10:54.477191+0000","last_fullsized":"2024-09-13T15:10:54.477191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:53.210463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873067+0000","last_change":"2024-09-13T15:10:52.991197+0000","last_active":"2024-09-13T15:10:54.873067+0000","last_peered":"2024-09-13T15:10:54.873067+0000","last_clean":"2024-09-13T15:10:54.873067+0000","last_became_active":"2024-09-13T15:10:52.990803+0000","last_became_peered":"2024-09-13T15:10:52.990803+0000","last_unstale":"2024-09-13T15:10:54.873067+0000","last_undegraded":"2024-09-13T15:10:54.873067+0000","last_fullsized":"2024-09-13T15:10:54.873067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:03.483408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743211+0000","last_change":"2024-09-13T15:10:53.502020+0000","last_active":"2024-09-13T15:10:54.743211+0000","last_peered":"2024-09-13T15:10:54.743211+0000","last_clean":"2024-09-13T15:10:54.743211+0000","last_became_active":"2024-09-13T15:10:53.501734+0000","last_became_peered":"2024-09-13T15:10:53.501734+0000","last_unstale":"2024-09-13T15:10:54.743211+0000","last_undegraded":"2024-09-13T15:10:54.743211+0000","last_fullsized":"2024-09-13T15:10:54.743211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:48.221378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477398+0000","last_change":"2024-09-13T15:10:52.987783+0000","last_active":"2024-09-13T15:10:54.477398+0000","last_peered":"2024-09-13T15:10:54.477398+0000","last_clean":"2024-09-13T15:10:54.477398+0000","last_became_active":"2024-09-13T15:10:52.987522+0000","last_became_peered":"2024-09-13T15:10:52.987522+0000","last_unstale":"2024-09-13T15:10:54.477398+0000","last_undegraded":"2024-09-13T15:10:54.477398+0000","last_fullsized":"2024-09-13T15:10:54.477398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:01.857205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743546+0000","last_change":"2024-09-13T15:10:53.498905+0000","last_active":"2024-09-13T15:10:54.743546+0000","last_peered":"2024-09-13T15:10:54.743546+0000","last_clean":"2024-09-13T15:10:54.743546+0000","last_became_active":"2024-09-13T15:10:53.498544+0000","last_became_peered":"2024-09-13T15:10:53.498544+0000","last_unstale":"2024-09-13T15:10:54.743546+0000","last_undegraded":"2024-09-13T15:10:54.743546+0000","last_fullsized":"2024-09-13T15:10:54.743546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:31.662455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477402+0000","last_change":"2024-09-13T15:10:52.972077+0000","last_active":"2024-09-13T15:10:54.477402+0000","last_peered":"2024-09-13T15:10:54.477402+0000","last_clean":"2024-09-13T15:10:54.477402+0000","last_became_active":"2024-09-13T15:10:52.971707+0000","last_became_peered":"2024-09-13T15:10:52.971707+0000","last_unstale":"2024-09-13T15:10:54.477402+0000","last_undegraded":"2024-09-13T15:10:54.477402+0000","last_fullsized":"2024-09-13T15:10:54.477402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:59.606213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.478205+0000","last_change":"2024-09-13T15:10:53.486255+0000","last_active":"2024-09-13T15:10:54.478205+0000","last_peered":"2024-09-13T15:10:54.478205+0000","last_clean":"2024-09-13T15:10:54.478205+0000","last_became_active":"2024-09-13T15:10:53.485238+0000","last_became_peered":"2024-09-13T15:10:53.485238+0000","last_unstale":"2024-09-13T15:10:54.478205+0000","last_undegraded":"2024-09-13T15:10:54.478205+0000","last_fullsized":"2024-09-13T15:10:54.478205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:49.012405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742648+0000","last_change":"2024-09-13T15:10:52.981564+0000","last_active":"2024-09-13T15:10:54.742648+0000","last_peered":"2024-09-13T15:10:54.742648+0000","last_clean":"2024-09-13T15:10:54.742648+0000","last_became_active":"2024-09-13T15:10:52.981289+0000","last_became_peered":"2024-09-13T15:10:52.981289+0000","last_unstale":"2024-09-13T15:10:54.742648+0000","last_undegraded":"2024-09-13T15:10:54.742648+0000","last_fullsized":"2024-09-13T15:10:54.742648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:13.333546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873247+0000","last_change":"2024-09-13T15:10:53.507377+0000","last_active":"2024-09-13T15:10:54.873247+0000","last_peered":"2024-09-13T15:10:54.873247+0000","last_clean":"2024-09-13T15:10:54.873247+0000","last_became_active":"2024-09-13T15:10:53.507025+0000","last_became_peered":"2024-09-13T15:10:53.507025+0000","last_unstale":"2024-09-13T15:10:54.873247+0000","last_undegraded":"2024-09-13T15:10:54.873247+0000","last_fullsized":"2024-09-13T15:10:54.873247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.238381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477144+0000","last_change":"2024-09-13T15:10:52.987736+0000","last_active":"2024-09-13T15:10:54.477144+0000","last_peered":"2024-09-13T15:10:54.477144+0000","last_clean":"2024-09-13T15:10:54.477144+0000","last_became_active":"2024-09-13T15:10:52.987457+0000","last_became_peered":"2024-09-13T15:10:52.987457+0000","last_unstale":"2024-09-13T15:10:54.477144+0000","last_undegraded":"2024-09-13T15:10:54.477144+0000","last_fullsized":"2024-09-13T15:10:54.477144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:27.391548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742618+0000","last_change":"2024-09-13T15:10:53.481788+0000","last_active":"2024-09-13T15:10:54.742618+0000","last_peered":"2024-09-13T15:10:54.742618+0000","last_clean":"2024-09-13T15:10:54.742618+0000","last_became_active":"2024-09-13T15:10:53.481020+0000","last_became_peered":"2024-09-13T15:10:53.481020+0000","last_unstale":"2024-09-13T15:10:54.742618+0000","last_undegraded":"2024-09-13T15:10:54.742618+0000","last_fullsized":"2024-09-13T15:10:54.742618+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:20.497760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873018+0000","last_change":"2024-09-13T15:10:52.992236+0000","last_active":"2024-09-13T15:10:54.873018+0000","last_peered":"2024-09-13T15:10:54.873018+0000","last_clean":"2024-09-13T15:10:54.873018+0000","last_became_active":"2024-09-13T15:10:52.991968+0000","last_became_peered":"2024-09-13T15:10:52.991968+0000","last_unstale":"2024-09-13T15:10:54.873018+0000","last_undegraded":"2024-09-13T15:10:54.873018+0000","last_fullsized":"2024-09-13T15:10:54.873018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:31.233193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477648+0000","last_change":"2024-09-13T15:10:53.481398+0000","last_active":"2024-09-13T15:10:54.477648+0000","last_peered":"2024-09-13T15:10:54.477648+0000","last_clean":"2024-09-13T15:10:54.477648+0000","last_became_active":"2024-09-13T15:10:53.481079+0000","last_became_peered":"2024-09-13T15:10:53.481079+0000","last_unstale":"2024-09-13T15:10:54.477648+0000","last_undegraded":"2024-09-13T15:10:54.477648+0000","last_fullsized":"2024-09-13T15:10:54.477648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:24.919017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477940+0000","last_change":"2024-09-13T15:10:52.974458+0000","last_active":"2024-09-13T15:10:54.477940+0000","last_peered":"2024-09-13T15:10:54.477940+0000","last_clean":"2024-09-13T15:10:54.477940+0000","last_became_active":"2024-09-13T15:10:52.974204+0000","last_became_peered":"2024-09-13T15:10:52.974204+0000","last_unstale":"2024-09-13T15:10:54.477940+0000","last_undegraded":"2024-09-13T15:10:54.477940+0000","last_fullsized":"2024-09-13T15:10:54.477940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:31.233193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874685+0000","last_change":"2024-09-13T15:10:53.492890+0000","last_active":"2024-09-13T15:10:54.874685+0000","last_peered":"2024-09-13T15:10:54.874685+0000","last_clean":"2024-09-13T15:10:54.874685+0000","last_became_active":"2024-09-13T15:10:53.492623+0000","last_became_peered":"2024-09-13T15:10:53.492623+0000","last_unstale":"2024-09-13T15:10:54.874685+0000","last_undegraded":"2024-09-13T15:10:54.874685+0000","last_fullsized":"2024-09-13T15:10:54.874685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:52.471197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477896+0000","last_change":"2024-09-13T15:10:52.993232+0000","last_active":"2024-09-13T15:10:54.477896+0000","last_peered":"2024-09-13T15:10:54.477896+0000","last_clean":"2024-09-13T15:10:54.477896+0000","last_became_active":"2024-09-13T15:10:52.992919+0000","last_became_peered":"2024-09-13T15:10:52.992919+0000","last_unstale":"2024-09-13T15:10:54.477896+0000","last_undegraded":"2024-09-13T15:10:54.477896+0000","last_fullsized":"2024-09-13T15:10:54.477896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:51.029367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874518+0000","last_change":"2024-09-13T15:10:53.490358+0000","last_active":"2024-09-13T15:10:54.874518+0000","last_peered":"2024-09-13T15:10:54.874518+0000","last_clean":"2024-09-13T15:10:54.874518+0000","last_became_active":"2024-09-13T15:10:53.489816+0000","last_became_peered":"2024-09-13T15:10:53.489816+0000","last_unstale":"2024-09-13T15:10:54.874518+0000","last_undegraded":"2024-09-13T15:10:54.874518+0000","last_fullsized":"2024-09-13T15:10:54.874518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:53.210463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873126+0000","last_change":"2024-09-13T15:10:52.986869+0000","last_active":"2024-09-13T15:10:54.873126+0000","last_peered":"2024-09-13T15:10:54.873126+0000","last_clean":"2024-09-13T15:10:54.873126+0000","last_became_active":"2024-09-13T15:10:52.986581+0000","last_became_peered":"2024-09-13T15:10:52.986581+0000","last_unstale":"2024-09-13T15:10:54.873126+0000","last_undegraded":"2024-09-13T15:10:54.873126+0000","last_fullsized":"2024-09-13T15:10:54.873126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:42.270734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477824+0000","last_change":"2024-09-13T15:10:53.497102+0000","last_active":"2024-09-13T15:10:54.477824+0000","last_peered":"2024-09-13T15:10:54.477824+0000","last_clean":"2024-09-13T15:10:54.477824+0000","last_became_active":"2024-09-13T15:10:53.496692+0000","last_became_peered":"2024-09-13T15:10:53.496692+0000","last_unstale":"2024-09-13T15:10:54.477824+0000","last_undegraded":"2024-09-13T15:10:54.477824+0000","last_fullsized":"2024-09-13T15:10:54.477824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:13.384742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477894+0000","last_change":"2024-09-13T15:10:52.980203+0000","last_active":"2024-09-13T15:10:54.477894+0000","last_peered":"2024-09-13T15:10:54.477894+0000","last_clean":"2024-09-13T15:10:54.477894+0000","last_became_active":"2024-09-13T15:10:52.979956+0000","last_became_peered":"2024-09-13T15:10:52.979956+0000","last_unstale":"2024-09-13T15:10:54.477894+0000","last_undegraded":"2024-09-13T15:10:54.477894+0000","last_fullsized":"2024-09-13T15:10:54.477894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:15.180191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872369+0000","last_change":"2024-09-13T15:10:53.488931+0000","last_active":"2024-09-13T15:10:54.872369+0000","last_peered":"2024-09-13T15:10:54.872369+0000","last_clean":"2024-09-13T15:10:54.872369+0000","last_became_active":"2024-09-13T15:10:53.488628+0000","last_became_peered":"2024-09-13T15:10:53.488628+0000","last_unstale":"2024-09-13T15:10:54.872369+0000","last_undegraded":"2024-09-13T15:10:54.872369+0000","last_fullsized":"2024-09-13T15:10:54.872369+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:16.185379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872002+0000","last_change":"2024-09-13T15:10:52.987177+0000","last_active":"2024-09-13T15:10:54.872002+0000","last_peered":"2024-09-13T15:10:54.872002+0000","last_clean":"2024-09-13T15:10:54.872002+0000","last_became_active":"2024-09-13T15:10:52.986628+0000","last_became_peered":"2024-09-13T15:10:52.986628+0000","last_unstale":"2024-09-13T15:10:54.872002+0000","last_undegraded":"2024-09-13T15:10:54.872002+0000","last_fullsized":"2024-09-13T15:10:54.872002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:52.205275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872931+0000","last_change":"2024-09-13T15:10:53.491941+0000","last_active":"2024-09-13T15:10:54.872931+0000","last_peered":"2024-09-13T15:10:54.872931+0000","last_clean":"2024-09-13T15:10:54.872931+0000","last_became_active":"2024-09-13T15:10:53.491682+0000","last_became_peered":"2024-09-13T15:10:53.491682+0000","last_unstale":"2024-09-13T15:10:54.872931+0000","last_undegraded":"2024-09-13T15:10:54.872931+0000","last_fullsized":"2024-09-13T15:10:54.872931+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477484+0000","last_change":"2024-09-13T15:10:52.996076+0000","last_active":"2024-09-13T15:10:54.477484+0000","last_peered":"2024-09-13T15:10:54.477484+0000","last_clean":"2024-09-13T15:10:54.477484+0000","last_became_active":"2024-09-13T15:10:52.995826+0000","last_became_peered":"2024-09-13T15:10:52.995826+0000","last_unstale":"2024-09-13T15:10:54.477484+0000","last_undegraded":"2024-09-13T15:10:54.477484+0000","last_fullsized":"2024-09-13T15:10:54.477484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:16.254786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873245+0000","last_change":"2024-09-13T15:10:53.502433+0000","last_active":"2024-09-13T15:10:54.873245+0000","last_peered":"2024-09-13T15:10:54.873245+0000","last_clean":"2024-09-13T15:10:54.873245+0000","last_became_active":"2024-09-13T15:10:53.502054+0000","last_became_peered":"2024-09-13T15:10:53.502054+0000","last_unstale":"2024-09-13T15:10:54.873245+0000","last_undegraded":"2024-09-13T15:10:54.873245+0000","last_fullsized":"2024-09-13T15:10:54.873245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.737942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.742853+0000","last_change":"2024-09-13T15:10:52.986607+0000","last_active":"2024-09-13T15:10:54.742853+0000","last_peered":"2024-09-13T15:10:54.742853+0000","last_clean":"2024-09-13T15:10:54.742853+0000","last_became_active":"2024-09-13T15:10:52.986313+0000","last_became_peered":"2024-09-13T15:10:52.986313+0000","last_unstale":"2024-09-13T15:10:54.742853+0000","last_undegraded":"2024-09-13T15:10:54.742853+0000","last_fullsized":"2024-09-13T15:10:54.742853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:45.645274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873647+0000","last_change":"2024-09-13T15:10:53.505177+0000","last_active":"2024-09-13T15:10:54.873647+0000","last_peered":"2024-09-13T15:10:54.873647+0000","last_clean":"2024-09-13T15:10:54.873647+0000","last_became_active":"2024-09-13T15:10:53.504975+0000","last_became_peered":"2024-09-13T15:10:53.504975+0000","last_unstale":"2024-09-13T15:10:54.873647+0000","last_undegraded":"2024-09-13T15:10:54.873647+0000","last_fullsized":"2024-09-13T15:10:54.873647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:41.213660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873150+0000","last_change":"2024-09-13T15:10:52.980497+0000","last_active":"2024-09-13T15:10:54.873150+0000","last_peered":"2024-09-13T15:10:54.873150+0000","last_clean":"2024-09-13T15:10:54.873150+0000","last_became_active":"2024-09-13T15:10:52.980278+0000","last_became_peered":"2024-09-13T15:10:52.980278+0000","last_unstale":"2024-09-13T15:10:54.873150+0000","last_undegraded":"2024-09-13T15:10:54.873150+0000","last_fullsized":"2024-09-13T15:10:54.873150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:15.180191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477344+0000","last_change":"2024-09-13T15:10:53.510709+0000","last_active":"2024-09-13T15:10:54.477344+0000","last_peered":"2024-09-13T15:10:54.477344+0000","last_clean":"2024-09-13T15:10:54.477344+0000","last_became_active":"2024-09-13T15:10:53.510235+0000","last_became_peered":"2024-09-13T15:10:53.510235+0000","last_unstale":"2024-09-13T15:10:54.477344+0000","last_undegraded":"2024-09-13T15:10:54.477344+0000","last_fullsized":"2024-09-13T15:10:54.477344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:39.767769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.478253+0000","last_change":"2024-09-13T15:10:52.984396+0000","last_active":"2024-09-13T15:10:54.478253+0000","last_peered":"2024-09-13T15:10:54.478253+0000","last_clean":"2024-09-13T15:10:54.478253+0000","last_became_active":"2024-09-13T15:10:52.984147+0000","last_became_peered":"2024-09-13T15:10:52.984147+0000","last_unstale":"2024-09-13T15:10:54.478253+0000","last_undegraded":"2024-09-13T15:10:54.478253+0000","last_fullsized":"2024-09-13T15:10:54.478253+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:11.803544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477212+0000","last_change":"2024-09-13T15:10:53.512110+0000","last_active":"2024-09-13T15:10:54.477212+0000","last_peered":"2024-09-13T15:10:54.477212+0000","last_clean":"2024-09-13T15:10:54.477212+0000","last_became_active":"2024-09-13T15:10:53.510762+0000","last_became_peered":"2024-09-13T15:10:53.510762+0000","last_unstale":"2024-09-13T15:10:54.477212+0000","last_undegraded":"2024-09-13T15:10:54.477212+0000","last_fullsized":"2024-09-13T15:10:54.477212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:49.739370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477973+0000","last_change":"2024-09-13T15:10:52.992801+0000","last_active":"2024-09-13T15:10:54.477973+0000","last_peered":"2024-09-13T15:10:54.477973+0000","last_clean":"2024-09-13T15:10:54.477973+0000","last_became_active":"2024-09-13T15:10:52.992547+0000","last_became_peered":"2024-09-13T15:10:52.992547+0000","last_unstale":"2024-09-13T15:10:54.477973+0000","last_undegraded":"2024-09-13T15:10:54.477973+0000","last_fullsized":"2024-09-13T15:10:54.477973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:42:29.404965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874773+0000","last_change":"2024-09-13T15:10:53.505059+0000","last_active":"2024-09-13T15:10:54.874773+0000","last_peered":"2024-09-13T15:10:54.874773+0000","last_clean":"2024-09-13T15:10:54.874773+0000","last_became_active":"2024-09-13T15:10:53.504746+0000","last_became_peered":"2024-09-13T15:10:53.504746+0000","last_unstale":"2024-09-13T15:10:54.874773+0000","last_undegraded":"2024-09-13T15:10:54.874773+0000","last_fullsized":"2024-09-13T15:10:54.874773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.253171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.875547+0000","last_change":"2024-09-13T15:10:52.989845+0000","last_active":"2024-09-13T15:10:54.875547+0000","last_peered":"2024-09-13T15:10:54.875547+0000","last_clean":"2024-09-13T15:10:54.875547+0000","last_became_active":"2024-09-13T15:10:52.989595+0000","last_became_peered":"2024-09-13T15:10:52.989595+0000","last_unstale":"2024-09-13T15:10:54.875547+0000","last_undegraded":"2024-09-13T15:10:54.875547+0000","last_fullsized":"2024-09-13T15:10:54.875547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:01.857205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743350+0000","last_change":"2024-09-13T15:10:53.485205+0000","last_active":"2024-09-13T15:10:54.743350+0000","last_peered":"2024-09-13T15:10:54.743350+0000","last_clean":"2024-09-13T15:10:54.743350+0000","last_became_active":"2024-09-13T15:10:53.484958+0000","last_became_peered":"2024-09-13T15:10:53.484958+0000","last_unstale":"2024-09-13T15:10:54.743350+0000","last_undegraded":"2024-09-13T15:10:54.743350+0000","last_fullsized":"2024-09-13T15:10:54.743350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:51.035015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"76'2","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874872+0000","last_change":"2024-09-13T15:10:52.982978+0000","last_active":"2024-09-13T15:10:54.874872+0000","last_peered":"2024-09-13T15:10:54.874872+0000","last_clean":"2024-09-13T15:10:54.874872+0000","last_became_active":"2024-09-13T15:10:52.982692+0000","last_became_peered":"2024-09-13T15:10:52.982692+0000","last_unstale":"2024-09-13T15:10:54.874872+0000","last_undegraded":"2024-09-13T15:10:54.874872+0000","last_fullsized":"2024-09-13T15:10:54.874872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:04.418179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743712+0000","last_change":"2024-09-13T15:10:53.482013+0000","last_active":"2024-09-13T15:10:54.743712+0000","last_peered":"2024-09-13T15:10:54.743712+0000","last_clean":"2024-09-13T15:10:54.743712+0000","last_became_active":"2024-09-13T15:10:53.481746+0000","last_became_peered":"2024-09-13T15:10:53.481746+0000","last_unstale":"2024-09-13T15:10:54.743712+0000","last_undegraded":"2024-09-13T15:10:54.743712+0000","last_fullsized":"2024-09-13T15:10:54.743712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:26.265510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873827+0000","last_change":"2024-09-13T15:10:52.994011+0000","last_active":"2024-09-13T15:10:54.873827+0000","last_peered":"2024-09-13T15:10:54.873827+0000","last_clean":"2024-09-13T15:10:54.873827+0000","last_became_active":"2024-09-13T15:10:52.993708+0000","last_became_peered":"2024-09-13T15:10:52.993708+0000","last_unstale":"2024-09-13T15:10:54.873827+0000","last_undegraded":"2024-09-13T15:10:54.873827+0000","last_fullsized":"2024-09-13T15:10:54.873827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:04.144431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873357+0000","last_change":"2024-09-13T15:10:53.499038+0000","last_active":"2024-09-13T15:10:54.873357+0000","last_peered":"2024-09-13T15:10:54.873357+0000","last_clean":"2024-09-13T15:10:54.873357+0000","last_became_active":"2024-09-13T15:10:53.498760+0000","last_became_peered":"2024-09-13T15:10:53.498760+0000","last_unstale":"2024-09-13T15:10:54.873357+0000","last_undegraded":"2024-09-13T15:10:54.873357+0000","last_fullsized":"2024-09-13T15:10:54.873357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:00.611401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873700+0000","last_change":"2024-09-13T15:10:52.987154+0000","last_active":"2024-09-13T15:10:54.873700+0000","last_peered":"2024-09-13T15:10:54.873700+0000","last_clean":"2024-09-13T15:10:54.873700+0000","last_became_active":"2024-09-13T15:10:52.986894+0000","last_became_peered":"2024-09-13T15:10:52.986894+0000","last_unstale":"2024-09-13T15:10:54.873700+0000","last_undegraded":"2024-09-13T15:10:54.873700+0000","last_fullsized":"2024-09-13T15:10:54.873700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:03.425474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.476864+0000","last_change":"2024-09-13T15:10:53.501804+0000","last_active":"2024-09-13T15:10:54.476864+0000","last_peered":"2024-09-13T15:10:54.476864+0000","last_clean":"2024-09-13T15:10:54.476864+0000","last_became_active":"2024-09-13T15:10:53.500160+0000","last_became_peered":"2024-09-13T15:10:53.500160+0000","last_unstale":"2024-09-13T15:10:54.476864+0000","last_undegraded":"2024-09-13T15:10:54.476864+0000","last_fullsized":"2024-09-13T15:10:54.476864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.238381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477726+0000","last_change":"2024-09-13T15:10:52.977325+0000","last_active":"2024-09-13T15:10:54.477726+0000","last_peered":"2024-09-13T15:10:54.477726+0000","last_clean":"2024-09-13T15:10:54.477726+0000","last_became_active":"2024-09-13T15:10:52.976925+0000","last_became_peered":"2024-09-13T15:10:52.976925+0000","last_unstale":"2024-09-13T15:10:54.477726+0000","last_undegraded":"2024-09-13T15:10:54.477726+0000","last_fullsized":"2024-09-13T15:10:54.477726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:52.205275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872544+0000","last_change":"2024-09-13T15:10:53.503189+0000","last_active":"2024-09-13T15:10:54.872544+0000","last_peered":"2024-09-13T15:10:54.872544+0000","last_clean":"2024-09-13T15:10:54.872544+0000","last_became_active":"2024-09-13T15:10:53.502791+0000","last_became_peered":"2024-09-13T15:10:53.502791+0000","last_unstale":"2024-09-13T15:10:54.872544+0000","last_undegraded":"2024-09-13T15:10:54.872544+0000","last_fullsized":"2024-09-13T15:10:54.872544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:40.298615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743669+0000","last_change":"2024-09-13T15:10:52.989346+0000","last_active":"2024-09-13T15:10:54.743669+0000","last_peered":"2024-09-13T15:10:54.743669+0000","last_clean":"2024-09-13T15:10:54.743669+0000","last_became_active":"2024-09-13T15:10:52.989052+0000","last_became_peered":"2024-09-13T15:10:52.989052+0000","last_unstale":"2024-09-13T15:10:54.743669+0000","last_undegraded":"2024-09-13T15:10:54.743669+0000","last_fullsized":"2024-09-13T15:10:54.743669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:46.967616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477198+0000","last_change":"2024-09-13T15:10:53.495850+0000","last_active":"2024-09-13T15:10:54.477198+0000","last_peered":"2024-09-13T15:10:54.477198+0000","last_clean":"2024-09-13T15:10:54.477198+0000","last_became_active":"2024-09-13T15:10:53.495211+0000","last_became_peered":"2024-09-13T15:10:53.495211+0000","last_unstale":"2024-09-13T15:10:54.477198+0000","last_undegraded":"2024-09-13T15:10:54.477198+0000","last_fullsized":"2024-09-13T15:10:54.477198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:23.491576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872634+0000","last_change":"2024-09-13T15:10:52.980994+0000","last_active":"2024-09-13T15:10:54.872634+0000","last_peered":"2024-09-13T15:10:54.872634+0000","last_clean":"2024-09-13T15:10:54.872634+0000","last_became_active":"2024-09-13T15:10:52.980744+0000","last_became_peered":"2024-09-13T15:10:52.980744+0000","last_unstale":"2024-09-13T15:10:54.872634+0000","last_undegraded":"2024-09-13T15:10:54.872634+0000","last_fullsized":"2024-09-13T15:10:54.872634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:48.732754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.743099+0000","last_change":"2024-09-13T15:10:53.486100+0000","last_active":"2024-09-13T15:10:54.743099+0000","last_peered":"2024-09-13T15:10:54.743099+0000","last_clean":"2024-09-13T15:10:54.743099+0000","last_became_active":"2024-09-13T15:10:53.485852+0000","last_became_peered":"2024-09-13T15:10:53.485852+0000","last_unstale":"2024-09-13T15:10:54.743099+0000","last_undegraded":"2024-09-13T15:10:54.743099+0000","last_fullsized":"2024-09-13T15:10:54.743099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.253171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872164+0000","last_change":"2024-09-13T15:10:52.990689+0000","last_active":"2024-09-13T15:10:54.872164+0000","last_peered":"2024-09-13T15:10:54.872164+0000","last_clean":"2024-09-13T15:10:54.872164+0000","last_became_active":"2024-09-13T15:10:52.990389+0000","last_became_peered":"2024-09-13T15:10:52.990389+0000","last_unstale":"2024-09-13T15:10:54.872164+0000","last_undegraded":"2024-09-13T15:10:54.872164+0000","last_fullsized":"2024-09-13T15:10:54.872164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:57.433704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872866+0000","last_change":"2024-09-13T15:10:53.505512+0000","last_active":"2024-09-13T15:10:54.872866+0000","last_peered":"2024-09-13T15:10:54.872866+0000","last_clean":"2024-09-13T15:10:54.872866+0000","last_became_active":"2024-09-13T15:10:53.504820+0000","last_became_peered":"2024-09-13T15:10:53.504820+0000","last_unstale":"2024-09-13T15:10:54.872866+0000","last_undegraded":"2024-09-13T15:10:54.872866+0000","last_fullsized":"2024-09-13T15:10:54.872866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:35.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872774+0000","last_change":"2024-09-13T15:10:52.990000+0000","last_active":"2024-09-13T15:10:54.872774+0000","last_peered":"2024-09-13T15:10:54.872774+0000","last_clean":"2024-09-13T15:10:54.872774+0000","last_became_active":"2024-09-13T15:10:52.989753+0000","last_became_peered":"2024-09-13T15:10:52.989753+0000","last_unstale":"2024-09-13T15:10:54.872774+0000","last_undegraded":"2024-09-13T15:10:54.872774+0000","last_fullsized":"2024-09-13T15:10:54.872774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:17.965061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872578+0000","last_change":"2024-09-13T15:10:53.504018+0000","last_active":"2024-09-13T15:10:54.872578+0000","last_peered":"2024-09-13T15:10:54.872578+0000","last_clean":"2024-09-13T15:10:54.872578+0000","last_became_active":"2024-09-13T15:10:53.503727+0000","last_became_peered":"2024-09-13T15:10:53.503727+0000","last_unstale":"2024-09-13T15:10:54.872578+0000","last_undegraded":"2024-09-13T15:10:54.872578+0000","last_fullsized":"2024-09-13T15:10:54.872578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:26.360323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.477409+0000","last_change":"2024-09-13T15:10:52.993272+0000","last_active":"2024-09-13T15:10:54.477409+0000","last_peered":"2024-09-13T15:10:54.477409+0000","last_clean":"2024-09-13T15:10:54.477409+0000","last_became_active":"2024-09-13T15:10:52.993003+0000","last_became_peered":"2024-09-13T15:10:52.993003+0000","last_unstale":"2024-09-13T15:10:54.477409+0000","last_undegraded":"2024-09-13T15:10:54.477409+0000","last_fullsized":"2024-09-13T15:10:54.477409+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:42.546329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.875565+0000","last_change":"2024-09-13T15:10:53.485120+0000","last_active":"2024-09-13T15:10:54.875565+0000","last_peered":"2024-09-13T15:10:54.875565+0000","last_clean":"2024-09-13T15:10:54.875565+0000","last_became_active":"2024-09-13T15:10:53.482719+0000","last_became_peered":"2024-09-13T15:10:53.482719+0000","last_unstale":"2024-09-13T15:10:54.875565+0000","last_undegraded":"2024-09-13T15:10:54.875565+0000","last_fullsized":"2024-09-13T15:10:54.875565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.238381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872808+0000","last_change":"2024-09-13T15:10:52.992692+0000","last_active":"2024-09-13T15:10:54.872808+0000","last_peered":"2024-09-13T15:10:54.872808+0000","last_clean":"2024-09-13T15:10:54.872808+0000","last_became_active":"2024-09-13T15:10:52.991220+0000","last_became_peered":"2024-09-13T15:10:52.991220+0000","last_unstale":"2024-09-13T15:10:54.872808+0000","last_undegraded":"2024-09-13T15:10:54.872808+0000","last_fullsized":"2024-09-13T15:10:54.872808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:48.288588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.875489+0000","last_change":"2024-09-13T15:10:53.483453+0000","last_active":"2024-09-13T15:10:54.875489+0000","last_peered":"2024-09-13T15:10:54.875489+0000","last_clean":"2024-09-13T15:10:54.875489+0000","last_became_active":"2024-09-13T15:10:53.483212+0000","last_became_peered":"2024-09-13T15:10:53.483212+0000","last_unstale":"2024-09-13T15:10:54.875489+0000","last_undegraded":"2024-09-13T15:10:54.875489+0000","last_fullsized":"2024-09-13T15:10:54.875489+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:00.611401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.873809+0000","last_change":"2024-09-13T15:10:52.992061+0000","last_active":"2024-09-13T15:10:54.873809+0000","last_peered":"2024-09-13T15:10:54.873809+0000","last_clean":"2024-09-13T15:10:54.873809+0000","last_became_active":"2024-09-13T15:10:52.991735+0000","last_became_peered":"2024-09-13T15:10:52.991735+0000","last_unstale":"2024-09-13T15:10:54.873809+0000","last_undegraded":"2024-09-13T15:10:54.873809+0000","last_fullsized":"2024-09-13T15:10:54.873809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:11.803544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.872488+0000","last_change":"2024-09-13T15:10:53.481187+0000","last_active":"2024-09-13T15:10:54.872488+0000","last_peered":"2024-09-13T15:10:54.872488+0000","last_clean":"2024-09-13T15:10:54.872488+0000","last_became_active":"2024-09-13T15:10:53.480855+0000","last_became_peered":"2024-09-13T15:10:53.480855+0000","last_unstale":"2024-09-13T15:10:54.872488+0000","last_undegraded":"2024-09-13T15:10:54.872488+0000","last_fullsized":"2024-09-13T15:10:54.872488+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:52.954301+0000","last_clean_scrub_stamp":"2024-09-13T15:10:52.954301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:04.430662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T15:10:54.874917+0000","last_change":"2024-09-13T15:10:52.992488+0000","last_active":"2024-09-13T15:10:54.874917+0000","last_peered":"2024-09-13T15:10:54.874917+0000","last_clean":"2024-09-13T15:10:54.874917+0000","last_became_active":"2024-09-13T15:10:52.992233+0000","last_became_peered":"2024-09-13T15:10:52.992233+0000","last_unstale":"2024-09-13T15:10:54.874917+0000","last_undegraded":"2024-09-13T15:10:54.874917+0000","last_fullsized":"2024-09-13T15:10:54.874917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:10:51.949113+0000","last_clean_scrub_stamp":"2024-09-13T15:10:51.949113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:25.790842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-13T15:10:53.475711+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:10:53.475711+0000","last_peered":"2024-09-13T15:10:53.475711+0000","last_clean":"2024-09-13T15:10:53.475711+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:10:53.475711+0000","last_undegraded":"2024-09-13T15:10:53.475711+0000","last_fullsized":"2024-09-13T15:10:53.475711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1540096,"data_stored":1014182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.159,"15min":1.1830000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6180000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.73099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5369999999999999,"5min":1.839,"15min":1.839},"last":1.147}]},{"osd":1,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.3009999999999999,"15min":1.359},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4059999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.431},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.212,"15min":1.258},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.577,"15min":1.577},"last":1.0249999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.329,"15min":1.391},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3260000000000001,"15min":1.363},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.3260000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3999999999999999,"15min":1.4379999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.25,"5min":1.46,"15min":1.532},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.681,"5min":2.081,"15min":2.081},"last":1.2529999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.29,"15min":1.3700000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5580000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.3680000000000001,"15min":1.4370000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6180000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.995}]},{"osd":5,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5049999999999999,"15min":1.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.917,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5129999999999999,"15min":1.6040000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.194},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.5669999999999999,"15min":1.6499999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7190000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.113}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":424337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.157,"15min":1.1970000000000001},"min":{"1min":0.751,"5min":0.749,"15min":0.749},"max":{"1min":1.3979999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3819999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2370000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.534,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.2849999999999999,"15min":1.345},"min":{"1min":0.86899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.619,"5min":2.282,"15min":2.282},"last":1.3109999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2589999999999999,"15min":1.2949999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.5069999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.298},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.353,"15min":1.395},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.484,"5min":1.986,"15min":1.986},"last":1.405}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2969999999999999,"15min":1.3180000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6140000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.341,"15min":1.391},"min":{"1min":0.96099999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.6180000000000001,"5min":2.371,"15min":2.371},"last":1.2}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.325,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4630000000000001,"5min":2.835,"15min":2.835},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.117,"5min":1.3180000000000001,"15min":1.381},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5800000000000001,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6699999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.5389999999999999,"15min":1.605},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.74,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.413,"15min":1.4450000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.538,"5min":2.444,"15min":2.444},"last":1.143},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.5109999999999999,"15min":1.5509999999999999},"min":{"1min":0.92000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.7909999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.3520000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":423826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2390000000000001,"15min":1.304},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.2729999999999999,"15min":1.3700000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2450000000000001,"15min":1.2829999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.488,"5min":1.976,"15min":1.976},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.224,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.587,"5min":2.665,"15min":2.665},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.236,"15min":1.27},"min":{"1min":0.79300000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.556,"5min":2.347,"15min":2.347},"last":1.083},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3320000000000001,"15min":1.3779999999999999},"min":{"1min":0.73899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6759999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.165}]},{"osd":3,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":0.86399999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.593,"5min":2.524,"15min":2.524},"last":1.198},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4359999999999999,"15min":1.504},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.2370000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3959999999999999},"min":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6919999999999999,"5min":2.012,"15min":2.012},"last":1.254},{"interface":"front","average":{"1min":1.29,"5min":1.4239999999999999,"15min":1.494},"min":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7569999999999999,"5min":3.117,"15min":3.117},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.444,"15min":1.5429999999999999},"min":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.603,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4930000000000001,"15min":1.5880000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6479999999999999,"5min":2.411,"15min":2.411},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4790000000000001,"15min":1.5620000000000001},"min":{"1min":0.80800000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.671,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.579,"15min":1.681},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.694,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":425460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.139,"15min":1.167},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.597,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1830000000000001,"15min":1.2030000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.627}]},{"osd":1,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.23,"15min":1.2569999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.651,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.2090000000000001,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.794,"15min":1.794},"last":1.157}]},{"osd":2,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.85699999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5269999999999999,"5min":1.621,"15min":1.621},"last":1.589},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3320000000000001,"15min":1.347},"min":{"1min":1.0549999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.349}]},{"osd":3,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.244,"15min":1.2649999999999999},"min":{"1min":0.77500000000000002,"5min":0.754,"15min":0.754},"max":{"1min":1.498,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2989999999999999,"15min":1.341},"min":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.524,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.373}]},{"osd":5,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3480000000000001,"15min":1.3799999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.0219999999999998,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.268},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.375,"15min":1.399},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.9099999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.7509999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.268,"15min":1.304},"min":{"1min":0.77400000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7,"5min":2.214,"15min":2.214},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.4159999999999999,"15min":1.4490000000000001},"min":{"1min":0.89000000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.48}]},{"osd":7,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.95999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7390000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.4490000000000001,"15min":1.496},"min":{"1min":0.98099999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.677,"5min":2.524,"15min":2.524},"last":1.716}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":423355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0589999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.419,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0549999999999999,"15min":1.079},"min":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3959999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.02,"15min":1.073},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9379999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.111},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.2130000000000001},"min":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.306,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.133,"15min":1.2030000000000001},"min":{"1min":0.71599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.603,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.085,"5min":1.286,"15min":1.3580000000000001},"min":{"1min":0.70299999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5069999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.4299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.337,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7529999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.3859999999999999,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1669999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.4630000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4390000000000001,"15min":1.5129999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.802,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.581,"15min":1.6739999999999999},"min":{"1min":1.0660000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.55,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.236}]},{"osd":6,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4399999999999999,"15min":1.4970000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.605,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.27},{"interface":"front","average":{"1min":1.383,"5min":1.5029999999999999,"15min":1.5669999999999999},"min":{"1min":0.90300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0800000000000001,"5min":3.786,"15min":3.786},"last":1.54}]},{"osd":7,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.6859999999999999,"15min":1.7829999999999999},"min":{"1min":1.1890000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7529999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.5980000000000001,"15min":1.671},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.782,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.401}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":954368,"data_stored":424534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.5,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":1.393,"15min":1.393},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.73699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4630000000000001,"5min":1.643,"15min":1.643},"last":0.97999999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.54200000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.2}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.069,"15min":1.113},"min":{"1min":0.78600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4319999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.369},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.081},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.302,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4179999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.343,"15min":1.3839999999999999},"min":{"1min":0.93700000000000006,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.494,"5min":2.657,"15min":2.657},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.4490000000000001,"15min":1.5},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5569999999999999,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.3160000000000001},"min":{"1min":0.95999999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.385,"15min":1.395},"min":{"1min":1.0089999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.609,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.446,"15min":1.486},"min":{"1min":0.95499999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0459999999999998,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.4359999999999999,"15min":1.468},"min":{"1min":1.0369999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.849,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.4930000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5589999999999999},"min":{"1min":1.1359999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.1480000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.353},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5580000000000001},"min":{"1min":1.2310000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7689999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.7030000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":950272,"data_stored":423904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88300000000000001,"15min":0.86099999999999999},"min":{"1min":0.50900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99099999999999999,"15min":1.0109999999999999},"min":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.722,"15min":1.722},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.875,"15min":0.89200000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.321,"5min":1.502,"15min":1.502},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.042,"15min":1.0529999999999999},"min":{"1min":0.71699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.73199999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5780000000000001,"5min":1.764,"15min":1.764},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0900000000000001,"15min":1.143},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.242,"5min":3.254,"15min":3.254},"last":1.024}]},{"osd":4,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1759999999999999,"15min":1.1930000000000001},"min":{"1min":0.877,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5229999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.335,"5min":1.3540000000000001,"15min":1.3759999999999999},"min":{"1min":1.0660000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.762,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.377,"15min":1.4370000000000001},"min":{"1min":0.91200000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6639999999999999,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.325,"15min":1.367},"min":{"1min":0.92000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5960000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4790000000000001,"15min":1.5169999999999999},"min":{"1min":0.98599999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.9410000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4950000000000001,"15min":1.5669999999999999},"min":{"1min":0.92100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7270000000000001,"5min":4.843,"15min":4.843},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.6040000000000001,"15min":1.7030000000000001},"min":{"1min":1.113,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.6399999999999999,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.45,"15min":1.5},"min":{"1min":0.93700000000000006,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.768,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.0720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1531904,"data_stored":1013141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91800000000000004,"15min":0.90400000000000003},"min":{"1min":0.56599999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.3959999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2210000000000001,"15min":1.3089999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.371,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.1899999999999999,"15min":1.3200000000000001},"min":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2649999999999999,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.2310000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.119,"15min":1.159},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4430000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3029999999999999,"15min":1.3049999999999999},"min":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.724,"5min":2.157,"15min":2.157},"last":1.5489999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.95499999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.8260000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.661,"5min":1.827,"15min":1.827},"last":1.633}]},{"osd":5,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.345,"15min":1.3859999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.54,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.341},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3700000000000001,"15min":1.3919999999999999},"min":{"1min":0.98099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.7330000000000001,"5min":2.367,"15min":2.367},"last":1.484}]},{"osd":6,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.472,"15min":1.488},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.8690000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.704},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.478},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.752,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.49,"15min":1.538},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8879999999999999,"5min":3.302,"15min":3.302},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.359,"5min":1.4399999999999999,"15min":1.47},"min":{"1min":1.0409999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.788,"5min":2.266,"15min":2.266},"last":1.0700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:10:58.332 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:10:58.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T15:10:58.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 Processor -- start 2024-09-13T15:10:58.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 -- start start 2024-09-13T15:10:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa806a5d0 0x7fcfa8071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfa80b19f0 0x7fcfa806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80ce140 con 0x7fcfa80cd610 2024-09-13T15:10:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa806aef0 con 0x7fcfa80b19f0 2024-09-13T15:10:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.549+0000 7fcfaf400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80b1e30 con 0x7fcfa806a5d0 2024-09-13T15:10:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfa80b19f0 0x7fcfa806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfad400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcfa80cd610 0x7fcfa806ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59864/0 (socket says 172.21.15.50:59864) 2024-09-13T15:10:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfa80b19f0 0x7fcfa806a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58736/0 (socket says 172.21.15.50:58736) 2024-09-13T15:10:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfad400700 1 -- 172.21.15.50:0/785265993 learned_addr learned my addr 172.21.15.50:0/785265993 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfaca00700 1 --2- 172.21.15.50:0/785265993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa806a5d0 0x7fcfa8071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7400700 1 -- 172.21.15.50:0/785265993 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178989870 0 0) 0x7fcfa80ce140 con 0x7fcfa80cd610 2024-09-13T15:10:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7400700 1 -- 172.21.15.50:0/785265993 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf900035d0 con 0x7fcfa80cd610 2024-09-13T15:10:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 -- 172.21.15.50:0/785265993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa806a5d0 msgr2=0x7fcfa8071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 --2- 172.21.15.50:0/785265993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa806a5d0 0x7fcfa8071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 -- 172.21.15.50:0/785265993 >> v1:172.21.15.50:6789/0 conn(0x7fcfa80cd610 legacy=0x7fcfa806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 -- 172.21.15.50:0/785265993 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80cde60 con 0x7fcfa80b19f0 2024-09-13T15:10:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7e00700 1 --2- 172.21.15.50:0/785265993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80b19f0 0x7fcfa806a9b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009850 tx=0x7fcf94009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a7a45dab9412a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7400700 1 -- 172.21.15.50:0/785265993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011830 con 0x7fcfa80b19f0 2024-09-13T15:10:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7400700 1 -- 172.21.15.50:0/785265993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94011990 con 0x7fcfa80b19f0 2024-09-13T15:10:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfa7400700 1 -- 172.21.15.50:0/785265993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011d40 con 0x7fcfa80b19f0 2024-09-13T15:10:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfaf400700 1 -- 172.21.15.50:0/785265993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80b19f0 msgr2=0x7fcfa806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.553+0000 7fcfaf400700 1 --2- 172.21.15.50:0/785265993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80b19f0 0x7fcfa806a9b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009850 tx=0x7fcf94009b60 comp rx=0 tx=0).stop 2024-09-13T15:10:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- 172.21.15.50:0/785265993 shutdown_connections 2024-09-13T15:10:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 --2- 172.21.15.50:0/785265993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80b19f0 0x7fcfa806a9b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 --2- 172.21.15.50:0/785265993 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa806a5d0 0x7fcfa8071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- 172.21.15.50:0/785265993 >> 172.21.15.50:0/785265993 conn(0x7fcfa80b08d0 msgr2=0x7fcfa80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- 172.21.15.50:0/785265993 shutdown_connections 2024-09-13T15:10:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- 172.21.15.50:0/785265993 wait complete. 2024-09-13T15:10:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 Processor -- start 2024-09-13T15:10:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- start start 2024-09-13T15:10:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfa806a5d0 0x7fcfa8164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa80b19f0 0x7fcfa8162860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 0x7fcfa8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8154d10 con 0x7fcfa80cd610 2024-09-13T15:10:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8154ff0 con 0x7fcfa806a5d0 2024-09-13T15:10:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfaf400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81552d0 con 0x7fcfa80b19f0 2024-09-13T15:10:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.557+0000 7fcfad400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 0x7fcfa8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 0x7fcfa8162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58744/0 (socket says 172.21.15.50:58744) 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 -- 172.21.15.50:0/297119534 learned_addr learned my addr 172.21.15.50:0/297119534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfa7e00700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa80b19f0 0x7fcfa8162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfaca00700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfa806a5d0 0x7fcfa8164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 -- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa80b19f0 msgr2=0x7fcfa8162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa80b19f0 0x7fcfa8162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 -- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfa806a5d0 msgr2=0x7fcfa8164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfa806a5d0 0x7fcfa8164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 -- 172.21.15.50:0/297119534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940094b0 con 0x7fcfa80cd610 2024-09-13T15:10:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfad400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 0x7fcfa8162da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000caa0 tx=0x7fcfa000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007480 con 0x7fcfa80cd610 2024-09-13T15:10:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa00075e0 con 0x7fcfa80cd610 2024-09-13T15:10:58.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007970 con 0x7fcfa80cd610 2024-09-13T15:10:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa81555b0 con 0x7fcfa80cd610 2024-09-13T15:10:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80a86f0 con 0x7fcfa80cd610 2024-09-13T15:10:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.561+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa8155ad0 con 0x7fcfa80cd610 2024-09-13T15:10:58.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.565+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcfa001b3b0 con 0x7fcfa80cd610 2024-09-13T15:10:58.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.565+0000 7fcfa4c00700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf88066730 0x7fcf88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.565+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcfa0083c60 con 0x7fcfa80cd610 2024-09-13T15:10:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.565+0000 7fcfaca00700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf88066730 0x7fcf88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:58.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.569+0000 7fcfaca00700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf88066730 0x7fcf88068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009bf0 tx=0x7fcf9c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:58.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.573+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcfa8155ad0 con 0x7fcfa80cd610 2024-09-13T15:10:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.817+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcfa8155ad0 con 0x7fcfa80cd610 2024-09-13T15:10:58.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.825+0000 7fcfa4c00700 1 -- 172.21.15.50:0/297119534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcfa8155ad0 con 0x7fcfa80cd610 2024-09-13T15:10:58.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf88066730 msgr2=0x7fcf88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf88066730 0x7fcf88068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009bf0 tx=0x7fcf9c009240 comp rx=0 tx=0).stop 2024-09-13T15:10:58.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 msgr2=0x7fcfa8162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 0x7fcfa8162da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000caa0 tx=0x7fcfa000cad0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 shutdown_connections 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf88066730 0x7fcf88068bf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa80cd610 0x7fcfa8162da0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcfa80b19f0 0x7fcfa8162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 --2- 172.21.15.50:0/297119534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfa806a5d0 0x7fcfa8164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:58.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 >> 172.21.15.50:0/297119534 conn(0x7fcfa80b08d0 msgr2=0x7fcfa81496b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:58.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 shutdown_connections 2024-09-13T15:10:58.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:58.829+0000 7fcfaf400700 1 -- 172.21.15.50:0/297119534 wait complete. 2024-09-13T15:10:58.836 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-13T15:10:58.857 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:58.950 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-13T15:10:58.945+0000 7fc88d600700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:10:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.037+0000 7f6105e00700 1 Processor -- start 2024-09-13T15:10:59.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.037+0000 7f6105e00700 1 -- start start 2024-09-13T15:10:59.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.037+0000 7f6105e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61000cc6f0 0x7f610015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.037+0000 7f6105e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f610006aaa0 0x7f610006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61000ccb40 con 0x7f61000cb020 2024-09-13T15:10:59.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610006b430 con 0x7f610006aaa0 2024-09-13T15:10:59.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61000b2ad0 con 0x7f61000cc6f0 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6104a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f61000cb020 0x7f610015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59876/0 (socket says 172.21.15.50:59876) 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6104a00700 1 -- 172.21.15.50:0/2470716792 learned_addr learned my addr 172.21.15.50:0/2470716792 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ffe00700 1 --2- 172.21.15.50:0/2470716792 >> v2:172.21.15.181:3300/0 conn(0x7f61000cc6f0 0x7f610015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105400700 1 --2- 172.21.15.50:0/2470716792 >> v2:172.21.15.50:3300/0 conn(0x7f610006aaa0 0x7f610006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ffe00700 1 -- 172.21.15.50:0/2470716792 >> v2:172.21.15.50:3300/0 conn(0x7f610006aaa0 msgr2=0x7f610006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ffe00700 1 --2- 172.21.15.50:0/2470716792 >> v2:172.21.15.50:3300/0 conn(0x7f610006aaa0 0x7f610006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ffe00700 1 -- 172.21.15.50:0/2470716792 >> v1:172.21.15.50:6789/0 conn(0x7f61000cb020 legacy=0x7f610015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ffe00700 1 -- 172.21.15.50:0/2470716792 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610015b960 con 0x7f61000cc6f0 2024-09-13T15:10:59.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105400700 1 --2- 172.21.15.50:0/2470716792 >> v2:172.21.15.50:3300/0 conn(0x7f610006aaa0 0x7f610006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:10:59.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ffe00700 1 --2- 172.21.15.50:0/2470716792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61000cc6f0 0x7f610015b0e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f610015e630 tx=0x7f60ec009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68744e37b5e2346 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ff400700 1 -- 172.21.15.50:0/2470716792 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec011830 con 0x7f61000cc6f0 2024-09-13T15:10:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ff400700 1 -- 172.21.15.50:0/2470716792 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec011990 con 0x7f61000cc6f0 2024-09-13T15:10:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f60ff400700 1 -- 172.21.15.50:0/2470716792 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec011d20 con 0x7f61000cc6f0 2024-09-13T15:10:59.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105e00700 1 -- 172.21.15.50:0/2470716792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61000cc6f0 msgr2=0x7f610015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.041+0000 7f6105e00700 1 --2- 172.21.15.50:0/2470716792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61000cc6f0 0x7f610015b0e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f610015e630 tx=0x7f60ec009b30 comp rx=0 tx=0).stop 2024-09-13T15:10:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 -- 172.21.15.50:0/2470716792 shutdown_connections 2024-09-13T15:10:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 --2- 172.21.15.50:0/2470716792 >> v2:172.21.15.50:3300/0 conn(0x7f610006aaa0 0x7f610006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 --2- 172.21.15.50:0/2470716792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61000cc6f0 0x7f610015b0e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 -- 172.21.15.50:0/2470716792 >> 172.21.15.50:0/2470716792 conn(0x7f61000b0c40 msgr2=0x7f610006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 -- 172.21.15.50:0/2470716792 shutdown_connections 2024-09-13T15:10:59.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 -- 172.21.15.50:0/2470716792 wait complete. 2024-09-13T15:10:59.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 Processor -- start 2024-09-13T15:10:59.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.045+0000 7f6105e00700 1 -- start start 2024-09-13T15:10:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f610006aaa0 0x7f61000c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 0x7f61001555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61000cc6f0 0x7f6100153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6100144d10 con 0x7f61000cb020 2024-09-13T15:10:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61000ca2e0 con 0x7f610006aaa0 2024-09-13T15:10:59.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000ca000 con 0x7f61000cc6f0 2024-09-13T15:10:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 0x7f61001555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 0x7f61001555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58772/0 (socket says 172.21.15.50:58772) 2024-09-13T15:10:59.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 -- 172.21.15.50:0/821630774 learned_addr learned my addr 172.21.15.50:0/821630774 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6104a00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f610006aaa0 0x7f61000c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105400700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61000cc6f0 0x7f6100153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 -- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61000cc6f0 msgr2=0x7f6100153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61000cc6f0 0x7f6100153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 -- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f610006aaa0 msgr2=0x7f61000c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f610006aaa0 0x7f61000c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 -- 172.21.15.50:0/821630774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f8009a70 con 0x7f61000cb020 2024-09-13T15:10:59.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6104a00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f610006aaa0 0x7f61000c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60ffe00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 0x7f61001555d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f60ec014040 tx=0x7f60ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0036c0 con 0x7f61000cb020 2024-09-13T15:10:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec01e070 con 0x7f61000cb020 2024-09-13T15:10:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec0094b0 con 0x7f61000cb020 2024-09-13T15:10:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec003a40 con 0x7f61000cb020 2024-09-13T15:10:59.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.049+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6100154dd0 con 0x7f61000cb020 2024-09-13T15:10:59.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.053+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61000cb400 con 0x7f61000cb020 2024-09-13T15:10:59.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.053+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60ec003ba0 con 0x7f61000cb020 2024-09-13T15:10:59.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.053+0000 7f60fcc00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f60e0066730 0x7f60e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.053+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60ec085380 con 0x7f61000cb020 2024-09-13T15:10:59.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.057+0000 7f6104a00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f60e0066730 0x7f60e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.057+0000 7f6104a00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f60e0066730 0x7f60e0068bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f60f4007fd0 tx=0x7f60f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.061+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60ec0525a0 con 0x7f61000cb020 2024-09-13T15:10:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.285+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f610015b570 con 0x7f61000cb020 2024-09-13T15:10:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.285+0000 7f60fcc00700 1 -- 172.21.15.50:0/821630774 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f60ec055bc0 con 0x7f61000cb020 2024-09-13T15:10:59.290 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:10:59.290 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f60e0066730 msgr2=0x7f60e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f60e0066730 0x7f60e0068bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f60f4007fd0 tx=0x7f60f4009040 comp rx=0 tx=0).stop 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 msgr2=0x7f61001555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 0x7f61001555d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f60ec014040 tx=0x7f60ec004770 comp rx=0 tx=0).stop 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 shutdown_connections 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f60e0066730 0x7f60e0068bf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f61000cc6f0 0x7f6100153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61000cb020 0x7f61001555d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 --2- 172.21.15.50:0/821630774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f610006aaa0 0x7f61000c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 >> 172.21.15.50:0/821630774 conn(0x7f61000b0c40 msgr2=0x7f610015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 shutdown_connections 2024-09-13T15:10:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.289+0000 7f6105e00700 1 -- 172.21.15.50:0/821630774 wait complete. 2024-09-13T15:10:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:10:59.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:10:53.459545+0000', 'modified': '2024-09-13T15:10:56.477493+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6525}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6525': {'gid': 6525, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/1253018463', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 1253018463}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 1253018463}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:10:59.718 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:10:59.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T15:10:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.889+0000 7ff59ca00700 1 Processor -- start 2024-09-13T15:10:59.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.889+0000 7ff59ca00700 1 -- start start 2024-09-13T15:10:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.889+0000 7ff59ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.889+0000 7ff59ca00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5981599e0 0x7ff59806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.889+0000 7ff59ca00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff59806b830 0x7ff598070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff59ca00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5980b3d70 con 0x7ff5981599e0 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff59ca00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59806ae60 con 0x7ff59806b830 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff59ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b3aa0 con 0x7ff598159600 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5981599e0 0x7ff59806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff5981599e0 0x7ff59806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58782/0 (socket says 172.21.15.50:58782) 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 -- 172.21.15.50:0/1765418020 learned_addr learned my addr 172.21.15.50:0/1765418020 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff597e00700 1 --2- 172.21.15.50:0/1765418020 >> v2:172.21.15.181:3300/0 conn(0x7ff59806b830 0x7ff598070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff597400700 1 --2- 172.21.15.50:0/1765418020 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 -- 172.21.15.50:0/1765418020 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 msgr2=0x7ff5980b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 --2- 172.21.15.50:0/1765418020 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 -- 172.21.15.50:0/1765418020 >> v2:172.21.15.181:3300/0 conn(0x7ff59806b830 msgr2=0x7ff598070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 --2- 172.21.15.50:0/1765418020 >> v2:172.21.15.181:3300/0 conn(0x7ff59806b830 0x7ff598070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 -- 172.21.15.50:0/1765418020 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59806a530 con 0x7ff5981599e0 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff58fe00700 1 --2- 172.21.15.50:0/1765418020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981599e0 0x7ff59806b2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff59806add0 tx=0x7ff580009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86658cb0d08459b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff596a00700 1 -- 172.21.15.50:0/1765418020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011830 con 0x7ff5981599e0 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff596a00700 1 -- 172.21.15.50:0/1765418020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580011990 con 0x7ff5981599e0 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff596a00700 1 -- 172.21.15.50:0/1765418020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011d20 con 0x7ff5981599e0 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff59ca00700 1 -- 172.21.15.50:0/1765418020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981599e0 msgr2=0x7ff59806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.893+0000 7ff59ca00700 1 --2- 172.21.15.50:0/1765418020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981599e0 0x7ff59806b2f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff59806add0 tx=0x7ff580009bf0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 -- 172.21.15.50:0/1765418020 shutdown_connections 2024-09-13T15:10:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 --2- 172.21.15.50:0/1765418020 >> v2:172.21.15.181:3300/0 conn(0x7ff59806b830 0x7ff598070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 --2- 172.21.15.50:0/1765418020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981599e0 0x7ff59806b2f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 --2- 172.21.15.50:0/1765418020 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 -- 172.21.15.50:0/1765418020 >> 172.21.15.50:0/1765418020 conn(0x7ff59806e660 msgr2=0x7ff59806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 -- 172.21.15.50:0/1765418020 shutdown_connections 2024-09-13T15:10:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.897+0000 7ff59ca00700 1 -- 172.21.15.50:0/1765418020 wait complete. 2024-09-13T15:10:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 Processor -- start 2024-09-13T15:10:59.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 -- start start 2024-09-13T15:10:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5981599e0 0x7ff59814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 0x7ff598154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598154da0 con 0x7ff5981543b0 2024-09-13T15:10:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980c7780 con 0x7ff5981599e0 2024-09-13T15:10:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff59ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980c4bf0 con 0x7ff598159600 2024-09-13T15:10:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 0x7ff598154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 0x7ff598154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58794/0 (socket says 172.21.15.50:58794) 2024-09-13T15:10:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 -- 172.21.15.50:0/2646866164 learned_addr learned my addr 172.21.15.50:0/2646866164 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597400700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff58fe00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5981599e0 0x7ff59814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 -- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 msgr2=0x7ff5980c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 -- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5981599e0 msgr2=0x7ff59814f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5981599e0 0x7ff59814f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff597e00700 1 -- 172.21.15.50:0/2646866164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580009570 con 0x7ff5981543b0 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.901+0000 7ff58fe00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5981599e0 0x7ff59814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.905+0000 7ff597e00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 0x7ff598154860 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff59000ef00 tx=0x7ff59000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.905+0000 7ff58f400700 1 -- 172.21.15.50:0/2646866164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590010040 con 0x7ff5981543b0 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.905+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5980c4ed0 con 0x7ff5981543b0 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.905+0000 7ff58f400700 1 -- 172.21.15.50:0/2646866164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000baa0 con 0x7ff5981543b0 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.905+0000 7ff58f400700 1 -- 172.21.15.50:0/2646866164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000be50 con 0x7ff5981543b0 2024-09-13T15:10:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.905+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5980c5490 con 0x7ff5981543b0 2024-09-13T15:10:59.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58f400700 1 -- 172.21.15.50:0/2646866164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff590014400 con 0x7ff5981543b0 2024-09-13T15:10:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 Processor -- start 2024-09-13T15:10:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 -- start start 2024-09-13T15:10:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58f400700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff574066730 0x7ff574068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58f400700 1 -- 172.21.15.50:0/2646866164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff590084680 con 0x7ff5981543b0 2024-09-13T15:10:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xc9f9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9d7d00 0xc9c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f96c0 0xc9c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xc920d80 con 0xc9d7d00 2024-09-13T15:10:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xc91e510 con 0xc9f8da0 2024-09-13T15:10:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xc919e00 con 0xc9f96c0 2024-09-13T15:10:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58fe00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff574066730 0x7ff574068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9d7d00 0xc9c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff597400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xc9f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9d7d00 0xc9c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58800/0 (socket says 172.21.15.50:58800) 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff58fe00700 1 -- 172.21.15.50:0/865372457 learned_addr learned my addr 172.21.15.50:0/865372457 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.909+0000 7ff597e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f96c0 0xc9c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff597400700 1 -- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f96c0 msgr2=0xc9c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff597400700 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f96c0 0xc9c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff597400700 1 -- 172.21.15.50:0/865372457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9d7d00 msgr2=0xc9c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff597400700 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9d7d00 0xc9c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff597400700 1 -- 172.21.15.50:0/865372457 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc78c960 con 0xc9f8da0 2024-09-13T15:10:59.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff597400700 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xc9f9180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff588009c20 tx=0x7ff588009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fdabd71a42c7b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff58fe00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff574066730 0x7ff574068bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff58000a010 tx=0x7ff58000e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff587400700 1 -- 172.21.15.50:0/865372457 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588004300 con 0xc9f8da0 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff587400700 1 -- 172.21.15.50:0/865372457 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588004460 con 0xc9f8da0 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff587400700 1 -- 172.21.15.50:0/865372457 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880045d0 con 0xc9f8da0 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 -- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 msgr2=0xc9f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xc9f9180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff588009c20 tx=0x7ff588009f30 comp rx=0 tx=0).stop 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 -- 172.21.15.50:0/865372457 shutdown_connections 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f96c0 0xc9c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9d7d00 0xc9c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 --2- 172.21.15.50:0/865372457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xc9f9180 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 -- 172.21.15.50:0/865372457 >> 172.21.15.50:0/865372457 conn(0xc7414d0 msgr2=0xc9dac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 -- 172.21.15.50:0/865372457 shutdown_connections 2024-09-13T15:10:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 -- 172.21.15.50:0/865372457 wait complete. 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.913+0000 7ff5a1430740 1 -- start start 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 Processor -- start 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9d7d00 0xc9dbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f8da0 0xca02f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xc9dd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8d7730 con 0xc9f96c0 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8dd5b0 con 0xc9d7d00 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xc7c5aa0 con 0xc9f8da0 2024-09-13T15:10:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 10 client.0 _ll_register_callbacks cb 0xc913610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xc9dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xc9dd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58808/0 (socket says 172.21.15.50:58808) 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 -- 172.21.15.50:0/885119588 learned_addr learned my addr 172.21.15.50:0/885119588 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597400700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9d7d00 0xc9dbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff58fe00700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f8da0 0xca02f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 -- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f8da0 msgr2=0xca02f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f8da0 0xca02f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 -- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9d7d00 msgr2=0xc9dbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9d7d00 0xc9dbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 -- 172.21.15.50:0/885119588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff588009850 con 0xc9f96c0 2024-09-13T15:10:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff597e00700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xc9dd170 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff59000eed0 tx=0x7ff590023580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7013967a6bad75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff57be00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff57be00700 1 -- 172.21.15.50:0/885119588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590054bd0 con 0xc9f96c0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff57be00700 1 -- 172.21.15.50:0/885119588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff59006f060 con 0xc9f96c0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc74e1e0 con 0xc9f96c0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff57be00700 1 -- 172.21.15.50:0/885119588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff59005d440 con 0xc9f96c0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 10 client.6654 fetch_fsmap learned FSMap version 39 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0xc8e0220 con 0xc9f96c0 2024-09-13T15:10:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff57be00700 1 -- 172.21.15.50:0/885119588 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590080070 con 0xc9f96c0 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff57be00700 1 -- 172.21.15.50:0/885119588 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff59005b2a0 con 0xc9f96c0 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 10 client.6654 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.917+0000 7ff5a1430740 10 client.6654 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 20 client.6654 populate_metadata read hostname 'smithi050' 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xc9ddc00 0xc9da920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 4 client.6654 mds_command: new command op to 6525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:10:59.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 --> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc798460 con 0xc9ddc00 2024-09-13T15:10:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff597400700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xc9ddc00 0xc9da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff597400700 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xc9ddc00 0xc9da920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c9ec7e0262f1e69 server_cookie=1bb2bc43f80195b8 in_seq=0 out_seq=0 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff57be00700 10 client.6654 ms_handle_connect on v2:172.21.15.50:6834/1253018463 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff57be00700 1 -- 172.21.15.50:0/885119588 <== mds.0 v2:172.21.15.50:6834/1253018463 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0xc798460 con 0xc9ddc00 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff57be00700 10 client.6654 handle_command_reply: tid=0 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 client.6654 shutdown 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 msgr2=0xc9dd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xc9dd170 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff59000eed0 tx=0x7ff590023580 comp rx=0 tx=0).stop 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 shutdown_connections 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xc9ddc00 0xc9da920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xc9dd170 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9f8da0 0xca02f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff57be00700 0 client.6654 ms_handle_reset on v2:172.21.15.50:6834/1253018463 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 --2- 172.21.15.50:0/885119588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9d7d00 0xc9dbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 >> 172.21.15.50:0/885119588 conn(0xc7414d0 msgr2=0xc9b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 shutdown_connections 2024-09-13T15:10:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.921+0000 7ff5a1430740 1 -- 172.21.15.50:0/885119588 wait complete. 2024-09-13T15:10:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.925+0000 7ff5a1430740 20 client.6654 trim_cache size 0 max 16384 2024-09-13T15:10:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 Processor -- start 2024-09-13T15:10:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 -- start start 2024-09-13T15:10:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xca15290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca05d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9de200 con 0xc9f96c0 2024-09-13T15:10:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8e44f0 con 0xc9f8da0 2024-09-13T15:10:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xc948ec0 con 0xc9d7d00 2024-09-13T15:10:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58814/0 (socket says 172.21.15.50:58814) 2024-09-13T15:10:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 -- 172.21.15.50:0/2063011150 learned_addr learned my addr 172.21.15.50:0/2063011150 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff58fe00700 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca05d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597400700 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xca15290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 -- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 msgr2=0xca15290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xca15290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 -- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 msgr2=0xca05d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca05d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 -- 172.21.15.50:0/2063011150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc8c6450 con 0xc9f96c0 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff58fe00700 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca05d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff597e00700 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca062c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff59000bfd0 tx=0x7ff590057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dd00da15538c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.949+0000 7ff587e00700 1 -- 172.21.15.50:0/2063011150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900552b0 con 0xc9f96c0 2024-09-13T15:10:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff587e00700 1 -- 172.21.15.50:0/2063011150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590080040 con 0xc9f96c0 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff587e00700 1 -- 172.21.15.50:0/2063011150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59005d640 con 0xc9f96c0 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 -- 172.21.15.50:0/2063011150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 msgr2=0xca062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca062c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff59000bfd0 tx=0x7ff590057000 comp rx=0 tx=0).stop 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 -- 172.21.15.50:0/2063011150 shutdown_connections 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca062c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca05d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 --2- 172.21.15.50:0/2063011150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xca15290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 -- 172.21.15.50:0/2063011150 >> 172.21.15.50:0/2063011150 conn(0xc7414d0 msgr2=0xc9da920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 -- 172.21.15.50:0/2063011150 shutdown_connections 2024-09-13T15:10:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 -- 172.21.15.50:0/2063011150 wait complete. 2024-09-13T15:10:59.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.953+0000 7ff5a1430740 1 -- start start 2024-09-13T15:10:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 Processor -- start 2024-09-13T15:10:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xc9d9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca61fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca05dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9b1780 con 0xc9f96c0 2024-09-13T15:10:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9b0c70 con 0xc9f8da0 2024-09-13T15:10:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xc9b0f10 con 0xc9d7d00 2024-09-13T15:10:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 10 client.0 _ll_register_callbacks cb 0xc970710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:10:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca05dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca05dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58828/0 (socket says 172.21.15.50:58828) 2024-09-13T15:10:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 -- 172.21.15.50:0/759384989 learned_addr learned my addr 172.21.15.50:0/759384989 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:10:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597400700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xc9d9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff58fe00700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca61fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 -- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 msgr2=0xc9d9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xc9d9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 -- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 msgr2=0xca61fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca61fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 -- 172.21.15.50:0/759384989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc8e0220 con 0xc9f96c0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff597e00700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca05dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff590004ba0 tx=0x7ff590051950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6134ea47ad2ffb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff57be00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff57be00700 1 -- 172.21.15.50:0/759384989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590054bd0 con 0xc9f96c0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff57be00700 1 -- 172.21.15.50:0/759384989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff59005db20 con 0xc9f96c0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.957+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff588004460 con 0xc9f96c0 2024-09-13T15:10:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 1 -- 172.21.15.50:0/759384989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5900552b0 con 0xc9f96c0 2024-09-13T15:10:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 10 client.6660 fetch_fsmap learned FSMap version 39 2024-09-13T15:10:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0xc8ba720 con 0xc9f96c0 2024-09-13T15:10:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 1 -- 172.21.15.50:0/759384989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588004460 con 0xc9f96c0 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 1 -- 172.21.15.50:0/759384989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff59005dd00 con 0xc9f96c0 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 10 client.6660 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 10 client.6660 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 20 client.6660 populate_metadata read hostname 'smithi050' 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xca06300 0xca63360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 4 client.6660 mds_command: new command op to 6525 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 --> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] -- command(tid 0: {"prefix": "status"}) v1 -- 0xc7bd1e0 con 0xca06300 2024-09-13T15:10:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff597400700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xca06300 0xca63360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:59.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff597400700 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xca06300 0xca63360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e010971b42bacc server_cookie=9f36c86a0e66dd25 in_seq=0 out_seq=0 2024-09-13T15:10:59.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 10 client.6660 ms_handle_connect on v2:172.21.15.50:6834/1253018463 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 1 -- 172.21.15.50:0/759384989 <== mds.0 v2:172.21.15.50:6834/1253018463 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xc7bd1e0 con 0xca06300 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 10 client.6660 handle_command_reply: tid=0 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 client.6660 shutdown 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 msgr2=0xca05dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca05dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff590004ba0 tx=0x7ff590051950 comp rx=0 tx=0).stop 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 shutdown_connections 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0xca06300 0xca63360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xc9f96c0 0xca05dc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xc9f8da0 0xca61fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 --2- 172.21.15.50:0/759384989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xc9d7d00 0xc9d9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff57be00700 0 client.6660 ms_handle_reset on v2:172.21.15.50:6834/1253018463 2024-09-13T15:10:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 >> 172.21.15.50:0/759384989 conn(0xc7414d0 msgr2=0xc9db050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 shutdown_connections 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 1 -- 172.21.15.50:0/759384989 wait complete. 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.961+0000 7ff5a1430740 20 client.6660 trim_cache size 0 max 16384 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6525, 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:10:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:10:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.4999145049999996, 2024-09-13T15:10:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 39, 2024-09-13T15:10:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 77, 2024-09-13T15:10:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 77, 2024-09-13T15:10:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 11.71106666 2024-09-13T15:10:59.970 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff574066730 msgr2=0x7ff574068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff574066730 0x7ff574068bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff58000a010 tx=0x7ff58000e000 comp rx=0 tx=0).stop 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 msgr2=0x7ff598154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 0x7ff598154860 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff59000ef00 tx=0x7ff59000ef30 comp rx=0 tx=0).stop 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 shutdown_connections 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff574066730 0x7ff574068bf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5981543b0 0x7ff598154860 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5981599e0 0x7ff59814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 --2- 172.21.15.50:0/2646866164 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff598159600 0x7ff5980c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:59.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 >> 172.21.15.50:0/2646866164 conn(0x7ff59806e660 msgr2=0x7ff59815d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:59.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 shutdown_connections 2024-09-13T15:10:59.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:10:59.965+0000 7ff59ca00700 1 -- 172.21.15.50:0/2646866164 wait complete. 2024-09-13T15:10:59.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:11:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.165+0000 7f18e5800700 1 Processor -- start 2024-09-13T15:11:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.165+0000 7f18e5800700 1 -- start start 2024-09-13T15:11:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e5800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f18e0157040 0x7f18e00cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e5800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18e0157420 0x7f18e015d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e5800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00cc3c0 con 0x7f18e00ccba0 2024-09-13T15:11:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e5800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e015da70 con 0x7f18e0157420 2024-09-13T15:11:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e5800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e015dd50 con 0x7f18e0157040 2024-09-13T15:11:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18d7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18e0157420 0x7f18e015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e4e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f18e00ccba0 0x7f18e0066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59880/0 (socket says 172.21.15.50:59880) 2024-09-13T15:11:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18e4e00700 1 -- 172.21.15.50:0/3216320700 learned_addr learned my addr 172.21.15.50:0/3216320700 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18dfe00700 1 --2- 172.21.15.50:0/3216320700 >> v2:172.21.15.181:3300/0 conn(0x7f18e0157040 0x7f18e00cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18df400700 1 -- 172.21.15.50:0/3216320700 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009129009 0 0) 0x7f18e00cc3c0 con 0x7f18e00ccba0 2024-09-13T15:11:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18df400700 1 -- 172.21.15.50:0/3216320700 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c40035d0 con 0x7f18e00ccba0 2024-09-13T15:11:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18d7400700 1 -- 172.21.15.50:0/3216320700 >> v2:172.21.15.181:3300/0 conn(0x7f18e0157040 msgr2=0x7f18e00cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18d7400700 1 --2- 172.21.15.50:0/3216320700 >> v2:172.21.15.181:3300/0 conn(0x7f18e0157040 0x7f18e00cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18d7400700 1 -- 172.21.15.50:0/3216320700 >> v1:172.21.15.50:6789/0 conn(0x7f18e00ccba0 legacy=0x7f18e0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18d7400700 1 -- 172.21.15.50:0/3216320700 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e015e030 con 0x7f18e0157420 2024-09-13T15:11:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18d7400700 1 --2- 172.21.15.50:0/3216320700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0157420 0x7f18e015d220 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f18e006d8c0 tx=0x7f18c8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae15423533090213 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18df400700 1 -- 172.21.15.50:0/3216320700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011830 con 0x7f18e0157420 2024-09-13T15:11:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18df400700 1 -- 172.21.15.50:0/3216320700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8011990 con 0x7f18e0157420 2024-09-13T15:11:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.169+0000 7f18df400700 1 -- 172.21.15.50:0/3216320700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011d00 con 0x7f18e0157420 2024-09-13T15:11:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 -- 172.21.15.50:0/3216320700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0157420 msgr2=0x7f18e015d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 --2- 172.21.15.50:0/3216320700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0157420 0x7f18e015d220 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f18e006d8c0 tx=0x7f18c8009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 -- 172.21.15.50:0/3216320700 shutdown_connections 2024-09-13T15:11:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 --2- 172.21.15.50:0/3216320700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0157420 0x7f18e015d220 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 --2- 172.21.15.50:0/3216320700 >> v2:172.21.15.181:3300/0 conn(0x7f18e0157040 0x7f18e00cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 -- 172.21.15.50:0/3216320700 >> 172.21.15.50:0/3216320700 conn(0x7f18e006ca10 msgr2=0x7f18e006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 -- 172.21.15.50:0/3216320700 shutdown_connections 2024-09-13T15:11:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 -- 172.21.15.50:0/3216320700 wait complete. 2024-09-13T15:11:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 Processor -- start 2024-09-13T15:11:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.173+0000 7f18e5800700 1 -- start start 2024-09-13T15:11:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 0x7f18e014f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18e0157040 0x7f18e0159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18e0157420 0x7f18e015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e014f590 con 0x7f18e00ccba0 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c9240 con 0x7f18e0157420 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c94c0 con 0x7f18e0157040 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 0x7f18e014f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 0x7f18e014f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58848/0 (socket says 172.21.15.50:58848) 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 -- 172.21.15.50:0/3782174471 learned_addr learned my addr 172.21.15.50:0/3782174471 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18d7400700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18e0157040 0x7f18e0159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e4e00700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18e0157420 0x7f18e015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 -- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18e0157040 msgr2=0x7f18e0159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18e0157040 0x7f18e0159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 -- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18e0157420 msgr2=0x7f18e015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18e0157420 0x7f18e015a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 -- 172.21.15.50:0/3782174471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80094b0 con 0x7f18e00ccba0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dfe00700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 0x7f18e014f050 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f18d000efc0 tx=0x7f18d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000cdc0 con 0x7f18e00ccba0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000f040 con 0x7f18e00ccba0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00146a0 con 0x7f18e00ccba0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00c97a0 con 0x7f18e00ccba0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.177+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00c9d60 con 0x7f18e00ccba0 2024-09-13T15:11:00.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.181+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00ccfb0 con 0x7f18e00ccba0 2024-09-13T15:11:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.181+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18d0014800 con 0x7f18e00ccba0 2024-09-13T15:11:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.181+0000 7f18dcc00700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f18bc066760 0x7f18bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.181+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f18d0084bb0 con 0x7f18e00ccba0 2024-09-13T15:11:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.185+0000 7f18d7400700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f18bc066760 0x7f18bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.185+0000 7f18d7400700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f18bc066760 0x7f18bc068c20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000c00 tx=0x7f18c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:00.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.189+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18d0051dd0 con 0x7f18e00ccba0 2024-09-13T15:11:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.425+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f18e014f6e0 con 0x7f18e00ccba0 2024-09-13T15:11:00.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.425+0000 7f18dcc00700 1 -- 172.21.15.50:0/3782174471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f18d00553f0 con 0x7f18e00ccba0 2024-09-13T15:11:00.428 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:11:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f18bc066760 msgr2=0x7f18bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f18bc066760 0x7f18bc068c20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000c00 tx=0x7f18c8008030 comp rx=0 tx=0).stop 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 msgr2=0x7f18e014f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 0x7f18e014f050 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f18d000efc0 tx=0x7f18d000c3a0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 shutdown_connections 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f18bc066760 0x7f18bc068c20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18e0157420 0x7f18e015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18e0157040 0x7f18e0159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 --2- 172.21.15.50:0/3782174471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e00ccba0 0x7f18e014f050 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 >> 172.21.15.50:0/3782174471 conn(0x7f18e006ca10 msgr2=0x7f18e015adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 shutdown_connections 2024-09-13T15:11:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:00.429+0000 7f18e5800700 1 -- 172.21.15.50:0/3782174471 wait complete. 2024-09-13T15:11:00.454 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:11:00.455 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:11:00.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.455 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42246sec preferred_lft 42246sec 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:00.476 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:11:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:11:00.478 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:00.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.479 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:11:00.555 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:11:00.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.558 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:11:00.621 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:11:00.621 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:11:00.621 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:11:00.621 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:11:00.621 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:11:00.622 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:11:00.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.623 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:11:00.623 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:11:00.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:11:00.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:11:00.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:11:00.623 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:11:00.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.757 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:11:00.774 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:11:00.774 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:11:00.775 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:11:00.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:11:00.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:00.854 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:00.913 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:11:00.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:00.914 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:00.973 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:11:00.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:00.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:01.108 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:01.108 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:01.132 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:01.132 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:01.132 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:11:01.132 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:11:01.132 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:11:01.140 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:11:01.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:01.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:01.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:01.171 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:11:01.251 INFO:teuthology.orchestra.run.smithi050.stdout:client6631 2024-09-13T15:11:01.252 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:01.252 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:01.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:11:01.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.537+0000 7f5265200700 1 Processor -- start 2024-09-13T15:11:01.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f5265200700 1 -- start start 2024-09-13T15:11:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f5265200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5260161150 0x7f52600cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f5265200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f526006aaa0 0x7f52600ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f5265200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600cb1a0 con 0x7f52600cc740 2024-09-13T15:11:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f5265200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600cb440 con 0x7f5260161150 2024-09-13T15:11:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f5265200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600cb720 con 0x7f526006aaa0 2024-09-13T15:11:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f525de00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5260161150 0x7f52600cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f525d400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f52600cc740 0x7f526006a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59890/0 (socket says 172.21.15.50:59890) 2024-09-13T15:11:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.541+0000 7f525d400700 1 -- 172.21.15.50:0/1215151107 learned_addr learned my addr 172.21.15.50:0/1215151107 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525e800700 1 --2- 172.21.15.50:0/1215151107 >> v2:172.21.15.181:3300/0 conn(0x7f526006aaa0 0x7f52600ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525de00700 1 -- 172.21.15.50:0/1215151107 >> v2:172.21.15.181:3300/0 conn(0x7f526006aaa0 msgr2=0x7f52600ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525de00700 1 --2- 172.21.15.50:0/1215151107 >> v2:172.21.15.181:3300/0 conn(0x7f526006aaa0 0x7f52600ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525de00700 1 -- 172.21.15.50:0/1215151107 >> v1:172.21.15.50:6789/0 conn(0x7f52600cc740 legacy=0x7f526006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525de00700 1 -- 172.21.15.50:0/1215151107 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600cba00 con 0x7f5260161150 2024-09-13T15:11:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525ca00700 1 -- 172.21.15.50:0/1215151107 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251731939 0 0) 0x7f52600cb1a0 con 0x7f52600cc740 2024-09-13T15:11:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525de00700 1 --2- 172.21.15.50:0/1215151107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5260161150 0x7f52600cc200 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f52600d0d70 tx=0x7f5250009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b78e1936c622aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525ca00700 1 -- 172.21.15.50:0/1215151107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250011830 con 0x7f5260161150 2024-09-13T15:11:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525ca00700 1 -- 172.21.15.50:0/1215151107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250011990 con 0x7f5260161150 2024-09-13T15:11:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f525ca00700 1 -- 172.21.15.50:0/1215151107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250011d20 con 0x7f5260161150 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 -- 172.21.15.50:0/1215151107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5260161150 msgr2=0x7f52600cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 --2- 172.21.15.50:0/1215151107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5260161150 0x7f52600cc200 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f52600d0d70 tx=0x7f5250009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 -- 172.21.15.50:0/1215151107 shutdown_connections 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 --2- 172.21.15.50:0/1215151107 >> v2:172.21.15.181:3300/0 conn(0x7f526006aaa0 0x7f52600ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 --2- 172.21.15.50:0/1215151107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5260161150 0x7f52600cc200 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 -- 172.21.15.50:0/1215151107 >> 172.21.15.50:0/1215151107 conn(0x7f5260071f00 msgr2=0x7f52600722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 -- 172.21.15.50:0/1215151107 shutdown_connections 2024-09-13T15:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.545+0000 7f5265200700 1 -- 172.21.15.50:0/1215151107 wait complete. 2024-09-13T15:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.549+0000 7f5265200700 1 Processor -- start 2024-09-13T15:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.549+0000 7f5265200700 1 -- start start 2024-09-13T15:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f526006aaa0 0x7f52600c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 0x7f5260151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5260161150 0x7f5260152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526014f980 con 0x7f52600cc740 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600c3520 con 0x7f5260161150 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526014fbc0 con 0x7f526006aaa0 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 0x7f5260151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 0x7f5260151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58872/0 (socket says 172.21.15.50:58872) 2024-09-13T15:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 -- 172.21.15.50:0/877736170 learned_addr learned my addr 172.21.15.50:0/877736170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:01.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525e800700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5260161150 0x7f5260152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:01.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525de00700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f526006aaa0 0x7f52600c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:01.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 -- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f526006aaa0 msgr2=0x7f52600c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f526006aaa0 0x7f52600c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 -- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5260161150 msgr2=0x7f5260152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5260161150 0x7f5260152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 -- 172.21.15.50:0/877736170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500094b0 con 0x7f52600cc740 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f525d400700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 0x7f5260151c50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c580 tx=0x7f524c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c004ca0 con 0x7f52600cc740 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c004e20 con 0x7f52600cc740 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52600ca4b0 con 0x7f52600cc740 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c007310 con 0x7f52600cc740 2024-09-13T15:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.553+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52601503d0 con 0x7f52600cc740 2024-09-13T15:11:01.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.557+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526014ff30 con 0x7f52600cc740 2024-09-13T15:11:01.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.557+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f524c007470 con 0x7f52600cc740 2024-09-13T15:11:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.557+0000 7f5256000700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5240066730 0x7f5240068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.561+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f524c084090 con 0x7f52600cc740 2024-09-13T15:11:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.561+0000 7f525de00700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5240066730 0x7f5240068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.561+0000 7f525de00700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5240066730 0x7f5240068bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5250009fd0 tx=0x7f5250008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:01.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.565+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f524c0512c0 con 0x7f52600cc740 2024-09-13T15:11:01.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.789+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f52601505f0 con 0x7f52600cc740 2024-09-13T15:11:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.789+0000 7f5256000700 1 -- 172.21.15.50:0/877736170 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f524c007720 con 0x7f52600cc740 2024-09-13T15:11:01.793 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:11:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5240066730 msgr2=0x7f5240068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5240066730 0x7f5240068bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5250009fd0 tx=0x7f5250008030 comp rx=0 tx=0).stop 2024-09-13T15:11:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 msgr2=0x7f5260151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 0x7f5260151c50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c580 tx=0x7f524c00c940 comp rx=0 tx=0).stop 2024-09-13T15:11:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 shutdown_connections 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5240066730 0x7f5240068bf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5260161150 0x7f5260152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52600cc740 0x7f5260151c50 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 --2- 172.21.15.50:0/877736170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f526006aaa0 0x7f52600c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 >> 172.21.15.50:0/877736170 conn(0x7f5260071f00 msgr2=0x7f52600cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 shutdown_connections 2024-09-13T15:11:01.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:01.793+0000 7f5265200700 1 -- 172.21.15.50:0/877736170 wait complete. 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:11:01.819 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:11:01.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:01.820 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:11:01.837 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:11:01.837 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:11:01.837 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:11:01.837 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.837 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42235sec preferred_lft 42235sec 2024-09-13T15:11:01.838 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:11:01.839 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.840 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:11:01.840 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.840 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:01.841 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:11:01.841 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:11:01.841 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.841 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:01.841 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:11:01.841 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:11:01.842 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:01.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:01.842 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:11:01.924 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:11:01.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:01.927 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:11:01.985 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:11:01.986 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:11:01.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:01.987 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:11:01.987 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:11:01.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:11:01.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:11:01.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:11:01.988 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:11:02.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:02.115 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:11:02.130 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:11:02.131 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:11:02.131 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:11:02.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:02.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:11:02.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:02.211 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:02.268 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:11:02.268 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:02.268 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:02.333 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:11:02.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:02.333 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:02.461 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:02.461 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:02.486 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:02.486 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:02.487 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:11:02.487 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:11:02.487 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:11:02.495 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:11:02.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:02.496 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:02.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:02.524 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:11:02.595 INFO:teuthology.orchestra.run.smithi181.stdout:client6026 2024-09-13T15:11:02.595 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:02.595 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:02.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-13T15:11:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac7de00700 1 Processor -- start 2024-09-13T15:11:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac7de00700 1 -- start start 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac7de00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fac78145b60 0x7fac78070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac7de00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac780b3b80 con 0x7fac780b5a40 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac7de00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac780b5e80 con 0x7fac7806b4b0 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac7de00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac781469f0 con 0x7fac78145b60 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac76a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fac78145b60 0x7fac78070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac76000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fac780b5a40 0x7fac7806ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59898/0 (socket says 172.21.15.50:59898) 2024-09-13T15:11:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.833+0000 7fac76000700 1 -- 172.21.15.50:0/2253935527 learned_addr learned my addr 172.21.15.50:0/2253935527 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac76a00700 1 -- 172.21.15.50:0/2253935527 >> v1:172.21.15.181:6789/0 conn(0x7fac7806b4b0 legacy=0x7fac780d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac76a00700 1 -- 172.21.15.50:0/2253935527 >> v1:172.21.15.50:6789/0 conn(0x7fac780b5a40 legacy=0x7fac7806ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac76a00700 1 -- 172.21.15.50:0/2253935527 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac78145f40 con 0x7fac78145b60 2024-09-13T15:11:02.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac76a00700 1 --2- 172.21.15.50:0/2253935527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac78145b60 0x7fac78070490 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac68009850 tx=0x7fac68009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5459743a2858b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:02.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac75600700 1 -- 172.21.15.50:0/2253935527 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68011830 con 0x7fac78145b60 2024-09-13T15:11:02.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac75600700 1 -- 172.21.15.50:0/2253935527 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac68011990 con 0x7fac78145b60 2024-09-13T15:11:02.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac75600700 1 -- 172.21.15.50:0/2253935527 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68011d20 con 0x7fac78145b60 2024-09-13T15:11:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 -- 172.21.15.50:0/2253935527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac78145b60 msgr2=0x7fac78070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 --2- 172.21.15.50:0/2253935527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac78145b60 0x7fac78070490 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac68009850 tx=0x7fac68009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 -- 172.21.15.50:0/2253935527 shutdown_connections 2024-09-13T15:11:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 --2- 172.21.15.50:0/2253935527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac78145b60 0x7fac78070490 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 -- 172.21.15.50:0/2253935527 >> 172.21.15.50:0/2253935527 conn(0x7fac7806e660 msgr2=0x7fac7806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:02.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 -- 172.21.15.50:0/2253935527 shutdown_connections 2024-09-13T15:11:02.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.837+0000 7fac7de00700 1 -- 172.21.15.50:0/2253935527 wait complete. 2024-09-13T15:11:02.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 Processor -- start 2024-09-13T15:11:02.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 -- start start 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 0x7fac7815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac780b5a40 0x7fac780b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac78145b60 0x7fac780b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7813e550 con 0x7fac78145b60 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7813edb0 con 0x7fac7806b4b0 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac7de00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7813df90 con 0x7fac780b5a40 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac77400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac78145b60 0x7fac780b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac76a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 0x7fac7815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac77400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac78145b60 0x7fac780b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58876/0 (socket says 172.21.15.50:58876) 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac77400700 1 -- 172.21.15.50:0/1215884683 learned_addr learned my addr 172.21.15.50:0/1215884683 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac76a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 0x7fac7815b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:56174/0 (socket says 172.21.15.50:56174) 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.841+0000 7fac76000700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac780b5a40 0x7fac780b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac76a00700 1 -- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac780b5a40 msgr2=0x7fac780b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac76a00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac780b5a40 0x7fac780b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac76a00700 1 -- 172.21.15.50:0/1215884683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac78145b60 msgr2=0x7fac780b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac76a00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac78145b60 0x7fac780b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac76a00700 1 -- 172.21.15.50:0/1215884683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac680094b0 con 0x7fac7806b4b0 2024-09-13T15:11:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac76a00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 0x7fac7815b220 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac68016000 tx=0x7fac68004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680036c0 con 0x7fac7806b4b0 2024-09-13T15:11:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6801e070 con 0x7fac7806b4b0 2024-09-13T15:11:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68003a80 con 0x7fac7806b4b0 2024-09-13T15:11:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7813e270 con 0x7fac7806b4b0 2024-09-13T15:11:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7813db00 con 0x7fac7806b4b0 2024-09-13T15:11:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.845+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7804e7a0 con 0x7fac7806b4b0 2024-09-13T15:11:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.849+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac68003be0 con 0x7fac7806b4b0 2024-09-13T15:11:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.849+0000 7fac6f400700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac58066730 0x7fac58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.849+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fac680850e0 con 0x7fac7806b4b0 2024-09-13T15:11:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.849+0000 7fac76000700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac58066730 0x7fac58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:02.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.853+0000 7fac76000700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac58066730 0x7fac58068bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fac7806ebf0 tx=0x7fac64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:02.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:02.861+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac68052300 con 0x7fac7806b4b0 2024-09-13T15:11:03.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.053+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7fac7806c0d0 con 0x7fac7806b4b0 2024-09-13T15:11:03.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.065+0000 7fac6f400700 1 -- 172.21.15.50:0/1215884683 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fac68023e90 con 0x7fac7806b4b0 2024-09-13T15:11:03.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac58066730 msgr2=0x7fac58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac58066730 0x7fac58068bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fac7806ebf0 tx=0x7fac64009040 comp rx=0 tx=0).stop 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 msgr2=0x7fac7815b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 0x7fac7815b220 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac68016000 tx=0x7fac68004770 comp rx=0 tx=0).stop 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 shutdown_connections 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac58066730 0x7fac58068bf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac78145b60 0x7fac780b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac780b5a40 0x7fac780b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 --2- 172.21.15.50:0/1215884683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac7806b4b0 0x7fac7815b220 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 >> 172.21.15.50:0/1215884683 conn(0x7fac7806e660 msgr2=0x7fac780cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 shutdown_connections 2024-09-13T15:11:03.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.069+0000 7fac7de00700 1 -- 172.21.15.50:0/1215884683 wait complete. 2024-09-13T15:11:03.097 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:03.097 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:03.114 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:03.114 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:03.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:03.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.381+0000 7f2e17e00700 1 Processor -- start 2024-09-13T15:11:03.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.381+0000 7f2e17e00700 1 -- start start 2024-09-13T15:11:03.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e1806aaa0 0x7f2e1806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2e180b2670 0x7f2e180b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180b3560 con 0x7f2e181610b0 2024-09-13T15:11:03.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e18070b30 con 0x7f2e1806aaa0 2024-09-13T15:11:03.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1806b450 con 0x7f2e180b2670 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e0e000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e1806aaa0 0x7f2e1806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e16a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e181610b0 0x7f2e180719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58390/0 (socket says 172.21.15.50:58390) 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e16a00700 1 -- 172.21.15.50:0/4038298957 learned_addr learned my addr 172.21.15.50:0/4038298957 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17400700 1 --2- 172.21.15.50:0/4038298957 >> v2:172.21.15.181:3300/0 conn(0x7f2e180b2670 0x7f2e180b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e0e000700 1 -- 172.21.15.50:0/4038298957 >> v2:172.21.15.181:3300/0 conn(0x7f2e180b2670 msgr2=0x7f2e180b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e0e000700 1 --2- 172.21.15.50:0/4038298957 >> v2:172.21.15.181:3300/0 conn(0x7f2e180b2670 0x7f2e180b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e0e000700 1 -- 172.21.15.50:0/4038298957 >> v1:172.21.15.50:6789/0 conn(0x7f2e181610b0 legacy=0x7f2e180719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e0e000700 1 -- 172.21.15.50:0/4038298957 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180b3000 con 0x7f2e1806aaa0 2024-09-13T15:11:03.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e17400700 1 --2- 172.21.15.50:0/4038298957 >> v2:172.21.15.181:3300/0 conn(0x7f2e180b2670 0x7f2e180b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:03.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e16000700 1 -- 172.21.15.50:0/4038298957 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374982469 0 0) 0x7f2e180b3560 con 0x7f2e181610b0 2024-09-13T15:11:03.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e0e000700 1 --2- 172.21.15.50:0/4038298957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1806aaa0 0x7f2e1806af10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009880 tx=0x7f2e00009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5e49b55cf9e0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:03.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e16000700 1 -- 172.21.15.50:0/4038298957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011830 con 0x7f2e1806aaa0 2024-09-13T15:11:03.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e16000700 1 -- 172.21.15.50:0/4038298957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00011990 con 0x7f2e1806aaa0 2024-09-13T15:11:03.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.385+0000 7f2e16000700 1 -- 172.21.15.50:0/4038298957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011d20 con 0x7f2e1806aaa0 2024-09-13T15:11:03.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 -- 172.21.15.50:0/4038298957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1806aaa0 msgr2=0x7f2e1806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 --2- 172.21.15.50:0/4038298957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1806aaa0 0x7f2e1806af10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009880 tx=0x7f2e00009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 -- 172.21.15.50:0/4038298957 shutdown_connections 2024-09-13T15:11:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 --2- 172.21.15.50:0/4038298957 >> v2:172.21.15.181:3300/0 conn(0x7f2e180b2670 0x7f2e180b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 --2- 172.21.15.50:0/4038298957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e1806aaa0 0x7f2e1806af10 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 -- 172.21.15.50:0/4038298957 >> 172.21.15.50:0/4038298957 conn(0x7f2e180b0c40 msgr2=0x7f2e1806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 -- 172.21.15.50:0/4038298957 shutdown_connections 2024-09-13T15:11:03.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 -- 172.21.15.50:0/4038298957 wait complete. 2024-09-13T15:11:03.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 Processor -- start 2024-09-13T15:11:03.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.389+0000 7f2e17e00700 1 -- start start 2024-09-13T15:11:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e1806aaa0 0x7f2e181f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e180b2670 0x7f2e181f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 0x7f2e180af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18164370 con 0x7f2e181610b0 2024-09-13T15:11:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181f79f0 con 0x7f2e180b2670 2024-09-13T15:11:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18162bb0 con 0x7f2e1806aaa0 2024-09-13T15:11:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 0x7f2e180af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 0x7f2e180af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58052/0 (socket says 172.21.15.50:58052) 2024-09-13T15:11:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 -- 172.21.15.50:0/2603164843 learned_addr learned my addr 172.21.15.50:0/2603164843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e0e000700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e180b2670 0x7f2e181f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e16a00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e1806aaa0 0x7f2e181f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 -- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e1806aaa0 msgr2=0x7f2e181f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e1806aaa0 0x7f2e181f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 -- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e180b2670 msgr2=0x7f2e181f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e180b2670 0x7f2e181f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 -- 172.21.15.50:0/2603164843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094b0 con 0x7f2e181610b0 2024-09-13T15:11:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e16a00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e1806aaa0 0x7f2e181f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e0e000700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e180b2670 0x7f2e181f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17400700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 0x7f2e180af6d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000cef0 tx=0x7f2e1000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000ae50 con 0x7f2e181610b0 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10015440 con 0x7f2e181610b0 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100157f0 con 0x7f2e181610b0 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e18162e90 con 0x7f2e181610b0 2024-09-13T15:11:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.393+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e18163450 con 0x7f2e181610b0 2024-09-13T15:11:03.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.397+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e18161490 con 0x7f2e181610b0 2024-09-13T15:11:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.397+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e1000d430 con 0x7f2e181610b0 2024-09-13T15:11:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.401+0000 7f2e0f400700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2df4066730 0x7f2df4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.401+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e10084940 con 0x7f2e181610b0 2024-09-13T15:11:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.401+0000 7f2e16a00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2df4066730 0x7f2df4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.401+0000 7f2e16a00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2df4066730 0x7f2df4068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2e08000f60 tx=0x7f2e08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:03.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.409+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e10051ae0 con 0x7f2e181610b0 2024-09-13T15:11:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.597+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e180673c0 con 0x7f2e181610b0 2024-09-13T15:11:03.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.597+0000 7f2e0f400700 1 -- 172.21.15.50:0/2603164843 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16765 (secure 0 0 0) 0x7f2e1001a090 con 0x7f2e181610b0 2024-09-13T15:11:03.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:03.602 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:54.464580+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2df4066730 msgr2=0x7f2df4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2df4066730 0x7f2df4068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2e08000f60 tx=0x7f2e08009040 comp rx=0 tx=0).stop 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 msgr2=0x7f2e180af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 0x7f2e180af6d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000cef0 tx=0x7f2e1000a340 comp rx=0 tx=0).stop 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 shutdown_connections 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2df4066730 0x7f2df4068bf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e181610b0 0x7f2e180af6d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e180b2670 0x7f2e181f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 --2- 172.21.15.50:0/2603164843 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e1806aaa0 0x7f2e181f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 >> 172.21.15.50:0/2603164843 conn(0x7f2e180b0c40 msgr2=0x7f2e1806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 shutdown_connections 2024-09-13T15:11:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.601+0000 7f2e17e00700 1 -- 172.21.15.50:0/2603164843 wait complete. 2024-09-13T15:11:03.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:10:51.524270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:10:52.462039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:03.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.797+0000 7f258ac00700 1 Processor -- start 2024-09-13T15:11:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.797+0000 7f258ac00700 1 -- start start 2024-09-13T15:11:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.797+0000 7f258ac00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f258415af60 0x7f2584066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.797+0000 7f258ac00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840669e0 con 0x7f258415ab80 2024-09-13T15:11:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.797+0000 7f258ac00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258406a780 con 0x7f25840665d0 2024-09-13T15:11:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.797+0000 7f258ac00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2584070fd0 con 0x7f258415af60 2024-09-13T15:11:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f258415ab80 0x7f25840cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58404/0 (socket says 172.21.15.50:58404) 2024-09-13T15:11:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583e00700 1 -- 172.21.15.50:0/2085801645 learned_addr learned my addr 172.21.15.50:0/2085801645 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583400700 1 --2- 172.21.15.50:0/2085801645 >> v2:172.21.15.181:3300/0 conn(0x7f258415af60 0x7f2584066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2582a00700 1 -- 172.21.15.50:0/2085801645 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139438616 0 0) 0x7f25840669e0 con 0x7f258415ab80 2024-09-13T15:11:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2582a00700 1 -- 172.21.15.50:0/2085801645 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25680035d0 con 0x7f258415ab80 2024-09-13T15:11:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583400700 1 -- 172.21.15.50:0/2085801645 >> v1:172.21.15.181:6789/0 conn(0x7f25840665d0 legacy=0x7f258415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2582a00700 1 -- 172.21.15.50:0/2085801645 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855261738 0 0) 0x7f258406a780 con 0x7f25840665d0 2024-09-13T15:11:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583400700 1 -- 172.21.15.50:0/2085801645 >> v1:172.21.15.50:6789/0 conn(0x7f258415ab80 legacy=0x7f25840cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583400700 1 -- 172.21.15.50:0/2085801645 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840712b0 con 0x7f258415af60 2024-09-13T15:11:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2583400700 1 --2- 172.21.15.50:0/2085801645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584066090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2570009850 tx=0x7f2570009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82a2f14924c87a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2582a00700 1 -- 172.21.15.50:0/2085801645 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570011830 con 0x7f258415af60 2024-09-13T15:11:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2582a00700 1 -- 172.21.15.50:0/2085801645 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570011990 con 0x7f258415af60 2024-09-13T15:11:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f2582a00700 1 -- 172.21.15.50:0/2085801645 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570011d40 con 0x7f258415af60 2024-09-13T15:11:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f258ac00700 1 -- 172.21.15.50:0/2085801645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 msgr2=0x7f2584066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.801+0000 7f258ac00700 1 --2- 172.21.15.50:0/2085801645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584066090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2570009850 tx=0x7f2570009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 -- 172.21.15.50:0/2085801645 shutdown_connections 2024-09-13T15:11:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 --2- 172.21.15.50:0/2085801645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584066090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 -- 172.21.15.50:0/2085801645 >> 172.21.15.50:0/2085801645 conn(0x7f258406e660 msgr2=0x7f258406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 -- 172.21.15.50:0/2085801645 shutdown_connections 2024-09-13T15:11:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 -- 172.21.15.50:0/2085801645 wait complete. 2024-09-13T15:11:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 Processor -- start 2024-09-13T15:11:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.805+0000 7f258ac00700 1 -- start start 2024-09-13T15:11:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25840665d0 0x7f2584151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 0x7f2584153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841f2a00 con 0x7f258415ab80 2024-09-13T15:11:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840ca720 con 0x7f258415af60 2024-09-13T15:11:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2584152440 con 0x7f25840665d0 2024-09-13T15:11:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 0x7f2584153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 0x7f2584153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58066/0 (socket says 172.21.15.50:58066) 2024-09-13T15:11:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 -- 172.21.15.50:0/1012588768 learned_addr learned my addr 172.21.15.50:0/1012588768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583e00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25840665d0 0x7f2584151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2588c00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 -- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25840665d0 msgr2=0x7f2584151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25840665d0 0x7f2584151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 -- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 msgr2=0x7f2584148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 -- 172.21.15.50:0/1012588768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700094b0 con 0x7f258415ab80 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583e00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25840665d0 0x7f2584151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2588c00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f2583400700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 0x7f2584153bf0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2584066b90 tx=0x7f2570004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257001ab70 con 0x7f258415ab80 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257001f070 con 0x7f258415ab80 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584152160 con 0x7f258415ab80 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257001b430 con 0x7f258415ab80 2024-09-13T15:11:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.809+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25840ca3b0 con 0x7f258415ab80 2024-09-13T15:11:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.813+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584066f80 con 0x7f258415ab80 2024-09-13T15:11:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.813+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f257001b590 con 0x7f258415ab80 2024-09-13T15:11:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.813+0000 7f257be00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2564066760 0x7f2564068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.813+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2570085400 con 0x7f258415ab80 2024-09-13T15:11:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.817+0000 7f2583e00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2564066760 0x7f2564068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:03.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.817+0000 7f2583e00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2564066760 0x7f2564068c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2574005930 tx=0x7f2574009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:03.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.817+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2570052620 con 0x7f258415ab80 2024-09-13T15:11:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:03.997+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2584066090 con 0x7f258415ab80 2024-09-13T15:11:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f257be00700 1 -- 172.21.15.50:0/1012588768 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2570015020 con 0x7f258415ab80 2024-09-13T15:11:04.002 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2564066760 msgr2=0x7f2564068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2564066760 0x7f2564068c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2574005930 tx=0x7f2574009040 comp rx=0 tx=0).stop 2024-09-13T15:11:04.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 msgr2=0x7f2584153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 0x7f2584153bf0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2584066b90 tx=0x7f2570004770 comp rx=0 tx=0).stop 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 shutdown_connections 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2564066760 0x7f2564068c20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f258415af60 0x7f2584148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f258415ab80 0x7f2584153bf0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 --2- 172.21.15.50:0/1012588768 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f25840665d0 0x7f2584151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.001+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 >> 172.21.15.50:0/1012588768 conn(0x7f258406e660 msgr2=0x7f25840cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.005+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 shutdown_connections 2024-09-13T15:11:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.005+0000 7f258ac00700 1 -- 172.21.15.50:0/1012588768 wait complete. 2024-09-13T15:11:04.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:11:04.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.197+0000 7fc44a000700 1 Processor -- start 2024-09-13T15:11:04.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.197+0000 7fc44a000700 1 -- start start 2024-09-13T15:11:04.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc44a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc444161110 0x7fc44406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc44a000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4440b0020 con 0x7fc444160d30 2024-09-13T15:11:04.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc44a000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44406b580 con 0x7fc44406b170 2024-09-13T15:11:04.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc44a000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440d1770 con 0x7fc444161110 2024-09-13T15:11:04.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc443e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc444161110 0x7fc44406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc449600700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc44406b170 0x7fc4440b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52452/0 (socket says 172.21.15.50:52452) 2024-09-13T15:11:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.201+0000 7fc449600700 1 -- 172.21.15.50:0/1286303738 learned_addr learned my addr 172.21.15.50:0/1286303738 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:04.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443e00700 1 -- 172.21.15.50:0/1286303738 >> v1:172.21.15.181:6789/0 conn(0x7fc44406b170 legacy=0x7fc4440b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443400700 1 -- 172.21.15.50:0/1286303738 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148160911 0 0) 0x7fc44406b580 con 0x7fc44406b170 2024-09-13T15:11:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443e00700 1 -- 172.21.15.50:0/1286303738 >> v1:172.21.15.50:6789/0 conn(0x7fc444160d30 legacy=0x7fc44406cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443e00700 1 -- 172.21.15.50:0/1286303738 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440d03f0 con 0x7fc444161110 2024-09-13T15:11:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443e00700 1 --2- 172.21.15.50:0/1286303738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc44406ac30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc430009850 tx=0x7fc430009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29eb10456773d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:04.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443400700 1 -- 172.21.15.50:0/1286303738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430011830 con 0x7fc444161110 2024-09-13T15:11:04.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443400700 1 -- 172.21.15.50:0/1286303738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430011990 con 0x7fc444161110 2024-09-13T15:11:04.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc443400700 1 -- 172.21.15.50:0/1286303738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430011d20 con 0x7fc444161110 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 -- 172.21.15.50:0/1286303738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 msgr2=0x7fc44406ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 --2- 172.21.15.50:0/1286303738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc44406ac30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc430009850 tx=0x7fc430009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 -- 172.21.15.50:0/1286303738 shutdown_connections 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 --2- 172.21.15.50:0/1286303738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc44406ac30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 -- 172.21.15.50:0/1286303738 >> 172.21.15.50:0/1286303738 conn(0x7fc444071d20 msgr2=0x7fc444072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 -- 172.21.15.50:0/1286303738 shutdown_connections 2024-09-13T15:11:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.205+0000 7fc44a000700 1 -- 172.21.15.50:0/1286303738 wait complete. 2024-09-13T15:11:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.209+0000 7fc44a000700 1 Processor -- start 2024-09-13T15:11:04.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.209+0000 7fc44a000700 1 -- start start 2024-09-13T15:11:04.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc44406b170 0x7fc4441e9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc444160d30 0x7fc4441f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc4441f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4441fa190 con 0x7fc444161110 2024-09-13T15:11:04.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc444157200 con 0x7fc44406b170 2024-09-13T15:11:04.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc444144260 con 0x7fc444160d30 2024-09-13T15:11:04.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc4441f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc4441f9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58086/0 (socket says 172.21.15.50:58086) 2024-09-13T15:11:04.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 -- 172.21.15.50:0/3894871970 learned_addr learned my addr 172.21.15.50:0/3894871970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:04.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc443e00700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc444160d30 0x7fc4441f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc448c00700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc44406b170 0x7fc4441e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 -- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc444160d30 msgr2=0x7fc4441f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc444160d30 0x7fc4441f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 -- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc44406b170 msgr2=0x7fc4441e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc44406b170 0x7fc4441e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 -- 172.21.15.50:0/3894871970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300094b0 con 0x7fc444161110 2024-09-13T15:11:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc449600700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc4441f9c50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00cca0 tx=0x7fc43c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00cea0 con 0x7fc444161110 2024-09-13T15:11:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c00ade0 con 0x7fc444161110 2024-09-13T15:11:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc444143930 con 0x7fc444161110 2024-09-13T15:11:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c007310 con 0x7fc444161110 2024-09-13T15:11:04.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.213+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc444143ef0 con 0x7fc444161110 2024-09-13T15:11:04.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.217+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4441443d0 con 0x7fc444161110 2024-09-13T15:11:04.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.217+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc43c007470 con 0x7fc444161110 2024-09-13T15:11:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.217+0000 7fc440c00700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc424066730 0x7fc424068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.217+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc43c0841a0 con 0x7fc444161110 2024-09-13T15:11:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.217+0000 7fc448c00700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc424066730 0x7fc424068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.221+0000 7fc448c00700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc424066730 0x7fc424068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc438000f60 tx=0x7fc438009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.225+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc43c0513c0 con 0x7fc444161110 2024-09-13T15:11:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.409+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4440d1250 con 0x7fc444161110 2024-09-13T15:11:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.409+0000 7fc440c00700 1 -- 172.21.15.50:0/3894871970 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc43c0549e0 con 0x7fc444161110 2024-09-13T15:11:04.412 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc424066730 msgr2=0x7fc424068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc424066730 0x7fc424068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc438000f60 tx=0x7fc438009040 comp rx=0 tx=0).stop 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 msgr2=0x7fc4441f9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc4441f9c50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00cca0 tx=0x7fc43c00a340 comp rx=0 tx=0).stop 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 shutdown_connections 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc424066730 0x7fc424068bf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc444161110 0x7fc4441f9c50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc444160d30 0x7fc4441f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 --2- 172.21.15.50:0/3894871970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc44406b170 0x7fc4441e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 >> 172.21.15.50:0/3894871970 conn(0x7fc444071d20 msgr2=0x7fc44415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 shutdown_connections 2024-09-13T15:11:04.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.413+0000 7fc44a000700 1 -- 172.21.15.50:0/3894871970 wait complete. 2024-09-13T15:11:04.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:11:04.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 Processor -- start 2024-09-13T15:11:04.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 -- start start 2024-09-13T15:11:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c144330 0x7f778c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f778c06d760 0x7f778c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f778c144710 0x7f778c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0cce10 con 0x7f778c06d760 2024-09-13T15:11:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c06bcf0 con 0x7f778c144710 2024-09-13T15:11:04.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.617+0000 7f7790e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c06cb50 con 0x7f778c144330 2024-09-13T15:11:04.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f778c06d760 0x7f778c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f778c06d760 0x7f778c0b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58100/0 (socket says 172.21.15.50:58100) 2024-09-13T15:11:04.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 -- 172.21.15.50:0/714517707 learned_addr learned my addr 172.21.15.50:0/714517707 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:04.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7789e00700 1 --2- 172.21.15.50:0/714517707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c144330 0x7f778c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f778a800700 1 --2- 172.21.15.50:0/714517707 >> v2:172.21.15.181:3300/0 conn(0x7f778c144710 0x7f778c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 -- 172.21.15.50:0/714517707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c144330 msgr2=0x7f778c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 --2- 172.21.15.50:0/714517707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c144330 0x7f778c0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 -- 172.21.15.50:0/714517707 >> v2:172.21.15.181:3300/0 conn(0x7f778c144710 msgr2=0x7f778c0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 --2- 172.21.15.50:0/714517707 >> v2:172.21.15.181:3300/0 conn(0x7f778c144710 0x7f778c0b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 -- 172.21.15.50:0/714517707 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0cf4b0 con 0x7f778c06d760 2024-09-13T15:11:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7781400700 1 --2- 172.21.15.50:0/714517707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c06d760 0x7f778c0b35a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f778c15e530 tx=0x7f7774009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50d48abc20a1eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:04.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7789400700 1 -- 172.21.15.50:0/714517707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774011830 con 0x7f778c06d760 2024-09-13T15:11:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7789400700 1 -- 172.21.15.50:0/714517707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774011990 con 0x7f778c06d760 2024-09-13T15:11:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7789400700 1 -- 172.21.15.50:0/714517707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774011d20 con 0x7f778c06d760 2024-09-13T15:11:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7790e00700 1 -- 172.21.15.50:0/714517707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c06d760 msgr2=0x7f778c0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.621+0000 7f7790e00700 1 --2- 172.21.15.50:0/714517707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c06d760 0x7f778c0b35a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f778c15e530 tx=0x7f7774009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 -- 172.21.15.50:0/714517707 shutdown_connections 2024-09-13T15:11:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 --2- 172.21.15.50:0/714517707 >> v2:172.21.15.181:3300/0 conn(0x7f778c144710 0x7f778c0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 --2- 172.21.15.50:0/714517707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c06d760 0x7f778c0b35a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 --2- 172.21.15.50:0/714517707 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c144330 0x7f778c0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 -- 172.21.15.50:0/714517707 >> 172.21.15.50:0/714517707 conn(0x7f778c06a570 msgr2=0x7f778c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:04.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 -- 172.21.15.50:0/714517707 shutdown_connections 2024-09-13T15:11:04.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.625+0000 7f7790e00700 1 -- 172.21.15.50:0/714517707 wait complete. 2024-09-13T15:11:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 Processor -- start 2024-09-13T15:11:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 -- start start 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c06d760 0x7f778c1f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 0x7f778c0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f778c0b2ab0 0x7f778c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1388c0 con 0x7f778c144330 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0b3030 con 0x7f778c0b2ab0 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0b3310 con 0x7f778c06d760 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 0x7f778c0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 0x7f778c0b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58114/0 (socket says 172.21.15.50:58114) 2024-09-13T15:11:04.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 -- 172.21.15.50:0/883353332 learned_addr learned my addr 172.21.15.50:0/883353332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f778a800700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f778c0b2ab0 0x7f778c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7789e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c06d760 0x7f778c1f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 -- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c06d760 msgr2=0x7f778c1f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c06d760 0x7f778c1f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 -- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f778c0b2ab0 msgr2=0x7f778c0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f778c0b2ab0 0x7f778c0aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 -- 172.21.15.50:0/883353332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774009570 con 0x7f778c144330 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7781400700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 0x7f778c0b2570 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f778c06b360 tx=0x7f7774004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740044d0 con 0x7f778c144330 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777401f070 con 0x7f778c144330 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.629+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c138ad0 con 0x7f778c144330 2024-09-13T15:11:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.633+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774003900 con 0x7f778c144330 2024-09-13T15:11:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.633+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c1f2800 con 0x7f778c144330 2024-09-13T15:11:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.633+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c138ff0 con 0x7f778c144330 2024-09-13T15:11:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.633+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7774003a60 con 0x7f778c144330 2024-09-13T15:11:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.637+0000 7f7782a00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7768066730 0x7f7768068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.637+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7774021070 con 0x7f778c144330 2024-09-13T15:11:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.637+0000 7f7789e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7768066730 0x7f7768068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.637+0000 7f7789e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7768066730 0x7f7768068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f777c009b80 tx=0x7f777c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.641+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f778c138ff0 con 0x7f778c144330 2024-09-13T15:11:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.825+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f778c138ff0 con 0x7f778c144330 2024-09-13T15:11:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.825+0000 7f7782a00700 1 -- 172.21.15.50:0/883353332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7774015020 con 0x7f778c144330 2024-09-13T15:11:04.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:11:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7768066730 msgr2=0x7f7768068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7768066730 0x7f7768068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f777c009b80 tx=0x7f777c008040 comp rx=0 tx=0).stop 2024-09-13T15:11:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 msgr2=0x7f778c0b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 0x7f778c0b2570 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f778c06b360 tx=0x7f7774004770 comp rx=0 tx=0).stop 2024-09-13T15:11:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 shutdown_connections 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7768066730 0x7f7768068bf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f778c0b2ab0 0x7f778c0aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f778c144330 0x7f778c0b2570 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 --2- 172.21.15.50:0/883353332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f778c06d760 0x7f778c1f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 >> 172.21.15.50:0/883353332 conn(0x7f778c06a570 msgr2=0x7f778c159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 shutdown_connections 2024-09-13T15:11:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:04.833+0000 7f7790e00700 1 -- 172.21.15.50:0/883353332 wait complete. 2024-09-13T15:11:04.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:11:05.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.033+0000 7fb1c4e00700 1 Processor -- start 2024-09-13T15:11:05.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.033+0000 7fb1c4e00700 1 -- start start 2024-09-13T15:11:05.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1c4e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1c00cfa80 0x7fb1c00ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1c4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c00ca1b0 0x7fb1c00ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1c4e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0160ed0 con 0x7fb1c0145cb0 2024-09-13T15:11:05.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1c4e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c0146090 con 0x7fb1c00cfa80 2024-09-13T15:11:05.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1c4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0161a50 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bde00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb1c0145cb0 0x7fb1c00cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58422/0 (socket says 172.21.15.50:58422) 2024-09-13T15:11:05.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bde00700 1 -- 172.21.15.50:0/1313521811 learned_addr learned my addr 172.21.15.50:0/1313521811 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:05.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1313521811 >> v2:172.21.15.50:3300/0 conn(0x7fb1c00cfa80 0x7fb1c00ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1be800700 1 --2- 172.21.15.50:0/1313521811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c00ca1b0 0x7fb1c00ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bca00700 1 -- 172.21.15.50:0/1313521811 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827021045 0 0) 0x7fb1c0160ed0 con 0x7fb1c0145cb0 2024-09-13T15:11:05.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bd400700 1 -- 172.21.15.50:0/1313521811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c00ca1b0 msgr2=0x7fb1c00ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:05.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1313521811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c00ca1b0 0x7fb1c00ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bd400700 1 -- 172.21.15.50:0/1313521811 >> v1:172.21.15.50:6789/0 conn(0x7fb1c0145cb0 legacy=0x7fb1c00cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bd400700 1 -- 172.21.15.50:0/1313521811 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c01611b0 con 0x7fb1c00cfa80 2024-09-13T15:11:05.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1313521811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00cfa80 0x7fb1c00ce360 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009850 tx=0x7fb1ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854ca49e4066c3f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:05.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bca00700 1 -- 172.21.15.50:0/1313521811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011830 con 0x7fb1c00cfa80 2024-09-13T15:11:05.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bca00700 1 -- 172.21.15.50:0/1313521811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac011990 con 0x7fb1c00cfa80 2024-09-13T15:11:05.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.037+0000 7fb1bca00700 1 -- 172.21.15.50:0/1313521811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011d20 con 0x7fb1c00cfa80 2024-09-13T15:11:05.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1313521811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00cfa80 msgr2=0x7fb1c00ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1313521811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00cfa80 0x7fb1c00ce360 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009850 tx=0x7fb1ac009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1313521811 shutdown_connections 2024-09-13T15:11:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1313521811 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c00ca1b0 0x7fb1c00ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1313521811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00cfa80 0x7fb1c00ce360 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1313521811 >> 172.21.15.50:0/1313521811 conn(0x7fb1c00726d0 msgr2=0x7fb1c006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1313521811 shutdown_connections 2024-09-13T15:11:05.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1313521811 wait complete. 2024-09-13T15:11:05.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.041+0000 7fb1c4e00700 1 Processor -- start 2024-09-13T15:11:05.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 -- start start 2024-09-13T15:11:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 0x7fb1c01524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1c00cfa80 0x7fb1c0140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c0145cb0 0x7fb1c01414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015df10 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0152a00 con 0x7fb1c00cfa80 2024-09-13T15:11:05.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015e1b0 con 0x7fb1c0145cb0 2024-09-13T15:11:05.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 0x7fb1c01524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 0x7fb1c01524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58130/0 (socket says 172.21.15.50:58130) 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 -- 172.21.15.50:0/1979166638 learned_addr learned my addr 172.21.15.50:0/1979166638 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1c00cfa80 0x7fb1c0140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1be800700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c0145cb0 0x7fb1c01414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 -- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c0145cb0 msgr2=0x7fb1c01414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c0145cb0 0x7fb1c01414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 -- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1c00cfa80 msgr2=0x7fb1c0140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1c00cfa80 0x7fb1c0140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 -- 172.21.15.50:0/1979166638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0094b0 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1c00cfa80 0x7fb1c0140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1bde00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 0x7fb1c01524c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000c4e0 tx=0x7fb1b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0004ca0 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b0004e20 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0007310 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c015e490 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.045+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c015ea50 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.049+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c00cbd80 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.049+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1b0007470 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.053+0000 7fb1b6000700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1a0066730 0x7fb1a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.053+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1b0084090 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.053+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1a0066730 0x7fb1a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.053+0000 7fb1bd400700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1a0066730 0x7fb1a0068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0090b0 tx=0x7fb1ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.057+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1b0051220 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.253+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1c0067730 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1b6000700 1 -- 172.21.15.50:0/1979166638 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v77) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1b0007720 con 0x7fb1c00ca1b0 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1a0066730 msgr2=0x7fb1a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1a0066730 0x7fb1a0068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0090b0 tx=0x7fb1ac008030 comp rx=0 tx=0).stop 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 msgr2=0x7fb1c01524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 0x7fb1c01524c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000c4e0 tx=0x7fb1b000c8a0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 shutdown_connections 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb1a0066730 0x7fb1a0068bf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1c0145cb0 0x7fb1c01414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1c00cfa80 0x7fb1c0140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 --2- 172.21.15.50:0/1979166638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c00ca1b0 0x7fb1c01524c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 >> 172.21.15.50:0/1979166638 conn(0x7fb1c00726d0 msgr2=0x7fb1c00cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 shutdown_connections 2024-09-13T15:11:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.257+0000 7fb1c4e00700 1 -- 172.21.15.50:0/1979166638 wait complete. 2024-09-13T15:11:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:11:05.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:11:05.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:05.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:05.335 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:11:05.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:05.335 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:11:05.402 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:05.403 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:05.421 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:05.422 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:05.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 Processor -- start 2024-09-13T15:11:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 -- start start 2024-09-13T15:11:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99cc0cc6f0 0x7f99cc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0ccb40 con 0x7f99cc0cb020 2024-09-13T15:11:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc06b430 con 0x7f99cc0cc6f0 2024-09-13T15:11:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d2800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0b2ad0 con 0x7f99cc06aaa0 2024-09-13T15:11:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d0a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99cc0cc6f0 0x7f99cc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d0a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99cc0cc6f0 0x7f99cc15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58138/0 (socket says 172.21.15.50:58138) 2024-09-13T15:11:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc06aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38334/0 (socket says 172.21.15.50:38334) 2024-09-13T15:11:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.657+0000 7f99d0a00700 1 -- 172.21.15.50:0/1445173746 learned_addr learned my addr 172.21.15.50:0/1445173746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d0a00700 1 -- 172.21.15.50:0/1445173746 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 msgr2=0x7f99cc06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d0a00700 1 --2- 172.21.15.50:0/1445173746 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d0a00700 1 -- 172.21.15.50:0/1445173746 >> v1:172.21.15.181:6789/0 conn(0x7f99cc0cb020 legacy=0x7f99cc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d0a00700 1 -- 172.21.15.50:0/1445173746 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc15b960 con 0x7f99cc0cc6f0 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d0a00700 1 --2- 172.21.15.50:0/1445173746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc15b0e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009910 tx=0x7f99b8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6525f075270510d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99cbe00700 1 -- 172.21.15.50:0/1445173746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8011830 con 0x7f99cc0cc6f0 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99cbe00700 1 -- 172.21.15.50:0/1445173746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b8011990 con 0x7f99cc0cc6f0 2024-09-13T15:11:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99cbe00700 1 -- 172.21.15.50:0/1445173746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8011d40 con 0x7f99cc0cc6f0 2024-09-13T15:11:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 -- 172.21.15.50:0/1445173746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cc6f0 msgr2=0x7f99cc15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 --2- 172.21.15.50:0/1445173746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc15b0e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009910 tx=0x7f99b8009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 -- 172.21.15.50:0/1445173746 shutdown_connections 2024-09-13T15:11:05.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 --2- 172.21.15.50:0/1445173746 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 --2- 172.21.15.50:0/1445173746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc15b0e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 -- 172.21.15.50:0/1445173746 >> 172.21.15.50:0/1445173746 conn(0x7f99cc0b0c40 msgr2=0x7f99cc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 -- 172.21.15.50:0/1445173746 shutdown_connections 2024-09-13T15:11:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.661+0000 7f99d2800700 1 -- 172.21.15.50:0/1445173746 wait complete. 2024-09-13T15:11:05.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 Processor -- start 2024-09-13T15:11:05.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 -- start start 2024-09-13T15:11:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 0x7f99cc155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc1f2680 con 0x7f99cc0cb020 2024-09-13T15:11:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c8000 con 0x7f99cc0cc6f0 2024-09-13T15:11:05.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.665+0000 7f99d2800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c82e0 con 0x7f99cc06aaa0 2024-09-13T15:11:05.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 0x7f99cc155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d1400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 0x7f99cc155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58142/0 (socket says 172.21.15.50:58142) 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 -- 172.21.15.50:0/994118438 learned_addr learned my addr 172.21.15.50:0/994118438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d1e00700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 -- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 msgr2=0x7f99cc1f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc1f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 -- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99cc0cc6f0 msgr2=0x7f99cc155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 -- 172.21.15.50:0/994118438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009570 con 0x7f99cc0cb020 2024-09-13T15:11:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d0a00700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 0x7f99cc155760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0b1690 tx=0x7f99b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8004510 con 0x7f99cc0cb020 2024-09-13T15:11:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b801e070 con 0x7f99cc0cb020 2024-09-13T15:11:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8003900 con 0x7f99cc0cb020 2024-09-13T15:11:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc0c85c0 con 0x7f99cc0cb020 2024-09-13T15:11:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc0c7c90 con 0x7f99cc0cb020 2024-09-13T15:11:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.669+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc1f2b30 con 0x7f99cc0cb020 2024-09-13T15:11:05.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.673+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99b8003a60 con 0x7f99cc0cb020 2024-09-13T15:11:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.673+0000 7f99c9600700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99ac066780 0x7f99ac068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.673+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99b8084e90 con 0x7f99cc0cb020 2024-09-13T15:11:05.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.673+0000 7f99d1400700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99ac066780 0x7f99ac068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.677+0000 7f99d1400700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99ac066780 0x7f99ac068c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f99cc14f920 tx=0x7f99c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:05.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.681+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99cc1f2b30 con 0x7f99cc0cb020 2024-09-13T15:11:05.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:05.749 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.877+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99cc1f2b30 con 0x7f99cc0cb020 2024-09-13T15:11:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.881+0000 7f99c9600700 1 -- 172.21.15.50:0/994118438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16765 (secure 0 0 0) 0x7f99cc1f2b30 con 0x7f99cc0cb020 2024-09-13T15:11:05.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:05.885 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:54.464580+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99ac066780 msgr2=0x7f99ac068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99ac066780 0x7f99ac068c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f99cc14f920 tx=0x7f99c0009040 comp rx=0 tx=0).stop 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 msgr2=0x7f99cc155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 0x7f99cc155760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0b1690 tx=0x7f99b8004770 comp rx=0 tx=0).stop 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 shutdown_connections 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f99ac066780 0x7f99ac068c40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99cc0cc6f0 0x7f99cc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99cc0cb020 0x7f99cc155760 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 --2- 172.21.15.50:0/994118438 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f99cc06aaa0 0x7f99cc1f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 >> 172.21.15.50:0/994118438 conn(0x7f99cc0b0c40 msgr2=0x7f99cc0ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 shutdown_connections 2024-09-13T15:11:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:05.885+0000 7f99d2800700 1 -- 172.21.15.50:0/994118438 wait complete. 2024-09-13T15:11:05.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:10:51.524270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:10:52.462039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:05.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:06.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.085+0000 7f8e0ec00700 1 Processor -- start 2024-09-13T15:11:06.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.085+0000 7f8e0ec00700 1 -- start start 2024-09-13T15:11:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e080cf4e0 0x7f8e08070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8e0806b3a0 0x7f8e0806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0815b2c0 con 0x7f8e080ae980 2024-09-13T15:11:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0806bd70 con 0x7f8e080cf4e0 2024-09-13T15:11:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0815be40 con 0x7f8e0806b3a0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e080cf4e0 0x7f8e08070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e080cf4e0 0x7f8e08070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58156/0 (socket says 172.21.15.50:58156) 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 -- 172.21.15.50:0/963458213 learned_addr learned my addr 172.21.15.50:0/963458213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0e200700 1 --2- 172.21.15.50:0/963458213 >> v2:172.21.15.181:3300/0 conn(0x7f8e0806b3a0 0x7f8e0806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 -- 172.21.15.50:0/963458213 >> v2:172.21.15.181:3300/0 conn(0x7f8e0806b3a0 msgr2=0x7f8e0806b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 --2- 172.21.15.50:0/963458213 >> v2:172.21.15.181:3300/0 conn(0x7f8e0806b3a0 0x7f8e0806b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 -- 172.21.15.50:0/963458213 >> v1:172.21.15.181:6789/0 conn(0x7f8e080ae980 legacy=0x7f8e080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 -- 172.21.15.50:0/963458213 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0815b5a0 con 0x7f8e080cf4e0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ce00700 1 --2- 172.21.15.50:0/963458213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080cf4e0 0x7f8e08070ca0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8e080ce630 tx=0x7f8df4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa76de833a5dbf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e07e00700 1 -- 172.21.15.50:0/963458213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400ba20 con 0x7f8e080cf4e0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e07e00700 1 -- 172.21.15.50:0/963458213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400bb80 con 0x7f8e080cf4e0 2024-09-13T15:11:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e07e00700 1 -- 172.21.15.50:0/963458213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4009e60 con 0x7f8e080cf4e0 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- 172.21.15.50:0/963458213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080cf4e0 msgr2=0x7f8e08070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/963458213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080cf4e0 0x7f8e08070ca0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8e080ce630 tx=0x7f8df4009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- 172.21.15.50:0/963458213 shutdown_connections 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/963458213 >> v2:172.21.15.181:3300/0 conn(0x7f8e0806b3a0 0x7f8e0806b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/963458213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080cf4e0 0x7f8e08070ca0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- 172.21.15.50:0/963458213 >> 172.21.15.50:0/963458213 conn(0x7f8e0806c9b0 msgr2=0x7f8e0806cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- 172.21.15.50:0/963458213 shutdown_connections 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.089+0000 7f8e0ec00700 1 -- 172.21.15.50:0/963458213 wait complete. 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 Processor -- start 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 -- start start 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0806b3a0 0x7f8e080ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080ae980 0x7f8e080b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e080cf4e0 0x7f8e080adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080adaf0 con 0x7f8e080ae980 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e08156a70 con 0x7f8e080cf4e0 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ec00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080ace70 con 0x7f8e0806b3a0 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.093+0000 7f8e0ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080ae980 0x7f8e080b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080ae980 0x7f8e080b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58170/0 (socket says 172.21.15.50:58170) 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0ce00700 1 -- 172.21.15.50:0/1454467791 learned_addr learned my addr 172.21.15.50:0/1454467791 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0806b3a0 0x7f8e080ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0e200700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e080cf4e0 0x7f8e080adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 -- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e080cf4e0 msgr2=0x7f8e080adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e080cf4e0 0x7f8e080adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 -- 172.21.15.50:0/1454467791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080ae980 msgr2=0x7f8e080b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080ae980 0x7f8e080b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 -- 172.21.15.50:0/1454467791 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009570 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0e200700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e080cf4e0 0x7f8e080adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0d800700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0806b3a0 0x7f8e080ac890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c400 tx=0x7f8dfc00c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0052d0 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc005450 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e080ad150 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc006ac0 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.097+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e080ad710 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.101+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0815ae90 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.101+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8dfc0036a0 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.101+0000 7f8e05600700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de8066760 0x7f8de8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.101+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8dfc083330 con 0x7f8e0806b3a0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.101+0000 7f8e0ce00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de8066760 0x7f8de8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.105+0000 7f8e0ce00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de8066760 0x7f8de8068c20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009150 tx=0x7f8df4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.109+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8dfc050550 con 0x7f8e0806b3a0 2024-09-13T15:11:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.293+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e080ae4c0 con 0x7f8e0806b3a0 2024-09-13T15:11:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.293+0000 7f8e05600700 1 -- 172.21.15.50:0/1454467791 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dfc053b70 con 0x7f8e0806b3a0 2024-09-13T15:11:06.296 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de8066760 msgr2=0x7f8de8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de8066760 0x7f8de8068c20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009150 tx=0x7f8df4008030 comp rx=0 tx=0).stop 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0806b3a0 msgr2=0x7f8e080ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0806b3a0 0x7f8e080ac890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c400 tx=0x7f8dfc00c710 comp rx=0 tx=0).stop 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 shutdown_connections 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8de8066760 0x7f8de8068c20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e080cf4e0 0x7f8e080adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e080ae980 0x7f8e080b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 --2- 172.21.15.50:0/1454467791 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e0806b3a0 0x7f8e080ac890 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 >> 172.21.15.50:0/1454467791 conn(0x7f8e0806c9b0 msgr2=0x7f8e080cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:06.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 shutdown_connections 2024-09-13T15:11:06.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.297+0000 7f8e0ec00700 1 -- 172.21.15.50:0/1454467791 wait complete. 2024-09-13T15:11:06.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:11:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 Processor -- start 2024-09-13T15:11:06.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 -- start start 2024-09-13T15:11:06.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd99006d760 0x7fd9900b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd990144710 0x7fd9900b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99006bcf0 con 0x7fd990144330 2024-09-13T15:11:06.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9900cce10 con 0x7fd990144710 2024-09-13T15:11:06.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.505+0000 7fd995c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99006cb50 con 0x7fd99006d760 2024-09-13T15:11:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd990144710 0x7fd9900b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd990144710 0x7fd9900b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58178/0 (socket says 172.21.15.50:58178) 2024-09-13T15:11:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 -- 172.21.15.50:0/4187485041 learned_addr learned my addr 172.21.15.50:0/4187485041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98e000700 1 --2- 172.21.15.50:0/4187485041 >> v2:172.21.15.181:3300/0 conn(0x7fd99006d760 0x7fd9900b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 -- 172.21.15.50:0/4187485041 >> v2:172.21.15.181:3300/0 conn(0x7fd99006d760 msgr2=0x7fd9900b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 --2- 172.21.15.50:0/4187485041 >> v2:172.21.15.181:3300/0 conn(0x7fd99006d760 0x7fd9900b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 -- 172.21.15.50:0/4187485041 >> v1:172.21.15.181:6789/0 conn(0x7fd990144330 legacy=0x7fd9900cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 -- 172.21.15.50:0/4187485041 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99006bf40 con 0x7fd990144710 2024-09-13T15:11:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98f400700 1 --2- 172.21.15.50:0/4187485041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd990144710 0x7fd9900b3ae0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd9900ce900 tx=0x7fd98800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f01d3a465d6c9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98d600700 1 -- 172.21.15.50:0/4187485041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800e070 con 0x7fd990144710 2024-09-13T15:11:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98d600700 1 -- 172.21.15.50:0/4187485041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98800b910 con 0x7fd990144710 2024-09-13T15:11:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd98d600700 1 -- 172.21.15.50:0/4187485041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800bcc0 con 0x7fd990144710 2024-09-13T15:11:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd995c00700 1 -- 172.21.15.50:0/4187485041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd990144710 msgr2=0x7fd9900b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd995c00700 1 --2- 172.21.15.50:0/4187485041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd990144710 0x7fd9900b3ae0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd9900ce900 tx=0x7fd98800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd995c00700 1 -- 172.21.15.50:0/4187485041 shutdown_connections 2024-09-13T15:11:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd995c00700 1 --2- 172.21.15.50:0/4187485041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd990144710 0x7fd9900b3ae0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd995c00700 1 --2- 172.21.15.50:0/4187485041 >> v2:172.21.15.181:3300/0 conn(0x7fd99006d760 0x7fd9900b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.509+0000 7fd995c00700 1 -- 172.21.15.50:0/4187485041 >> 172.21.15.50:0/4187485041 conn(0x7fd99006a570 msgr2=0x7fd99006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.513+0000 7fd995c00700 1 -- 172.21.15.50:0/4187485041 shutdown_connections 2024-09-13T15:11:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.513+0000 7fd995c00700 1 -- 172.21.15.50:0/4187485041 wait complete. 2024-09-13T15:11:06.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.513+0000 7fd995c00700 1 Processor -- start 2024-09-13T15:11:06.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.513+0000 7fd995c00700 1 -- start start 2024-09-13T15:11:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 0x7fd990142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd990144330 0x7fd99013b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd990151760 0x7fd9900af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900af380 con 0x7fd99006d760 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990154e90 con 0x7fd990151760 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99013b640 con 0x7fd990144330 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 0x7fd990142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 0x7fd990142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58184/0 (socket says 172.21.15.50:58184) 2024-09-13T15:11:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 -- 172.21.15.50:0/3273673589 learned_addr learned my addr 172.21.15.50:0/3273673589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98e000700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd990144330 0x7fd99013b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98f400700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd990151760 0x7fd9900af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 -- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd990144330 msgr2=0x7fd99013b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd990144330 0x7fd99013b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 -- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd990151760 msgr2=0x7fd9900af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd990151760 0x7fd9900af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 -- 172.21.15.50:0/3273673589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988009b30 con 0x7fd99006d760 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd98ea00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 0x7fd990142430 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c500 tx=0x7fd98000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800052d0 con 0x7fd99006d760 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980005430 con 0x7fd99006d760 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800055a0 con 0x7fd99006d760 2024-09-13T15:11:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.517+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9900ae770 con 0x7fd99006d760 2024-09-13T15:11:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.521+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9900aed30 con 0x7fd99006d760 2024-09-13T15:11:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.521+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9900cef70 con 0x7fd99006d760 2024-09-13T15:11:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.521+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9800038e0 con 0x7fd99006d760 2024-09-13T15:11:06.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.525+0000 7fd986a00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd970066760 0x7fd970068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.525+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd9800837b0 con 0x7fd99006d760 2024-09-13T15:11:06.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.525+0000 7fd98e000700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd970066760 0x7fd970068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.525+0000 7fd98e000700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd970066760 0x7fd970068c20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd990139540 tx=0x7fd97c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.533+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9800509d0 con 0x7fd99006d760 2024-09-13T15:11:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.717+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd990143900 con 0x7fd99006d760 2024-09-13T15:11:06.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.717+0000 7fd986a00700 1 -- 172.21.15.50:0/3273673589 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd980053ff0 con 0x7fd99006d760 2024-09-13T15:11:06.719 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:11:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd970066760 msgr2=0x7fd970068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd970066760 0x7fd970068c20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd990139540 tx=0x7fd97c008040 comp rx=0 tx=0).stop 2024-09-13T15:11:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 msgr2=0x7fd990142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 0x7fd990142430 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c500 tx=0x7fd98000c8c0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 shutdown_connections 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd970066760 0x7fd970068c20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd990151760 0x7fd9900af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd990144330 0x7fd99013b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 --2- 172.21.15.50:0/3273673589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99006d760 0x7fd990142430 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 >> 172.21.15.50:0/3273673589 conn(0x7fd99006a570 msgr2=0x7fd9901429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 shutdown_connections 2024-09-13T15:11:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.721+0000 7fd995c00700 1 -- 172.21.15.50:0/3273673589 wait complete. 2024-09-13T15:11:06.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:11:06.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.921+0000 7f41d4800700 1 Processor -- start 2024-09-13T15:11:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.921+0000 7f41d4800700 1 -- start start 2024-09-13T15:11:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d4800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d4800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41cc0b3990 0x7f41cc0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d4800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f41cc0cf0b0 0x7f41cc06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d4800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0cf540 con 0x7f41cc0b3990 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d4800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc06d000 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d4800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc06c3f0 con 0x7f41cc160fc0 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41cc0b3990 0x7f41cc0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41cc0b3990 0x7f41cc0ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58186/0 (socket says 172.21.15.50:58186) 2024-09-13T15:11:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 -- 172.21.15.50:0/1374261384 learned_addr learned my addr 172.21.15.50:0/1374261384 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d2800700 1 --2- 172.21.15.50:0/1374261384 >> v2:172.21.15.181:3300/0 conn(0x7f41cc0cf0b0 0x7f41cc06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 -- 172.21.15.50:0/1374261384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 msgr2=0x7f41cc06be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 --2- 172.21.15.50:0/1374261384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc06be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 -- 172.21.15.50:0/1374261384 >> v2:172.21.15.181:3300/0 conn(0x7f41cc0cf0b0 msgr2=0x7f41cc06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 --2- 172.21.15.50:0/1374261384 >> v2:172.21.15.181:3300/0 conn(0x7f41cc0cf0b0 0x7f41cc06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 -- 172.21.15.50:0/1374261384 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc06c6d0 con 0x7f41cc0b3990 2024-09-13T15:11:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.925+0000 7f41d1400700 1 --2- 172.21.15.50:0/1374261384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0b3990 0x7f41cc0ceb70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0ae610 tx=0x7f41bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66c60ff10fa4534 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d0a00700 1 -- 172.21.15.50:0/1374261384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc011830 con 0x7f41cc0b3990 2024-09-13T15:11:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d0a00700 1 -- 172.21.15.50:0/1374261384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc011990 con 0x7f41cc0b3990 2024-09-13T15:11:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d0a00700 1 -- 172.21.15.50:0/1374261384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc011d20 con 0x7f41cc0b3990 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 -- 172.21.15.50:0/1374261384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0b3990 msgr2=0x7f41cc0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 --2- 172.21.15.50:0/1374261384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0b3990 0x7f41cc0ceb70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0ae610 tx=0x7f41bc009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 -- 172.21.15.50:0/1374261384 shutdown_connections 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 --2- 172.21.15.50:0/1374261384 >> v2:172.21.15.181:3300/0 conn(0x7f41cc0cf0b0 0x7f41cc06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 --2- 172.21.15.50:0/1374261384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0b3990 0x7f41cc0ceb70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 --2- 172.21.15.50:0/1374261384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc06be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 -- 172.21.15.50:0/1374261384 >> 172.21.15.50:0/1374261384 conn(0x7f41cc06a570 msgr2=0x7f41cc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 -- 172.21.15.50:0/1374261384 shutdown_connections 2024-09-13T15:11:06.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 -- 172.21.15.50:0/1374261384 wait complete. 2024-09-13T15:11:06.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 Processor -- start 2024-09-13T15:11:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.929+0000 7f41d4800700 1 -- start start 2024-09-13T15:11:06.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41cc0b3990 0x7f41cc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 0x7f41cc0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0cd450 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc153200 con 0x7f41cc0b3990 2024-09-13T15:11:06.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0cc810 con 0x7f41cc160fc0 2024-09-13T15:11:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 0x7f41cc0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 0x7f41cc0cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58190/0 (socket says 172.21.15.50:58190) 2024-09-13T15:11:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 -- 172.21.15.50:0/1225561012 learned_addr learned my addr 172.21.15.50:0/1225561012 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1e00700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41cc0b3990 0x7f41cc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d2800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 -- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 msgr2=0x7f41cc0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 -- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41cc0b3990 msgr2=0x7f41cc152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41cc0b3990 0x7f41cc152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 -- 172.21.15.50:0/1225561012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc009570 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d1400700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 0x7f41cc0cda50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f41bc000c00 tx=0x7f41bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc004590 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc01e070 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc0ccab0 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc003900 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.933+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0cd070 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.937+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc0ceb70 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.937+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41bc003a60 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.941+0000 7f41c6000700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b0066730 0x7f41b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:06.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.941+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41bc085180 con 0x7f41cc0cf0b0 2024-09-13T15:11:06.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.941+0000 7f41d1e00700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b0066730 0x7f41b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:06.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.941+0000 7f41d1e00700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b0066730 0x7f41b0068bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f41cc153800 tx=0x7f41c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:06.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:06.945+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41bc052320 con 0x7f41cc0cf0b0 2024-09-13T15:11:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.129+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41cc1605d0 con 0x7f41cc0cf0b0 2024-09-13T15:11:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.129+0000 7f41c6000700 1 -- 172.21.15.50:0/1225561012 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41bc055940 con 0x7f41cc0cf0b0 2024-09-13T15:11:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:11:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b0066730 msgr2=0x7f41b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b0066730 0x7f41b0068bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f41cc153800 tx=0x7f41c0008040 comp rx=0 tx=0).stop 2024-09-13T15:11:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 msgr2=0x7f41cc0cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 0x7f41cc0cda50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f41bc000c00 tx=0x7f41bc004770 comp rx=0 tx=0).stop 2024-09-13T15:11:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 shutdown_connections 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41b0066730 0x7f41b0068bf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41cc160fc0 0x7f41cc0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41cc0cf0b0 0x7f41cc0cda50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 --2- 172.21.15.50:0/1225561012 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41cc0b3990 0x7f41cc152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 >> 172.21.15.50:0/1225561012 conn(0x7f41cc06a570 msgr2=0x7f41cc15e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 shutdown_connections 2024-09-13T15:11:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.137+0000 7f41d4800700 1 -- 172.21.15.50:0/1225561012 wait complete. 2024-09-13T15:11:07.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:11:07.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.333+0000 7f0741800700 1 Processor -- start 2024-09-13T15:11:07.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.333+0000 7f0741800700 1 -- start start 2024-09-13T15:11:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0741800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c06b1b0 0x7f073c1646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0741800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0707d0 con 0x7f073c0cb700 2024-09-13T15:11:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0741800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c06fee0 con 0x7f073c159bd0 2024-09-13T15:11:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0741800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0720a0 con 0x7f073c06b1b0 2024-09-13T15:11:07.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f073c0cb700 0x7f073c06aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58430/0 (socket says 172.21.15.50:58430) 2024-09-13T15:11:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073b400700 1 -- 172.21.15.50:0/2237361771 learned_addr learned my addr 172.21.15.50:0/2237361771 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0740e00700 1 --2- 172.21.15.50:0/2237361771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c06b1b0 0x7f073c1646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211059354 0 0) 0x7f073c0707d0 con 0x7f073c0cb700 2024-09-13T15:11:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07200057e0 con 0x7f073c0cb700 2024-09-13T15:11:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296042437 0 0) 0x7f073c06fee0 con 0x7f073c159bd0 2024-09-13T15:11:07.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f073c0707d0 con 0x7f073c159bd0 2024-09-13T15:11:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0740e00700 1 -- 172.21.15.50:0/2237361771 >> v1:172.21.15.181:6789/0 conn(0x7f073c159bd0 legacy=0x7f073c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0740e00700 1 -- 172.21.15.50:0/2237361771 >> v1:172.21.15.50:6789/0 conn(0x7f073c0cb700 legacy=0x7f073c06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0740e00700 1 -- 172.21.15.50:0/2237361771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0b2ef0 con 0x7f073c06b1b0 2024-09-13T15:11:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f0740e00700 1 --2- 172.21.15.50:0/2237361771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c06b1b0 0x7f073c1646c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0734009dc0 tx=0x7f073400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d221bd6681af9b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400e070 con 0x7f073c06b1b0 2024-09-13T15:11:07.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073400bb20 con 0x7f073c06b1b0 2024-09-13T15:11:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.337+0000 7f073aa00700 1 -- 172.21.15.50:0/2237361771 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734012430 con 0x7f073c06b1b0 2024-09-13T15:11:07.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 -- 172.21.15.50:0/2237361771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c06b1b0 msgr2=0x7f073c1646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 --2- 172.21.15.50:0/2237361771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c06b1b0 0x7f073c1646c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0734009dc0 tx=0x7f073400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 -- 172.21.15.50:0/2237361771 shutdown_connections 2024-09-13T15:11:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 --2- 172.21.15.50:0/2237361771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c06b1b0 0x7f073c1646c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 -- 172.21.15.50:0/2237361771 >> 172.21.15.50:0/2237361771 conn(0x7f073c0b0c40 msgr2=0x7f073c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 -- 172.21.15.50:0/2237361771 shutdown_connections 2024-09-13T15:11:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 -- 172.21.15.50:0/2237361771 wait complete. 2024-09-13T15:11:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 Processor -- start 2024-09-13T15:11:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.341+0000 7f0741800700 1 -- start start 2024-09-13T15:11:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f073c06b1b0 0x7f073c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 0x7f073c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c159bd0 0x7f073c158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c15d3a0 con 0x7f073c0cb700 2024-09-13T15:11:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c14e600 con 0x7f073c06b1b0 2024-09-13T15:11:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c15d100 con 0x7f073c159bd0 2024-09-13T15:11:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 0x7f073c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 0x7f073c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58192/0 (socket says 172.21.15.50:58192) 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 -- 172.21.15.50:0/2812501824 learned_addr learned my addr 172.21.15.50:0/2812501824 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073be00700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f073c06b1b0 0x7f073c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0740e00700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c159bd0 0x7f073c158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 -- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c159bd0 msgr2=0x7f073c158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c159bd0 0x7f073c158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 -- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f073c06b1b0 msgr2=0x7f073c14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f073c06b1b0 0x7f073c14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 -- 172.21.15.50:0/2812501824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0734009a70 con 0x7f073c0cb700 2024-09-13T15:11:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0740e00700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c159bd0 0x7f073c158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f073b400700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 0x7f073c1585c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f072800c560 tx=0x7f072800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728005d90 con 0x7f073c0cb700 2024-09-13T15:11:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07280070d0 con 0x7f073c0cb700 2024-09-13T15:11:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728007460 con 0x7f073c0cb700 2024-09-13T15:11:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.345+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c14d7e0 con 0x7f073c0cb700 2024-09-13T15:11:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.349+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c14e290 con 0x7f073c0cb700 2024-09-13T15:11:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.349+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c14de10 con 0x7f073c0cb700 2024-09-13T15:11:07.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.349+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07280075c0 con 0x7f073c0cb700 2024-09-13T15:11:07.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.353+0000 7f0733e00700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f071c066730 0x7f071c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.353+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0728083880 con 0x7f073c0cb700 2024-09-13T15:11:07.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.353+0000 7f073be00700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f071c066730 0x7f071c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.353+0000 7f073be00700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f071c066730 0x7f071c068bf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f072c0011e0 tx=0x7f072c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:07.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.357+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f073c14de10 con 0x7f073c0cb700 2024-09-13T15:11:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.549+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f073c14de10 con 0x7f073c0cb700 2024-09-13T15:11:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.549+0000 7f0733e00700 1 -- 172.21.15.50:0/2812501824 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v77) v1 ==== 80+0+0 (secure 0 0 0) 0x7f073c14de10 con 0x7f073c0cb700 2024-09-13T15:11:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f071c066730 msgr2=0x7f071c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f071c066730 0x7f071c068bf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f072c0011e0 tx=0x7f072c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 msgr2=0x7f073c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 0x7f073c1585c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f072800c560 tx=0x7f072800c870 comp rx=0 tx=0).stop 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 shutdown_connections 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f071c066730 0x7f071c068bf0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f073c159bd0 0x7f073c158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073c0cb700 0x7f073c1585c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 --2- 172.21.15.50:0/2812501824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f073c06b1b0 0x7f073c14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 >> 172.21.15.50:0/2812501824 conn(0x7f073c0b0c40 msgr2=0x7f073c0ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 shutdown_connections 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.553+0000 7f0741800700 1 -- 172.21.15.50:0/2812501824 wait complete. 2024-09-13T15:11:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:11:07.576 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:11:07.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:07.577 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:07.624 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:11:07.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:07.624 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:11:07.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:07.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 Processor -- start 2024-09-13T15:11:07.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 -- start start 2024-09-13T15:11:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4394071d20 0x7f43940b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f43940cd610 0x7f439406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940ce140 con 0x7f439406a5d0 2024-09-13T15:11:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43940cde60 con 0x7f4394071d20 2024-09-13T15:11:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f439be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439406c3b0 con 0x7f43940cd610 2024-09-13T15:11:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4398a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4394071d20 0x7f43940b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4399400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f439406a5d0 0x7f439406a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58442/0 (socket says 172.21.15.50:58442) 2024-09-13T15:11:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4399400700 1 -- 172.21.15.50:0/2842520266 learned_addr learned my addr 172.21.15.50:0/2842520266 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4399e00700 1 --2- 172.21.15.50:0/2842520266 >> v2:172.21.15.181:3300/0 conn(0x7f43940cd610 0x7f439406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4398a00700 1 -- 172.21.15.50:0/2842520266 >> v2:172.21.15.181:3300/0 conn(0x7f43940cd610 msgr2=0x7f439406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4398a00700 1 --2- 172.21.15.50:0/2842520266 >> v2:172.21.15.181:3300/0 conn(0x7f43940cd610 0x7f439406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.869+0000 7f4398a00700 1 -- 172.21.15.50:0/2842520266 >> v1:172.21.15.50:6789/0 conn(0x7f439406a5d0 legacy=0x7f439406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f4398a00700 1 -- 172.21.15.50:0/2842520266 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439406c690 con 0x7f4394071d20 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f4398a00700 1 --2- 172.21.15.50:0/2842520266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4394071d20 0x7f43940b19f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f43940cce60 tx=0x7f4380009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78bdf7a81ce088e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f4393e00700 1 -- 172.21.15.50:0/2842520266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380011830 con 0x7f4394071d20 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f4393e00700 1 -- 172.21.15.50:0/2842520266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4380011990 con 0x7f4394071d20 2024-09-13T15:11:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f4393e00700 1 -- 172.21.15.50:0/2842520266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380011d20 con 0x7f4394071d20 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 -- 172.21.15.50:0/2842520266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4394071d20 msgr2=0x7f43940b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 --2- 172.21.15.50:0/2842520266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4394071d20 0x7f43940b19f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f43940cce60 tx=0x7f4380009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 -- 172.21.15.50:0/2842520266 shutdown_connections 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 --2- 172.21.15.50:0/2842520266 >> v2:172.21.15.181:3300/0 conn(0x7f43940cd610 0x7f439406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 --2- 172.21.15.50:0/2842520266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4394071d20 0x7f43940b19f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 -- 172.21.15.50:0/2842520266 >> 172.21.15.50:0/2842520266 conn(0x7f43940b08d0 msgr2=0x7f43940b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 -- 172.21.15.50:0/2842520266 shutdown_connections 2024-09-13T15:11:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.873+0000 7f439be00700 1 -- 172.21.15.50:0/2842520266 wait complete. 2024-09-13T15:11:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 Processor -- start 2024-09-13T15:11:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 -- start start 2024-09-13T15:11:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439406a5d0 0x7f43941430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4394071d20 0x7f43940a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 0x7f43940a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941469c0 con 0x7f43940cd610 2024-09-13T15:11:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4394145920 con 0x7f439406a5d0 2024-09-13T15:11:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f439be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4394145c00 con 0x7f4394071d20 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 0x7f43940a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 0x7f43940a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58208/0 (socket says 172.21.15.50:58208) 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 -- 172.21.15.50:0/3037444402 learned_addr learned my addr 172.21.15.50:0/3037444402 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399400700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439406a5d0 0x7f43941430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4398a00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4394071d20 0x7f43940a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 -- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4394071d20 msgr2=0x7f43940a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4394071d20 0x7f43940a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 -- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439406a5d0 msgr2=0x7f43941430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439406a5d0 0x7f43941430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 -- 172.21.15.50:0/3037444402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800094b0 con 0x7f43940cd610 2024-09-13T15:11:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399400700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439406a5d0 0x7f43941430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.877+0000 7f4399e00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 0x7f43940a9610 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e7f0 tx=0x7f438c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c0095c0 con 0x7f43940cd610 2024-09-13T15:11:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c013680 con 0x7f43940cd610 2024-09-13T15:11:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c013a10 con 0x7f43940cd610 2024-09-13T15:11:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4394145ee0 con 0x7f43940cd610 2024-09-13T15:11:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43941464a0 con 0x7f43940cd610 2024-09-13T15:11:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4394070d80 con 0x7f43940cd610 2024-09-13T15:11:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.881+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f438c013b70 con 0x7f43940cd610 2024-09-13T15:11:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.885+0000 7f4391600700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4374066730 0x7f4374068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.885+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f438c084250 con 0x7f43940cd610 2024-09-13T15:11:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.885+0000 7f4399400700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4374066730 0x7f4374068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:07.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.885+0000 7f4399400700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4374066730 0x7f4374068bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4388005cb0 tx=0x7f4388009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:07.889+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f438c051470 con 0x7f43940cd610 2024-09-13T15:11:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.265+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4394146690 con 0x7f43940cd610 2024-09-13T15:11:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.269+0000 7f4391600700 1 -- 172.21.15.50:0/3037444402 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f438c054a90 con 0x7f43940cd610 2024-09-13T15:11:08.270 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:08.270 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:11:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.269+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4374066730 msgr2=0x7f4374068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.269+0000 7f439be00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4374066730 0x7f4374068bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4388005cb0 tx=0x7f4388009040 comp rx=0 tx=0).stop 2024-09-13T15:11:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.269+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 msgr2=0x7f43940a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.269+0000 7f439be00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 0x7f43940a9610 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e7f0 tx=0x7f438c00ebb0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 shutdown_connections 2024-09-13T15:11:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4374066730 0x7f4374068bf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43940cd610 0x7f43940a9610 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4394071d20 0x7f43940a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 --2- 172.21.15.50:0/3037444402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439406a5d0 0x7f43941430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 >> 172.21.15.50:0/3037444402 conn(0x7f43940b08d0 msgr2=0x7f4394148140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 shutdown_connections 2024-09-13T15:11:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.273+0000 7f439be00700 1 -- 172.21.15.50:0/3037444402 wait complete. 2024-09-13T15:11:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:11:08.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-13T15:11:08.492 INFO:teuthology.orchestra.run.smithi050.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":23,"msgr_send_messages":25,"msgr_recv_bytes":6215,"msgr_send_bytes":13464,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.015294551,"msgr_running_send_time":0.000821330,"msgr_running_recv_time":0.007394307,"msgr_running_fast_dispatch_time":0.000999176,"msgr_send_messages_queue_lat":{"avgcount":24,"sum":0.120126185,"avgtime":0.005005257},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":100,"msgr_send_messages":89,"msgr_recv_bytes":121396,"msgr_send_bytes":46451,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.024932963,"msgr_running_send_time":0.008161400,"msgr_running_recv_time":0.022384414,"msgr_running_fast_dispatch_time":0.000485163,"msgr_send_messages_queue_lat":{"avgcount":89,"sum":0.159104740,"avgtime":0.001787693},"msgr_handle_ack_lat":{"avgcount":56,"sum":0.000020349,"avgtime":0.000000363},"msgr_recv_encrypted_bytes":110240,"msgr_send_encrypted_bytes":11888},"AsyncMessenger::Worker-2":{"msgr_recv_messages":25,"msgr_send_messages":25,"msgr_recv_bytes":7114,"msgr_send_bytes":76269,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.012601081,"msgr_running_send_time":0.001823238,"msgr_running_recv_time":0.009734270,"msgr_running_fast_dispatch_time":0.000758526,"msgr_send_messages_queue_lat":{"avgcount":23,"sum":0.269713737,"avgtime":0.011726684},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000004966,"avgtime":0.000000354},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":62800},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":41,"sum":0.004369676,"avgtime":0.000106577}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000020637,"avgtime":0.000010318}},"mds":{"request":26,"reply":26,"reply_latency":{"avgcount":26,"sum":0.009730839,"avgtime":0.000374263},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":51,"traverse_hit":51,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196983,"rdpos":0,"jlat":{"avgcount":5,"sum":0.017805050,"avgtime":0.003561010},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":48020,"heap":207224},"mds_server":{"dispatch_client_request":26,"dispatch_server_request":0,"handle_client_request":26,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":25,"sum":0.008825055,"avgtime":0.000353002},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000905784,"avgtime":0.000905784},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":24,"average_load":12,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":224963,"buffer_anon_items":79,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":51728,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13799,"op_resend":37,"op_reply":43,"op_latency":{"avgcount":43,"sum":1.051975000,"avgtime":0.024464534},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":77,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":144,"get_sum":117515,"get_or_fail_fail":0,"get_or_fail_success":144,"take":0,"take_sum":0,"put":144,"put_sum":117515,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13799,"put":43,"put_sum":13799,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563355b3cd20":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2679,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2679,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T15:11:08.493 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6215, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000999176, "msgr_running_recv_time": 0.007394307, "msgr_running_send_time": 0.00082133, "msgr_running_total_time": 0.015294551, "msgr_send_bytes": 13464, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 25, "msgr_send_messages_queue_lat": { "avgcount": 24, "avgtime": 0.005005257, "sum": 0.120126185 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 56, "avgtime": 3.63e-07, "sum": 2.0349e-05 }, "msgr_recv_bytes": 121396, "msgr_recv_encrypted_bytes": 110240, "msgr_recv_messages": 100, "msgr_running_fast_dispatch_time": 0.000485163, "msgr_running_recv_time": 0.022384414, "msgr_running_send_time": 0.0081614, "msgr_running_total_time": 0.024932963, "msgr_send_bytes": 46451, "msgr_send_encrypted_bytes": 11888, "msgr_send_messages": 89, "msgr_send_messages_queue_lat": { "avgcount": 89, "avgtime": 0.001787693, "sum": 0.15910474 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 3.54e-07, "sum": 4.966e-06 }, "msgr_recv_bytes": 7114, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.000758526, "msgr_running_recv_time": 0.00973427, "msgr_running_send_time": 0.001823238, "msgr_running_total_time": 0.012601081, "msgr_send_bytes": 76269, "msgr_send_encrypted_bytes": 62800, "msgr_send_messages": 25, "msgr_send_messages_queue_lat": { "avgcount": 23, "avgtime": 0.011726684, "sum": 0.269713737 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 41, "avgtime": 0.000106577, "sum": 0.004369676 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.0318e-05, "sum": 2.0637e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 26, "reply_latency": { "avgcount": 26, "avgtime": 0.000374263, "sum": 0.009730839 }, "request": 26, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 51, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 51, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.00356101, "sum": 0.01780505 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196983 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207224, "ino": 13, "ino+": 13, "ino-": 0, "rss": 48020 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 26, "dispatch_server_request": 0, "handle_client_request": 26, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 25, "avgtime": 0.000353002, "sum": 0.008825055 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000905784, "sum": 0.000905784 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 12, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 24 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 224963, "buffer_anon_items": 79, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 51728, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 77, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.024464534, "sum": 1.051975 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13799, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 144, "get_or_fail_fail": 0, "get_or_fail_success": 144, "get_started": 0, "get_sum": 117515, "max": 104857600, "put": 144, "put_sum": 117515, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13799, "take": 43, "take_sum": 13799, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563355b3cd20": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2679, "max": 3758096384, "put": 5, "put_sum": 2679, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T15:11:08.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 session ls 2024-09-13T15:11:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.661+0000 7faac1c00700 1 Processor -- start 2024-09-13T15:11:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.661+0000 7faac1c00700 1 -- start start 2024-09-13T15:11:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.661+0000 7faac1c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faabc159920 0x7faabc0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cd2a0 con 0x7faabc0b30d0 2024-09-13T15:11:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0ccc90 con 0x7faabc06d070 2024-09-13T15:11:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0b3580 con 0x7faabc159920 2024-09-13T15:11:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faab3e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faabc0b30d0 0x7faabc06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58456/0 (socket says 172.21.15.50:58456) 2024-09-13T15:11:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faab3e00700 1 -- 172.21.15.50:0/2236899877 learned_addr learned my addr 172.21.15.50:0/2236899877 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabbe00700 1 --2- 172.21.15.50:0/2236899877 >> v2:172.21.15.50:3300/0 conn(0x7faabc159920 0x7faabc0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558546374 0 0) 0x7faabc0cd2a0 con 0x7faabc0b30d0 2024-09-13T15:11:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa00035d0 con 0x7faabc0b30d0 2024-09-13T15:11:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719217776 0 0) 0x7faaa00035d0 con 0x7faabc0b30d0 2024-09-13T15:11:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 >> v2:172.21.15.50:3300/0 conn(0x7faabc159920 msgr2=0x7faabc0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 --2- 172.21.15.50:0/2236899877 >> v2:172.21.15.50:3300/0 conn(0x7faabc159920 0x7faabc0b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 >> v1:172.21.15.181:6789/0 conn(0x7faabc06d070 legacy=0x7faabc0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0b3860 con 0x7faabc0b30d0 2024-09-13T15:11:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7faaa4001670 con 0x7faabc0b30d0 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 >> v1:172.21.15.50:6789/0 conn(0x7faabc0b30d0 legacy=0x7faabc06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0003a20 0x7faaa0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faaa0004870 0x7faaa0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa0005230 0x7faaa000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0b3580 con 0x7faaa0005230 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa000c0d0 con 0x7faaa0003a20 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa000c290 con 0x7faaa0004870 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa0005230 0x7faaa000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faab3e00700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faaa0004870 0x7faaa0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabbe00700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0003a20 0x7faaa0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 -- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faaa0004870 msgr2=0x7faaa0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faaa0004870 0x7faaa0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 -- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0003a20 msgr2=0x7faaa0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0003a20 0x7faaa0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 -- 172.21.15.50:0/2236899877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa00035d0 con 0x7faaa0005230 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 -- 172.21.15.50:0/2236899877 reap_dead start 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faac1200700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa0005230 0x7faaa000ba30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faab400c190 tx=0x7faaa00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88727973853f8d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.665+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4001db0 con 0x7faaa0005230 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab400ccf0 con 0x7faaa0005230 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faabb400700 1 -- 172.21.15.50:0/2236899877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4003c60 con 0x7faaa0005230 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 -- 172.21.15.50:0/2236899877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa0005230 msgr2=0x7faaa000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa0005230 0x7faaa000ba30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faab400c190 tx=0x7faaa00058a0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 -- 172.21.15.50:0/2236899877 shutdown_connections 2024-09-13T15:11:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 --2- 172.21.15.50:0/2236899877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa0005230 0x7faaa000ba30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 -- 172.21.15.50:0/2236899877 >> 172.21.15.50:0/2236899877 conn(0x7faabc06a390 msgr2=0x7faabc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 -- 172.21.15.50:0/2236899877 shutdown_connections 2024-09-13T15:11:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 -- 172.21.15.50:0/2236899877 wait complete. 2024-09-13T15:11:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 Processor -- start 2024-09-13T15:11:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.669+0000 7faac1c00700 1 -- start start 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0005230 0x7faabc14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 0x7faabc0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faabc14ca80 0x7faabc14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc14ade0 con 0x7faabc0b1a80 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0b2420 con 0x7faaa0005230 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc14e010 con 0x7faabc14ca80 2024-09-13T15:11:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 0x7faabc0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 0x7faabc0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58232/0 (socket says 172.21.15.50:58232) 2024-09-13T15:11:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 -- 172.21.15.50:0/3962971837 learned_addr learned my addr 172.21.15.50:0/3962971837 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faabbe00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0005230 0x7faabc14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1200700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faabc14ca80 0x7faabc14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 -- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faabc14ca80 msgr2=0x7faabc14cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faabc14ca80 0x7faabc14cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 -- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0005230 msgr2=0x7faabc14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0005230 0x7faabc14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 -- 172.21.15.50:0/3962971837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc14d770 con 0x7faabc0b1a80 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faabbe00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0005230 0x7faabc14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab3e00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 0x7faabc0b1ee0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faaa40072c0 tx=0x7faaa4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab8c00700 1 -- 172.21.15.50:0/3962971837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40014c0 con 0x7faabc0b1a80 2024-09-13T15:11:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab8c00700 1 -- 172.21.15.50:0/3962971837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa400f850 con 0x7faabc0b1a80 2024-09-13T15:11:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc14da50 con 0x7faabc0b1a80 2024-09-13T15:11:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faab8c00700 1 -- 172.21.15.50:0/3962971837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400fc00 con 0x7faabc0b1a80 2024-09-13T15:11:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.673+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc1f36f0 con 0x7faabc0b1a80 2024-09-13T15:11:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.677+0000 7faab8c00700 1 -- 172.21.15.50:0/3962971837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faaa400fd60 con 0x7faabc0b1a80 2024-09-13T15:11:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.677+0000 7faab8c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa98066730 0x7faa98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.677+0000 7faab8c00700 1 -- 172.21.15.50:0/3962971837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faaa4083db0 con 0x7faabc0b1a80 2024-09-13T15:11:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.677+0000 7faabbe00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa98066730 0x7faa98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa98066730 0x7faa98068bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faaac0045e0 tx=0x7faaac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 Processor -- start 2024-09-13T15:11:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 -- start start 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x390de230 0x390dc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x390df960 0x390dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x39070010 con 0x39106ec0 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x38ffdf40 con 0x390df960 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x39050e30 con 0x390de230 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58248/0 (socket says 172.21.15.50:58248) 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 -- 172.21.15.50:0/1278187355 learned_addr learned my addr 172.21.15.50:0/1278187355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faab3e00700 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x390de230 0x390dc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faac1200700 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x390df960 0x390dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 -- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x390de230 msgr2=0x390dc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x390de230 0x390dc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 -- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x390df960 msgr2=0x390dcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x390df960 0x390dcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.681+0000 7faabbe00700 1 -- 172.21.15.50:0/1278187355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x38ebca40 con 0x39106ec0 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faabbe00700 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391072a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7faaac006b40 tx=0x7faaac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d678d99bd8f09e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faab0c00700 1 -- 172.21.15.50:0/1278187355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0155f0 con 0x39106ec0 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faab0c00700 1 -- 172.21.15.50:0/1278187355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac015750 con 0x39106ec0 2024-09-13T15:11:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faab0c00700 1 -- 172.21.15.50:0/1278187355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac015ac0 con 0x39106ec0 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 -- 172.21.15.50:0/1278187355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 msgr2=0x391072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391072a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7faaac006b40 tx=0x7faaac014000 comp rx=0 tx=0).stop 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 -- 172.21.15.50:0/1278187355 shutdown_connections 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x390df960 0x390dcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x390de230 0x390dc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 --2- 172.21.15.50:0/1278187355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391072a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 -- 172.21.15.50:0/1278187355 >> 172.21.15.50:0/1278187355 conn(0x38e715b0 msgr2=0x390e2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 -- 172.21.15.50:0/1278187355 shutdown_connections 2024-09-13T15:11:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 -- 172.21.15.50:0/1278187355 wait complete. 2024-09-13T15:11:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 -- start start 2024-09-13T15:11:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.685+0000 7faac64d1740 1 Processor -- start 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 0x39109d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x3912ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x3912e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x3904c150 con 0x390df960 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x39049eb0 con 0x39106ec0 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x390078e0 con 0x3910a290 2024-09-13T15:11:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 10 client.0 _ll_register_callbacks cb 0x38fe6670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:11:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 0x39109d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 0x39109d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58256/0 (socket says 172.21.15.50:58256) 2024-09-13T15:11:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 -- 172.21.15.50:0/1956690605 learned_addr learned my addr 172.21.15.50:0/1956690605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faab3e00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x3912ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac1200700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x3912e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 -- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 msgr2=0x3912e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x3912e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 -- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 msgr2=0x3912ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x3912ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 -- 172.21.15.50:0/1956690605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac009630 con 0x390df960 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faab3e00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x3912ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faabbe00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 0x39109d50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7faaac008010 tx=0x7faaac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558bbc90bbe41343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faaa9600700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faaa9600700 1 -- 172.21.15.50:0/1956690605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0155f0 con 0x390df960 2024-09-13T15:11:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faaa9600700 1 -- 172.21.15.50:0/1956690605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faaac021650 con 0x390df960 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.689+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x38e7e2c0 con 0x390df960 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 1 -- 172.21.15.50:0/1956690605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaac004250 con 0x390df960 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 10 client.6777 fetch_fsmap learned FSMap version 39 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x39010290 con 0x390df960 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 1 -- 172.21.15.50:0/1956690605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x38e7e2c0 con 0x390df960 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 1 -- 172.21.15.50:0/1956690605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7faaac021810 con 0x390df960 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 10 client.6777 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 10 client.6777 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 20 client.6777 populate_metadata read hostname 'smithi050' 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x390f6460 0x390f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 4 client.6777 mds_command: new command op to 6525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 --> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x38ec8540 con 0x390f6460 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faab3e00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x390f6460 0x390f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faab3e00700 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x390f6460 0x390f6840 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4476725de6c43459 server_cookie=e6eac474e268262c in_seq=0 out_seq=0 2024-09-13T15:11:08.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 10 client.6777 ms_handle_connect on v2:172.21.15.50:6834/1253018463 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 1 -- 172.21.15.50:0/1956690605 <== mds.0 v2:172.21.15.50:6834/1253018463 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x38ec8540 con 0x390f6460 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 10 client.6777 handle_command_reply: tid=0 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 client.6777 shutdown 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 msgr2=0x39109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 0x39109d50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7faaac008010 tx=0x7faaac0047e0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 shutdown_connections 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x390f6460 0x390f6840 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x3912e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x3912ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 --2- 172.21.15.50:0/1956690605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x390df960 0x39109d50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 >> 172.21.15.50:0/1956690605 conn(0x38e715b0 msgr2=0x390de620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.693+0000 7faaa9600700 0 client.6777 ms_handle_reset on v2:172.21.15.50:6834/1253018463 2024-09-13T15:11:08.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.697+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 shutdown_connections 2024-09-13T15:11:08.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.697+0000 7faac64d1740 1 -- 172.21.15.50:0/1956690605 wait complete. 2024-09-13T15:11:08.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.697+0000 7faac64d1740 20 client.6777 trim_cache size 0 max 16384 2024-09-13T15:11:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 Processor -- start 2024-09-13T15:11:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 -- start start 2024-09-13T15:11:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x39149690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391368f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 0x3912dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x38ef5b80 con 0x39136e30 2024-09-13T15:11:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x38fe8620 con 0x39106ec0 2024-09-13T15:11:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x39071610 con 0x3910a290 2024-09-13T15:11:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 0x3912dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 0x3912dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58270/0 (socket says 172.21.15.50:58270) 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 -- 172.21.15.50:0/2372298277 learned_addr learned my addr 172.21.15.50:0/2372298277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faab3e00700 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faabbe00700 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x39149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 -- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 msgr2=0x391368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 -- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 msgr2=0x39149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x39149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faac1200700 1 -- 172.21.15.50:0/2372298277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x38ff64c0 con 0x39136e30 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.717+0000 7faabbe00700 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x39149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac1200700 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 0x3912dd10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faabc073af0 tx=0x7faab4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88941f61474131 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faab1600700 1 -- 172.21.15.50:0/2372298277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab400ce60 con 0x39136e30 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faab1600700 1 -- 172.21.15.50:0/2372298277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4001cd0 con 0x39136e30 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faab1600700 1 -- 172.21.15.50:0/2372298277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4003c40 con 0x39136e30 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- 172.21.15.50:0/2372298277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 msgr2=0x3912dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 0x3912dd10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faabc073af0 tx=0x7faab4011000 comp rx=0 tx=0).stop 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- 172.21.15.50:0/2372298277 shutdown_connections 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39136e30 0x3912dd10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- 172.21.15.50:0/2372298277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39106ec0 0x39149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- 172.21.15.50:0/2372298277 >> 172.21.15.50:0/2372298277 conn(0x38e715b0 msgr2=0x39141780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- 172.21.15.50:0/2372298277 shutdown_connections 2024-09-13T15:11:08.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- 172.21.15.50:0/2372298277 wait complete. 2024-09-13T15:11:08.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- start start 2024-09-13T15:11:08.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 Processor -- start 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391966f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39136e30 0x39196c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x39147e40 con 0x39106ec0 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x39148ba0 con 0x39136e30 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x39193090 con 0x3910a290 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.721+0000 7faac64d1740 10 client.0 _ll_register_callbacks cb 0x39048a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58276/0 (socket says 172.21.15.50:58276) 2024-09-13T15:11:08.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 -- 172.21.15.50:0/814441688 learned_addr learned my addr 172.21.15.50:0/814441688 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faab3e00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac1200700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39136e30 0x39196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 -- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 msgr2=0x391966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 -- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39136e30 msgr2=0x39196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39136e30 0x39196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 -- 172.21.15.50:0/814441688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa00035d0 con 0x39106ec0 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faab3e00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faabbe00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391481c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faaac000c00 tx=0x7faaac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5eda6d593153833 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faaa9600700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:11:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faaa9600700 1 -- 172.21.15.50:0/814441688 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac045030 con 0x39106ec0 2024-09-13T15:11:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faaac015750 con 0x39106ec0 2024-09-13T15:11:08.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faaa9600700 1 -- 172.21.15.50:0/814441688 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faaac046070 con 0x39106ec0 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faaa9600700 1 -- 172.21.15.50:0/814441688 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaac003de0 con 0x39106ec0 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 10 client.6783 fetch_fsmap learned FSMap version 39 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x38fea790 con 0x39106ec0 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faaa9600700 1 -- 172.21.15.50:0/814441688 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac015750 con 0x39106ec0 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faaa9600700 1 -- 172.21.15.50:0/814441688 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7faaac035820 con 0x39106ec0 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 10 client.6783 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T15:11:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 10 client.6783 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 20 client.6783 populate_metadata read hostname 'smithi050' 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x39148700 0x39197170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 4 client.6783 mds_command: new command op to 6525 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 --> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x38eed2c0 con 0x39148700 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.725+0000 7faab3e00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x39148700 0x39197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faaa9600700 10 client.6783 ms_handle_connect on v2:172.21.15.50:6834/1253018463 2024-09-13T15:11:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faab3e00700 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x39148700 0x39197170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33eb0814473bced server_cookie=5ab3f23bccfa1cfb in_seq=0 out_seq=0 2024-09-13T15:11:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faaa9600700 1 -- 172.21.15.50:0/814441688 <== mds.0 v2:172.21.15.50:6834/1253018463 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x38eed2c0 con 0x39148700 2024-09-13T15:11:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faaa9600700 10 client.6783 handle_command_reply: tid=0 2024-09-13T15:11:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 client.6783 shutdown 2024-09-13T15:11:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 msgr2=0x391481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391481c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faaac000c00 tx=0x7faaac0046c0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 shutdown_connections 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:6834/1253018463,v1:172.21.15.50:6835/1253018463] conn(0x39148700 0x39197170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x39136e30 0x39196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3910a290 0x391966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 --2- 172.21.15.50:0/814441688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x39106ec0 0x391481c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faaa9600700 0 client.6783 ms_handle_reset on v2:172.21.15.50:6834/1253018463 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 >> 172.21.15.50:0/814441688 conn(0x38e715b0 msgr2=0x391059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 shutdown_connections 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 1 -- 172.21.15.50:0/814441688 wait complete. 2024-09-13T15:11:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac64d1740 20 client.6783 trim_cache size 0 max 16384 2024-09-13T15:11:08.734 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-13T15:11:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa98066730 msgr2=0x7faa98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa98066730 0x7faa98068bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faaac0045e0 tx=0x7faaac008040 comp rx=0 tx=0).stop 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 msgr2=0x7faabc0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 0x7faabc0b1ee0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faaa40072c0 tx=0x7faaa4007680 comp rx=0 tx=0).stop 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 shutdown_connections 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa98066730 0x7faa98068bf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faabc14ca80 0x7faabc14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc0b1a80 0x7faabc0b1ee0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 --2- 172.21.15.50:0/3962971837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0005230 0x7faabc14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 >> 172.21.15.50:0/3962971837 conn(0x7faabc06a390 msgr2=0x7faabc1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 shutdown_connections 2024-09-13T15:11:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:08.729+0000 7faac1c00700 1 -- 172.21.15.50:0/3962971837 wait complete. 2024-09-13T15:11:08.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-13T15:11:08.942 INFO:teuthology.orchestra.run.smithi050.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":23,"msgr_send_messages":25,"msgr_recv_bytes":6215,"msgr_send_bytes":13464,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.015694434,"msgr_running_send_time":0.000821330,"msgr_running_recv_time":0.007394307,"msgr_running_fast_dispatch_time":0.000999176,"msgr_send_messages_queue_lat":{"avgcount":24,"sum":0.120126185,"avgtime":0.005005257},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":102,"msgr_send_messages":91,"msgr_recv_bytes":121686,"msgr_send_bytes":65723,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.026989182,"msgr_running_send_time":0.008372330,"msgr_running_recv_time":0.023885480,"msgr_running_fast_dispatch_time":0.000485163,"msgr_send_messages_queue_lat":{"avgcount":91,"sum":0.159177349,"avgtime":0.001749201},"msgr_handle_ack_lat":{"avgcount":58,"sum":0.000020719,"avgtime":0.000000357},"msgr_recv_encrypted_bytes":110240,"msgr_send_encrypted_bytes":11888},"AsyncMessenger::Worker-2":{"msgr_recv_messages":25,"msgr_send_messages":25,"msgr_recv_bytes":7114,"msgr_send_bytes":76269,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.012601081,"msgr_running_send_time":0.001823238,"msgr_running_recv_time":0.009734270,"msgr_running_fast_dispatch_time":0.000758526,"msgr_send_messages_queue_lat":{"avgcount":23,"sum":0.269713737,"avgtime":0.011726684},"msgr_handle_ack_lat":{"avgcount":14,"sum":0.000004966,"avgtime":0.000000354},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":62800},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":41,"sum":0.004369676,"avgtime":0.000106577}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000020637,"avgtime":0.000010318}},"mds":{"request":26,"reply":26,"reply_latency":{"avgcount":26,"sum":0.009730839,"avgtime":0.000374263},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":51,"traverse_hit":51,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196983,"rdpos":0,"jlat":{"avgcount":5,"sum":0.017805050,"avgtime":0.003561010},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":48276,"heap":207224},"mds_server":{"dispatch_client_request":26,"dispatch_server_request":0,"handle_client_request":26,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":25,"sum":0.008825055,"avgtime":0.000353002},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000905784,"avgtime":0.000905784},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":24,"average_load":12,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":224963,"buffer_anon_items":79,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":51728,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13799,"op_resend":37,"op_reply":43,"op_latency":{"avgcount":43,"sum":1.051975000,"avgtime":0.024464534},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":77,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":146,"get_sum":117625,"get_or_fail_fail":0,"get_or_fail_success":146,"take":0,"take_sum":0,"put":146,"put_sum":117625,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13799,"put":43,"put_sum":13799,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563355b3cd20":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2679,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2679,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T15:11:08.944 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6215, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000999176, "msgr_running_recv_time": 0.007394307, "msgr_running_send_time": 0.00082133, "msgr_running_total_time": 0.015694434, "msgr_send_bytes": 13464, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 25, "msgr_send_messages_queue_lat": { "avgcount": 24, "avgtime": 0.005005257, "sum": 0.120126185 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 58, "avgtime": 3.57e-07, "sum": 2.0719e-05 }, "msgr_recv_bytes": 121686, "msgr_recv_encrypted_bytes": 110240, "msgr_recv_messages": 102, "msgr_running_fast_dispatch_time": 0.000485163, "msgr_running_recv_time": 0.02388548, "msgr_running_send_time": 0.00837233, "msgr_running_total_time": 0.026989182, "msgr_send_bytes": 65723, "msgr_send_encrypted_bytes": 11888, "msgr_send_messages": 91, "msgr_send_messages_queue_lat": { "avgcount": 91, "avgtime": 0.001749201, "sum": 0.159177349 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 14, "avgtime": 3.54e-07, "sum": 4.966e-06 }, "msgr_recv_bytes": 7114, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.000758526, "msgr_running_recv_time": 0.00973427, "msgr_running_send_time": 0.001823238, "msgr_running_total_time": 0.012601081, "msgr_send_bytes": 76269, "msgr_send_encrypted_bytes": 62800, "msgr_send_messages": 25, "msgr_send_messages_queue_lat": { "avgcount": 23, "avgtime": 0.011726684, "sum": 0.269713737 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 41, "avgtime": 0.000106577, "sum": 0.004369676 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.0318e-05, "sum": 2.0637e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 26, "reply_latency": { "avgcount": 26, "avgtime": 0.000374263, "sum": 0.009730839 }, "request": 26, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 51, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 51, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.00356101, "sum": 0.01780505 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196983 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207224, "ino": 13, "ino+": 13, "ino-": 0, "rss": 48276 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 26, "dispatch_server_request": 0, "handle_client_request": 26, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 25, "avgtime": 0.000353002, "sum": 0.008825055 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000905784, "sum": 0.000905784 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 12, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 24 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 224963, "buffer_anon_items": 79, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 51728, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 77, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.024464534, "sum": 1.051975 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13799, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 146, "get_or_fail_fail": 0, "get_or_fail_success": 146, "get_started": 0, "get_sum": 117625, "max": 104857600, "put": 146, "put_sum": 117625, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13799, "take": 43, "take_sum": 13799, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563355b3cd20": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2679, "max": 3758096384, "put": 5, "put_sum": 2679, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T15:11:08.945 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T15:11:08.945 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:11:08.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:08.989 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:09.030 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:11:09.031 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:09.031 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:09.049 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:09.049 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:09.050 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:09.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:09.091 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:09.091 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:09.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:09.111 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:09.111 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:09.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:09.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.341+0000 7feb1ca00700 1 Processor -- start 2024-09-13T15:11:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.341+0000 7feb1ca00700 1 -- start start 2024-09-13T15:11:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb1ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb180719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb1ca00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb1806aaa0 0x7feb1806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb1ca00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180b3560 con 0x7feb180b2670 2024-09-13T15:11:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb1ca00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb18070b30 con 0x7feb1806aaa0 2024-09-13T15:11:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb1ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1806b420 con 0x7feb181610b0 2024-09-13T15:11:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb0ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb1806aaa0 0x7feb1806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb17e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feb180b2670 0x7feb180cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58472/0 (socket says 172.21.15.50:58472) 2024-09-13T15:11:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb17e00700 1 -- 172.21.15.50:0/4093007242 learned_addr learned my addr 172.21.15.50:0/4093007242 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb17400700 1 --2- 172.21.15.50:0/4093007242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb180719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb0ea00700 1 -- 172.21.15.50:0/4093007242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 msgr2=0x7feb180719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb0ea00700 1 --2- 172.21.15.50:0/4093007242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb180719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb0ea00700 1 -- 172.21.15.50:0/4093007242 >> v1:172.21.15.50:6789/0 conn(0x7feb180b2670 legacy=0x7feb180cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.345+0000 7feb0ea00700 1 -- 172.21.15.50:0/4093007242 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180b3280 con 0x7feb1806aaa0 2024-09-13T15:11:09.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb0ea00700 1 --2- 172.21.15.50:0/4093007242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1806aee0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7feb00009850 tx=0x7feb00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f95618a5242612 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:09.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb16a00700 1 -- 172.21.15.50:0/4093007242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00004230 con 0x7feb1806aaa0 2024-09-13T15:11:09.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb16a00700 1 -- 172.21.15.50:0/4093007242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00004390 con 0x7feb1806aaa0 2024-09-13T15:11:09.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb16a00700 1 -- 172.21.15.50:0/4093007242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000036c0 con 0x7feb1806aaa0 2024-09-13T15:11:09.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 -- 172.21.15.50:0/4093007242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 msgr2=0x7feb1806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 --2- 172.21.15.50:0/4093007242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1806aee0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7feb00009850 tx=0x7feb00009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 -- 172.21.15.50:0/4093007242 shutdown_connections 2024-09-13T15:11:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 --2- 172.21.15.50:0/4093007242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1806aee0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 --2- 172.21.15.50:0/4093007242 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb180719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 -- 172.21.15.50:0/4093007242 >> 172.21.15.50:0/4093007242 conn(0x7feb180b0c40 msgr2=0x7feb1806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:09.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 -- 172.21.15.50:0/4093007242 shutdown_connections 2024-09-13T15:11:09.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.349+0000 7feb1ca00700 1 -- 172.21.15.50:0/4093007242 wait complete. 2024-09-13T15:11:09.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 Processor -- start 2024-09-13T15:11:09.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 -- start start 2024-09-13T15:11:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1814c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb180b2670 0x7feb180a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb1806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1814ce20 con 0x7feb1806aaa0 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1814d100 con 0x7feb180b2670 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb1ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1814d3e0 con 0x7feb181610b0 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1814c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1814c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58302/0 (socket says 172.21.15.50:58302) 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 -- 172.21.15.50:0/605506886 learned_addr learned my addr 172.21.15.50:0/605506886 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17e00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb1806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb0ea00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb180b2670 0x7feb180a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 -- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 msgr2=0x7feb1806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb1806cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 -- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb180b2670 msgr2=0x7feb180a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb180b2670 0x7feb180a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 -- 172.21.15.50:0/605506886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000094b0 con 0x7feb1806aaa0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.353+0000 7feb17400700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1814c560 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feb0800e870 tx=0x7feb0800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.357+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080095c0 con 0x7feb1806aaa0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.357+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800ee70 con 0x7feb1806aaa0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.357+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800ca70 con 0x7feb1806aaa0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.357+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1814d6c0 con 0x7feb1806aaa0 2024-09-13T15:11:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.357+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1814dc80 con 0x7feb1806aaa0 2024-09-13T15:11:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.357+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb180b23e0 con 0x7feb1806aaa0 2024-09-13T15:11:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.361+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb0800cbd0 con 0x7feb1806aaa0 2024-09-13T15:11:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.361+0000 7feb0fe00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feaf4066730 0x7feaf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.361+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb08084340 con 0x7feb1806aaa0 2024-09-13T15:11:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.361+0000 7feb0ea00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feaf4066730 0x7feaf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.361+0000 7feb0ea00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feaf4066730 0x7feaf4068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feb180ce560 tx=0x7feb00008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:09.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.369+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb080514d0 con 0x7feb1806aaa0 2024-09-13T15:11:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.629+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb18161490 con 0x7feb1806aaa0 2024-09-13T15:11:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.629+0000 7feb0fe00700 1 -- 172.21.15.50:0/605506886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7feb08054af0 con 0x7feb1806aaa0 2024-09-13T15:11:09.631 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:09.632 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:11:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feaf4066730 msgr2=0x7feaf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feaf4066730 0x7feaf4068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feb180ce560 tx=0x7feb00008030 comp rx=0 tx=0).stop 2024-09-13T15:11:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 msgr2=0x7feb1814c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1814c560 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feb0800e870 tx=0x7feb0800ec30 comp rx=0 tx=0).stop 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 shutdown_connections 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feaf4066730 0x7feaf4068bf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb181610b0 0x7feb1806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb180b2670 0x7feb180a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 --2- 172.21.15.50:0/605506886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb1806aaa0 0x7feb1814c560 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 >> 172.21.15.50:0/605506886 conn(0x7feb180b0c40 msgr2=0x7feb1806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 shutdown_connections 2024-09-13T15:11:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.633+0000 7feb1ca00700 1 -- 172.21.15.50:0/605506886 wait complete. 2024-09-13T15:11:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:11:09.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.825+0000 7f1982800700 1 Processor -- start 2024-09-13T15:11:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.825+0000 7f1982800700 1 -- start start 2024-09-13T15:11:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1982800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f197c06aaa0 0x7f197c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1982800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0b3560 con 0x7f197c1610b0 2024-09-13T15:11:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1982800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0b3280 con 0x7f197c0b2670 2024-09-13T15:11:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1982800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c070b30 con 0x7f197c06aaa0 2024-09-13T15:11:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f197c06aaa0 0x7f197c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f197c06aaa0 0x7f197c06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58310/0 (socket says 172.21.15.50:58310) 2024-09-13T15:11:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 -- 172.21.15.50:0/3225849633 learned_addr learned my addr 172.21.15.50:0/3225849633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 -- 172.21.15.50:0/3225849633 >> v1:172.21.15.181:6789/0 conn(0x7f197c0b2670 legacy=0x7f197c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 -- 172.21.15.50:0/3225849633 >> v1:172.21.15.50:6789/0 conn(0x7f197c1610b0 legacy=0x7f197c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 -- 172.21.15.50:0/3225849633 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c070ee0 con 0x7f197c06aaa0 2024-09-13T15:11:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f1980a00700 1 --2- 172.21.15.50:0/3225849633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c06af10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1968009940 tx=0x7f1968009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c796d8c4e28ad52a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.829+0000 7f197be00700 1 -- 172.21.15.50:0/3225849633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968004230 con 0x7f197c06aaa0 2024-09-13T15:11:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f197be00700 1 -- 172.21.15.50:0/3225849633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1968009e90 con 0x7f197c06aaa0 2024-09-13T15:11:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f197be00700 1 -- 172.21.15.50:0/3225849633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680045b0 con 0x7f197c06aaa0 2024-09-13T15:11:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 -- 172.21.15.50:0/3225849633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 msgr2=0x7f197c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 --2- 172.21.15.50:0/3225849633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c06af10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1968009940 tx=0x7f1968009c50 comp rx=0 tx=0).stop 2024-09-13T15:11:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 -- 172.21.15.50:0/3225849633 shutdown_connections 2024-09-13T15:11:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 --2- 172.21.15.50:0/3225849633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c06af10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 -- 172.21.15.50:0/3225849633 >> 172.21.15.50:0/3225849633 conn(0x7f197c0b0c40 msgr2=0x7f197c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 -- 172.21.15.50:0/3225849633 shutdown_connections 2024-09-13T15:11:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.833+0000 7f1982800700 1 -- 172.21.15.50:0/3225849633 wait complete. 2024-09-13T15:11:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 Processor -- start 2024-09-13T15:11:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 -- start start 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c1eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f197c0b2670 0x7f197c1ec610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f197c1610b0 0x7f197c0a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1ecb50 con 0x7f197c06aaa0 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1ed970 con 0x7f197c1610b0 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1982800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1ecd60 con 0x7f197c0b2670 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1981400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c1eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1981400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c1eaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58320/0 (socket says 172.21.15.50:58320) 2024-09-13T15:11:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1981400700 1 -- 172.21.15.50:0/3735851608 learned_addr learned my addr 172.21.15.50:0/3735851608 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1980a00700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f197c0b2670 0x7f197c1ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.837+0000 7f1981e00700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f197c1610b0 0x7f197c0a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981400700 1 -- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f197c0b2670 msgr2=0x7f197c1ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981400700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f197c0b2670 0x7f197c1ec610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981400700 1 -- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f197c1610b0 msgr2=0x7f197c0a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981400700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f197c1610b0 0x7f197c0a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981400700 1 -- 172.21.15.50:0/3735851608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1968009570 con 0x7f197c06aaa0 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981e00700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f197c1610b0 0x7f197c0a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1980a00700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f197c0b2670 0x7f197c1ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1981400700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c1eaea0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f197000c410 tx=0x7f197000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700052d0 con 0x7f197c06aaa0 2024-09-13T15:11:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970005430 con 0x7f197c06aaa0 2024-09-13T15:11:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c1ed040 con 0x7f197c06aaa0 2024-09-13T15:11:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700055a0 con 0x7f197c06aaa0 2024-09-13T15:11:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c1ed600 con 0x7f197c06aaa0 2024-09-13T15:11:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.841+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c06af10 con 0x7f197c06aaa0 2024-09-13T15:11:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.845+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19700036a0 con 0x7f197c06aaa0 2024-09-13T15:11:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.845+0000 7f1979600700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f195c066730 0x7f195c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.845+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1970083620 con 0x7f197c06aaa0 2024-09-13T15:11:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.845+0000 7f1980a00700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f195c066730 0x7f195c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.849+0000 7f1980a00700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f195c066730 0x7f195c068bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1968009890 tx=0x7f1968008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:09.849+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19700507b0 con 0x7f197c06aaa0 2024-09-13T15:11:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.049+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f197c1606d0 con 0x7f197c06aaa0 2024-09-13T15:11:10.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.049+0000 7f1979600700 1 -- 172.21.15.50:0/3735851608 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16765 (secure 0 0 0) 0x7f1970053dd0 con 0x7f197c06aaa0 2024-09-13T15:11:10.053 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:10.053 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:54.464580+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f195c066730 msgr2=0x7f195c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f195c066730 0x7f195c068bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1968009890 tx=0x7f1968008030 comp rx=0 tx=0).stop 2024-09-13T15:11:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 msgr2=0x7f197c1eaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c1eaea0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f197000c410 tx=0x7f197000c7d0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 shutdown_connections 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f195c066730 0x7f195c068bf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f197c1610b0 0x7f197c0a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f197c0b2670 0x7f197c1ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 --2- 172.21.15.50:0/3735851608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c06aaa0 0x7f197c1eaea0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 >> 172.21.15.50:0/3735851608 conn(0x7f197c0b0c40 msgr2=0x7f197c15f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 shutdown_connections 2024-09-13T15:11:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.057+0000 7f1982800700 1 -- 172.21.15.50:0/3735851608 wait complete. 2024-09-13T15:11:10.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:10:51.524270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:10:52.462039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:10.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:10.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.265+0000 7fa66ae00700 1 Processor -- start 2024-09-13T15:11:10.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.265+0000 7fa66ae00700 1 -- start start 2024-09-13T15:11:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa66ae00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6640725c0 0x7fa66415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa66ae00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa66406ed70 0x7fa66406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa66ae00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66406f6e0 con 0x7fa664157470 2024-09-13T15:11:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa66ae00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa664157850 con 0x7fa6640725c0 2024-09-13T15:11:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa66ae00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66415dd20 con 0x7fa66406ed70 2024-09-13T15:11:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6640725c0 0x7fa66415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa668e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa66406ed70 0x7fa66406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6640725c0 0x7fa66415d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58334/0 (socket says 172.21.15.50:58334) 2024-09-13T15:11:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 -- 172.21.15.50:0/468319465 learned_addr learned my addr 172.21.15.50:0/468319465 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 -- 172.21.15.50:0/468319465 >> v2:172.21.15.181:3300/0 conn(0x7fa66406ed70 msgr2=0x7fa66406f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 --2- 172.21.15.50:0/468319465 >> v2:172.21.15.181:3300/0 conn(0x7fa66406ed70 0x7fa66406f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 -- 172.21.15.50:0/468319465 >> v1:172.21.15.181:6789/0 conn(0x7fa664157470 legacy=0x7fa66415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.269+0000 7fa663400700 1 -- 172.21.15.50:0/468319465 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66415e000 con 0x7fa6640725c0 2024-09-13T15:11:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa663400700 1 --2- 172.21.15.50:0/468319465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6640725c0 0x7fa66415d4d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa6640b2800 tx=0x7fa650009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3634598cf4f5c4a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa662a00700 1 -- 172.21.15.50:0/468319465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650011830 con 0x7fa6640725c0 2024-09-13T15:11:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa662a00700 1 -- 172.21.15.50:0/468319465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650011990 con 0x7fa6640725c0 2024-09-13T15:11:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa662a00700 1 -- 172.21.15.50:0/468319465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650011d20 con 0x7fa6640725c0 2024-09-13T15:11:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 -- 172.21.15.50:0/468319465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6640725c0 msgr2=0x7fa66415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 --2- 172.21.15.50:0/468319465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6640725c0 0x7fa66415d4d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa6640b2800 tx=0x7fa650009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 -- 172.21.15.50:0/468319465 shutdown_connections 2024-09-13T15:11:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 --2- 172.21.15.50:0/468319465 >> v2:172.21.15.181:3300/0 conn(0x7fa66406ed70 0x7fa66406f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 --2- 172.21.15.50:0/468319465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6640725c0 0x7fa66415d4d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 -- 172.21.15.50:0/468319465 >> 172.21.15.50:0/468319465 conn(0x7fa6640b1e10 msgr2=0x7fa66406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 -- 172.21.15.50:0/468319465 shutdown_connections 2024-09-13T15:11:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.273+0000 7fa66ae00700 1 -- 172.21.15.50:0/468319465 wait complete. 2024-09-13T15:11:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 Processor -- start 2024-09-13T15:11:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 -- start start 2024-09-13T15:11:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 0x7fa664143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6640725c0 0x7fa664143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa664157470 0x7fa6640cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664152030 con 0x7fa66406ed70 2024-09-13T15:11:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6641513b0 con 0x7fa664157470 2024-09-13T15:11:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa66ae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa664151690 con 0x7fa6640725c0 2024-09-13T15:11:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 0x7fa664143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 0x7fa664143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58344/0 (socket says 172.21.15.50:58344) 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 -- 172.21.15.50:0/1043516574 learned_addr learned my addr 172.21.15.50:0/1043516574 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa668e00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa664157470 0x7fa6640cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663400700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6640725c0 0x7fa664143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 -- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6640725c0 msgr2=0x7fa664143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6640725c0 0x7fa664143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 -- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa664157470 msgr2=0x7fa6640cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa664157470 0x7fa6640cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.277+0000 7fa663e00700 1 -- 172.21.15.50:0/1043516574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009570 con 0x7fa66406ed70 2024-09-13T15:11:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa663e00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 0x7fa664143b70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c450 tx=0x7fa65400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540052d0 con 0x7fa66406ed70 2024-09-13T15:11:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654005430 con 0x7fa66406ed70 2024-09-13T15:11:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540055a0 con 0x7fa66406ed70 2024-09-13T15:11:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa664151970 con 0x7fa66406ed70 2024-09-13T15:11:10.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6641440b0 con 0x7fa66406ed70 2024-09-13T15:11:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.281+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66406f1a0 con 0x7fa66406ed70 2024-09-13T15:11:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.285+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa654003900 con 0x7fa66406ed70 2024-09-13T15:11:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.285+0000 7fa65be00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa644066730 0x7fa644068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.285+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa654083620 con 0x7fa66406ed70 2024-09-13T15:11:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.285+0000 7fa663400700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa644066730 0x7fa644068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.289+0000 7fa663400700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa644066730 0x7fa644068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa650000c00 tx=0x7fa650008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:10.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.289+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6540507b0 con 0x7fa66406ed70 2024-09-13T15:11:10.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.481+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa66406beb0 con 0x7fa66406ed70 2024-09-13T15:11:10.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.481+0000 7fa65be00700 1 -- 172.21.15.50:0/1043516574 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa65400ce60 con 0x7fa66406ed70 2024-09-13T15:11:10.484 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:10.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa644066730 msgr2=0x7fa644068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa644066730 0x7fa644068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa650000c00 tx=0x7fa650008030 comp rx=0 tx=0).stop 2024-09-13T15:11:10.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 msgr2=0x7fa664143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 0x7fa664143b70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c450 tx=0x7fa65400c760 comp rx=0 tx=0).stop 2024-09-13T15:11:10.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 shutdown_connections 2024-09-13T15:11:10.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa644066730 0x7fa644068bf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa664157470 0x7fa6640cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6640725c0 0x7fa664143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 --2- 172.21.15.50:0/1043516574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa66406ed70 0x7fa664143b70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 >> 172.21.15.50:0/1043516574 conn(0x7fa6640b1e10 msgr2=0x7fa6640ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:10.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 shutdown_connections 2024-09-13T15:11:10.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.489+0000 7fa66ae00700 1 -- 172.21.15.50:0/1043516574 wait complete. 2024-09-13T15:11:10.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:11:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.697+0000 7fe0dd200700 1 Processor -- start 2024-09-13T15:11:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.697+0000 7fe0dd200700 1 -- start start 2024-09-13T15:11:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 0x7fe0d80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0d806ada0 0x7fe0d806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d8160680 con 0x7fe0d815ca20 2024-09-13T15:11:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d806b770 con 0x7fe0d806ada0 2024-09-13T15:11:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d815d670 con 0x7fe0d806cd80 2024-09-13T15:11:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 0x7fe0d80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0d806ada0 0x7fe0d806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d7400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe0d815ca20 0x7fe0d815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52518/0 (socket says 172.21.15.50:52518) 2024-09-13T15:11:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 0x7fe0d80b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38508/0 (socket says 172.21.15.50:38508) 2024-09-13T15:11:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d7400700 1 -- 172.21.15.50:0/156883879 learned_addr learned my addr 172.21.15.50:0/156883879 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 -- 172.21.15.50:0/156883879 >> v2:172.21.15.50:3300/0 conn(0x7fe0d806ada0 msgr2=0x7fe0d806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 --2- 172.21.15.50:0/156883879 >> v2:172.21.15.50:3300/0 conn(0x7fe0d806ada0 0x7fe0d806b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 -- 172.21.15.50:0/156883879 >> v1:172.21.15.181:6789/0 conn(0x7fe0d815ca20 legacy=0x7fe0d815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 -- 172.21.15.50:0/156883879 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d815d950 con 0x7fe0d806cd80 2024-09-13T15:11:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6000700 1 -- 172.21.15.50:0/156883879 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750135746 0 0) 0x7fe0d8160680 con 0x7fe0d815ca20 2024-09-13T15:11:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6a00700 1 --2- 172.21.15.50:0/156883879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 0x7fe0d80b4310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009850 tx=0x7fe0c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153437f859bcaebc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6000700 1 -- 172.21.15.50:0/156883879 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011830 con 0x7fe0d806cd80 2024-09-13T15:11:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6000700 1 -- 172.21.15.50:0/156883879 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c4011990 con 0x7fe0d806cd80 2024-09-13T15:11:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0d6000700 1 -- 172.21.15.50:0/156883879 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011d40 con 0x7fe0d806cd80 2024-09-13T15:11:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 -- 172.21.15.50:0/156883879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 msgr2=0x7fe0d80b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.701+0000 7fe0dd200700 1 --2- 172.21.15.50:0/156883879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 0x7fe0d80b4310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009850 tx=0x7fe0c4009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 -- 172.21.15.50:0/156883879 shutdown_connections 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 --2- 172.21.15.50:0/156883879 >> v2:172.21.15.50:3300/0 conn(0x7fe0d806ada0 0x7fe0d806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 --2- 172.21.15.50:0/156883879 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806cd80 0x7fe0d80b4310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 -- 172.21.15.50:0/156883879 >> 172.21.15.50:0/156883879 conn(0x7fe0d8071d20 msgr2=0x7fe0d8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 -- 172.21.15.50:0/156883879 shutdown_connections 2024-09-13T15:11:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 -- 172.21.15.50:0/156883879 wait complete. 2024-09-13T15:11:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 Processor -- start 2024-09-13T15:11:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.705+0000 7fe0dd200700 1 -- start start 2024-09-13T15:11:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806ada0 0x7fe0d81f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 0x7fe0d81efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d815ca20 0x7fe0d81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d81f3830 con 0x7fe0d806cd80 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d81515d0 con 0x7fe0d815ca20 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8150530 con 0x7fe0d806ada0 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 0x7fe0d81efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 0x7fe0d81efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58374/0 (socket says 172.21.15.50:58374) 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 -- 172.21.15.50:0/1034362685 learned_addr learned my addr 172.21.15.50:0/1034362685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d7400700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806ada0 0x7fe0d81f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d7e00700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d815ca20 0x7fe0d81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 -- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806ada0 msgr2=0x7fe0d81f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806ada0 0x7fe0d81f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 -- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d815ca20 msgr2=0x7fe0d81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d815ca20 0x7fe0d81521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 -- 172.21.15.50:0/1034362685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40094b0 con 0x7fe0d806cd80 2024-09-13T15:11:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d7e00700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d815ca20 0x7fe0d81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0d6a00700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 0x7fe0d81efcc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401aa10 con 0x7fe0d806cd80 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c401f070 con 0x7fe0d806cd80 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401adb0 con 0x7fe0d806cd80 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d8150810 con 0x7fe0d806cd80 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.709+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8150dd0 con 0x7fe0d806cd80 2024-09-13T15:11:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.713+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d806d1c0 con 0x7fe0d806cd80 2024-09-13T15:11:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.713+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0c401b430 con 0x7fe0d806cd80 2024-09-13T15:11:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.717+0000 7fe0cf400700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b8066730 0x7fe0b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.717+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe0c4085420 con 0x7fe0d806cd80 2024-09-13T15:11:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.717+0000 7fe0d7400700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b8066730 0x7fe0b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.717+0000 7fe0d7400700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b8066730 0x7fe0b8068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000f60 tx=0x7fe0c8007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.725+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0c4052640 con 0x7fe0d806cd80 2024-09-13T15:11:10.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.909+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0d806ab80 con 0x7fe0d806cd80 2024-09-13T15:11:10.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.909+0000 7fe0cf400700 1 -- 172.21.15.50:0/1034362685 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0c4021020 con 0x7fe0d806cd80 2024-09-13T15:11:10.913 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:11:10.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b8066730 msgr2=0x7fe0b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b8066730 0x7fe0b8068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000f60 tx=0x7fe0c8007e90 comp rx=0 tx=0).stop 2024-09-13T15:11:10.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 msgr2=0x7fe0d81efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:10.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 0x7fe0d81efcc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4004770 comp rx=0 tx=0).stop 2024-09-13T15:11:10.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 shutdown_connections 2024-09-13T15:11:10.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe0b8066730 0x7fe0b8068bf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0d815ca20 0x7fe0d81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0d806cd80 0x7fe0d81efcc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 --2- 172.21.15.50:0/1034362685 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe0d806ada0 0x7fe0d81f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:10.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 >> 172.21.15.50:0/1034362685 conn(0x7fe0d8071d20 msgr2=0x7fe0d815f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:10.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 shutdown_connections 2024-09-13T15:11:10.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:10.913+0000 7fe0dd200700 1 -- 172.21.15.50:0/1034362685 wait complete. 2024-09-13T15:11:10.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:11:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 Processor -- start 2024-09-13T15:11:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 -- start start 2024-09-13T15:11:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7914144330 0x7f79140cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 0x7f79140b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7914144710 0x7f79140b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79140cce10 con 0x7f7914144710 2024-09-13T15:11:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791406bcf0 con 0x7f7914144330 2024-09-13T15:11:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.113+0000 7f791c600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791406cb50 con 0x7f791406d760 2024-09-13T15:11:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f791a600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7914144710 0x7f79140b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7914144330 0x7f79140cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 0x7f79140b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 0x7f79140b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38522/0 (socket says 172.21.15.50:38522) 2024-09-13T15:11:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 -- 172.21.15.50:0/4073036859 learned_addr learned my addr 172.21.15.50:0/4073036859 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7914144330 0x7f79140cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:38938/0 (socket says 172.21.15.50:38938) 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 -- 172.21.15.50:0/4073036859 >> v2:172.21.15.181:3300/0 conn(0x7f7914144330 msgr2=0x7f79140cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 --2- 172.21.15.50:0/4073036859 >> v2:172.21.15.181:3300/0 conn(0x7f7914144330 0x7f79140cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 -- 172.21.15.50:0/4073036859 >> v2:172.21.15.50:3300/0 conn(0x7f7914144710 msgr2=0x7f79140b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 --2- 172.21.15.50:0/4073036859 >> v2:172.21.15.50:3300/0 conn(0x7f7914144710 0x7f79140b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 -- 172.21.15.50:0/4073036859 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140cf4b0 con 0x7f791406d760 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f791a600700 1 --2- 172.21.15.50:0/4073036859 >> v2:172.21.15.50:3300/0 conn(0x7f7914144710 0x7f79140b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7919200700 1 --2- 172.21.15.50:0/4073036859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 0x7f79140b35a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f79140b1740 tx=0x7f7900009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645d982ae7ed6afa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7913e00700 1 -- 172.21.15.50:0/4073036859 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011830 con 0x7f791406d760 2024-09-13T15:11:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7913e00700 1 -- 172.21.15.50:0/4073036859 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900011990 con 0x7f791406d760 2024-09-13T15:11:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.117+0000 7f7913e00700 1 -- 172.21.15.50:0/4073036859 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011d20 con 0x7f791406d760 2024-09-13T15:11:11.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 -- 172.21.15.50:0/4073036859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 msgr2=0x7f79140b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 --2- 172.21.15.50:0/4073036859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 0x7f79140b35a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f79140b1740 tx=0x7f7900009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 -- 172.21.15.50:0/4073036859 shutdown_connections 2024-09-13T15:11:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 --2- 172.21.15.50:0/4073036859 >> v2:172.21.15.50:3300/0 conn(0x7f7914144710 0x7f79140b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 --2- 172.21.15.50:0/4073036859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791406d760 0x7f79140b35a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 --2- 172.21.15.50:0/4073036859 >> v2:172.21.15.181:3300/0 conn(0x7f7914144330 0x7f79140cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 -- 172.21.15.50:0/4073036859 >> 172.21.15.50:0/4073036859 conn(0x7f791406a570 msgr2=0x7f791406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 -- 172.21.15.50:0/4073036859 shutdown_connections 2024-09-13T15:11:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 -- 172.21.15.50:0/4073036859 wait complete. 2024-09-13T15:11:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.121+0000 7f791c600700 1 Processor -- start 2024-09-13T15:11:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 -- start start 2024-09-13T15:11:11.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791406d760 0x7f79141f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 0x7f7914140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7914140c40 0x7f7914159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7914071da0 con 0x7f7914144330 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7914143a00 con 0x7f791406d760 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7914152aa0 con 0x7f7914140c40 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 0x7f7914140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 0x7f7914140700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58392/0 (socket says 172.21.15.50:58392) 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 -- 172.21.15.50:0/1552830855 learned_addr learned my addr 172.21.15.50:0/1552830855 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791a600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7914140c40 0x7f7914159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919c00700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791406d760 0x7f79141f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 -- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7914140c40 msgr2=0x7f7914159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7914140c40 0x7f7914159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 -- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791406d760 msgr2=0x7f79141f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791406d760 0x7f79141f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 -- 172.21.15.50:0/1552830855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c009a70 con 0x7f7914144330 2024-09-13T15:11:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7919200700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 0x7f7914140700 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f791406cc90 tx=0x7f7900004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900004240 con 0x7f7914144330 2024-09-13T15:11:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790001f070 con 0x7f7914144330 2024-09-13T15:11:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7900009570 con 0x7f7914144330 2024-09-13T15:11:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.125+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900004600 con 0x7f7914144330 2024-09-13T15:11:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.129+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7914143160 con 0x7f7914144330 2024-09-13T15:11:11.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.129+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791406dda0 con 0x7f7914144330 2024-09-13T15:11:11.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.129+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7900021030 con 0x7f7914144330 2024-09-13T15:11:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.129+0000 7f7911600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78f4066760 0x7f78f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.129+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f79000850f0 con 0x7f7914144330 2024-09-13T15:11:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.133+0000 7f7919c00700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78f4066760 0x7f78f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.133+0000 7f7919c00700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78f4066760 0x7f78f4068c20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7908009bf0 tx=0x7f7908009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.137+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7900052470 con 0x7f7914144330 2024-09-13T15:11:11.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.317+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79140732f0 con 0x7f7914144330 2024-09-13T15:11:11.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.321+0000 7f7911600700 1 -- 172.21.15.50:0/1552830855 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7900055a90 con 0x7f7914144330 2024-09-13T15:11:11.323 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:11:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78f4066760 msgr2=0x7f78f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78f4066760 0x7f78f4068c20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7908009bf0 tx=0x7f7908009240 comp rx=0 tx=0).stop 2024-09-13T15:11:11.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 msgr2=0x7f7914140700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 0x7f7914140700 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f791406cc90 tx=0x7f7900004770 comp rx=0 tx=0).stop 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 shutdown_connections 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78f4066760 0x7f78f4068c20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7914140c40 0x7f7914159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914144330 0x7f7914140700 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 --2- 172.21.15.50:0/1552830855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791406d760 0x7f79141f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 >> 172.21.15.50:0/1552830855 conn(0x7f791406a570 msgr2=0x7f791406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 shutdown_connections 2024-09-13T15:11:11.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.325+0000 7f791c600700 1 -- 172.21.15.50:0/1552830855 wait complete. 2024-09-13T15:11:11.352 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.525+0000 7f4933200700 1 Processor -- start 2024-09-13T15:11:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4933200700 1 -- start start 2024-09-13T15:11:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4933200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49340b2d80 0x7f493406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4933200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49340b3560 con 0x7f49341610b0 2024-09-13T15:11:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4933200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49340b3280 con 0x7f493406aaa0 2024-09-13T15:11:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4933200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4934070b30 con 0x7f49340b2d80 2024-09-13T15:11:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4931e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49341610b0 0x7f49340719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58496/0 (socket says 172.21.15.50:58496) 2024-09-13T15:11:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4931e00700 1 -- 172.21.15.50:0/11805488 learned_addr learned my addr 172.21.15.50:0/11805488 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4932800700 1 --2- 172.21.15.50:0/11805488 >> v2:172.21.15.181:3300/0 conn(0x7f49340b2d80 0x7f493406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771046323 0 0) 0x7f49340b3560 con 0x7f49341610b0 2024-09-13T15:11:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49180035d0 con 0x7f49341610b0 2024-09-13T15:11:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.529+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695995299 0 0) 0x7f49340b3280 con 0x7f493406aaa0 2024-09-13T15:11:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49340b3560 con 0x7f493406aaa0 2024-09-13T15:11:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4932800700 1 -- 172.21.15.50:0/11805488 >> v1:172.21.15.181:6789/0 conn(0x7f493406aaa0 legacy=0x7f49340b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4932800700 1 -- 172.21.15.50:0/11805488 >> v1:172.21.15.50:6789/0 conn(0x7f49341610b0 legacy=0x7f49340719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4932800700 1 -- 172.21.15.50:0/11805488 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934070ee0 con 0x7f49340b2d80 2024-09-13T15:11:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4932800700 1 --2- 172.21.15.50:0/11805488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49340b2d80 0x7f493406af10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f492c009880 tx=0x7f492c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abf2fb750aec4c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011830 con 0x7f49340b2d80 2024-09-13T15:11:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011990 con 0x7f49340b2d80 2024-09-13T15:11:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4930a00700 1 -- 172.21.15.50:0/11805488 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011d20 con 0x7f49340b2d80 2024-09-13T15:11:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 -- 172.21.15.50:0/11805488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49340b2d80 msgr2=0x7f493406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 --2- 172.21.15.50:0/11805488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49340b2d80 0x7f493406af10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f492c009880 tx=0x7f492c009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 -- 172.21.15.50:0/11805488 shutdown_connections 2024-09-13T15:11:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 --2- 172.21.15.50:0/11805488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49340b2d80 0x7f493406af10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 -- 172.21.15.50:0/11805488 >> 172.21.15.50:0/11805488 conn(0x7f49340b0c40 msgr2=0x7f493406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 -- 172.21.15.50:0/11805488 shutdown_connections 2024-09-13T15:11:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.533+0000 7f4933200700 1 -- 172.21.15.50:0/11805488 wait complete. 2024-09-13T15:11:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.537+0000 7f4933200700 1 Processor -- start 2024-09-13T15:11:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.537+0000 7f4933200700 1 -- start start 2024-09-13T15:11:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f493406aaa0 0x7f49341f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49340b2d80 0x7f49340ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 0x7f49340cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934162810 con 0x7f49341610b0 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934162380 con 0x7f493406aaa0 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4934161790 con 0x7f49340b2d80 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4932800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 0x7f49340cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f493406aaa0 0x7f49341f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4932800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 0x7f49340cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58404/0 (socket says 172.21.15.50:58404) 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49340b2d80 0x7f49340ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4932800700 1 -- 172.21.15.50:0/1735820216 learned_addr learned my addr 172.21.15.50:0/1735820216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 -- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49340b2d80 msgr2=0x7f49340ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49340b2d80 0x7f49340ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 -- 172.21.15.50:0/1735820216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 msgr2=0x7f49340cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 0x7f49340cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 -- 172.21.15.50:0/1735820216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0094b0 con 0x7f493406aaa0 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931400700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49340b2d80 0x7f49340ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4932800700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 0x7f49340cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4931e00700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f493406aaa0 0x7f49341f7070 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f492400ca80 tx=0x7f492400cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924007500 con 0x7f493406aaa0 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924007660 con 0x7f493406aaa0 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924007a10 con 0x7f493406aaa0 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.541+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4934161a50 con 0x7f493406aaa0 2024-09-13T15:11:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.545+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4934162010 con 0x7f493406aaa0 2024-09-13T15:11:11.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.545+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493406af10 con 0x7f493406aaa0 2024-09-13T15:11:11.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.545+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f492401b3b0 con 0x7f493406aaa0 2024-09-13T15:11:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.549+0000 7f492a000700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4914066730 0x7f4914068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.549+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4924083b80 con 0x7f493406aaa0 2024-09-13T15:11:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.549+0000 7f4931400700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4914066730 0x7f4914068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.549+0000 7f4931400700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4914066730 0x7f4914068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f49341faef0 tx=0x7f4920009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.557+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4924050da0 con 0x7f493406aaa0 2024-09-13T15:11:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.793+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f493415e8c0 con 0x7f493406aaa0 2024-09-13T15:11:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.793+0000 7f492a000700 1 -- 172.21.15.50:0/1735820216 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f4924017020 con 0x7f493406aaa0 2024-09-13T15:11:11.798 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:11.798 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:11:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4914066730 msgr2=0x7f4914068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4914066730 0x7f4914068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f49341faef0 tx=0x7f4920009040 comp rx=0 tx=0).stop 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f493406aaa0 msgr2=0x7f49341f7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f493406aaa0 0x7f49341f7070 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f492400ca80 tx=0x7f492400cab0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 shutdown_connections 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4914066730 0x7f4914068bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49341610b0 0x7f49340cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49340b2d80 0x7f49340ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 --2- 172.21.15.50:0/1735820216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f493406aaa0 0x7f49341f7070 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 >> 172.21.15.50:0/1735820216 conn(0x7f49340b0c40 msgr2=0x7f493406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 shutdown_connections 2024-09-13T15:11:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:11.801+0000 7f4933200700 1 -- 172.21.15.50:0/1735820216 wait complete. 2024-09-13T15:11:11.805 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:11:11.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.017+0000 7fd80d800700 1 Processor -- start 2024-09-13T15:11:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.017+0000 7fd80d800700 1 -- start start 2024-09-13T15:11:12.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd80d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 0x7fd8080cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd80d800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd80815dc70 0x7fd8080cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd80d800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080cfc80 con 0x7fd8080cf2e0 2024-09-13T15:11:12.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd80d800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8080c9df0 con 0x7fd80815dc70 2024-09-13T15:11:12.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd80d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80815e2d0 con 0x7fd8081464b0 2024-09-13T15:11:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd806a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 0x7fd8080cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd7ffe00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd8080cf2e0 0x7fd80815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52548/0 (socket says 172.21.15.50:52548) 2024-09-13T15:11:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd806a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 0x7fd8080cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38556/0 (socket says 172.21.15.50:38556) 2024-09-13T15:11:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd7ffe00700 1 -- 172.21.15.50:0/3349440509 learned_addr learned my addr 172.21.15.50:0/3349440509 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd807400700 1 --2- 172.21.15.50:0/3349440509 >> v2:172.21.15.181:3300/0 conn(0x7fd80815dc70 0x7fd8080cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.021+0000 7fd806000700 1 -- 172.21.15.50:0/3349440509 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234855201 0 0) 0x7fd8080cfc80 con 0x7fd8080cf2e0 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806000700 1 -- 172.21.15.50:0/3349440509 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec0035d0 con 0x7fd8080cf2e0 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806a00700 1 -- 172.21.15.50:0/3349440509 >> v2:172.21.15.181:3300/0 conn(0x7fd80815dc70 msgr2=0x7fd8080cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806a00700 1 --2- 172.21.15.50:0/3349440509 >> v2:172.21.15.181:3300/0 conn(0x7fd80815dc70 0x7fd8080cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806a00700 1 -- 172.21.15.50:0/3349440509 >> v1:172.21.15.181:6789/0 conn(0x7fd8080cf2e0 legacy=0x7fd80815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806a00700 1 -- 172.21.15.50:0/3349440509 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080ca040 con 0x7fd8081464b0 2024-09-13T15:11:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806a00700 1 --2- 172.21.15.50:0/3349440509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 0x7fd8080cab20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009880 tx=0x7fd7f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1121b05630f94e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806000700 1 -- 172.21.15.50:0/3349440509 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011830 con 0x7fd8081464b0 2024-09-13T15:11:12.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806000700 1 -- 172.21.15.50:0/3349440509 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8011990 con 0x7fd8081464b0 2024-09-13T15:11:12.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd806000700 1 -- 172.21.15.50:0/3349440509 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011d20 con 0x7fd8081464b0 2024-09-13T15:11:12.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 -- 172.21.15.50:0/3349440509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 msgr2=0x7fd8080cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 --2- 172.21.15.50:0/3349440509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 0x7fd8080cab20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009880 tx=0x7fd7f8009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 -- 172.21.15.50:0/3349440509 shutdown_connections 2024-09-13T15:11:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 --2- 172.21.15.50:0/3349440509 >> v2:172.21.15.181:3300/0 conn(0x7fd80815dc70 0x7fd8080cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 --2- 172.21.15.50:0/3349440509 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8081464b0 0x7fd8080cab20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 -- 172.21.15.50:0/3349440509 >> 172.21.15.50:0/3349440509 conn(0x7fd8080726d0 msgr2=0x7fd80806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 -- 172.21.15.50:0/3349440509 shutdown_connections 2024-09-13T15:11:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.025+0000 7fd80d800700 1 -- 172.21.15.50:0/3349440509 wait complete. 2024-09-13T15:11:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 Processor -- start 2024-09-13T15:11:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 -- start start 2024-09-13T15:11:12.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8080cf2e0 0x7fd80813f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 0x7fd80806af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80815dc70 0x7fd808144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808143000 con 0x7fd8081464b0 2024-09-13T15:11:12.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081412d0 con 0x7fd80815dc70 2024-09-13T15:11:12.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd80d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80806a430 con 0x7fd8080cf2e0 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd7ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 0x7fd80806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd806a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8080cf2e0 0x7fd80813f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd7ffe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 0x7fd80806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58416/0 (socket says 172.21.15.50:58416) 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd7ffe00700 1 -- 172.21.15.50:0/901917088 learned_addr learned my addr 172.21.15.50:0/901917088 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.029+0000 7fd807400700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80815dc70 0x7fd808144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7ffe00700 1 -- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8080cf2e0 msgr2=0x7fd80813f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7ffe00700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8080cf2e0 0x7fd80813f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7ffe00700 1 -- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80815dc70 msgr2=0x7fd808144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7ffe00700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80815dc70 0x7fd808144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7ffe00700 1 -- 172.21.15.50:0/901917088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80094b0 con 0x7fd8081464b0 2024-09-13T15:11:12.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd807400700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80815dc70 0x7fd808144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:12.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7ffe00700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 0x7fd80806af10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c4d0 tx=0x7fd7f000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0005d90 con 0x7fd8081464b0 2024-09-13T15:11:12.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000ce80 con 0x7fd8081464b0 2024-09-13T15:11:12.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00072d0 con 0x7fd8081464b0 2024-09-13T15:11:12.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80806a710 con 0x7fd8081464b0 2024-09-13T15:11:12.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.033+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8081415b0 con 0x7fd8081464b0 2024-09-13T15:11:12.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.037+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80806ac30 con 0x7fd8081464b0 2024-09-13T15:11:12.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.037+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd7f0007430 con 0x7fd8081464b0 2024-09-13T15:11:12.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.037+0000 7fd7fea00700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd7e4066760 0x7fd7e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.037+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd7f00834d0 con 0x7fd8081464b0 2024-09-13T15:11:12.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.037+0000 7fd806a00700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd7e4066760 0x7fd7e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.041+0000 7fd806a00700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd7e4066760 0x7fd7e4068c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000c00 tx=0x7fd7f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.045+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd80806ac30 con 0x7fd8081464b0 2024-09-13T15:11:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.241+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd80806ac30 con 0x7fd8081464b0 2024-09-13T15:11:12.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.241+0000 7fd7fea00700 1 -- 172.21.15.50:0/901917088 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16765 (secure 0 0 0) 0x7fd80806ac30 con 0x7fd8081464b0 2024-09-13T15:11:12.246 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:12.246 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:54.464580+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd7e4066760 msgr2=0x7fd7e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd7e4066760 0x7fd7e4068c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000c00 tx=0x7fd7f8008030 comp rx=0 tx=0).stop 2024-09-13T15:11:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 msgr2=0x7fd80806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 0x7fd80806af10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c4d0 tx=0x7fd7f000c7e0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 shutdown_connections 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd7e4066760 0x7fd7e4068c20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd80815dc70 0x7fd808144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8081464b0 0x7fd80806af10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 --2- 172.21.15.50:0/901917088 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd8080cf2e0 0x7fd80813f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 >> 172.21.15.50:0/901917088 conn(0x7fd8080726d0 msgr2=0x7fd8080b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 shutdown_connections 2024-09-13T15:11:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.245+0000 7fd80d800700 1 -- 172.21.15.50:0/901917088 wait complete. 2024-09-13T15:11:12.272 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:11:12.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.445+0000 7f943b200700 1 Processor -- start 2024-09-13T15:11:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.445+0000 7f943b200700 1 -- start start 2024-09-13T15:11:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f943c15d310 0x7f943c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943b200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f943c15e9f0 0x7f943c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943b200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c15e560 con 0x7f943c06aaa0 2024-09-13T15:11:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943b200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0b3ec0 con 0x7f943c15e9f0 2024-09-13T15:11:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0adf90 con 0x7f943c15d310 2024-09-13T15:11:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f943c15e9f0 0x7f943c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f943c15e9f0 0x7f943c15ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58424/0 (socket says 172.21.15.50:58424) 2024-09-13T15:11:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 -- 172.21.15.50:0/1000590125 learned_addr learned my addr 172.21.15.50:0/1000590125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f9431400700 1 --2- 172.21.15.50:0/1000590125 >> v2:172.21.15.181:3300/0 conn(0x7f943c15d310 0x7f943c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f9439400700 1 -- 172.21.15.50:0/1000590125 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792502598 0 0) 0x7f943c15e560 con 0x7f943c06aaa0 2024-09-13T15:11:12.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 -- 172.21.15.50:0/1000590125 >> v2:172.21.15.181:3300/0 conn(0x7f943c15d310 msgr2=0x7f943c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:12.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 --2- 172.21.15.50:0/1000590125 >> v2:172.21.15.181:3300/0 conn(0x7f943c15d310 0x7f943c0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 -- 172.21.15.50:0/1000590125 >> v1:172.21.15.181:6789/0 conn(0x7f943c06aaa0 legacy=0x7f943c06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 -- 172.21.15.50:0/1000590125 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c15d920 con 0x7f943c15e9f0 2024-09-13T15:11:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f943a800700 1 --2- 172.21.15.50:0/1000590125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15e9f0 0x7f943c15ee80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f943c0cb010 tx=0x7f943400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbc3e628059e5f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f9439400700 1 -- 172.21.15.50:0/1000590125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400e070 con 0x7f943c15e9f0 2024-09-13T15:11:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.449+0000 7f9439400700 1 -- 172.21.15.50:0/1000590125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400b910 con 0x7f943c15e9f0 2024-09-13T15:11:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f9439400700 1 -- 172.21.15.50:0/1000590125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400bcc0 con 0x7f943c15e9f0 2024-09-13T15:11:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 -- 172.21.15.50:0/1000590125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15e9f0 msgr2=0x7f943c15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 --2- 172.21.15.50:0/1000590125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15e9f0 0x7f943c15ee80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f943c0cb010 tx=0x7f943400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 -- 172.21.15.50:0/1000590125 shutdown_connections 2024-09-13T15:11:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 --2- 172.21.15.50:0/1000590125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15e9f0 0x7f943c15ee80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 --2- 172.21.15.50:0/1000590125 >> v2:172.21.15.181:3300/0 conn(0x7f943c15d310 0x7f943c0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 -- 172.21.15.50:0/1000590125 >> 172.21.15.50:0/1000590125 conn(0x7f943c0b0c40 msgr2=0x7f943c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 -- 172.21.15.50:0/1000590125 shutdown_connections 2024-09-13T15:11:12.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.453+0000 7f943b200700 1 -- 172.21.15.50:0/1000590125 wait complete. 2024-09-13T15:11:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 Processor -- start 2024-09-13T15:11:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 -- start start 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f943c06aaa0 0x7f943c13d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 0x7f943c15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f943c15e9f0 0x7f943c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c13f460 con 0x7f943c15d310 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c13db50 con 0x7f943c15e9f0 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c13de30 con 0x7f943c06aaa0 2024-09-13T15:11:12.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 0x7f943c15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 0x7f943c15c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58430/0 (socket says 172.21.15.50:58430) 2024-09-13T15:11:12.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 -- 172.21.15.50:0/2737145996 learned_addr learned my addr 172.21.15.50:0/2737145996 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:12.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943a800700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f943c15e9f0 0x7f943c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9439e00700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f943c06aaa0 0x7f943c13d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 -- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f943c06aaa0 msgr2=0x7f943c13d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f943c06aaa0 0x7f943c13d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 -- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f943c15e9f0 msgr2=0x7f943c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f943c15e9f0 0x7f943c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 -- 172.21.15.50:0/2737145996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009b30 con 0x7f943c15d310 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f943a800700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f943c15e9f0 0x7f943c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.457+0000 7f9431400700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 0x7f943c15c5e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f942400e9d0 tx=0x7f942400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424009720 con 0x7f943c15d310 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400c850 con 0x7f943c15d310 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c13e110 con 0x7f943c15d310 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400cbc0 con 0x7f943c15d310 2024-09-13T15:11:12.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c13e6d0 con 0x7f943c15d310 2024-09-13T15:11:12.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c0b3980 con 0x7f943c15d310 2024-09-13T15:11:12.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.461+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f942400cd20 con 0x7f943c15d310 2024-09-13T15:11:12.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.465+0000 7f9432a00700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9418066730 0x7f9418068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.465+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9424084470 con 0x7f943c15d310 2024-09-13T15:11:12.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.465+0000 7f9439e00700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9418066730 0x7f9418068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.465+0000 7f9439e00700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9418066730 0x7f9418068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f942c000f60 tx=0x7f942c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.469+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9424051600 con 0x7f943c15d310 2024-09-13T15:11:12.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.697+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f943c06c620 con 0x7f943c15d310 2024-09-13T15:11:12.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.701+0000 7f9432a00700 1 -- 172.21.15.50:0/2737145996 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f9424054c20 con 0x7f943c15d310 2024-09-13T15:11:12.703 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:12.703 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:11:12.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9418066730 msgr2=0x7f9418068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9418066730 0x7f9418068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f942c000f60 tx=0x7f942c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:12.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 msgr2=0x7f943c15c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 0x7f943c15c5e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f942400e9d0 tx=0x7f942400ed90 comp rx=0 tx=0).stop 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 shutdown_connections 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9418066730 0x7f9418068bf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f943c15e9f0 0x7f943c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f943c15d310 0x7f943c15c5e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 --2- 172.21.15.50:0/2737145996 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f943c06aaa0 0x7f943c13d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 >> 172.21.15.50:0/2737145996 conn(0x7f943c0b0c40 msgr2=0x7f943c0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 shutdown_connections 2024-09-13T15:11:12.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.705+0000 7f943b200700 1 -- 172.21.15.50:0/2737145996 wait complete. 2024-09-13T15:11:12.710 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:11:12.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:12.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.901+0000 7fcf87e00700 1 Processor -- start 2024-09-13T15:11:12.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.901+0000 7fcf87e00700 1 -- start start 2024-09-13T15:11:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf87e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf800ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf87e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcf800b3a10 0x7fcf800cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf87e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf800b2c50 con 0x7fcf800cb830 2024-09-13T15:11:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf87e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf800cc3b0 con 0x7fcf800b3a10 2024-09-13T15:11:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf87e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800b2f30 con 0x7fcf8015ac60 2024-09-13T15:11:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf800ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf800ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38570/0 (socket says 172.21.15.50:38570) 2024-09-13T15:11:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 -- 172.21.15.50:0/2993942305 learned_addr learned my addr 172.21.15.50:0/2993942305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85e00700 1 --1- 172.21.15.50:0/2993942305 >> v1:172.21.15.181:6789/0 conn(0x7fcf800cb830 0x7fcf800cbca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52560/0 (socket says 172.21.15.50:52560) 2024-09-13T15:11:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf84a00700 1 --2- 172.21.15.50:0/2993942305 >> v2:172.21.15.181:3300/0 conn(0x7fcf800b3a10 0x7fcf800cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 -- 172.21.15.50:0/2993942305 >> v2:172.21.15.181:3300/0 conn(0x7fcf800b3a10 msgr2=0x7fcf800cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 --2- 172.21.15.50:0/2993942305 >> v2:172.21.15.181:3300/0 conn(0x7fcf800b3a10 0x7fcf800cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 -- 172.21.15.50:0/2993942305 >> v1:172.21.15.181:6789/0 conn(0x7fcf800cb830 legacy=0x7fcf800cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 -- 172.21.15.50:0/2993942305 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800b3210 con 0x7fcf8015ac60 2024-09-13T15:11:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf7fe00700 1 -- 172.21.15.50:0/2993942305 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155079846 0 0) 0x7fcf800b2c50 con 0x7fcf800cb830 2024-09-13T15:11:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf85400700 1 --2- 172.21.15.50:0/2993942305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf800ceaa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009910 tx=0x7fcf74009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633ad4cf49e91edd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.905+0000 7fcf7fe00700 1 -- 172.21.15.50:0/2993942305 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74011830 con 0x7fcf8015ac60 2024-09-13T15:11:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf7fe00700 1 -- 172.21.15.50:0/2993942305 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74011990 con 0x7fcf8015ac60 2024-09-13T15:11:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf7fe00700 1 -- 172.21.15.50:0/2993942305 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74011d40 con 0x7fcf8015ac60 2024-09-13T15:11:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 -- 172.21.15.50:0/2993942305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 msgr2=0x7fcf800ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 --2- 172.21.15.50:0/2993942305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf800ceaa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009910 tx=0x7fcf74009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 -- 172.21.15.50:0/2993942305 shutdown_connections 2024-09-13T15:11:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 --2- 172.21.15.50:0/2993942305 >> v2:172.21.15.181:3300/0 conn(0x7fcf800b3a10 0x7fcf800cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 --2- 172.21.15.50:0/2993942305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf800ceaa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 -- 172.21.15.50:0/2993942305 >> 172.21.15.50:0/2993942305 conn(0x7fcf800b0a40 msgr2=0x7fcf800b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 -- 172.21.15.50:0/2993942305 shutdown_connections 2024-09-13T15:11:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.909+0000 7fcf87e00700 1 -- 172.21.15.50:0/2993942305 wait complete. 2024-09-13T15:11:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 Processor -- start 2024-09-13T15:11:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 -- start start 2024-09-13T15:11:12.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 0x7fcf80155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf800cb830 0x7fcf8014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf80147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8014f7f0 con 0x7fcf800b3a10 2024-09-13T15:11:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80150630 con 0x7fcf800cb830 2024-09-13T15:11:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf87e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80152740 con 0x7fcf8015ac60 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf85400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 0x7fcf80155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf85400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 0x7fcf80155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58432/0 (socket says 172.21.15.50:58432) 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf85400700 1 -- 172.21.15.50:0/1484355512 learned_addr learned my addr 172.21.15.50:0/1484355512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf84a00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf800cb830 0x7fcf8014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.913+0000 7fcf85e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf80147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf85400700 1 -- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 msgr2=0x7fcf80147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf85400700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf80147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf85400700 1 -- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf800cb830 msgr2=0x7fcf8014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf85400700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf800cb830 0x7fcf8014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf85400700 1 -- 172.21.15.50:0/1484355512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74009570 con 0x7fcf800b3a10 2024-09-13T15:11:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf85400700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 0x7fcf80155f80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fcf74014040 tx=0x7fcf74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7401a8f0 con 0x7fcf800b3a10 2024-09-13T15:11:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7401e070 con 0x7fcf800b3a10 2024-09-13T15:11:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf80152a20 con 0x7fcf800b3a10 2024-09-13T15:11:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7401acb0 con 0x7fcf800b3a10 2024-09-13T15:11:12.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf80152fe0 con 0x7fcf800b3a10 2024-09-13T15:11:12.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.917+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf80153640 con 0x7fcf800b3a10 2024-09-13T15:11:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.921+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf7402d450 con 0x7fcf800b3a10 2024-09-13T15:11:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.921+0000 7fcf7d600700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf60066760 0x7fcf60068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.921+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf74085210 con 0x7fcf800b3a10 2024-09-13T15:11:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.921+0000 7fcf84a00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf60066760 0x7fcf60068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.925+0000 7fcf84a00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf60066760 0x7fcf60068c20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf8015a670 tx=0x7fcf6c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:12.929+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf80153640 con 0x7fcf800b3a10 2024-09-13T15:11:13.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.161+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf80153640 con 0x7fcf800b3a10 2024-09-13T15:11:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf7d600700 1 -- 172.21.15.50:0/1484355512 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fcf80153640 con 0x7fcf800b3a10 2024-09-13T15:11:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:13.166 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:10:53.459545+0000","modified":"2024-09-13T15:10:56.477493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/1253018463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1253018463},{"type":"v1","addr":"172.21.15.50:6835","nonce":1253018463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T15:11:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf60066760 msgr2=0x7fcf60068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf60066760 0x7fcf60068c20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf8015a670 tx=0x7fcf6c009240 comp rx=0 tx=0).stop 2024-09-13T15:11:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 msgr2=0x7fcf80155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 0x7fcf80155f80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fcf74014040 tx=0x7fcf74004770 comp rx=0 tx=0).stop 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 shutdown_connections 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcf60066760 0x7fcf60068c20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcf8015ac60 0x7fcf80147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf800cb830 0x7fcf8014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 --2- 172.21.15.50:0/1484355512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf800b3a10 0x7fcf80155f80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 >> 172.21.15.50:0/1484355512 conn(0x7fcf800b0a40 msgr2=0x7fcf800cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 shutdown_connections 2024-09-13T15:11:13.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.165+0000 7fcf87e00700 1 -- 172.21.15.50:0/1484355512 wait complete. 2024-09-13T15:11:13.172 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-13T15:11:13.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd189800700 1 Processor -- start 2024-09-13T15:11:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd189800700 1 -- start start 2024-09-13T15:11:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd189800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd1840cb020 0x7fd1840cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd189800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1840b2ad0 con 0x7fd18406aaa0 2024-09-13T15:11:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd189800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18415b960 con 0x7fd18415c2a0 2024-09-13T15:11:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd189800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18415bc40 con 0x7fd1840cb020 2024-09-13T15:11:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd188e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd18406aaa0 0x7fd1840b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50862/0 (socket says 172.21.15.50:50862) 2024-09-13T15:11:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd188e00700 1 -- 172.21.15.50:0/3914916801 learned_addr learned my addr 172.21.15.50:0/3914916801 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd183e00700 1 --2- 172.21.15.50:0/3914916801 >> v2:172.21.15.181:3300/0 conn(0x7fd1840cb020 0x7fd1840cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654790832 0 0) 0x7fd1840b2ad0 con 0x7fd18406aaa0 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1680035d0 con 0x7fd18406aaa0 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.365+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829920226 0 0) 0x7fd18415b960 con 0x7fd18415c2a0 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1840b2ad0 con 0x7fd18415c2a0 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183e00700 1 -- 172.21.15.50:0/3914916801 >> v1:172.21.15.181:6789/0 conn(0x7fd18415c2a0 legacy=0x7fd18415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183e00700 1 -- 172.21.15.50:0/3914916801 >> v1:172.21.15.50:6789/0 conn(0x7fd18406aaa0 legacy=0x7fd1840b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183e00700 1 -- 172.21.15.50:0/3914916801 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18415bf20 con 0x7fd1840cb020 2024-09-13T15:11:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183e00700 1 --2- 172.21.15.50:0/3914916801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1840cc6f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd174009850 tx=0x7fd174009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894a76d64a58343a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174011830 con 0x7fd1840cb020 2024-09-13T15:11:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174011990 con 0x7fd1840cb020 2024-09-13T15:11:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd183400700 1 -- 172.21.15.50:0/3914916801 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174011d40 con 0x7fd1840cb020 2024-09-13T15:11:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 -- 172.21.15.50:0/3914916801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 msgr2=0x7fd1840cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 --2- 172.21.15.50:0/3914916801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1840cc6f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd174009850 tx=0x7fd174009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 -- 172.21.15.50:0/3914916801 shutdown_connections 2024-09-13T15:11:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 --2- 172.21.15.50:0/3914916801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1840cc6f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 -- 172.21.15.50:0/3914916801 >> 172.21.15.50:0/3914916801 conn(0x7fd1840b0c40 msgr2=0x7fd18406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 -- 172.21.15.50:0/3914916801 shutdown_connections 2024-09-13T15:11:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.369+0000 7fd189800700 1 -- 172.21.15.50:0/3914916801 wait complete. 2024-09-13T15:11:13.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 Processor -- start 2024-09-13T15:11:13.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 -- start start 2024-09-13T15:11:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd18406aaa0 0x7fd1841f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1841353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 0x7fd1841347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18413b7f0 con 0x7fd18415c2a0 2024-09-13T15:11:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd184157c80 con 0x7fd1840cb020 2024-09-13T15:11:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.373+0000 7fd189800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1841f2ff0 con 0x7fd18406aaa0 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 0x7fd1841347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 0x7fd1841347c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59012/0 (socket says 172.21.15.50:59012) 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 -- 172.21.15.50:0/1544233832 learned_addr learned my addr 172.21.15.50:0/1544233832 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd183e00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd18406aaa0 0x7fd1841f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd17be00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1841353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 -- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd18406aaa0 msgr2=0x7fd1841f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd18406aaa0 0x7fd1841f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 -- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 msgr2=0x7fd1841353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1841353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 -- 172.21.15.50:0/1544233832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740094b0 con 0x7fd18415c2a0 2024-09-13T15:11:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd17be00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1841353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd188e00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 0x7fd1841347c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00cbd0 tx=0x7fd17c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00a7b0 con 0x7fd18415c2a0 2024-09-13T15:11:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c00a910 con 0x7fd18415c2a0 2024-09-13T15:11:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00aca0 con 0x7fd18415c2a0 2024-09-13T15:11:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1841f32d0 con 0x7fd18415c2a0 2024-09-13T15:11:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1841f3890 con 0x7fd18415c2a0 2024-09-13T15:11:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.377+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1840b3ce0 con 0x7fd18415c2a0 2024-09-13T15:11:13.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.381+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd17c01b3b0 con 0x7fd18415c2a0 2024-09-13T15:11:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.381+0000 7fd180c00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd160066730 0x7fd160068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.381+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd17c083cd0 con 0x7fd18415c2a0 2024-09-13T15:11:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.381+0000 7fd183e00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd160066730 0x7fd160068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.385+0000 7fd183e00700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd160066730 0x7fd160068bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd1740090b0 tx=0x7fd174008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.389+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd17c050ef0 con 0x7fd18415c2a0 2024-09-13T15:11:13.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.577+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1841f3460 con 0x7fd18415c2a0 2024-09-13T15:11:13.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.577+0000 7fd180c00700 1 -- 172.21.15.50:0/1544233832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16765 (secure 0 0 0) 0x7fd17c017090 con 0x7fd18415c2a0 2024-09-13T15:11:13.581 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:13.581 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:10:54.464580+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:10:51.524270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T15:10:52.462039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd160066730 msgr2=0x7fd160068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd160066730 0x7fd160068bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd1740090b0 tx=0x7fd174008030 comp rx=0 tx=0).stop 2024-09-13T15:11:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 msgr2=0x7fd1841347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 0x7fd1841347c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00cbd0 tx=0x7fd17c00cc00 comp rx=0 tx=0).stop 2024-09-13T15:11:13.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 shutdown_connections 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd160066730 0x7fd160068bf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd18415c2a0 0x7fd1841347c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1840cb020 0x7fd1841353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 --2- 172.21.15.50:0/1544233832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd18406aaa0 0x7fd1841f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 >> 172.21.15.50:0/1544233832 conn(0x7fd1840b0c40 msgr2=0x7fd18406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 shutdown_connections 2024-09-13T15:11:13.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.581+0000 7fd189800700 1 -- 172.21.15.50:0/1544233832 wait complete. 2024-09-13T15:11:13.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:11:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.785+0000 7f9341200700 1 Processor -- start 2024-09-13T15:11:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.785+0000 7f9341200700 1 -- start start 2024-09-13T15:11:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.785+0000 7f9341200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f933c1610b0 0x7f933c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.785+0000 7f9341200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0b3560 con 0x7f933c06aaa0 2024-09-13T15:11:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.785+0000 7f9341200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0b3280 con 0x7f933c0b2d80 2024-09-13T15:11:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.785+0000 7f9341200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c070b30 con 0x7f933c1610b0 2024-09-13T15:11:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f933c06aaa0 0x7f933c0b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50876/0 (socket says 172.21.15.50:50876) 2024-09-13T15:11:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933aa00700 1 -- 172.21.15.50:0/3704733462 learned_addr learned my addr 172.21.15.50:0/3704733462 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933b400700 1 --2- 172.21.15.50:0/3704733462 >> v2:172.21.15.181:3300/0 conn(0x7f933c1610b0 0x7f933c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818277978 0 0) 0x7f933c0b3560 con 0x7f933c06aaa0 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93200035d0 con 0x7f933c06aaa0 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49087534 0 0) 0x7f933c0b3280 con 0x7f933c0b2d80 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f933c0b3560 con 0x7f933c0b2d80 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933b400700 1 -- 172.21.15.50:0/3704733462 >> v1:172.21.15.181:6789/0 conn(0x7f933c0b2d80 legacy=0x7f933c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933b400700 1 -- 172.21.15.50:0/3704733462 >> v1:172.21.15.50:6789/0 conn(0x7f933c06aaa0 legacy=0x7f933c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933b400700 1 -- 172.21.15.50:0/3704733462 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c070ee0 con 0x7f933c1610b0 2024-09-13T15:11:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933b400700 1 --2- 172.21.15.50:0/3704733462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0719c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f932c009880 tx=0x7f932c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23eb8f7b6c8412b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:13.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c011830 con 0x7f933c1610b0 2024-09-13T15:11:13.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c011990 con 0x7f933c1610b0 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f933a000700 1 -- 172.21.15.50:0/3704733462 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c011d20 con 0x7f933c1610b0 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f9341200700 1 -- 172.21.15.50:0/3704733462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 msgr2=0x7f933c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f9341200700 1 --2- 172.21.15.50:0/3704733462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0719c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f932c009880 tx=0x7f932c009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f9341200700 1 -- 172.21.15.50:0/3704733462 shutdown_connections 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f9341200700 1 --2- 172.21.15.50:0/3704733462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0719c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f9341200700 1 -- 172.21.15.50:0/3704733462 >> 172.21.15.50:0/3704733462 conn(0x7f933c0b0c40 msgr2=0x7f933c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.789+0000 7f9341200700 1 -- 172.21.15.50:0/3704733462 shutdown_connections 2024-09-13T15:11:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 -- 172.21.15.50:0/3704733462 wait complete. 2024-09-13T15:11:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 Processor -- start 2024-09-13T15:11:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 -- start start 2024-09-13T15:11:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f933c06aaa0 0x7f933c151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 0x7f933c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ad690 con 0x7f933c0b2d80 2024-09-13T15:11:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1516a0 con 0x7f933c1610b0 2024-09-13T15:11:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f9341200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ad0d0 con 0x7f933c06aaa0 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.793+0000 7f933aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 0x7f933c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 0x7f933c0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59024/0 (socket says 172.21.15.50:59024) 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 -- 172.21.15.50:0/1433657838 learned_addr learned my addr 172.21.15.50:0/1433657838 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933be00700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933b400700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f933c06aaa0 0x7f933c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 -- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f933c06aaa0 msgr2=0x7f933c151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f933c06aaa0 0x7f933c151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 -- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 msgr2=0x7f933c0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 -- 172.21.15.50:0/1433657838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0094b0 con 0x7f933c0b2d80 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933b400700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f933c06aaa0 0x7f933c151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f933aa00700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 0x7f933c0ca730 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f932800c590 tx=0x7f932800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328005d90 con 0x7f933c0b2d80 2024-09-13T15:11:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93280070d0 con 0x7f933c0b2d80 2024-09-13T15:11:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c0ad3b0 con 0x7f933c0b2d80 2024-09-13T15:11:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328007440 con 0x7f933c0b2d80 2024-09-13T15:11:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c14eb40 con 0x7f933c0b2d80 2024-09-13T15:11:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.797+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c14e6c0 con 0x7f933c0b2d80 2024-09-13T15:11:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.801+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93280075a0 con 0x7f933c0b2d80 2024-09-13T15:11:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.801+0000 7f9333400700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f931c066730 0x7f931c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.801+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9328083710 con 0x7f933c0b2d80 2024-09-13T15:11:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.801+0000 7f933b400700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f931c066730 0x7f931c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.805+0000 7f933b400700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f931c066730 0x7f931c068bf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f932c0090b0 tx=0x7f932c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:13.805+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f933c14e6c0 con 0x7f933c0b2d80 2024-09-13T15:11:14.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.029+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f933c14e6c0 con 0x7f933c0b2d80 2024-09-13T15:11:14.033 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:11:14.029+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:11:14.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.045+0000 7f9333400700 1 -- 172.21.15.50:0/1433657838 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f933c14e6c0 con 0x7f933c0b2d80 2024-09-13T15:11:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.045+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f931c066730 msgr2=0x7f931c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.045+0000 7f9341200700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f931c066730 0x7f931c068bf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f932c0090b0 tx=0x7f932c01c040 comp rx=0 tx=0).stop 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.045+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 msgr2=0x7f933c0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.045+0000 7f9341200700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 0x7f933c0ca730 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f932800c590 tx=0x7f932800c8a0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 shutdown_connections 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f931c066730 0x7f931c068bf0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f933c1610b0 0x7f933c0ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f933c0b2d80 0x7f933c0ca730 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 --2- 172.21.15.50:0/1433657838 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f933c06aaa0 0x7f933c151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 >> 172.21.15.50:0/1433657838 conn(0x7f933c0b0c40 msgr2=0x7f933c15fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:14.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 shutdown_connections 2024-09-13T15:11:14.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.049+0000 7f9341200700 1 -- 172.21.15.50:0/1433657838 wait complete. 2024-09-13T15:11:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:11:14.053 INFO:tasks.ceph.mds.a.smithi050.stderr: -2059> 2024-09-13T15:10:58.945+0000 7fc88d600700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:11:14.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:11:14.107 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:11:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.249+0000 7f019ce00700 1 Processor -- start 2024-09-13T15:11:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.249+0000 7f019ce00700 1 -- start start 2024-09-13T15:11:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f019ce00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f019806d620 0x7f019806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f019ce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f019806cea0 0x7f01980b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f019ce00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01980b1980 con 0x7f0198143b70 2024-09-13T15:11:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f019ce00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b2500 con 0x7f019806cea0 2024-09-13T15:11:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f019ce00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806d2f0 con 0x7f019806d620 2024-09-13T15:11:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0197e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f019806cea0 0x7f01980b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0197400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0198143b70 0x7f01980cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:39036/0 (socket says 172.21.15.50:39036) 2024-09-13T15:11:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0197400700 1 -- 172.21.15.50:0/2904343351 learned_addr learned my addr 172.21.15.50:0/2904343351 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196a00700 1 --2- 172.21.15.50:0/2904343351 >> v2:172.21.15.181:3300/0 conn(0x7f019806d620 0x7f019806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196000700 1 -- 172.21.15.50:0/2904343351 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258459425 0 0) 0x7f01980b1980 con 0x7f0198143b70 2024-09-13T15:11:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196a00700 1 -- 172.21.15.50:0/2904343351 >> v2:172.21.15.50:3300/0 conn(0x7f019806cea0 msgr2=0x7f01980b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196a00700 1 --2- 172.21.15.50:0/2904343351 >> v2:172.21.15.50:3300/0 conn(0x7f019806cea0 0x7f01980b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196a00700 1 -- 172.21.15.50:0/2904343351 >> v1:172.21.15.181:6789/0 conn(0x7f0198143b70 legacy=0x7f01980cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196a00700 1 -- 172.21.15.50:0/2904343351 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980b1bd0 con 0x7f019806d620 2024-09-13T15:11:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196a00700 1 --2- 172.21.15.50:0/2904343351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f019806c960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f01980ce860 tx=0x7f0184009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daf36531d727cae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.253+0000 7f0196000700 1 -- 172.21.15.50:0/2904343351 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184011830 con 0x7f019806d620 2024-09-13T15:11:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f0196000700 1 -- 172.21.15.50:0/2904343351 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0184011990 con 0x7f019806d620 2024-09-13T15:11:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f0196000700 1 -- 172.21.15.50:0/2904343351 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184011d20 con 0x7f019806d620 2024-09-13T15:11:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 -- 172.21.15.50:0/2904343351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 msgr2=0x7f019806c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 --2- 172.21.15.50:0/2904343351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f019806c960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f01980ce860 tx=0x7f0184009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 -- 172.21.15.50:0/2904343351 shutdown_connections 2024-09-13T15:11:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 --2- 172.21.15.50:0/2904343351 >> v2:172.21.15.50:3300/0 conn(0x7f019806cea0 0x7f01980b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 --2- 172.21.15.50:0/2904343351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f019806c960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 -- 172.21.15.50:0/2904343351 >> 172.21.15.50:0/2904343351 conn(0x7f019806a390 msgr2=0x7f019806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 -- 172.21.15.50:0/2904343351 shutdown_connections 2024-09-13T15:11:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 -- 172.21.15.50:0/2904343351 wait complete. 2024-09-13T15:11:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 Processor -- start 2024-09-13T15:11:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.257+0000 7f019ce00700 1 -- start start 2024-09-13T15:11:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f019806cea0 0x7f019813f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f0198158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 0x7f0198141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01981402f0 con 0x7f0198143b70 2024-09-13T15:11:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01981405d0 con 0x7f019806d620 2024-09-13T15:11:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01981408b0 con 0x7f019806cea0 2024-09-13T15:11:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 0x7f0198141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 0x7f0198141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59060/0 (socket says 172.21.15.50:59060) 2024-09-13T15:11:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 -- 172.21.15.50:0/1973286150 learned_addr learned my addr 172.21.15.50:0/1973286150 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197400700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f019806cea0 0x7f019813f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0196a00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f0198158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 -- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f019806cea0 msgr2=0x7f019813f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f019806cea0 0x7f019813f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 -- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 msgr2=0x7f0198158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f0198158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 -- 172.21.15.50:0/1973286150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01840094b0 con 0x7f0198143b70 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0196a00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f0198158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f0197e00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 0x7f0198141390 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f019000efc0 tx=0x7f019000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000cad0 con 0x7f0198143b70 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000f040 con 0x7f0198143b70 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000ce70 con 0x7f0198143b70 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.261+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0198140b90 con 0x7f0198143b70 2024-09-13T15:11:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.265+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01981590e0 con 0x7f0198143b70 2024-09-13T15:11:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.265+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01981410b0 con 0x7f0198143b70 2024-09-13T15:11:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.265+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0190014480 con 0x7f0198143b70 2024-09-13T15:11:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.269+0000 7f018f400700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0178066730 0x7f0178068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.269+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f0190084a90 con 0x7f0198143b70 2024-09-13T15:11:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.269+0000 7f0197400700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0178066730 0x7f0178068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.269+0000 7f0197400700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0178066730 0x7f0178068bf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0188000f60 tx=0x7f0188007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.273+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01981410b0 con 0x7f0198143b70 2024-09-13T15:11:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:14.493+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f01981410b0 con 0x7f0198143b70 2024-09-13T15:11:15.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.053+0000 7f018f400700 1 -- 172.21.15.50:0/1973286150 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f01981410b0 con 0x7f0198143b70 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0178066730 msgr2=0x7f0178068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0178066730 0x7f0178068bf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0188000f60 tx=0x7f0188007e00 comp rx=0 tx=0).stop 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 msgr2=0x7f0198141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 0x7f0198141390 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f019000efc0 tx=0x7f019000c0c0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 shutdown_connections 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0178066730 0x7f0178068bf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0198143b70 0x7f0198141390 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019806d620 0x7f0198158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 --2- 172.21.15.50:0/1973286150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f019806cea0 0x7f019813f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 >> 172.21.15.50:0/1973286150 conn(0x7f019806a390 msgr2=0x7f01980b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 shutdown_connections 2024-09-13T15:11:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.061+0000 7f019ce00700 1 -- 172.21.15.50:0/1973286150 wait complete. 2024-09-13T15:11:15.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:11:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.321+0000 7fac2d200700 1 Processor -- start 2024-09-13T15:11:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.321+0000 7fac2d200700 1 -- start start 2024-09-13T15:11:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.321+0000 7fac2d200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac28164410 0x7fac280ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.321+0000 7fac2d200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fac280b25b0 0x7fac280b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac280cda10 con 0x7fac280b3920 2024-09-13T15:11:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280cfbd0 con 0x7fac28164410 2024-09-13T15:11:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280b2f40 con 0x7fac280b25b0 2024-09-13T15:11:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac28164410 0x7fac280ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac28164410 0x7fac280ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59064/0 (socket says 172.21.15.50:59064) 2024-09-13T15:11:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 -- 172.21.15.50:0/313327487 learned_addr learned my addr 172.21.15.50:0/313327487 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27e00700 1 --2- 172.21.15.50:0/313327487 >> v2:172.21.15.181:3300/0 conn(0x7fac280b25b0 0x7fac280b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 -- 172.21.15.50:0/313327487 >> v2:172.21.15.181:3300/0 conn(0x7fac280b25b0 msgr2=0x7fac280b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 --2- 172.21.15.50:0/313327487 >> v2:172.21.15.181:3300/0 conn(0x7fac280b25b0 0x7fac280b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 -- 172.21.15.50:0/313327487 >> v1:172.21.15.181:6789/0 conn(0x7fac280b3920 legacy=0x7fac280cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 -- 172.21.15.50:0/313327487 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280d0700 con 0x7fac28164410 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27e00700 1 --2- 172.21.15.50:0/313327487 >> v2:172.21.15.181:3300/0 conn(0x7fac280b25b0 0x7fac280b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac27400700 1 --2- 172.21.15.50:0/313327487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac28164410 0x7fac280ce850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fac280b5ff0 tx=0x7fac18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e35e564d01fe35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac26000700 1 -- 172.21.15.50:0/313327487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800b8a0 con 0x7fac28164410 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac26000700 1 -- 172.21.15.50:0/313327487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1800ba00 con 0x7fac28164410 2024-09-13T15:11:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac26000700 1 -- 172.21.15.50:0/313327487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800bd90 con 0x7fac28164410 2024-09-13T15:11:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- 172.21.15.50:0/313327487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac28164410 msgr2=0x7fac280ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 --2- 172.21.15.50:0/313327487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac28164410 0x7fac280ce850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fac280b5ff0 tx=0x7fac18009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- 172.21.15.50:0/313327487 shutdown_connections 2024-09-13T15:11:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 --2- 172.21.15.50:0/313327487 >> v2:172.21.15.181:3300/0 conn(0x7fac280b25b0 0x7fac280b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 --2- 172.21.15.50:0/313327487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac28164410 0x7fac280ce850 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- 172.21.15.50:0/313327487 >> 172.21.15.50:0/313327487 conn(0x7fac28066270 msgr2=0x7fac28071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- 172.21.15.50:0/313327487 shutdown_connections 2024-09-13T15:11:15.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.325+0000 7fac2d200700 1 -- 172.21.15.50:0/313327487 wait complete. 2024-09-13T15:11:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 Processor -- start 2024-09-13T15:11:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 -- start start 2024-09-13T15:11:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 0x7fac281fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac280b3920 0x7fac2806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac28164410 0x7fac2815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281faa20 con 0x7fac280b25b0 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281fad00 con 0x7fac28164410 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac2d200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac281fafe0 con 0x7fac280b3920 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 0x7fac281fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 0x7fac281fa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59076/0 (socket says 172.21.15.50:59076) 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.329+0000 7fac27400700 1 -- 172.21.15.50:0/2697206050 learned_addr learned my addr 172.21.15.50:0/2697206050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac26a00700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac280b3920 0x7fac2806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27e00700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac28164410 0x7fac2815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27400700 1 -- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac280b3920 msgr2=0x7fac2806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27400700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac280b3920 0x7fac2806c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27400700 1 -- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac28164410 msgr2=0x7fac2815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27400700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac28164410 0x7fac2815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27400700 1 -- 172.21.15.50:0/2697206050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009570 con 0x7fac280b25b0 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac27400700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 0x7fac281fa0f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fac18000c00 tx=0x7fac18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180038c0 con 0x7fac280b25b0 2024-09-13T15:11:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1801e070 con 0x7fac280b25b0 2024-09-13T15:11:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18003c80 con 0x7fac280b25b0 2024-09-13T15:11:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac280c5930 con 0x7fac280b25b0 2024-09-13T15:11:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.333+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281fa630 con 0x7fac280b25b0 2024-09-13T15:11:15.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.337+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac281647f0 con 0x7fac280b25b0 2024-09-13T15:11:15.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.337+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac18011420 con 0x7fac280b25b0 2024-09-13T15:11:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.337+0000 7fac1f400700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac08066730 0x7fac08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.337+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fac18020070 con 0x7fac280b25b0 2024-09-13T15:11:15.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.337+0000 7fac26a00700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac08066730 0x7fac08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.341+0000 7fac26a00700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac08066730 0x7fac08068bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fac2815d4b0 tx=0x7fac14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.345+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac18052c10 con 0x7fac280b25b0 2024-09-13T15:11:15.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:15.541+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fac2806b5a0 con 0x7fac280b25b0 2024-09-13T15:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.061+0000 7fac1f400700 1 -- 172.21.15.50:0/2697206050 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7fac18056230 con 0x7fac280b25b0 2024-09-13T15:11:16.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac08066730 msgr2=0x7fac08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac08066730 0x7fac08068bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fac2815d4b0 tx=0x7fac14009040 comp rx=0 tx=0).stop 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 msgr2=0x7fac281fa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 0x7fac281fa0f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fac18000c00 tx=0x7fac18004770 comp rx=0 tx=0).stop 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 shutdown_connections 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fac08066730 0x7fac08068bf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac28164410 0x7fac2815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fac280b3920 0x7fac2806c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 --2- 172.21.15.50:0/2697206050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac280b25b0 0x7fac281fa0f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.065+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 >> 172.21.15.50:0/2697206050 conn(0x7fac28066270 msgr2=0x7fac280d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.069+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 shutdown_connections 2024-09-13T15:11:16.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.069+0000 7fac2d200700 1 -- 172.21.15.50:0/2697206050 wait complete. 2024-09-13T15:11:16.071 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:11:16.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:11:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.285+0000 7f8b57200700 1 Processor -- start 2024-09-13T15:11:16.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.285+0000 7f8b57200700 1 -- start start 2024-09-13T15:11:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b57200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b29e0 0x7f8b580cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b57200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b580ce1c0 0x7f8b5815d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b57200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b580b5a40 con 0x7f8b580b3290 2024-09-13T15:11:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b57200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580b2f30 con 0x7f8b580ce1c0 2024-09-13T15:11:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b57200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580ce650 con 0x7f8b580b29e0 2024-09-13T15:11:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b55e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b580b3290 0x7f8b58071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50892/0 (socket says 172.21.15.50:50892) 2024-09-13T15:11:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b55e00700 1 -- 172.21.15.50:0/537704678 learned_addr learned my addr 172.21.15.50:0/537704678 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b56800700 1 --2- 172.21.15.50:0/537704678 >> v2:172.21.15.181:3300/0 conn(0x7f8b580ce1c0 0x7f8b5815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.289+0000 7f8b55400700 1 --2- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b29e0 0x7f8b580cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b56800700 1 -- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b29e0 msgr2=0x7f8b580cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b56800700 1 --2- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b29e0 0x7f8b580cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b54a00700 1 -- 172.21.15.50:0/537704678 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450580370 0 0) 0x7f8b580b5a40 con 0x7f8b580b3290 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b56800700 1 -- 172.21.15.50:0/537704678 >> v1:172.21.15.50:6789/0 conn(0x7f8b580b3290 legacy=0x7f8b58071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b56800700 1 -- 172.21.15.50:0/537704678 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580b5480 con 0x7f8b580ce1c0 2024-09-13T15:11:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b56800700 1 --2- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580ce1c0 0x7f8b5815d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009d90 tx=0x7f8b5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf31234ae94665fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b54a00700 1 -- 172.21.15.50:0/537704678 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000e070 con 0x7f8b580ce1c0 2024-09-13T15:11:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b54a00700 1 -- 172.21.15.50:0/537704678 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5000bb20 con 0x7f8b580ce1c0 2024-09-13T15:11:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b54a00700 1 -- 172.21.15.50:0/537704678 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50012430 con 0x7f8b580ce1c0 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 -- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580ce1c0 msgr2=0x7f8b5815d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 --2- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580ce1c0 0x7f8b5815d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009d90 tx=0x7f8b5000b330 comp rx=0 tx=0).stop 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 -- 172.21.15.50:0/537704678 shutdown_connections 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 --2- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580ce1c0 0x7f8b5815d330 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 --2- 172.21.15.50:0/537704678 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b29e0 0x7f8b580cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 -- 172.21.15.50:0/537704678 >> 172.21.15.50:0/537704678 conn(0x7f8b5806d4b0 msgr2=0x7f8b5806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 -- 172.21.15.50:0/537704678 shutdown_connections 2024-09-13T15:11:16.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.293+0000 7f8b57200700 1 -- 172.21.15.50:0/537704678 wait complete. 2024-09-13T15:11:16.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 Processor -- start 2024-09-13T15:11:16.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 -- start start 2024-09-13T15:11:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580b29e0 0x7f8b58158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b3290 0x7f8b58139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 0x7f8b5813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5813b610 con 0x7f8b580ce1c0 2024-09-13T15:11:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5813a570 con 0x7f8b580b29e0 2024-09-13T15:11:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.297+0000 7f8b57200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5813a850 con 0x7f8b580b3290 2024-09-13T15:11:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 0x7f8b5813bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 0x7f8b5813bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59084/0 (socket says 172.21.15.50:59084) 2024-09-13T15:11:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 -- 172.21.15.50:0/3528524813 learned_addr learned my addr 172.21.15.50:0/3528524813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:16.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b55e00700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580b29e0 0x7f8b58158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b55400700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b3290 0x7f8b58139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 -- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b3290 msgr2=0x7f8b58139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b3290 0x7f8b58139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 -- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580b29e0 msgr2=0x7f8b58158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580b29e0 0x7f8b58158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 -- 172.21.15.50:0/3528524813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50009a70 con 0x7f8b580ce1c0 2024-09-13T15:11:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b56800700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 0x7f8b5813bf70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8b50014040 tx=0x7f8b50004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50012430 con 0x7f8b580ce1c0 2024-09-13T15:11:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50020070 con 0x7f8b580ce1c0 2024-09-13T15:11:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5813ab30 con 0x7f8b580ce1c0 2024-09-13T15:11:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50004280 con 0x7f8b580ce1c0 2024-09-13T15:11:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.301+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5813b0f0 con 0x7f8b580ce1c0 2024-09-13T15:11:16.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.305+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b580cdc80 con 0x7f8b580ce1c0 2024-09-13T15:11:16.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.305+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b500043e0 con 0x7f8b580ce1c0 2024-09-13T15:11:16.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.305+0000 7f8b4e000700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b38066730 0x7f8b38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.305+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f8b50022070 con 0x7f8b580ce1c0 2024-09-13T15:11:16.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.309+0000 7f8b55e00700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b38066730 0x7f8b38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.309+0000 7f8b55e00700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b38066730 0x7f8b38068bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b48000f60 tx=0x7f8b48007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.309+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b500531f0 con 0x7f8b580ce1c0 2024-09-13T15:11:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:16.493+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b580b4920 con 0x7f8b580ce1c0 2024-09-13T15:11:17.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.065+0000 7f8b4e000700 1 -- 172.21.15.50:0/3528524813 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8b50056810 con 0x7f8b580ce1c0 2024-09-13T15:11:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b38066730 msgr2=0x7f8b38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b38066730 0x7f8b38068bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b48000f60 tx=0x7f8b48007e90 comp rx=0 tx=0).stop 2024-09-13T15:11:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 msgr2=0x7f8b5813bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 0x7f8b5813bf70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8b50014040 tx=0x7f8b50004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 shutdown_connections 2024-09-13T15:11:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8b38066730 0x7f8b38068bf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b580ce1c0 0x7f8b5813bf70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8b580b3290 0x7f8b58139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 --2- 172.21.15.50:0/3528524813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b580b29e0 0x7f8b58158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 >> 172.21.15.50:0/3528524813 conn(0x7f8b5806d4b0 msgr2=0x7f8b5806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 shutdown_connections 2024-09-13T15:11:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.073+0000 7f8b57200700 1 -- 172.21.15.50:0/3528524813 wait complete. 2024-09-13T15:11:17.077 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:11:17.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T15:11:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.265+0000 7f38f1800700 1 Processor -- start 2024-09-13T15:11:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.265+0000 7f38f1800700 1 -- start start 2024-09-13T15:11:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f1800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f38ec15a980 0x7f38ec0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f1800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec15af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f1800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec066090 con 0x7f38ec0b5330 2024-09-13T15:11:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f1800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec071f50 con 0x7f38ec15a980 2024-09-13T15:11:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f1800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15ad60 con 0x7f38ec0cd5c0 2024-09-13T15:11:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38eb400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f38ec0b5330 0x7f38ec0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50902/0 (socket says 172.21.15.50:50902) 2024-09-13T15:11:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38eb400700 1 -- 172.21.15.50:0/3458810015 learned_addr learned my addr 172.21.15.50:0/3458810015 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38ebe00700 1 --2- 172.21.15.50:0/3458810015 >> v2:172.21.15.181:3300/0 conn(0x7f38ec15a980 0x7f38ec0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f0e00700 1 --2- 172.21.15.50:0/3458810015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f0e00700 1 -- 172.21.15.50:0/3458810015 >> v2:172.21.15.181:3300/0 conn(0x7f38ec15a980 msgr2=0x7f38ec0b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f0e00700 1 --2- 172.21.15.50:0/3458810015 >> v2:172.21.15.181:3300/0 conn(0x7f38ec15a980 0x7f38ec0b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f0e00700 1 -- 172.21.15.50:0/3458810015 >> v1:172.21.15.50:6789/0 conn(0x7f38ec0b5330 legacy=0x7f38ec0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.269+0000 7f38f0e00700 1 -- 172.21.15.50:0/3458810015 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec066370 con 0x7f38ec0cd5c0 2024-09-13T15:11:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f0e00700 1 --2- 172.21.15.50:0/3458810015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec15af60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009dc0 tx=0x7f38e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cccfaaa978810c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38eaa00700 1 -- 172.21.15.50:0/3458810015 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400e070 con 0x7f38ec0cd5c0 2024-09-13T15:11:17.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38eaa00700 1 -- 172.21.15.50:0/3458810015 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e400bae0 con 0x7f38ec0cd5c0 2024-09-13T15:11:17.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38eaa00700 1 -- 172.21.15.50:0/3458810015 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400be90 con 0x7f38ec0cd5c0 2024-09-13T15:11:17.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 -- 172.21.15.50:0/3458810015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 msgr2=0x7f38ec15af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 --2- 172.21.15.50:0/3458810015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec15af60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009dc0 tx=0x7f38e400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:17.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 -- 172.21.15.50:0/3458810015 shutdown_connections 2024-09-13T15:11:17.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 --2- 172.21.15.50:0/3458810015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec15af60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 --2- 172.21.15.50:0/3458810015 >> v2:172.21.15.181:3300/0 conn(0x7f38ec15a980 0x7f38ec0b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 -- 172.21.15.50:0/3458810015 >> 172.21.15.50:0/3458810015 conn(0x7f38ec070d10 msgr2=0x7f38ec0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 -- 172.21.15.50:0/3458810015 shutdown_connections 2024-09-13T15:11:17.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 -- 172.21.15.50:0/3458810015 wait complete. 2024-09-13T15:11:17.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 Processor -- start 2024-09-13T15:11:17.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.273+0000 7f38f1800700 1 -- start start 2024-09-13T15:11:17.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 0x7f38ec159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec15a980 0x7f38ec149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec154080 con 0x7f38ec0b5330 2024-09-13T15:11:17.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec154320 con 0x7f38ec15a980 2024-09-13T15:11:17.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec154600 con 0x7f38ec0cd5c0 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 0x7f38ec159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 0x7f38ec159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59086/0 (socket says 172.21.15.50:59086) 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 -- 172.21.15.50:0/3807620422 learned_addr learned my addr 172.21.15.50:0/3807620422 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38eb400700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f0e00700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec15a980 0x7f38ec149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 -- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 msgr2=0x7f38ec1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 -- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec15a980 msgr2=0x7f38ec149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec15a980 0x7f38ec149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 -- 172.21.15.50:0/3807620422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4009a70 con 0x7f38ec0b5330 2024-09-13T15:11:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38ebe00700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 0x7f38ec159b00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00e840 tx=0x7f38dc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0095a0 con 0x7f38ec0b5330 2024-09-13T15:11:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc013680 con 0x7f38ec0b5330 2024-09-13T15:11:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0139f0 con 0x7f38ec0b5330 2024-09-13T15:11:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ec1548e0 con 0x7f38ec0b5330 2024-09-13T15:11:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.277+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec15a040 con 0x7f38ec0b5330 2024-09-13T15:11:17.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.281+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec0b4df0 con 0x7f38ec0b5330 2024-09-13T15:11:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.281+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38dc013b50 con 0x7f38ec0b5330 2024-09-13T15:11:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.285+0000 7f38e3e00700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f38cc066730 0x7f38cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.285+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f38dc083e80 con 0x7f38ec0b5330 2024-09-13T15:11:17.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.285+0000 7f38eb400700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f38cc066730 0x7f38cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.285+0000 7f38eb400700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f38cc066730 0x7f38cc068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f38ec159140 tx=0x7f38d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.289+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38dc051310 con 0x7f38ec0b5330 2024-09-13T15:11:17.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.473+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f38ec0b2f60 con 0x7f38ec0b5330 2024-09-13T15:11:17.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.481+0000 7f38e3e00700 1 -- 172.21.15.50:0/3807620422 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38dc054930 con 0x7f38ec0b5330 2024-09-13T15:11:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f38cc066730 msgr2=0x7f38cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f38cc066730 0x7f38cc068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f38ec159140 tx=0x7f38d8009040 comp rx=0 tx=0).stop 2024-09-13T15:11:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 msgr2=0x7f38ec159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 0x7f38ec159b00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00e840 tx=0x7f38dc00eb50 comp rx=0 tx=0).stop 2024-09-13T15:11:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 shutdown_connections 2024-09-13T15:11:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f38cc066730 0x7f38cc068bf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec15a980 0x7f38ec149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f38ec0cd5c0 0x7f38ec1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 --2- 172.21.15.50:0/3807620422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38ec0b5330 0x7f38ec159b00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 >> 172.21.15.50:0/3807620422 conn(0x7f38ec070d10 msgr2=0x7f38ec0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.485+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 shutdown_connections 2024-09-13T15:11:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.488+0000 7f38f1800700 1 -- 172.21.15.50:0/3807620422 wait complete. 2024-09-13T15:11:17.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-09-13T15:11:17.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.696+0000 7fe73ca00700 1 Processor -- start 2024-09-13T15:11:17.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.696+0000 7fe73ca00700 1 -- start start 2024-09-13T15:11:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe73ca00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe73806d620 0x7fe73806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe73ca00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7380b1980 con 0x7fe738143b70 2024-09-13T15:11:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe73ca00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7380b2500 con 0x7fe73806cea0 2024-09-13T15:11:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe73ca00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73806d2f0 con 0x7fe73806d620 2024-09-13T15:11:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe73806d620 0x7fe73806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe73806d620 0x7fe73806c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59102/0 (socket says 172.21.15.50:59102) 2024-09-13T15:11:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736a00700 1 -- 172.21.15.50:0/489660896 learned_addr learned my addr 172.21.15.50:0/489660896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736a00700 1 -- 172.21.15.50:0/489660896 >> v1:172.21.15.181:6789/0 conn(0x7fe73806cea0 legacy=0x7fe7380b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736a00700 1 -- 172.21.15.50:0/489660896 >> v1:172.21.15.50:6789/0 conn(0x7fe738143b70 legacy=0x7fe7380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736a00700 1 -- 172.21.15.50:0/489660896 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380b1bd0 con 0x7fe73806d620 2024-09-13T15:11:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.700+0000 7fe736000700 1 -- 172.21.15.50:0/489660896 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663189769 0 0) 0x7fe7380b1980 con 0x7fe738143b70 2024-09-13T15:11:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe736a00700 1 --2- 172.21.15.50:0/489660896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806d620 0x7fe73806c960 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe724009910 tx=0x7fe724009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8efff7d854a4e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe736000700 1 -- 172.21.15.50:0/489660896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400ba60 con 0x7fe73806d620 2024-09-13T15:11:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe736000700 1 -- 172.21.15.50:0/489660896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72400bbc0 con 0x7fe73806d620 2024-09-13T15:11:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe736000700 1 -- 172.21.15.50:0/489660896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724009e60 con 0x7fe73806d620 2024-09-13T15:11:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 -- 172.21.15.50:0/489660896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806d620 msgr2=0x7fe73806c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 --2- 172.21.15.50:0/489660896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806d620 0x7fe73806c960 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe724009910 tx=0x7fe724009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 -- 172.21.15.50:0/489660896 shutdown_connections 2024-09-13T15:11:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 --2- 172.21.15.50:0/489660896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806d620 0x7fe73806c960 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 -- 172.21.15.50:0/489660896 >> 172.21.15.50:0/489660896 conn(0x7fe73806a390 msgr2=0x7fe73806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 -- 172.21.15.50:0/489660896 shutdown_connections 2024-09-13T15:11:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.704+0000 7fe73ca00700 1 -- 172.21.15.50:0/489660896 wait complete. 2024-09-13T15:11:17.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 Processor -- start 2024-09-13T15:11:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 -- start start 2024-09-13T15:11:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 0x7fe73815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe73806d620 0x7fe738142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe738143b70 0x7fe738139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738141540 con 0x7fe73806cea0 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738141790 con 0x7fe73806d620 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe73ca00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe738141a70 con 0x7fe738143b70 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe737400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 0x7fe73815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe737400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 0x7fe73815ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59118/0 (socket says 172.21.15.50:59118) 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe737400700 1 -- 172.21.15.50:0/3242515947 learned_addr learned my addr 172.21.15.50:0/3242515947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe736a00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe73806d620 0x7fe738142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.708+0000 7fe737e00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe738143b70 0x7fe738139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737400700 1 -- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe738143b70 msgr2=0x7fe738139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737400700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe738143b70 0x7fe738139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737400700 1 -- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe73806d620 msgr2=0x7fe738142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737400700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe73806d620 0x7fe738142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737400700 1 -- 172.21.15.50:0/3242515947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009570 con 0x7fe73806cea0 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737e00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe738143b70 0x7fe738139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe736a00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe73806d620 0x7fe738142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe737400700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 0x7fe73815ce90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe72800cca0 tx=0x7fe72800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728003e50 con 0x7fe73806cea0 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800a810 con 0x7fe73806cea0 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe738141d50 con 0x7fe73806cea0 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800abc0 con 0x7fe73806cea0 2024-09-13T15:11:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe738142310 con 0x7fe73806cea0 2024-09-13T15:11:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.712+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73806c960 con 0x7fe73806cea0 2024-09-13T15:11:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.716+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe72800ad20 con 0x7fe73806cea0 2024-09-13T15:11:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.716+0000 7fe72f400700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe718066730 0x7fe718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.716+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe7280841c0 con 0x7fe73806cea0 2024-09-13T15:11:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.720+0000 7fe736a00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe718066730 0x7fe718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.720+0000 7fe736a00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe718066730 0x7fe718068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe724000c00 tx=0x7fe724008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.720+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe728051650 con 0x7fe73806cea0 2024-09-13T15:11:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.904+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7fe738071f60 con 0x7fe73806cea0 2024-09-13T15:11:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.912+0000 7fe72f400700 1 -- 172.21.15.50:0/3242515947 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v21) v1 ==== 106+0+0 (secure 0 0 0) 0x7fe728054c70 con 0x7fe73806cea0 2024-09-13T15:11:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.912+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe718066730 msgr2=0x7fe718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.912+0000 7fe73ca00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe718066730 0x7fe718068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe724000c00 tx=0x7fe724008030 comp rx=0 tx=0).stop 2024-09-13T15:11:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.912+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 msgr2=0x7fe73815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 0x7fe73815ce90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe72800cca0 tx=0x7fe72800a060 comp rx=0 tx=0).stop 2024-09-13T15:11:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 shutdown_connections 2024-09-13T15:11:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe718066730 0x7fe718068bf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe738143b70 0x7fe738139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe73806d620 0x7fe738142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 --2- 172.21.15.50:0/3242515947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe73806cea0 0x7fe73815ce90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 >> 172.21.15.50:0/3242515947 conn(0x7fe73806a390 msgr2=0x7fe7380cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 shutdown_connections 2024-09-13T15:11:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:17.916+0000 7fe73ca00700 1 -- 172.21.15.50:0/3242515947 wait complete. 2024-09-13T15:11:17.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-13T15:11:18.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 Processor -- start 2024-09-13T15:11:18.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 -- start start 2024-09-13T15:11:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef406aaa0 0x7f3ef406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef40b3040 con 0x7f3ef41610b0 2024-09-13T15:11:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef4070b30 con 0x7f3ef406aaa0 2024-09-13T15:11:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.120+0000 7f3efb000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef406b450 con 0x7f3ef40b2670 2024-09-13T15:11:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9c00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3ef41610b0 0x7f3ef40719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:39062/0 (socket says 172.21.15.50:39062) 2024-09-13T15:11:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9c00700 1 -- 172.21.15.50:0/2852109282 learned_addr learned my addr 172.21.15.50:0/2852109282 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ef406aaa0 0x7f3ef406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efa600700 1 --2- 172.21.15.50:0/2852109282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9200700 1 -- 172.21.15.50:0/2852109282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 msgr2=0x7f3ef40b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9200700 1 --2- 172.21.15.50:0/2852109282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9200700 1 -- 172.21.15.50:0/2852109282 >> v1:172.21.15.181:6789/0 conn(0x7f3ef41610b0 legacy=0x7f3ef40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef3e00700 1 -- 172.21.15.50:0/2852109282 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834487129 0 0) 0x7f3ee8001110 con 0x7f3ef41610b0 2024-09-13T15:11:18.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9200700 1 -- 172.21.15.50:0/2852109282 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40b3560 con 0x7f3ef406aaa0 2024-09-13T15:11:18.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef9200700 1 --2- 172.21.15.50:0/2852109282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef406af10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009880 tx=0x7f3ee0009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da002de71bb1d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:18.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef3e00700 1 -- 172.21.15.50:0/2852109282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011830 con 0x7f3ef406aaa0 2024-09-13T15:11:18.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef3e00700 1 -- 172.21.15.50:0/2852109282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0011990 con 0x7f3ef406aaa0 2024-09-13T15:11:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3ef3e00700 1 -- 172.21.15.50:0/2852109282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011d20 con 0x7f3ef406aaa0 2024-09-13T15:11:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 -- 172.21.15.50:0/2852109282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 msgr2=0x7f3ef406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 --2- 172.21.15.50:0/2852109282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef406af10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009880 tx=0x7f3ee0009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 -- 172.21.15.50:0/2852109282 shutdown_connections 2024-09-13T15:11:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 --2- 172.21.15.50:0/2852109282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 --2- 172.21.15.50:0/2852109282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef406af10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 -- 172.21.15.50:0/2852109282 >> 172.21.15.50:0/2852109282 conn(0x7f3ef40b0c40 msgr2=0x7f3ef406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 -- 172.21.15.50:0/2852109282 shutdown_connections 2024-09-13T15:11:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.124+0000 7f3efb000700 1 -- 172.21.15.50:0/2852109282 wait complete. 2024-09-13T15:11:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.128+0000 7f3efb000700 1 Processor -- start 2024-09-13T15:11:18.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.128+0000 7f3efb000700 1 -- start start 2024-09-13T15:11:18.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef41f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef41610b0 0x7f3ef40ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40aad40 con 0x7f3ef406aaa0 2024-09-13T15:11:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40aa3e0 con 0x7f3ef41610b0 2024-09-13T15:11:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef41f6730 con 0x7f3ef40b2670 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef41f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef41f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59130/0 (socket says 172.21.15.50:59130) 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 -- 172.21.15.50:0/1346418667 learned_addr learned my addr 172.21.15.50:0/1346418667 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9200700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efa600700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef41610b0 0x7f3ef40ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 -- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 msgr2=0x7f3ef40acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 -- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef41610b0 msgr2=0x7f3ef40ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef41610b0 0x7f3ef40ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 -- 172.21.15.50:0/1346418667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00094b0 con 0x7f3ef406aaa0 2024-09-13T15:11:18.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef9c00700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef41f61f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c4e0 tx=0x7f3ee800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:18.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8004ca0 con 0x7f3ef406aaa0 2024-09-13T15:11:18.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8004e20 con 0x7f3ef406aaa0 2024-09-13T15:11:18.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef40a9ed0 con 0x7f3ef406aaa0 2024-09-13T15:11:18.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8007310 con 0x7f3ef406aaa0 2024-09-13T15:11:18.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.132+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef40aa960 con 0x7f3ef406aaa0 2024-09-13T15:11:18.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.136+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef4161490 con 0x7f3ef406aaa0 2024-09-13T15:11:18.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.136+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ee8007470 con 0x7f3ef406aaa0 2024-09-13T15:11:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.140+0000 7f3ef1600700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ed4066760 0x7f3ed4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.140+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3ee80839d0 con 0x7f3ef406aaa0 2024-09-13T15:11:18.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.140+0000 7f3ef9200700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ed4066760 0x7f3ed4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:18.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.140+0000 7f3ef9200700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ed4066760 0x7f3ed4068c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00090b0 tx=0x7f3ee0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.144+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ee8050e60 con 0x7f3ef406aaa0 2024-09-13T15:11:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:18.412+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7f3ef40b3040 con 0x7f3ef406aaa0 2024-09-13T15:11:19.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.092+0000 7f3ef1600700 1 -- 172.21.15.50:0/1346418667 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v230) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3ef40b3040 con 0x7f3ef406aaa0 2024-09-13T15:11:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ed4066760 msgr2=0x7f3ed4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ed4066760 0x7f3ed4068c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00090b0 tx=0x7f3ee0008030 comp rx=0 tx=0).stop 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 msgr2=0x7f3ef41f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef41f61f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c4e0 tx=0x7f3ee800c7f0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 shutdown_connections 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3ed4066760 0x7f3ed4068c20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef41610b0 0x7f3ef40ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3ef40b2670 0x7f3ef40acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 --2- 172.21.15.50:0/1346418667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef406aaa0 0x7f3ef41f61f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 >> 172.21.15.50:0/1346418667 conn(0x7f3ef40b0c40 msgr2=0x7f3ef40cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 shutdown_connections 2024-09-13T15:11:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.096+0000 7f3efb000700 1 -- 172.21.15.50:0/1346418667 wait complete. 2024-09-13T15:11:19.125 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-13T15:11:19.126 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-13T15:11:19.126 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T15:11:19.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.312+0000 7f8f30c00700 1 Processor -- start 2024-09-13T15:11:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.312+0000 7f8f30c00700 1 -- start start 2024-09-13T15:11:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f30c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f30c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0ad030 con 0x7f8f2c0667a0 2024-09-13T15:11:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f30c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0ad2d0 con 0x7f8f2c06a8d0 2024-09-13T15:11:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f30c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c06b680 con 0x7f8f2c146440 2024-09-13T15:11:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f2c0667a0 0x7f8f2c0ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50918/0 (socket says 172.21.15.50:50918) 2024-09-13T15:11:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2be00700 1 -- 172.21.15.50:0/1728447019 learned_addr learned my addr 172.21.15.50:0/1728447019 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2b400700 1 --2- 172.21.15.50:0/1728447019 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512677605 0 0) 0x7f8f2c0ad030 con 0x7f8f2c0667a0 2024-09-13T15:11:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f100035d0 con 0x7f8f2c0667a0 2024-09-13T15:11:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050027275 0 0) 0x7f8f2c0ad2d0 con 0x7f8f2c06a8d0 2024-09-13T15:11:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c0ad030 con 0x7f8f2c06a8d0 2024-09-13T15:11:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2b400700 1 -- 172.21.15.50:0/1728447019 >> v1:172.21.15.181:6789/0 conn(0x7f8f2c06a8d0 legacy=0x7f8f2c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2b400700 1 -- 172.21.15.50:0/1728447019 >> v1:172.21.15.50:6789/0 conn(0x7f8f2c0667a0 legacy=0x7f8f2c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2b400700 1 -- 172.21.15.50:0/1728447019 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c06ade0 con 0x7f8f2c146440 2024-09-13T15:11:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2b400700 1 --2- 172.21.15.50:0/1728447019 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c06a390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009880 tx=0x7f8f1c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe49774e9980874 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011830 con 0x7f8f2c146440 2024-09-13T15:11:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c011990 con 0x7f8f2c146440 2024-09-13T15:11:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.316+0000 7f8f2a000700 1 -- 172.21.15.50:0/1728447019 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011d20 con 0x7f8f2c146440 2024-09-13T15:11:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 -- 172.21.15.50:0/1728447019 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 msgr2=0x7f8f2c06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 --2- 172.21.15.50:0/1728447019 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c06a390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009880 tx=0x7f8f1c009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 -- 172.21.15.50:0/1728447019 shutdown_connections 2024-09-13T15:11:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 --2- 172.21.15.50:0/1728447019 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c06a390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 -- 172.21.15.50:0/1728447019 >> 172.21.15.50:0/1728447019 conn(0x7f8f2c06e660 msgr2=0x7f8f2c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 -- 172.21.15.50:0/1728447019 shutdown_connections 2024-09-13T15:11:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 -- 172.21.15.50:0/1728447019 wait complete. 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.320+0000 7f8f30c00700 1 Processor -- start 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 -- start start 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 0x7f8f2c0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c06a8d0 0x7f8f2c0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c14dc80 con 0x7f8f2c0667a0 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c14d320 con 0x7f8f2c06a8d0 2024-09-13T15:11:19.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f30c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c13a910 con 0x7f8f2c146440 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 0x7f8f2c0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 0x7f8f2c0afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59136/0 (socket says 172.21.15.50:59136) 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 -- 172.21.15.50:0/2528294948 learned_addr learned my addr 172.21.15.50:0/2528294948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 -- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 msgr2=0x7f8f2c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 -- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c06a8d0 msgr2=0x7f8f2c0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c06a8d0 0x7f8f2c0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 -- 172.21.15.50:0/2528294948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0094b0 con 0x7f8f2c0667a0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f2b400700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 0x7f8f2c0afea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0090b0 tx=0x7f8f1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.324+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0044d0 con 0x7f8f2c0667a0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.328+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c01e070 con 0x7f8f2c0667a0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.328+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c003900 con 0x7f8f2c0667a0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.328+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c14d5c0 con 0x7f8f2c0667a0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.328+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c0ad600 con 0x7f8f2c0667a0 2024-09-13T15:11:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.328+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c06a390 con 0x7f8f2c0667a0 2024-09-13T15:11:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.328+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f1c003a60 con 0x7f8f2c0667a0 2024-09-13T15:11:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.332+0000 7f8f23400700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f0c066730 0x7f8f0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.332+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8f1c084da0 con 0x7f8f2c0667a0 2024-09-13T15:11:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.332+0000 7f8f2aa00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f0c066730 0x7f8f0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.332+0000 7f8f2aa00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f0c066730 0x7f8f0c068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8f180010e0 tx=0x7f8f18007a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:19.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.340+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f1c052360 con 0x7f8f2c0667a0 2024-09-13T15:11:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.540+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f2c160450 con 0x7f8f2c0667a0 2024-09-13T15:11:19.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.540+0000 7f8f23400700 1 -- 172.21.15.50:0/2528294948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f8f1c055980 con 0x7f8f2c0667a0 2024-09-13T15:11:19.545 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:19.545 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:17.057835+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/1253018463":"2024-09-14T15:11:14.031755+0000","172.21.15.50:6834/1253018463":"2024-09-14T15:11:14.031755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:19.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f0c066730 msgr2=0x7f8f0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f0c066730 0x7f8f0c068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8f180010e0 tx=0x7f8f18007a00 comp rx=0 tx=0).stop 2024-09-13T15:11:19.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 msgr2=0x7f8f2c0afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 0x7f8f2c0afea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0090b0 tx=0x7f8f1c004770 comp rx=0 tx=0).stop 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 shutdown_connections 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f0c066730 0x7f8f0c068bf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8f2c146440 0x7f8f2c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c06a8d0 0x7f8f2c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 --2- 172.21.15.50:0/2528294948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c0667a0 0x7f8f2c0afea0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 >> 172.21.15.50:0/2528294948 conn(0x7f8f2c06e660 msgr2=0x7f8f2c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 shutdown_connections 2024-09-13T15:11:19.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.544+0000 7f8f30c00700 1 -- 172.21.15.50:0/2528294948 wait complete. 2024-09-13T15:11:19.570 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:19.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:19.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.752+0000 7f24ad800700 1 Processor -- start 2024-09-13T15:11:19.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.752+0000 7f24ad800700 1 -- start start 2024-09-13T15:11:19.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24ad800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a8164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24ad800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f24a806ed70 0x7f24a806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24ad800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80b3b50 con 0x7f24a8160f40 2024-09-13T15:11:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24ad800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a806f740 con 0x7f24a806ed70 2024-09-13T15:11:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24ad800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81656a0 con 0x7f24a8164b30 2024-09-13T15:11:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a6a00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f24a8160f40 0x7f24a8072430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:39080/0 (socket says 172.21.15.50:39080) 2024-09-13T15:11:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a6a00700 1 -- 172.21.15.50:0/4254535289 learned_addr learned my addr 172.21.15.50:0/4254535289 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a6000700 1 --2- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a8164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a7400700 1 --2- 172.21.15.50:0/4254535289 >> v2:172.21.15.181:3300/0 conn(0x7f24a806ed70 0x7f24a806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a5600700 1 -- 172.21.15.50:0/4254535289 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763150478 0 0) 0x7f24a80b3b50 con 0x7f24a8160f40 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a5600700 1 -- 172.21.15.50:0/4254535289 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c0035d0 con 0x7f24a8160f40 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a7400700 1 -- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 msgr2=0x7f24a8164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a7400700 1 --2- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a8164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a7400700 1 -- 172.21.15.50:0/4254535289 >> v1:172.21.15.181:6789/0 conn(0x7f24a8160f40 legacy=0x7f24a8072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a7400700 1 -- 172.21.15.50:0/4254535289 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8165980 con 0x7f24a806ed70 2024-09-13T15:11:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.756+0000 7f24a7400700 1 --2- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a806ed70 0x7f24a806f200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009d90 tx=0x7f24a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a72ae50d45c4062 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24a5600700 1 -- 172.21.15.50:0/4254535289 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000e070 con 0x7f24a806ed70 2024-09-13T15:11:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24a5600700 1 -- 172.21.15.50:0/4254535289 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000bb20 con 0x7f24a806ed70 2024-09-13T15:11:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24a5600700 1 -- 172.21.15.50:0/4254535289 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0012430 con 0x7f24a806ed70 2024-09-13T15:11:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 -- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a806ed70 msgr2=0x7f24a806f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 --2- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a806ed70 0x7f24a806f200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009d90 tx=0x7f24a000b330 comp rx=0 tx=0).stop 2024-09-13T15:11:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 -- 172.21.15.50:0/4254535289 shutdown_connections 2024-09-13T15:11:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 --2- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a806ed70 0x7f24a806f200 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 --2- 172.21.15.50:0/4254535289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a8164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 -- 172.21.15.50:0/4254535289 >> 172.21.15.50:0/4254535289 conn(0x7f24a80b1e10 msgr2=0x7f24a806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 -- 172.21.15.50:0/4254535289 shutdown_connections 2024-09-13T15:11:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.760+0000 7f24ad800700 1 -- 172.21.15.50:0/4254535289 wait complete. 2024-09-13T15:11:19.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 Processor -- start 2024-09-13T15:11:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 -- start start 2024-09-13T15:11:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 0x7f24a8162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a8160f40 0x7f24a80c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c6ce0 con 0x7f24a806ed70 2024-09-13T15:11:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c6850 con 0x7f24a8160f40 2024-09-13T15:11:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24ad800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c5970 con 0x7f24a8164b30 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 0x7f24a8162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 0x7f24a8162bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59152/0 (socket says 172.21.15.50:59152) 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 -- 172.21.15.50:0/3854332172 learned_addr learned my addr 172.21.15.50:0/3854332172 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6000700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a8160f40 0x7f24a80c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a7400700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 -- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 msgr2=0x7f24a814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 -- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a8160f40 msgr2=0x7f24a80c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a8160f40 0x7f24a80c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.764+0000 7f24a6a00700 1 -- 172.21.15.50:0/3854332172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009a70 con 0x7f24a806ed70 2024-09-13T15:11:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f24a6a00700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 0x7f24a8162bc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f249800c700 tx=0x7f249800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498005d90 con 0x7f24a806ed70 2024-09-13T15:11:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980070d0 con 0x7f24a806ed70 2024-09-13T15:11:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498007480 con 0x7f24a806ed70 2024-09-13T15:11:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a80c5c40 con 0x7f24a806ed70 2024-09-13T15:11:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80c6200 con 0x7f24a806ed70 2024-09-13T15:11:19.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.768+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80cc710 con 0x7f24a806ed70 2024-09-13T15:11:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.772+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24980075e0 con 0x7f24a806ed70 2024-09-13T15:11:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.772+0000 7f249ea00700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2488066730 0x7f2488068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.772+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2498083520 con 0x7f24a806ed70 2024-09-13T15:11:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.772+0000 7f24a6000700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2488066730 0x7f2488068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:19.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.776+0000 7f24a6000700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2488066730 0x7f2488068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f24a815f3d0 tx=0x7f2494009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.780+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2498050930 con 0x7f24a806ed70 2024-09-13T15:11:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.972+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24a806f200 con 0x7f24a806ed70 2024-09-13T15:11:19.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f249ea00700 1 -- 172.21.15.50:0/3854332172 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2498053f50 con 0x7f24a806ed70 2024-09-13T15:11:19.979 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:19.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2488066730 msgr2=0x7f2488068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2488066730 0x7f2488068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f24a815f3d0 tx=0x7f2494009240 comp rx=0 tx=0).stop 2024-09-13T15:11:19.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 msgr2=0x7f24a8162bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:19.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 0x7f24a8162bc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f249800c700 tx=0x7f249800ca10 comp rx=0 tx=0).stop 2024-09-13T15:11:19.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 shutdown_connections 2024-09-13T15:11:19.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2488066730 0x7f2488068bf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f24a8164b30 0x7f24a814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24a8160f40 0x7f24a80c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 --2- 172.21.15.50:0/3854332172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24a806ed70 0x7f24a8162bc0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:19.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 >> 172.21.15.50:0/3854332172 conn(0x7f24a80b1e10 msgr2=0x7f24a815ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:19.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.976+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 shutdown_connections 2024-09-13T15:11:19.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:19.980+0000 7f24ad800700 1 -- 172.21.15.50:0/3854332172 wait complete. 2024-09-13T15:11:20.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-13T15:11:20.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.188+0000 7f3b32800700 1 Processor -- start 2024-09-13T15:11:20.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.188+0000 7f3b32800700 1 -- start start 2024-09-13T15:11:20.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b32800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b2c1610b0 0x7f3b2c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:20.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b32800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b2c06aaa0 0x7f3b2c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:20.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b32800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0b3560 con 0x7f3b2c0b2670 2024-09-13T15:11:20.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b32800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c070b30 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b32800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c06b450 con 0x7f3b2c1610b0 2024-09-13T15:11:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b2c06aaa0 0x7f3b2c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b2c06aaa0 0x7f3b2c06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59154/0 (socket says 172.21.15.50:59154) 2024-09-13T15:11:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 -- 172.21.15.50:0/4274428728 learned_addr learned my addr 172.21.15.50:0/4274428728 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 -- 172.21.15.50:0/4274428728 >> v2:172.21.15.181:3300/0 conn(0x7f3b2c1610b0 msgr2=0x7f3b2c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:20.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b31400700 1 --2- 172.21.15.50:0/4274428728 >> v2:172.21.15.181:3300/0 conn(0x7f3b2c1610b0 0x7f3b2c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:20.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 --2- 172.21.15.50:0/4274428728 >> v2:172.21.15.181:3300/0 conn(0x7f3b2c1610b0 0x7f3b2c0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:20.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 -- 172.21.15.50:0/4274428728 >> v1:172.21.15.181:6789/0 conn(0x7f3b2c0b2670 legacy=0x7f3b2c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:20.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 -- 172.21.15.50:0/4274428728 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0b3280 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b31400700 1 --2- 172.21.15.50:0/4274428728 >> v2:172.21.15.181:3300/0 conn(0x7f3b2c1610b0 0x7f3b2c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:20.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b30a00700 1 --2- 172.21.15.50:0/4274428728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c06af10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009940 tx=0x7f3b18009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b844d70e7e0fc9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:20.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b2be00700 1 -- 172.21.15.50:0/4274428728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18004230 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b2be00700 1 -- 172.21.15.50:0/4274428728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18009e90 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.192+0000 7f3b2be00700 1 -- 172.21.15.50:0/4274428728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180045b0 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 -- 172.21.15.50:0/4274428728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 msgr2=0x7f3b2c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 --2- 172.21.15.50:0/4274428728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c06af10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009940 tx=0x7f3b18009c50 comp rx=0 tx=0).stop 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 -- 172.21.15.50:0/4274428728 shutdown_connections 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 --2- 172.21.15.50:0/4274428728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c06af10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 --2- 172.21.15.50:0/4274428728 >> v2:172.21.15.181:3300/0 conn(0x7f3b2c1610b0 0x7f3b2c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 -- 172.21.15.50:0/4274428728 >> 172.21.15.50:0/4274428728 conn(0x7f3b2c0b0c40 msgr2=0x7f3b2c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 -- 172.21.15.50:0/4274428728 shutdown_connections 2024-09-13T15:11:20.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 -- 172.21.15.50:0/4274428728 wait complete. 2024-09-13T15:11:20.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 Processor -- start 2024-09-13T15:11:20.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.196+0000 7f3b32800700 1 -- start start 2024-09-13T15:11:20.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b32800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c1f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b32800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b2c0b2670 0x7f3b2c0ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b32800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b2c1610b0 0x7f3b2c0ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b32800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0abaf0 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b32800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0a87d0 con 0x7f3b2c1610b0 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b32800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ad820 con 0x7f3b2c0b2670 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c1f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c1f9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59156/0 (socket says 172.21.15.50:59156) 2024-09-13T15:11:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 -- 172.21.15.50:0/3022576142 learned_addr learned my addr 172.21.15.50:0/3022576142 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:20.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b30a00700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b2c0b2670 0x7f3b2c0ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:20.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31e00700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b2c1610b0 0x7f3b2c0ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:20.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 -- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b2c0b2670 msgr2=0x7f3b2c0ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b2c0b2670 0x7f3b2c0ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 -- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b2c1610b0 msgr2=0x7f3b2c0ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b2c1610b0 0x7f3b2c0ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:20.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 -- 172.21.15.50:0/3022576142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18009570 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.200+0000 7f3b31400700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c1f9e70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000ce00 tx=0x7f3b2000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000f480 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2000f5e0 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000f970 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c1fa570 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c1fab30 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c0a8530 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.204+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b2000b040 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.208+0000 7f3b29600700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b0c066760 0x7f3b0c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.208+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3b200845d0 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.208+0000 7f3b30a00700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b0c066760 0x7f3b0c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.208+0000 7f3b30a00700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b0c066760 0x7f3b0c068c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3b18006fd0 tx=0x7f3b18008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.212+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b2c0a8530 con 0x7f3b2c06aaa0 2024-09-13T15:11:20.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:20.472+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7f3b2c0a8530 con 0x7f3b2c06aaa0 2024-09-13T15:11:21.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.104+0000 7f3b29600700 1 -- 172.21.15.50:0/3022576142 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v232) v1 ==== 148+0+0 (secure 0 0 0) 0x7f3b2c0a8530 con 0x7f3b2c06aaa0 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b0c066760 msgr2=0x7f3b0c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b0c066760 0x7f3b0c068c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3b18006fd0 tx=0x7f3b18008030 comp rx=0 tx=0).stop 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 msgr2=0x7f3b2c1f9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c1f9e70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000ce00 tx=0x7f3b2000a560 comp rx=0 tx=0).stop 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 shutdown_connections 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b0c066760 0x7f3b0c068c20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b2c1610b0 0x7f3b2c0ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b2c0b2670 0x7f3b2c0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 --2- 172.21.15.50:0/3022576142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b2c06aaa0 0x7f3b2c1f9e70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 >> 172.21.15.50:0/3022576142 conn(0x7f3b2c0b0c40 msgr2=0x7f3b2c1600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 shutdown_connections 2024-09-13T15:11:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.112+0000 7f3b32800700 1 -- 172.21.15.50:0/3022576142 wait complete. 2024-09-13T15:11:21.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T15:11:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1e00700 1 Processor -- start 2024-09-13T15:11:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1e00700 1 -- start start 2024-09-13T15:11:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0b3990 0x7f6fbc0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc0d03f0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc0cf7e0 con 0x7f6fbc0cd470 2024-09-13T15:11:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0cfac0 con 0x7f6fbc0b3990 2024-09-13T15:11:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fbc0b5c20 0x7f6fbc1644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50932/0 (socket says 172.21.15.50:50932) 2024-09-13T15:11:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc1400700 1 -- 172.21.15.50:0/3281171226 learned_addr learned my addr 172.21.15.50:0/3281171226 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.324+0000 7f6fc0a00700 1 --2- 172.21.15.50:0/3281171226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0b3990 0x7f6fbc0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc0a00700 1 -- 172.21.15.50:0/3281171226 >> v1:172.21.15.181:6789/0 conn(0x7f6fbc0cd470 legacy=0x7f6fbc0b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc0a00700 1 -- 172.21.15.50:0/3281171226 >> v1:172.21.15.50:6789/0 conn(0x7f6fbc0b5c20 legacy=0x7f6fbc1644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc0a00700 1 -- 172.21.15.50:0/3281171226 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0cfda0 con 0x7f6fbc0b3990 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc0a00700 1 --2- 172.21.15.50:0/3281171226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0b3990 0x7f6fbc0b56e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009880 tx=0x7f6fb0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261718ea546d9c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fbb400700 1 -- 172.21.15.50:0/3281171226 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0011830 con 0x7f6fbc0b3990 2024-09-13T15:11:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fbb400700 1 -- 172.21.15.50:0/3281171226 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0011990 con 0x7f6fbc0b3990 2024-09-13T15:11:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fbb400700 1 -- 172.21.15.50:0/3281171226 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0011d20 con 0x7f6fbc0b3990 2024-09-13T15:11:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 -- 172.21.15.50:0/3281171226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0b3990 msgr2=0x7f6fbc0b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/3281171226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0b3990 0x7f6fbc0b56e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009880 tx=0x7f6fb0009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 -- 172.21.15.50:0/3281171226 shutdown_connections 2024-09-13T15:11:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/3281171226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0b3990 0x7f6fbc0b56e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 -- 172.21.15.50:0/3281171226 >> 172.21.15.50:0/3281171226 conn(0x7f6fbc0b2690 msgr2=0x7f6fbc0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 -- 172.21.15.50:0/3281171226 shutdown_connections 2024-09-13T15:11:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.328+0000 7f6fc1e00700 1 -- 172.21.15.50:0/3281171226 wait complete. 2024-09-13T15:11:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 Processor -- start 2024-09-13T15:11:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 -- start start 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b3990 0x7f6fbc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 0x7f6fbc136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0cd470 0x7f6fbc137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc13dae0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc13dd30 con 0x7f6fbc0b3990 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fc1e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc13e010 con 0x7f6fbc0cd470 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.332+0000 7f6fbbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 0x7f6fbc136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 0x7f6fbc136bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59168/0 (socket says 172.21.15.50:59168) 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 -- 172.21.15.50:0/663823781 learned_addr learned my addr 172.21.15.50:0/663823781 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fc1400700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0cd470 0x7f6fbc137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fc0a00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b3990 0x7f6fbc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 -- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0cd470 msgr2=0x7f6fbc137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0cd470 0x7f6fbc137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 -- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b3990 msgr2=0x7f6fbc159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b3990 0x7f6fbc159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 -- 172.21.15.50:0/663823781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00094b0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fc1400700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0cd470 0x7f6fbc137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:21.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fbbe00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 0x7f6fbc136bd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c500 tx=0x7f6fa800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80052d0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8005450 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80038e0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc13b060 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc15a160 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.336+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc13aec0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.340+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fa8003a40 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.340+0000 7f6fb8c00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f9c066730 0x7f6f9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.344+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6fa8083290 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.344+0000 7f6fc0a00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f9c066730 0x7f6f9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.344+0000 7f6fc0a00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f9c066730 0x7f6f9c068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00090b0 tx=0x7f6fb001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.348+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fbc13aec0 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.528+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6fbc13b580 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.536+0000 7f6fb8c00700 1 -- 172.21.15.50:0/663823781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6fbc13b580 con 0x7f6fbc0b5c20 2024-09-13T15:11:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f9c066730 msgr2=0x7f6f9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f9c066730 0x7f6f9c068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00090b0 tx=0x7f6fb001c040 comp rx=0 tx=0).stop 2024-09-13T15:11:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 msgr2=0x7f6fbc136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 0x7f6fbc136bd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c500 tx=0x7f6fa800c810 comp rx=0 tx=0).stop 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 shutdown_connections 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6f9c066730 0x7f6f9c068bf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fbc0cd470 0x7f6fbc137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fbc0b5c20 0x7f6fbc136bd0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 --2- 172.21.15.50:0/663823781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fbc0b3990 0x7f6fbc159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 >> 172.21.15.50:0/663823781 conn(0x7f6fbc0b2690 msgr2=0x7f6fbc15aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 shutdown_connections 2024-09-13T15:11:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.540+0000 7f6fc1e00700 1 -- 172.21.15.50:0/663823781 wait complete. 2024-09-13T15:11:21.566 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:11:21.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:21.605 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:21.646 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:11:21.647 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:21.647 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:21.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:21.667 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:21.667 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:21.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:21.706 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:21.706 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:21.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:21.729 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:21.729 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:21.766 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:21.767 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T15:11:21.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:21.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.944+0000 7fd6a1600700 1 Processor -- start 2024-09-13T15:11:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.944+0000 7fd6a1600700 1 -- start start 2024-09-13T15:11:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd6a1600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd69c0ce4c0 0x7fd69c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd6a1600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd6a1600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0ad480 con 0x7fd69c1573b0 2024-09-13T15:11:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd6a1600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c06afa0 con 0x7fd69c0ce4c0 2024-09-13T15:11:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd6a1600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c157790 con 0x7fd69c06ab10 2024-09-13T15:11:21.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd69aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd69c1573b0 0x7fd69c0cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50944/0 (socket says 172.21.15.50:50944) 2024-09-13T15:11:21.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd69aa00700 1 -- 172.21.15.50:0/1806632455 learned_addr learned my addr 172.21.15.50:0/1806632455 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:21.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd69a000700 1 --2- 172.21.15.50:0/1806632455 >> v2:172.21.15.50:3300/0 conn(0x7fd69c0ce4c0 0x7fd69c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd69b400700 1 --2- 172.21.15.50:0/1806632455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd699600700 1 -- 172.21.15.50:0/1806632455 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404058585 0 0) 0x7fd69c0ad480 con 0x7fd69c1573b0 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd699600700 1 -- 172.21.15.50:0/1806632455 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6800035d0 con 0x7fd69c1573b0 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd69a000700 1 -- 172.21.15.50:0/1806632455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 msgr2=0x7fd69c06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.948+0000 7fd69a000700 1 --2- 172.21.15.50:0/1806632455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c06ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd69a000700 1 -- 172.21.15.50:0/1806632455 >> v1:172.21.15.50:6789/0 conn(0x7fd69c1573b0 legacy=0x7fd69c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd69a000700 1 -- 172.21.15.50:0/1806632455 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0ad6d0 con 0x7fd69c0ce4c0 2024-09-13T15:11:21.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd69a000700 1 --2- 172.21.15.50:0/1806632455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c0ce4c0 0x7fd69c06a5d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd688009850 tx=0x7fd688009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aa2d41b65b3ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd699600700 1 -- 172.21.15.50:0/1806632455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011830 con 0x7fd69c0ce4c0 2024-09-13T15:11:21.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd699600700 1 -- 172.21.15.50:0/1806632455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688011990 con 0x7fd69c0ce4c0 2024-09-13T15:11:21.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd699600700 1 -- 172.21.15.50:0/1806632455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011d00 con 0x7fd69c0ce4c0 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 -- 172.21.15.50:0/1806632455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c0ce4c0 msgr2=0x7fd69c06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 --2- 172.21.15.50:0/1806632455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c0ce4c0 0x7fd69c06a5d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd688009850 tx=0x7fd688009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 -- 172.21.15.50:0/1806632455 shutdown_connections 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 --2- 172.21.15.50:0/1806632455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 --2- 172.21.15.50:0/1806632455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c0ce4c0 0x7fd69c06a5d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 -- 172.21.15.50:0/1806632455 >> 172.21.15.50:0/1806632455 conn(0x7fd69c0b08d0 msgr2=0x7fd69c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 -- 172.21.15.50:0/1806632455 shutdown_connections 2024-09-13T15:11:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.952+0000 7fd6a1600700 1 -- 172.21.15.50:0/1806632455 wait complete. 2024-09-13T15:11:21.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.956+0000 7fd6a1600700 1 Processor -- start 2024-09-13T15:11:21.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.956+0000 7fd6a1600700 1 -- start start 2024-09-13T15:11:21.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 0x7fd69c14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd69c1e70e0 0x7fd69c1e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c14d820 con 0x7fd69c1573b0 2024-09-13T15:11:21.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0b3b60 con 0x7fd69c1e70e0 2024-09-13T15:11:21.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c14ad60 con 0x7fd69c06ab10 2024-09-13T15:11:21.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 0x7fd69c14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 0x7fd69c14a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59182/0 (socket says 172.21.15.50:59182) 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 -- 172.21.15.50:0/4110711141 learned_addr learned my addr 172.21.15.50:0/4110711141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69aa00700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69b400700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd69c1e70e0 0x7fd69c1e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 -- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 msgr2=0x7fd69c0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 -- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd69c1e70e0 msgr2=0x7fd69c1e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd69c1e70e0 0x7fd69c1e7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 -- 172.21.15.50:0/4110711141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880094b0 con 0x7fd69c1573b0 2024-09-13T15:11:21.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd69a000700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 0x7fd69c14a820 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd688013000 tx=0x7fd688004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880044d0 con 0x7fd69c1573b0 2024-09-13T15:11:21.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68801f070 con 0x7fd69c1573b0 2024-09-13T15:11:21.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c1e7610 con 0x7fd69c1573b0 2024-09-13T15:11:21.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688003900 con 0x7fd69c1573b0 2024-09-13T15:11:21.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.960+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c14f450 con 0x7fd69c1573b0 2024-09-13T15:11:21.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.964+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c06a5d0 con 0x7fd69c1573b0 2024-09-13T15:11:21.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.964+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd688003a60 con 0x7fd69c1573b0 2024-09-13T15:11:21.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.968+0000 7fd692a00700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd67c066760 0x7fd67c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.968+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd688021070 con 0x7fd69c1573b0 2024-09-13T15:11:21.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.968+0000 7fd69aa00700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd67c066760 0x7fd67c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.968+0000 7fd69aa00700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd67c066760 0x7fd67c068c20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd68c007fd0 tx=0x7fd68c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:21.972+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd688052c90 con 0x7fd69c1573b0 2024-09-13T15:11:22.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.204+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd69c1e8340 con 0x7fd69c1573b0 2024-09-13T15:11:22.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.208+0000 7fd692a00700 1 -- 172.21.15.50:0/4110711141 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fd688015de0 con 0x7fd69c1573b0 2024-09-13T15:11:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:22.210 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1702251874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":1702251874},{"type":"v1","addr":"172.21.15.181:6837","nonce":1702251874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/3568512168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3568512168},{"type":"v1","addr":"172.21.15.181:6836","nonce":3568512168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6516,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2393630483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2393630483},{"type":"v1","addr":"172.21.15.50:6833","nonce":2393630483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1369737929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1369737929},{"type":"v1","addr":"172.21.15.50:6835","nonce":1369737929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2024-09-13T15:11:22.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd67c066760 msgr2=0x7fd67c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:22.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd67c066760 0x7fd67c068c20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd68c007fd0 tx=0x7fd68c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:22.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 msgr2=0x7fd69c14a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:22.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 0x7fd69c14a820 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd688013000 tx=0x7fd688004770 comp rx=0 tx=0).stop 2024-09-13T15:11:22.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 shutdown_connections 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd67c066760 0x7fd67c068c20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd69c1e70e0 0x7fd69c1e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd69c1573b0 0x7fd69c14a820 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 --2- 172.21.15.50:0/4110711141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd69c06ab10 0x7fd69c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 >> 172.21.15.50:0/4110711141 conn(0x7fd69c0b08d0 msgr2=0x7fd69c0ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 shutdown_connections 2024-09-13T15:11:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.212+0000 7fd6a1600700 1 -- 172.21.15.50:0/4110711141 wait complete. 2024-09-13T15:11:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 41 2024-09-13T15:11:22.239 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:11:22.239 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T15:11:22.240 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:11:22.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:22.240 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:11:22.240 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T15:11:22.240 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:11:22.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:22.240 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:11:22.241 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T15:11:22.241 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:11:22.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:22.241 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:11:22.241 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T15:11:22.241 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:11:22.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:22.268 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:11:22.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:11:22.269 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:11:22.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:11:22.270 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:11:22.270 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:11:22.272 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:11:22.272 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:11:22.315 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:11:22.315 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:22.316 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:11:22.317 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:22.319 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:11:22.319 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:22.320 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:11:22.320 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:22.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T15:11:22.432 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:11:22.433 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:11:22.435 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:11:22.441 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:11:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 Processor -- start 2024-09-13T15:11:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 -- start start 2024-09-13T15:11:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b415d310 0x7f94b40b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94b415e9f0 0x7f94b415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b415e560 con 0x7f94b406aaa0 2024-09-13T15:11:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40b3ec0 con 0x7f94b415d310 2024-09-13T15:11:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.480+0000 7f94baa00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40adf90 con 0x7f94b415e9f0 2024-09-13T15:11:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b415d310 0x7f94b40b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b415d310 0x7f94b40b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59226/0 (socket says 172.21.15.50:59226) 2024-09-13T15:11:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 -- 172.21.15.50:0/2864261623 learned_addr learned my addr 172.21.15.50:0/2864261623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94ba000700 1 --2- 172.21.15.50:0/2864261623 >> v2:172.21.15.181:3300/0 conn(0x7f94b415e9f0 0x7f94b415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 -- 172.21.15.50:0/2864261623 >> v2:172.21.15.181:3300/0 conn(0x7f94b415e9f0 msgr2=0x7f94b415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 --2- 172.21.15.50:0/2864261623 >> v2:172.21.15.181:3300/0 conn(0x7f94b415e9f0 0x7f94b415ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 -- 172.21.15.50:0/2864261623 >> v1:172.21.15.181:6789/0 conn(0x7f94b406aaa0 legacy=0x7f94b406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 -- 172.21.15.50:0/2864261623 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b415d920 con 0x7f94b415d310 2024-09-13T15:11:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b8c00700 1 --2- 172.21.15.50:0/2864261623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b40b3980 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f94b40b2960 tx=0x7f94a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da44c5a9c90a9185 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b3e00700 1 -- 172.21.15.50:0/2864261623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011830 con 0x7f94b415d310 2024-09-13T15:11:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b3e00700 1 -- 172.21.15.50:0/2864261623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0011990 con 0x7f94b415d310 2024-09-13T15:11:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94b3e00700 1 -- 172.21.15.50:0/2864261623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011d20 con 0x7f94b415d310 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94baa00700 1 -- 172.21.15.50:0/2864261623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 msgr2=0x7f94b40b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.484+0000 7f94baa00700 1 --2- 172.21.15.50:0/2864261623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b40b3980 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f94b40b2960 tx=0x7f94a0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 -- 172.21.15.50:0/2864261623 shutdown_connections 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 --2- 172.21.15.50:0/2864261623 >> v2:172.21.15.181:3300/0 conn(0x7f94b415e9f0 0x7f94b415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 --2- 172.21.15.50:0/2864261623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b40b3980 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 -- 172.21.15.50:0/2864261623 >> 172.21.15.50:0/2864261623 conn(0x7f94b40b0c40 msgr2=0x7f94b406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 -- 172.21.15.50:0/2864261623 shutdown_connections 2024-09-13T15:11:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 -- 172.21.15.50:0/2864261623 wait complete. 2024-09-13T15:11:22.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 Processor -- start 2024-09-13T15:11:22.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.488+0000 7f94baa00700 1 -- start start 2024-09-13T15:11:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94baa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94b406aaa0 0x7f94b413b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94baa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b41f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94baa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94b415e9f0 0x7f94b4141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94baa00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41f2f70 con 0x7f94b415d310 2024-09-13T15:11:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94baa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40afbf0 con 0x7f94b415e9f0 2024-09-13T15:11:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94baa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41448f0 con 0x7f94b406aaa0 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b41f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b41f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59236/0 (socket says 172.21.15.50:59236) 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 -- 172.21.15.50:0/2070500368 learned_addr learned my addr 172.21.15.50:0/2070500368 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94ba000700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94b415e9f0 0x7f94b4141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b9600700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94b406aaa0 0x7f94b413b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 -- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94b406aaa0 msgr2=0x7f94b413b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94b406aaa0 0x7f94b413b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 -- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94b415e9f0 msgr2=0x7f94b4141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94b415e9f0 0x7f94b4141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 -- 172.21.15.50:0/2070500368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0009570 con 0x7f94b415d310 2024-09-13T15:11:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b8c00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b41f2a30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009c30 tx=0x7f94a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.492+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0004240 con 0x7f94b415d310 2024-09-13T15:11:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.496+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a001f070 con 0x7f94b415d310 2024-09-13T15:11:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.496+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b4144bd0 con 0x7f94b415d310 2024-09-13T15:11:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.496+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a00045c0 con 0x7f94b415d310 2024-09-13T15:11:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.496+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b4145190 con 0x7f94b415d310 2024-09-13T15:11:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.496+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b41453b0 con 0x7f94b415d310 2024-09-13T15:11:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.496+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94a0021030 con 0x7f94b415d310 2024-09-13T15:11:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.500+0000 7f94b1600700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9494066730 0x7f9494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.500+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f94a0085730 con 0x7f94b415d310 2024-09-13T15:11:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.500+0000 7f94b9600700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9494066730 0x7f9494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.500+0000 7f94b9600700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9494066730 0x7f9494068bf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f94a80012e0 tx=0x7f94a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.500+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94a0052c50 con 0x7f94b415d310 2024-09-13T15:11:22.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:22.696+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f94b40b3980 con 0x7f94b415d310 2024-09-13T15:11:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.544+0000 7f94b1600700 1 -- 172.21.15.50:0/2070500368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7f94a0056270 con 0x7f94b415d310 2024-09-13T15:11:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9494066730 msgr2=0x7f9494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9494066730 0x7f9494068bf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f94a80012e0 tx=0x7f94a8009040 comp rx=0 tx=0).stop 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 msgr2=0x7f94b41f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b41f2a30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009c30 tx=0x7f94a0004770 comp rx=0 tx=0).stop 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 shutdown_connections 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9494066730 0x7f9494068bf0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94b415e9f0 0x7f94b4141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b415d310 0x7f94b41f2a30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 --2- 172.21.15.50:0/2070500368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94b406aaa0 0x7f94b413b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 >> 172.21.15.50:0/2070500368 conn(0x7f94b40b0c40 msgr2=0x7f94b406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 shutdown_connections 2024-09-13T15:11:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.548+0000 7f94baa00700 1 -- 172.21.15.50:0/2070500368 wait complete. 2024-09-13T15:11:23.553 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-13T15:11:23.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T15:11:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.756+0000 7f8c13e00700 1 Processor -- start 2024-09-13T15:11:23.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.756+0000 7f8c13e00700 1 -- start start 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c13e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c141610b0 0x7f8c140719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1406aaa0 0x7f8c1406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c13e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c140b3560 con 0x7f8c140b2670 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c13e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c14070b30 con 0x7f8c141610b0 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c13e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1406b420 con 0x7f8c1406aaa0 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c141610b0 0x7f8c140719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c141610b0 0x7f8c140719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39942/0 (socket says 172.21.15.50:39942) 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 -- 172.21.15.50:0/3652825657 learned_addr learned my addr 172.21.15.50:0/3652825657 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c0be00700 1 --2- 172.21.15.50:0/3652825657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1406aaa0 0x7f8c1406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12000700 1 -- 172.21.15.50:0/3652825657 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093896610 0 0) 0x7f8c140b3560 con 0x7f8c140b2670 2024-09-13T15:11:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12000700 1 -- 172.21.15.50:0/3652825657 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf80035d0 con 0x7f8c140b2670 2024-09-13T15:11:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 -- 172.21.15.50:0/3652825657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1406aaa0 msgr2=0x7f8c1406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 --2- 172.21.15.50:0/3652825657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1406aaa0 0x7f8c1406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 -- 172.21.15.50:0/3652825657 >> v1:172.21.15.181:6789/0 conn(0x7f8c140b2670 legacy=0x7f8c140cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 -- 172.21.15.50:0/3652825657 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c140b3280 con 0x7f8c141610b0 2024-09-13T15:11:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12a00700 1 --2- 172.21.15.50:0/3652825657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141610b0 0x7f8c140719c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009910 tx=0x7f8c04009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941d8fb3f1170981 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12000700 1 -- 172.21.15.50:0/3652825657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04011830 con 0x7f8c141610b0 2024-09-13T15:11:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12000700 1 -- 172.21.15.50:0/3652825657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04011990 con 0x7f8c141610b0 2024-09-13T15:11:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.760+0000 7f8c12000700 1 -- 172.21.15.50:0/3652825657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04011d40 con 0x7f8c141610b0 2024-09-13T15:11:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 -- 172.21.15.50:0/3652825657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141610b0 msgr2=0x7f8c140719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 --2- 172.21.15.50:0/3652825657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141610b0 0x7f8c140719c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009910 tx=0x7f8c04009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 -- 172.21.15.50:0/3652825657 shutdown_connections 2024-09-13T15:11:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 --2- 172.21.15.50:0/3652825657 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c1406aaa0 0x7f8c1406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 --2- 172.21.15.50:0/3652825657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141610b0 0x7f8c140719c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 -- 172.21.15.50:0/3652825657 >> 172.21.15.50:0/3652825657 conn(0x7f8c140b0c40 msgr2=0x7f8c1406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 -- 172.21.15.50:0/3652825657 shutdown_connections 2024-09-13T15:11:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.764+0000 7f8c13e00700 1 -- 172.21.15.50:0/3652825657 wait complete. 2024-09-13T15:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 Processor -- start 2024-09-13T15:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 -- start start 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 0x7f8c141f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c140b2670 0x7f8c14161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c141610b0 0x7f8c14159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14158310 con 0x7f8c1406aaa0 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141f4580 con 0x7f8c141610b0 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14159b00 con 0x7f8c140b2670 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 0x7f8c141f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 0x7f8c141f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39952/0 (socket says 172.21.15.50:39952) 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 -- 172.21.15.50:0/409163658 learned_addr learned my addr 172.21.15.50:0/409163658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c0be00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c140b2670 0x7f8c14161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c13400700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c141610b0 0x7f8c14159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 -- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c140b2670 msgr2=0x7f8c14161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c140b2670 0x7f8c14161c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 -- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c141610b0 msgr2=0x7f8c14159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c141610b0 0x7f8c14159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.768+0000 7f8c12a00700 1 -- 172.21.15.50:0/409163658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04009570 con 0x7f8c1406aaa0 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c12a00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 0x7f8c141f4040 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8c04000c00 tx=0x7f8c04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04004510 con 0x7f8c1406aaa0 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1415a050 con 0x7f8c1406aaa0 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0401e070 con 0x7f8c1406aaa0 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04003900 con 0x7f8c1406aaa0 2024-09-13T15:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1415a610 con 0x7f8c1406aaa0 2024-09-13T15:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.772+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c14161490 con 0x7f8c1406aaa0 2024-09-13T15:11:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.776+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c04003a60 con 0x7f8c1406aaa0 2024-09-13T15:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.776+0000 7f8c0b400700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bf0066730 0x7f8bf0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.776+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8c04084ed0 con 0x7f8c1406aaa0 2024-09-13T15:11:23.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.776+0000 7f8c0be00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bf0066730 0x7f8bf0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.780+0000 7f8c0be00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bf0066730 0x7f8bf0068bf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c140adc60 tx=0x7f8bfc009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:23.784+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c04052480 con 0x7f8c1406aaa0 2024-09-13T15:11:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.036+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8c14071b50 con 0x7f8c1406aaa0 2024-09-13T15:11:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.036+0000 7f8c0b400700 1 -- 172.21.15.50:0/409163658 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8c04055aa0 con 0x7f8c1406aaa0 2024-09-13T15:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w==", 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ==", 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw==", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ==", 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw==", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw==", 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-13T15:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g==", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg==", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg==", 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw==", 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA==", 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g==", 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg==", 2024-09-13T15:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A==", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw==", 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g==", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORmfQGsHhAAoWi5rerqSyo7H67168RTZw==", 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg==", 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w==", 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:11:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bf0066730 msgr2=0x7f8bf0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bf0066730 0x7f8bf0068bf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c140adc60 tx=0x7f8bfc009240 comp rx=0 tx=0).stop 2024-09-13T15:11:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 msgr2=0x7f8c141f4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 0x7f8c141f4040 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8c04000c00 tx=0x7f8c04004770 comp rx=0 tx=0).stop 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 shutdown_connections 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8bf0066730 0x7f8bf0068bf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c141610b0 0x7f8c14159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c140b2670 0x7f8c14161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 --2- 172.21.15.50:0/409163658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c1406aaa0 0x7f8c141f4040 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 >> 172.21.15.50:0/409163658 conn(0x7f8c140b0c40 msgr2=0x7f8c140cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 shutdown_connections 2024-09-13T15:11:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.040+0000 7f8c13e00700 1 -- 172.21.15.50:0/409163658 wait complete. 2024-09-13T15:11:24.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:24.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.240+0000 7fa34f000700 1 Processor -- start 2024-09-13T15:11:24.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.240+0000 7fa34f000700 1 -- start start 2024-09-13T15:11:24.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34f000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3480667a0 0x7fa3480b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34f000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3480ae200 0x7fa3480ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34f000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34815d0a0 con 0x7fa34815ccc0 2024-09-13T15:11:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34f000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3480aebd0 con 0x7fa3480667a0 2024-09-13T15:11:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34f000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480aede0 con 0x7fa3480ae200 2024-09-13T15:11:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3480667a0 0x7fa3480b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3480667a0 0x7fa3480b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39964/0 (socket says 172.21.15.50:39964) 2024-09-13T15:11:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 -- 172.21.15.50:0/59535364 learned_addr learned my addr 172.21.15.50:0/59535364 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:24.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34e600700 1 --2- 172.21.15.50:0/59535364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3480ae200 0x7fa3480ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 -- 172.21.15.50:0/59535364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3480ae200 msgr2=0x7fa3480ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:24.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 --2- 172.21.15.50:0/59535364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3480ae200 0x7fa3480ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 -- 172.21.15.50:0/59535364 >> v1:172.21.15.181:6789/0 conn(0x7fa34815ccc0 legacy=0x7fa348066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 -- 172.21.15.50:0/59535364 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480b3ae0 con 0x7fa3480667a0 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa34d200700 1 --2- 172.21.15.50:0/59535364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480667a0 0x7fa3480b48a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa334009910 tx=0x7fa334009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280f6ba178896d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa347e00700 1 -- 172.21.15.50:0/59535364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334011830 con 0x7fa3480667a0 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa347e00700 1 -- 172.21.15.50:0/59535364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334011990 con 0x7fa3480667a0 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.244+0000 7fa347e00700 1 -- 172.21.15.50:0/59535364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334011d40 con 0x7fa3480667a0 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 -- 172.21.15.50:0/59535364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480667a0 msgr2=0x7fa3480b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 --2- 172.21.15.50:0/59535364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480667a0 0x7fa3480b48a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa334009910 tx=0x7fa334009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 -- 172.21.15.50:0/59535364 shutdown_connections 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 --2- 172.21.15.50:0/59535364 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa3480ae200 0x7fa3480ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 --2- 172.21.15.50:0/59535364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480667a0 0x7fa3480b48a0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 -- 172.21.15.50:0/59535364 >> 172.21.15.50:0/59535364 conn(0x7fa34806c8e0 msgr2=0x7fa34806ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 -- 172.21.15.50:0/59535364 shutdown_connections 2024-09-13T15:11:24.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 -- 172.21.15.50:0/59535364 wait complete. 2024-09-13T15:11:24.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 Processor -- start 2024-09-13T15:11:24.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.248+0000 7fa34f000700 1 -- start start 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480667a0 0x7fa348147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 0x7fa3481564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa34815ccc0 0x7fa3481528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815ec10 con 0x7fa3480ae200 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481571a0 con 0x7fa3480667a0 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815e600 con 0x7fa34815ccc0 2024-09-13T15:11:24.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 0x7fa3481564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 0x7fa3481564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39966/0 (socket says 172.21.15.50:39966) 2024-09-13T15:11:24.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 -- 172.21.15.50:0/550787684 learned_addr learned my addr 172.21.15.50:0/550787684 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34e600700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa34815ccc0 0x7fa3481528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34dc00700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480667a0 0x7fa348147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 -- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa34815ccc0 msgr2=0x7fa3481528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa34815ccc0 0x7fa3481528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 -- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480667a0 msgr2=0x7fa348147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480667a0 0x7fa348147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 -- 172.21.15.50:0/550787684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009570 con 0x7fa3480ae200 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34dc00700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480667a0 0x7fa348147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:24.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34d200700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 0x7fa3481564e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa334000c00 tx=0x7fa334004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334004590 con 0x7fa3480ae200 2024-09-13T15:11:24.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3340036c0 con 0x7fa3480ae200 2024-09-13T15:11:24.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa348156ec0 con 0x7fa3480ae200 2024-09-13T15:11:24.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334003a70 con 0x7fa3480ae200 2024-09-13T15:11:24.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.252+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa348147a60 con 0x7fa3480ae200 2024-09-13T15:11:24.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.256+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34815edc0 con 0x7fa3480ae200 2024-09-13T15:11:24.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.256+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa334003bd0 con 0x7fa3480ae200 2024-09-13T15:11:24.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.256+0000 7fa345600700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa328066730 0x7fa328068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.256+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa334021030 con 0x7fa3480ae200 2024-09-13T15:11:24.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.260+0000 7fa34dc00700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa328066730 0x7fa328068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.260+0000 7fa34dc00700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa328066730 0x7fa328068bf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa33c000f60 tx=0x7fa33c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.264+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa334052b80 con 0x7fa3480ae200 2024-09-13T15:11:24.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.456+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3480b3520 con 0x7fa3480ae200 2024-09-13T15:11:24.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.456+0000 7fa345600700 1 -- 172.21.15.50:0/550787684 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+13051 (secure 0 0 0) 0x7fa334015090 con 0x7fa3480ae200 2024-09-13T15:11:24.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:24.462 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:23.538126+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa328066730 msgr2=0x7fa328068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa328066730 0x7fa328068bf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa33c000f60 tx=0x7fa33c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 msgr2=0x7fa3481564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 0x7fa3481564e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa334000c00 tx=0x7fa334004770 comp rx=0 tx=0).stop 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 shutdown_connections 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa328066730 0x7fa328068bf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa34815ccc0 0x7fa3481528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3480ae200 0x7fa3481564e0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 --2- 172.21.15.50:0/550787684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3480667a0 0x7fa348147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 >> 172.21.15.50:0/550787684 conn(0x7fa34806c8e0 msgr2=0x7fa3480ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 shutdown_connections 2024-09-13T15:11:24.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.460+0000 7fa34f000700 1 -- 172.21.15.50:0/550787684 wait complete. 2024-09-13T15:11:24.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:24.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 Processor -- start 2024-09-13T15:11:24.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 -- start start 2024-09-13T15:11:24.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9f88143b60 0x7f9f880d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 0x7f9f880cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f880d0780 con 0x7f9f8815e720 2024-09-13T15:11:24.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8815f710 con 0x7f9f88143b60 2024-09-13T15:11:24.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.668+0000 7f9f8f000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880d19e0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 0x7f9f880cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f8d000700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9f8815e720 0x7f9f8815ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52966/0 (socket says 172.21.15.50:52966) 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f8d000700 1 -- 172.21.15.50:0/2301370342 learned_addr learned my addr 172.21.15.50:0/2301370342 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 0x7f9f880cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:52812/0 (socket says 172.21.15.50:52812) 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f87e00700 1 --2- 172.21.15.50:0/2301370342 >> v2:172.21.15.181:3300/0 conn(0x7f9f88143b60 0x7f9f880d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f87400700 1 -- 172.21.15.50:0/2301370342 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057705971 0 0) 0x7f9f80001490 con 0x7f9f8815e720 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 -- 172.21.15.50:0/2301370342 >> v2:172.21.15.181:3300/0 conn(0x7f9f88143b60 msgr2=0x7f9f880d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 --2- 172.21.15.50:0/2301370342 >> v2:172.21.15.181:3300/0 conn(0x7f9f88143b60 0x7f9f880d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 -- 172.21.15.50:0/2301370342 >> v1:172.21.15.181:6789/0 conn(0x7f9f8815e720 legacy=0x7f9f8815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 -- 172.21.15.50:0/2301370342 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880cfd30 con 0x7f9f880cf3b0 2024-09-13T15:11:24.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f7fe00700 1 --2- 172.21.15.50:0/2301370342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 0x7f9f880cf7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009850 tx=0x7f9f70009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c799c90b6473cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f87400700 1 -- 172.21.15.50:0/2301370342 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70011830 con 0x7f9f880cf3b0 2024-09-13T15:11:24.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f87400700 1 -- 172.21.15.50:0/2301370342 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70011990 con 0x7f9f880cf3b0 2024-09-13T15:11:24.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.672+0000 7f9f87400700 1 -- 172.21.15.50:0/2301370342 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70011d40 con 0x7f9f880cf3b0 2024-09-13T15:11:24.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 -- 172.21.15.50:0/2301370342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 msgr2=0x7f9f880cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2301370342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 0x7f9f880cf7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009850 tx=0x7f9f70009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:24.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 -- 172.21.15.50:0/2301370342 shutdown_connections 2024-09-13T15:11:24.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2301370342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f880cf3b0 0x7f9f880cf7f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2301370342 >> v2:172.21.15.181:3300/0 conn(0x7f9f88143b60 0x7f9f880d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 -- 172.21.15.50:0/2301370342 >> 172.21.15.50:0/2301370342 conn(0x7f9f8806e660 msgr2=0x7f9f8806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 -- 172.21.15.50:0/2301370342 shutdown_connections 2024-09-13T15:11:24.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.676+0000 7f9f8f000700 1 -- 172.21.15.50:0/2301370342 wait complete. 2024-09-13T15:11:24.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 Processor -- start 2024-09-13T15:11:24.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 -- start start 2024-09-13T15:11:24.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 0x7f9f880aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f88143b60 0x7f9f8815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f8815e720 0x7f9f880adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880abeb0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880ab8d0 con 0x7f9f88143b60 2024-09-13T15:11:24.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8f000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880aa900 con 0x7f9f8815e720 2024-09-13T15:11:24.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f87e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 0x7f9f880aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f87e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 0x7f9f880aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39970/0 (socket says 172.21.15.50:39970) 2024-09-13T15:11:24.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f87e00700 1 -- 172.21.15.50:0/2627171103 learned_addr learned my addr 172.21.15.50:0/2627171103 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f7fe00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f88143b60 0x7f9f8815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.680+0000 7f9f8d000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f8815e720 0x7f9f880adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f87e00700 1 -- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f8815e720 msgr2=0x7f9f880adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f87e00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f8815e720 0x7f9f880adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f87e00700 1 -- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f88143b60 msgr2=0x7f9f8815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f87e00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f88143b60 0x7f9f8815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f87e00700 1 -- 172.21.15.50:0/2627171103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700094b0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f87e00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 0x7f9f880aa3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e870 tx=0x7f9f7800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780095a0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f78013680 con 0x7f9f880cf3b0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780139f0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f880aabd0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f881f0840 con 0x7f9f880cf3b0 2024-09-13T15:11:24.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.684+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f880cf7f0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.688+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f78013b50 con 0x7f9f880cf3b0 2024-09-13T15:11:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.688+0000 7f9f84c00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9f64066760 0x7f9f64068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.688+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9f78083da0 con 0x7f9f880cf3b0 2024-09-13T15:11:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.688+0000 7f9f7fe00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9f64066760 0x7f9f64068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.692+0000 7f9f7fe00700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9f64066760 0x7f9f64068c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9f700090b0 tx=0x7f9f7001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.696+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f78051310 con 0x7f9f880cf3b0 2024-09-13T15:11:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.884+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f8813f790 con 0x7f9f880cf3b0 2024-09-13T15:11:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.884+0000 7f9f84c00700 1 -- 172.21.15.50:0/2627171103 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f78054930 con 0x7f9f880cf3b0 2024-09-13T15:11:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9f64066760 msgr2=0x7f9f64068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9f64066760 0x7f9f64068c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9f700090b0 tx=0x7f9f7001c040 comp rx=0 tx=0).stop 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 msgr2=0x7f9f880aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 0x7f9f880aa3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e870 tx=0x7f9f7800eb80 comp rx=0 tx=0).stop 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 shutdown_connections 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9f64066760 0x7f9f64068c20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9f8815e720 0x7f9f880adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f88143b60 0x7f9f8815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 --2- 172.21.15.50:0/2627171103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f880cf3b0 0x7f9f880aa3c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 >> 172.21.15.50:0/2627171103 conn(0x7f9f8806e660 msgr2=0x7f9f8806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 shutdown_connections 2024-09-13T15:11:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:24.888+0000 7f9f8f000700 1 -- 172.21.15.50:0/2627171103 wait complete. 2024-09-13T15:11:24.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a86600700 1 Processor -- start 2024-09-13T15:11:25.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a86600700 1 -- start start 2024-09-13T15:11:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a86600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a801610b0 0x7f0a800719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a86600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800b3560 con 0x7f0a800b2d80 2024-09-13T15:11:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a86600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800b3280 con 0x7f0a8006aaa0 2024-09-13T15:11:25.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a86600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a80070b30 con 0x7f0a801610b0 2024-09-13T15:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a85c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a800b2d80 0x7f0a800cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47814/0 (socket says 172.21.15.50:47814) 2024-09-13T15:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a85c00700 1 -- 172.21.15.50:0/2759618159 learned_addr learned my addr 172.21.15.50:0/2759618159 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:25.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.092+0000 7f0a85200700 1 --2- 172.21.15.50:0/2759618159 >> v2:172.21.15.50:3300/0 conn(0x7f0a801610b0 0x7f0a800719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a85200700 1 -- 172.21.15.50:0/2759618159 >> v1:172.21.15.181:6789/0 conn(0x7f0a8006aaa0 legacy=0x7f0a800b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a85200700 1 -- 172.21.15.50:0/2759618159 >> v1:172.21.15.50:6789/0 conn(0x7f0a800b2d80 legacy=0x7f0a800cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a7f400700 1 -- 172.21.15.50:0/2759618159 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552376319 0 0) 0x7f0a800b3560 con 0x7f0a800b2d80 2024-09-13T15:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a85200700 1 -- 172.21.15.50:0/2759618159 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80070ee0 con 0x7f0a801610b0 2024-09-13T15:11:25.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a85200700 1 --2- 172.21.15.50:0/2759618159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a801610b0 0x7f0a800719c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009800 tx=0x7f0a74009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df43ce8e3c69fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a7f400700 1 -- 172.21.15.50:0/2759618159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74004230 con 0x7f0a801610b0 2024-09-13T15:11:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a7f400700 1 -- 172.21.15.50:0/2759618159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74004390 con 0x7f0a801610b0 2024-09-13T15:11:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a7f400700 1 -- 172.21.15.50:0/2759618159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740036c0 con 0x7f0a801610b0 2024-09-13T15:11:25.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 -- 172.21.15.50:0/2759618159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a801610b0 msgr2=0x7f0a800719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 --2- 172.21.15.50:0/2759618159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a801610b0 0x7f0a800719c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009800 tx=0x7f0a74009b10 comp rx=0 tx=0).stop 2024-09-13T15:11:25.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 -- 172.21.15.50:0/2759618159 shutdown_connections 2024-09-13T15:11:25.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 --2- 172.21.15.50:0/2759618159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a801610b0 0x7f0a800719c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 -- 172.21.15.50:0/2759618159 >> 172.21.15.50:0/2759618159 conn(0x7f0a800b0c40 msgr2=0x7f0a8006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:25.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 -- 172.21.15.50:0/2759618159 shutdown_connections 2024-09-13T15:11:25.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.096+0000 7f0a86600700 1 -- 172.21.15.50:0/2759618159 wait complete. 2024-09-13T15:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.100+0000 7f0a86600700 1 Processor -- start 2024-09-13T15:11:25.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.100+0000 7f0a86600700 1 -- start start 2024-09-13T15:11:25.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a8006aaa0 0x7f0a800ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 0x7f0a800abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a801610b0 0x7f0a800ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800caa60 con 0x7f0a800b2d80 2024-09-13T15:11:25.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a80163ba0 con 0x7f0a801610b0 2024-09-13T15:11:25.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a80163e80 con 0x7f0a8006aaa0 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 0x7f0a800abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 0x7f0a800abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39982/0 (socket says 172.21.15.50:39982) 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 -- 172.21.15.50:0/3458321015 learned_addr learned my addr 172.21.15.50:0/3458321015 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a85200700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a8006aaa0 0x7f0a800ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a85c00700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a801610b0 0x7f0a800ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 -- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a8006aaa0 msgr2=0x7f0a800ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a8006aaa0 0x7f0a800ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 -- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a801610b0 msgr2=0x7f0a800ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a801610b0 0x7f0a800ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 -- 172.21.15.50:0/3458321015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740094b0 con 0x7f0a800b2d80 2024-09-13T15:11:25.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a85c00700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a801610b0 0x7f0a800ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7fe00700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 0x7f0a800abb10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00c6b0 tx=0x7f0a6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c005480 con 0x7f0a800b2d80 2024-09-13T15:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0036a0 con 0x7f0a800b2d80 2024-09-13T15:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003a50 con 0x7f0a800b2d80 2024-09-13T15:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a80164160 con 0x7f0a800b2d80 2024-09-13T15:11:25.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.104+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a80162e30 con 0x7f0a800b2d80 2024-09-13T15:11:25.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.108+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800719c0 con 0x7f0a800b2d80 2024-09-13T15:11:25.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.108+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a6c003bb0 con 0x7f0a800b2d80 2024-09-13T15:11:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.112+0000 7f0a7cc00700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0a60066730 0x7f0a60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.112+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0a6c083b00 con 0x7f0a800b2d80 2024-09-13T15:11:25.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.112+0000 7f0a85200700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0a60066730 0x7f0a60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.112+0000 7f0a85200700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0a60066730 0x7f0a60068bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009800 tx=0x7f0a74008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:25.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.116+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a6c085e60 con 0x7f0a800b2d80 2024-09-13T15:11:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.312+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a8006d7a0 con 0x7f0a800b2d80 2024-09-13T15:11:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.312+0000 7f0a7cc00700 1 -- 172.21.15.50:0/3458321015 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0a6c051070 con 0x7f0a800b2d80 2024-09-13T15:11:25.317 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:25.317 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:11:25.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:25.317 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:11:25.318 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:11:25.318 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:25.318 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:11:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0a60066730 msgr2=0x7f0a60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0a60066730 0x7f0a60068bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009800 tx=0x7f0a74008030 comp rx=0 tx=0).stop 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 msgr2=0x7f0a800abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 0x7f0a800abb10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00c6b0 tx=0x7f0a6c00c9c0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 shutdown_connections 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0a60066730 0x7f0a60068bf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a801610b0 0x7f0a800ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a800b2d80 0x7f0a800abb10 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 --2- 172.21.15.50:0/3458321015 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a8006aaa0 0x7f0a800ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 >> 172.21.15.50:0/3458321015 conn(0x7f0a800b0c40 msgr2=0x7f0a800af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 shutdown_connections 2024-09-13T15:11:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.316+0000 7f0a86600700 1 -- 172.21.15.50:0/3458321015 wait complete. 2024-09-13T15:11:25.342 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:11:25.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:11:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.516+0000 7fb78d600700 1 Processor -- start 2024-09-13T15:11:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.516+0000 7fb78d600700 1 -- start start 2024-09-13T15:11:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78d600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb788155020 0x7fb7880cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 0x7fb78815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78d600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb78815f270 0x7fb788066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78d600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78815e5c0 con 0x7fb788155020 2024-09-13T15:11:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78d600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880cdb50 con 0x7fb78815f270 2024-09-13T15:11:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78d600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb788155400 con 0x7fb78815afd0 2024-09-13T15:11:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb787e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb788155020 0x7fb7880cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb787400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 0x7fb78815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb78cc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb78815f270 0x7fb788066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb787400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 0x7fb78815ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:52844/0 (socket says 172.21.15.50:52844) 2024-09-13T15:11:25.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.520+0000 7fb787400700 1 -- 172.21.15.50:0/1225703010 learned_addr learned my addr 172.21.15.50:0/1225703010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787400700 1 -- 172.21.15.50:0/1225703010 >> v2:172.21.15.181:3300/0 conn(0x7fb78815f270 msgr2=0x7fb788066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787400700 1 --2- 172.21.15.50:0/1225703010 >> v2:172.21.15.181:3300/0 conn(0x7fb78815f270 0x7fb788066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787400700 1 -- 172.21.15.50:0/1225703010 >> v2:172.21.15.50:3300/0 conn(0x7fb788155020 msgr2=0x7fb7880cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787400700 1 --2- 172.21.15.50:0/1225703010 >> v2:172.21.15.50:3300/0 conn(0x7fb788155020 0x7fb7880cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787400700 1 -- 172.21.15.50:0/1225703010 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78815b7b0 con 0x7fb78815afd0 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787e00700 1 --2- 172.21.15.50:0/1225703010 >> v2:172.21.15.50:3300/0 conn(0x7fb788155020 0x7fb7880cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:25.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb787400700 1 --2- 172.21.15.50:0/1225703010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 0x7fb78815ed30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb78815e500 tx=0x7fb774009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe554ab72a09b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb786a00700 1 -- 172.21.15.50:0/1225703010 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774011830 con 0x7fb78815afd0 2024-09-13T15:11:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb786a00700 1 -- 172.21.15.50:0/1225703010 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb774011990 con 0x7fb78815afd0 2024-09-13T15:11:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb786a00700 1 -- 172.21.15.50:0/1225703010 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774011d20 con 0x7fb78815afd0 2024-09-13T15:11:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 -- 172.21.15.50:0/1225703010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 msgr2=0x7fb78815ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 --2- 172.21.15.50:0/1225703010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 0x7fb78815ed30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb78815e500 tx=0x7fb774009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 -- 172.21.15.50:0/1225703010 shutdown_connections 2024-09-13T15:11:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 --2- 172.21.15.50:0/1225703010 >> v2:172.21.15.181:3300/0 conn(0x7fb78815f270 0x7fb788066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 --2- 172.21.15.50:0/1225703010 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815afd0 0x7fb78815ed30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 --2- 172.21.15.50:0/1225703010 >> v2:172.21.15.50:3300/0 conn(0x7fb788155020 0x7fb7880cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 -- 172.21.15.50:0/1225703010 >> 172.21.15.50:0/1225703010 conn(0x7fb7880b22d0 msgr2=0x7fb78806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 -- 172.21.15.50:0/1225703010 shutdown_connections 2024-09-13T15:11:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.524+0000 7fb78d600700 1 -- 172.21.15.50:0/1225703010 wait complete. 2024-09-13T15:11:25.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 Processor -- start 2024-09-13T15:11:25.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 -- start start 2024-09-13T15:11:25.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 0x7fb78814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78815afd0 0x7fb7880c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815f270 0x7fb7880c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78814dac0 con 0x7fb788155020 2024-09-13T15:11:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880b3c40 con 0x7fb78815afd0 2024-09-13T15:11:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78d600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880cb520 con 0x7fb78815f270 2024-09-13T15:11:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 0x7fb78814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 0x7fb78814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39988/0 (socket says 172.21.15.50:39988) 2024-09-13T15:11:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 -- 172.21.15.50:0/3215287216 learned_addr learned my addr 172.21.15.50:0/3215287216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787400700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78815afd0 0x7fb7880c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb78cc00700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815f270 0x7fb7880c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 -- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815f270 msgr2=0x7fb7880c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815f270 0x7fb7880c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 -- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78815afd0 msgr2=0x7fb7880c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78815afd0 0x7fb7880c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 -- 172.21.15.50:0/3215287216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780094b0 con 0x7fb788155020 2024-09-13T15:11:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787400700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78815afd0 0x7fb7880c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.528+0000 7fb787e00700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 0x7fb78814d580 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e990 tx=0x7fb77800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.532+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780096f0 con 0x7fb788155020 2024-09-13T15:11:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.532+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800c850 con 0x7fb788155020 2024-09-13T15:11:25.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.532+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800eee0 con 0x7fb788155020 2024-09-13T15:11:25.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.532+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774009570 con 0x7fb788155020 2024-09-13T15:11:25.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.532+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880b35f0 con 0x7fb788155020 2024-09-13T15:11:25.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.532+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880cf440 con 0x7fb788155020 2024-09-13T15:11:25.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.536+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb77800cbe0 con 0x7fb788155020 2024-09-13T15:11:25.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.536+0000 7fb77fe00700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb768066730 0x7fb768068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:25.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.536+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb7780840c0 con 0x7fb788155020 2024-09-13T15:11:25.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.536+0000 7fb787400700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb768066730 0x7fb768068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:25.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.536+0000 7fb787400700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb768066730 0x7fb768068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb774000c00 tx=0x7fb774008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:25.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.540+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb778051520 con 0x7fb788155020 2024-09-13T15:11:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:25.720+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb788073c90 con 0x7fb788155020 2024-09-13T15:11:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.140+0000 7fb77fe00700 1 -- 172.21.15.50:0/3215287216 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v86) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb778054b40 con 0x7fb788155020 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb768066730 msgr2=0x7fb768068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb768066730 0x7fb768068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb774000c00 tx=0x7fb774008030 comp rx=0 tx=0).stop 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 msgr2=0x7fb78814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 0x7fb78814d580 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e990 tx=0x7fb77800eca0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 shutdown_connections 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fb768066730 0x7fb768068bf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb78815f270 0x7fb7880c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb78815afd0 0x7fb7880c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 --2- 172.21.15.50:0/3215287216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb788155020 0x7fb78814d580 secure :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e990 tx=0x7fb77800eca0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.144+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 >> 172.21.15.50:0/3215287216 conn(0x7fb7880b22d0 msgr2=0x7fb788066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.148+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 shutdown_connections 2024-09-13T15:11:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.148+0000 7fb78d600700 1 -- 172.21.15.50:0/3215287216 wait complete. 2024-09-13T15:11:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:11:26.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:11:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.348+0000 7f5667a00700 1 Processor -- start 2024-09-13T15:11:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.348+0000 7f5667a00700 1 -- start start 2024-09-13T15:11:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5667a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566015a9f0 0x7f56600ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5667a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56600d14d0 0x7f56600cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5667a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56600cfb20 con 0x7f56600d0310 2024-09-13T15:11:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5667a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600b63c0 con 0x7f56600d14d0 2024-09-13T15:11:26.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5667a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600d0780 con 0x7f566015a9f0 2024-09-13T15:11:26.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56600d14d0 0x7f56600cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:26.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5665000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566015a9f0 0x7f56600ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:26.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5665a00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f56600d0310 0x7f566015e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52978/0 (socket says 172.21.15.50:52978) 2024-09-13T15:11:26.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5665a00700 1 -- 172.21.15.50:0/2351234964 learned_addr learned my addr 172.21.15.50:0/2351234964 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565f400700 1 -- 172.21.15.50:0/2351234964 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722899447 0 0) 0x7f56600cfb20 con 0x7f56600d0310 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565f400700 1 -- 172.21.15.50:0/2351234964 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56480035d0 con 0x7f56600d0310 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565fe00700 1 -- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566015a9f0 msgr2=0x7f56600ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565fe00700 1 --2- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566015a9f0 0x7f56600ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565fe00700 1 -- 172.21.15.50:0/2351234964 >> v1:172.21.15.181:6789/0 conn(0x7f56600d0310 legacy=0x7f566015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565fe00700 1 -- 172.21.15.50:0/2351234964 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600cec40 con 0x7f56600d14d0 2024-09-13T15:11:26.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f5665000700 1 --2- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566015a9f0 0x7f56600ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:26.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.352+0000 7f565fe00700 1 --2- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600d14d0 0x7f56600cfdd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f564c009880 tx=0x7f564c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2740a8916ef3da1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:26.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f565f400700 1 -- 172.21.15.50:0/2351234964 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011830 con 0x7f56600d14d0 2024-09-13T15:11:26.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f565f400700 1 -- 172.21.15.50:0/2351234964 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c011990 con 0x7f56600d14d0 2024-09-13T15:11:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f565f400700 1 -- 172.21.15.50:0/2351234964 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011d20 con 0x7f56600d14d0 2024-09-13T15:11:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 -- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600d14d0 msgr2=0x7f56600cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:26.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 --2- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600d14d0 0x7f56600cfdd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f564c009880 tx=0x7f564c009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 -- 172.21.15.50:0/2351234964 shutdown_connections 2024-09-13T15:11:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 --2- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600d14d0 0x7f56600cfdd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 --2- 172.21.15.50:0/2351234964 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566015a9f0 0x7f56600ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 -- 172.21.15.50:0/2351234964 >> 172.21.15.50:0/2351234964 conn(0x7f566006c5a0 msgr2=0x7f566006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 -- 172.21.15.50:0/2351234964 shutdown_connections 2024-09-13T15:11:26.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.356+0000 7f5667a00700 1 -- 172.21.15.50:0/2351234964 wait complete. 2024-09-13T15:11:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 Processor -- start 2024-09-13T15:11:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 -- start start 2024-09-13T15:11:26.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600d0310 0x7f56600ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:26.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 0x7f56600c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566015a9f0 0x7f5660151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600c6cf0 con 0x7f56600d14d0 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600c6fd0 con 0x7f566015a9f0 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5667a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600c72b0 con 0x7f56600d0310 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 0x7f56600c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 0x7f56600c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39998/0 (socket says 172.21.15.50:39998) 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 -- 172.21.15.50:0/515847257 learned_addr learned my addr 172.21.15.50:0/515847257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5665000700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600d0310 0x7f56600ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5665a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566015a9f0 0x7f5660151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 -- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600d0310 msgr2=0x7f56600ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600d0310 0x7f56600ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 -- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566015a9f0 msgr2=0x7f5660151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566015a9f0 0x7f5660151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f565fe00700 1 -- 172.21.15.50:0/515847257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540094b0 con 0x7f56600d14d0 2024-09-13T15:11:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.360+0000 7f5665000700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600d0310 0x7f56600ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f565fe00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 0x7f56600c6330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f564c009bd0 tx=0x7f564c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c004530 con 0x7f56600d14d0 2024-09-13T15:11:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c01f070 con 0x7f56600d14d0 2024-09-13T15:11:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0038e0 con 0x7f56600d14d0 2024-09-13T15:11:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c0094b0 con 0x7f56600d14d0 2024-09-13T15:11:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566015afe0 con 0x7f56600d14d0 2024-09-13T15:11:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.364+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566015add0 con 0x7f56600d14d0 2024-09-13T15:11:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.368+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f564c021030 con 0x7f56600d14d0 2024-09-13T15:11:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.368+0000 7f565cc00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5640066730 0x7f5640068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.368+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f564c0854a0 con 0x7f56600d14d0 2024-09-13T15:11:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.368+0000 7f5665000700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5640066730 0x7f5640068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.368+0000 7f5665000700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5640066730 0x7f5640068bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5654009dd0 tx=0x7f5654008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:26.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.376+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f564c0529c0 con 0x7f56600d14d0 2024-09-13T15:11:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:26.564+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f56600c6e30 con 0x7f56600d14d0 2024-09-13T15:11:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.148+0000 7f565cc00700 1 -- 172.21.15.50:0/515847257 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v87) v1 ==== 170+0+0 (secure 0 0 0) 0x7f56600c6e30 con 0x7f56600d14d0 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5640066730 msgr2=0x7f5640068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5640066730 0x7f5640068bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5654009dd0 tx=0x7f5654008040 comp rx=0 tx=0).stop 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 msgr2=0x7f56600c6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 0x7f56600c6330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f564c009bd0 tx=0x7f564c004770 comp rx=0 tx=0).stop 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 shutdown_connections 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5640066730 0x7f5640068bf0 secure :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5654009dd0 tx=0x7f5654008040 comp rx=0 tx=0).stop 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566015a9f0 0x7f5660151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56600d14d0 0x7f56600c6330 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 --2- 172.21.15.50:0/515847257 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600d0310 0x7f56600ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.156+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 >> 172.21.15.50:0/515847257 conn(0x7f566006c5a0 msgr2=0x7f56600b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.160+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 shutdown_connections 2024-09-13T15:11:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.160+0000 7f5667a00700 1 -- 172.21.15.50:0/515847257 wait complete. 2024-09-13T15:11:27.177 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:11:27.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:11:27.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 Processor -- start 2024-09-13T15:11:27.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 -- start start 2024-09-13T15:11:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc7e015ed90 0x7fc7e00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e015f170 0x7fc7e006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00cdc30 con 0x7fc7e00cf5b0 2024-09-13T15:11:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e015b050 con 0x7fc7e015ed90 2024-09-13T15:11:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e8600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e015b330 con 0x7fc7e015f170 2024-09-13T15:11:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e6600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7e00cf5b0 0x7fc7e0066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47816/0 (socket says 172.21.15.50:47816) 2024-09-13T15:11:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e6600700 1 -- 172.21.15.50:0/2042634680 learned_addr learned my addr 172.21.15.50:0/2042634680 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e5c00700 1 --2- 172.21.15.50:0/2042634680 >> v2:172.21.15.181:3300/0 conn(0x7fc7e015ed90 0x7fc7e00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.376+0000 7fc7e5200700 1 --2- 172.21.15.50:0/2042634680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e015f170 0x7fc7e006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7dfe00700 1 -- 172.21.15.50:0/2042634680 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413662493 0 0) 0x7fc7e00cdc30 con 0x7fc7e00cf5b0 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7dfe00700 1 -- 172.21.15.50:0/2042634680 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c80035d0 con 0x7fc7e00cf5b0 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e5200700 1 -- 172.21.15.50:0/2042634680 >> v2:172.21.15.181:3300/0 conn(0x7fc7e015ed90 msgr2=0x7fc7e00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e5200700 1 --2- 172.21.15.50:0/2042634680 >> v2:172.21.15.181:3300/0 conn(0x7fc7e015ed90 0x7fc7e00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e5200700 1 -- 172.21.15.50:0/2042634680 >> v1:172.21.15.50:6789/0 conn(0x7fc7e00cf5b0 legacy=0x7fc7e0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e5200700 1 -- 172.21.15.50:0/2042634680 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e015b610 con 0x7fc7e015f170 2024-09-13T15:11:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e5c00700 1 --2- 172.21.15.50:0/2042634680 >> v2:172.21.15.181:3300/0 conn(0x7fc7e015ed90 0x7fc7e00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e5200700 1 --2- 172.21.15.50:0/2042634680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e015f170 0x7fc7e006ed70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009850 tx=0x7fc7cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ceca50334f0d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7dfe00700 1 -- 172.21.15.50:0/2042634680 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc011830 con 0x7fc7e015f170 2024-09-13T15:11:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7dfe00700 1 -- 172.21.15.50:0/2042634680 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc011990 con 0x7fc7e015f170 2024-09-13T15:11:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7dfe00700 1 -- 172.21.15.50:0/2042634680 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc011d00 con 0x7fc7e015f170 2024-09-13T15:11:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 -- 172.21.15.50:0/2042634680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e015f170 msgr2=0x7fc7e006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2042634680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e015f170 0x7fc7e006ed70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009850 tx=0x7fc7cc009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 -- 172.21.15.50:0/2042634680 shutdown_connections 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2042634680 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e015f170 0x7fc7e006ed70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2042634680 >> v2:172.21.15.181:3300/0 conn(0x7fc7e015ed90 0x7fc7e00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 -- 172.21.15.50:0/2042634680 >> 172.21.15.50:0/2042634680 conn(0x7fc7e00b1e10 msgr2=0x7fc7e006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 -- 172.21.15.50:0/2042634680 shutdown_connections 2024-09-13T15:11:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.380+0000 7fc7e8600700 1 -- 172.21.15.50:0/2042634680 wait complete. 2024-09-13T15:11:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.384+0000 7fc7e8600700 1 Processor -- start 2024-09-13T15:11:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.384+0000 7fc7e8600700 1 -- start start 2024-09-13T15:11:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e00cf5b0 0x7fc7e0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 0x7fc7e0151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e015f170 0x7fc7e0153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0153a10 con 0x7fc7e015ed90 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e015c7f0 con 0x7fc7e015f170 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0153730 con 0x7fc7e00cf5b0 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 0x7fc7e0151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 0x7fc7e0151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40004/0 (socket says 172.21.15.50:40004) 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e00cf5b0 0x7fc7e0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 -- 172.21.15.50:0/2521293475 learned_addr learned my addr 172.21.15.50:0/2521293475 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e6600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e015f170 0x7fc7e0153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 -- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e00cf5b0 msgr2=0x7fc7e0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e00cf5b0 0x7fc7e0152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 -- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e015f170 msgr2=0x7fc7e0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e015f170 0x7fc7e0153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 -- 172.21.15.50:0/2521293475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40094b0 con 0x7fc7e015ed90 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e5200700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 0x7fc7e0151530 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc014040 tx=0x7fc7cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0044d0 con 0x7fc7e015ed90 2024-09-13T15:11:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0094b0 con 0x7fc7e015ed90 2024-09-13T15:11:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc01f070 con 0x7fc7e015ed90 2024-09-13T15:11:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0038e0 con 0x7fc7e015ed90 2024-09-13T15:11:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.388+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e015c480 con 0x7fc7e015ed90 2024-09-13T15:11:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.392+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e015c960 con 0x7fc7e015ed90 2024-09-13T15:11:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.392+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7cc003a40 con 0x7fc7e015ed90 2024-09-13T15:11:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.392+0000 7fc7dd600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc7c0066730 0x7fc7c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.392+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fc7cc021070 con 0x7fc7e015ed90 2024-09-13T15:11:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.396+0000 7fc7e5c00700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc7c0066730 0x7fc7c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.396+0000 7fc7e5c00700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc7c0066730 0x7fc7c0068bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00ae9e0 tx=0x7fc7d4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.400+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7cc052b20 con 0x7fc7e015ed90 2024-09-13T15:11:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.620+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc7e00cf070 con 0x7fc7e015ed90 2024-09-13T15:11:27.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.632+0000 7fc7dd600700 1 -- 172.21.15.50:0/2521293475 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc7cc0150c0 con 0x7fc7e015ed90 2024-09-13T15:11:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc7c0066730 msgr2=0x7fc7c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc7c0066730 0x7fc7c0068bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00ae9e0 tx=0x7fc7d4009240 comp rx=0 tx=0).stop 2024-09-13T15:11:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 msgr2=0x7fc7e0151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 0x7fc7e0151530 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc014040 tx=0x7fc7cc004770 comp rx=0 tx=0).stop 2024-09-13T15:11:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 shutdown_connections 2024-09-13T15:11:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc7c0066730 0x7fc7c0068bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e015f170 0x7fc7e0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e015ed90 0x7fc7e0151530 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 --2- 172.21.15.50:0/2521293475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7e00cf5b0 0x7fc7e0152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 >> 172.21.15.50:0/2521293475 conn(0x7fc7e00b1e10 msgr2=0x7fc7e00af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 shutdown_connections 2024-09-13T15:11:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.644+0000 7fc7e8600700 1 -- 172.21.15.50:0/2521293475 wait complete. 2024-09-13T15:11:27.660 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 13 and data pool 14 2024-09-13T15:11:27.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:27.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.852+0000 7f941ba00700 1 Processor -- start 2024-09-13T15:11:27.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.852+0000 7f941ba00700 1 -- start start 2024-09-13T15:11:27.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f941ba00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94140b43d0 0x7f941406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f941ba00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9414161120 0x7f941406a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f941ba00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941406f6f0 con 0x7f941406f2b0 2024-09-13T15:11:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f941ba00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941415dd50 con 0x7f9414161120 2024-09-13T15:11:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f941ba00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9414161590 con 0x7f94140b43d0 2024-09-13T15:11:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9413e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f941406f2b0 0x7f9414160a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47832/0 (socket says 172.21.15.50:47832) 2024-09-13T15:11:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9413e00700 1 -- 172.21.15.50:0/4094729665 learned_addr learned my addr 172.21.15.50:0/4094729665 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419000700 1 --2- 172.21.15.50:0/4094729665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94140b43d0 0x7f941406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419a00700 1 --2- 172.21.15.50:0/4094729665 >> v2:172.21.15.181:3300/0 conn(0x7f9414161120 0x7f941406a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9413400700 1 -- 172.21.15.50:0/4094729665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038092294 0 0) 0x7f941406f6f0 con 0x7f941406f2b0 2024-09-13T15:11:27.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9413400700 1 -- 172.21.15.50:0/4094729665 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc0035d0 con 0x7f941406f2b0 2024-09-13T15:11:27.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419000700 1 -- 172.21.15.50:0/4094729665 >> v2:172.21.15.181:3300/0 conn(0x7f9414161120 msgr2=0x7f941406a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:27.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419000700 1 --2- 172.21.15.50:0/4094729665 >> v2:172.21.15.181:3300/0 conn(0x7f9414161120 0x7f941406a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419000700 1 -- 172.21.15.50:0/4094729665 >> v1:172.21.15.50:6789/0 conn(0x7f941406f2b0 legacy=0x7f9414160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419000700 1 -- 172.21.15.50:0/4094729665 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414161780 con 0x7f94140b43d0 2024-09-13T15:11:27.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419a00700 1 --2- 172.21.15.50:0/4094729665 >> v2:172.21.15.181:3300/0 conn(0x7f9414161120 0x7f941406a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:27.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9419000700 1 --2- 172.21.15.50:0/4094729665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94140b43d0 0x7f941406ed70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9408009850 tx=0x7f9408009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22a56f32abb9a2ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9413400700 1 -- 172.21.15.50:0/4094729665 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408011830 con 0x7f94140b43d0 2024-09-13T15:11:27.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.856+0000 7f9413400700 1 -- 172.21.15.50:0/4094729665 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9408011990 con 0x7f94140b43d0 2024-09-13T15:11:27.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f9413400700 1 -- 172.21.15.50:0/4094729665 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408011d40 con 0x7f94140b43d0 2024-09-13T15:11:27.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 -- 172.21.15.50:0/4094729665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94140b43d0 msgr2=0x7f941406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 --2- 172.21.15.50:0/4094729665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94140b43d0 0x7f941406ed70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9408009850 tx=0x7f9408009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 -- 172.21.15.50:0/4094729665 shutdown_connections 2024-09-13T15:11:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 --2- 172.21.15.50:0/4094729665 >> v2:172.21.15.181:3300/0 conn(0x7f9414161120 0x7f941406a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 --2- 172.21.15.50:0/4094729665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94140b43d0 0x7f941406ed70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 -- 172.21.15.50:0/4094729665 >> 172.21.15.50:0/4094729665 conn(0x7f941406d880 msgr2=0x7f941406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 -- 172.21.15.50:0/4094729665 shutdown_connections 2024-09-13T15:11:27.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 -- 172.21.15.50:0/4094729665 wait complete. 2024-09-13T15:11:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 Processor -- start 2024-09-13T15:11:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.860+0000 7f941ba00700 1 -- start start 2024-09-13T15:11:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 0x7f941414c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9414161120 0x7f94140adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94141f6890 0x7f94140b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b0650 con 0x7f94140b43d0 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140af9d0 con 0x7f94141f6890 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140afcb0 con 0x7f9414161120 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 0x7f941414c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 0x7f941414c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40008/0 (socket says 172.21.15.50:40008) 2024-09-13T15:11:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 -- 172.21.15.50:0/1721131235 learned_addr learned my addr 172.21.15.50:0/1721131235 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419a00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94141f6890 0x7f94140b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 -- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9414161120 msgr2=0x7f94140adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9413e00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9414161120 0x7f94140adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9414161120 0x7f94140adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 -- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94141f6890 msgr2=0x7f94140b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94141f6890 0x7f94140b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 -- 172.21.15.50:0/1721131235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c009a70 con 0x7f94140b43d0 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419a00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94141f6890 0x7f94140b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9413e00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9414161120 0x7f94140adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9419000700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 0x7f941414c910 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f94080090b0 tx=0x7f9408004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408004480 con 0x7f94140b43d0 2024-09-13T15:11:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940801f070 con 0x7f94140b43d0 2024-09-13T15:11:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94080094b0 con 0x7f94140b43d0 2024-09-13T15:11:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408003900 con 0x7f94140b43d0 2024-09-13T15:11:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.864+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140b0270 con 0x7f94140b43d0 2024-09-13T15:11:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.868+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140b08c0 con 0x7f94140b43d0 2024-09-13T15:11:27.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.868+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9408021030 con 0x7f94140b43d0 2024-09-13T15:11:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.872+0000 7f9410c00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93f4066730 0x7f93f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.872+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9408085610 con 0x7f94140b43d0 2024-09-13T15:11:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.872+0000 7f9413e00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93f4066730 0x7f93f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.872+0000 7f9413e00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93f4066730 0x7f93f4068bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9414157980 tx=0x7f9400009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:27.876+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9408052950 con 0x7f94140b43d0 2024-09-13T15:11:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.068+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94140b47b0 con 0x7f94140b43d0 2024-09-13T15:11:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.072+0000 7f9410c00700 1 -- 172.21.15.50:0/1721131235 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f9408006ce0 con 0x7f94140b43d0 2024-09-13T15:11:28.076 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:28.076 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":88,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:27.626169+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.072+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93f4066730 msgr2=0x7f93f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.072+0000 7f941ba00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93f4066730 0x7f93f4068bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9414157980 tx=0x7f9400009040 comp rx=0 tx=0).stop 2024-09-13T15:11:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.072+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 msgr2=0x7f941414c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.072+0000 7f941ba00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 0x7f941414c910 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f94080090b0 tx=0x7f9408004770 comp rx=0 tx=0).stop 2024-09-13T15:11:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 shutdown_connections 2024-09-13T15:11:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f93f4066730 0x7f93f4068bf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94141f6890 0x7f94140b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9414161120 0x7f94140adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 --2- 172.21.15.50:0/1721131235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94140b43d0 0x7f941414c910 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 >> 172.21.15.50:0/1721131235 conn(0x7f941406f2b0 msgr2=0x7f941415ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 shutdown_connections 2024-09-13T15:11:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.076+0000 7f941ba00700 1 -- 172.21.15.50:0/1721131235 wait complete. 2024-09-13T15:11:28.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.268+0000 7f7933e00700 1 Processor -- start 2024-09-13T15:11:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.268+0000 7f7933e00700 1 -- start start 2024-09-13T15:11:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f793406aaa0 0x7f793415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79340b3980 0x7f793406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793415e560 con 0x7f793406cbb0 2024-09-13T15:11:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340adf90 con 0x7f79340b3980 2024-09-13T15:11:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793406b3c0 con 0x7f793406aaa0 2024-09-13T15:11:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f792a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79340b3980 0x7f793406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f793406cbb0 0x7f793406d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47836/0 (socket says 172.21.15.50:47836) 2024-09-13T15:11:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7933400700 1 -- 172.21.15.50:0/2287760895 learned_addr learned my addr 172.21.15.50:0/2287760895 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f7932a00700 1 --2- 172.21.15.50:0/2287760895 >> v2:172.21.15.181:3300/0 conn(0x7f793406aaa0 0x7f793415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f792a000700 1 -- 172.21.15.50:0/2287760895 >> v2:172.21.15.181:3300/0 conn(0x7f793406aaa0 msgr2=0x7f793415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f792a000700 1 --2- 172.21.15.50:0/2287760895 >> v2:172.21.15.181:3300/0 conn(0x7f793406aaa0 0x7f793415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f792a000700 1 -- 172.21.15.50:0/2287760895 >> v1:172.21.15.50:6789/0 conn(0x7f793406cbb0 legacy=0x7f793406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f792a000700 1 -- 172.21.15.50:0/2287760895 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793415d920 con 0x7f79340b3980 2024-09-13T15:11:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.272+0000 7f792a000700 1 --2- 172.21.15.50:0/2287760895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f793406ae80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f79340ad490 tx=0x7f791c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2232dd7feb74b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7932000700 1 -- 172.21.15.50:0/2287760895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c011830 con 0x7f79340b3980 2024-09-13T15:11:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7932000700 1 -- 172.21.15.50:0/2287760895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c011990 con 0x7f79340b3980 2024-09-13T15:11:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7932000700 1 -- 172.21.15.50:0/2287760895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c011d20 con 0x7f79340b3980 2024-09-13T15:11:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 -- 172.21.15.50:0/2287760895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 msgr2=0x7f793406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 --2- 172.21.15.50:0/2287760895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f793406ae80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f79340ad490 tx=0x7f791c009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 -- 172.21.15.50:0/2287760895 shutdown_connections 2024-09-13T15:11:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 --2- 172.21.15.50:0/2287760895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f793406ae80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 --2- 172.21.15.50:0/2287760895 >> v2:172.21.15.181:3300/0 conn(0x7f793406aaa0 0x7f793415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 -- 172.21.15.50:0/2287760895 >> 172.21.15.50:0/2287760895 conn(0x7f79340b0c40 msgr2=0x7f793406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 -- 172.21.15.50:0/2287760895 shutdown_connections 2024-09-13T15:11:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.276+0000 7f7933e00700 1 -- 172.21.15.50:0/2287760895 wait complete. 2024-09-13T15:11:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 Processor -- start 2024-09-13T15:11:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 -- start start 2024-09-13T15:11:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f793406aaa0 0x7f793413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793406cbb0 0x7f79341e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f79341e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793413bd30 con 0x7f79340b3980 2024-09-13T15:11:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79341426d0 con 0x7f793406cbb0 2024-09-13T15:11:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79341429b0 con 0x7f793406aaa0 2024-09-13T15:11:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f79341e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f79341e5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40030/0 (socket says 172.21.15.50:40030) 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7933400700 1 -- 172.21.15.50:0/1798716734 learned_addr learned my addr 172.21.15.50:0/1798716734 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f792a000700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793406cbb0 0x7f79341e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.280+0000 7f7932a00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f793406aaa0 0x7f793413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933400700 1 -- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f793406aaa0 msgr2=0x7f793413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933400700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f793406aaa0 0x7f793413c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933400700 1 -- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793406cbb0 msgr2=0x7f79341e55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933400700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793406cbb0 0x7f79341e55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933400700 1 -- 172.21.15.50:0/1798716734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0094b0 con 0x7f79340b3980 2024-09-13T15:11:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f792a000700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793406cbb0 0x7f79341e55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933400700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f79341e5ae0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f792c00c4d0 tx=0x7f792c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c005d90 con 0x7f79340b3980 2024-09-13T15:11:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c0070d0 con 0x7f79340b3980 2024-09-13T15:11:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c007440 con 0x7f79340b3980 2024-09-13T15:11:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7934142c90 con 0x7f79340b3980 2024-09-13T15:11:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79341468b0 con 0x7f79340b3980 2024-09-13T15:11:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793413be70 con 0x7f79340b3980 2024-09-13T15:11:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.284+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f792c0075a0 con 0x7f79340b3980 2024-09-13T15:11:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.288+0000 7f792b400700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7910066730 0x7f7910068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.288+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f792c083520 con 0x7f79340b3980 2024-09-13T15:11:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.288+0000 7f7932a00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7910066730 0x7f7910068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.288+0000 7f7932a00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7910066730 0x7f7910068bf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7924011340 tx=0x7f792400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:28.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.296+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f793413be70 con 0x7f79340b3980 2024-09-13T15:11:28.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.488+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f793413be70 con 0x7f79340b3980 2024-09-13T15:11:28.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.488+0000 7f792b400700 1 -- 172.21.15.50:0/1798716734 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f793413be70 con 0x7f79340b3980 2024-09-13T15:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":88,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:27.626169+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7910066730 msgr2=0x7f7910068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7910066730 0x7f7910068bf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7924011340 tx=0x7f792400b040 comp rx=0 tx=0).stop 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 msgr2=0x7f79341e5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f79341e5ae0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f792c00c4d0 tx=0x7f792c00c7e0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 shutdown_connections 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7910066730 0x7f7910068bf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79340b3980 0x7f79341e5ae0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793406cbb0 0x7f79341e55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 --2- 172.21.15.50:0/1798716734 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f793406aaa0 0x7f793413c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 >> 172.21.15.50:0/1798716734 conn(0x7f79340b0c40 msgr2=0x7f7934070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 shutdown_connections 2024-09-13T15:11:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.492+0000 7f7933e00700 1 -- 172.21.15.50:0/1798716734 wait complete. 2024-09-13T15:11:28.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:11:28.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.692+0000 7fe3f6c00700 1 Processor -- start 2024-09-13T15:11:28.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.692+0000 7fe3f6c00700 1 -- start start 2024-09-13T15:11:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f00cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3f006d070 0x7fe3f00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00b1980 con 0x7fe3f006d620 2024-09-13T15:11:28.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00b2500 con 0x7fe3f006d070 2024-09-13T15:11:28.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00b1bd0 con 0x7fe3f0143b70 2024-09-13T15:11:28.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3f006d070 0x7fe3f00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3f006d070 0x7fe3f00b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40036/0 (socket says 172.21.15.50:40036) 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 -- 172.21.15.50:0/2279491829 learned_addr learned my addr 172.21.15.50:0/2279491829 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f5800700 1 --2- 172.21.15.50:0/2279491829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f00cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 -- 172.21.15.50:0/2279491829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 msgr2=0x7fe3f00cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 --2- 172.21.15.50:0/2279491829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f00cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 -- 172.21.15.50:0/2279491829 >> v1:172.21.15.181:6789/0 conn(0x7fe3f006d620 legacy=0x7fe3f006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.696+0000 7fe3f6200700 1 -- 172.21.15.50:0/2279491829 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00b1eb0 con 0x7fe3f006d070 2024-09-13T15:11:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6200700 1 --2- 172.21.15.50:0/2279491829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d070 0x7fe3f00b2990 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009e50 tx=0x7fe3e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba2cd096bfdde7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3efe00700 1 -- 172.21.15.50:0/2279491829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800e070 con 0x7fe3f006d070 2024-09-13T15:11:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3efe00700 1 -- 172.21.15.50:0/2279491829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e800b910 con 0x7fe3f006d070 2024-09-13T15:11:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3efe00700 1 -- 172.21.15.50:0/2279491829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800bcc0 con 0x7fe3f006d070 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 -- 172.21.15.50:0/2279491829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d070 msgr2=0x7fe3f00b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/2279491829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d070 0x7fe3f00b2990 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009e50 tx=0x7fe3e800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 -- 172.21.15.50:0/2279491829 shutdown_connections 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/2279491829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d070 0x7fe3f00b2990 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/2279491829 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f00cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 -- 172.21.15.50:0/2279491829 >> 172.21.15.50:0/2279491829 conn(0x7fe3f006a390 msgr2=0x7fe3f006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 -- 172.21.15.50:0/2279491829 shutdown_connections 2024-09-13T15:11:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.700+0000 7fe3f6c00700 1 -- 172.21.15.50:0/2279491829 wait complete. 2024-09-13T15:11:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 Processor -- start 2024-09-13T15:11:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 -- start start 2024-09-13T15:11:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3f006d070 0x7fe3f0156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 0x7fe3f0158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f0132a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01570d0 con 0x7fe3f006d620 2024-09-13T15:11:28.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01547e0 con 0x7fe3f006d070 2024-09-13T15:11:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.704+0000 7fe3f6c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01592a0 con 0x7fe3f0143b70 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 0x7fe3f0158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 0x7fe3f0158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40040/0 (socket says 172.21.15.50:40040) 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 -- 172.21.15.50:0/1295476664 learned_addr learned my addr 172.21.15.50:0/1295476664 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f5800700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3f006d070 0x7fe3f0156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f6200700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f0132a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 -- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 msgr2=0x7fe3f0132a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f0132a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 -- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3f006d070 msgr2=0x7fe3f0156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3f006d070 0x7fe3f0156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:28.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 -- 172.21.15.50:0/1295476664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009b30 con 0x7fe3f006d620 2024-09-13T15:11:28.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f4e00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 0x7fe3f0158850 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00c500 tx=0x7fe3dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:28.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0052d0 con 0x7fe3f006d620 2024-09-13T15:11:28.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc005430 con 0x7fe3f006d620 2024-09-13T15:11:28.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0055a0 con 0x7fe3f006d620 2024-09-13T15:11:28.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0159580 con 0x7fe3f006d620 2024-09-13T15:11:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.708+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f0159b40 con 0x7fe3f006d620 2024-09-13T15:11:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.712+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f00cde20 con 0x7fe3f006d620 2024-09-13T15:11:28.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.712+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3dc0036a0 con 0x7fe3f006d620 2024-09-13T15:11:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.716+0000 7fe3ed600700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3d0066730 0x7fe3d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.716+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe3dc0834c0 con 0x7fe3f006d620 2024-09-13T15:11:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.716+0000 7fe3f5800700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3d0066730 0x7fe3d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.716+0000 7fe3f5800700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3d0066730 0x7fe3d0068bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009bf0 tx=0x7fe3e4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.720+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3dc0506e0 con 0x7fe3f006d620 2024-09-13T15:11:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:28.936+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe3f0071f60 con 0x7fe3f006d620 2024-09-13T15:11:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.648+0000 7fe3ed600700 1 -- 172.21.15.50:0/1295476664 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe3dc053d00 con 0x7fe3f006d620 2024-09-13T15:11:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3d0066730 msgr2=0x7fe3d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3d0066730 0x7fe3d0068bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009bf0 tx=0x7fe3e4009240 comp rx=0 tx=0).stop 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 msgr2=0x7fe3f0158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 0x7fe3f0158850 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00c500 tx=0x7fe3dc00c810 comp rx=0 tx=0).stop 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 shutdown_connections 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe3d0066730 0x7fe3d0068bf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3f0143b70 0x7fe3f0132a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3f006d620 0x7fe3f0158850 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 --2- 172.21.15.50:0/1295476664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3f006d070 0x7fe3f0156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 >> 172.21.15.50:0/1295476664 conn(0x7fe3f006a390 msgr2=0x7fe3f015e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 shutdown_connections 2024-09-13T15:11:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.652+0000 7fe3f6c00700 1 -- 172.21.15.50:0/1295476664 wait complete. 2024-09-13T15:11:29.682 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:11:29.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:11:29.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 Processor -- start 2024-09-13T15:11:29.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 -- start start 2024-09-13T15:11:29.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f653015ca20 0x7f653015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f653006ada0 0x7f653006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653006b710 con 0x7f653006cd80 2024-09-13T15:11:29.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65300b4a20 con 0x7f653006ada0 2024-09-13T15:11:29.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6530160680 con 0x7f653015ca20 2024-09-13T15:11:29.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f6535200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f653006ada0 0x7f653006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f652f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f653006cd80 0x7f65300b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47838/0 (socket says 172.21.15.50:47838) 2024-09-13T15:11:29.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f652f400700 1 -- 172.21.15.50:0/1886634644 learned_addr learned my addr 172.21.15.50:0/1886634644 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:29.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.856+0000 7f652fe00700 1 --2- 172.21.15.50:0/1886634644 >> v2:172.21.15.181:3300/0 conn(0x7f653015ca20 0x7f653015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f652ea00700 1 -- 172.21.15.50:0/1886634644 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831046533 0 0) 0x7f653006b710 con 0x7f653006cd80 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f652ea00700 1 -- 172.21.15.50:0/1886634644 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65140035d0 con 0x7f653006cd80 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535200700 1 -- 172.21.15.50:0/1886634644 >> v2:172.21.15.181:3300/0 conn(0x7f653015ca20 msgr2=0x7f653015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535200700 1 --2- 172.21.15.50:0/1886634644 >> v2:172.21.15.181:3300/0 conn(0x7f653015ca20 0x7f653015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535200700 1 -- 172.21.15.50:0/1886634644 >> v1:172.21.15.50:6789/0 conn(0x7f653006cd80 legacy=0x7f65300b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535200700 1 -- 172.21.15.50:0/1886634644 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653015d670 con 0x7f653006ada0 2024-09-13T15:11:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f652fe00700 1 --2- 172.21.15.50:0/1886634644 >> v2:172.21.15.181:3300/0 conn(0x7f653015ca20 0x7f653015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535200700 1 --2- 172.21.15.50:0/1886634644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653006b1d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6530073c60 tx=0x7f652800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e57c072acdae835 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f652ea00700 1 -- 172.21.15.50:0/1886634644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800e070 con 0x7f653006ada0 2024-09-13T15:11:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f652ea00700 1 -- 172.21.15.50:0/1886634644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652800bb20 con 0x7f653006ada0 2024-09-13T15:11:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f652ea00700 1 -- 172.21.15.50:0/1886634644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528012430 con 0x7f653006ada0 2024-09-13T15:11:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 -- 172.21.15.50:0/1886634644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 msgr2=0x7f653006b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 --2- 172.21.15.50:0/1886634644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653006b1d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6530073c60 tx=0x7f652800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 -- 172.21.15.50:0/1886634644 shutdown_connections 2024-09-13T15:11:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 --2- 172.21.15.50:0/1886634644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653006b1d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 --2- 172.21.15.50:0/1886634644 >> v2:172.21.15.181:3300/0 conn(0x7f653015ca20 0x7f653015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 -- 172.21.15.50:0/1886634644 >> 172.21.15.50:0/1886634644 conn(0x7f6530071d20 msgr2=0x7f6530072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 -- 172.21.15.50:0/1886634644 shutdown_connections 2024-09-13T15:11:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.860+0000 7f6535c00700 1 -- 172.21.15.50:0/1886634644 wait complete. 2024-09-13T15:11:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.864+0000 7f6535c00700 1 Processor -- start 2024-09-13T15:11:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.864+0000 7f6535c00700 1 -- start start 2024-09-13T15:11:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653014f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f653006cd80 0x7f6530154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f653015ca20 0x7f6530155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530154030 con 0x7f653006ada0 2024-09-13T15:11:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530153690 con 0x7f653006cd80 2024-09-13T15:11:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6530153970 con 0x7f653015ca20 2024-09-13T15:11:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653014f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653014f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40068/0 (socket says 172.21.15.50:40068) 2024-09-13T15:11:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 -- 172.21.15.50:0/3147045603 learned_addr learned my addr 172.21.15.50:0/3147045603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652f400700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f653006cd80 0x7f6530154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535200700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f653015ca20 0x7f6530155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 -- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f653015ca20 msgr2=0x7f6530155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f653015ca20 0x7f6530155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 -- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f653006cd80 msgr2=0x7f6530154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f653006cd80 0x7f6530154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 -- 172.21.15.50:0/3147045603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200094b0 con 0x7f653006ada0 2024-09-13T15:11:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535200700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f653015ca20 0x7f6530155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652f400700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f653006cd80 0x7f6530154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f652fe00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653014f4b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f652000ebe0 tx=0x7f6520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000c8b0 con 0x7f653006ada0 2024-09-13T15:11:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652000ca10 con 0x7f653006ada0 2024-09-13T15:11:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6528009a70 con 0x7f653006ada0 2024-09-13T15:11:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000cda0 con 0x7f653006ada0 2024-09-13T15:11:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.868+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653014f9f0 con 0x7f653006ada0 2024-09-13T15:11:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.872+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653006d1c0 con 0x7f653006ada0 2024-09-13T15:11:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.872+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6520013470 con 0x7f653006ada0 2024-09-13T15:11:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.872+0000 7f6527e00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6510066730 0x7f6510068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.872+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6520084320 con 0x7f653006ada0 2024-09-13T15:11:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.876+0000 7f652f400700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6510066730 0x7f6510068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.876+0000 7f652f400700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6510066730 0x7f6510068bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65300cd0a0 tx=0x7f651c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:29.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:29.884+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65200515e0 con 0x7f653006ada0 2024-09-13T15:11:30.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.104+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f65300b30c0 con 0x7f653006ada0 2024-09-13T15:11:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.652+0000 7f6527e00700 1 -- 172.21.15.50:0/3147045603 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6520054c00 con 0x7f653006ada0 2024-09-13T15:11:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6510066730 msgr2=0x7f6510068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6510066730 0x7f6510068bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65300cd0a0 tx=0x7f651c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 msgr2=0x7f653014f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653014f4b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f652000ebe0 tx=0x7f6520009e30 comp rx=0 tx=0).stop 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 shutdown_connections 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6510066730 0x7f6510068bf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f653015ca20 0x7f6530155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f653006cd80 0x7f6530154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 --2- 172.21.15.50:0/3147045603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f653006ada0 0x7f653014f4b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 >> 172.21.15.50:0/3147045603 conn(0x7f6530071d20 msgr2=0x7f653015fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 shutdown_connections 2024-09-13T15:11:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.656+0000 7f6535c00700 1 -- 172.21.15.50:0/3147045603 wait complete. 2024-09-13T15:11:30.687 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:11:30.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 Processor -- start 2024-09-13T15:11:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 -- start start 2024-09-13T15:11:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98081573b0 0x7f98080cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980806ace0 0x7f980806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080ad480 con 0x7f98080ce2f0 2024-09-13T15:11:30.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9808157790 con 0x7f98081573b0 2024-09-13T15:11:30.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980f600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98080ad6d0 con 0x7f980806ace0 2024-09-13T15:11:30.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f9807e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98080ce2f0 0x7f980806a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47850/0 (socket says 172.21.15.50:47850) 2024-09-13T15:11:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f9807e00700 1 -- 172.21.15.50:0/2910843771 learned_addr learned my addr 172.21.15.50:0/2910843771 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980d600700 1 --2- 172.21.15.50:0/2910843771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980806ace0 0x7f980806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f980cc00700 1 --2- 172.21.15.50:0/2910843771 >> v2:172.21.15.181:3300/0 conn(0x7f98081573b0 0x7f98080cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f9807400700 1 -- 172.21.15.50:0/2910843771 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927889589 0 0) 0x7f98080ad480 con 0x7f98080ce2f0 2024-09-13T15:11:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.864+0000 7f9807400700 1 -- 172.21.15.50:0/2910843771 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f00035d0 con 0x7f98080ce2f0 2024-09-13T15:11:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980d600700 1 -- 172.21.15.50:0/2910843771 >> v2:172.21.15.181:3300/0 conn(0x7f98081573b0 msgr2=0x7f98080cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f9807400700 1 -- 172.21.15.50:0/2910843771 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541597581 0 0) 0x7f97f00035d0 con 0x7f98080ce2f0 2024-09-13T15:11:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980d600700 1 --2- 172.21.15.50:0/2910843771 >> v2:172.21.15.181:3300/0 conn(0x7f98081573b0 0x7f98080cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980d600700 1 -- 172.21.15.50:0/2910843771 >> v1:172.21.15.50:6789/0 conn(0x7f98080ce2f0 legacy=0x7f980806a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980d600700 1 -- 172.21.15.50:0/2910843771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080ad9b0 con 0x7f980806ace0 2024-09-13T15:11:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980d600700 1 --2- 172.21.15.50:0/2910843771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980806ace0 0x7f980806ff60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9800009d90 tx=0x7f980000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9dada0eb6db812b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:30.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f9807400700 1 -- 172.21.15.50:0/2910843771 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000e070 con 0x7f980806ace0 2024-09-13T15:11:30.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f9807400700 1 -- 172.21.15.50:0/2910843771 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800003a40 con 0x7f980806ace0 2024-09-13T15:11:30.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f9807400700 1 -- 172.21.15.50:0/2910843771 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4001670 con 0x7f980806ace0 2024-09-13T15:11:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 -- 172.21.15.50:0/2910843771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980806ace0 msgr2=0x7f980806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 --2- 172.21.15.50:0/2910843771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980806ace0 0x7f980806ff60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9800009d90 tx=0x7f980000b330 comp rx=0 tx=0).stop 2024-09-13T15:11:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 -- 172.21.15.50:0/2910843771 shutdown_connections 2024-09-13T15:11:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 --2- 172.21.15.50:0/2910843771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f980806ace0 0x7f980806ff60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 --2- 172.21.15.50:0/2910843771 >> v2:172.21.15.181:3300/0 conn(0x7f98081573b0 0x7f98080cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 -- 172.21.15.50:0/2910843771 >> 172.21.15.50:0/2910843771 conn(0x7f98080b08d0 msgr2=0x7f98080b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 -- 172.21.15.50:0/2910843771 shutdown_connections 2024-09-13T15:11:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.868+0000 7f980f600700 1 -- 172.21.15.50:0/2910843771 wait complete. 2024-09-13T15:11:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 Processor -- start 2024-09-13T15:11:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 -- start start 2024-09-13T15:11:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 0x7f9808150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98080ce2f0 0x7f980814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98081573b0 0x7f98080b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980814f580 con 0x7f980806ace0 2024-09-13T15:11:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080b3b00 con 0x7f98080ce2f0 2024-09-13T15:11:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980f600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980814f760 con 0x7f98081573b0 2024-09-13T15:11:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980cc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 0x7f9808150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980cc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 0x7f9808150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40082/0 (socket says 172.21.15.50:40082) 2024-09-13T15:11:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.872+0000 7f980cc00700 1 -- 172.21.15.50:0/336345894 learned_addr learned my addr 172.21.15.50:0/336345894 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980d600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98081573b0 0x7f98080b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f9807e00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98080ce2f0 0x7f980814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980cc00700 1 -- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98081573b0 msgr2=0x7f98080b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980cc00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98081573b0 0x7f98080b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980cc00700 1 -- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98080ce2f0 msgr2=0x7f980814cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980cc00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98080ce2f0 0x7f980814cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980cc00700 1 -- 172.21.15.50:0/336345894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800009a70 con 0x7f980806ace0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980cc00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 0x7f9808150240 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00e840 tx=0x7f97fc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0095a0 con 0x7f980806ace0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc013680 con 0x7f980806ace0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980814fa40 con 0x7f980806ace0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0139f0 con 0x7f980806ace0 2024-09-13T15:11:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98080b28b0 con 0x7f980806ace0 2024-09-13T15:11:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.876+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980806ff60 con 0x7f980806ace0 2024-09-13T15:11:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.880+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97fc013b50 con 0x7f980806ace0 2024-09-13T15:11:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.880+0000 7f9804c00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f97e8066730 0x7f97e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.880+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f97fc084290 con 0x7f980806ace0 2024-09-13T15:11:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.880+0000 7f9807e00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f97e8066730 0x7f97e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.884+0000 7f9807e00700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f97e8066730 0x7f97e8068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f97f4001eb0 tx=0x7f97f4001c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:30.888+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97fc0513a0 con 0x7f980806ace0 2024-09-13T15:11:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.120+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9808070470 con 0x7f980806ace0 2024-09-13T15:11:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.120+0000 7f9804c00700 1 -- 172.21.15.50:0/336345894 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f97fc0549c0 con 0x7f980806ace0 2024-09-13T15:11:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:31.126 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:31.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f97e8066730 msgr2=0x7f97e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f97e8066730 0x7f97e8068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f97f4001eb0 tx=0x7f97f4001c60 comp rx=0 tx=0).stop 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 msgr2=0x7f9808150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 0x7f9808150240 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00e840 tx=0x7f97fc00eb50 comp rx=0 tx=0).stop 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 shutdown_connections 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f97e8066730 0x7f97e8068bf0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98081573b0 0x7f98080b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98080ce2f0 0x7f980814cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 --2- 172.21.15.50:0/336345894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f980806ace0 0x7f9808150240 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 >> 172.21.15.50:0/336345894 conn(0x7f98080b08d0 msgr2=0x7f98080af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 shutdown_connections 2024-09-13T15:11:31.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.128+0000 7f980f600700 1 -- 172.21.15.50:0/336345894 wait complete. 2024-09-13T15:11:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:31.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:31.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.332+0000 7fa193200700 1 Processor -- start 2024-09-13T15:11:31.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.332+0000 7fa193200700 1 -- start start 2024-09-13T15:11:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa193200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa18c1610b0 0x7fa18c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa193200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa18c06aaa0 0x7fa18c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa193200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c0b3560 con 0x7fa18c0b2670 2024-09-13T15:11:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa193200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c070b30 con 0x7fa18c1610b0 2024-09-13T15:11:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa193200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c06b450 con 0x7fa18c06aaa0 2024-09-13T15:11:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa18c1610b0 0x7fa18c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa192800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa18c0b2670 0x7fa18c0b2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47860/0 (socket says 172.21.15.50:47860) 2024-09-13T15:11:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa192800700 1 -- 172.21.15.50:0/3009428992 learned_addr learned my addr 172.21.15.50:0/3009428992 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191400700 1 --2- 172.21.15.50:0/3009428992 >> v2:172.21.15.181:3300/0 conn(0x7fa18c06aaa0 0x7fa18c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa190a00700 1 -- 172.21.15.50:0/3009428992 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917714646 0 0) 0x7fa18c0b3560 con 0x7fa18c0b2670 2024-09-13T15:11:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa190a00700 1 -- 172.21.15.50:0/3009428992 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1740035d0 con 0x7fa18c0b2670 2024-09-13T15:11:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191e00700 1 -- 172.21.15.50:0/3009428992 >> v2:172.21.15.181:3300/0 conn(0x7fa18c06aaa0 msgr2=0x7fa18c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191e00700 1 --2- 172.21.15.50:0/3009428992 >> v2:172.21.15.181:3300/0 conn(0x7fa18c06aaa0 0x7fa18c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191e00700 1 -- 172.21.15.50:0/3009428992 >> v1:172.21.15.50:6789/0 conn(0x7fa18c0b2670 legacy=0x7fa18c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191e00700 1 -- 172.21.15.50:0/3009428992 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0b3280 con 0x7fa18c1610b0 2024-09-13T15:11:31.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa191e00700 1 --2- 172.21.15.50:0/3009428992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c1610b0 0x7fa18c0719c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa180009880 tx=0x7fa180009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1abe074cf97849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa190a00700 1 -- 172.21.15.50:0/3009428992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180011830 con 0x7fa18c1610b0 2024-09-13T15:11:31.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.336+0000 7fa190a00700 1 -- 172.21.15.50:0/3009428992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa180011990 con 0x7fa18c1610b0 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa190a00700 1 -- 172.21.15.50:0/3009428992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180011d00 con 0x7fa18c1610b0 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 -- 172.21.15.50:0/3009428992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c1610b0 msgr2=0x7fa18c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 --2- 172.21.15.50:0/3009428992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c1610b0 0x7fa18c0719c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa180009880 tx=0x7fa180009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 -- 172.21.15.50:0/3009428992 shutdown_connections 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 --2- 172.21.15.50:0/3009428992 >> v2:172.21.15.181:3300/0 conn(0x7fa18c06aaa0 0x7fa18c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 --2- 172.21.15.50:0/3009428992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c1610b0 0x7fa18c0719c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 -- 172.21.15.50:0/3009428992 >> 172.21.15.50:0/3009428992 conn(0x7fa18c0b0c40 msgr2=0x7fa18c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 -- 172.21.15.50:0/3009428992 shutdown_connections 2024-09-13T15:11:31.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 -- 172.21.15.50:0/3009428992 wait complete. 2024-09-13T15:11:31.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 Processor -- start 2024-09-13T15:11:31.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.340+0000 7fa193200700 1 -- start start 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa18c06aaa0 0x7fa18c163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 0x7fa18c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa18c1610b0 0x7fa18c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c158210 con 0x7fa18c0b2670 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c158460 con 0x7fa18c1610b0 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c158740 con 0x7fa18c06aaa0 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 0x7fa18c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 0x7fa18c15a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40090/0 (socket says 172.21.15.50:40090) 2024-09-13T15:11:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 -- 172.21.15.50:0/3278259298 learned_addr learned my addr 172.21.15.50:0/3278259298 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa192800700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa18c1610b0 0x7fa18c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191e00700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa18c06aaa0 0x7fa18c163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 -- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa18c06aaa0 msgr2=0x7fa18c163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa18c06aaa0 0x7fa18c163f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 -- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa18c1610b0 msgr2=0x7fa18c15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa18c1610b0 0x7fa18c15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 -- 172.21.15.50:0/3278259298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800094b0 con 0x7fa18c0b2670 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa191400700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 0x7fa18c15a460 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00e9d0 tx=0x7fa17c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c009720 con 0x7fa18c0b2670 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00c850 con 0x7fa18c0b2670 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c158a20 con 0x7fa18c0b2670 2024-09-13T15:11:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00cbc0 con 0x7fa18c0b2670 2024-09-13T15:11:31.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.344+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c158fe0 con 0x7fa18c0b2670 2024-09-13T15:11:31.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.348+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c04e760 con 0x7fa18c0b2670 2024-09-13T15:11:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.348+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa17c00cd20 con 0x7fa18c0b2670 2024-09-13T15:11:31.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.348+0000 7fa186000700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa170066730 0x7fa170068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.348+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa17c0844c0 con 0x7fa18c0b2670 2024-09-13T15:11:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.352+0000 7fa191e00700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa170066730 0x7fa170068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.352+0000 7fa191e00700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa170066730 0x7fa170068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1800090b0 tx=0x7fa180010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.356+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa17c051650 con 0x7fa18c0b2670 2024-09-13T15:11:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.540+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa18c06a530 con 0x7fa18c0b2670 2024-09-13T15:11:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.544+0000 7fa186000700 1 -- 172.21.15.50:0/3278259298 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fa17c054c70 con 0x7fa18c0b2670 2024-09-13T15:11:31.550 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:31.550 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:28.631014+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa170066730 msgr2=0x7fa170068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa170066730 0x7fa170068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1800090b0 tx=0x7fa180010000 comp rx=0 tx=0).stop 2024-09-13T15:11:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 msgr2=0x7fa18c15a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 0x7fa18c15a460 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00e9d0 tx=0x7fa17c00ed90 comp rx=0 tx=0).stop 2024-09-13T15:11:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 shutdown_connections 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa170066730 0x7fa170068bf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa18c1610b0 0x7fa18c15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa18c0b2670 0x7fa18c15a460 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 --2- 172.21.15.50:0/3278259298 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa18c06aaa0 0x7fa18c163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 >> 172.21.15.50:0/3278259298 conn(0x7fa18c0b0c40 msgr2=0x7fa18c0cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 shutdown_connections 2024-09-13T15:11:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.548+0000 7fa193200700 1 -- 172.21.15.50:0/3278259298 wait complete. 2024-09-13T15:11:31.576 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:11:31.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:11:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.748+0000 7f5858e00700 1 Processor -- start 2024-09-13T15:11:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.748+0000 7f5858e00700 1 -- start start 2024-09-13T15:11:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5858e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f585415e070 0x7f58540cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5858e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f58540d10f0 0x7f58540b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5858e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58540cd970 con 0x7f58540d1540 2024-09-13T15:11:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5858e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585415e450 con 0x7f585415e070 2024-09-13T15:11:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5858e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58540d0050 con 0x7f58540d10f0 2024-09-13T15:11:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f585415e070 0x7f58540cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f585415e070 0x7f58540cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40104/0 (socket says 172.21.15.50:40104) 2024-09-13T15:11:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 -- 172.21.15.50:0/2160643154 learned_addr learned my addr 172.21.15.50:0/2160643154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f584be00700 1 --2- 172.21.15.50:0/2160643154 >> v2:172.21.15.181:3300/0 conn(0x7f58540d10f0 0x7f58540b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 -- 172.21.15.50:0/2160643154 >> v2:172.21.15.181:3300/0 conn(0x7f58540d10f0 msgr2=0x7f58540b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 --2- 172.21.15.50:0/2160643154 >> v2:172.21.15.181:3300/0 conn(0x7f58540d10f0 0x7f58540b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 -- 172.21.15.50:0/2160643154 >> v1:172.21.15.181:6789/0 conn(0x7f58540d1540 legacy=0x7f58540b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 -- 172.21.15.50:0/2160643154 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540d0330 con 0x7f585415e070 2024-09-13T15:11:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f584be00700 1 --2- 172.21.15.50:0/2160643154 >> v2:172.21.15.181:3300/0 conn(0x7f58540d10f0 0x7f58540b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5853400700 1 --2- 172.21.15.50:0/2160643154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585415e070 0x7f58540cd430 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f58540ce350 tx=0x7f5844009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf4cf623ae67a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5852a00700 1 -- 172.21.15.50:0/2160643154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400b8a0 con 0x7f585415e070 2024-09-13T15:11:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5852a00700 1 -- 172.21.15.50:0/2160643154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400ba00 con 0x7f585415e070 2024-09-13T15:11:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.752+0000 7f5852a00700 1 -- 172.21.15.50:0/2160643154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400bd90 con 0x7f585415e070 2024-09-13T15:11:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 -- 172.21.15.50:0/2160643154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585415e070 msgr2=0x7f58540cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 --2- 172.21.15.50:0/2160643154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585415e070 0x7f58540cd430 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f58540ce350 tx=0x7f5844009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 -- 172.21.15.50:0/2160643154 shutdown_connections 2024-09-13T15:11:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 --2- 172.21.15.50:0/2160643154 >> v2:172.21.15.181:3300/0 conn(0x7f58540d10f0 0x7f58540b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 --2- 172.21.15.50:0/2160643154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585415e070 0x7f58540cd430 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 -- 172.21.15.50:0/2160643154 >> 172.21.15.50:0/2160643154 conn(0x7f5854071f00 msgr2=0x7f58540722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 -- 172.21.15.50:0/2160643154 shutdown_connections 2024-09-13T15:11:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 -- 172.21.15.50:0/2160643154 wait complete. 2024-09-13T15:11:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.756+0000 7f5858e00700 1 Processor -- start 2024-09-13T15:11:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 -- start start 2024-09-13T15:11:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 0x7f585406a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58540d1540 0x7f5854150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f585415e070 0x7f585406baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585406aa00 con 0x7f58540d10f0 2024-09-13T15:11:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585406ace0 con 0x7f58540d1540 2024-09-13T15:11:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585406afc0 con 0x7f585415e070 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 0x7f585406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 0x7f585406a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40118/0 (socket says 172.21.15.50:40118) 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 -- 172.21.15.50:0/2855415575 learned_addr learned my addr 172.21.15.50:0/2855415575 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f584be00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58540d1540 0x7f5854150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f585415e070 0x7f585406baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 -- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f585415e070 msgr2=0x7f585406baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f585415e070 0x7f585406baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 -- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58540d1540 msgr2=0x7f5854150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58540d1540 0x7f5854150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 -- 172.21.15.50:0/2855415575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009570 con 0x7f58540d10f0 2024-09-13T15:11:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5853400700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 0x7f585406a390 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5844000c00 tx=0x7f5844004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58440038c0 con 0x7f58540d10f0 2024-09-13T15:11:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5844003a20 con 0x7f58540d10f0 2024-09-13T15:11:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844003d90 con 0x7f58540d10f0 2024-09-13T15:11:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.760+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585406b2a0 con 0x7f58540d10f0 2024-09-13T15:11:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.764+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5854151370 con 0x7f58540d10f0 2024-09-13T15:11:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.764+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585406b7c0 con 0x7f58540d10f0 2024-09-13T15:11:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.764+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5844011420 con 0x7f58540d10f0 2024-09-13T15:11:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.768+0000 7f584b400700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5830066730 0x7f5830068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.768+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5844020030 con 0x7f58540d10f0 2024-09-13T15:11:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.768+0000 7f584be00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5830066730 0x7f5830068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.768+0000 7f584be00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5830066730 0x7f5830068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f58541f5c40 tx=0x7f583c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.772+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f585406b7c0 con 0x7f58540d10f0 2024-09-13T15:11:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.968+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58540d0bd0 con 0x7f5830066730 2024-09-13T15:11:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.988+0000 7f584b400700 1 -- 172.21.15.50:0/2855415575 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272313 (secure 0 0 0) 0x7f583c00c5b0 con 0x7f5830066730 2024-09-13T15:11:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5830066730 msgr2=0x7f5830068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5830066730 0x7f5830068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f58541f5c40 tx=0x7f583c008040 comp rx=0 tx=0).stop 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 msgr2=0x7f585406a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 0x7f585406a390 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5844000c00 tx=0x7f5844004770 comp rx=0 tx=0).stop 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 shutdown_connections 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5830066730 0x7f5830068bf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f585415e070 0x7f585406baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58540d1540 0x7f5854150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 --2- 172.21.15.50:0/2855415575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58540d10f0 0x7f585406a390 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 >> 172.21.15.50:0/2855415575 conn(0x7f5854071f00 msgr2=0x7f58540b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 shutdown_connections 2024-09-13T15:11:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:31.996+0000 7f5858e00700 1 -- 172.21.15.50:0/2855415575 wait complete. 2024-09-13T15:11:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:11:32.021 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-13T15:11:30.091026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":246040,"kb_used_data":9340,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728680,"statfs":{"total":773094113280,"available":772842168320,"internally_reserved":0,"allocated":9564160,"data_stored":4935279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001339"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:27.138078+0000","last_change":"2024-09-13T15:11:27.138078+0000","last_active":"2024-09-13T15:11:27.138078+0000","last_peered":"2024-09-13T15:11:27.138078+0000","last_clean":"2024-09-13T15:11:27.138078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:27.138078+0000","last_undegraded":"2024-09-13T15:11:27.138078+0000","last_fullsized":"2024-09-13T15:11:27.138078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:11:26.126904+0000","last_change":"2024-09-13T15:11:26.126904+0000","last_active":"2024-09-13T15:11:26.126904+0000","last_peered":"2024-09-13T15:11:26.126904+0000","last_clean":"2024-09-13T15:11:26.126904+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:11:26.126904+0000","last_undegraded":"2024-09-13T15:11:26.126904+0000","last_fullsized":"2024-09-13T15:11:26.126904+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T15:11:22.467600+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:11:22.467600+0000","last_peered":"2024-09-13T15:11:22.467600+0000","last_clean":"2024-09-13T15:11:22.467600+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:11:22.467600+0000","last_undegraded":"2024-09-13T15:11:22.467600+0000","last_fullsized":"2024-09-13T15:11:22.467600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1642496,"data_stored":1060068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.159,"15min":1.1830000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6180000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.73099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5369999999999999,"5min":1.839,"15min":1.839},"last":1.1759999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.3009999999999999,"15min":1.359},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4059999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.024},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.212,"15min":1.258},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.577,"15min":1.577},"last":1.3680000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.329,"15min":1.391},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.409},{"interface":"front","average":{"1min":1.264,"5min":1.3260000000000001,"15min":1.363},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.5309999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3999999999999999,"15min":1.4379999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.46,"15min":1.532},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.681,"5min":2.081,"15min":2.081},"last":1.625}]},{"osd":4,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.29,"15min":1.3700000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5580000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.3680000000000001,"15min":1.4370000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6180000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.2729999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5049999999999999,"15min":1.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.917,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4370000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5129999999999999,"15min":1.6040000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.5669999999999999,"15min":1.6499999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7190000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.5109999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1044480,"data_stored":468681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.157,"15min":1.1970000000000001},"min":{"1min":0.751,"5min":0.749,"15min":0.749},"max":{"1min":1.3979999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3819999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4390000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.534,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.355},{"interface":"front","average":{"1min":1.159,"5min":1.2849999999999999,"15min":1.345},"min":{"1min":0.86899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.619,"5min":2.282,"15min":2.282},"last":1.4890000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2589999999999999,"15min":1.2949999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.5069999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.353,"15min":1.395},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.484,"5min":1.986,"15min":1.986},"last":1.268}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2969999999999999,"15min":1.3180000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6140000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.341,"15min":1.391},"min":{"1min":0.96099999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.6180000000000001,"5min":2.371,"15min":2.371},"last":1.577}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.325,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4630000000000001,"5min":2.835,"15min":2.835},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.3180000000000001,"15min":1.381},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5800000000000001,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.198}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6699999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.5389999999999999,"15min":1.605},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.74,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.3859999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.413,"15min":1.4450000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.538,"5min":2.444,"15min":2.444},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.5109999999999999,"15min":1.5509999999999999},"min":{"1min":0.92000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.7909999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.522}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1048576,"data_stored":469700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2390000000000001,"15min":1.304},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.2729999999999999,"15min":1.3700000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.9390000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2450000000000001,"15min":1.2829999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.488,"5min":1.976,"15min":1.976},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.224,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.587,"5min":2.665,"15min":2.665},"last":1.51}]},{"osd":2,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.236,"15min":1.27},"min":{"1min":0.79300000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.556,"5min":2.347,"15min":2.347},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3320000000000001,"15min":1.3779999999999999},"min":{"1min":0.73899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6759999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":2.1629999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":0.86399999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.593,"5min":2.524,"15min":2.524},"last":1.8149999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4359999999999999,"15min":1.504},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":2.036}]},{"osd":4,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3959999999999999},"min":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6919999999999999,"5min":2.012,"15min":2.012},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.29,"5min":1.4239999999999999,"15min":1.494},"min":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7569999999999999,"5min":3.117,"15min":3.117},"last":2.1179999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.444,"15min":1.5429999999999999},"min":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.603,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4930000000000001,"15min":1.5880000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6479999999999999,"5min":2.411,"15min":2.411},"last":2.0600000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4790000000000001,"15min":1.5620000000000001},"min":{"1min":0.80800000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.671,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":2.2170000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.579,"15min":1.681},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.694,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":2.3260000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1048576,"data_stored":469700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.139,"15min":1.167},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.597,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.319},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1830000000000001,"15min":1.2030000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.371}]},{"osd":1,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.23,"15min":1.2569999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.651,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.278},{"interface":"front","average":{"1min":1.139,"5min":1.2090000000000001,"15min":1.234},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5609999999999999,"5min":1.794,"15min":1.794},"last":1.101}]},{"osd":2,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.85699999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5269999999999999,"5min":1.621,"15min":1.621},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3320000000000001,"15min":1.347},"min":{"1min":1.0549999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.89800000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.244,"15min":1.2649999999999999},"min":{"1min":0.77500000000000002,"5min":0.754,"15min":0.754},"max":{"1min":1.498,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2989999999999999,"15min":1.341},"min":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.524,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.038}]},{"osd":5,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3480000000000001,"15min":1.3799999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.0219999999999998,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.375,"15min":1.399},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.9099999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.268,"15min":1.304},"min":{"1min":0.77400000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7,"5min":2.214,"15min":2.214},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.4159999999999999,"15min":1.4490000000000001},"min":{"1min":0.89000000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.077}]},{"osd":7,"last update":"Fri Sep 13 15:10:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4099999999999999,"15min":1.4490000000000001},"min":{"1min":0.95999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7390000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.325,"5min":1.4490000000000001,"15min":1.496},"min":{"1min":0.98099999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.677,"5min":2.524,"15min":2.524},"last":1.2470000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1044480,"data_stored":468681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0589999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.419,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.0549999999999999,"15min":1.079},"min":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3959999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.02,"15min":1.073},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9379999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.03},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.2130000000000001},"min":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.306,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.133,"15min":1.2030000000000001},"min":{"1min":0.71599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.603,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.091},{"interface":"front","average":{"1min":1.085,"5min":1.286,"15min":1.3580000000000001},"min":{"1min":0.70299999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5069999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.337,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7529999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.3859999999999999,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1669999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.371}]},{"osd":5,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4390000000000001,"15min":1.5129999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.802,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.581,"15min":1.6739999999999999},"min":{"1min":1.0660000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.55,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4399999999999999,"15min":1.4970000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.605,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.494},{"interface":"front","average":{"1min":1.383,"5min":1.5029999999999999,"15min":1.5669999999999999},"min":{"1min":0.90300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0800000000000001,"5min":3.786,"15min":3.786},"last":1.6299999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.6859999999999999,"15min":1.7829999999999999},"min":{"1min":1.1890000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7529999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.5980000000000001,"15min":1.671},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.782,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.2330000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":1048576,"data_stored":469700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.5,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":1.393,"15min":1.393},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.028,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.73699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4630000000000001,"5min":1.643,"15min":1.643},"last":1.0629999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.54200000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.069,"15min":1.113},"min":{"1min":0.78600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4319999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.081},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.302,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.343,"15min":1.3839999999999999},"min":{"1min":0.93700000000000006,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.494,"5min":2.657,"15min":2.657},"last":1.345},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.4490000000000001,"15min":1.5},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5569999999999999,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.3160000000000001},"min":{"1min":0.95999999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.385,"15min":1.395},"min":{"1min":1.0089999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.609,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1220000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.446,"15min":1.486},"min":{"1min":0.95499999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0459999999999998,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.4359999999999999,"15min":1.468},"min":{"1min":1.0369999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.849,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5589999999999999},"min":{"1min":1.1359999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.1480000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.383},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5580000000000001},"min":{"1min":1.2310000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7689999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.411}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":1048576,"data_stored":469700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88300000000000001,"15min":0.86099999999999999},"min":{"1min":0.50900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.274},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99099999999999999,"15min":1.0109999999999999},"min":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.722,"15min":1.722},"last":1.5209999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.875,"15min":0.89200000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.321,"5min":1.502,"15min":1.502},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.042,"15min":1.0529999999999999},"min":{"1min":0.71699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.7110000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5780000000000001,"5min":1.764,"15min":1.764},"last":1.4930000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0900000000000001,"15min":1.143},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.242,"5min":3.254,"15min":3.254},"last":1.431}]},{"osd":4,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1759999999999999,"15min":1.1930000000000001},"min":{"1min":0.877,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5229999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.641},{"interface":"front","average":{"1min":1.335,"5min":1.3540000000000001,"15min":1.3759999999999999},"min":{"1min":1.0660000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.762,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.5720000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.377,"15min":1.4370000000000001},"min":{"1min":0.91200000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6639999999999999,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.325,"15min":1.367},"min":{"1min":0.92000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5960000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.79}]},{"osd":6,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4790000000000001,"15min":1.5169999999999999},"min":{"1min":0.98599999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.9410000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4950000000000001,"15min":1.5669999999999999},"min":{"1min":0.92100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7270000000000001,"5min":4.843,"15min":4.843},"last":1.746}]},{"osd":7,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.6040000000000001,"15min":1.7030000000000001},"min":{"1min":1.113,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.6399999999999999,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.821},{"interface":"front","average":{"1min":1.335,"5min":1.45,"15min":1.5},"min":{"1min":0.93700000000000006,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.768,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.895}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1638400,"data_stored":1059049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91800000000000004,"15min":0.90400000000000003},"min":{"1min":0.56599999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.3959999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2210000000000001,"15min":1.3089999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.371,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.1899999999999999,"15min":1.3200000000000001},"min":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2649999999999999,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.747}]},{"osd":3,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.119,"15min":1.159},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4430000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.375},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3029999999999999,"15min":1.3049999999999999},"min":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.724,"5min":2.157,"15min":2.157},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.95499999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.8260000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.661,"5min":1.827,"15min":1.827},"last":1.2290000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.345,"15min":1.3859999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.54,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3700000000000001,"15min":1.3919999999999999},"min":{"1min":0.98099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.7330000000000001,"5min":2.367,"15min":2.367},"last":1.165}]},{"osd":6,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.472,"15min":1.488},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.8690000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.341},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.478},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.752,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.03}]},{"osd":7,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.49,"15min":1.538},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8879999999999999,"5min":3.302,"15min":3.302},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.359,"5min":1.4399999999999999,"15min":1.47},"min":{"1min":1.0409999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.788,"5min":2.266,"15min":2.266},"last":1.298}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:11:32.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:11:32.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.228+0000 7f15bb200700 1 Processor -- start 2024-09-13T15:11:32.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.228+0000 7f15bb200700 1 -- start start 2024-09-13T15:11:32.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15bb200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f15bc15e070 0x7f15bc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15bb200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15bc0b2c50 0x7f15bc0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15bb200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc0cd970 con 0x7f15bc0d10f0 2024-09-13T15:11:32.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15bb200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc15e450 con 0x7f15bc0b2c50 2024-09-13T15:11:32.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15bb200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc0d0050 con 0x7f15bc15e070 2024-09-13T15:11:32.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15ba800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15bc0b2c50 0x7f15bc0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15b9e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f15bc15e070 0x7f15bc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15b9400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f15bc0d10f0 0x7f15bc0b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:52998/0 (socket says 172.21.15.50:52998) 2024-09-13T15:11:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15b9400700 1 -- 172.21.15.50:0/1457711546 learned_addr learned my addr 172.21.15.50:0/1457711546 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15ba800700 1 -- 172.21.15.50:0/1457711546 >> v2:172.21.15.181:3300/0 conn(0x7f15bc15e070 msgr2=0x7f15bc0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15ba800700 1 --2- 172.21.15.50:0/1457711546 >> v2:172.21.15.181:3300/0 conn(0x7f15bc15e070 0x7f15bc0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15ba800700 1 -- 172.21.15.50:0/1457711546 >> v1:172.21.15.181:6789/0 conn(0x7f15bc0d10f0 legacy=0x7f15bc0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15ba800700 1 -- 172.21.15.50:0/1457711546 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0d0330 con 0x7f15bc0b2c50 2024-09-13T15:11:32.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15ba800700 1 --2- 172.21.15.50:0/1457711546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc0b2c50 0x7f15bc0b38b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0d1ac0 tx=0x7f15b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce23cf99e9af424 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15b8a00700 1 -- 172.21.15.50:0/1457711546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400e070 con 0x7f15bc0b2c50 2024-09-13T15:11:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15b8a00700 1 -- 172.21.15.50:0/1457711546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400bb20 con 0x7f15bc0b2c50 2024-09-13T15:11:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.232+0000 7f15b8a00700 1 -- 172.21.15.50:0/1457711546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4012430 con 0x7f15bc0b2c50 2024-09-13T15:11:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 -- 172.21.15.50:0/1457711546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc0b2c50 msgr2=0x7f15bc0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 --2- 172.21.15.50:0/1457711546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc0b2c50 0x7f15bc0b38b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0d1ac0 tx=0x7f15b400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 -- 172.21.15.50:0/1457711546 shutdown_connections 2024-09-13T15:11:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 --2- 172.21.15.50:0/1457711546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc0b2c50 0x7f15bc0b38b0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 --2- 172.21.15.50:0/1457711546 >> v2:172.21.15.181:3300/0 conn(0x7f15bc15e070 0x7f15bc0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 -- 172.21.15.50:0/1457711546 >> 172.21.15.50:0/1457711546 conn(0x7f15bc071f00 msgr2=0x7f15bc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 -- 172.21.15.50:0/1457711546 shutdown_connections 2024-09-13T15:11:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.236+0000 7f15bb200700 1 -- 172.21.15.50:0/1457711546 wait complete. 2024-09-13T15:11:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 Processor -- start 2024-09-13T15:11:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 -- start start 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15bc0b2c50 0x7f15bc153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc0d10f0 0x7f15bc0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 0x7f15bc0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc154190 con 0x7f15bc15e070 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b5830 con 0x7f15bc0d10f0 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b3c00 con 0x7f15bc0b2c50 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 0x7f15bc0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 0x7f15bc0b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40136/0 (socket says 172.21.15.50:40136) 2024-09-13T15:11:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 -- 172.21.15.50:0/1823467167 learned_addr learned my addr 172.21.15.50:0/1823467167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15b9400700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc0d10f0 0x7f15bc0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15b9e00700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15bc0b2c50 0x7f15bc153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 -- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15bc0b2c50 msgr2=0x7f15bc153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15bc0b2c50 0x7f15bc153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 -- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc0d10f0 msgr2=0x7f15bc0ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc0d10f0 0x7f15bc0ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 -- 172.21.15.50:0/1823467167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009a70 con 0x7f15bc15e070 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15b9400700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc0d10f0 0x7f15bc0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15ba800700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 0x7f15bc0b4090 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f15bc072b20 tx=0x7f15b4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4012430 con 0x7f15bc15e070 2024-09-13T15:11:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4020070 con 0x7f15bc15e070 2024-09-13T15:11:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc0aed30 con 0x7f15bc15e070 2024-09-13T15:11:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.240+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4004280 con 0x7f15bc15e070 2024-09-13T15:11:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.244+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0aefd0 con 0x7f15bc15e070 2024-09-13T15:11:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.244+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc0cd3c0 con 0x7f15bc15e070 2024-09-13T15:11:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.244+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15b40043e0 con 0x7f15bc15e070 2024-09-13T15:11:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.248+0000 7f15b2000700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1598066730 0x7f1598068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.248+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15b4022070 con 0x7f15bc15e070 2024-09-13T15:11:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.248+0000 7f15b9e00700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1598066730 0x7f1598068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.248+0000 7f15b9e00700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1598066730 0x7f1598068bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009ae0 tx=0x7f15ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.252+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15b4053230 con 0x7f15bc15e070 2024-09-13T15:11:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.436+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15bc0af8e0 con 0x7f1598066730 2024-09-13T15:11:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.452+0000 7f15b2000700 1 -- 172.21.15.50:0/1823467167 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287091 (secure 0 0 0) 0x7f15bc0af8e0 con 0x7f1598066730 2024-09-13T15:11:32.461 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1598066730 msgr2=0x7f1598068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1598066730 0x7f1598068bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009ae0 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2024-09-13T15:11:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 msgr2=0x7f15bc0b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 0x7f15bc0b4090 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f15bc072b20 tx=0x7f15b4004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 shutdown_connections 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1598066730 0x7f1598068bf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15bc15e070 0x7f15bc0b4090 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc0d10f0 0x7f15bc0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 --2- 172.21.15.50:0/1823467167 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f15bc0b2c50 0x7f15bc153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 >> 172.21.15.50:0/1823467167 conn(0x7f15bc071f00 msgr2=0x7f15bc0cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 shutdown_connections 2024-09-13T15:11:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.460+0000 7f15bb200700 1 -- 172.21.15.50:0/1823467167 wait complete. 2024-09-13T15:11:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:11:32.487 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-13T15:11:32.091658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246436,"kb_used_data":9776,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728284,"statfs":{"total":773094113280,"available":772841762816,"internally_reserved":0,"allocated":10010624,"data_stored":5144959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.951291"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.886555+0000","last_change":"2024-09-13T15:11:27.666746+0000","last_active":"2024-09-13T15:11:29.886555+0000","last_peered":"2024-09-13T15:11:29.886555+0000","last_clean":"2024-09-13T15:11:29.886555+0000","last_became_active":"2024-09-13T15:11:27.666505+0000","last_became_peered":"2024-09-13T15:11:27.666505+0000","last_unstale":"2024-09-13T15:11:29.886555+0000","last_undegraded":"2024-09-13T15:11:29.886555+0000","last_fullsized":"2024-09-13T15:11:29.886555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:39.744555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480072+0000","last_change":"2024-09-13T15:11:27.642231+0000","last_active":"2024-09-13T15:11:30.480072+0000","last_peered":"2024-09-13T15:11:30.480072+0000","last_clean":"2024-09-13T15:11:30.480072+0000","last_became_active":"2024-09-13T15:11:27.641921+0000","last_became_peered":"2024-09-13T15:11:27.641921+0000","last_unstale":"2024-09-13T15:11:30.480072+0000","last_undegraded":"2024-09-13T15:11:30.480072+0000","last_fullsized":"2024-09-13T15:11:30.480072+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:11.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.886325+0000","last_change":"2024-09-13T15:11:27.651207+0000","last_active":"2024-09-13T15:11:29.886325+0000","last_peered":"2024-09-13T15:11:29.886325+0000","last_clean":"2024-09-13T15:11:29.886325+0000","last_became_active":"2024-09-13T15:11:27.649781+0000","last_became_peered":"2024-09-13T15:11:27.649781+0000","last_unstale":"2024-09-13T15:11:29.886325+0000","last_undegraded":"2024-09-13T15:11:29.886325+0000","last_fullsized":"2024-09-13T15:11:29.886325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:15.519401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.642030+0000","last_change":"2024-09-13T15:11:27.665100+0000","last_active":"2024-09-13T15:11:28.642030+0000","last_peered":"2024-09-13T15:11:28.642030+0000","last_clean":"2024-09-13T15:11:28.642030+0000","last_became_active":"2024-09-13T15:11:27.664596+0000","last_became_peered":"2024-09-13T15:11:27.664596+0000","last_unstale":"2024-09-13T15:11:28.642030+0000","last_undegraded":"2024-09-13T15:11:28.642030+0000","last_fullsized":"2024-09-13T15:11:28.642030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639248+0000","last_change":"2024-09-13T15:11:27.654758+0000","last_active":"2024-09-13T15:11:28.639248+0000","last_peered":"2024-09-13T15:11:28.639248+0000","last_clean":"2024-09-13T15:11:28.639248+0000","last_became_active":"2024-09-13T15:11:27.651964+0000","last_became_peered":"2024-09-13T15:11:27.651964+0000","last_unstale":"2024-09-13T15:11:28.639248+0000","last_undegraded":"2024-09-13T15:11:28.639248+0000","last_fullsized":"2024-09-13T15:11:28.639248+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639654+0000","last_change":"2024-09-13T15:11:27.675607+0000","last_active":"2024-09-13T15:11:28.639654+0000","last_peered":"2024-09-13T15:11:28.639654+0000","last_clean":"2024-09-13T15:11:28.639654+0000","last_became_active":"2024-09-13T15:11:27.675372+0000","last_became_peered":"2024-09-13T15:11:27.675372+0000","last_unstale":"2024-09-13T15:11:28.639654+0000","last_undegraded":"2024-09-13T15:11:28.639654+0000","last_fullsized":"2024-09-13T15:11:28.639654+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:54.457221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479027+0000","last_change":"2024-09-13T15:11:27.665978+0000","last_active":"2024-09-13T15:11:30.479027+0000","last_peered":"2024-09-13T15:11:30.479027+0000","last_clean":"2024-09-13T15:11:30.479027+0000","last_became_active":"2024-09-13T15:11:27.665640+0000","last_became_peered":"2024-09-13T15:11:27.665640+0000","last_unstale":"2024-09-13T15:11:30.479027+0000","last_undegraded":"2024-09-13T15:11:30.479027+0000","last_fullsized":"2024-09-13T15:11:30.479027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:16.430990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641270+0000","last_change":"2024-09-13T15:11:27.673385+0000","last_active":"2024-09-13T15:11:28.641270+0000","last_peered":"2024-09-13T15:11:28.641270+0000","last_clean":"2024-09-13T15:11:28.641270+0000","last_became_active":"2024-09-13T15:11:27.673079+0000","last_became_peered":"2024-09-13T15:11:27.673079+0000","last_unstale":"2024-09-13T15:11:28.641270+0000","last_undegraded":"2024-09-13T15:11:28.641270+0000","last_fullsized":"2024-09-13T15:11:28.641270+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:04.120826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639139+0000","last_change":"2024-09-13T15:11:27.649371+0000","last_active":"2024-09-13T15:11:28.639139+0000","last_peered":"2024-09-13T15:11:28.639139+0000","last_clean":"2024-09-13T15:11:28.639139+0000","last_became_active":"2024-09-13T15:11:27.648815+0000","last_became_peered":"2024-09-13T15:11:27.648815+0000","last_unstale":"2024-09-13T15:11:28.639139+0000","last_undegraded":"2024-09-13T15:11:28.639139+0000","last_fullsized":"2024-09-13T15:11:28.639139+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:16.523557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.482481+0000","last_change":"2024-09-13T15:11:27.675480+0000","last_active":"2024-09-13T15:11:30.482481+0000","last_peered":"2024-09-13T15:11:30.482481+0000","last_clean":"2024-09-13T15:11:30.482481+0000","last_became_active":"2024-09-13T15:11:27.675230+0000","last_became_peered":"2024-09-13T15:11:27.675230+0000","last_unstale":"2024-09-13T15:11:30.482481+0000","last_undegraded":"2024-09-13T15:11:30.482481+0000","last_fullsized":"2024-09-13T15:11:30.482481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:03.423917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639414+0000","last_change":"2024-09-13T15:11:27.662407+0000","last_active":"2024-09-13T15:11:28.639414+0000","last_peered":"2024-09-13T15:11:28.639414+0000","last_clean":"2024-09-13T15:11:28.639414+0000","last_became_active":"2024-09-13T15:11:27.661596+0000","last_became_peered":"2024-09-13T15:11:27.661596+0000","last_unstale":"2024-09-13T15:11:28.639414+0000","last_undegraded":"2024-09-13T15:11:28.639414+0000","last_fullsized":"2024-09-13T15:11:28.639414+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:16.153743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.482132+0000","last_change":"2024-09-13T15:11:27.645924+0000","last_active":"2024-09-13T15:11:30.482132+0000","last_peered":"2024-09-13T15:11:30.482132+0000","last_clean":"2024-09-13T15:11:30.482132+0000","last_became_active":"2024-09-13T15:11:27.645621+0000","last_became_peered":"2024-09-13T15:11:27.645621+0000","last_unstale":"2024-09-13T15:11:30.482132+0000","last_undegraded":"2024-09-13T15:11:30.482132+0000","last_fullsized":"2024-09-13T15:11:30.482132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:24.436948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.642404+0000","last_change":"2024-09-13T15:11:27.666009+0000","last_active":"2024-09-13T15:11:28.642404+0000","last_peered":"2024-09-13T15:11:28.642404+0000","last_clean":"2024-09-13T15:11:28.642404+0000","last_became_active":"2024-09-13T15:11:27.663778+0000","last_became_peered":"2024-09-13T15:11:27.663778+0000","last_unstale":"2024-09-13T15:11:28.642404+0000","last_undegraded":"2024-09-13T15:11:28.642404+0000","last_fullsized":"2024-09-13T15:11:28.642404+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:18.541562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639075+0000","last_change":"2024-09-13T15:11:27.673607+0000","last_active":"2024-09-13T15:11:28.639075+0000","last_peered":"2024-09-13T15:11:28.639075+0000","last_clean":"2024-09-13T15:11:28.639075+0000","last_became_active":"2024-09-13T15:11:27.673315+0000","last_became_peered":"2024-09-13T15:11:27.673315+0000","last_unstale":"2024-09-13T15:11:28.639075+0000","last_undegraded":"2024-09-13T15:11:28.639075+0000","last_fullsized":"2024-09-13T15:11:28.639075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:25.344851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641466+0000","last_change":"2024-09-13T15:11:27.665455+0000","last_active":"2024-09-13T15:11:28.641466+0000","last_peered":"2024-09-13T15:11:28.641466+0000","last_clean":"2024-09-13T15:11:28.641466+0000","last_became_active":"2024-09-13T15:11:27.664080+0000","last_became_peered":"2024-09-13T15:11:27.664080+0000","last_unstale":"2024-09-13T15:11:28.641466+0000","last_undegraded":"2024-09-13T15:11:28.641466+0000","last_fullsized":"2024-09-13T15:11:28.641466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:38.298643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639243+0000","last_change":"2024-09-13T15:11:27.673997+0000","last_active":"2024-09-13T15:11:28.639243+0000","last_peered":"2024-09-13T15:11:28.639243+0000","last_clean":"2024-09-13T15:11:28.639243+0000","last_became_active":"2024-09-13T15:11:27.673613+0000","last_became_peered":"2024-09-13T15:11:27.673613+0000","last_unstale":"2024-09-13T15:11:28.639243+0000","last_undegraded":"2024-09-13T15:11:28.639243+0000","last_fullsized":"2024-09-13T15:11:28.639243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:38.267907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640592+0000","last_change":"2024-09-13T15:11:27.668164+0000","last_active":"2024-09-13T15:11:28.640592+0000","last_peered":"2024-09-13T15:11:28.640592+0000","last_clean":"2024-09-13T15:11:28.640592+0000","last_became_active":"2024-09-13T15:11:27.667902+0000","last_became_peered":"2024-09-13T15:11:27.667902+0000","last_unstale":"2024-09-13T15:11:28.640592+0000","last_undegraded":"2024-09-13T15:11:28.640592+0000","last_fullsized":"2024-09-13T15:11:28.640592+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:01.972886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.886361+0000","last_change":"2024-09-13T15:11:27.651837+0000","last_active":"2024-09-13T15:11:29.886361+0000","last_peered":"2024-09-13T15:11:29.886361+0000","last_clean":"2024-09-13T15:11:29.886361+0000","last_became_active":"2024-09-13T15:11:27.651607+0000","last_became_peered":"2024-09-13T15:11:27.651607+0000","last_unstale":"2024-09-13T15:11:29.886361+0000","last_undegraded":"2024-09-13T15:11:29.886361+0000","last_fullsized":"2024-09-13T15:11:29.886361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:27.024274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639569+0000","last_change":"2024-09-13T15:11:27.673817+0000","last_active":"2024-09-13T15:11:28.639569+0000","last_peered":"2024-09-13T15:11:28.639569+0000","last_clean":"2024-09-13T15:11:28.639569+0000","last_became_active":"2024-09-13T15:11:27.673524+0000","last_became_peered":"2024-09-13T15:11:27.673524+0000","last_unstale":"2024-09-13T15:11:28.639569+0000","last_undegraded":"2024-09-13T15:11:28.639569+0000","last_fullsized":"2024-09-13T15:11:28.639569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:57.390087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641973+0000","last_change":"2024-09-13T15:11:27.662245+0000","last_active":"2024-09-13T15:11:28.641973+0000","last_peered":"2024-09-13T15:11:28.641973+0000","last_clean":"2024-09-13T15:11:28.641973+0000","last_became_active":"2024-09-13T15:11:27.661980+0000","last_became_peered":"2024-09-13T15:11:27.661980+0000","last_unstale":"2024-09-13T15:11:28.641973+0000","last_undegraded":"2024-09-13T15:11:28.641973+0000","last_fullsized":"2024-09-13T15:11:28.641973+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:11.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.638926+0000","last_change":"2024-09-13T15:11:27.654148+0000","last_active":"2024-09-13T15:11:28.638926+0000","last_peered":"2024-09-13T15:11:28.638926+0000","last_clean":"2024-09-13T15:11:28.638926+0000","last_became_active":"2024-09-13T15:11:27.653906+0000","last_became_peered":"2024-09-13T15:11:27.653906+0000","last_unstale":"2024-09-13T15:11:28.638926+0000","last_undegraded":"2024-09-13T15:11:28.638926+0000","last_fullsized":"2024-09-13T15:11:28.638926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:55.365660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.638840+0000","last_change":"2024-09-13T15:11:27.673633+0000","last_active":"2024-09-13T15:11:28.638840+0000","last_peered":"2024-09-13T15:11:28.638840+0000","last_clean":"2024-09-13T15:11:28.638840+0000","last_became_active":"2024-09-13T15:11:27.673305+0000","last_became_peered":"2024-09-13T15:11:27.673305+0000","last_unstale":"2024-09-13T15:11:28.638840+0000","last_undegraded":"2024-09-13T15:11:28.638840+0000","last_fullsized":"2024-09-13T15:11:28.638840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:48.359736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479373+0000","last_change":"2024-09-13T15:11:27.668134+0000","last_active":"2024-09-13T15:11:30.479373+0000","last_peered":"2024-09-13T15:11:30.479373+0000","last_clean":"2024-09-13T15:11:30.479373+0000","last_became_active":"2024-09-13T15:11:27.667441+0000","last_became_peered":"2024-09-13T15:11:27.667441+0000","last_unstale":"2024-09-13T15:11:30.479373+0000","last_undegraded":"2024-09-13T15:11:30.479373+0000","last_fullsized":"2024-09-13T15:11:30.479373+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:42.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.885947+0000","last_change":"2024-09-13T15:11:27.655643+0000","last_active":"2024-09-13T15:11:29.885947+0000","last_peered":"2024-09-13T15:11:29.885947+0000","last_clean":"2024-09-13T15:11:29.885947+0000","last_became_active":"2024-09-13T15:11:27.655390+0000","last_became_peered":"2024-09-13T15:11:27.655390+0000","last_unstale":"2024-09-13T15:11:29.885947+0000","last_undegraded":"2024-09-13T15:11:29.885947+0000","last_fullsized":"2024-09-13T15:11:29.885947+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:50.843078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480360+0000","last_change":"2024-09-13T15:11:27.652126+0000","last_active":"2024-09-13T15:11:30.480360+0000","last_peered":"2024-09-13T15:11:30.480360+0000","last_clean":"2024-09-13T15:11:30.480360+0000","last_became_active":"2024-09-13T15:11:27.651918+0000","last_became_peered":"2024-09-13T15:11:27.651918+0000","last_unstale":"2024-09-13T15:11:30.480360+0000","last_undegraded":"2024-09-13T15:11:30.480360+0000","last_fullsized":"2024-09-13T15:11:30.480360+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:37.722836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639394+0000","last_change":"2024-09-13T15:11:27.673391+0000","last_active":"2024-09-13T15:11:28.639394+0000","last_peered":"2024-09-13T15:11:28.639394+0000","last_clean":"2024-09-13T15:11:28.639394+0000","last_became_active":"2024-09-13T15:11:27.673103+0000","last_became_peered":"2024-09-13T15:11:27.673103+0000","last_unstale":"2024-09-13T15:11:28.639394+0000","last_undegraded":"2024-09-13T15:11:28.639394+0000","last_fullsized":"2024-09-13T15:11:28.639394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:01.458498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.482222+0000","last_change":"2024-09-13T15:11:27.652269+0000","last_active":"2024-09-13T15:11:30.482222+0000","last_peered":"2024-09-13T15:11:30.482222+0000","last_clean":"2024-09-13T15:11:30.482222+0000","last_became_active":"2024-09-13T15:11:27.652030+0000","last_became_peered":"2024-09-13T15:11:27.652030+0000","last_unstale":"2024-09-13T15:11:30.482222+0000","last_undegraded":"2024-09-13T15:11:30.482222+0000","last_fullsized":"2024-09-13T15:11:30.482222+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:16.779828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.642233+0000","last_change":"2024-09-13T15:11:27.677311+0000","last_active":"2024-09-13T15:11:28.642233+0000","last_peered":"2024-09-13T15:11:28.642233+0000","last_clean":"2024-09-13T15:11:28.642233+0000","last_became_active":"2024-09-13T15:11:27.675668+0000","last_became_peered":"2024-09-13T15:11:27.675668+0000","last_unstale":"2024-09-13T15:11:28.642233+0000","last_undegraded":"2024-09-13T15:11:28.642233+0000","last_fullsized":"2024-09-13T15:11:28.642233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:37.722836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480258+0000","last_change":"2024-09-13T15:11:27.652980+0000","last_active":"2024-09-13T15:11:30.480258+0000","last_peered":"2024-09-13T15:11:30.480258+0000","last_clean":"2024-09-13T15:11:30.480258+0000","last_became_active":"2024-09-13T15:11:27.652681+0000","last_became_peered":"2024-09-13T15:11:27.652681+0000","last_unstale":"2024-09-13T15:11:30.480258+0000","last_undegraded":"2024-09-13T15:11:30.480258+0000","last_fullsized":"2024-09-13T15:11:30.480258+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.389867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639238+0000","last_change":"2024-09-13T15:11:27.642952+0000","last_active":"2024-09-13T15:11:28.639238+0000","last_peered":"2024-09-13T15:11:28.639238+0000","last_clean":"2024-09-13T15:11:28.639238+0000","last_became_active":"2024-09-13T15:11:27.642335+0000","last_became_peered":"2024-09-13T15:11:27.642335+0000","last_unstale":"2024-09-13T15:11:28.639238+0000","last_undegraded":"2024-09-13T15:11:28.639238+0000","last_fullsized":"2024-09-13T15:11:28.639238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:31.641403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479735+0000","last_change":"2024-09-13T15:11:27.663843+0000","last_active":"2024-09-13T15:11:30.479735+0000","last_peered":"2024-09-13T15:11:30.479735+0000","last_clean":"2024-09-13T15:11:30.479735+0000","last_became_active":"2024-09-13T15:11:27.663576+0000","last_became_peered":"2024-09-13T15:11:27.663576+0000","last_unstale":"2024-09-13T15:11:30.479735+0000","last_undegraded":"2024-09-13T15:11:30.479735+0000","last_fullsized":"2024-09-13T15:11:30.479735+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639243+0000","last_change":"2024-09-13T15:11:27.673849+0000","last_active":"2024-09-13T15:11:28.639243+0000","last_peered":"2024-09-13T15:11:28.639243+0000","last_clean":"2024-09-13T15:11:28.639243+0000","last_became_active":"2024-09-13T15:11:27.673287+0000","last_became_peered":"2024-09-13T15:11:27.673287+0000","last_unstale":"2024-09-13T15:11:28.639243+0000","last_undegraded":"2024-09-13T15:11:28.639243+0000","last_fullsized":"2024-09-13T15:11:28.639243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:38.894621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639821+0000","last_change":"2024-09-13T15:11:27.658879+0000","last_active":"2024-09-13T15:11:28.639821+0000","last_peered":"2024-09-13T15:11:28.639821+0000","last_clean":"2024-09-13T15:11:28.639821+0000","last_became_active":"2024-09-13T15:11:27.658541+0000","last_became_peered":"2024-09-13T15:11:27.658541+0000","last_unstale":"2024-09-13T15:11:28.639821+0000","last_undegraded":"2024-09-13T15:11:28.639821+0000","last_fullsized":"2024-09-13T15:11:28.639821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:21.391809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"88'4","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479752+0000","last_change":"2024-09-13T15:11:27.173259+0000","last_active":"2024-09-13T15:11:30.479752+0000","last_peered":"2024-09-13T15:11:30.479752+0000","last_clean":"2024-09-13T15:11:30.479752+0000","last_became_active":"2024-09-13T15:11:27.173005+0000","last_became_peered":"2024-09-13T15:11:27.173005+0000","last_unstale":"2024-09-13T15:11:30.479752+0000","last_undegraded":"2024-09-13T15:11:30.479752+0000","last_fullsized":"2024-09-13T15:11:30.479752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:10.639245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640716+0000","last_change":"2024-09-13T15:11:27.651825+0000","last_active":"2024-09-13T15:11:28.640716+0000","last_peered":"2024-09-13T15:11:28.640716+0000","last_clean":"2024-09-13T15:11:28.640716+0000","last_became_active":"2024-09-13T15:11:27.651599+0000","last_became_peered":"2024-09-13T15:11:27.651599+0000","last_unstale":"2024-09-13T15:11:28.640716+0000","last_undegraded":"2024-09-13T15:11:28.640716+0000","last_fullsized":"2024-09-13T15:11:28.640716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:42:58.881289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639524+0000","last_change":"2024-09-13T15:11:27.169415+0000","last_active":"2024-09-13T15:11:28.639524+0000","last_peered":"2024-09-13T15:11:28.639524+0000","last_clean":"2024-09-13T15:11:28.639524+0000","last_became_active":"2024-09-13T15:11:27.169158+0000","last_became_peered":"2024-09-13T15:11:27.169158+0000","last_unstale":"2024-09-13T15:11:28.639524+0000","last_undegraded":"2024-09-13T15:11:28.639524+0000","last_fullsized":"2024-09-13T15:11:28.639524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:25.492582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480581+0000","last_change":"2024-09-13T15:11:27.672017+0000","last_active":"2024-09-13T15:11:30.480581+0000","last_peered":"2024-09-13T15:11:30.480581+0000","last_clean":"2024-09-13T15:11:30.480581+0000","last_became_active":"2024-09-13T15:11:27.671796+0000","last_became_peered":"2024-09-13T15:11:27.671796+0000","last_unstale":"2024-09-13T15:11:30.480581+0000","last_undegraded":"2024-09-13T15:11:30.480581+0000","last_fullsized":"2024-09-13T15:11:30.480581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:55.365660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480472+0000","last_change":"2024-09-13T15:11:27.171988+0000","last_active":"2024-09-13T15:11:30.480472+0000","last_peered":"2024-09-13T15:11:30.480472+0000","last_clean":"2024-09-13T15:11:30.480472+0000","last_became_active":"2024-09-13T15:11:27.171742+0000","last_became_peered":"2024-09-13T15:11:27.171742+0000","last_unstale":"2024-09-13T15:11:30.480472+0000","last_undegraded":"2024-09-13T15:11:30.480472+0000","last_fullsized":"2024-09-13T15:11:30.480472+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:17.530388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640795+0000","last_change":"2024-09-13T15:11:27.662847+0000","last_active":"2024-09-13T15:11:28.640795+0000","last_peered":"2024-09-13T15:11:28.640795+0000","last_clean":"2024-09-13T15:11:28.640795+0000","last_became_active":"2024-09-13T15:11:27.660514+0000","last_became_peered":"2024-09-13T15:11:27.660514+0000","last_unstale":"2024-09-13T15:11:28.640795+0000","last_undegraded":"2024-09-13T15:11:28.640795+0000","last_fullsized":"2024-09-13T15:11:28.640795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:50.357051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479821+0000","last_change":"2024-09-13T15:11:27.176321+0000","last_active":"2024-09-13T15:11:30.479821+0000","last_peered":"2024-09-13T15:11:30.479821+0000","last_clean":"2024-09-13T15:11:30.479821+0000","last_became_active":"2024-09-13T15:11:27.175933+0000","last_became_peered":"2024-09-13T15:11:27.175933+0000","last_unstale":"2024-09-13T15:11:30.479821+0000","last_undegraded":"2024-09-13T15:11:30.479821+0000","last_fullsized":"2024-09-13T15:11:30.479821+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.121001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641469+0000","last_change":"2024-09-13T15:11:27.673617+0000","last_active":"2024-09-13T15:11:28.641469+0000","last_peered":"2024-09-13T15:11:28.641469+0000","last_clean":"2024-09-13T15:11:28.641469+0000","last_became_active":"2024-09-13T15:11:27.672292+0000","last_became_peered":"2024-09-13T15:11:27.672292+0000","last_unstale":"2024-09-13T15:11:28.641469+0000","last_undegraded":"2024-09-13T15:11:28.641469+0000","last_fullsized":"2024-09-13T15:11:28.641469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:10.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639114+0000","last_change":"2024-09-13T15:11:27.177992+0000","last_active":"2024-09-13T15:11:28.639114+0000","last_peered":"2024-09-13T15:11:28.639114+0000","last_clean":"2024-09-13T15:11:28.639114+0000","last_became_active":"2024-09-13T15:11:27.177066+0000","last_became_peered":"2024-09-13T15:11:27.177066+0000","last_unstale":"2024-09-13T15:11:28.639114+0000","last_undegraded":"2024-09-13T15:11:28.639114+0000","last_fullsized":"2024-09-13T15:11:28.639114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.225666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479971+0000","last_change":"2024-09-13T15:11:27.659308+0000","last_active":"2024-09-13T15:11:30.479971+0000","last_peered":"2024-09-13T15:11:30.479971+0000","last_clean":"2024-09-13T15:11:30.479971+0000","last_became_active":"2024-09-13T15:11:27.659043+0000","last_became_peered":"2024-09-13T15:11:27.659043+0000","last_unstale":"2024-09-13T15:11:30.479971+0000","last_undegraded":"2024-09-13T15:11:30.479971+0000","last_fullsized":"2024-09-13T15:11:30.479971+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:15.812613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.642324+0000","last_change":"2024-09-13T15:11:27.180114+0000","last_active":"2024-09-13T15:11:28.642324+0000","last_peered":"2024-09-13T15:11:28.642324+0000","last_clean":"2024-09-13T15:11:28.642324+0000","last_became_active":"2024-09-13T15:11:27.179844+0000","last_became_peered":"2024-09-13T15:11:27.179844+0000","last_unstale":"2024-09-13T15:11:28.642324+0000","last_undegraded":"2024-09-13T15:11:28.642324+0000","last_fullsized":"2024-09-13T15:11:28.642324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:42.378441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639727+0000","last_change":"2024-09-13T15:11:27.661204+0000","last_active":"2024-09-13T15:11:28.639727+0000","last_peered":"2024-09-13T15:11:28.639727+0000","last_clean":"2024-09-13T15:11:28.639727+0000","last_became_active":"2024-09-13T15:11:27.660908+0000","last_became_peered":"2024-09-13T15:11:27.660908+0000","last_unstale":"2024-09-13T15:11:28.639727+0000","last_undegraded":"2024-09-13T15:11:28.639727+0000","last_fullsized":"2024-09-13T15:11:28.639727+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:02.878625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.885994+0000","last_change":"2024-09-13T15:11:27.161637+0000","last_active":"2024-09-13T15:11:29.885994+0000","last_peered":"2024-09-13T15:11:29.885994+0000","last_clean":"2024-09-13T15:11:29.885994+0000","last_became_active":"2024-09-13T15:11:27.161445+0000","last_became_peered":"2024-09-13T15:11:27.161445+0000","last_unstale":"2024-09-13T15:11:29.885994+0000","last_undegraded":"2024-09-13T15:11:29.885994+0000","last_fullsized":"2024-09-13T15:11:29.885994+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:15.419816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641976+0000","last_change":"2024-09-13T15:11:27.666224+0000","last_active":"2024-09-13T15:11:28.641976+0000","last_peered":"2024-09-13T15:11:28.641976+0000","last_clean":"2024-09-13T15:11:28.641976+0000","last_became_active":"2024-09-13T15:11:27.665744+0000","last_became_peered":"2024-09-13T15:11:27.665744+0000","last_unstale":"2024-09-13T15:11:28.641976+0000","last_undegraded":"2024-09-13T15:11:28.641976+0000","last_fullsized":"2024-09-13T15:11:28.641976+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:11.489469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479152+0000","last_change":"2024-09-13T15:11:27.169810+0000","last_active":"2024-09-13T15:11:30.479152+0000","last_peered":"2024-09-13T15:11:30.479152+0000","last_clean":"2024-09-13T15:11:30.479152+0000","last_became_active":"2024-09-13T15:11:27.169240+0000","last_became_peered":"2024-09-13T15:11:27.169240+0000","last_unstale":"2024-09-13T15:11:30.479152+0000","last_undegraded":"2024-09-13T15:11:30.479152+0000","last_fullsized":"2024-09-13T15:11:30.479152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:16.371913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639498+0000","last_change":"2024-09-13T15:11:27.643388+0000","last_active":"2024-09-13T15:11:28.639498+0000","last_peered":"2024-09-13T15:11:28.639498+0000","last_clean":"2024-09-13T15:11:28.639498+0000","last_became_active":"2024-09-13T15:11:27.643117+0000","last_became_peered":"2024-09-13T15:11:27.643117+0000","last_unstale":"2024-09-13T15:11:28.639498+0000","last_undegraded":"2024-09-13T15:11:28.639498+0000","last_fullsized":"2024-09-13T15:11:28.639498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.389867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480495+0000","last_change":"2024-09-13T15:11:27.171356+0000","last_active":"2024-09-13T15:11:30.480495+0000","last_peered":"2024-09-13T15:11:30.480495+0000","last_clean":"2024-09-13T15:11:30.480495+0000","last_became_active":"2024-09-13T15:11:27.170975+0000","last_became_peered":"2024-09-13T15:11:27.170975+0000","last_unstale":"2024-09-13T15:11:30.480495+0000","last_undegraded":"2024-09-13T15:11:30.480495+0000","last_fullsized":"2024-09-13T15:11:30.480495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:15.028401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480281+0000","last_change":"2024-09-13T15:11:27.661085+0000","last_active":"2024-09-13T15:11:30.480281+0000","last_peered":"2024-09-13T15:11:30.480281+0000","last_clean":"2024-09-13T15:11:30.480281+0000","last_became_active":"2024-09-13T15:11:27.660798+0000","last_became_peered":"2024-09-13T15:11:27.660798+0000","last_unstale":"2024-09-13T15:11:30.480281+0000","last_undegraded":"2024-09-13T15:11:30.480281+0000","last_fullsized":"2024-09-13T15:11:30.480281+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:16.523557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.886535+0000","last_change":"2024-09-13T15:11:27.170606+0000","last_active":"2024-09-13T15:11:29.886535+0000","last_peered":"2024-09-13T15:11:29.886535+0000","last_clean":"2024-09-13T15:11:29.886535+0000","last_became_active":"2024-09-13T15:11:27.170300+0000","last_became_peered":"2024-09-13T15:11:27.170300+0000","last_unstale":"2024-09-13T15:11:29.886535+0000","last_undegraded":"2024-09-13T15:11:29.886535+0000","last_fullsized":"2024-09-13T15:11:29.886535+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:56.378913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.886426+0000","last_change":"2024-09-13T15:11:27.667796+0000","last_active":"2024-09-13T15:11:29.886426+0000","last_peered":"2024-09-13T15:11:29.886426+0000","last_clean":"2024-09-13T15:11:29.886426+0000","last_became_active":"2024-09-13T15:11:27.667564+0000","last_became_peered":"2024-09-13T15:11:27.667564+0000","last_unstale":"2024-09-13T15:11:29.886426+0000","last_undegraded":"2024-09-13T15:11:29.886426+0000","last_fullsized":"2024-09-13T15:11:29.886426+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:03.144459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"88'3","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639758+0000","last_change":"2024-09-13T15:11:27.176697+0000","last_active":"2024-09-13T15:11:28.639758+0000","last_peered":"2024-09-13T15:11:28.639758+0000","last_clean":"2024-09-13T15:11:28.639758+0000","last_became_active":"2024-09-13T15:11:27.176411+0000","last_became_peered":"2024-09-13T15:11:27.176411+0000","last_unstale":"2024-09-13T15:11:28.639758+0000","last_undegraded":"2024-09-13T15:11:28.639758+0000","last_fullsized":"2024-09-13T15:11:28.639758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:15.028401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.642504+0000","last_change":"2024-09-13T15:11:27.673188+0000","last_active":"2024-09-13T15:11:28.642504+0000","last_peered":"2024-09-13T15:11:28.642504+0000","last_clean":"2024-09-13T15:11:28.642504+0000","last_became_active":"2024-09-13T15:11:27.672914+0000","last_became_peered":"2024-09-13T15:11:27.672914+0000","last_unstale":"2024-09-13T15:11:28.642504+0000","last_undegraded":"2024-09-13T15:11:28.642504+0000","last_fullsized":"2024-09-13T15:11:28.642504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:42.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"88'6","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640277+0000","last_change":"2024-09-13T15:11:27.176159+0000","last_active":"2024-09-13T15:11:28.640277+0000","last_peered":"2024-09-13T15:11:28.640277+0000","last_clean":"2024-09-13T15:11:28.640277+0000","last_became_active":"2024-09-13T15:11:27.175267+0000","last_became_peered":"2024-09-13T15:11:27.175267+0000","last_unstale":"2024-09-13T15:11:28.640277+0000","last_undegraded":"2024-09-13T15:11:28.640277+0000","last_fullsized":"2024-09-13T15:11:28.640277+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:57.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641417+0000","last_change":"2024-09-13T15:11:27.663800+0000","last_active":"2024-09-13T15:11:28.641417+0000","last_peered":"2024-09-13T15:11:28.641417+0000","last_clean":"2024-09-13T15:11:28.641417+0000","last_became_active":"2024-09-13T15:11:27.663242+0000","last_became_peered":"2024-09-13T15:11:27.663242+0000","last_unstale":"2024-09-13T15:11:28.641417+0000","last_undegraded":"2024-09-13T15:11:28.641417+0000","last_fullsized":"2024-09-13T15:11:28.641417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:08.812361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480381+0000","last_change":"2024-09-13T15:11:27.169551+0000","last_active":"2024-09-13T15:11:30.480381+0000","last_peered":"2024-09-13T15:11:30.480381+0000","last_clean":"2024-09-13T15:11:30.480381+0000","last_became_active":"2024-09-13T15:11:27.168995+0000","last_became_peered":"2024-09-13T15:11:27.168995+0000","last_unstale":"2024-09-13T15:11:30.480381+0000","last_undegraded":"2024-09-13T15:11:30.480381+0000","last_fullsized":"2024-09-13T15:11:30.480381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:14.212771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.638641+0000","last_change":"2024-09-13T15:11:27.650220+0000","last_active":"2024-09-13T15:11:28.638641+0000","last_peered":"2024-09-13T15:11:28.638641+0000","last_clean":"2024-09-13T15:11:28.638641+0000","last_became_active":"2024-09-13T15:11:27.649905+0000","last_became_peered":"2024-09-13T15:11:27.649905+0000","last_unstale":"2024-09-13T15:11:28.638641+0000","last_undegraded":"2024-09-13T15:11:28.638641+0000","last_fullsized":"2024-09-13T15:11:28.638641+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:11.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639792+0000","last_change":"2024-09-13T15:11:27.174799+0000","last_active":"2024-09-13T15:11:28.639792+0000","last_peered":"2024-09-13T15:11:28.639792+0000","last_clean":"2024-09-13T15:11:28.639792+0000","last_became_active":"2024-09-13T15:11:27.174062+0000","last_became_peered":"2024-09-13T15:11:27.174062+0000","last_unstale":"2024-09-13T15:11:28.639792+0000","last_undegraded":"2024-09-13T15:11:28.639792+0000","last_fullsized":"2024-09-13T15:11:28.639792+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:01:30.550992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.481774+0000","last_change":"2024-09-13T15:11:27.676101+0000","last_active":"2024-09-13T15:11:30.481774+0000","last_peered":"2024-09-13T15:11:30.481774+0000","last_clean":"2024-09-13T15:11:30.481774+0000","last_became_active":"2024-09-13T15:11:27.675374+0000","last_became_peered":"2024-09-13T15:11:27.675374+0000","last_unstale":"2024-09-13T15:11:30.481774+0000","last_undegraded":"2024-09-13T15:11:30.481774+0000","last_fullsized":"2024-09-13T15:11:30.481774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:15.397438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641762+0000","last_change":"2024-09-13T15:11:27.173256+0000","last_active":"2024-09-13T15:11:28.641762+0000","last_peered":"2024-09-13T15:11:28.641762+0000","last_clean":"2024-09-13T15:11:28.641762+0000","last_became_active":"2024-09-13T15:11:27.172991+0000","last_became_peered":"2024-09-13T15:11:27.172991+0000","last_unstale":"2024-09-13T15:11:28.641762+0000","last_undegraded":"2024-09-13T15:11:28.641762+0000","last_fullsized":"2024-09-13T15:11:28.641762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:10.639245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.482315+0000","last_change":"2024-09-13T15:11:27.646862+0000","last_active":"2024-09-13T15:11:30.482315+0000","last_peered":"2024-09-13T15:11:30.482315+0000","last_clean":"2024-09-13T15:11:30.482315+0000","last_became_active":"2024-09-13T15:11:27.646619+0000","last_became_peered":"2024-09-13T15:11:27.646619+0000","last_unstale":"2024-09-13T15:11:30.482315+0000","last_undegraded":"2024-09-13T15:11:30.482315+0000","last_fullsized":"2024-09-13T15:11:30.482315+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:25:26.654975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"88'8","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.641565+0000","last_change":"2024-09-13T15:11:27.172797+0000","last_active":"2024-09-13T15:11:28.641565+0000","last_peered":"2024-09-13T15:11:28.641565+0000","last_clean":"2024-09-13T15:11:28.641565+0000","last_became_active":"2024-09-13T15:11:27.172448+0000","last_became_peered":"2024-09-13T15:11:27.172448+0000","last_unstale":"2024-09-13T15:11:28.641565+0000","last_undegraded":"2024-09-13T15:11:28.641565+0000","last_fullsized":"2024-09-13T15:11:28.641565+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.121001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640112+0000","last_change":"2024-09-13T15:11:27.658783+0000","last_active":"2024-09-13T15:11:28.640112+0000","last_peered":"2024-09-13T15:11:28.640112+0000","last_clean":"2024-09-13T15:11:28.640112+0000","last_became_active":"2024-09-13T15:11:27.658117+0000","last_became_peered":"2024-09-13T15:11:27.658117+0000","last_unstale":"2024-09-13T15:11:28.640112+0000","last_undegraded":"2024-09-13T15:11:28.640112+0000","last_fullsized":"2024-09-13T15:11:28.640112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:03.282344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479865+0000","last_change":"2024-09-13T15:11:27.172698+0000","last_active":"2024-09-13T15:11:30.479865+0000","last_peered":"2024-09-13T15:11:30.479865+0000","last_clean":"2024-09-13T15:11:30.479865+0000","last_became_active":"2024-09-13T15:11:27.172420+0000","last_became_peered":"2024-09-13T15:11:27.172420+0000","last_unstale":"2024-09-13T15:11:30.479865+0000","last_undegraded":"2024-09-13T15:11:30.479865+0000","last_fullsized":"2024-09-13T15:11:30.479865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:34.948198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480619+0000","last_change":"2024-09-13T15:11:27.651716+0000","last_active":"2024-09-13T15:11:30.480619+0000","last_peered":"2024-09-13T15:11:30.480619+0000","last_clean":"2024-09-13T15:11:30.480619+0000","last_became_active":"2024-09-13T15:11:27.651394+0000","last_became_peered":"2024-09-13T15:11:27.651394+0000","last_unstale":"2024-09-13T15:11:30.480619+0000","last_undegraded":"2024-09-13T15:11:30.480619+0000","last_fullsized":"2024-09-13T15:11:30.480619+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:16.039575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480628+0000","last_change":"2024-09-13T15:11:27.163488+0000","last_active":"2024-09-13T15:11:30.480628+0000","last_peered":"2024-09-13T15:11:30.480628+0000","last_clean":"2024-09-13T15:11:30.480628+0000","last_became_active":"2024-09-13T15:11:27.163228+0000","last_became_peered":"2024-09-13T15:11:27.163228+0000","last_unstale":"2024-09-13T15:11:30.480628+0000","last_undegraded":"2024-09-13T15:11:30.480628+0000","last_fullsized":"2024-09-13T15:11:30.480628+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:39.376115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639631+0000","last_change":"2024-09-13T15:11:27.647651+0000","last_active":"2024-09-13T15:11:28.639631+0000","last_peered":"2024-09-13T15:11:28.639631+0000","last_clean":"2024-09-13T15:11:28.639631+0000","last_became_active":"2024-09-13T15:11:27.647376+0000","last_became_peered":"2024-09-13T15:11:27.647376+0000","last_unstale":"2024-09-13T15:11:28.639631+0000","last_undegraded":"2024-09-13T15:11:28.639631+0000","last_fullsized":"2024-09-13T15:11:28.639631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:16.430990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639789+0000","last_change":"2024-09-13T15:11:27.168071+0000","last_active":"2024-09-13T15:11:28.639789+0000","last_peered":"2024-09-13T15:11:28.639789+0000","last_clean":"2024-09-13T15:11:28.639789+0000","last_became_active":"2024-09-13T15:11:27.167829+0000","last_became_peered":"2024-09-13T15:11:27.167829+0000","last_unstale":"2024-09-13T15:11:28.639789+0000","last_undegraded":"2024-09-13T15:11:28.639789+0000","last_fullsized":"2024-09-13T15:11:28.639789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:17.448097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639390+0000","last_change":"2024-09-13T15:11:27.670280+0000","last_active":"2024-09-13T15:11:28.639390+0000","last_peered":"2024-09-13T15:11:28.639390+0000","last_clean":"2024-09-13T15:11:28.639390+0000","last_became_active":"2024-09-13T15:11:27.670014+0000","last_became_peered":"2024-09-13T15:11:27.670014+0000","last_unstale":"2024-09-13T15:11:28.639390+0000","last_undegraded":"2024-09-13T15:11:28.639390+0000","last_fullsized":"2024-09-13T15:11:28.639390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:27.275964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479917+0000","last_change":"2024-09-13T15:11:27.166897+0000","last_active":"2024-09-13T15:11:30.479917+0000","last_peered":"2024-09-13T15:11:30.479917+0000","last_clean":"2024-09-13T15:11:30.479917+0000","last_became_active":"2024-09-13T15:11:27.166554+0000","last_became_peered":"2024-09-13T15:11:27.166554+0000","last_unstale":"2024-09-13T15:11:30.479917+0000","last_undegraded":"2024-09-13T15:11:30.479917+0000","last_fullsized":"2024-09-13T15:11:30.479917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:14.746947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479904+0000","last_change":"2024-09-13T15:11:27.649298+0000","last_active":"2024-09-13T15:11:30.479904+0000","last_peered":"2024-09-13T15:11:30.479904+0000","last_clean":"2024-09-13T15:11:30.479904+0000","last_became_active":"2024-09-13T15:11:27.648619+0000","last_became_peered":"2024-09-13T15:11:27.648619+0000","last_unstale":"2024-09-13T15:11:30.479904+0000","last_undegraded":"2024-09-13T15:11:30.479904+0000","last_fullsized":"2024-09-13T15:11:30.479904+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:04.120826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.481804+0000","last_change":"2024-09-13T15:11:27.173365+0000","last_active":"2024-09-13T15:11:30.481804+0000","last_peered":"2024-09-13T15:11:30.481804+0000","last_clean":"2024-09-13T15:11:30.481804+0000","last_became_active":"2024-09-13T15:11:27.171677+0000","last_became_peered":"2024-09-13T15:11:27.171677+0000","last_unstale":"2024-09-13T15:11:30.481804+0000","last_undegraded":"2024-09-13T15:11:30.481804+0000","last_fullsized":"2024-09-13T15:11:30.481804+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:47.511337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479736+0000","last_change":"2024-09-13T15:11:27.659768+0000","last_active":"2024-09-13T15:11:30.479736+0000","last_peered":"2024-09-13T15:11:30.479736+0000","last_clean":"2024-09-13T15:11:30.479736+0000","last_became_active":"2024-09-13T15:11:27.659246+0000","last_became_peered":"2024-09-13T15:11:27.659246+0000","last_unstale":"2024-09-13T15:11:30.479736+0000","last_undegraded":"2024-09-13T15:11:30.479736+0000","last_fullsized":"2024-09-13T15:11:30.479736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:10.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480360+0000","last_change":"2024-09-13T15:11:27.171382+0000","last_active":"2024-09-13T15:11:30.480360+0000","last_peered":"2024-09-13T15:11:30.480360+0000","last_clean":"2024-09-13T15:11:30.480360+0000","last_became_active":"2024-09-13T15:11:27.171064+0000","last_became_peered":"2024-09-13T15:11:27.171064+0000","last_unstale":"2024-09-13T15:11:30.480360+0000","last_undegraded":"2024-09-13T15:11:30.480360+0000","last_fullsized":"2024-09-13T15:11:30.480360+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:14.801439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639791+0000","last_change":"2024-09-13T15:11:27.656278+0000","last_active":"2024-09-13T15:11:28.639791+0000","last_peered":"2024-09-13T15:11:28.639791+0000","last_clean":"2024-09-13T15:11:28.639791+0000","last_became_active":"2024-09-13T15:11:27.656048+0000","last_became_peered":"2024-09-13T15:11:27.656048+0000","last_unstale":"2024-09-13T15:11:28.639791+0000","last_undegraded":"2024-09-13T15:11:28.639791+0000","last_fullsized":"2024-09-13T15:11:28.639791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:41.564419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.481869+0000","last_change":"2024-09-13T15:11:27.166289+0000","last_active":"2024-09-13T15:11:30.481869+0000","last_peered":"2024-09-13T15:11:30.481869+0000","last_clean":"2024-09-13T15:11:30.481869+0000","last_became_active":"2024-09-13T15:11:27.163526+0000","last_became_peered":"2024-09-13T15:11:27.163526+0000","last_unstale":"2024-09-13T15:11:30.481869+0000","last_undegraded":"2024-09-13T15:11:30.481869+0000","last_fullsized":"2024-09-13T15:11:30.481869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:38.322222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479481+0000","last_change":"2024-09-13T15:11:27.651853+0000","last_active":"2024-09-13T15:11:30.479481+0000","last_peered":"2024-09-13T15:11:30.479481+0000","last_clean":"2024-09-13T15:11:30.479481+0000","last_became_active":"2024-09-13T15:11:27.651581+0000","last_became_peered":"2024-09-13T15:11:27.651581+0000","last_unstale":"2024-09-13T15:11:30.479481+0000","last_undegraded":"2024-09-13T15:11:30.479481+0000","last_fullsized":"2024-09-13T15:11:30.479481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:18.541562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480920+0000","last_change":"2024-09-13T15:11:27.170449+0000","last_active":"2024-09-13T15:11:30.480920+0000","last_peered":"2024-09-13T15:11:30.480920+0000","last_clean":"2024-09-13T15:11:30.480920+0000","last_became_active":"2024-09-13T15:11:27.170189+0000","last_became_peered":"2024-09-13T15:11:27.170189+0000","last_unstale":"2024-09-13T15:11:30.480920+0000","last_undegraded":"2024-09-13T15:11:30.480920+0000","last_fullsized":"2024-09-13T15:11:30.480920+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:07.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640900+0000","last_change":"2024-09-13T15:11:27.661175+0000","last_active":"2024-09-13T15:11:28.640900+0000","last_peered":"2024-09-13T15:11:28.640900+0000","last_clean":"2024-09-13T15:11:28.640900+0000","last_became_active":"2024-09-13T15:11:27.660917+0000","last_became_peered":"2024-09-13T15:11:27.660917+0000","last_unstale":"2024-09-13T15:11:28.640900+0000","last_undegraded":"2024-09-13T15:11:28.640900+0000","last_fullsized":"2024-09-13T15:11:28.640900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:52.622684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639636+0000","last_change":"2024-09-13T15:11:27.173183+0000","last_active":"2024-09-13T15:11:28.639636+0000","last_peered":"2024-09-13T15:11:28.639636+0000","last_clean":"2024-09-13T15:11:28.639636+0000","last_became_active":"2024-09-13T15:11:27.172884+0000","last_became_peered":"2024-09-13T15:11:27.172884+0000","last_unstale":"2024-09-13T15:11:28.639636+0000","last_undegraded":"2024-09-13T15:11:28.639636+0000","last_fullsized":"2024-09-13T15:11:28.639636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:13.751962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.640697+0000","last_change":"2024-09-13T15:11:27.658593+0000","last_active":"2024-09-13T15:11:28.640697+0000","last_peered":"2024-09-13T15:11:28.640697+0000","last_clean":"2024-09-13T15:11:28.640697+0000","last_became_active":"2024-09-13T15:11:27.658287+0000","last_became_peered":"2024-09-13T15:11:27.658287+0000","last_unstale":"2024-09-13T15:11:28.640697+0000","last_undegraded":"2024-09-13T15:11:28.640697+0000","last_fullsized":"2024-09-13T15:11:28.640697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:15.860354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639899+0000","last_change":"2024-09-13T15:11:27.177162+0000","last_active":"2024-09-13T15:11:28.639899+0000","last_peered":"2024-09-13T15:11:28.639899+0000","last_clean":"2024-09-13T15:11:28.639899+0000","last_became_active":"2024-09-13T15:11:27.176760+0000","last_became_peered":"2024-09-13T15:11:27.176760+0000","last_unstale":"2024-09-13T15:11:28.639899+0000","last_undegraded":"2024-09-13T15:11:28.639899+0000","last_fullsized":"2024-09-13T15:11:28.639899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:15.511485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480394+0000","last_change":"2024-09-13T15:11:27.655647+0000","last_active":"2024-09-13T15:11:30.480394+0000","last_peered":"2024-09-13T15:11:30.480394+0000","last_clean":"2024-09-13T15:11:30.480394+0000","last_became_active":"2024-09-13T15:11:27.655410+0000","last_became_peered":"2024-09-13T15:11:27.655410+0000","last_unstale":"2024-09-13T15:11:30.480394+0000","last_undegraded":"2024-09-13T15:11:30.480394+0000","last_fullsized":"2024-09-13T15:11:30.480394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:57.390087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479986+0000","last_change":"2024-09-13T15:11:27.178111+0000","last_active":"2024-09-13T15:11:30.479986+0000","last_peered":"2024-09-13T15:11:30.479986+0000","last_clean":"2024-09-13T15:11:30.479986+0000","last_became_active":"2024-09-13T15:11:27.177628+0000","last_became_peered":"2024-09-13T15:11:27.177628+0000","last_unstale":"2024-09-13T15:11:30.479986+0000","last_undegraded":"2024-09-13T15:11:30.479986+0000","last_fullsized":"2024-09-13T15:11:30.479986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:07:26.219472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.481735+0000","last_change":"2024-09-13T15:11:27.661584+0000","last_active":"2024-09-13T15:11:30.481735+0000","last_peered":"2024-09-13T15:11:30.481735+0000","last_clean":"2024-09-13T15:11:30.481735+0000","last_became_active":"2024-09-13T15:11:27.661353+0000","last_became_peered":"2024-09-13T15:11:27.661353+0000","last_unstale":"2024-09-13T15:11:30.481735+0000","last_undegraded":"2024-09-13T15:11:30.481735+0000","last_fullsized":"2024-09-13T15:11:30.481735+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:54.681538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639899+0000","last_change":"2024-09-13T15:11:27.174380+0000","last_active":"2024-09-13T15:11:28.639899+0000","last_peered":"2024-09-13T15:11:28.639899+0000","last_clean":"2024-09-13T15:11:28.639899+0000","last_became_active":"2024-09-13T15:11:27.174099+0000","last_became_peered":"2024-09-13T15:11:27.174099+0000","last_unstale":"2024-09-13T15:11:28.639899+0000","last_undegraded":"2024-09-13T15:11:28.639899+0000","last_fullsized":"2024-09-13T15:11:28.639899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:11.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:29.885924+0000","last_change":"2024-09-13T15:11:27.668904+0000","last_active":"2024-09-13T15:11:29.885924+0000","last_peered":"2024-09-13T15:11:29.885924+0000","last_clean":"2024-09-13T15:11:29.885924+0000","last_became_active":"2024-09-13T15:11:27.668293+0000","last_became_peered":"2024-09-13T15:11:27.668293+0000","last_unstale":"2024-09-13T15:11:29.885924+0000","last_undegraded":"2024-09-13T15:11:29.885924+0000","last_fullsized":"2024-09-13T15:11:29.885924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:18.345447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479864+0000","last_change":"2024-09-13T15:11:27.159207+0000","last_active":"2024-09-13T15:11:30.479864+0000","last_peered":"2024-09-13T15:11:30.479864+0000","last_clean":"2024-09-13T15:11:30.479864+0000","last_became_active":"2024-09-13T15:11:27.158905+0000","last_became_peered":"2024-09-13T15:11:27.158905+0000","last_unstale":"2024-09-13T15:11:30.479864+0000","last_undegraded":"2024-09-13T15:11:30.479864+0000","last_fullsized":"2024-09-13T15:11:30.479864+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:41.295401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479191+0000","last_change":"2024-09-13T15:11:27.673625+0000","last_active":"2024-09-13T15:11:30.479191+0000","last_peered":"2024-09-13T15:11:30.479191+0000","last_clean":"2024-09-13T15:11:30.479191+0000","last_became_active":"2024-09-13T15:11:27.673315+0000","last_became_peered":"2024-09-13T15:11:27.673315+0000","last_unstale":"2024-09-13T15:11:30.479191+0000","last_undegraded":"2024-09-13T15:11:30.479191+0000","last_fullsized":"2024-09-13T15:11:30.479191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:15.758121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480089+0000","last_change":"2024-09-13T15:11:27.177079+0000","last_active":"2024-09-13T15:11:30.480089+0000","last_peered":"2024-09-13T15:11:30.480089+0000","last_clean":"2024-09-13T15:11:30.480089+0000","last_became_active":"2024-09-13T15:11:27.176760+0000","last_became_peered":"2024-09-13T15:11:27.176760+0000","last_unstale":"2024-09-13T15:11:30.480089+0000","last_undegraded":"2024-09-13T15:11:30.480089+0000","last_fullsized":"2024-09-13T15:11:30.480089+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:42.378441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.639916+0000","last_change":"2024-09-13T15:11:27.668443+0000","last_active":"2024-09-13T15:11:28.639916+0000","last_peered":"2024-09-13T15:11:28.639916+0000","last_clean":"2024-09-13T15:11:28.639916+0000","last_became_active":"2024-09-13T15:11:27.668226+0000","last_became_peered":"2024-09-13T15:11:27.668226+0000","last_unstale":"2024-09-13T15:11:28.639916+0000","last_undegraded":"2024-09-13T15:11:28.639916+0000","last_fullsized":"2024-09-13T15:11:28.639916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:14.579363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479387+0000","last_change":"2024-09-13T15:11:27.167155+0000","last_active":"2024-09-13T15:11:30.479387+0000","last_peered":"2024-09-13T15:11:30.479387+0000","last_clean":"2024-09-13T15:11:30.479387+0000","last_became_active":"2024-09-13T15:11:27.166834+0000","last_became_peered":"2024-09-13T15:11:27.166834+0000","last_unstale":"2024-09-13T15:11:30.479387+0000","last_undegraded":"2024-09-13T15:11:30.479387+0000","last_fullsized":"2024-09-13T15:11:30.479387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:10.478295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.480812+0000","last_change":"2024-09-13T15:11:27.665828+0000","last_active":"2024-09-13T15:11:30.480812+0000","last_peered":"2024-09-13T15:11:30.480812+0000","last_clean":"2024-09-13T15:11:30.480812+0000","last_became_active":"2024-09-13T15:11:27.665559+0000","last_became_peered":"2024-09-13T15:11:27.665559+0000","last_unstale":"2024-09-13T15:11:30.480812+0000","last_undegraded":"2024-09-13T15:11:30.480812+0000","last_fullsized":"2024-09-13T15:11:30.480812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:27.138078+0000","last_clean_scrub_stamp":"2024-09-13T15:11:27.138078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:31.641403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:28.642173+0000","last_change":"2024-09-13T15:11:27.176142+0000","last_active":"2024-09-13T15:11:28.642173+0000","last_peered":"2024-09-13T15:11:28.642173+0000","last_clean":"2024-09-13T15:11:28.642173+0000","last_became_active":"2024-09-13T15:11:27.175935+0000","last_became_peered":"2024-09-13T15:11:27.175935+0000","last_unstale":"2024-09-13T15:11:28.642173+0000","last_undegraded":"2024-09-13T15:11:28.642173+0000","last_fullsized":"2024-09-13T15:11:28.642173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:26.126904+0000","last_clean_scrub_stamp":"2024-09-13T15:11:26.126904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:34.948198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:11:30.479520+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:11:30.479520+0000","last_peered":"2024-09-13T15:11:30.479520+0000","last_clean":"2024-09-13T15:11:30.479520+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:11:30.479520+0000","last_undegraded":"2024-09-13T15:11:30.479520+0000","last_fullsized":"2024-09-13T15:11:30.479520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1699840,"data_stored":1086571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.159,"15min":1.1830000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6180000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.73099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5369999999999999,"5min":1.839,"15min":1.839},"last":1.101}]},{"osd":1,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.3009999999999999,"15min":1.359},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4059999999999999,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.024},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.212,"15min":1.258},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.577,"15min":1.577},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.329,"15min":1.391},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.3260000000000001,"15min":1.363},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.3200000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3999999999999999,"15min":1.4379999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.25,"5min":1.46,"15min":1.532},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.681,"5min":2.081,"15min":2.081},"last":1.2470000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.29,"15min":1.3700000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5580000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.462},{"interface":"front","average":{"1min":1.169,"5min":1.3680000000000001,"15min":1.4370000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6180000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.343}]},{"osd":5,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.5049999999999999,"15min":1.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.917,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.389},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.748,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.552}]},{"osd":6,"last update":"Fri Sep 13 15:10:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5129999999999999,"15min":1.6040000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.359},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.5669999999999999,"15min":1.6499999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7190000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.2809999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":497296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.157,"15min":1.1970000000000001},"min":{"1min":0.751,"5min":0.749,"15min":0.749},"max":{"1min":1.3979999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.075},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1419999999999999,"15min":1.1639999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3819999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0900000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.534,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.2849999999999999,"15min":1.345},"min":{"1min":0.86899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.619,"5min":2.282,"15min":2.282},"last":0.83299999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2589999999999999,"15min":1.2949999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.5069999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.167},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.353,"15min":1.395},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.484,"5min":1.986,"15min":1.986},"last":1.121}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2969999999999999,"15min":1.3180000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6140000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.341,"15min":1.391},"min":{"1min":0.96099999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.6180000000000001,"5min":2.371,"15min":2.371},"last":1.2589999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.325,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4630000000000001,"5min":2.835,"15min":2.835},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.3180000000000001,"15min":1.381},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5800000000000001,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3089999999999999,"15min":1.3149999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6699999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.341,"5min":1.5389999999999999,"15min":1.605},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.74,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.137}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.413,"15min":1.4450000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.538,"5min":2.444,"15min":2.444},"last":1.28},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.5109999999999999,"15min":1.5509999999999999},"min":{"1min":0.92000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.7909999999999999,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.2969999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":496147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2390000000000001,"15min":1.304},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.373},{"interface":"front","average":{"1min":1.05,"5min":1.2729999999999999,"15min":1.3700000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.141}]},{"osd":1,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2450000000000001,"15min":1.2829999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.488,"5min":1.976,"15min":1.976},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.224,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.587,"5min":2.665,"15min":2.665},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.236,"15min":1.27},"min":{"1min":0.79300000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.556,"5min":2.347,"15min":2.347},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.3320000000000001,"15min":1.3779999999999999},"min":{"1min":0.73899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6759999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":0.86399999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.593,"5min":2.524,"15min":2.524},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.4359999999999999,"15min":1.504},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.29}]},{"osd":4,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3400000000000001,"15min":1.3959999999999999},"min":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6919999999999999,"5min":2.012,"15min":2.012},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.4239999999999999,"15min":1.494},"min":{"1min":0.70299999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7569999999999999,"5min":3.117,"15min":3.117},"last":1.329}]},{"osd":6,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.444,"15min":1.5429999999999999},"min":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.603,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4930000000000001,"15min":1.5880000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6479999999999999,"5min":2.411,"15min":2.411},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:10:34 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4790000000000001,"15min":1.5620000000000001},"min":{"1min":0.80800000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.671,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.579,"15min":1.681},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.694,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.4670000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1105920,"data_stored":496307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1120000000000001,"15min":1.1579999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.579,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.167,"15min":1.1970000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.627,"5min":1.78,"15min":1.78},"last":1.099}]},{"osd":1,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2070000000000001,"15min":1.2490000000000001},"min":{"1min":0.88500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5569999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1819999999999999,"15min":1.2250000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6559999999999999,"5min":1.794,"15min":1.794},"last":1.3959999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.171,"15min":1.1870000000000001},"min":{"1min":0.76400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.589,"5min":1.621,"15min":1.621},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3,"15min":1.3360000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5960000000000001,"5min":1.887,"15min":1.887},"last":1.5029999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2350000000000001,"15min":1.262},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.49,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.153},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.258,"15min":1.3280000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.75,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.75}]},{"osd":5,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3180000000000001,"15min":1.3700000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.722},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3440000000000001,"15min":1.389},"min":{"1min":0.75700000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7889999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2370000000000001,"15min":1.294},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.843,"5min":2.214,"15min":2.214},"last":1.319},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3759999999999999,"15min":1.4359999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6699999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.6699999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3640000000000001,"15min":1.4339999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7150000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.54},{"interface":"front","average":{"1min":1.345,"5min":1.4139999999999999,"15min":1.484},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9470000000000001,"5min":2.524,"15min":2.524},"last":1.6220000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1093632,"data_stored":495128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0589999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.419,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.004,"5min":1.0549999999999999,"15min":1.079},"min":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3959999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.036}]},{"osd":1,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.02,"15min":1.073},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.9379999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.2130000000000001},"min":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.306,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.133,"15min":1.2030000000000001},"min":{"1min":0.71599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.603,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.286,"15min":1.3580000000000001},"min":{"1min":0.70299999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5069999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.2110000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.337,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7529999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.141},{"interface":"front","average":{"1min":1.278,"5min":1.3859999999999999,"15min":1.4379999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1669999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.95999999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4390000000000001,"15min":1.5129999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.802,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.581,"15min":1.6739999999999999},"min":{"1min":1.0660000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.55,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4399999999999999,"15min":1.4970000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.605,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.087},{"interface":"front","average":{"1min":1.383,"5min":1.5029999999999999,"15min":1.5669999999999999},"min":{"1min":0.90300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.0800000000000001,"5min":3.786,"15min":3.786},"last":1.1659999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.6859999999999999,"15min":1.7829999999999999},"min":{"1min":1.1890000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7529999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.5980000000000001,"15min":1.671},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.782,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":1.2470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1085440,"data_stored":489527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.5,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":1.393,"15min":1.393},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.028,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.73699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4630000000000001,"5min":1.643,"15min":1.643},"last":1.052}]},{"osd":1,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.54200000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.1990000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.069,"15min":1.113},"min":{"1min":0.78600000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4319999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.081},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.302,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.343,"15min":1.3839999999999999},"min":{"1min":0.93700000000000006,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.494,"5min":2.657,"15min":2.657},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.4490000000000001,"15min":1.5},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5569999999999999,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.296}]},{"osd":5,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.3160000000000001},"min":{"1min":0.95999999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.577},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.385,"15min":1.395},"min":{"1min":1.0089999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.609,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.446,"15min":1.486},"min":{"1min":0.95499999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0459999999999998,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.514},{"interface":"front","average":{"1min":1.335,"5min":1.4359999999999999,"15min":1.468},"min":{"1min":1.0369999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.849,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.958}]},{"osd":7,"last update":"Fri Sep 13 15:10:35 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5589999999999999},"min":{"1min":1.1359999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.1480000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.415},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.528,"15min":1.5580000000000001},"min":{"1min":1.2310000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7689999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.833}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1101824,"data_stored":496217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88300000000000001,"15min":0.86099999999999999},"min":{"1min":0.50900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99099999999999999,"15min":1.0109999999999999},"min":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.722,"15min":1.722},"last":1.2729999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.875,"15min":0.89200000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.321,"5min":1.502,"15min":1.502},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.042,"15min":1.0529999999999999},"min":{"1min":0.71699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.4510000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5780000000000001,"5min":1.764,"15min":1.764},"last":1.3879999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0900000000000001,"15min":1.143},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.242,"5min":3.254,"15min":3.254},"last":1.361}]},{"osd":4,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1759999999999999,"15min":1.1930000000000001},"min":{"1min":0.877,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5229999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.476},{"interface":"front","average":{"1min":1.335,"5min":1.3540000000000001,"15min":1.3759999999999999},"min":{"1min":1.0660000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.762,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.6140000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.377,"15min":1.4370000000000001},"min":{"1min":0.91200000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.6639999999999999,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.421},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.325,"15min":1.367},"min":{"1min":0.92000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5960000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4790000000000001,"15min":1.5169999999999999},"min":{"1min":0.98599999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.9410000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4950000000000001,"15min":1.5669999999999999},"min":{"1min":0.92100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7270000000000001,"5min":4.843,"15min":4.843},"last":1.5109999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:10:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.6040000000000001,"15min":1.7030000000000001},"min":{"1min":1.113,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.6399999999999999,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.45,"15min":1.5},"min":{"1min":0.93700000000000006,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.768,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.373}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1712128,"data_stored":1087766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.91800000000000004,"15min":0.90400000000000003},"min":{"1min":0.56599999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.3959999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.2210000000000001,"15min":1.3089999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.371,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.1899999999999999,"15min":1.3200000000000001},"min":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2649999999999999,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.119,"15min":1.159},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4430000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.351},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.3029999999999999,"15min":1.3049999999999999},"min":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.724,"5min":2.157,"15min":2.157},"last":1.518}]},{"osd":4,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.95499999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.8260000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3640000000000001,"15min":1.3720000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.661,"5min":1.827,"15min":1.827},"last":1.385}]},{"osd":5,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.345,"15min":1.3859999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.54,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3700000000000001,"15min":1.3919999999999999},"min":{"1min":0.98099999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.7330000000000001,"5min":2.367,"15min":2.367},"last":1.5760000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.472,"15min":1.488},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.8690000000000002,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.292},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.478},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.752,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.228}]},{"osd":7,"last update":"Fri Sep 13 15:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.49,"15min":1.538},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8879999999999999,"5min":3.302,"15min":3.302},"last":1.036},{"interface":"front","average":{"1min":1.359,"5min":1.4399999999999999,"15min":1.47},"min":{"1min":1.0409999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.788,"5min":2.266,"15min":2.266},"last":1.4710000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:11:32.492 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:11:32.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T15:11:32.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.716+0000 7fd6eae00700 1 Processor -- start 2024-09-13T15:11:32.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.716+0000 7fd6eae00700 1 -- start start 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6eae00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6e40b3b00 0x7fd6e40720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6eae00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40ce970 con 0x7fd6e4071cb0 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6eae00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40ce040 con 0x7fd6e41433e0 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6eae00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e41437c0 con 0x7fd6e40b3b00 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6e40b3b00 0x7fd6e40720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6e40b3b00 0x7fd6e40720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40138/0 (socket says 172.21.15.50:40138) 2024-09-13T15:11:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 -- 172.21.15.50:0/436702343 learned_addr learned my addr 172.21.15.50:0/436702343 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 -- 172.21.15.50:0/436702343 >> v1:172.21.15.181:6789/0 conn(0x7fd6e41433e0 legacy=0x7fd6e4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 -- 172.21.15.50:0/436702343 >> v1:172.21.15.50:6789/0 conn(0x7fd6e4071cb0 legacy=0x7fd6e40b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 -- 172.21.15.50:0/436702343 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40ce320 con 0x7fd6e40b3b00 2024-09-13T15:11:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6ea400700 1 --2- 172.21.15.50:0/436702343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40b3b00 0x7fd6e40720d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009e40 tx=0x7fd6dc00e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2488fdd2ad5adc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6e3e00700 1 -- 172.21.15.50:0/436702343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00c070 con 0x7fd6e40b3b00 2024-09-13T15:11:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6e3e00700 1 -- 172.21.15.50:0/436702343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00ece0 con 0x7fd6e40b3b00 2024-09-13T15:11:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.720+0000 7fd6e3e00700 1 -- 172.21.15.50:0/436702343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc013610 con 0x7fd6e40b3b00 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 -- 172.21.15.50:0/436702343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40b3b00 msgr2=0x7fd6e40720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 --2- 172.21.15.50:0/436702343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40b3b00 0x7fd6e40720d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009e40 tx=0x7fd6dc00e450 comp rx=0 tx=0).stop 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 -- 172.21.15.50:0/436702343 shutdown_connections 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 --2- 172.21.15.50:0/436702343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e40b3b00 0x7fd6e40720d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 -- 172.21.15.50:0/436702343 >> 172.21.15.50:0/436702343 conn(0x7fd6e406d580 msgr2=0x7fd6e406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 -- 172.21.15.50:0/436702343 shutdown_connections 2024-09-13T15:11:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 -- 172.21.15.50:0/436702343 wait complete. 2024-09-13T15:11:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 Processor -- start 2024-09-13T15:11:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.724+0000 7fd6eae00700 1 -- start start 2024-09-13T15:11:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 0x7fd6e41f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6e40b3b00 0x7fd6e40ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6e41433e0 0x7fd6e413b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e413d4c0 con 0x7fd6e4071cb0 2024-09-13T15:11:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41f2e40 con 0x7fd6e41433e0 2024-09-13T15:11:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40cb010 con 0x7fd6e40b3b00 2024-09-13T15:11:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 0x7fd6e41f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 0x7fd6e41f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40150/0 (socket says 172.21.15.50:40150) 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 -- 172.21.15.50:0/2163302883 learned_addr learned my addr 172.21.15.50:0/2163302883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9000700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6e40b3b00 0x7fd6e40ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6ea400700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6e41433e0 0x7fd6e413b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 -- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6e40b3b00 msgr2=0x7fd6e40ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6e40b3b00 0x7fd6e40ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 -- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6e41433e0 msgr2=0x7fd6e413b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6e41433e0 0x7fd6e413b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 -- 172.21.15.50:0/2163302883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009aa0 con 0x7fd6e4071cb0 2024-09-13T15:11:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e9a00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 0x7fd6e41f2900 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c500 tx=0x7fd6d800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80052d0 con 0x7fd6e4071cb0 2024-09-13T15:11:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8005430 con 0x7fd6e4071cb0 2024-09-13T15:11:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80055a0 con 0x7fd6e4071cb0 2024-09-13T15:11:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.728+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e40cb2f0 con 0x7fd6e4071cb0 2024-09-13T15:11:32.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.732+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e40cad20 con 0x7fd6e4071cb0 2024-09-13T15:11:32.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.732+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e406e660 con 0x7fd6e4071cb0 2024-09-13T15:11:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.732+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6d80038e0 con 0x7fd6e4071cb0 2024-09-13T15:11:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.736+0000 7fd6e1600700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6c4066730 0x7fd6c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.736+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd6d8083690 con 0x7fd6e4071cb0 2024-09-13T15:11:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.736+0000 7fd6e9000700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6c4066730 0x7fd6c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.736+0000 7fd6e9000700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6c4066730 0x7fd6c4068bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4142340 tx=0x7fd6d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.740+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6d8050820 con 0x7fd6e4071cb0 2024-09-13T15:11:32.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.988+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd6e40720d0 con 0x7fd6e4071cb0 2024-09-13T15:11:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:32.996+0000 7fd6e1600700 1 -- 172.21.15.50:0/2163302883 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd6d8053e40 con 0x7fd6e4071cb0 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6c4066730 msgr2=0x7fd6c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6c4066730 0x7fd6c4068bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4142340 tx=0x7fd6d0009040 comp rx=0 tx=0).stop 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 msgr2=0x7fd6e41f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 0x7fd6e41f2900 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c500 tx=0x7fd6d800c810 comp rx=0 tx=0).stop 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 shutdown_connections 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd6c4066730 0x7fd6c4068bf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6e41433e0 0x7fd6e413b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd6e40b3b00 0x7fd6e40ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 --2- 172.21.15.50:0/2163302883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6e4071cb0 0x7fd6e41f2900 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 >> 172.21.15.50:0/2163302883 conn(0x7fd6e406d580 msgr2=0x7fd6e415a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 shutdown_connections 2024-09-13T15:11:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.000+0000 7fd6eae00700 1 -- 172.21.15.50:0/2163302883 wait complete. 2024-09-13T15:11:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-13T15:11:33.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:33.127 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-13T15:11:33.124+0000 7fb10a200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:11:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.196+0000 7f8003000700 1 Processor -- start 2024-09-13T15:11:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.196+0000 7f8003000700 1 -- start start 2024-09-13T15:11:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8003000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7ffc15e070 0x7f7ffc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8003000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc0cd970 con 0x7f7ffc0b2c50 2024-09-13T15:11:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8003000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc15e450 con 0x7f7ffc0d10f0 2024-09-13T15:11:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8003000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc0d0050 con 0x7f7ffc15e070 2024-09-13T15:11:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8002600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ffc0b2c50 0x7f7ffc0b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39922/0 (socket says 172.21.15.50:39922) 2024-09-13T15:11:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8002600700 1 -- 172.21.15.50:0/3930546523 learned_addr learned my addr 172.21.15.50:0/3930546523 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8001c00700 1 --2- 172.21.15.50:0/3930546523 >> v2:172.21.15.181:3300/0 conn(0x7f7ffc15e070 0x7f7ffc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f7ffbe00700 1 -- 172.21.15.50:0/3930546523 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551420876 0 0) 0x7f7ff4001490 con 0x7f7ffc0b2c50 2024-09-13T15:11:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f7ffbe00700 1 -- 172.21.15.50:0/3930546523 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe40035d0 con 0x7f7ffc0b2c50 2024-09-13T15:11:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8001c00700 1 -- 172.21.15.50:0/3930546523 >> v1:172.21.15.181:6789/0 conn(0x7f7ffc0d10f0 legacy=0x7f7ffc0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f7ffbe00700 1 -- 172.21.15.50:0/3930546523 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3315076781 0 0) 0x7f7fe40035d0 con 0x7f7ffc0b2c50 2024-09-13T15:11:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8001c00700 1 -- 172.21.15.50:0/3930546523 >> v1:172.21.15.50:6789/0 conn(0x7f7ffc0b2c50 legacy=0x7f7ffc0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.200+0000 7f8001c00700 1 -- 172.21.15.50:0/3930546523 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0d0330 con 0x7f7ffc15e070 2024-09-13T15:11:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8001c00700 1 --2- 172.21.15.50:0/3930546523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0cd430 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009850 tx=0x7f7ff0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9e46395dafdfb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f7ffbe00700 1 -- 172.21.15.50:0/3930546523 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4001b80 con 0x7f7ffc15e070 2024-09-13T15:11:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f7ffbe00700 1 -- 172.21.15.50:0/3930546523 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff0010590 con 0x7f7ffc15e070 2024-09-13T15:11:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f7ffbe00700 1 -- 172.21.15.50:0/3930546523 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0010940 con 0x7f7ffc15e070 2024-09-13T15:11:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 -- 172.21.15.50:0/3930546523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc15e070 msgr2=0x7f7ffc0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 --2- 172.21.15.50:0/3930546523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0cd430 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009850 tx=0x7f7ff0009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 -- 172.21.15.50:0/3930546523 shutdown_connections 2024-09-13T15:11:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 --2- 172.21.15.50:0/3930546523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0cd430 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 -- 172.21.15.50:0/3930546523 >> 172.21.15.50:0/3930546523 conn(0x7f7ffc071f00 msgr2=0x7f7ffc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 -- 172.21.15.50:0/3930546523 shutdown_connections 2024-09-13T15:11:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.204+0000 7f8003000700 1 -- 172.21.15.50:0/3930546523 wait complete. 2024-09-13T15:11:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 Processor -- start 2024-09-13T15:11:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 -- start start 2024-09-13T15:11:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ffc0b2c50 0x7f7ffc06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc0d10f0 0x7f7ffc0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc06b360 con 0x7f7ffc15e070 2024-09-13T15:11:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc06b640 con 0x7f7ffc0d10f0 2024-09-13T15:11:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8003000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc06b920 con 0x7f7ffc0b2c50 2024-09-13T15:11:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8002600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8002600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40948/0 (socket says 172.21.15.50:40948) 2024-09-13T15:11:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8002600700 1 -- 172.21.15.50:0/1914613306 learned_addr learned my addr 172.21.15.50:0/1914613306 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8001200700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc0d10f0 0x7f7ffc0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.208+0000 7f8001c00700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ffc0b2c50 0x7f7ffc06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8002600700 1 -- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ffc0b2c50 msgr2=0x7f7ffc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8002600700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ffc0b2c50 0x7f7ffc06ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8002600700 1 -- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc0d10f0 msgr2=0x7f7ffc0c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8002600700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc0d10f0 0x7f7ffc0c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8002600700 1 -- 172.21.15.50:0/1914613306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00094b0 con 0x7f7ffc15e070 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8002600700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0c62e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400cbe0 tx=0x7f7ff400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400aaa0 con 0x7f7ffc15e070 2024-09-13T15:11:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400ac00 con 0x7f7ffc15e070 2024-09-13T15:11:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc06bc00 con 0x7f7ffc15e070 2024-09-13T15:11:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40070d0 con 0x7f7ffc15e070 2024-09-13T15:11:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc14f4f0 con 0x7f7ffc15e070 2024-09-13T15:11:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.212+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc0ace00 con 0x7f7ffc15e070 2024-09-13T15:11:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.216+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ff4007230 con 0x7f7ffc15e070 2024-09-13T15:11:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.216+0000 7f7ff9600700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fdc066730 0x7f7fdc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.216+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ff4083e70 con 0x7f7ffc15e070 2024-09-13T15:11:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.220+0000 7f8001c00700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fdc066730 0x7f7fdc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.220+0000 7f8001c00700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fdc066730 0x7f7fdc068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0013040 tx=0x7f7ff0008000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.224+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ffc0ace00 con 0x7f7ffc15e070 2024-09-13T15:11:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.456+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ffc0ace00 con 0x7f7ffc15e070 2024-09-13T15:11:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.456+0000 7f7ff9600700 1 -- 172.21.15.50:0/1914613306 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f7ffc0ace00 con 0x7f7ffc15e070 2024-09-13T15:11:33.461 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:33.461 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fdc066730 msgr2=0x7f7fdc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fdc066730 0x7f7fdc068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0013040 tx=0x7f7ff0008000 comp rx=0 tx=0).stop 2024-09-13T15:11:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 msgr2=0x7f7ffc0c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0c62e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400cbe0 tx=0x7f7ff400cef0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 shutdown_connections 2024-09-13T15:11:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7fdc066730 0x7f7fdc068bf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ffc15e070 0x7f7ffc0c62e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ffc0d10f0 0x7f7ffc0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 --2- 172.21.15.50:0/1914613306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7ffc0b2c50 0x7f7ffc06ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 >> 172.21.15.50:0/1914613306 conn(0x7f7ffc071f00 msgr2=0x7f7ffc0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 shutdown_connections 2024-09-13T15:11:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:33.460+0000 7f8003000700 1 -- 172.21.15.50:0/1914613306 wait complete. 2024-09-13T15:11:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:33.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:11:27.626965+0000', 'modified': '2024-09-13T15:11:30.646818+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6954}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6954': {'gid': 6954, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/2602636353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2602636353}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2602636353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:11:33.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:11:33.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T15:11:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.080+0000 7f9084a00700 1 Processor -- start 2024-09-13T15:11:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.080+0000 7f9084a00700 1 -- start start 2024-09-13T15:11:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f9084a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9080157d70 0x7f9080066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f9084a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9080165560 0x7f90800665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f9084a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800b4080 con 0x7f9080158150 2024-09-13T15:11:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f9084a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90801659c0 con 0x7f9080165560 2024-09-13T15:11:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f9084a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800b34b0 con 0x7f9080157d70 2024-09-13T15:11:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9080165560 0x7f90800665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9080165560 0x7f90800665d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40960/0 (socket says 172.21.15.50:40960) 2024-09-13T15:11:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 -- 172.21.15.50:0/49605480 learned_addr learned my addr 172.21.15.50:0/49605480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907e800700 1 --2- 172.21.15.50:0/49605480 >> v2:172.21.15.181:3300/0 conn(0x7f9080157d70 0x7f9080066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 -- 172.21.15.50:0/49605480 >> v2:172.21.15.181:3300/0 conn(0x7f9080157d70 msgr2=0x7f9080066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 --2- 172.21.15.50:0/49605480 >> v2:172.21.15.181:3300/0 conn(0x7f9080157d70 0x7f9080066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 -- 172.21.15.50:0/49605480 >> v1:172.21.15.50:6789/0 conn(0x7f9080158150 legacy=0x7f9080164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 -- 172.21.15.50:0/49605480 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800b3750 con 0x7f9080165560 2024-09-13T15:11:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907d400700 1 -- 172.21.15.50:0/49605480 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591149360 0 0) 0x7f90800b4080 con 0x7f9080158150 2024-09-13T15:11:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907f200700 1 --2- 172.21.15.50:0/49605480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f90800665d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f908006d920 tx=0x7f907800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e502cb64a0e6f598 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907d400700 1 -- 172.21.15.50:0/49605480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800e070 con 0x7f9080165560 2024-09-13T15:11:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907d400700 1 -- 172.21.15.50:0/49605480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907800b910 con 0x7f9080165560 2024-09-13T15:11:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.084+0000 7f907d400700 1 -- 172.21.15.50:0/49605480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800bcc0 con 0x7f9080165560 2024-09-13T15:11:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 -- 172.21.15.50:0/49605480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 msgr2=0x7f90800665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 --2- 172.21.15.50:0/49605480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f90800665d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f908006d920 tx=0x7f907800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 -- 172.21.15.50:0/49605480 shutdown_connections 2024-09-13T15:11:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 --2- 172.21.15.50:0/49605480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f90800665d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 --2- 172.21.15.50:0/49605480 >> v2:172.21.15.181:3300/0 conn(0x7f9080157d70 0x7f9080066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 -- 172.21.15.50:0/49605480 >> 172.21.15.50:0/49605480 conn(0x7f908006e660 msgr2=0x7f908006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 -- 172.21.15.50:0/49605480 shutdown_connections 2024-09-13T15:11:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 -- 172.21.15.50:0/49605480 wait complete. 2024-09-13T15:11:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 Processor -- start 2024-09-13T15:11:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.088+0000 7f9084a00700 1 -- start start 2024-09-13T15:11:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9080157d70 0x7f9080141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9080158150 0x7f9080144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f9080143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90801432e0 con 0x7f9080165560 2024-09-13T15:11:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080141db0 con 0x7f9080157d70 2024-09-13T15:11:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080145050 con 0x7f9080158150 2024-09-13T15:11:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f9080143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f9080143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40970/0 (socket says 172.21.15.50:40970) 2024-09-13T15:11:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 -- 172.21.15.50:0/337488559 learned_addr learned my addr 172.21.15.50:0/337488559 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907e800700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9080157d70 0x7f9080141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907de00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9080158150 0x7f9080144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 -- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9080158150 msgr2=0x7f9080144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9080158150 0x7f9080144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 -- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9080157d70 msgr2=0x7f9080141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9080157d70 0x7f9080141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 -- 172.21.15.50:0/337488559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078009b30 con 0x7f9080165560 2024-09-13T15:11:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f907f200700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f9080143700 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f90800b2980 tx=0x7f9078004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9076a00700 1 -- 172.21.15.50:0/337488559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078004840 con 0x7f9080165560 2024-09-13T15:11:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9076a00700 1 -- 172.21.15.50:0/337488559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90780092e0 con 0x7f9080165560 2024-09-13T15:11:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9076a00700 1 -- 172.21.15.50:0/337488559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907801b650 con 0x7f9080165560 2024-09-13T15:11:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9080142660 con 0x7f9080165560 2024-09-13T15:11:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.092+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9080142c20 con 0x7f9080165560 2024-09-13T15:11:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.096+0000 7f9076a00700 1 -- 172.21.15.50:0/337488559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f907801b7b0 con 0x7f9080165560 2024-09-13T15:11:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f9076a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9060066730 0x7f9060068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f9076a00700 1 -- 172.21.15.50:0/337488559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9078085ad0 con 0x7f9080165560 2024-09-13T15:11:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907e800700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9060066730 0x7f9060068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 Processor -- start 2024-09-13T15:11:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 -- start start 2024-09-13T15:11:34.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907e800700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9060066730 0x7f9060068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9070009bf0 tx=0x7f9070009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80acda0 0x80ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 0x8075890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x8075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80 con 0x808bd00 2024-09-13T15:11:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2510 con 0x80ad6c0 2024-09-13T15:11:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00 con 0x80acda0 2024-09-13T15:11:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 0x8075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 0x8075890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40974/0 (socket says 172.21.15.50:40974) 2024-09-13T15:11:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 -- 172.21.15.50:0/4044426545 learned_addr learned my addr 172.21.15.50:0/4044426545 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907e800700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80acda0 0x80ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907f200700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x8075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 -- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80acda0 msgr2=0x80ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80acda0 0x80ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 -- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 msgr2=0x8075dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x8075dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 -- 172.21.15.50:0/4044426545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7e40960 con 0x808bd00 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907f200700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x8075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907e800700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80acda0 0x80ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:34.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.100+0000 7f907de00700 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 0x8075890 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f906c0011e0 tx=0x7f906c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24ceb8be6c77e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f906b000700 1 -- 172.21.15.50:0/4044426545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c001460 con 0x808bd00 2024-09-13T15:11:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f906b000700 1 -- 172.21.15.50:0/4044426545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0052e0 con 0x808bd00 2024-09-13T15:11:34.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f906b000700 1 -- 172.21.15.50:0/4044426545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0036a0 con 0x808bd00 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 -- 172.21.15.50:0/4044426545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 msgr2=0x8075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 0x8075890 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f906c0011e0 tx=0x7f906c007de0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 -- 172.21.15.50:0/4044426545 shutdown_connections 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x8075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x808bd00 0x8075890 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 --2- 172.21.15.50:0/4044426545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80acda0 0x80ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 -- 172.21.15.50:0/4044426545 >> 172.21.15.50:0/4044426545 conn(0x7df54d0 msgr2=0x808ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 -- 172.21.15.50:0/4044426545 shutdown_connections 2024-09-13T15:11:34.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 -- 172.21.15.50:0/4044426545 wait complete. 2024-09-13T15:11:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 -- start start 2024-09-13T15:11:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.104+0000 7f90886cb740 1 Processor -- start 2024-09-13T15:11:34.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x808cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x8065020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b730 con 0x80acda0 2024-09-13T15:11:34.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915b0 con 0x808bd00 2024-09-13T15:11:34.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7e79aa0 con 0x80ad6c0 2024-09-13T15:11:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 10 client.0 _ll_register_callbacks cb 0x7fc7610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:11:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907e800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x808cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907e800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x808cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:52486/0 (socket says 172.21.15.50:52486) 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907e800700 1 -- 172.21.15.50:0/2828690182 learned_addr learned my addr 172.21.15.50:0/2828690182 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907f200700 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x8065020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 -- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 msgr2=0x8065020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x8065020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 -- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 msgr2=0x808cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x808cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 -- 172.21.15.50:0/2828690182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c0015c0 con 0x80acda0 2024-09-13T15:11:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f907de00700 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80665e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f906c017000 tx=0x7f906c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7482a9428cfef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f905f400700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f905f400700 1 -- 172.21.15.50:0/2828690182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c006860 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7e021e0 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.108+0000 7f905f400700 1 -- 172.21.15.50:0/2828690182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f906c0069c0 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f905f400700 1 -- 172.21.15.50:0/2828690182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906c006b80 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 10 client.7086 fetch_fsmap learned FSMap version 46 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x7f94220 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f905f400700 1 -- 172.21.15.50:0/2828690182 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7e021e0 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f905f400700 1 -- 172.21.15.50:0/2828690182 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 46) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f906c012070 con 0x80acda0 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 10 client.7086 fetch_fsmap finished waiting for FSMap version 46 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 10 client.7086 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:11:34.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 20 client.7086 populate_metadata read hostname 'smithi050' 2024-09-13T15:11:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x8088030 0x80630c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 4 client.7086 mds_command: new command op to 6954 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:11:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 --> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7e4c460 con 0x8088030 2024-09-13T15:11:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f907e800700 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x8088030 0x80630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f905f400700 10 client.7086 ms_handle_connect on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:34.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.112+0000 7f907e800700 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x8088030 0x80630c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5566d31ccdc23b95 server_cookie=d7ff8386b02d8813 in_seq=0 out_seq=0 2024-09-13T15:11:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f905f400700 1 -- 172.21.15.50:0/2828690182 <== mds.0 v2:172.21.15.50:6834/2602636353 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7e4c460 con 0x8088030 2024-09-13T15:11:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f905f400700 10 client.7086 handle_command_reply: tid=0 2024-09-13T15:11:34.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 client.7086 shutdown 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 msgr2=0x80665e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80665e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f906c017000 tx=0x7f906c000ed0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 shutdown_connections 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x8065020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80665e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x8088030 0x80630c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 --2- 172.21.15.50:0/2828690182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x808cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f905f400700 0 client.7086 ms_handle_reset on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:34.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 >> 172.21.15.50:0/2828690182 conn(0x7df54d0 msgr2=0x8088780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 shutdown_connections 2024-09-13T15:11:34.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 1 -- 172.21.15.50:0/2828690182 wait complete. 2024-09-13T15:11:34.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.116+0000 7f90886cb740 20 client.7086 trim_cache size 0 max 16384 2024-09-13T15:11:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 Processor -- start 2024-09-13T15:11:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 -- start start 2024-09-13T15:11:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x80a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x808b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x805e960 con 0x80acda0 2024-09-13T15:11:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffcec0 con 0x808bd00 2024-09-13T15:11:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00 con 0x80ad6c0 2024-09-13T15:11:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x80a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40992/0 (socket says 172.21.15.50:40992) 2024-09-13T15:11:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907de00700 1 -- 172.21.15.50:0/4077269480 learned_addr learned my addr 172.21.15.50:0/4077269480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907f200700 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x808b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 -- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 msgr2=0x808b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x808b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 -- 172.21.15.50:0/4077269480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 msgr2=0x80a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80a87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 -- 172.21.15.50:0/4077269480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a450 con 0x808bd00 2024-09-13T15:11:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907de00700 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.140+0000 7f907e800700 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x80a82a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x8065c40 tx=0x7f9070018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f18a672a24d01a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f906ba00700 1 -- 172.21.15.50:0/4077269480 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907001c040 con 0x808bd00 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f906ba00700 1 -- 172.21.15.50:0/4077269480 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070011c20 con 0x808bd00 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f906ba00700 1 -- 172.21.15.50:0/4077269480 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907002a1e0 con 0x808bd00 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 msgr2=0x80a82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x80a82a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x8065c40 tx=0x7f9070018000 comp rx=0 tx=0).stop 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- 172.21.15.50:0/4077269480 shutdown_connections 2024-09-13T15:11:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x80ad6c0 0x808b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x80a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- 172.21.15.50:0/4077269480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x808bd00 0x80a82a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- 172.21.15.50:0/4077269480 >> 172.21.15.50:0/4077269480 conn(0x7df54d0 msgr2=0x808a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- 172.21.15.50:0/4077269480 shutdown_connections 2024-09-13T15:11:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- 172.21.15.50:0/4077269480 wait complete. 2024-09-13T15:11:34.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- start start 2024-09-13T15:11:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 Processor -- start 2024-09-13T15:11:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x808bd00 0x80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x80cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x8064ee0 con 0x80acda0 2024-09-13T15:11:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x80ccd80 con 0x80ad6c0 2024-09-13T15:11:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x8064040 con 0x808bd00 2024-09-13T15:11:34.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.144+0000 7f90886cb740 10 client.0 _ll_register_callbacks cb 0x8024710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907e800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x808bd00 0x80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x80cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907e800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x808bd00 0x80c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:33038/0 (socket says 172.21.15.50:33038) 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907e800700 1 -- 172.21.15.50:0/698151280 learned_addr learned my addr 172.21.15.50:0/698151280 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 -- 172.21.15.50:0/698151280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x808bd00 msgr2=0x80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x808bd00 0x80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 -- 172.21.15.50:0/698151280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 msgr2=0x80cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x80cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 -- 172.21.15.50:0/698151280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94220 con 0x80acda0 2024-09-13T15:11:34.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907de00700 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x810e5b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f906c001eb0 tx=0x7f906c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e786c94865fa0815 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f905f400700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:11:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f905f400700 1 -- 172.21.15.50:0/698151280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c006a70 con 0x80acda0 2024-09-13T15:11:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f905f400700 1 -- 172.21.15.50:0/698151280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f906c006dd0 con 0x80acda0 2024-09-13T15:11:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f906c0052e0 con 0x80acda0 2024-09-13T15:11:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f905f400700 1 -- 172.21.15.50:0/698151280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906c006bd0 con 0x80acda0 2024-09-13T15:11:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 10 client.7092 fetch_fsmap learned FSMap version 46 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x7f9070004160 con 0x80acda0 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f905f400700 1 -- 172.21.15.50:0/698151280 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c03e070 con 0x80acda0 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f905f400700 1 -- 172.21.15.50:0/698151280 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 46) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f906c00f1d0 con 0x80acda0 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 10 client.7092 fetch_fsmap finished waiting for FSMap version 46 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 10 client.7092 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 20 client.7092 populate_metadata read hostname 'smithi050' 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x80cbe00 0x810f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 4 client.7092 mds_command: new command op to 6954 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 --> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7e711e0 con 0x80cbe00 2024-09-13T15:11:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.148+0000 7f907e800700 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x80cbe00 0x810f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f907e800700 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x80cbe00 0x810f7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0eff4a44f905c45 server_cookie=7042274e4d3e4396 in_seq=0 out_seq=0 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f905f400700 10 client.7092 ms_handle_connect on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f905f400700 1 -- 172.21.15.50:0/698151280 <== mds.0 v2:172.21.15.50:6834/2602636353 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7e711e0 con 0x80cbe00 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f905f400700 10 client.7092 handle_command_reply: tid=0 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 client.7092 shutdown 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 msgr2=0x810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x810e5b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f906c001eb0 tx=0x7f906c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 shutdown_connections 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x80cbe00 0x810f7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x80ad6c0 0x80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x80acda0 0x810e5b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 --2- 172.21.15.50:0/698151280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x808bd00 0x80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 >> 172.21.15.50:0/698151280 conn(0x7df54d0 msgr2=0x808afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f905f400700 0 client.7092 ms_handle_reset on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 shutdown_connections 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 1 -- 172.21.15.50:0/698151280 wait complete. 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f90886cb740 20 client.7092 trim_cache size 0 max 16384 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:11:34.157 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6954, 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.5223676360000002, 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 46, 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 89, 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 11.706912129999999 2024-09-13T15:11:34.158 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:11:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9060066730 msgr2=0x7f9060068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9060066730 0x7f9060068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9070009bf0 tx=0x7f9070009240 comp rx=0 tx=0).stop 2024-09-13T15:11:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 msgr2=0x7f9080143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f9080143700 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f90800b2980 tx=0x7f9078004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 shutdown_connections 2024-09-13T15:11:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9060066730 0x7f9060068bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9080165560 0x7f9080143700 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9080158150 0x7f9080144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 --2- 172.21.15.50:0/337488559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9080157d70 0x7f9080141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 >> 172.21.15.50:0/337488559 conn(0x7f908006e660 msgr2=0x7f90800ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 shutdown_connections 2024-09-13T15:11:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.152+0000 7f9084a00700 1 -- 172.21.15.50:0/337488559 wait complete. 2024-09-13T15:11:34.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:11:34.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 Processor -- start 2024-09-13T15:11:34.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 -- start start 2024-09-13T15:11:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc3f415cb30 0x7fc3f41611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f4071200 0x7fc3f4066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3f40665d0 0x7fc3f40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f4066a80 con 0x7fc3f40665d0 2024-09-13T15:11:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f406a7a0 con 0x7fc3f415cb30 2024-09-13T15:11:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cd8a0 con 0x7fc3f4071200 2024-09-13T15:11:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fa800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3f40665d0 0x7fc3f40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fa800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3f40665d0 0x7fc3f40cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41014/0 (socket says 172.21.15.50:41014) 2024-09-13T15:11:34.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3f9e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc3f415cb30 0x7fc3f41611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3fa800700 1 -- 172.21.15.50:0/708586656 learned_addr learned my addr 172.21.15.50:0/708586656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.356+0000 7fc3f9400700 1 --2- 172.21.15.50:0/708586656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f4071200 0x7fc3f4066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fa800700 1 -- 172.21.15.50:0/708586656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f4071200 msgr2=0x7fc3f4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fa800700 1 --2- 172.21.15.50:0/708586656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f4071200 0x7fc3f4066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fa800700 1 -- 172.21.15.50:0/708586656 >> v2:172.21.15.181:3300/0 conn(0x7fc3f415cb30 msgr2=0x7fc3f41611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fa800700 1 --2- 172.21.15.50:0/708586656 >> v2:172.21.15.181:3300/0 conn(0x7fc3f415cb30 0x7fc3f41611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fa800700 1 -- 172.21.15.50:0/708586656 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40cdb40 con 0x7fc3f40665d0 2024-09-13T15:11:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fa800700 1 --2- 172.21.15.50:0/708586656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f40665d0 0x7fc3f40cc430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc3f406d8c0 tx=0x7fc3f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55ae4356f1125c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3f8a00700 1 -- 172.21.15.50:0/708586656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0011830 con 0x7fc3f40665d0 2024-09-13T15:11:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3f8a00700 1 -- 172.21.15.50:0/708586656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0011990 con 0x7fc3f40665d0 2024-09-13T15:11:34.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3f8a00700 1 -- 172.21.15.50:0/708586656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0011d20 con 0x7fc3f40665d0 2024-09-13T15:11:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 -- 172.21.15.50:0/708586656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f40665d0 msgr2=0x7fc3f40cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 --2- 172.21.15.50:0/708586656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f40665d0 0x7fc3f40cc430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc3f406d8c0 tx=0x7fc3f0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 -- 172.21.15.50:0/708586656 shutdown_connections 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 --2- 172.21.15.50:0/708586656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f40665d0 0x7fc3f40cc430 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 --2- 172.21.15.50:0/708586656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f4071200 0x7fc3f4066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 --2- 172.21.15.50:0/708586656 >> v2:172.21.15.181:3300/0 conn(0x7fc3f415cb30 0x7fc3f41611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 -- 172.21.15.50:0/708586656 >> 172.21.15.50:0/708586656 conn(0x7fc3f406ca10 msgr2=0x7fc3f406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 -- 172.21.15.50:0/708586656 shutdown_connections 2024-09-13T15:11:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.360+0000 7fc3fb200700 1 -- 172.21.15.50:0/708586656 wait complete. 2024-09-13T15:11:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 Processor -- start 2024-09-13T15:11:34.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 -- start start 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f40665d0 0x7fc3f4153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 0x7fc3f41523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3f415cb30 0x7fc3f413fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f41551e0 con 0x7fc3f4071200 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4154560 con 0x7fc3f415cb30 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.364+0000 7fc3fb200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4154840 con 0x7fc3f40665d0 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 0x7fc3f41523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 0x7fc3f41523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41030/0 (socket says 172.21.15.50:41030) 2024-09-13T15:11:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 -- 172.21.15.50:0/1571860461 learned_addr learned my addr 172.21.15.50:0/1571860461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3fa800700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3f415cb30 0x7fc3f413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9e00700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f40665d0 0x7fc3f4153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 -- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f40665d0 msgr2=0x7fc3f4153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f40665d0 0x7fc3f4153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 -- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3f415cb30 msgr2=0x7fc3f413fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3f415cb30 0x7fc3f413fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 -- 172.21.15.50:0/1571860461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0009570 con 0x7fc3f4071200 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3f9400700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 0x7fc3f41523d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400e730 tx=0x7fc3e400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400c070 con 0x7fc3f4071200 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4004020 con 0x7fc3f4071200 2024-09-13T15:11:34.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40043d0 con 0x7fc3f4071200 2024-09-13T15:11:34.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f4154b20 con 0x7fc3f4071200 2024-09-13T15:11:34.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4152910 con 0x7fc3f4071200 2024-09-13T15:11:34.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.368+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f40b3160 con 0x7fc3f4071200 2024-09-13T15:11:34.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.372+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3e40036c0 con 0x7fc3f4071200 2024-09-13T15:11:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.372+0000 7fc3ea000700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3d8066730 0x7fc3d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.372+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3e4083c40 con 0x7fc3f4071200 2024-09-13T15:11:34.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.372+0000 7fc3f9e00700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3d8066730 0x7fc3d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:34.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.376+0000 7fc3f9e00700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3d8066730 0x7fc3d8068bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0113e0 tx=0x7fc3ec00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.380+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3e4050dd0 con 0x7fc3f4071200 2024-09-13T15:11:34.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.608+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc3f40cbcf0 con 0x7fc3f4071200 2024-09-13T15:11:34.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.608+0000 7fc3ea000700 1 -- 172.21.15.50:0/1571860461 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc3e40543f0 con 0x7fc3f4071200 2024-09-13T15:11:34.611 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:11:34.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.608+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3d8066730 msgr2=0x7fc3d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.608+0000 7fc3fb200700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3d8066730 0x7fc3d8068bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0113e0 tx=0x7fc3ec00b040 comp rx=0 tx=0).stop 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.608+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 msgr2=0x7fc3f41523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.608+0000 7fc3fb200700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 0x7fc3f41523d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400e730 tx=0x7fc3e400ea40 comp rx=0 tx=0).stop 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 shutdown_connections 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3d8066730 0x7fc3d8068bf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3f415cb30 0x7fc3f413fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3f4071200 0x7fc3f41523d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 --2- 172.21.15.50:0/1571860461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc3f40665d0 0x7fc3f4153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:34.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 >> 172.21.15.50:0/1571860461 conn(0x7fc3f406ca10 msgr2=0x7fc3f40b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 shutdown_connections 2024-09-13T15:11:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:34.612+0000 7fc3fb200700 1 -- 172.21.15.50:0/1571860461 wait complete. 2024-09-13T15:11:34.636 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:11:34.637 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:11:34.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:34.637 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:34.658 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42212sec preferred_lft 42212sec 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:11:34.659 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:11:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:11:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:11:34.662 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:34.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:34.662 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:11:34.739 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:11:34.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:34.742 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:11:34.808 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:11:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:11:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:11:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:11:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:11:34.809 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:11:34.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:34.809 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:11:34.809 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:11:34.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:11:34.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:11:34.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:11:34.810 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:11:34.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:34.944 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:11:34.960 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:11:34.960 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:11:34.961 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:11:34.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:34.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:11:35.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:35.039 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:35.098 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:11:35.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:35.098 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:35.163 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:11:35.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:35.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:35.295 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:35.295 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:35.323 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:35.323 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:35.323 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:11:35.323 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:11:35.323 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:11:35.331 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:11:35.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:35.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:35.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:35.364 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:11:35.445 INFO:teuthology.orchestra.run.smithi050.stdout:client7101 2024-09-13T15:11:35.446 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:35.446 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:35.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:11:35.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.732+0000 7fc007200700 1 Processor -- start 2024-09-13T15:11:35.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc007200700 1 -- start start 2024-09-13T15:11:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc007200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc00806b1b0 0x7fc0081646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc007200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080707d0 con 0x7fc008159bd0 2024-09-13T15:11:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc007200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00806fee0 con 0x7fc0080cb700 2024-09-13T15:11:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc007200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080720a0 con 0x7fc00806b1b0 2024-09-13T15:11:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc006800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc00806b1b0 0x7fc0081646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc005e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc008159bd0 0x7fc008071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39938/0 (socket says 172.21.15.50:39938) 2024-09-13T15:11:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc005e00700 1 -- 172.21.15.50:0/3666150622 learned_addr learned my addr 172.21.15.50:0/3666150622 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc006800700 1 -- 172.21.15.50:0/3666150622 >> v1:172.21.15.181:6789/0 conn(0x7fc0080cb700 legacy=0x7fc00806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc006800700 1 -- 172.21.15.50:0/3666150622 >> v1:172.21.15.50:6789/0 conn(0x7fc008159bd0 legacy=0x7fc008071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc004a00700 1 -- 172.21.15.50:0/3666150622 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246589141 0 0) 0x7fc0080707d0 con 0x7fc008159bd0 2024-09-13T15:11:35.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.736+0000 7fc006800700 1 -- 172.21.15.50:0/3666150622 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080b2ef0 con 0x7fc00806b1b0 2024-09-13T15:11:35.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc006800700 1 --2- 172.21.15.50:0/3666150622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00806b1b0 0x7fc0081646c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc000009dc0 tx=0x7fc00000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444a9f6b6d272293 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:35.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc004a00700 1 -- 172.21.15.50:0/3666150622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00000e070 con 0x7fc00806b1b0 2024-09-13T15:11:35.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc004a00700 1 -- 172.21.15.50:0/3666150622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00000bb90 con 0x7fc00806b1b0 2024-09-13T15:11:35.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc004a00700 1 -- 172.21.15.50:0/3666150622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000012430 con 0x7fc00806b1b0 2024-09-13T15:11:35.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 -- 172.21.15.50:0/3666150622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00806b1b0 msgr2=0x7fc0081646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 --2- 172.21.15.50:0/3666150622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00806b1b0 0x7fc0081646c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc000009dc0 tx=0x7fc00000b330 comp rx=0 tx=0).stop 2024-09-13T15:11:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 -- 172.21.15.50:0/3666150622 shutdown_connections 2024-09-13T15:11:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 --2- 172.21.15.50:0/3666150622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00806b1b0 0x7fc0081646c0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 -- 172.21.15.50:0/3666150622 >> 172.21.15.50:0/3666150622 conn(0x7fc0080b0c40 msgr2=0x7fc00806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 -- 172.21.15.50:0/3666150622 shutdown_connections 2024-09-13T15:11:35.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.740+0000 7fc007200700 1 -- 172.21.15.50:0/3666150622 wait complete. 2024-09-13T15:11:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 Processor -- start 2024-09-13T15:11:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 -- start start 2024-09-13T15:11:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00806b1b0 0x7fc0080af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 0x7fc00806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc008159bd0 0x7fc00806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080a8830 con 0x7fc0080cb700 2024-09-13T15:11:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081f5fa0 con 0x7fc00806b1b0 2024-09-13T15:11:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc007200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081f6280 con 0x7fc008159bd0 2024-09-13T15:11:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc005400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 0x7fc00806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc005400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 0x7fc00806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41048/0 (socket says 172.21.15.50:41048) 2024-09-13T15:11:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc005400700 1 -- 172.21.15.50:0/4143376831 learned_addr learned my addr 172.21.15.50:0/4143376831 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc005e00700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00806b1b0 0x7fc0080af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.744+0000 7fc006800700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc008159bd0 0x7fc00806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc005400700 1 -- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc008159bd0 msgr2=0x7fc00806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc005400700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc008159bd0 0x7fc00806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc005400700 1 -- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00806b1b0 msgr2=0x7fc0080af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc005400700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00806b1b0 0x7fc0080af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc005400700 1 -- 172.21.15.50:0/4143376831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000009a70 con 0x7fc0080cb700 2024-09-13T15:11:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc005400700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 0x7fc00806d160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c500 tx=0x7fbff400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff40052d0 con 0x7fc0080cb700 2024-09-13T15:11:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4005430 con 0x7fc0080cb700 2024-09-13T15:11:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0081f6560 con 0x7fc0080cb700 2024-09-13T15:11:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff40055a0 con 0x7fc0080cb700 2024-09-13T15:11:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0081f6b20 con 0x7fc0080cb700 2024-09-13T15:11:35.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.748+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008070c40 con 0x7fc0080cb700 2024-09-13T15:11:35.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.752+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbff40038e0 con 0x7fc0080cb700 2024-09-13T15:11:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.752+0000 7fbffe000700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbfe8066730 0x7fbfe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:35.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.752+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbff4083650 con 0x7fc0080cb700 2024-09-13T15:11:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.756+0000 7fc005e00700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbfe8066730 0x7fbfe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.756+0000 7fc005e00700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbfe8066730 0x7fbfe8068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbff8000f60 tx=0x7fbff8004a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.760+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc008070c40 con 0x7fc0080cb700 2024-09-13T15:11:35.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:35.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.996+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc008070c40 con 0x7fc0080cb700 2024-09-13T15:11:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:35.996+0000 7fbffe000700 1 -- 172.21.15.50:0/4143376831 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc008070c40 con 0x7fc0080cb700 2024-09-13T15:11:36.002 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbfe8066730 msgr2=0x7fbfe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbfe8066730 0x7fbfe8068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbff8000f60 tx=0x7fbff8004a70 comp rx=0 tx=0).stop 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 msgr2=0x7fc00806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 0x7fc00806d160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c500 tx=0x7fbff400c810 comp rx=0 tx=0).stop 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 shutdown_connections 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbfe8066730 0x7fbfe8068bf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc008159bd0 0x7fc00806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0080cb700 0x7fc00806d160 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 --2- 172.21.15.50:0/4143376831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00806b1b0 0x7fc0080af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 >> 172.21.15.50:0/4143376831 conn(0x7fc0080b0c40 msgr2=0x7fc00814d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 shutdown_connections 2024-09-13T15:11:36.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:36.004+0000 7fc007200700 1 -- 172.21.15.50:0/4143376831 wait complete. 2024-09-13T15:11:36.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:11:36.029 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:11:36.030 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:11:36.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.030 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.050 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.051 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:11:36.052 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:11:36.053 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.053 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:11:36.053 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:11:36.053 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:11:36.053 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:11:36.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.054 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:11:36.129 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:11:36.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.132 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:11:36.196 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:11:36.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.196 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:11:36.196 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:11:36.196 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:11:36.196 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:11:36.196 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:11:36.196 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:11:36.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.317 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:11:36.332 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:11:36.332 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:11:36.334 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:11:36.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.334 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:11:36.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:36.413 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:36.477 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:11:36.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:11:36.477 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:36.534 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:11:36.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:36.661 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:36.661 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:36.688 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:11:36.688 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:11:36.688 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:11:36.688 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:11:36.688 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:11:36.694 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:11:36.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.694 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:36.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:36.721 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:11:36.796 INFO:teuthology.orchestra.run.smithi181.stdout:client6299 2024-09-13T15:11:36.816 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:36.816 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:36.862 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:36.862 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:36.879 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:36.879 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:36.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.156+0000 7fcab6c00700 1 Processor -- start 2024-09-13T15:11:37.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.156+0000 7fcab6c00700 1 -- start start 2024-09-13T15:11:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcab00b2d80 0x7fcab006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00b3560 con 0x7fcab006aaa0 2024-09-13T15:11:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00b3280 con 0x7fcab01610b0 2024-09-13T15:11:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab0070b30 con 0x7fcab00b2d80 2024-09-13T15:11:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab4e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcab006aaa0 0x7fcab00b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39946/0 (socket says 172.21.15.50:39946) 2024-09-13T15:11:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab4e00700 1 -- 172.21.15.50:0/3031120231 learned_addr learned my addr 172.21.15.50:0/3031120231 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6200700 1 --2- 172.21.15.50:0/3031120231 >> v2:172.21.15.181:3300/0 conn(0x7fcab00b2d80 0x7fcab006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcaafe00700 1 -- 172.21.15.50:0/3031120231 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202334709 0 0) 0x7fcab00b3560 con 0x7fcab006aaa0 2024-09-13T15:11:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcaafe00700 1 -- 172.21.15.50:0/3031120231 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca980035d0 con 0x7fcab006aaa0 2024-09-13T15:11:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6200700 1 -- 172.21.15.50:0/3031120231 >> v1:172.21.15.181:6789/0 conn(0x7fcab01610b0 legacy=0x7fcab00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcaafe00700 1 -- 172.21.15.50:0/3031120231 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065600171 0 0) 0x7fcab00b3280 con 0x7fcab01610b0 2024-09-13T15:11:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6200700 1 -- 172.21.15.50:0/3031120231 >> v1:172.21.15.50:6789/0 conn(0x7fcab006aaa0 legacy=0x7fcab00b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.160+0000 7fcab6200700 1 -- 172.21.15.50:0/3031120231 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0070ee0 con 0x7fcab00b2d80 2024-09-13T15:11:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6200700 1 --2- 172.21.15.50:0/3031120231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab00b2d80 0x7fcab006af10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009dc0 tx=0x7fcaa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27efef63d2dbc986 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcaafe00700 1 -- 172.21.15.50:0/3031120231 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800e070 con 0x7fcab00b2d80 2024-09-13T15:11:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcaafe00700 1 -- 172.21.15.50:0/3031120231 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800bae0 con 0x7fcab00b2d80 2024-09-13T15:11:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcaafe00700 1 -- 172.21.15.50:0/3031120231 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800be90 con 0x7fcab00b2d80 2024-09-13T15:11:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 -- 172.21.15.50:0/3031120231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab00b2d80 msgr2=0x7fcab006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 --2- 172.21.15.50:0/3031120231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab00b2d80 0x7fcab006af10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009dc0 tx=0x7fcaa800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 -- 172.21.15.50:0/3031120231 shutdown_connections 2024-09-13T15:11:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 --2- 172.21.15.50:0/3031120231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab00b2d80 0x7fcab006af10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 -- 172.21.15.50:0/3031120231 >> 172.21.15.50:0/3031120231 conn(0x7fcab00b0c40 msgr2=0x7fcab006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 -- 172.21.15.50:0/3031120231 shutdown_connections 2024-09-13T15:11:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.164+0000 7fcab6c00700 1 -- 172.21.15.50:0/3031120231 wait complete. 2024-09-13T15:11:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 Processor -- start 2024-09-13T15:11:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 -- start start 2024-09-13T15:11:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab006aaa0 0x7fcab01f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 0x7fcab0159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcab01610b0 0x7fcab015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab01f7950 con 0x7fcab00b2d80 2024-09-13T15:11:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0161f80 con 0x7fcab006aaa0 2024-09-13T15:11:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab01f9cb0 con 0x7fcab01610b0 2024-09-13T15:11:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 0x7fcab0159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 0x7fcab0159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41054/0 (socket says 172.21.15.50:41054) 2024-09-13T15:11:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab4e00700 1 -- 172.21.15.50:0/2626386708 learned_addr learned my addr 172.21.15.50:0/2626386708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab5800700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab006aaa0 0x7fcab01f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.168+0000 7fcab6200700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcab01610b0 0x7fcab015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab4e00700 1 -- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcab01610b0 msgr2=0x7fcab015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab4e00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcab01610b0 0x7fcab015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab4e00700 1 -- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab006aaa0 msgr2=0x7fcab01f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab4e00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab006aaa0 0x7fcab01f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab4e00700 1 -- 172.21.15.50:0/2626386708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8009a70 con 0x7fcab00b2d80 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab6200700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcab01610b0 0x7fcab015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab4e00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 0x7fcab0159cc0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c4f0 tx=0x7fca9c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c005d90 con 0x7fcab00b2d80 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c0070d0 con 0x7fcab00b2d80 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab01f7670 con 0x7fcab00b2d80 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c007440 con 0x7fcab00b2d80 2024-09-13T15:11:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab0161c10 con 0x7fcab00b2d80 2024-09-13T15:11:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.172+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0161790 con 0x7fcab00b2d80 2024-09-13T15:11:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.176+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca9c0075a0 con 0x7fcab00b2d80 2024-09-13T15:11:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.176+0000 7fcaad600700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fca90066730 0x7fca90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.176+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca9c0836a0 con 0x7fcab00b2d80 2024-09-13T15:11:37.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.176+0000 7fcab5800700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fca90066730 0x7fca90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.180+0000 7fcab5800700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fca90066730 0x7fca90068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4000f60 tx=0x7fcaa4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:37.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.180+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcab0161790 con 0x7fcab00b2d80 2024-09-13T15:11:37.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.372+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcab0161790 con 0x7fcab00b2d80 2024-09-13T15:11:37.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.372+0000 7fcaad600700 1 -- 172.21.15.50:0/2626386708 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fcab0161790 con 0x7fcab00b2d80 2024-09-13T15:11:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:37.378 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:28.631014+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fca90066730 msgr2=0x7fca90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fca90066730 0x7fca90068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4000f60 tx=0x7fcaa4009040 comp rx=0 tx=0).stop 2024-09-13T15:11:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 msgr2=0x7fcab0159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 0x7fcab0159cc0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c4f0 tx=0x7fca9c00c800 comp rx=0 tx=0).stop 2024-09-13T15:11:37.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 shutdown_connections 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fca90066730 0x7fca90068bf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcab01610b0 0x7fcab015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab00b2d80 0x7fcab0159cc0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 --2- 172.21.15.50:0/2626386708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcab006aaa0 0x7fcab01f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 >> 172.21.15.50:0/2626386708 conn(0x7fcab00b0c40 msgr2=0x7fcab00afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 shutdown_connections 2024-09-13T15:11:37.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.380+0000 7fcab6c00700 1 -- 172.21.15.50:0/2626386708 wait complete. 2024-09-13T15:11:37.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:25.790116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:26.629791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:37.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:37.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.584+0000 7f256e400700 1 Processor -- start 2024-09-13T15:11:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.584+0000 7f256e400700 1 -- start start 2024-09-13T15:11:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f256e400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f25680cf280 0x7f256816bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f256e400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256806d000 con 0x7f256806be10 2024-09-13T15:11:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f256e400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256806c3f0 con 0x7f2568160fc0 2024-09-13T15:11:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f256e400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256806c6d0 con 0x7f25680cf280 2024-09-13T15:11:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2566a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f256806be10 0x7f25680ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39958/0 (socket says 172.21.15.50:39958) 2024-09-13T15:11:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2567400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2568160fc0 0x7f25680b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:40996/0 (socket says 172.21.15.50:40996) 2024-09-13T15:11:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2566a00700 1 -- 172.21.15.50:0/2046720838 learned_addr learned my addr 172.21.15.50:0/2046720838 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2567e00700 1 --2- 172.21.15.50:0/2046720838 >> v2:172.21.15.181:3300/0 conn(0x7f25680cf280 0x7f256816bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050609646 0 0) 0x7f256806d000 con 0x7f256806be10 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f254c0035d0 con 0x7f256806be10 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994982903 0 0) 0x7f256806c3f0 con 0x7f2568160fc0 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256806d000 con 0x7f2568160fc0 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2567e00700 1 -- 172.21.15.50:0/2046720838 >> v1:172.21.15.181:6789/0 conn(0x7f2568160fc0 legacy=0x7f25680b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2567e00700 1 -- 172.21.15.50:0/2046720838 >> v1:172.21.15.50:6789/0 conn(0x7f256806be10 legacy=0x7f25680ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2567e00700 1 -- 172.21.15.50:0/2046720838 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256806c9b0 con 0x7f25680cf280 2024-09-13T15:11:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.588+0000 7f2567e00700 1 --2- 172.21.15.50:0/2046720838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256816bbc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2560009d90 tx=0x7f256000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6ed0edf8f256385 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e070 con 0x7f25680cf280 2024-09-13T15:11:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000bb20 con 0x7f25680cf280 2024-09-13T15:11:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f2566000700 1 -- 172.21.15.50:0/2046720838 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000be90 con 0x7f25680cf280 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 -- 172.21.15.50:0/2046720838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 msgr2=0x7f256816bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 --2- 172.21.15.50:0/2046720838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256816bbc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2560009d90 tx=0x7f256000b330 comp rx=0 tx=0).stop 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 -- 172.21.15.50:0/2046720838 shutdown_connections 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 --2- 172.21.15.50:0/2046720838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256816bbc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 -- 172.21.15.50:0/2046720838 >> 172.21.15.50:0/2046720838 conn(0x7f256806a570 msgr2=0x7f256806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 -- 172.21.15.50:0/2046720838 shutdown_connections 2024-09-13T15:11:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 -- 172.21.15.50:0/2046720838 wait complete. 2024-09-13T15:11:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 Processor -- start 2024-09-13T15:11:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.592+0000 7f256e400700 1 -- start start 2024-09-13T15:11:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f256806be10 0x7f256814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 0x7f256814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256814cda0 con 0x7f2568160fc0 2024-09-13T15:11:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256815a210 con 0x7f25680cf280 2024-09-13T15:11:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680cd1b0 con 0x7f256806be10 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 0x7f256814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 0x7f256814d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41064/0 (socket says 172.21.15.50:41064) 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 -- 172.21.15.50:0/1469362408 learned_addr learned my addr 172.21.15.50:0/1469362408 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f256806be10 0x7f256814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2566a00700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 -- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f256806be10 msgr2=0x7f256814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f256806be10 0x7f256814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 -- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 msgr2=0x7f256814f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256814f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 -- 172.21.15.50:0/1469362408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009a70 con 0x7f2568160fc0 2024-09-13T15:11:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f2567e00700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 0x7f256814d1f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f256806b7d0 tx=0x7f2560004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560004880 con 0x7f2568160fc0 2024-09-13T15:11:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560020070 con 0x7f2568160fc0 2024-09-13T15:11:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680cd490 con 0x7f2568160fc0 2024-09-13T15:11:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600276c0 con 0x7f2568160fc0 2024-09-13T15:11:37.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.596+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680cda50 con 0x7f2568160fc0 2024-09-13T15:11:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.600+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256814cf10 con 0x7f2568160fc0 2024-09-13T15:11:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.600+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2560012430 con 0x7f2568160fc0 2024-09-13T15:11:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.604+0000 7f255f400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2548066730 0x7f2548068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.604+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2560022070 con 0x7f2568160fc0 2024-09-13T15:11:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.604+0000 7f2567400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2548066730 0x7f2548068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:37.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.604+0000 7f2567400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2548066730 0x7f2548068bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2558007fd0 tx=0x7f2558007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:37.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.608+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f256814cf10 con 0x7f2568160fc0 2024-09-13T15:11:37.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.792+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f256814cee0 con 0x7f2568160fc0 2024-09-13T15:11:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.792+0000 7f255f400700 1 -- 172.21.15.50:0/1469362408 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f256002c020 con 0x7f2568160fc0 2024-09-13T15:11:37.797 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2548066730 msgr2=0x7f2548068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2548066730 0x7f2548068bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2558007fd0 tx=0x7f2558007de0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 msgr2=0x7f256814d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:37.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 0x7f256814d1f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f256806b7d0 tx=0x7f2560004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 shutdown_connections 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2548066730 0x7f2548068bf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2568160fc0 0x7f256814d1f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25680cf280 0x7f256814f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 --2- 172.21.15.50:0/1469362408 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f256806be10 0x7f256814ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 >> 172.21.15.50:0/1469362408 conn(0x7f256806a570 msgr2=0x7f256806fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 shutdown_connections 2024-09-13T15:11:37.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:37.796+0000 7f256e400700 1 -- 172.21.15.50:0/1469362408 wait complete. 2024-09-13T15:11:37.825 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:11:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.000+0000 7f6669a00700 1 Processor -- start 2024-09-13T15:11:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.000+0000 7f6669a00700 1 -- start start 2024-09-13T15:11:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f666406d620 0x7f666406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f666406cea0 0x7f66640b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66640b1980 con 0x7f6664143b70 2024-09-13T15:11:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66640b2500 con 0x7f666406d620 2024-09-13T15:11:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666406d2f0 con 0x7f666406cea0 2024-09-13T15:11:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f666406d620 0x7f666406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f666406d620 0x7f666406c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41078/0 (socket says 172.21.15.50:41078) 2024-09-13T15:11:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 -- 172.21.15.50:0/2917748395 learned_addr learned my addr 172.21.15.50:0/2917748395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669000700 1 --2- 172.21.15.50:0/2917748395 >> v2:172.21.15.181:3300/0 conn(0x7f666406cea0 0x7f66640b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 -- 172.21.15.50:0/2917748395 >> v2:172.21.15.181:3300/0 conn(0x7f666406cea0 msgr2=0x7f66640b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 --2- 172.21.15.50:0/2917748395 >> v2:172.21.15.181:3300/0 conn(0x7f666406cea0 0x7f66640b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 -- 172.21.15.50:0/2917748395 >> v1:172.21.15.50:6789/0 conn(0x7f6664143b70 legacy=0x7f66640cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 -- 172.21.15.50:0/2917748395 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640b1bd0 con 0x7f666406d620 2024-09-13T15:11:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6669000700 1 --2- 172.21.15.50:0/2917748395 >> v2:172.21.15.181:3300/0 conn(0x7f666406cea0 0x7f66640b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6663400700 1 --2- 172.21.15.50:0/2917748395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406d620 0x7f666406c960 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f66640cb4d0 tx=0x7f6650009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f388bc8f5e0a4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6662a00700 1 -- 172.21.15.50:0/2917748395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000b8a0 con 0x7f666406d620 2024-09-13T15:11:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6662a00700 1 -- 172.21.15.50:0/2917748395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000ba00 con 0x7f666406d620 2024-09-13T15:11:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.004+0000 7f6662a00700 1 -- 172.21.15.50:0/2917748395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000bd90 con 0x7f666406d620 2024-09-13T15:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 -- 172.21.15.50:0/2917748395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406d620 msgr2=0x7f666406c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 --2- 172.21.15.50:0/2917748395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406d620 0x7f666406c960 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f66640cb4d0 tx=0x7f6650009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 -- 172.21.15.50:0/2917748395 shutdown_connections 2024-09-13T15:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 --2- 172.21.15.50:0/2917748395 >> v2:172.21.15.181:3300/0 conn(0x7f666406cea0 0x7f66640b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 --2- 172.21.15.50:0/2917748395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406d620 0x7f666406c960 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 -- 172.21.15.50:0/2917748395 >> 172.21.15.50:0/2917748395 conn(0x7f666406a390 msgr2=0x7f666406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 -- 172.21.15.50:0/2917748395 shutdown_connections 2024-09-13T15:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.008+0000 7f6669a00700 1 -- 172.21.15.50:0/2917748395 wait complete. 2024-09-13T15:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 Processor -- start 2024-09-13T15:11:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 -- start start 2024-09-13T15:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 0x7f6664159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f666406d620 0x7f6664154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6664143b70 0x7f66641e5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6664157550 con 0x7f666406cea0 2024-09-13T15:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666413fd30 con 0x7f666406d620 2024-09-13T15:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6664154690 con 0x7f6664143b70 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6663e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 0x7f6664159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6663e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 0x7f6664159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41086/0 (socket says 172.21.15.50:41086) 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6663e00700 1 -- 172.21.15.50:0/3910997454 learned_addr learned my addr 172.21.15.50:0/3910997454 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6663400700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f666406d620 0x7f6664154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.012+0000 7f6669000700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6664143b70 0x7f66641e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6663e00700 1 -- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6664143b70 msgr2=0x7f66641e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6663e00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6664143b70 0x7f66641e5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6663e00700 1 -- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f666406d620 msgr2=0x7f6664154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6663e00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f666406d620 0x7f6664154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6663e00700 1 -- 172.21.15.50:0/3910997454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009570 con 0x7f666406cea0 2024-09-13T15:11:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6663e00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 0x7f6664159fb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f665400c500 tx=0x7f665400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66540052d0 con 0x7f666406cea0 2024-09-13T15:11:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6654005430 con 0x7f666406cea0 2024-09-13T15:11:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6664156cb0 con 0x7f666406cea0 2024-09-13T15:11:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66540055a0 con 0x7f666406cea0 2024-09-13T15:11:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6664157270 con 0x7f666406cea0 2024-09-13T15:11:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.016+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666406c960 con 0x7f666406cea0 2024-09-13T15:11:38.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.020+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66540036a0 con 0x7f666406cea0 2024-09-13T15:11:38.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.024+0000 7f665be00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6644066730 0x7f6644068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.024+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6654083510 con 0x7f666406cea0 2024-09-13T15:11:38.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.024+0000 7f6663400700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6644066730 0x7f6644068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.024+0000 7f6663400700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6644066730 0x7f6644068bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6650000c00 tx=0x7f6650008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.028+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6654050730 con 0x7f666406cea0 2024-09-13T15:11:38.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.212+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f666415e1d0 con 0x7f666406cea0 2024-09-13T15:11:38.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.212+0000 7f665be00700 1 -- 172.21.15.50:0/3910997454 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6654053d50 con 0x7f666406cea0 2024-09-13T15:11:38.216 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6644066730 msgr2=0x7f6644068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6644066730 0x7f6644068bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6650000c00 tx=0x7f6650008030 comp rx=0 tx=0).stop 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 msgr2=0x7f6664159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 0x7f6664159fb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f665400c500 tx=0x7f665400c8c0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 shutdown_connections 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6644066730 0x7f6644068bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6664143b70 0x7f66641e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f666406d620 0x7f6664154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 --2- 172.21.15.50:0/3910997454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666406cea0 0x7f6664159fb0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 >> 172.21.15.50:0/3910997454 conn(0x7f666406a390 msgr2=0x7f66640aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 shutdown_connections 2024-09-13T15:11:38.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.216+0000 7f6669a00700 1 -- 172.21.15.50:0/3910997454 wait complete. 2024-09-13T15:11:38.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:11:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 Processor -- start 2024-09-13T15:11:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 -- start start 2024-09-13T15:11:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e20144330 0x7f8e200cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8e20144710 0x7f8e200b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2006bcf0 con 0x7f8e2006d760 2024-09-13T15:11:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e200cce10 con 0x7f8e20144330 2024-09-13T15:11:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.416+0000 7f8e25600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2006cb50 con 0x7f8e20144710 2024-09-13T15:11:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e20144330 0x7f8e200cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e20144330 0x7f8e200cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41102/0 (socket says 172.21.15.50:41102) 2024-09-13T15:11:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 -- 172.21.15.50:0/1989053195 learned_addr learned my addr 172.21.15.50:0/1989053195 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1f400700 1 --2- 172.21.15.50:0/1989053195 >> v2:172.21.15.181:3300/0 conn(0x7f8e20144710 0x7f8e200b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 -- 172.21.15.50:0/1989053195 >> v2:172.21.15.181:3300/0 conn(0x7f8e20144710 msgr2=0x7f8e200b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 --2- 172.21.15.50:0/1989053195 >> v2:172.21.15.181:3300/0 conn(0x7f8e20144710 0x7f8e200b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 -- 172.21.15.50:0/1989053195 >> v1:172.21.15.181:6789/0 conn(0x7f8e2006d760 legacy=0x7f8e200b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 -- 172.21.15.50:0/1989053195 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200cf4b0 con 0x7f8e20144330 2024-09-13T15:11:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1d600700 1 -- 172.21.15.50:0/1989053195 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365815288 0 0) 0x7f8e2006bcf0 con 0x7f8e2006d760 2024-09-13T15:11:38.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1ea00700 1 --2- 172.21.15.50:0/1989053195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e20144330 0x7f8e200cef70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8e2015b010 tx=0x7f8e10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff58c7893dc8e24e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1d600700 1 -- 172.21.15.50:0/1989053195 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10011830 con 0x7f8e20144330 2024-09-13T15:11:38.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1d600700 1 -- 172.21.15.50:0/1989053195 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10011990 con 0x7f8e20144330 2024-09-13T15:11:38.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e1d600700 1 -- 172.21.15.50:0/1989053195 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10011d20 con 0x7f8e20144330 2024-09-13T15:11:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 -- 172.21.15.50:0/1989053195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e20144330 msgr2=0x7f8e200cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 --2- 172.21.15.50:0/1989053195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e20144330 0x7f8e200cef70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8e2015b010 tx=0x7f8e10009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 -- 172.21.15.50:0/1989053195 shutdown_connections 2024-09-13T15:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 --2- 172.21.15.50:0/1989053195 >> v2:172.21.15.181:3300/0 conn(0x7f8e20144710 0x7f8e200b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 --2- 172.21.15.50:0/1989053195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e20144330 0x7f8e200cef70 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 -- 172.21.15.50:0/1989053195 >> 172.21.15.50:0/1989053195 conn(0x7f8e2006a570 msgr2=0x7f8e2006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.420+0000 7f8e25600700 1 -- 172.21.15.50:0/1989053195 shutdown_connections 2024-09-13T15:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.424+0000 7f8e25600700 1 -- 172.21.15.50:0/1989053195 wait complete. 2024-09-13T15:11:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.424+0000 7f8e25600700 1 Processor -- start 2024-09-13T15:11:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.424+0000 7f8e25600700 1 -- start start 2024-09-13T15:11:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e2006d760 0x7f8e20139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20144330 0x7f8e201546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 0x7f8e20154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20157240 con 0x7f8e201560e0 2024-09-13T15:11:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20156630 con 0x7f8e20144330 2024-09-13T15:11:38.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20156910 con 0x7f8e2006d760 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 0x7f8e20154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 0x7f8e20154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41108/0 (socket says 172.21.15.50:41108) 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 -- 172.21.15.50:0/2060245810 learned_addr learned my addr 172.21.15.50:0/2060245810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1e000700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20144330 0x7f8e201546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1ea00700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e2006d760 0x7f8e20139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 -- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e2006d760 msgr2=0x7f8e20139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e2006d760 0x7f8e20139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 -- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20144330 msgr2=0x7f8e201546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20144330 0x7f8e201546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 -- 172.21.15.50:0/2060245810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10009570 con 0x7f8e201560e0 2024-09-13T15:11:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e1f400700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 0x7f8e20154c30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800ec10 tx=0x7f8e1800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800c980 con 0x7f8e201560e0 2024-09-13T15:11:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800f040 con 0x7f8e201560e0 2024-09-13T15:11:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800cd40 con 0x7f8e201560e0 2024-09-13T15:11:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20156bf0 con 0x7f8e201560e0 2024-09-13T15:11:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.428+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20139e50 con 0x7f8e201560e0 2024-09-13T15:11:38.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.432+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e201573b0 con 0x7f8e201560e0 2024-09-13T15:11:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.432+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e18014480 con 0x7f8e201560e0 2024-09-13T15:11:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.436+0000 7f8e16a00700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e00066760 0x7f8e00068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.436+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e18084be0 con 0x7f8e201560e0 2024-09-13T15:11:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.436+0000 7f8e1ea00700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e00066760 0x7f8e00068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.436+0000 7f8e1ea00700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e00066760 0x7f8e00068c20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8e10000c00 tx=0x7f8e10008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.444+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e18051d70 con 0x7f8e201560e0 2024-09-13T15:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.624+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e200b3d40 con 0x7f8e201560e0 2024-09-13T15:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.624+0000 7f8e16a00700 1 -- 172.21.15.50:0/2060245810 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e18018070 con 0x7f8e201560e0 2024-09-13T15:11:38.627 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e00066760 msgr2=0x7f8e00068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e00066760 0x7f8e00068c20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8e10000c00 tx=0x7f8e10008030 comp rx=0 tx=0).stop 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 msgr2=0x7f8e20154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 0x7f8e20154c30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800ec10 tx=0x7f8e1800ef20 comp rx=0 tx=0).stop 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 shutdown_connections 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8e00066760 0x7f8e00068c20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e201560e0 0x7f8e20154c30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e20144330 0x7f8e201546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 --2- 172.21.15.50:0/2060245810 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8e2006d760 0x7f8e20139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 >> 172.21.15.50:0/2060245810 conn(0x7f8e2006a570 msgr2=0x7f8e2006a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:38.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 shutdown_connections 2024-09-13T15:11:38.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.628+0000 7f8e25600700 1 -- 172.21.15.50:0/2060245810 wait complete. 2024-09-13T15:11:38.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:11:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.832+0000 7fabd9800700 1 Processor -- start 2024-09-13T15:11:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.832+0000 7fabd9800700 1 -- start start 2024-09-13T15:11:38.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd9800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd40cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd9800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabd40b4f30 0x7fabd40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd9800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fabd415e660 0x7fabd40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd9800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd415b210 con 0x7fabd40b4f30 2024-09-13T15:11:38.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd9800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd415ec20 con 0x7fabd415e660 2024-09-13T15:11:38.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd9800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd415ef00 con 0x7fabd40b4b50 2024-09-13T15:11:38.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabd40b4f30 0x7fabd40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabd40b4f30 0x7fabd40b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41112/0 (socket says 172.21.15.50:41112) 2024-09-13T15:11:38.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 -- 172.21.15.50:0/935057154 learned_addr learned my addr 172.21.15.50:0/935057154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:38.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd3400700 1 --2- 172.21.15.50:0/935057154 >> v2:172.21.15.181:3300/0 conn(0x7fabd415e660 0x7fabd40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd2a00700 1 --2- 172.21.15.50:0/935057154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd40cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 -- 172.21.15.50:0/935057154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 msgr2=0x7fabd40cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 --2- 172.21.15.50:0/935057154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd40cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 -- 172.21.15.50:0/935057154 >> v2:172.21.15.181:3300/0 conn(0x7fabd415e660 msgr2=0x7fabd40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 --2- 172.21.15.50:0/935057154 >> v2:172.21.15.181:3300/0 conn(0x7fabd415e660 0x7fabd40d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 -- 172.21.15.50:0/935057154 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd415f1e0 con 0x7fabd40b4f30 2024-09-13T15:11:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd3400700 1 --2- 172.21.15.50:0/935057154 >> v2:172.21.15.181:3300/0 conn(0x7fabd415e660 0x7fabd40d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabcbe00700 1 --2- 172.21.15.50:0/935057154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd40b3aa0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fabd40d1b00 tx=0x7fabbc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe850487a40379 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd2000700 1 -- 172.21.15.50:0/935057154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00b8a0 con 0x7fabd40b4f30 2024-09-13T15:11:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.836+0000 7fabd2000700 1 -- 172.21.15.50:0/935057154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00ba00 con 0x7fabd40b4f30 2024-09-13T15:11:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd2000700 1 -- 172.21.15.50:0/935057154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bd90 con 0x7fabd40b4f30 2024-09-13T15:11:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 -- 172.21.15.50:0/935057154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 msgr2=0x7fabd40b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 --2- 172.21.15.50:0/935057154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd40b3aa0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fabd40d1b00 tx=0x7fabbc009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 -- 172.21.15.50:0/935057154 shutdown_connections 2024-09-13T15:11:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 --2- 172.21.15.50:0/935057154 >> v2:172.21.15.181:3300/0 conn(0x7fabd415e660 0x7fabd40d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 --2- 172.21.15.50:0/935057154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd40b3aa0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 --2- 172.21.15.50:0/935057154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd40cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 -- 172.21.15.50:0/935057154 >> 172.21.15.50:0/935057154 conn(0x7fabd40b5fc0 msgr2=0x7fabd40b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 -- 172.21.15.50:0/935057154 shutdown_connections 2024-09-13T15:11:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.840+0000 7fabd9800700 1 -- 172.21.15.50:0/935057154 wait complete. 2024-09-13T15:11:38.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 Processor -- start 2024-09-13T15:11:38.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 -- start start 2024-09-13T15:11:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd4147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabd415e660 0x7fabd41f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4155390 con 0x7fabd40b4f30 2024-09-13T15:11:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4147c40 con 0x7fabd415e660 2024-09-13T15:11:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.844+0000 7fabd9800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406a920 con 0x7fabd40b4b50 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd4147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd4147700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41118/0 (socket says 172.21.15.50:41118) 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 -- 172.21.15.50:0/3356275532 learned_addr learned my addr 172.21.15.50:0/3356275532 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabd3400700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabd415e660 0x7fabd41f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabd2a00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 -- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 msgr2=0x7fabd4154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd4154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 -- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabd415e660 msgr2=0x7fabd41f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabd415e660 0x7fabd41f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 -- 172.21.15.50:0/3356275532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc009570 con 0x7fabd40b4f30 2024-09-13T15:11:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabd2a00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcbe00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd4147700 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fabbc013000 tx=0x7fabbc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0036c0 con 0x7fabd40b4f30 2024-09-13T15:11:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc01f070 con 0x7fabd40b4f30 2024-09-13T15:11:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd406ac00 con 0x7fabd40b4f30 2024-09-13T15:11:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc003a80 con 0x7fabd40b4f30 2024-09-13T15:11:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd406b1c0 con 0x7fabd40b4f30 2024-09-13T15:11:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.848+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd40cd410 con 0x7fabd40b4f30 2024-09-13T15:11:38.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.852+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fabbc021030 con 0x7fabd40b4f30 2024-09-13T15:11:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.852+0000 7fabcaa00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabb0066730 0x7fabb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.852+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fabbc0858b0 con 0x7fabd40b4f30 2024-09-13T15:11:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.852+0000 7fabd2a00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabb0066730 0x7fabb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.856+0000 7fabd2a00700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabb0066730 0x7fabb0068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009990 tx=0x7fabc4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:38.860+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fabbc052ad0 con 0x7fabd40b4f30 2024-09-13T15:11:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.052+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fabd40cf260 con 0x7fabd40b4f30 2024-09-13T15:11:39.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.052+0000 7fabcaa00700 1 -- 172.21.15.50:0/3356275532 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) v1 ==== 80+0+0 (secure 0 0 0) 0x7fabbc0560f0 con 0x7fabd40b4f30 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabb0066730 msgr2=0x7fabb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabb0066730 0x7fabb0068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009990 tx=0x7fabc4008040 comp rx=0 tx=0).stop 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 msgr2=0x7fabd4147700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd4147700 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fabbc013000 tx=0x7fabbc004770 comp rx=0 tx=0).stop 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 shutdown_connections 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabb0066730 0x7fabb0068bf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabd415e660 0x7fabd41f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabd40b4f30 0x7fabd4147700 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 --2- 172.21.15.50:0/3356275532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabd40b4b50 0x7fabd4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 >> 172.21.15.50:0/3356275532 conn(0x7fabd40b5fc0 msgr2=0x7fabd415d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 shutdown_connections 2024-09-13T15:11:39.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.060+0000 7fabd9800700 1 -- 172.21.15.50:0/3356275532 wait complete. 2024-09-13T15:11:39.064 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:11:39.088 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:11:39.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:39.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:11:39.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:11:39.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:39.132 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:11:39.193 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:39.193 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:39.211 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:39.211 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:39.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.444+0000 7fe595200700 1 Processor -- start 2024-09-13T15:11:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.444+0000 7fe595200700 1 -- start start 2024-09-13T15:11:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe595200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5901610b0 0x7fe5900719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe595200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe59006aaa0 0x7fe59006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe595200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900b3560 con 0x7fe5900b2670 2024-09-13T15:11:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe595200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe590070b30 con 0x7fe59006aaa0 2024-09-13T15:11:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe595200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59006b420 con 0x7fe5901610b0 2024-09-13T15:11:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5900b2670 0x7fe5900cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39972/0 (socket says 172.21.15.50:39972) 2024-09-13T15:11:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58fe00700 1 -- 172.21.15.50:0/44536488 learned_addr learned my addr 172.21.15.50:0/44536488 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58f400700 1 --2- 172.21.15.50:0/44536488 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5901610b0 0x7fe5900719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58ea00700 1 --2- 172.21.15.50:0/44536488 >> v2:172.21.15.181:3300/0 conn(0x7fe59006aaa0 0x7fe59006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58e000700 1 -- 172.21.15.50:0/44536488 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058547907 0 0) 0x7fe5900b3560 con 0x7fe5900b2670 2024-09-13T15:11:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58e000700 1 -- 172.21.15.50:0/44536488 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5740035d0 con 0x7fe5900b2670 2024-09-13T15:11:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58f400700 1 -- 172.21.15.50:0/44536488 >> v2:172.21.15.181:3300/0 conn(0x7fe59006aaa0 msgr2=0x7fe59006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58f400700 1 --2- 172.21.15.50:0/44536488 >> v2:172.21.15.181:3300/0 conn(0x7fe59006aaa0 0x7fe59006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58f400700 1 -- 172.21.15.50:0/44536488 >> v1:172.21.15.50:6789/0 conn(0x7fe5900b2670 legacy=0x7fe5900cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58f400700 1 -- 172.21.15.50:0/44536488 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900b3280 con 0x7fe5901610b0 2024-09-13T15:11:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58f400700 1 --2- 172.21.15.50:0/44536488 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5901610b0 0x7fe5900719c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe580009850 tx=0x7fe580009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab03cddd61749723 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58e000700 1 -- 172.21.15.50:0/44536488 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580011830 con 0x7fe5901610b0 2024-09-13T15:11:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58e000700 1 -- 172.21.15.50:0/44536488 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580011990 con 0x7fe5901610b0 2024-09-13T15:11:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.448+0000 7fe58e000700 1 -- 172.21.15.50:0/44536488 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580011d40 con 0x7fe5901610b0 2024-09-13T15:11:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 -- 172.21.15.50:0/44536488 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5901610b0 msgr2=0x7fe5900719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 --2- 172.21.15.50:0/44536488 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5901610b0 0x7fe5900719c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe580009850 tx=0x7fe580009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 -- 172.21.15.50:0/44536488 shutdown_connections 2024-09-13T15:11:39.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 --2- 172.21.15.50:0/44536488 >> v2:172.21.15.181:3300/0 conn(0x7fe59006aaa0 0x7fe59006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 --2- 172.21.15.50:0/44536488 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5901610b0 0x7fe5900719c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 -- 172.21.15.50:0/44536488 >> 172.21.15.50:0/44536488 conn(0x7fe5900b0c40 msgr2=0x7fe59006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 -- 172.21.15.50:0/44536488 shutdown_connections 2024-09-13T15:11:39.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 -- 172.21.15.50:0/44536488 wait complete. 2024-09-13T15:11:39.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 Processor -- start 2024-09-13T15:11:39.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.452+0000 7fe595200700 1 -- start start 2024-09-13T15:11:39.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 0x7fe590157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5900b2670 0x7fe5900ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5901610b0 0x7fe590163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590158fe0 con 0x7fe59006aaa0 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901583d0 con 0x7fe5901610b0 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901586b0 con 0x7fe5900b2670 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 0x7fe590157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 0x7fe590157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41130/0 (socket says 172.21.15.50:41130) 2024-09-13T15:11:39.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 -- 172.21.15.50:0/3835836853 learned_addr learned my addr 172.21.15.50:0/3835836853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58fe00700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5901610b0 0x7fe590163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58ea00700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5900b2670 0x7fe5900ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 -- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5900b2670 msgr2=0x7fe5900ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5900b2670 0x7fe5900ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 -- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5901610b0 msgr2=0x7fe590163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5901610b0 0x7fe590163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 -- 172.21.15.50:0/3835836853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800094b0 con 0x7fe59006aaa0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe58f400700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 0x7fe590157330 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe5800090b0 tx=0x7fe580004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580004610 con 0x7fe59006aaa0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58001e070 con 0x7fe59006aaa0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe590158990 con 0x7fe59006aaa0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800038c0 con 0x7fe59006aaa0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.456+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe590157870 con 0x7fe59006aaa0 2024-09-13T15:11:39.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.460+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900008d0 con 0x7fe59006aaa0 2024-09-13T15:11:39.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.460+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe580003a20 con 0x7fe59006aaa0 2024-09-13T15:11:39.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.460+0000 7fe587400700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe570066730 0x7fe570068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.460+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe580020070 con 0x7fe59006aaa0 2024-09-13T15:11:39.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.460+0000 7fe58ea00700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe570066730 0x7fe570068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.464+0000 7fe58ea00700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe570066730 0x7fe570068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe590158010 tx=0x7fe57c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.464+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe580052a20 con 0x7fe59006aaa0 2024-09-13T15:11:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.652+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5900728f0 con 0x7fe59006aaa0 2024-09-13T15:11:39.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.656+0000 7fe587400700 1 -- 172.21.15.50:0/3835836853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fe580056040 con 0x7fe59006aaa0 2024-09-13T15:11:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:39.660 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:28.631014+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe570066730 msgr2=0x7fe570068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe570066730 0x7fe570068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe590158010 tx=0x7fe57c008040 comp rx=0 tx=0).stop 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 msgr2=0x7fe590157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 0x7fe590157330 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe5800090b0 tx=0x7fe580004770 comp rx=0 tx=0).stop 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 shutdown_connections 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe570066730 0x7fe570068bf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5901610b0 0x7fe590163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe5900b2670 0x7fe5900ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 --2- 172.21.15.50:0/3835836853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59006aaa0 0x7fe590157330 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 >> 172.21.15.50:0/3835836853 conn(0x7fe5900b0c40 msgr2=0x7fe5900cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:39.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 shutdown_connections 2024-09-13T15:11:39.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.660+0000 7fe595200700 1 -- 172.21.15.50:0/3835836853 wait complete. 2024-09-13T15:11:39.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:25.790116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:26.629791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:39.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:39.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.856+0000 7f4951e00700 1 Processor -- start 2024-09-13T15:11:39.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.856+0000 7f4951e00700 1 -- start start 2024-09-13T15:11:39.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c1464c0 0x7f494c071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f494c0b1980 0x7f494c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f494c06c960 0x7f494c06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c06d350 con 0x7f494c06c960 2024-09-13T15:11:39.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c070da0 con 0x7f494c0b1980 2024-09-13T15:11:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0b2440 con 0x7f494c1464c0 2024-09-13T15:11:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f494c06c960 0x7f494c06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f494c06c960 0x7f494c06ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41140/0 (socket says 172.21.15.50:41140) 2024-09-13T15:11:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 --2- 172.21.15.50:0/403156253 >> v2:172.21.15.181:3300/0 conn(0x7f494c0b1980 0x7f494c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4951400700 1 -- 172.21.15.50:0/403156253 learned_addr learned my addr 172.21.15.50:0/403156253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4950a00700 1 --2- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c1464c0 0x7f494c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 -- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c1464c0 msgr2=0x7f494c071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 --2- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c1464c0 0x7f494c071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 -- 172.21.15.50:0/403156253 >> v2:172.21.15.50:3300/0 conn(0x7f494c06c960 msgr2=0x7f494c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 --2- 172.21.15.50:0/403156253 >> v2:172.21.15.50:3300/0 conn(0x7f494c06c960 0x7f494c06ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 -- 172.21.15.50:0/403156253 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0b2720 con 0x7f494c0b1980 2024-09-13T15:11:39.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.860+0000 7f4943e00700 1 --2- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c0b1dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f494c066dc0 tx=0x7f4934009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e82d649e579faff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f494be00700 1 -- 172.21.15.50:0/403156253 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934011830 con 0x7f494c0b1980 2024-09-13T15:11:39.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f494be00700 1 -- 172.21.15.50:0/403156253 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4934011990 con 0x7f494c0b1980 2024-09-13T15:11:39.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f494be00700 1 -- 172.21.15.50:0/403156253 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934011d20 con 0x7f494c0b1980 2024-09-13T15:11:39.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 -- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 msgr2=0x7f494c0b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 --2- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c0b1dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f494c066dc0 tx=0x7f4934009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:39.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 -- 172.21.15.50:0/403156253 shutdown_connections 2024-09-13T15:11:39.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 --2- 172.21.15.50:0/403156253 >> v2:172.21.15.50:3300/0 conn(0x7f494c06c960 0x7f494c06ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 --2- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c0b1dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 --2- 172.21.15.50:0/403156253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c1464c0 0x7f494c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 -- 172.21.15.50:0/403156253 >> 172.21.15.50:0/403156253 conn(0x7f494c06a390 msgr2=0x7f494c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:39.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 -- 172.21.15.50:0/403156253 shutdown_connections 2024-09-13T15:11:39.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.864+0000 7f4951e00700 1 -- 172.21.15.50:0/403156253 wait complete. 2024-09-13T15:11:39.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 Processor -- start 2024-09-13T15:11:39.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 -- start start 2024-09-13T15:11:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c06c960 0x7f494c13d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 0x7f494c13f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c152ef0 con 0x7f494c1464c0 2024-09-13T15:11:39.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c13f610 con 0x7f494c0b1980 2024-09-13T15:11:39.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c13e030 con 0x7f494c06c960 2024-09-13T15:11:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 0x7f494c13f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 0x7f494c13f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41144/0 (socket says 172.21.15.50:41144) 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 -- 172.21.15.50:0/4100352455 learned_addr learned my addr 172.21.15.50:0/4100352455 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4943e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4950a00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c06c960 0x7f494c13d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 -- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c06c960 msgr2=0x7f494c13d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c06c960 0x7f494c13d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 -- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 msgr2=0x7f494c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 -- 172.21.15.50:0/4100352455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49340094b0 con 0x7f494c1464c0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951400700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 0x7f494c13f0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f494400efc0 tx=0x7f494400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944003c40 con 0x7f494c1464c0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c13e310 con 0x7f494c1464c0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400f040 con 0x7f494c1464c0 2024-09-13T15:11:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944009e90 con 0x7f494c1464c0 2024-09-13T15:11:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.868+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c13e8d0 con 0x7f494c1464c0 2024-09-13T15:11:39.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.872+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c071d20 con 0x7f494c1464c0 2024-09-13T15:11:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.872+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f494400c930 con 0x7f494c1464c0 2024-09-13T15:11:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.876+0000 7f4949600700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4928066730 0x7f4928068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.876+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4944084670 con 0x7f494c1464c0 2024-09-13T15:11:39.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.876+0000 7f4950a00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4928066730 0x7f4928068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.876+0000 7f4950a00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4928066730 0x7f4928068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f493c009b00 tx=0x7f493c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:39.880+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4944051800 con 0x7f494c1464c0 2024-09-13T15:11:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.064+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f494c06ce10 con 0x7f494c1464c0 2024-09-13T15:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.064+0000 7f4949600700 1 -- 172.21.15.50:0/4100352455 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4944054e20 con 0x7f494c1464c0 2024-09-13T15:11:40.068 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4928066730 msgr2=0x7f4928068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4928066730 0x7f4928068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f493c009b00 tx=0x7f493c008040 comp rx=0 tx=0).stop 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 msgr2=0x7f494c13f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 0x7f494c13f0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f494400efc0 tx=0x7f494400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 shutdown_connections 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4928066730 0x7f4928068bf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1464c0 0x7f494c13f0d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f494c0b1980 0x7f494c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 --2- 172.21.15.50:0/4100352455 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f494c06c960 0x7f494c13d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.068+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 >> 172.21.15.50:0/4100352455 conn(0x7f494c06a390 msgr2=0x7f494c0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.072+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 shutdown_connections 2024-09-13T15:11:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.072+0000 7f4951e00700 1 -- 172.21.15.50:0/4100352455 wait complete. 2024-09-13T15:11:40.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:11:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.276+0000 7faf15600700 1 Processor -- start 2024-09-13T15:11:40.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.276+0000 7faf15600700 1 -- start start 2024-09-13T15:11:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf101464c0 0x7faf10071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faf100b1980 0x7faf100b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf10070da0 con 0x7faf1006c960 2024-09-13T15:11:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100b2440 con 0x7faf101464c0 2024-09-13T15:11:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100b2720 con 0x7faf100b1980 2024-09-13T15:11:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf101464c0 0x7faf10071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf101464c0 0x7faf10071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41160/0 (socket says 172.21.15.50:41160) 2024-09-13T15:11:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 -- 172.21.15.50:0/4146622133 learned_addr learned my addr 172.21.15.50:0/4146622133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0f400700 1 --2- 172.21.15.50:0/4146622133 >> v2:172.21.15.181:3300/0 conn(0x7faf100b1980 0x7faf100b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 -- 172.21.15.50:0/4146622133 >> v2:172.21.15.181:3300/0 conn(0x7faf100b1980 msgr2=0x7faf100b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 --2- 172.21.15.50:0/4146622133 >> v2:172.21.15.181:3300/0 conn(0x7faf100b1980 0x7faf100b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 -- 172.21.15.50:0/4146622133 >> v1:172.21.15.50:6789/0 conn(0x7faf1006c960 legacy=0x7faf100ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0ea00700 1 -- 172.21.15.50:0/4146622133 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588544667 0 0) 0x7faf10070da0 con 0x7faf1006c960 2024-09-13T15:11:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 -- 172.21.15.50:0/4146622133 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10071060 con 0x7faf101464c0 2024-09-13T15:11:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0fe00700 1 --2- 172.21.15.50:0/4146622133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf101464c0 0x7faf10071860 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7faf1006dae0 tx=0x7faf00009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1223ffafaddb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0ea00700 1 -- 172.21.15.50:0/4146622133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000b8a0 con 0x7faf101464c0 2024-09-13T15:11:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0ea00700 1 -- 172.21.15.50:0/4146622133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000ba00 con 0x7faf101464c0 2024-09-13T15:11:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf0ea00700 1 -- 172.21.15.50:0/4146622133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000bd90 con 0x7faf101464c0 2024-09-13T15:11:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- 172.21.15.50:0/4146622133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf101464c0 msgr2=0x7faf10071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 --2- 172.21.15.50:0/4146622133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf101464c0 0x7faf10071860 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7faf1006dae0 tx=0x7faf00009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- 172.21.15.50:0/4146622133 shutdown_connections 2024-09-13T15:11:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 --2- 172.21.15.50:0/4146622133 >> v2:172.21.15.181:3300/0 conn(0x7faf100b1980 0x7faf100b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 --2- 172.21.15.50:0/4146622133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf101464c0 0x7faf10071860 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- 172.21.15.50:0/4146622133 >> 172.21.15.50:0/4146622133 conn(0x7faf1006a390 msgr2=0x7faf1006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- 172.21.15.50:0/4146622133 shutdown_connections 2024-09-13T15:11:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.280+0000 7faf15600700 1 -- 172.21.15.50:0/4146622133 wait complete. 2024-09-13T15:11:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.284+0000 7faf15600700 1 Processor -- start 2024-09-13T15:11:40.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.284+0000 7faf15600700 1 -- start start 2024-09-13T15:11:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf1006c960 0x7faf1013c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 0x7faf10143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf101464c0 0x7faf1013ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf101515d0 con 0x7faf100b1980 2024-09-13T15:11:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10150670 con 0x7faf101464c0 2024-09-13T15:11:40.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf10150950 con 0x7faf1006c960 2024-09-13T15:11:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 0x7faf10143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 0x7faf10143580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41172/0 (socket says 172.21.15.50:41172) 2024-09-13T15:11:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 -- 172.21.15.50:0/1678641466 learned_addr learned my addr 172.21.15.50:0/1678641466 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf14c00700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf101464c0 0x7faf1013ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0fe00700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf1006c960 0x7faf1013c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 -- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf1006c960 msgr2=0x7faf1013c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf1006c960 0x7faf1013c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 -- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf101464c0 msgr2=0x7faf1013ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf101464c0 0x7faf1013ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 -- 172.21.15.50:0/1678641466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009570 con 0x7faf100b1980 2024-09-13T15:11:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf0f400700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 0x7faf10143580 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d800 tx=0x7faefc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0125f0 con 0x7faf100b1980 2024-09-13T15:11:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc012750 con 0x7faf100b1980 2024-09-13T15:11:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.288+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10150c30 con 0x7faf100b1980 2024-09-13T15:11:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.292+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc012ac0 con 0x7faf100b1980 2024-09-13T15:11:40.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.292+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf101511f0 con 0x7faf100b1980 2024-09-13T15:11:40.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.292+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf100b1df0 con 0x7faf100b1980 2024-09-13T15:11:40.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.292+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faefc012c20 con 0x7faf100b1980 2024-09-13T15:11:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.296+0000 7faf07e00700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faef0066730 0x7faef0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.296+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faefc0843b0 con 0x7faf100b1980 2024-09-13T15:11:40.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.296+0000 7faf0fe00700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faef0066730 0x7faef0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.296+0000 7faf0fe00700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faef0066730 0x7faef0068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faf00000c00 tx=0x7faf00008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.300+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faefc051600 con 0x7faf100b1980 2024-09-13T15:11:40.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.484+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf1006ad30 con 0x7faf100b1980 2024-09-13T15:11:40.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.484+0000 7faf07e00700 1 -- 172.21.15.50:0/1678641466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7faefc054c20 con 0x7faf100b1980 2024-09-13T15:11:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:11:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faef0066730 msgr2=0x7faef0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faef0066730 0x7faef0068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faf00000c00 tx=0x7faf00008030 comp rx=0 tx=0).stop 2024-09-13T15:11:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 msgr2=0x7faf10143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 0x7faf10143580 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d800 tx=0x7faefc00db10 comp rx=0 tx=0).stop 2024-09-13T15:11:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 shutdown_connections 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faef0066730 0x7faef0068bf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf101464c0 0x7faf1013ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf100b1980 0x7faf10143580 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 --2- 172.21.15.50:0/1678641466 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faf1006c960 0x7faf1013c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 >> 172.21.15.50:0/1678641466 conn(0x7faf1006a390 msgr2=0x7faf100b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 shutdown_connections 2024-09-13T15:11:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.488+0000 7faf15600700 1 -- 172.21.15.50:0/1678641466 wait complete. 2024-09-13T15:11:40.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:11:40.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.688+0000 7f737c400700 1 Processor -- start 2024-09-13T15:11:40.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.688+0000 7f737c400700 1 -- start start 2024-09-13T15:11:40.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737c400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7374157470 0x7f737415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737c400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73740725c0 0x7f737415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737c400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7374157850 con 0x7f737406ed70 2024-09-13T15:11:40.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737c400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737415dd20 con 0x7f73740725c0 2024-09-13T15:11:40.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737c400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737415e000 con 0x7f7374157470 2024-09-13T15:11:40.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737a400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f737406ed70 0x7f73740cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39990/0 (socket says 172.21.15.50:39990) 2024-09-13T15:11:40.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f737a400700 1 -- 172.21.15.50:0/4012972577 learned_addr learned my addr 172.21.15.50:0/4012972577 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:40.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379000700 1 --2- 172.21.15.50:0/4012972577 >> v2:172.21.15.50:3300/0 conn(0x7f73740725c0 0x7f737415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379a00700 1 --2- 172.21.15.50:0/4012972577 >> v2:172.21.15.181:3300/0 conn(0x7f7374157470 0x7f737415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7373e00700 1 -- 172.21.15.50:0/4012972577 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228688471 0 0) 0x7f7374157850 con 0x7f737406ed70 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7373e00700 1 -- 172.21.15.50:0/4012972577 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f735c0035d0 con 0x7f737406ed70 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379000700 1 -- 172.21.15.50:0/4012972577 >> v2:172.21.15.181:3300/0 conn(0x7f7374157470 msgr2=0x7f737415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379000700 1 --2- 172.21.15.50:0/4012972577 >> v2:172.21.15.181:3300/0 conn(0x7f7374157470 0x7f737415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379000700 1 -- 172.21.15.50:0/4012972577 >> v1:172.21.15.50:6789/0 conn(0x7f737406ed70 legacy=0x7f73740cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379000700 1 -- 172.21.15.50:0/4012972577 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374159ff0 con 0x7f73740725c0 2024-09-13T15:11:40.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.692+0000 7f7379a00700 1 --2- 172.21.15.50:0/4012972577 >> v2:172.21.15.181:3300/0 conn(0x7f7374157470 0x7f737415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:40.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f7379000700 1 --2- 172.21.15.50:0/4012972577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f737415d4d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f737406f8d0 tx=0x7f7360009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9924c1031366bc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f7373e00700 1 -- 172.21.15.50:0/4012972577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011830 con 0x7f73740725c0 2024-09-13T15:11:40.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f7373e00700 1 -- 172.21.15.50:0/4012972577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360011990 con 0x7f73740725c0 2024-09-13T15:11:40.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f7373e00700 1 -- 172.21.15.50:0/4012972577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011d20 con 0x7f73740725c0 2024-09-13T15:11:40.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 -- 172.21.15.50:0/4012972577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 msgr2=0x7f737415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 --2- 172.21.15.50:0/4012972577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f737415d4d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f737406f8d0 tx=0x7f7360009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:40.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 -- 172.21.15.50:0/4012972577 shutdown_connections 2024-09-13T15:11:40.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 --2- 172.21.15.50:0/4012972577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f737415d4d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 --2- 172.21.15.50:0/4012972577 >> v2:172.21.15.181:3300/0 conn(0x7f7374157470 0x7f737415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 -- 172.21.15.50:0/4012972577 >> 172.21.15.50:0/4012972577 conn(0x7f73740b1e10 msgr2=0x7f737406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:40.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 -- 172.21.15.50:0/4012972577 shutdown_connections 2024-09-13T15:11:40.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.696+0000 7f737c400700 1 -- 172.21.15.50:0/4012972577 wait complete. 2024-09-13T15:11:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 Processor -- start 2024-09-13T15:11:40.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 -- start start 2024-09-13T15:11:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f737406ed70 0x7f737414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f7374158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7374157470 0x7f73741585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374158bd0 con 0x7f73740725c0 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374158eb0 con 0x7f7374157470 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737c400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7374159190 con 0x7f737406ed70 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f7379000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f7374158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f737a400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7374157470 0x7f73741585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f7379000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f7374158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41196/0 (socket says 172.21.15.50:41196) 2024-09-13T15:11:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f7379000700 1 -- 172.21.15.50:0/3585949712 learned_addr learned my addr 172.21.15.50:0/3585949712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:40.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.700+0000 7f7379a00700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f737406ed70 0x7f737414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7379000700 1 -- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f737406ed70 msgr2=0x7f737414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7379000700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f737406ed70 0x7f737414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7379000700 1 -- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7374157470 msgr2=0x7f73741585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7379000700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7374157470 0x7f73741585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7379000700 1 -- 172.21.15.50:0/3585949712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680094b0 con 0x7f73740725c0 2024-09-13T15:11:40.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f737a400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7374157470 0x7f73741585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:40.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7379000700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f7374158060 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7360014040 tx=0x7f7360004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360004510 con 0x7f73740725c0 2024-09-13T15:11:40.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736001e070 con 0x7f73740725c0 2024-09-13T15:11:40.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600094b0 con 0x7f73740725c0 2024-09-13T15:11:40.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360003900 con 0x7f73740725c0 2024-09-13T15:11:40.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7374159750 con 0x7f73740725c0 2024-09-13T15:11:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.704+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374159940 con 0x7f73740725c0 2024-09-13T15:11:40.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.708+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7360003a60 con 0x7f73740725c0 2024-09-13T15:11:40.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.708+0000 7f7371600700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7354066730 0x7f7354068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:40.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.708+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7360085080 con 0x7f73740725c0 2024-09-13T15:11:40.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.708+0000 7f7379a00700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7354066730 0x7f7354068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.712+0000 7f7379a00700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7354066730 0x7f7354068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7368009ce0 tx=0x7f7368009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.712+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f73600b6db0 con 0x7f73740725c0 2024-09-13T15:11:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.896+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f737415d4d0 con 0x7f73740725c0 2024-09-13T15:11:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.896+0000 7f7371600700 1 -- 172.21.15.50:0/3585949712 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7360052220 con 0x7f73740725c0 2024-09-13T15:11:40.900 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7354066730 msgr2=0x7f7354068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7354066730 0x7f7354068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7368009ce0 tx=0x7f7368009240 comp rx=0 tx=0).stop 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 msgr2=0x7f7374158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f7374158060 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7360014040 tx=0x7f7360004770 comp rx=0 tx=0).stop 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 shutdown_connections 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7354066730 0x7f7354068bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7374157470 0x7f73741585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73740725c0 0x7f7374158060 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 --2- 172.21.15.50:0/3585949712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f737406ed70 0x7f737414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 >> 172.21.15.50:0/3585949712 conn(0x7f73740b1e10 msgr2=0x7f73740680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 shutdown_connections 2024-09-13T15:11:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:40.900+0000 7f737c400700 1 -- 172.21.15.50:0/3585949712 wait complete. 2024-09-13T15:11:40.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:11:41.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 Processor -- start 2024-09-13T15:11:41.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 -- start start 2024-09-13T15:11:41.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f791c15e070 0x7f791c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f791c0b2c50 0x7f791c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c0cd970 con 0x7f791c0d10f0 2024-09-13T15:11:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c15e450 con 0x7f791c0b2c50 2024-09-13T15:11:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f7920a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c0d0050 con 0x7f791c15e070 2024-09-13T15:11:41.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f791aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f791c0d10f0 0x7f791c0b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39998/0 (socket says 172.21.15.50:39998) 2024-09-13T15:11:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f791aa00700 1 -- 172.21.15.50:0/2310092181 learned_addr learned my addr 172.21.15.50:0/2310092181 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f791be00700 1 --2- 172.21.15.50:0/2310092181 >> v2:172.21.15.50:3300/0 conn(0x7f791c0b2c50 0x7f791c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f791b400700 1 --2- 172.21.15.50:0/2310092181 >> v2:172.21.15.181:3300/0 conn(0x7f791c15e070 0x7f791c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.100+0000 7f791a000700 1 -- 172.21.15.50:0/2310092181 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558318773 0 0) 0x7f7908001110 con 0x7f791c0d10f0 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791b400700 1 -- 172.21.15.50:0/2310092181 >> v2:172.21.15.50:3300/0 conn(0x7f791c0b2c50 msgr2=0x7f791c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791b400700 1 --2- 172.21.15.50:0/2310092181 >> v2:172.21.15.50:3300/0 conn(0x7f791c0b2c50 0x7f791c0b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791b400700 1 -- 172.21.15.50:0/2310092181 >> v1:172.21.15.50:6789/0 conn(0x7f791c0d10f0 legacy=0x7f791c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791b400700 1 -- 172.21.15.50:0/2310092181 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0d0330 con 0x7f791c15e070 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791be00700 1 --2- 172.21.15.50:0/2310092181 >> v2:172.21.15.50:3300/0 conn(0x7f791c0b2c50 0x7f791c0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791b400700 1 --2- 172.21.15.50:0/2310092181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c15e070 0x7f791c0cd430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f791c0d1ac0 tx=0x7f790c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8cad8703766ecc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:41.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791a000700 1 -- 172.21.15.50:0/2310092181 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c011830 con 0x7f791c15e070 2024-09-13T15:11:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791a000700 1 -- 172.21.15.50:0/2310092181 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c011990 con 0x7f791c15e070 2024-09-13T15:11:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f791a000700 1 -- 172.21.15.50:0/2310092181 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c011d40 con 0x7f791c15e070 2024-09-13T15:11:41.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 -- 172.21.15.50:0/2310092181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c15e070 msgr2=0x7f791c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 --2- 172.21.15.50:0/2310092181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c15e070 0x7f791c0cd430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f791c0d1ac0 tx=0x7f790c009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 -- 172.21.15.50:0/2310092181 shutdown_connections 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 --2- 172.21.15.50:0/2310092181 >> v2:172.21.15.50:3300/0 conn(0x7f791c0b2c50 0x7f791c0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 --2- 172.21.15.50:0/2310092181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c15e070 0x7f791c0cd430 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 -- 172.21.15.50:0/2310092181 >> 172.21.15.50:0/2310092181 conn(0x7f791c071f00 msgr2=0x7f791c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 -- 172.21.15.50:0/2310092181 shutdown_connections 2024-09-13T15:11:41.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.104+0000 7f7920a00700 1 -- 172.21.15.50:0/2310092181 wait complete. 2024-09-13T15:11:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.108+0000 7f7920a00700 1 Processor -- start 2024-09-13T15:11:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.108+0000 7f7920a00700 1 -- start start 2024-09-13T15:11:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.108+0000 7f7920a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c0b2c50 0x7f791c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 0x7f791c0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791c15e070 0x7f791c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0c4960 con 0x7f791c0d10f0 2024-09-13T15:11:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0b56f0 con 0x7f791c0b2c50 2024-09-13T15:11:41.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0b59d0 con 0x7f791c15e070 2024-09-13T15:11:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 0x7f791c0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 0x7f791c0b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41222/0 (socket says 172.21.15.50:41222) 2024-09-13T15:11:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 -- 172.21.15.50:0/410384307 learned_addr learned my addr 172.21.15.50:0/410384307 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791b400700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c0b2c50 0x7f791c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791be00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791c15e070 0x7f791c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 -- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791c15e070 msgr2=0x7f791c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791c15e070 0x7f791c0c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 -- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c0b2c50 msgr2=0x7f791c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c0b2c50 0x7f791c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 -- 172.21.15.50:0/410384307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0094b0 con 0x7f791c0d10f0 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f791aa00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 0x7f791c0b42c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f790800c4e0 tx=0x7f790800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908004ca0 con 0x7f791c0d10f0 2024-09-13T15:11:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908004e20 con 0x7f791c0d10f0 2024-09-13T15:11:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c0b5cb0 con 0x7f791c0d10f0 2024-09-13T15:11:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007310 con 0x7f791c0d10f0 2024-09-13T15:11:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.112+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c15a620 con 0x7f791c0d10f0 2024-09-13T15:11:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.116+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791c0c4b10 con 0x7f791c0d10f0 2024-09-13T15:11:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.116+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7908007470 con 0x7f791c0d10f0 2024-09-13T15:11:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.116+0000 7f7913400700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78fc066730 0x7f78fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.116+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7908083cf0 con 0x7f791c0d10f0 2024-09-13T15:11:41.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.120+0000 7f791b400700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78fc066730 0x7f78fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.120+0000 7f791b400700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78fc066730 0x7f78fc068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f790c0090b0 tx=0x7f790c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:41.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.124+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f791c0c4b10 con 0x7f791c0d10f0 2024-09-13T15:11:41.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.320+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f791c0cd970 con 0x7f791c0d10f0 2024-09-13T15:11:41.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.320+0000 7f7913400700 1 -- 172.21.15.50:0/410384307 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) v1 ==== 80+0+0 (secure 0 0 0) 0x7f791c0cd970 con 0x7f791c0d10f0 2024-09-13T15:11:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78fc066730 msgr2=0x7f78fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78fc066730 0x7f78fc068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f790c0090b0 tx=0x7f790c01c040 comp rx=0 tx=0).stop 2024-09-13T15:11:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 msgr2=0x7f791c0b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 0x7f791c0b42c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f790800c4e0 tx=0x7f790800c7f0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 shutdown_connections 2024-09-13T15:11:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f78fc066730 0x7f78fc068bf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f791c15e070 0x7f791c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f791c0d10f0 0x7f791c0b42c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 --2- 172.21.15.50:0/410384307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f791c0b2c50 0x7f791c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 >> 172.21.15.50:0/410384307 conn(0x7f791c071f00 msgr2=0x7f791c0b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 shutdown_connections 2024-09-13T15:11:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.324+0000 7f7920a00700 1 -- 172.21.15.50:0/410384307 wait complete. 2024-09-13T15:11:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:11:41.349 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:11:41.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:41.349 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:11:41.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:11:41.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:11:41.395 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:11:41.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:41.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 Processor -- start 2024-09-13T15:11:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 -- start start 2024-09-13T15:11:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6fe006a5d0 0x7f6fe0071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fe00b19f0 0x7f6fe006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00cd610 0x7f6fe006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00ce140 con 0x7f6fe00b19f0 2024-09-13T15:11:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00b1e60 con 0x7f6fe006a5d0 2024-09-13T15:11:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fe7c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe006aef0 con 0x7f6fe00cd610 2024-09-13T15:11:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fdfe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fe00b19f0 0x7f6fe006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fdfe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fe00b19f0 0x7f6fe006a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2024-09-13T15:11:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.628+0000 7f6fdfe00700 1 -- 172.21.15.50:0/2585996758 learned_addr learned my addr 172.21.15.50:0/2585996758 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe5c00700 1 --2- 172.21.15.50:0/2585996758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00cd610 0x7f6fe006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe5200700 1 --2- 172.21.15.50:0/2585996758 >> v2:172.21.15.181:3300/0 conn(0x7f6fe006a5d0 0x7f6fe0071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdfe00700 1 -- 172.21.15.50:0/2585996758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00cd610 msgr2=0x7f6fe006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdfe00700 1 --2- 172.21.15.50:0/2585996758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00cd610 0x7f6fe006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdfe00700 1 -- 172.21.15.50:0/2585996758 >> v2:172.21.15.181:3300/0 conn(0x7f6fe006a5d0 msgr2=0x7f6fe0071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdfe00700 1 --2- 172.21.15.50:0/2585996758 >> v2:172.21.15.181:3300/0 conn(0x7f6fe006a5d0 0x7f6fe0071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdfe00700 1 -- 172.21.15.50:0/2585996758 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00cde60 con 0x7f6fe00b19f0 2024-09-13T15:11:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdfe00700 1 --2- 172.21.15.50:0/2585996758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe00b19f0 0x7f6fe006a9b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00cc4e0 tx=0x7f6fcc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5662f53b9eb6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdf400700 1 -- 172.21.15.50:0/2585996758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011830 con 0x7f6fe00b19f0 2024-09-13T15:11:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdf400700 1 -- 172.21.15.50:0/2585996758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc011990 con 0x7f6fe00b19f0 2024-09-13T15:11:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fdf400700 1 -- 172.21.15.50:0/2585996758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011d20 con 0x7f6fe00b19f0 2024-09-13T15:11:41.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2585996758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe00b19f0 msgr2=0x7f6fe006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2585996758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe00b19f0 0x7f6fe006a9b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00cc4e0 tx=0x7f6fcc009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2585996758 shutdown_connections 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2585996758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00cd610 0x7f6fe006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2585996758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe00b19f0 0x7f6fe006a9b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2585996758 >> v2:172.21.15.181:3300/0 conn(0x7f6fe006a5d0 0x7f6fe0071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2585996758 >> 172.21.15.50:0/2585996758 conn(0x7f6fe00b08d0 msgr2=0x7f6fe00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2585996758 shutdown_connections 2024-09-13T15:11:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.632+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2585996758 wait complete. 2024-09-13T15:11:41.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 Processor -- start 2024-09-13T15:11:41.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 -- start start 2024-09-13T15:11:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 0x7f6fe01579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00b19f0 0x7f6fe0149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe00cd610 0x7f6fe01fa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe01582a0 con 0x7f6fe006a5d0 2024-09-13T15:11:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0148a00 con 0x7f6fe00cd610 2024-09-13T15:11:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe7c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0148ce0 con 0x7f6fe00b19f0 2024-09-13T15:11:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe5200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 0x7f6fe01579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe5200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 0x7f6fe01579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41244/0 (socket says 172.21.15.50:41244) 2024-09-13T15:11:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe5200700 1 -- 172.21.15.50:0/2805356915 learned_addr learned my addr 172.21.15.50:0/2805356915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fdfe00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00b19f0 0x7f6fe0149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.636+0000 7f6fe5c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe00cd610 0x7f6fe01fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe5200700 1 -- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00b19f0 msgr2=0x7f6fe0149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe5200700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00b19f0 0x7f6fe0149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe5200700 1 -- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe00cd610 msgr2=0x7f6fe01fa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe5200700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe00cd610 0x7f6fe01fa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe5200700 1 -- 172.21.15.50:0/2805356915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009570 con 0x7f6fe006a5d0 2024-09-13T15:11:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe5200700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 0x7f6fe01579b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e840 tx=0x7f6fd400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40095a0 con 0x7f6fe006a5d0 2024-09-13T15:11:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4013680 con 0x7f6fe006a5d0 2024-09-13T15:11:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40139f0 con 0x7f6fe006a5d0 2024-09-13T15:11:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe0148fc0 con 0x7f6fe006a5d0 2024-09-13T15:11:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe0149580 con 0x7f6fe006a5d0 2024-09-13T15:11:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.640+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe00cda80 con 0x7f6fe006a5d0 2024-09-13T15:11:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.644+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fd4013b50 con 0x7f6fe006a5d0 2024-09-13T15:11:41.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.644+0000 7f6fdcc00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fc0066730 0x7f6fc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.644+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6fd4084130 con 0x7f6fe006a5d0 2024-09-13T15:11:41.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.644+0000 7f6fdfe00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fc0066730 0x7f6fc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:41.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.644+0000 7f6fdfe00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fc0066730 0x7f6fc0068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc000c00 tx=0x7f6fcc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:41.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.652+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fd4051360 con 0x7f6fe006a5d0 2024-09-13T15:11:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.884+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fe0071200 con 0x7f6fe006a5d0 2024-09-13T15:11:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.884+0000 7f6fdcc00700 1 -- 172.21.15.50:0/2805356915 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f6fd4054980 con 0x7f6fe006a5d0 2024-09-13T15:11:41.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:41.888 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fc0066730 msgr2=0x7f6fc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fc0066730 0x7f6fc0068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc000c00 tx=0x7f6fcc008030 comp rx=0 tx=0).stop 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 msgr2=0x7f6fe01579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 0x7f6fe01579b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e840 tx=0x7f6fd400eb50 comp rx=0 tx=0).stop 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 shutdown_connections 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6fc0066730 0x7f6fc0068bf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe00cd610 0x7f6fe01fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6fe00b19f0 0x7f6fe0149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 --2- 172.21.15.50:0/2805356915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fe006a5d0 0x7f6fe01579b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 >> 172.21.15.50:0/2805356915 conn(0x7f6fe00b08d0 msgr2=0x7f6fe00680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:41.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 shutdown_connections 2024-09-13T15:11:41.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:41.888+0000 7f6fe7c00700 1 -- 172.21.15.50:0/2805356915 wait complete. 2024-09-13T15:11:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:41.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2024-09-13T15:11:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.088+0000 7fc6b0000700 1 Processor -- start 2024-09-13T15:11:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.088+0000 7fc6b0000700 1 -- start start 2024-09-13T15:11:42.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6b0000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6a806ff00 0x7fc6a8070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6b0000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc6a806ab90 0x7fc6a806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6b0000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a8070880 con 0x7fc6a81612c0 2024-09-13T15:11:42.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6b0000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80d0810 con 0x7fc6a806ff00 2024-09-13T15:11:42.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6b0000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80b3c20 con 0x7fc6a806ab90 2024-09-13T15:11:42.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6a806ff00 0x7fc6a8070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6a806ff00 0x7fc6a8070340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41256/0 (socket says 172.21.15.50:41256) 2024-09-13T15:11:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 -- 172.21.15.50:0/394684010 learned_addr learned my addr 172.21.15.50:0/394684010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6ae000700 1 --2- 172.21.15.50:0/394684010 >> v2:172.21.15.181:3300/0 conn(0x7fc6a806ab90 0x7fc6a806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 -- 172.21.15.50:0/394684010 >> v2:172.21.15.181:3300/0 conn(0x7fc6a806ab90 msgr2=0x7fc6a806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 --2- 172.21.15.50:0/394684010 >> v2:172.21.15.181:3300/0 conn(0x7fc6a806ab90 0x7fc6a806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 -- 172.21.15.50:0/394684010 >> v1:172.21.15.50:6789/0 conn(0x7fc6a81612c0 legacy=0x7fc6a80d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 -- 172.21.15.50:0/394684010 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80b3f00 con 0x7fc6a806ff00 2024-09-13T15:11:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6acc00700 1 --2- 172.21.15.50:0/394684010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a8070340 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8071bc0 tx=0x7fc694009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5733cc2b3674a71f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6a7e00700 1 -- 172.21.15.50:0/394684010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc6a806ff00 2024-09-13T15:11:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6a7e00700 1 -- 172.21.15.50:0/394684010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011990 con 0x7fc6a806ff00 2024-09-13T15:11:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.092+0000 7fc6a7e00700 1 -- 172.21.15.50:0/394684010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011d20 con 0x7fc6a806ff00 2024-09-13T15:11:42.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 -- 172.21.15.50:0/394684010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 msgr2=0x7fc6a8070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 --2- 172.21.15.50:0/394684010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a8070340 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8071bc0 tx=0x7fc694009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 -- 172.21.15.50:0/394684010 shutdown_connections 2024-09-13T15:11:42.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 --2- 172.21.15.50:0/394684010 >> v2:172.21.15.181:3300/0 conn(0x7fc6a806ab90 0x7fc6a806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 --2- 172.21.15.50:0/394684010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a8070340 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 -- 172.21.15.50:0/394684010 >> 172.21.15.50:0/394684010 conn(0x7fc6a806e660 msgr2=0x7fc6a806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 -- 172.21.15.50:0/394684010 shutdown_connections 2024-09-13T15:11:42.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 -- 172.21.15.50:0/394684010 wait complete. 2024-09-13T15:11:42.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 Processor -- start 2024-09-13T15:11:42.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.096+0000 7fc6b0000700 1 -- start start 2024-09-13T15:11:42.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6a806ab90 0x7fc6a81e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a81ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a81612c0 0x7fc6a81517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8156770 con 0x7fc6a806ff00 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a815bef0 con 0x7fc6a81612c0 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81563d0 con 0x7fc6a806ab90 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a81ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a81ebde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41260/0 (socket says 172.21.15.50:41260) 2024-09-13T15:11:42.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 -- 172.21.15.50:0/2576369744 learned_addr learned my addr 172.21.15.50:0/2576369744 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6ad600700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6a806ab90 0x7fc6a81e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6ae000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a81612c0 0x7fc6a81517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 -- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6a806ab90 msgr2=0x7fc6a81e9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6a806ab90 0x7fc6a81e9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 -- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a81612c0 msgr2=0x7fc6a81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a81612c0 0x7fc6a81517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 -- 172.21.15.50:0/2576369744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009570 con 0x7fc6a806ff00 2024-09-13T15:11:42.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6ae000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a81612c0 0x7fc6a81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:42.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6acc00700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a81ebde0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc694009f40 tx=0x7fc694004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6a5600700 1 -- 172.21.15.50:0/2576369744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694004550 con 0x7fc6a806ff00 2024-09-13T15:11:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6a5600700 1 -- 172.21.15.50:0/2576369744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69401f070 con 0x7fc6a806ff00 2024-09-13T15:11:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6a5600700 1 -- 172.21.15.50:0/2576369744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694003900 con 0x7fc6a806ff00 2024-09-13T15:11:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a815b930 con 0x7fc6a806ff00 2024-09-13T15:11:42.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.100+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a81ea4e0 con 0x7fc6a806ff00 2024-09-13T15:11:42.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.104+0000 7fc6a5600700 1 -- 172.21.15.50:0/2576369744 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc694003a60 con 0x7fc6a806ff00 2024-09-13T15:11:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.104+0000 7fc6a5600700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc688066760 0x7fc688068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.104+0000 7fc6a5600700 1 -- 172.21.15.50:0/2576369744 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc694021070 con 0x7fc6a806ff00 2024-09-13T15:11:42.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6ad600700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc688066760 0x7fc688068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 Processor -- start 2024-09-13T15:11:42.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6ad600700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc688066760 0x7fc688068c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc69c000f60 tx=0x7fc69c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 -- start start 2024-09-13T15:11:42.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdda240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cdfbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdaf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cd43010 con 0x2cdd9d00 2024-09-13T15:11:42.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ccd0f40 con 0x2cdfb950 2024-09-13T15:11:42.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x2cd23e30 con 0x2cdfc270 2024-09-13T15:11:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cdfbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cdfbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41266/0 (socket says 172.21.15.50:41266) 2024-09-13T15:11:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 -- 172.21.15.50:0/3393055390 learned_addr learned my addr 172.21.15.50:0/3393055390 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6ad600700 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdda240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6ae000700 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdaf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 -- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 msgr2=0x2cdaf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdaf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 -- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 msgr2=0x2cdda240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdda240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 -- 172.21.15.50:0/3393055390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2cb8fa40 con 0x2cdd9d00 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6ae000700 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdaf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.108+0000 7fc6acc00700 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cdfbd30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc694083a50 tx=0x7fc694056130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2877c41e7bfaf920 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc699c00700 1 -- 172.21.15.50:0/3393055390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940566a0 con 0x2cdd9d00 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc699c00700 1 -- 172.21.15.50:0/3393055390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69405a4d0 con 0x2cdd9d00 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc699c00700 1 -- 172.21.15.50:0/3393055390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69405ea90 con 0x2cdd9d00 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 -- 172.21.15.50:0/3393055390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 msgr2=0x2cdfbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cdfbd30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc694083a50 tx=0x7fc694056130 comp rx=0 tx=0).stop 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 -- 172.21.15.50:0/3393055390 shutdown_connections 2024-09-13T15:11:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdaf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cdfbd30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3393055390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdda240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 -- 172.21.15.50:0/3393055390 >> 172.21.15.50:0/3393055390 conn(0x2cb445b0 msgr2=0x2cdb59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 -- 172.21.15.50:0/3393055390 shutdown_connections 2024-09-13T15:11:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 -- 172.21.15.50:0/3393055390 wait complete. 2024-09-13T15:11:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 -- start start 2024-09-13T15:11:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.112+0000 7fc6b333a740 1 Processor -- start 2024-09-13T15:11:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdd90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdfa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cd1f150 con 0x2cdd9d00 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cd1ceb0 con 0x2cdfb950 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ccda8e0 con 0x2cdfc270 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 10 client.0 _ll_register_callbacks cb 0x2ccb9670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41272/0 (socket says 172.21.15.50:41272) 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 -- 172.21.15.50:0/1353968902 learned_addr learned my addr 172.21.15.50:0/1353968902 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6acc00700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdd90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ae000700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdfa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 -- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 msgr2=0x2cdfa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdfa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 -- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 msgr2=0x2cdd90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdd90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 -- 172.21.15.50:0/1353968902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a81ea4e0 con 0x2cdd9d00 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ae000700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdfa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6acc00700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdd90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6ad600700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddc670 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc69c003990 tx=0x7fc69c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5743edbefc786e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc68e000700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc68e000700 1 -- 172.21.15.50:0/1353968902 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0148c0 con 0x2cdd9d00 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc68e000700 1 -- 172.21.15.50:0/1353968902 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc69c014a20 con 0x2cdd9d00 2024-09-13T15:11:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2cb512c0 con 0x2cdd9d00 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc68e000700 1 -- 172.21.15.50:0/1353968902 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc69c014be0 con 0x2cdd9d00 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 10 client.7203 fetch_fsmap learned FSMap version 46 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x2cce3290 con 0x2cdd9d00 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc68e000700 1 -- 172.21.15.50:0/1353968902 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2cb512c0 con 0x2cdd9d00 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc68e000700 1 -- 172.21.15.50:0/1353968902 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 46) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc69c020070 con 0x2cdd9d00 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 10 client.7203 fetch_fsmap finished waiting for FSMap version 46 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 10 client.7203 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 20 client.7203 populate_metadata read hostname 'smithi050' 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2cddb190 0x2cddb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 4 client.7203 mds_command: new command op to 6954 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:11:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.116+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 --> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2cb9b540 con 0x2cddb190 2024-09-13T15:11:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6acc00700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2cddb190 0x2cddb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc68e000700 10 client.7203 ms_handle_connect on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6acc00700 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2cddb190 0x2cddb5a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee2d69441602001a server_cookie=69a42cd88c6974b0 in_seq=0 out_seq=0 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc68e000700 1 -- 172.21.15.50:0/1353968902 <== mds.0 v2:172.21.15.50:6834/2602636353 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x2cb9b540 con 0x2cddb190 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc68e000700 10 client.7203 handle_command_reply: tid=0 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 client.7203 shutdown 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 msgr2=0x2cddc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddc670 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc69c003990 tx=0x7fc69c001120 comp rx=0 tx=0).stop 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 shutdown_connections 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2cdfa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2cddb190 0x2cddb5a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfb950 0x2cdd90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 --2- 172.21.15.50:0/1353968902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddc670 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc68e000700 0 client.7203 ms_handle_reset on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 >> 172.21.15.50:0/1353968902 conn(0x2cb445b0 msgr2=0x2cdaedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 shutdown_connections 2024-09-13T15:11:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 1 -- 172.21.15.50:0/1353968902 wait complete. 2024-09-13T15:11:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.120+0000 7fc6b333a740 20 client.7203 trim_cache size 0 max 16384 2024-09-13T15:11:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 Processor -- start 2024-09-13T15:11:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 -- start start 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfb950 0x2cddc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfc270 0x2ce0f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cbc8b80 con 0x2cdd9d00 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cca6a50 con 0x2cdfc270 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x2cd43010 con 0x2cdfb950 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41282/0 (socket says 172.21.15.50:41282) 2024-09-13T15:11:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 -- 172.21.15.50:0/2514594699 learned_addr learned my addr 172.21.15.50:0/2514594699 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6acc00700 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfb950 0x2cddc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 -- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfb950 msgr2=0x2cddc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ae000700 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfc270 0x2ce0f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfb950 0x2cddc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 -- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfc270 msgr2=0x2ce0f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfc270 0x2ce0f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 -- 172.21.15.50:0/2514594699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ccc94c0 con 0x2cdd9d00 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc6ad600700 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddbc90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc69c001160 tx=0x7fc69c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1570452aa6130a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc69a600700 1 -- 172.21.15.50:0/2514594699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c007a00 con 0x2cdd9d00 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc69a600700 1 -- 172.21.15.50:0/2514594699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c014710 con 0x2cdd9d00 2024-09-13T15:11:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.144+0000 7fc69a600700 1 -- 172.21.15.50:0/2514594699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c014aa0 con 0x2cdd9d00 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 -- 172.21.15.50:0/2514594699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 msgr2=0x2cddbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddbc90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc69c001160 tx=0x7fc69c01d000 comp rx=0 tx=0).stop 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 -- 172.21.15.50:0/2514594699 shutdown_connections 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdfc270 0x2ce0f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfb950 0x2cddc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 --2- 172.21.15.50:0/2514594699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdd9d00 0x2cddbc90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 -- 172.21.15.50:0/2514594699 >> 172.21.15.50:0/2514594699 conn(0x2cb445b0 msgr2=0x2ce0b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 -- 172.21.15.50:0/2514594699 shutdown_connections 2024-09-13T15:11:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 -- 172.21.15.50:0/2514594699 wait complete. 2024-09-13T15:11:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 -- start start 2024-09-13T15:11:42.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.148+0000 7fc6b333a740 1 Processor -- start 2024-09-13T15:11:42.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 0x2ce60600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 0x2ce121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2ce12720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ccedc00 con 0x2cdfb950 2024-09-13T15:11:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cd1a6c0 con 0x2cdd9d00 2024-09-13T15:11:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ce1bb10 con 0x2cdfc270 2024-09-13T15:11:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6b333a740 10 client.0 _ll_register_callbacks cb 0x2ccec8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:11:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 0x2ce60600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6acc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 0x2ce121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 0x2ce60600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:52754/0 (socket says 172.21.15.50:52754) 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 -- 172.21.15.50:0/3089327774 learned_addr learned my addr 172.21.15.50:0/3089327774 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6acc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 0x2ce121e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41296/0 (socket says 172.21.15.50:41296) 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ae000700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2ce12720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 -- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 msgr2=0x2ce12720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2ce12720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 -- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 msgr2=0x2ce121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 0x2ce121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6ad600700 1 -- 172.21.15.50:0/3089327774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2cce3290 con 0x2cdd9d00 2024-09-13T15:11:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.152+0000 7fc6acc00700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 0x2ce121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6ad600700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 0x2ce60600 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc69c003fd0 tx=0x7fc69c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51156eed67f6f2ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc68e000700 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-13T15:11:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc68e000700 1 -- 172.21.15.50:0/3089327774 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c007a00 con 0x2cdd9d00 2024-09-13T15:11:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc68e000700 1 -- 172.21.15.50:0/3089327774 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc69c022660 con 0x2cdd9d00 2024-09-13T15:11:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc69405a4d0 con 0x2cdd9d00 2024-09-13T15:11:42.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc68e000700 1 -- 172.21.15.50:0/3089327774 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc69c022820 con 0x2cdd9d00 2024-09-13T15:11:42.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 10 client.7132 fetch_fsmap learned FSMap version 46 2024-09-13T15:11:42.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x2ccbd790 con 0x2cdd9d00 2024-09-13T15:11:42.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc68e000700 1 -- 172.21.15.50:0/3089327774 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69405a4d0 con 0x2cdd9d00 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc68e000700 1 -- 172.21.15.50:0/3089327774 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 46) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc69c040020 con 0x2cdd9d00 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 10 client.7132 fetch_fsmap finished waiting for FSMap version 46 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 10 client.7132 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 20 client.7132 populate_metadata read hostname 'smithi050' 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2ce18ed0 0x2ce192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 4 client.7132 mds_command: new command op to 6954 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 --> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x2cbc02c0 con 0x2ce18ed0 2024-09-13T15:11:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.156+0000 7fc6acc00700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2ce18ed0 0x2ce192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6acc00700 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2ce18ed0 0x2ce192b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a811c5eead6efc07 server_cookie=9aace2a2adf55652 in_seq=0 out_seq=0 2024-09-13T15:11:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc68e000700 10 client.7132 ms_handle_connect on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc68e000700 1 -- 172.21.15.50:0/3089327774 <== mds.0 v2:172.21.15.50:6834/2602636353 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x2cbc02c0 con 0x2ce18ed0 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc68e000700 10 client.7132 handle_command_reply: tid=0 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 client.7132 shutdown 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 msgr2=0x2ce60600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 0x2ce60600 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc69c003fd0 tx=0x7fc69c020000 comp rx=0 tx=0).stop 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 shutdown_connections 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x2cdfc270 0x2ce12720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2cdfb950 0x2ce121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.50:6834/2602636353,v1:172.21.15.50:6835/2602636353] conn(0x2ce18ed0 0x2ce192b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 --2- 172.21.15.50:0/3089327774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x2cdd9d00 0x2ce60600 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 >> 172.21.15.50:0/3089327774 conn(0x2cb445b0 msgr2=0x2cddbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc68e000700 0 client.7132 ms_handle_reset on v2:172.21.15.50:6834/2602636353 2024-09-13T15:11:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 shutdown_connections 2024-09-13T15:11:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 1 -- 172.21.15.50:0/3089327774 wait complete. 2024-09-13T15:11:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b333a740 20 client.7132 trim_cache size 0 max 16384 2024-09-13T15:11:42.165 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-13T15:11:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc688066760 msgr2=0x7fc688068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc688066760 0x7fc688068c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc69c000f60 tx=0x7fc69c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 msgr2=0x7fc6a81ebde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a81ebde0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc694009f40 tx=0x7fc694004770 comp rx=0 tx=0).stop 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 shutdown_connections 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc688066760 0x7fc688068c20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a81612c0 0x7fc6a81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a806ff00 0x7fc6a81ebde0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 --2- 172.21.15.50:0/2576369744 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc6a806ab90 0x7fc6a81e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 >> 172.21.15.50:0/2576369744 conn(0x7fc6a806e660 msgr2=0x7fc6a80d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 shutdown_connections 2024-09-13T15:11:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.160+0000 7fc6b0000700 1 -- 172.21.15.50:0/2576369744 wait complete. 2024-09-13T15:11:42.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-13T15:11:42.390 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-13T15:11:42.391 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T15:11:42.391 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:11:42.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:42.434 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:42.478 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:11:42.478 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:42.478 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:42.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:42.499 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:42.499 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:42.536 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:42.536 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:42.537 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:42.564 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:42.565 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:42.565 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:42.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:42.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.780+0000 7f7566400700 1 Processor -- start 2024-09-13T15:11:42.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.780+0000 7f7566400700 1 -- start start 2024-09-13T15:11:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7566400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f756006aaa0 0x7f756015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7566400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75600b3980 0x7f756006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7566400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756015e560 con 0x7f756006cbb0 2024-09-13T15:11:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7566400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600adf90 con 0x7f75600b3980 2024-09-13T15:11:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7566400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756006b3c0 con 0x7f756006aaa0 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75600b3980 0x7f756006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75600b3980 0x7f756006ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41306/0 (socket says 172.21.15.50:41306) 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 -- 172.21.15.50:0/1257189665 learned_addr learned my addr 172.21.15.50:0/1257189665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7565000700 1 --2- 172.21.15.50:0/1257189665 >> v2:172.21.15.181:3300/0 conn(0x7f756006aaa0 0x7f756015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 -- 172.21.15.50:0/1257189665 >> v2:172.21.15.181:3300/0 conn(0x7f756006aaa0 msgr2=0x7f756015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 --2- 172.21.15.50:0/1257189665 >> v2:172.21.15.181:3300/0 conn(0x7f756006aaa0 0x7f756015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 -- 172.21.15.50:0/1257189665 >> v1:172.21.15.181:6789/0 conn(0x7f756006cbb0 legacy=0x7f756006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 -- 172.21.15.50:0/1257189665 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756015d920 con 0x7f75600b3980 2024-09-13T15:11:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f7557e00700 1 --2- 172.21.15.50:0/1257189665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600b3980 0x7f756006ae80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f75600ad490 tx=0x7f754c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a81c9adb3b9ca25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f755fe00700 1 -- 172.21.15.50:0/1257189665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00b8a0 con 0x7f75600b3980 2024-09-13T15:11:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f755fe00700 1 -- 172.21.15.50:0/1257189665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00ba00 con 0x7f75600b3980 2024-09-13T15:11:42.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.784+0000 7f755fe00700 1 -- 172.21.15.50:0/1257189665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00bd90 con 0x7f75600b3980 2024-09-13T15:11:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 -- 172.21.15.50:0/1257189665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600b3980 msgr2=0x7f756006ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 --2- 172.21.15.50:0/1257189665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600b3980 0x7f756006ae80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f75600ad490 tx=0x7f754c009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 -- 172.21.15.50:0/1257189665 shutdown_connections 2024-09-13T15:11:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 --2- 172.21.15.50:0/1257189665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75600b3980 0x7f756006ae80 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 --2- 172.21.15.50:0/1257189665 >> v2:172.21.15.181:3300/0 conn(0x7f756006aaa0 0x7f756015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 -- 172.21.15.50:0/1257189665 >> 172.21.15.50:0/1257189665 conn(0x7f75600b0c40 msgr2=0x7f756006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 -- 172.21.15.50:0/1257189665 shutdown_connections 2024-09-13T15:11:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 -- 172.21.15.50:0/1257189665 wait complete. 2024-09-13T15:11:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.788+0000 7f7566400700 1 Processor -- start 2024-09-13T15:11:42.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 -- start start 2024-09-13T15:11:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756006aaa0 0x7f7560144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 0x7f75601446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75600b3980 0x7f7560145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560145370 con 0x7f756006cbb0 2024-09-13T15:11:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560144db0 con 0x7f756006aaa0 2024-09-13T15:11:42.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7560145090 con 0x7f75600b3980 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 0x7f75601446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 0x7f75601446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41310/0 (socket says 172.21.15.50:41310) 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 -- 172.21.15.50:0/2420183075 learned_addr learned my addr 172.21.15.50:0/2420183075 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7565000700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756006aaa0 0x7f7560144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7565a00700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75600b3980 0x7f7560145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 -- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75600b3980 msgr2=0x7f7560145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75600b3980 0x7f7560145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 -- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756006aaa0 msgr2=0x7f7560144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756006aaa0 0x7f7560144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:42.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 -- 172.21.15.50:0/2420183075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009570 con 0x7f756006cbb0 2024-09-13T15:11:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7565a00700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75600b3980 0x7f7560145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7557e00700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 0x7f75601446a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f75600b1690 tx=0x7f754c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c004440 con 0x7f756006cbb0 2024-09-13T15:11:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c0045a0 con 0x7f756006cbb0 2024-09-13T15:11:42.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756013b9f0 con 0x7f756006cbb0 2024-09-13T15:11:42.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.792+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c011b00 con 0x7f756006cbb0 2024-09-13T15:11:42.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.796+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75601f2190 con 0x7f756006cbb0 2024-09-13T15:11:42.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.796+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756013bf10 con 0x7f756006cbb0 2024-09-13T15:11:42.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.796+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f754c011c60 con 0x7f756006cbb0 2024-09-13T15:11:42.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.796+0000 7f755d600700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7540066730 0x7f7540068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:42.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.800+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f754c021030 con 0x7f756006cbb0 2024-09-13T15:11:42.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.800+0000 7f7565000700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7540066730 0x7f7540068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:42.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.800+0000 7f7565000700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7540066730 0x7f7540068bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7550007a60 tx=0x7f7550008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:42.804+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f756013bf10 con 0x7f756006cbb0 2024-09-13T15:11:43.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.044+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f756013bf10 con 0x7f756006cbb0 2024-09-13T15:11:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.044+0000 7f755d600700 1 -- 172.21.15.50:0/2420183075 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f756013bf10 con 0x7f756006cbb0 2024-09-13T15:11:43.048 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:43.048 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7540066730 msgr2=0x7f7540068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7540066730 0x7f7540068bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7550007a60 tx=0x7f7550008040 comp rx=0 tx=0).stop 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 msgr2=0x7f75601446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 0x7f75601446a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f75600b1690 tx=0x7f754c004770 comp rx=0 tx=0).stop 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 shutdown_connections 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7540066730 0x7f7540068bf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75600b3980 0x7f7560145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f756006cbb0 0x7f75601446a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 --2- 172.21.15.50:0/2420183075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756006aaa0 0x7f7560144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 >> 172.21.15.50:0/2420183075 conn(0x7f75600b0c40 msgr2=0x7f7560070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 shutdown_connections 2024-09-13T15:11:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.048+0000 7f7566400700 1 -- 172.21.15.50:0/2420183075 wait complete. 2024-09-13T15:11:43.053 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:43.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa680e00700 1 Processor -- start 2024-09-13T15:11:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa680e00700 1 -- start start 2024-09-13T15:11:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa680e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 0x7fa67c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa680e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0ccb40 con 0x7fa67c0cc6f0 2024-09-13T15:11:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa680e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c06b430 con 0x7fa67c0cb020 2024-09-13T15:11:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa680e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0b2ad0 con 0x7fa67c06aaa0 2024-09-13T15:11:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa67c0cc6f0 0x7fa67c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35520/0 (socket says 172.21.15.50:35520) 2024-09-13T15:11:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67aa00700 1 -- 172.21.15.50:0/397673218 learned_addr learned my addr 172.21.15.50:0/397673218 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67be00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 0x7fa67c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566311411 0 0) 0x7fa67c0ccb40 con 0x7fa67c0cc6f0 2024-09-13T15:11:43.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6600035d0 con 0x7fa67c0cc6f0 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038760592 0 0) 0x7fa66c001110 con 0x7fa67c0cb020 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa67c0ccb40 con 0x7fa67c0cb020 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 854408879 0 0) 0x7fa6600035d0 con 0x7fa67c0cc6f0 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 msgr2=0x7fa67c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 0x7fa67c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 >> v1:172.21.15.181:6789/0 conn(0x7fa67c0cb020 legacy=0x7fa67c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c15b960 con 0x7fa67c0cc6f0 2024-09-13T15:11:43.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7fa668001670 con 0x7fa67c0cc6f0 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.248+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 >> v1:172.21.15.50:6789/0 conn(0x7fa67c0cc6f0 legacy=0x7fa67c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660003c50 0x7fa660004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa660004870 0x7fa660004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 0x7fa660005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0b2ad0 con 0x7fa660003c50 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66000bb10 con 0x7fa660004870 2024-09-13T15:11:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66000bcd0 con 0x7fa67c06aaa0 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67b400700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660003c50 0x7fa660004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa660004870 0x7fa660004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67be00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 0x7fa660005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 -- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 msgr2=0x7fa660005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa67c06aaa0 0x7fa660005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 -- 172.21.15.50:0/397673218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660003c50 msgr2=0x7fa660004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660003c50 0x7fa660004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 -- 172.21.15.50:0/397673218 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600035d0 con 0x7fa660004870 2024-09-13T15:11:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67aa00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa660004870 0x7fa660004cf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa668001eb0 tx=0x7fa6600058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddc6825cb01dcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800cd80 con 0x7fa660004870 2024-09-13T15:11:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668005980 con 0x7fa660004870 2024-09-13T15:11:43.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67a000700 1 -- 172.21.15.50:0/397673218 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668005d30 con 0x7fa660004870 2024-09-13T15:11:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa680e00700 1 -- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa660004870 msgr2=0x7fa660004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa680e00700 1 --2- 172.21.15.50:0/397673218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa660004870 0x7fa660004cf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa668001eb0 tx=0x7fa6600058a0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.252+0000 7fa67be00700 1 -- 172.21.15.50:0/397673218 reap_dead start 2024-09-13T15:11:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.256+0000 7fa680e00700 1 -- 172.21.15.50:0/397673218 shutdown_connections 2024-09-13T15:11:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.256+0000 7fa680e00700 1 -- 172.21.15.50:0/397673218 >> 172.21.15.50:0/397673218 conn(0x7fa67c0b0c40 msgr2=0x7fa67c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:43.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.256+0000 7fa680e00700 1 -- 172.21.15.50:0/397673218 shutdown_connections 2024-09-13T15:11:43.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.256+0000 7fa680e00700 1 -- 172.21.15.50:0/397673218 wait complete. 2024-09-13T15:11:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.256+0000 7fa680e00700 1 Processor -- start 2024-09-13T15:11:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.256+0000 7fa680e00700 1 -- start start 2024-09-13T15:11:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa660004870 0x7fa67c138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 0x7fa67c13a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c13acf0 0x7fa67c13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c13b170 con 0x7fa67c13c960 2024-09-13T15:11:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c13dea0 con 0x7fa67c13acf0 2024-09-13T15:11:43.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c13b950 con 0x7fa660004870 2024-09-13T15:11:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 0x7fa67c13a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 0x7fa67c13a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60384/0 (socket says 172.21.15.50:60384) 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 -- 172.21.15.50:0/3085399672 learned_addr learned my addr 172.21.15.50:0/3085399672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67be00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c13acf0 0x7fa67c13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67b400700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa660004870 0x7fa67c138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 -- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa660004870 msgr2=0x7fa67c138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa660004870 0x7fa67c138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 -- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c13acf0 msgr2=0x7fa67c13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c13acf0 0x7fa67c13d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 -- 172.21.15.50:0/3085399672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c1585f0 con 0x7fa67c13c960 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa67aa00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 0x7fa67c13a7b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa668001ca0 tx=0x7fa668001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668007bb0 con 0x7fa67c13c960 2024-09-13T15:11:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668004890 con 0x7fa67c13c960 2024-09-13T15:11:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668004c20 con 0x7fa67c13c960 2024-09-13T15:11:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c138f90 con 0x7fa67c13c960 2024-09-13T15:11:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.260+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c13be80 con 0x7fa67c13c960 2024-09-13T15:11:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.264+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c13b0d0 con 0x7fa67c13c960 2024-09-13T15:11:43.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.264+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa668007070 con 0x7fa67c13c960 2024-09-13T15:11:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.268+0000 7fa673400700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa65c066730 0x7fa65c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.268+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa6680850e0 con 0x7fa67c13c960 2024-09-13T15:11:43.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.268+0000 7fa67b400700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa65c066730 0x7fa65c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.268+0000 7fa67b400700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa65c066730 0x7fa65c068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa66c000c00 tx=0x7fa66c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:43.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.276+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa668052420 con 0x7fa67c13c960 2024-09-13T15:11:43.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.464+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa67c06aef0 con 0x7fa67c13c960 2024-09-13T15:11:43.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.464+0000 7fa673400700 1 -- 172.21.15.50:0/3085399672 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fa668055a40 con 0x7fa67c13c960 2024-09-13T15:11:43.470 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:43.470 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:28.631014+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:43.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa65c066730 msgr2=0x7fa65c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa65c066730 0x7fa65c068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa66c000c00 tx=0x7fa66c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:43.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 msgr2=0x7fa67c13a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 0x7fa67c13a7b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa668001ca0 tx=0x7fa668001980 comp rx=0 tx=0).stop 2024-09-13T15:11:43.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 shutdown_connections 2024-09-13T15:11:43.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa65c066730 0x7fa65c068bf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c13acf0 0x7fa67c13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa67c13c960 0x7fa67c13a7b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 --2- 172.21.15.50:0/3085399672 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa660004870 0x7fa67c138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 >> 172.21.15.50:0/3085399672 conn(0x7fa67c0b0c40 msgr2=0x7fa67c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:43.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 shutdown_connections 2024-09-13T15:11:43.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.468+0000 7fa680e00700 1 -- 172.21.15.50:0/3085399672 wait complete. 2024-09-13T15:11:43.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:25.790116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:26.629791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:43.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.672+0000 7f014aa00700 1 Processor -- start 2024-09-13T15:11:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.672+0000 7f014aa00700 1 -- start start 2024-09-13T15:11:43.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.672+0000 7f014aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01440667a0 0x7f0144165810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.672+0000 7f014aa00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0144071c00 con 0x7f0144144460 2024-09-13T15:11:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.672+0000 7f014aa00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0144144840 con 0x7f01440cd7d0 2024-09-13T15:11:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.672+0000 7f014aa00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01440717e0 con 0x7f01440667a0 2024-09-13T15:11:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f0149600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0144144460 0x7f01440ceed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35532/0 (socket says 172.21.15.50:35532) 2024-09-13T15:11:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f0149600700 1 -- 172.21.15.50:0/978090182 learned_addr learned my addr 172.21.15.50:0/978090182 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014a000700 1 --2- 172.21.15.50:0/978090182 >> v2:172.21.15.50:3300/0 conn(0x7f01440667a0 0x7f0144165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014a000700 1 -- 172.21.15.50:0/978090182 >> v1:172.21.15.181:6789/0 conn(0x7f01440cd7d0 legacy=0x7f0144066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014a000700 1 -- 172.21.15.50:0/978090182 >> v1:172.21.15.50:6789/0 conn(0x7f0144144460 legacy=0x7f01440ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014a000700 1 -- 172.21.15.50:0/978090182 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144070e40 con 0x7f01440667a0 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f0143e00700 1 -- 172.21.15.50:0/978090182 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551147338 0 0) 0x7f0144071c00 con 0x7f0144144460 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014a000700 1 --2- 172.21.15.50:0/978090182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01440667a0 0x7f0144165810 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f013c009d90 tx=0x7f013c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6b8b1ed34774d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f0143e00700 1 -- 172.21.15.50:0/978090182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00e070 con 0x7f01440667a0 2024-09-13T15:11:43.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f0143e00700 1 -- 172.21.15.50:0/978090182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00bbd0 con 0x7f01440667a0 2024-09-13T15:11:43.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f0143e00700 1 -- 172.21.15.50:0/978090182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c012430 con 0x7f01440667a0 2024-09-13T15:11:43.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 -- 172.21.15.50:0/978090182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01440667a0 msgr2=0x7f0144165810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 --2- 172.21.15.50:0/978090182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01440667a0 0x7f0144165810 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f013c009d90 tx=0x7f013c00b330 comp rx=0 tx=0).stop 2024-09-13T15:11:43.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 -- 172.21.15.50:0/978090182 shutdown_connections 2024-09-13T15:11:43.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 --2- 172.21.15.50:0/978090182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01440667a0 0x7f0144165810 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 -- 172.21.15.50:0/978090182 >> 172.21.15.50:0/978090182 conn(0x7f01440b17c0 msgr2=0x7f01440b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:43.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 -- 172.21.15.50:0/978090182 shutdown_connections 2024-09-13T15:11:43.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.676+0000 7f014aa00700 1 -- 172.21.15.50:0/978090182 wait complete. 2024-09-13T15:11:43.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 Processor -- start 2024-09-13T15:11:43.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 -- start start 2024-09-13T15:11:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01440667a0 0x7f014413fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01440cd7d0 0x7f014415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 0x7f014415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440ae400 con 0x7f0144144460 2024-09-13T15:11:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440ad7f0 con 0x7f01440cd7d0 2024-09-13T15:11:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014aa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440adad0 con 0x7f01440667a0 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 0x7f014415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 0x7f014415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60402/0 (socket says 172.21.15.50:60402) 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 -- 172.21.15.50:0/752270757 learned_addr learned my addr 172.21.15.50:0/752270757 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f0149600700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01440667a0 0x7f014413fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f0148c00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01440cd7d0 0x7f014415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 -- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01440667a0 msgr2=0x7f014413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01440667a0 0x7f014413fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 -- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01440cd7d0 msgr2=0x7f014415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01440cd7d0 0x7f014415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 -- 172.21.15.50:0/752270757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009a70 con 0x7f0144144460 2024-09-13T15:11:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.680+0000 7f014a000700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 0x7f014415d0e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f013c014040 tx=0x7f013c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c01b810 con 0x7f0144144460 2024-09-13T15:11:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c020070 con 0x7f0144144460 2024-09-13T15:11:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c01bbb0 con 0x7f0144144460 2024-09-13T15:11:43.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440addb0 con 0x7f0144144460 2024-09-13T15:11:43.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01441401c0 con 0x7f0144144460 2024-09-13T15:11:43.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01440ae5b0 con 0x7f0144144460 2024-09-13T15:11:43.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.684+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f013c01bd10 con 0x7f0144144460 2024-09-13T15:11:43.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.688+0000 7f0141600700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0124066730 0x7f0124068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:43.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.688+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f013c022070 con 0x7f0144144460 2024-09-13T15:11:43.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.688+0000 7f0149600700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0124066730 0x7f0124068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:43.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.688+0000 7f0149600700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0124066730 0x7f0124068bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0138007ce0 tx=0x7f0138007c30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:43.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.696+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01440ae5b0 con 0x7f0144144460 2024-09-13T15:11:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.872+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0144066090 con 0x7f0144144460 2024-09-13T15:11:43.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f0141600700 1 -- 172.21.15.50:0/752270757 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f013c056f70 con 0x7f0144144460 2024-09-13T15:11:43.878 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0124066730 msgr2=0x7f0124068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0124066730 0x7f0124068bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0138007ce0 tx=0x7f0138007c30 comp rx=0 tx=0).stop 2024-09-13T15:11:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 msgr2=0x7f014415d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 0x7f014415d0e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f013c014040 tx=0x7f013c004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 shutdown_connections 2024-09-13T15:11:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0124066730 0x7f0124068bf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0144144460 0x7f014415d0e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01440cd7d0 0x7f014415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.876+0000 7f014aa00700 1 --2- 172.21.15.50:0/752270757 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01440667a0 0x7f014413fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:43.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.880+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 >> 172.21.15.50:0/752270757 conn(0x7f01440b17c0 msgr2=0x7f01440ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:43.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.880+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 shutdown_connections 2024-09-13T15:11:43.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:43.880+0000 7f014aa00700 1 -- 172.21.15.50:0/752270757 wait complete. 2024-09-13T15:11:43.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:11:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.080+0000 7efdda000700 1 Processor -- start 2024-09-13T15:11:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.080+0000 7efdda000700 1 -- start start 2024-09-13T15:11:44.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdda000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd40ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdda000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40cf640 con 0x7efdd415a880 2024-09-13T15:11:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdda000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd415df90 con 0x7efdd40cf1e0 2024-09-13T15:11:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdda000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd415acb0 con 0x7efdd40ce280 2024-09-13T15:11:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdd3e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efdd415a880 0x7efdd4070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35536/0 (socket says 172.21.15.50:35536) 2024-09-13T15:11:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdd3e00700 1 -- 172.21.15.50:0/1224134033 learned_addr learned my addr 172.21.15.50:0/1224134033 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.084+0000 7efdd3400700 1 --2- 172.21.15.50:0/1224134033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd40ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203796308 0 0) 0x7efdd40cf640 con 0x7efdd415a880 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb80035d0 con 0x7efdd415a880 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943548364 0 0) 0x7efdd415df90 con 0x7efdd40cf1e0 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd40cf640 con 0x7efdd40cf1e0 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd3400700 1 -- 172.21.15.50:0/1224134033 >> v1:172.21.15.181:6789/0 conn(0x7efdd40cf1e0 legacy=0x7efdd415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd3400700 1 -- 172.21.15.50:0/1224134033 >> v1:172.21.15.50:6789/0 conn(0x7efdd415a880 legacy=0x7efdd4070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd3400700 1 -- 172.21.15.50:0/1224134033 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd415aea0 con 0x7efdd40ce280 2024-09-13T15:11:44.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd3400700 1 --2- 172.21.15.50:0/1224134033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd40ceca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009880 tx=0x7efdc4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a923585a7a709458 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011830 con 0x7efdd40ce280 2024-09-13T15:11:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4011990 con 0x7efdd40ce280 2024-09-13T15:11:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdd2000700 1 -- 172.21.15.50:0/1224134033 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011d20 con 0x7efdd40ce280 2024-09-13T15:11:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 -- 172.21.15.50:0/1224134033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 msgr2=0x7efdd40ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 --2- 172.21.15.50:0/1224134033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd40ceca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009880 tx=0x7efdc4009b90 comp rx=0 tx=0).stop 2024-09-13T15:11:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 -- 172.21.15.50:0/1224134033 shutdown_connections 2024-09-13T15:11:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 --2- 172.21.15.50:0/1224134033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd40ceca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 -- 172.21.15.50:0/1224134033 >> 172.21.15.50:0/1224134033 conn(0x7efdd406a570 msgr2=0x7efdd406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 -- 172.21.15.50:0/1224134033 shutdown_connections 2024-09-13T15:11:44.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.088+0000 7efdda000700 1 -- 172.21.15.50:0/1224134033 wait complete. 2024-09-13T15:11:44.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 Processor -- start 2024-09-13T15:11:44.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 -- start start 2024-09-13T15:11:44.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd41e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd40cf1e0 0x7efdd40cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 0x7efdd40cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4150fd0 con 0x7efdd415a880 2024-09-13T15:11:44.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.092+0000 7efdda000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4151220 con 0x7efdd40cf1e0 2024-09-13T15:11:44.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdda000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4151500 con 0x7efdd40ce280 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 0x7efdd40cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 0x7efdd40cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60418/0 (socket says 172.21.15.50:60418) 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 -- 172.21.15.50:0/3991779575 learned_addr learned my addr 172.21.15.50:0/3991779575 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3400700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd41e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd2a00700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd40cf1e0 0x7efdd40cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 -- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 msgr2=0x7efdd41e8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd41e8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 -- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd40cf1e0 msgr2=0x7efdd40cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd40cf1e0 0x7efdd40cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 -- 172.21.15.50:0/3991779575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40094b0 con 0x7efdd415a880 2024-09-13T15:11:44.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3400700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd41e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:44.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdd3e00700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 0x7efdd40cd690 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00caf0 tx=0x7efdcc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00a7b0 con 0x7efdd415a880 2024-09-13T15:11:44.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00a910 con 0x7efdd415a880 2024-09-13T15:11:44.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd41517e0 con 0x7efdd415a880 2024-09-13T15:11:44.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00ac80 con 0x7efdd415a880 2024-09-13T15:11:44.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.096+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd4151da0 con 0x7efdd415a880 2024-09-13T15:11:44.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.100+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4072170 con 0x7efdd415a880 2024-09-13T15:11:44.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.100+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdcc01b3b0 con 0x7efdd415a880 2024-09-13T15:11:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.100+0000 7efdcb400700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efdb4066730 0x7efdb4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.100+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdcc083c50 con 0x7efdd415a880 2024-09-13T15:11:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.104+0000 7efdd3400700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efdb4066730 0x7efdb4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.104+0000 7efdd3400700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efdb4066730 0x7efdb4068bf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efdc40090b0 tx=0x7efdc401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.108+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efdcc054920 con 0x7efdd415a880 2024-09-13T15:11:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.304+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdd415e400 con 0x7efdd415a880 2024-09-13T15:11:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdcb400700 1 -- 172.21.15.50:0/3991779575 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7efdcc017020 con 0x7efdd415a880 2024-09-13T15:11:44.311 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efdb4066730 msgr2=0x7efdb4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efdb4066730 0x7efdb4068bf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efdc40090b0 tx=0x7efdc401c040 comp rx=0 tx=0).stop 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 msgr2=0x7efdd40cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 0x7efdd40cd690 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00caf0 tx=0x7efdcc00cbd0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 shutdown_connections 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efdb4066730 0x7efdb4068bf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdd415a880 0x7efdd40cd690 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd40cf1e0 0x7efdd40cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 --2- 172.21.15.50:0/3991779575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdd40ce280 0x7efdd41e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 >> 172.21.15.50:0/3991779575 conn(0x7efdd406a570 msgr2=0x7efdd415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.308+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 shutdown_connections 2024-09-13T15:11:44.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.312+0000 7efdda000700 1 -- 172.21.15.50:0/3991779575 wait complete. 2024-09-13T15:11:44.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:11:44.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c79a00700 1 Processor -- start 2024-09-13T15:11:44.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c79a00700 1 -- start start 2024-09-13T15:11:44.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c79a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8c7406d070 0x7f8c741657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c79a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c740b1980 con 0x7f8c74143b70 2024-09-13T15:11:44.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c79a00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c740b2500 con 0x7f8c7406d620 2024-09-13T15:11:44.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c79a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740b1bd0 con 0x7f8c7406d070 2024-09-13T15:11:44.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.512+0000 7f8c73e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c74143b70 0x7f8c740cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35548/0 (socket says 172.21.15.50:35548) 2024-09-13T15:11:44.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c73e00700 1 -- 172.21.15.50:0/2094876516 learned_addr learned my addr 172.21.15.50:0/2094876516 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:44.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c79000700 1 --2- 172.21.15.50:0/2094876516 >> v2:172.21.15.181:3300/0 conn(0x7f8c7406d070 0x7f8c741657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908568057 0 0) 0x7f8c740b2500 con 0x7f8c7406d620 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c580035d0 con 0x7f8c7406d620 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316945781 0 0) 0x7f8c740b1980 con 0x7f8c74143b70 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c740b2500 con 0x7f8c74143b70 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c79000700 1 -- 172.21.15.50:0/2094876516 >> v1:172.21.15.181:6789/0 conn(0x7f8c7406d620 legacy=0x7f8c7406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c79000700 1 -- 172.21.15.50:0/2094876516 >> v1:172.21.15.50:6789/0 conn(0x7f8c74143b70 legacy=0x7f8c740cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c79000700 1 -- 172.21.15.50:0/2094876516 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740b1eb0 con 0x7f8c7406d070 2024-09-13T15:11:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c79000700 1 --2- 172.21.15.50:0/2094876516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d070 0x7f8c741657b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009d90 tx=0x7f8c6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d6d56ab752ea13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00e070 con 0x7f8c7406d070 2024-09-13T15:11:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00bb20 con 0x7f8c7406d070 2024-09-13T15:11:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.516+0000 7f8c72a00700 1 -- 172.21.15.50:0/2094876516 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c012430 con 0x7f8c7406d070 2024-09-13T15:11:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 -- 172.21.15.50:0/2094876516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d070 msgr2=0x7f8c741657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 --2- 172.21.15.50:0/2094876516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d070 0x7f8c741657b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009d90 tx=0x7f8c6c00b330 comp rx=0 tx=0).stop 2024-09-13T15:11:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 -- 172.21.15.50:0/2094876516 shutdown_connections 2024-09-13T15:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 --2- 172.21.15.50:0/2094876516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d070 0x7f8c741657b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 -- 172.21.15.50:0/2094876516 >> 172.21.15.50:0/2094876516 conn(0x7f8c7406a390 msgr2=0x7f8c7406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 -- 172.21.15.50:0/2094876516 shutdown_connections 2024-09-13T15:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 -- 172.21.15.50:0/2094876516 wait complete. 2024-09-13T15:11:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 Processor -- start 2024-09-13T15:11:44.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.520+0000 7f8c79a00700 1 -- start start 2024-09-13T15:11:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 0x7f8c7415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d620 0x7f8c7413e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c74143b70 0x7f8c741419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c74141f30 con 0x7f8c7406d070 2024-09-13T15:11:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c74156c90 con 0x7f8c7406d620 2024-09-13T15:11:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c741596e0 con 0x7f8c74143b70 2024-09-13T15:11:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 0x7f8c7415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 0x7f8c7415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60422/0 (socket says 172.21.15.50:60422) 2024-09-13T15:11:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 -- 172.21.15.50:0/1211551681 learned_addr learned my addr 172.21.15.50:0/1211551681 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73400700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d620 0x7f8c7413e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79000700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c74143b70 0x7f8c741419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 -- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c74143b70 msgr2=0x7f8c741419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c74143b70 0x7f8c741419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 -- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d620 msgr2=0x7f8c7413e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d620 0x7f8c7413e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 -- 172.21.15.50:0/1211551681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c009a70 con 0x7f8c7406d070 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79000700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c74143b70 0x7f8c741419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c73e00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 0x7f8c7415cc20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c4d0 tx=0x7f8c6400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64005d90 con 0x7f8c7406d070 2024-09-13T15:11:44.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c640070d0 con 0x7f8c7406d070 2024-09-13T15:11:44.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c741599c0 con 0x7f8c7406d070 2024-09-13T15:11:44.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64007440 con 0x7f8c7406d070 2024-09-13T15:11:44.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.524+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7413f570 con 0x7f8c7406d070 2024-09-13T15:11:44.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.528+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7415a620 con 0x7f8c7406d070 2024-09-13T15:11:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.528+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c640075a0 con 0x7f8c7406d070 2024-09-13T15:11:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.532+0000 7f8c6be00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c54066730 0x7f8c54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.532+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c640835f0 con 0x7f8c7406d070 2024-09-13T15:11:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.532+0000 7f8c73400700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c54066730 0x7f8c54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.532+0000 7f8c73400700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c54066730 0x7f8c54068bf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8c7415c450 tx=0x7f8c60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.536+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c7415a620 con 0x7f8c7406d070 2024-09-13T15:11:44.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.724+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c7415a620 con 0x7f8c7406d070 2024-09-13T15:11:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c6be00700 1 -- 172.21.15.50:0/1211551681 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c64017020 con 0x7f8c7406d070 2024-09-13T15:11:44.731 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:11:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c54066730 msgr2=0x7f8c54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c54066730 0x7f8c54068bf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8c7415c450 tx=0x7f8c60009040 comp rx=0 tx=0).stop 2024-09-13T15:11:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 msgr2=0x7f8c7415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 0x7f8c7415cc20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c4d0 tx=0x7f8c6400c7e0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 shutdown_connections 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8c54066730 0x7f8c54068bf0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8c74143b70 0x7f8c741419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c7406d620 0x7f8c7413e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 --2- 172.21.15.50:0/1211551681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c7406d070 0x7f8c7415cc20 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 >> 172.21.15.50:0/1211551681 conn(0x7f8c7406a390 msgr2=0x7f8c740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 shutdown_connections 2024-09-13T15:11:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.728+0000 7f8c79a00700 1 -- 172.21.15.50:0/1211551681 wait complete. 2024-09-13T15:11:44.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.932+0000 7f79ece00700 1 Processor -- start 2024-09-13T15:11:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.932+0000 7f79ece00700 1 -- start start 2024-09-13T15:11:44.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79ece00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 0x7f79e80cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79ece00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79e80cc650 0x7f79e80d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79ece00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b4d10 con 0x7f79e81446c0 2024-09-13T15:11:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79ece00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80b3eb0 con 0x7f79e80cc650 2024-09-13T15:11:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79ece00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8144aa0 con 0x7f79e80b3a70 2024-09-13T15:11:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 0x7f79e80cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e6800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79e80cc650 0x7f79e80d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 0x7f79e80cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:48304/0 (socket says 172.21.15.50:48304) 2024-09-13T15:11:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 -- 172.21.15.50:0/2993053510 learned_addr learned my addr 172.21.15.50:0/2993053510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 -- 172.21.15.50:0/2993053510 >> v2:172.21.15.181:3300/0 conn(0x7f79e80cc650 msgr2=0x7f79e80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 --2- 172.21.15.50:0/2993053510 >> v2:172.21.15.181:3300/0 conn(0x7f79e80cc650 0x7f79e80d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 -- 172.21.15.50:0/2993053510 >> v1:172.21.15.181:6789/0 conn(0x7f79e81446c0 legacy=0x7f79e80cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.936+0000 7f79e5400700 1 -- 172.21.15.50:0/2993053510 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80b4100 con 0x7f79e80b3a70 2024-09-13T15:11:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79e5400700 1 --2- 172.21.15.50:0/2993053510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 0x7f79e80cc110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009910 tx=0x7f79d4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d3da42b5edcbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79e4a00700 1 -- 172.21.15.50:0/2993053510 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4011830 con 0x7f79e80b3a70 2024-09-13T15:11:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79e4a00700 1 -- 172.21.15.50:0/2993053510 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d4011990 con 0x7f79e80b3a70 2024-09-13T15:11:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79e4a00700 1 -- 172.21.15.50:0/2993053510 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4011d40 con 0x7f79e80b3a70 2024-09-13T15:11:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 -- 172.21.15.50:0/2993053510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 msgr2=0x7f79e80cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 --2- 172.21.15.50:0/2993053510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 0x7f79e80cc110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009910 tx=0x7f79d4009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 -- 172.21.15.50:0/2993053510 shutdown_connections 2024-09-13T15:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 --2- 172.21.15.50:0/2993053510 >> v2:172.21.15.181:3300/0 conn(0x7f79e80cc650 0x7f79e80d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 --2- 172.21.15.50:0/2993053510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80b3a70 0x7f79e80cc110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 -- 172.21.15.50:0/2993053510 >> 172.21.15.50:0/2993053510 conn(0x7f79e80726d0 msgr2=0x7f79e806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 -- 172.21.15.50:0/2993053510 shutdown_connections 2024-09-13T15:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 -- 172.21.15.50:0/2993053510 wait complete. 2024-09-13T15:11:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.940+0000 7f79ece00700 1 Processor -- start 2024-09-13T15:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 -- start start 2024-09-13T15:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 0x7f79e813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80cc650 0x7f79e81f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e81446c0 0x7f79e8140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e813c2c0 con 0x7f79e80b3a70 2024-09-13T15:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e813c5a0 con 0x7f79e81446c0 2024-09-13T15:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e813c880 con 0x7f79e80cc650 2024-09-13T15:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 0x7f79e813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 0x7f79e813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60430/0 (socket says 172.21.15.50:60430) 2024-09-13T15:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 -- 172.21.15.50:0/1033557792 learned_addr learned my addr 172.21.15.50:0/1033557792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5400700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80cc650 0x7f79e81f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e6800700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e81446c0 0x7f79e8140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 -- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80cc650 msgr2=0x7f79e81f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80cc650 0x7f79e81f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 -- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e81446c0 msgr2=0x7f79e8140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e81446c0 0x7f79e8140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 -- 172.21.15.50:0/1033557792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4009570 con 0x7f79e80b3a70 2024-09-13T15:11:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e6800700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e81446c0 0x7f79e8140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79e5e00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 0x7f79e813bce0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c410 tx=0x7f79d800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d80052d0 con 0x7f79e80b3a70 2024-09-13T15:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8005430 con 0x7f79e80b3a70 2024-09-13T15:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e813cb60 con 0x7f79e80b3a70 2024-09-13T15:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d80055a0 con 0x7f79e80b3a70 2024-09-13T15:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.944+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e8141160 con 0x7f79e80b3a70 2024-09-13T15:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.948+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e80cc110 con 0x7f79e80b3a70 2024-09-13T15:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.948+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79d80036a0 con 0x7f79e80b3a70 2024-09-13T15:11:44.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.952+0000 7f79de000700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79c8066730 0x7f79c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:44.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.952+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f79d8083500 con 0x7f79e80b3a70 2024-09-13T15:11:44.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.952+0000 7f79e5400700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79c8066730 0x7f79c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:44.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.952+0000 7f79e5400700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79c8066730 0x7f79c8068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009910 tx=0x7f79d4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:44.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:44.956+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79d8050690 con 0x7f79e80b3a70 2024-09-13T15:11:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.188+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79e8067730 con 0x7f79e80b3a70 2024-09-13T15:11:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79de000700 1 -- 172.21.15.50:0/1033557792 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f79d8053cb0 con 0x7f79e80b3a70 2024-09-13T15:11:45.195 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:45.195 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79c8066730 msgr2=0x7f79c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79c8066730 0x7f79c8068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009910 tx=0x7f79d4008030 comp rx=0 tx=0).stop 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 msgr2=0x7f79e813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 0x7f79e813bce0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c410 tx=0x7f79d800c720 comp rx=0 tx=0).stop 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 shutdown_connections 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79c8066730 0x7f79c8068bf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e81446c0 0x7f79e8140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e80cc650 0x7f79e81f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 --2- 172.21.15.50:0/1033557792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80b3a70 0x7f79e813bce0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 >> 172.21.15.50:0/1033557792 conn(0x7f79e80726d0 msgr2=0x7f79e80b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.192+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 shutdown_connections 2024-09-13T15:11:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.196+0000 7f79ece00700 1 -- 172.21.15.50:0/1033557792 wait complete. 2024-09-13T15:11:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:45.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.412+0000 7ffa2e200700 1 Processor -- start 2024-09-13T15:11:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.412+0000 7ffa2e200700 1 -- start start 2024-09-13T15:11:45.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa2e200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa28146620 0x7ffa2806a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa2e200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffa280b4cf0 0x7ffa2806ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa2e200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa2806b350 0x7ffa2806f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa2e200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2806b780 con 0x7ffa2806b350 2024-09-13T15:11:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa2e200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280b5240 con 0x7ffa280b4cf0 2024-09-13T15:11:45.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa2e200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b5520 con 0x7ffa28146620 2024-09-13T15:11:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa27e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa2806b350 0x7ffa2806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa26a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffa280b4cf0 0x7ffa2806ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa27400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa28146620 0x7ffa2806a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa27e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa2806b350 0x7ffa2806f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60434/0 (socket says 172.21.15.50:60434) 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.416+0000 7ffa27e00700 1 -- 172.21.15.50:0/1149968938 learned_addr learned my addr 172.21.15.50:0/1149968938 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26a00700 1 -- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa28146620 msgr2=0x7ffa2806a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26a00700 1 --2- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa28146620 0x7ffa2806a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26a00700 1 -- 172.21.15.50:0/1149968938 >> v2:172.21.15.50:3300/0 conn(0x7ffa2806b350 msgr2=0x7ffa2806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26a00700 1 --2- 172.21.15.50:0/1149968938 >> v2:172.21.15.50:3300/0 conn(0x7ffa2806b350 0x7ffa2806f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26a00700 1 -- 172.21.15.50:0/1149968938 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280b5800 con 0x7ffa280b4cf0 2024-09-13T15:11:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26a00700 1 --2- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa280b4cf0 0x7ffa2806ae10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffa28070a70 tx=0x7ffa14009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3824baad065c9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26000700 1 -- 172.21.15.50:0/1149968938 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14011830 con 0x7ffa280b4cf0 2024-09-13T15:11:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26000700 1 -- 172.21.15.50:0/1149968938 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa14011990 con 0x7ffa280b4cf0 2024-09-13T15:11:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa26000700 1 -- 172.21.15.50:0/1149968938 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14011d20 con 0x7ffa280b4cf0 2024-09-13T15:11:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 -- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa280b4cf0 msgr2=0x7ffa2806ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa280b4cf0 0x7ffa2806ae10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffa28070a70 tx=0x7ffa14009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 -- 172.21.15.50:0/1149968938 shutdown_connections 2024-09-13T15:11:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1149968938 >> v2:172.21.15.50:3300/0 conn(0x7ffa2806b350 0x7ffa2806f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa280b4cf0 0x7ffa2806ae10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1149968938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa28146620 0x7ffa2806a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 -- 172.21.15.50:0/1149968938 >> 172.21.15.50:0/1149968938 conn(0x7ffa2806e660 msgr2=0x7ffa2806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 -- 172.21.15.50:0/1149968938 shutdown_connections 2024-09-13T15:11:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.420+0000 7ffa2e200700 1 -- 172.21.15.50:0/1149968938 wait complete. 2024-09-13T15:11:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 Processor -- start 2024-09-13T15:11:45.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 -- start start 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 0x7ffa280a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa280b4cf0 0x7ffa2814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa28146620 0x7ffa28150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28150690 con 0x7ffa2806b350 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa281567d0 con 0x7ffa28146620 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa2e200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280a8b80 con 0x7ffa280b4cf0 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 0x7ffa280a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 0x7ffa280a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60444/0 (socket says 172.21.15.50:60444) 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 -- 172.21.15.50:0/1168724854 learned_addr learned my addr 172.21.15.50:0/1168724854 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:45.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa26a00700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa280b4cf0 0x7ffa2814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27e00700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa28146620 0x7ffa28150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 -- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa280b4cf0 msgr2=0x7ffa2814fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa280b4cf0 0x7ffa2814fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 -- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa28146620 msgr2=0x7ffa28150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa28146620 0x7ffa28150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27400700 1 -- 172.21.15.50:0/1168724854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140094b0 con 0x7ffa2806b350 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.424+0000 7ffa27e00700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa28146620 0x7ffa28150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:45.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa27400700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 0x7ffa280a8480 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800e870 tx=0x7ffa1800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180095a0 con 0x7ffa2806b350 2024-09-13T15:11:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800ee70 con 0x7ffa2806b350 2024-09-13T15:11:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800ca50 con 0x7ffa2806b350 2024-09-13T15:11:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280cf020 con 0x7ffa2806b350 2024-09-13T15:11:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa280cf5e0 con 0x7ffa2806b350 2024-09-13T15:11:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2806a8e0 con 0x7ffa2806b350 2024-09-13T15:11:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.428+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa1800cbb0 con 0x7ffa2806b350 2024-09-13T15:11:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.432+0000 7ffa1f400700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa08066730 0x7ffa08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.432+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ffa180841a0 con 0x7ffa2806b350 2024-09-13T15:11:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.432+0000 7ffa26a00700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa08066730 0x7ffa08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.432+0000 7ffa26a00700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa08066730 0x7ffa08068bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa14000c00 tx=0x7ffa14008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:45.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.440+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa180513c0 con 0x7ffa2806b350 2024-09-13T15:11:45.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.628+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa2806a390 con 0x7ffa2806b350 2024-09-13T15:11:45.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.632+0000 7ffa1f400700 1 -- 172.21.15.50:0/1168724854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16705 (secure 0 0 0) 0x7ffa180549e0 con 0x7ffa2806b350 2024-09-13T15:11:45.636 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:45.637 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:28.631014+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa08066730 msgr2=0x7ffa08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa08066730 0x7ffa08068bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa14000c00 tx=0x7ffa14008030 comp rx=0 tx=0).stop 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 msgr2=0x7ffa280a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 0x7ffa280a8480 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800e870 tx=0x7ffa1800ec30 comp rx=0 tx=0).stop 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 shutdown_connections 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa08066730 0x7ffa08068bf0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa28146620 0x7ffa28150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa280b4cf0 0x7ffa2814fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 --2- 172.21.15.50:0/1168724854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa2806b350 0x7ffa280a8480 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 >> 172.21.15.50:0/1168724854 conn(0x7ffa2806e660 msgr2=0x7ffa280cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 shutdown_connections 2024-09-13T15:11:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.636+0000 7ffa2e200700 1 -- 172.21.15.50:0/1168724854 wait complete. 2024-09-13T15:11:45.662 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:11:45.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.828+0000 7ff147000700 1 Processor -- start 2024-09-13T15:11:45.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.828+0000 7ff147000700 1 -- start start 2024-09-13T15:11:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff147000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1400b2d80 0x7ff14006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff147000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400b3560 con 0x7ff14006aaa0 2024-09-13T15:11:45.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff147000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400b3280 con 0x7ff1401610b0 2024-09-13T15:11:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff147000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff140070b30 con 0x7ff1400b2d80 2024-09-13T15:11:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff145c00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff1401610b0 0x7ff1400719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:60040/0 (socket says 172.21.15.50:60040) 2024-09-13T15:11:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff145c00700 1 -- 172.21.15.50:0/69001255 learned_addr learned my addr 172.21.15.50:0/69001255 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff145200700 1 --1- 172.21.15.50:0/69001255 >> v1:172.21.15.50:6789/0 conn(0x7ff14006aaa0 0x7ff1400b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35554/0 (socket says 172.21.15.50:35554) 2024-09-13T15:11:45.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff146600700 1 --2- 172.21.15.50:0/69001255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1400b2d80 0x7ff14006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff13fe00700 1 -- 172.21.15.50:0/69001255 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492212227 0 0) 0x7ff1400b3280 con 0x7ff1401610b0 2024-09-13T15:11:45.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff13fe00700 1 -- 172.21.15.50:0/69001255 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1240035d0 con 0x7ff1401610b0 2024-09-13T15:11:45.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff146600700 1 -- 172.21.15.50:0/69001255 >> v1:172.21.15.181:6789/0 conn(0x7ff1401610b0 legacy=0x7ff1400719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff146600700 1 -- 172.21.15.50:0/69001255 >> v1:172.21.15.50:6789/0 conn(0x7ff14006aaa0 legacy=0x7ff1400b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff13fe00700 1 -- 172.21.15.50:0/69001255 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736980341 0 0) 0x7ff1400b3560 con 0x7ff14006aaa0 2024-09-13T15:11:45.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff146600700 1 -- 172.21.15.50:0/69001255 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff140070ee0 con 0x7ff1400b2d80 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff146600700 1 --2- 172.21.15.50:0/69001255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1400b2d80 0x7ff14006af10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff138009df0 tx=0x7ff13800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89978a6ad1a4daf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff13fe00700 1 -- 172.21.15.50:0/69001255 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800e070 con 0x7ff1400b2d80 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff13fe00700 1 -- 172.21.15.50:0/69001255 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800bae0 con 0x7ff1400b2d80 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.832+0000 7ff13fe00700 1 -- 172.21.15.50:0/69001255 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800be90 con 0x7ff1400b2d80 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 -- 172.21.15.50:0/69001255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1400b2d80 msgr2=0x7ff14006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 --2- 172.21.15.50:0/69001255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1400b2d80 0x7ff14006af10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff138009df0 tx=0x7ff13800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 -- 172.21.15.50:0/69001255 shutdown_connections 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 --2- 172.21.15.50:0/69001255 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1400b2d80 0x7ff14006af10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 -- 172.21.15.50:0/69001255 >> 172.21.15.50:0/69001255 conn(0x7ff1400b0c40 msgr2=0x7ff14006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 -- 172.21.15.50:0/69001255 shutdown_connections 2024-09-13T15:11:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 -- 172.21.15.50:0/69001255 wait complete. 2024-09-13T15:11:45.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 Processor -- start 2024-09-13T15:11:45.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.836+0000 7ff147000700 1 -- start start 2024-09-13T15:11:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 0x7ff1400cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1400b2d80 0x7ff140151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1401610b0 0x7ff140151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400acc20 con 0x7ff14006aaa0 2024-09-13T15:11:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400acf00 con 0x7ff1400b2d80 2024-09-13T15:11:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400ad1e0 con 0x7ff1401610b0 2024-09-13T15:11:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 0x7ff1400cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 0x7ff1400cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60452/0 (socket says 172.21.15.50:60452) 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 -- 172.21.15.50:0/4257396461 learned_addr learned my addr 172.21.15.50:0/4257396461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff146600700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1401610b0 0x7ff140151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145200700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1400b2d80 0x7ff140151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 -- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1401610b0 msgr2=0x7ff140151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1401610b0 0x7ff140151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 -- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1400b2d80 msgr2=0x7ff140151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1400b2d80 0x7ff140151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 -- 172.21.15.50:0/4257396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009a70 con 0x7ff14006aaa0 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff145c00700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 0x7ff1400cd600 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c4d0 tx=0x7ff13000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130005d90 con 0x7ff14006aaa0 2024-09-13T15:11:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1300070d0 con 0x7ff14006aaa0 2024-09-13T15:11:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400ad4c0 con 0x7ff14006aaa0 2024-09-13T15:11:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130007480 con 0x7ff14006aaa0 2024-09-13T15:11:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.840+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1400cdd20 con 0x7ff14006aaa0 2024-09-13T15:11:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.844+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14006af10 con 0x7ff14006aaa0 2024-09-13T15:11:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.844+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1300075e0 con 0x7ff14006aaa0 2024-09-13T15:11:45.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.844+0000 7ff13d600700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff120066730 0x7ff120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:45.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.844+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff130083680 con 0x7ff14006aaa0 2024-09-13T15:11:45.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.844+0000 7ff145200700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff120066730 0x7ff120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:45.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.848+0000 7ff145200700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff120066730 0x7ff120068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff140164320 tx=0x7ff12c007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:45.852+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1300508a0 con 0x7ff14006aaa0 2024-09-13T15:11:46.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.080+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1400cdd20 con 0x7ff14006aaa0 2024-09-13T15:11:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.080+0000 7ff13d600700 1 -- 172.21.15.50:0/4257396461 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7ff130053ec0 con 0x7ff14006aaa0 2024-09-13T15:11:46.084 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:46.085 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff120066730 msgr2=0x7ff120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff120066730 0x7ff120068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff140164320 tx=0x7ff12c007c00 comp rx=0 tx=0).stop 2024-09-13T15:11:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 msgr2=0x7ff1400cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 0x7ff1400cd600 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c4d0 tx=0x7ff13000c890 comp rx=0 tx=0).stop 2024-09-13T15:11:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 shutdown_connections 2024-09-13T15:11:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff120066730 0x7ff120068bf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1401610b0 0x7ff140151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1400b2d80 0x7ff140151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 --2- 172.21.15.50:0/4257396461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14006aaa0 0x7ff1400cd600 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 >> 172.21.15.50:0/4257396461 conn(0x7ff1400b0c40 msgr2=0x7ff1401600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 shutdown_connections 2024-09-13T15:11:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.084+0000 7ff147000700 1 -- 172.21.15.50:0/4257396461 wait complete. 2024-09-13T15:11:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:46.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bf200700 1 Processor -- start 2024-09-13T15:11:46.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bf200700 1 -- start start 2024-09-13T15:11:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bf200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f12c006aaa0 0x7f12c006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bf200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c00ccb40 con 0x7f12c00cc6f0 2024-09-13T15:11:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bf200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c006b430 con 0x7f12c00cb020 2024-09-13T15:11:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bf200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c00b2ad0 con 0x7f12c006aaa0 2024-09-13T15:11:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bd400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f12c00cc6f0 0x7f12c015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35562/0 (socket says 172.21.15.50:35562) 2024-09-13T15:11:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bd400700 1 -- 172.21.15.50:0/2903256727 learned_addr learned my addr 172.21.15.50:0/2903256727 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12be800700 1 --2- 172.21.15.50:0/2903256727 >> v2:172.21.15.181:3300/0 conn(0x7f12c006aaa0 0x7f12c006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.284+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039993974 0 0) 0x7f12c00ccb40 con 0x7f12c00cc6f0 2024-09-13T15:11:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a40035d0 con 0x7f12c00cc6f0 2024-09-13T15:11:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102083971 0 0) 0x7f12b0001110 con 0x7f12c00cb020 2024-09-13T15:11:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c00ccb40 con 0x7f12c00cb020 2024-09-13T15:11:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12be800700 1 -- 172.21.15.50:0/2903256727 >> v1:172.21.15.181:6789/0 conn(0x7f12c00cb020 legacy=0x7f12c015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12be800700 1 -- 172.21.15.50:0/2903256727 >> v1:172.21.15.50:6789/0 conn(0x7f12c00cc6f0 legacy=0x7f12c015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12be800700 1 -- 172.21.15.50:0/2903256727 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c015b960 con 0x7f12c006aaa0 2024-09-13T15:11:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12be800700 1 --2- 172.21.15.50:0/2903256727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c006aaa0 0x7f12c006aef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009d90 tx=0x7f12b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5653335987550384 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800e070 con 0x7f12c006aaa0 2024-09-13T15:11:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800bb20 con 0x7f12c006aaa0 2024-09-13T15:11:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bca00700 1 -- 172.21.15.50:0/2903256727 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8012430 con 0x7f12c006aaa0 2024-09-13T15:11:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 -- 172.21.15.50:0/2903256727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c006aaa0 msgr2=0x7f12c006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 --2- 172.21.15.50:0/2903256727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c006aaa0 0x7f12c006aef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009d90 tx=0x7f12b800b330 comp rx=0 tx=0).stop 2024-09-13T15:11:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 -- 172.21.15.50:0/2903256727 shutdown_connections 2024-09-13T15:11:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 --2- 172.21.15.50:0/2903256727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c006aaa0 0x7f12c006aef0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 -- 172.21.15.50:0/2903256727 >> 172.21.15.50:0/2903256727 conn(0x7f12c00b0c40 msgr2=0x7f12c006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 -- 172.21.15.50:0/2903256727 shutdown_connections 2024-09-13T15:11:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.288+0000 7f12bf200700 1 -- 172.21.15.50:0/2903256727 wait complete. 2024-09-13T15:11:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.292+0000 7f12bf200700 1 Processor -- start 2024-09-13T15:11:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.292+0000 7f12bf200700 1 -- start start 2024-09-13T15:11:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bf200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12c006aaa0 0x7f12c014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bf200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 0x7f12c00705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bf200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c00cc6f0 0x7f12c0157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bf200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0071de0 con 0x7f12c00cb020 2024-09-13T15:11:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bf200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00ca450 con 0x7f12c00cc6f0 2024-09-13T15:11:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bf200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00ca730 con 0x7f12c006aaa0 2024-09-13T15:11:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 0x7f12c00705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 0x7f12c00705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60454/0 (socket says 172.21.15.50:60454) 2024-09-13T15:11:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bd400700 1 -- 172.21.15.50:0/233049188 learned_addr learned my addr 172.21.15.50:0/233049188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c00cc6f0 0x7f12c0157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bde00700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12c006aaa0 0x7f12c014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 -- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12c006aaa0 msgr2=0x7f12c014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12c006aaa0 0x7f12c014b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 -- 172.21.15.50:0/233049188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 msgr2=0x7f12c00705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 0x7f12c00705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 -- 172.21.15.50:0/233049188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009a70 con 0x7f12c00cc6f0 2024-09-13T15:11:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12bd400700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 0x7f12c00705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.296+0000 7f12be800700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c00cc6f0 0x7f12c0157630 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f12b8016000 tx=0x7f12b8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.300+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8012430 con 0x7f12c00cc6f0 2024-09-13T15:11:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.300+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8020070 con 0x7f12c00cc6f0 2024-09-13T15:11:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.300+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c006fde0 con 0x7f12c00cc6f0 2024-09-13T15:11:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.300+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b801ba90 con 0x7f12c00cc6f0 2024-09-13T15:11:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.300+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c014b5b0 con 0x7f12c00cc6f0 2024-09-13T15:11:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.300+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c0070300 con 0x7f12c00cc6f0 2024-09-13T15:11:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.304+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12b801bbf0 con 0x7f12c00cc6f0 2024-09-13T15:11:46.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.304+0000 7f12b6000700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12a0066800 0x7f12a0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.304+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12b8022070 con 0x7f12c00cc6f0 2024-09-13T15:11:46.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.304+0000 7f12bde00700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12a0066800 0x7f12a0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.308+0000 7f12bde00700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12a0066800 0x7f12a0068cc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f12b0001370 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:46.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.312+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12b8053760 con 0x7f12c00cc6f0 2024-09-13T15:11:46.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.552+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12c0070300 con 0x7f12c00cc6f0 2024-09-13T15:11:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.552+0000 7f12b6000700 1 -- 172.21.15.50:0/233049188 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f12c0070300 con 0x7f12c00cc6f0 2024-09-13T15:11:46.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:46.556 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:11:27.626965+0000","modified":"2024-09-13T15:11:30.646818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6954},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6954":{"gid":6954,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2602636353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2602636353},{"type":"v1","addr":"172.21.15.50:6835","nonce":2602636353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12a0066800 msgr2=0x7f12a0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12a0066800 0x7f12a0068cc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f12b0001370 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c00cc6f0 msgr2=0x7f12c0157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c00cc6f0 0x7f12c0157630 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f12b8016000 tx=0x7f12b8004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 shutdown_connections 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12a0066800 0x7f12a0068cc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12c00cc6f0 0x7f12c0157630 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c00cb020 0x7f12c00705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 --2- 172.21.15.50:0/233049188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f12c006aaa0 0x7f12c014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 >> 172.21.15.50:0/233049188 conn(0x7f12c00b0c40 msgr2=0x7f12c0159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 shutdown_connections 2024-09-13T15:11:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.556+0000 7f12bf200700 1 -- 172.21.15.50:0/233049188 wait complete. 2024-09-13T15:11:46.561 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 46 2024-09-13T15:11:46.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:46.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.748+0000 7fe469200700 1 Processor -- start 2024-09-13T15:11:46.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.748+0000 7fe469200700 1 -- start start 2024-09-13T15:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe469200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4641610b0 0x7fe4640719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe469200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4640b2d80 0x7fe46406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe469200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4640b3560 con 0x7fe46406aaa0 2024-09-13T15:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe469200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe464070b30 con 0x7fe4641610b0 2024-09-13T15:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe469200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46406b450 con 0x7fe4640b2d80 2024-09-13T15:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe45aa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe46406aaa0 0x7fe4640b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35570/0 (socket says 172.21.15.50:35570) 2024-09-13T15:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe45aa00700 1 -- 172.21.15.50:0/1111222989 learned_addr learned my addr 172.21.15.50:0/1111222989 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe463400700 1 --2- 172.21.15.50:0/1111222989 >> v2:172.21.15.50:3300/0 conn(0x7fe4641610b0 0x7fe4640719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe463e00700 1 --2- 172.21.15.50:0/1111222989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4640b2d80 0x7fe46406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe462a00700 1 -- 172.21.15.50:0/1111222989 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074885112 0 0) 0x7fe4640b3560 con 0x7fe46406aaa0 2024-09-13T15:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe462a00700 1 -- 172.21.15.50:0/1111222989 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4480035d0 con 0x7fe46406aaa0 2024-09-13T15:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe463400700 1 -- 172.21.15.50:0/1111222989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4640b2d80 msgr2=0x7fe46406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe463400700 1 --2- 172.21.15.50:0/1111222989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4640b2d80 0x7fe46406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe463400700 1 -- 172.21.15.50:0/1111222989 >> v1:172.21.15.50:6789/0 conn(0x7fe46406aaa0 legacy=0x7fe4640b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.752+0000 7fe463400700 1 -- 172.21.15.50:0/1111222989 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640b3280 con 0x7fe4641610b0 2024-09-13T15:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe463400700 1 --2- 172.21.15.50:0/1111222989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4641610b0 0x7fe4640719c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe4540098b0 tx=0x7fe454009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9acbd85f0ed15f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe462a00700 1 -- 172.21.15.50:0/1111222989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454011830 con 0x7fe4641610b0 2024-09-13T15:11:46.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe462a00700 1 -- 172.21.15.50:0/1111222989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe454011990 con 0x7fe4641610b0 2024-09-13T15:11:46.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe462a00700 1 -- 172.21.15.50:0/1111222989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454011d20 con 0x7fe4641610b0 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 -- 172.21.15.50:0/1111222989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4641610b0 msgr2=0x7fe4640719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 --2- 172.21.15.50:0/1111222989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4641610b0 0x7fe4640719c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe4540098b0 tx=0x7fe454009bc0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 -- 172.21.15.50:0/1111222989 shutdown_connections 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 --2- 172.21.15.50:0/1111222989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4640b2d80 0x7fe46406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 --2- 172.21.15.50:0/1111222989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4641610b0 0x7fe4640719c0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 -- 172.21.15.50:0/1111222989 >> 172.21.15.50:0/1111222989 conn(0x7fe4640b0c40 msgr2=0x7fe46406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 -- 172.21.15.50:0/1111222989 shutdown_connections 2024-09-13T15:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.756+0000 7fe469200700 1 -- 172.21.15.50:0/1111222989 wait complete. 2024-09-13T15:11:46.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 Processor -- start 2024-09-13T15:11:46.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 -- start start 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 0x7fe46414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4640b2d80 0x7fe4641620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4641610b0 0x7fe46415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe464163130 con 0x7fe46406aaa0 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641f8010 con 0x7fe4640b2d80 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe469200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe464162b70 con 0x7fe4641610b0 2024-09-13T15:11:46.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe463400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 0x7fe46414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe463400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 0x7fe46414eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60474/0 (socket says 172.21.15.50:60474) 2024-09-13T15:11:46.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe463400700 1 -- 172.21.15.50:0/788248687 learned_addr learned my addr 172.21.15.50:0/788248687 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:46.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.760+0000 7fe463e00700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4641610b0 0x7fe46415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe45aa00700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4640b2d80 0x7fe4641620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe463400700 1 -- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4641610b0 msgr2=0x7fe46415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe463400700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4641610b0 0x7fe46415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe463400700 1 -- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4640b2d80 msgr2=0x7fe4641620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe463400700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4640b2d80 0x7fe4641620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe463400700 1 -- 172.21.15.50:0/788248687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4540094b0 con 0x7fe46406aaa0 2024-09-13T15:11:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe463400700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 0x7fe46414eb60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe454009c00 tx=0x7fe454004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:46.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540045d0 con 0x7fe46406aaa0 2024-09-13T15:11:46.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45401e070 con 0x7fe46406aaa0 2024-09-13T15:11:46.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540038c0 con 0x7fe46406aaa0 2024-09-13T15:11:46.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe464162e50 con 0x7fe46406aaa0 2024-09-13T15:11:46.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4641588b0 con 0x7fe46406aaa0 2024-09-13T15:11:46.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.764+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe464158430 con 0x7fe46406aaa0 2024-09-13T15:11:46.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.768+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe454003a20 con 0x7fe46406aaa0 2024-09-13T15:11:46.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.768+0000 7fe45be00700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe440066760 0x7fe440068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:46.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.768+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe454085130 con 0x7fe46406aaa0 2024-09-13T15:11:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.768+0000 7fe45aa00700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe440066760 0x7fe440068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:46.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.768+0000 7fe45aa00700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe440066760 0x7fe440068c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe46415a380 tx=0x7fe44c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:46.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.776+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe464158430 con 0x7fe46406aaa0 2024-09-13T15:11:46.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.968+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe464158430 con 0x7fe46406aaa0 2024-09-13T15:11:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.972+0000 7fe45be00700 1 -- 172.21.15.50:0/788248687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fe464158430 con 0x7fe46406aaa0 2024-09-13T15:11:46.977 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:46.977 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:28.631014+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:25.790116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:26.629791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe440066760 msgr2=0x7fe440068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe440066760 0x7fe440068c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe46415a380 tx=0x7fe44c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 msgr2=0x7fe46414eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 0x7fe46414eb60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe454009c00 tx=0x7fe454004770 comp rx=0 tx=0).stop 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 shutdown_connections 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe440066760 0x7fe440068c20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe4641610b0 0x7fe46415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4640b2d80 0x7fe4641620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 --2- 172.21.15.50:0/788248687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe46406aaa0 0x7fe46414eb60 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 >> 172.21.15.50:0/788248687 conn(0x7fe4640b0c40 msgr2=0x7fe4640af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 shutdown_connections 2024-09-13T15:11:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:46.976+0000 7fe469200700 1 -- 172.21.15.50:0/788248687 wait complete. 2024-09-13T15:11:47.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:11:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.164+0000 7f4d09600700 1 Processor -- start 2024-09-13T15:11:47.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.168+0000 7f4d09600700 1 -- start start 2024-09-13T15:11:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.168+0000 7f4d09600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4d0415cba0 0x7f4d04161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.168+0000 7f4d09600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d04073a90 0x7f4d040cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.168+0000 7f4d09600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d04161780 con 0x7f4d040704c0 2024-09-13T15:11:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.168+0000 7f4d09600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040aca30 con 0x7f4d04073a90 2024-09-13T15:11:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.168+0000 7f4d09600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040acd10 con 0x7f4d0415cba0 2024-09-13T15:11:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d04073a90 0x7f4d040cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d04073a90 0x7f4d040cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60480/0 (socket says 172.21.15.50:60480) 2024-09-13T15:11:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 -- 172.21.15.50:0/3912704812 learned_addr learned my addr 172.21.15.50:0/3912704812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03e00700 1 --2- 172.21.15.50:0/3912704812 >> v2:172.21.15.181:3300/0 conn(0x7f4d0415cba0 0x7f4d04161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 -- 172.21.15.50:0/3912704812 >> v2:172.21.15.181:3300/0 conn(0x7f4d0415cba0 msgr2=0x7f4d04161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 --2- 172.21.15.50:0/3912704812 >> v2:172.21.15.181:3300/0 conn(0x7f4d0415cba0 0x7f4d04161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 -- 172.21.15.50:0/3912704812 >> v1:172.21.15.181:6789/0 conn(0x7f4d040704c0 legacy=0x7f4d0406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 -- 172.21.15.50:0/3912704812 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040ae6f0 con 0x7f4d04073a90 2024-09-13T15:11:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d03400700 1 --2- 172.21.15.50:0/3912704812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d04073a90 0x7f4d040cba80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4d040d0160 tx=0x7f4cf0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d801dc2ee43920a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d02a00700 1 -- 172.21.15.50:0/3912704812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0004230 con 0x7f4d04073a90 2024-09-13T15:11:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d02a00700 1 -- 172.21.15.50:0/3912704812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf0004390 con 0x7f4d04073a90 2024-09-13T15:11:47.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d02a00700 1 -- 172.21.15.50:0/3912704812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00036c0 con 0x7f4d04073a90 2024-09-13T15:11:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d09600700 1 -- 172.21.15.50:0/3912704812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d04073a90 msgr2=0x7f4d040cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d09600700 1 --2- 172.21.15.50:0/3912704812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d04073a90 0x7f4d040cba80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4d040d0160 tx=0x7f4cf0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d09600700 1 -- 172.21.15.50:0/3912704812 shutdown_connections 2024-09-13T15:11:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d09600700 1 --2- 172.21.15.50:0/3912704812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d04073a90 0x7f4d040cba80 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d09600700 1 --2- 172.21.15.50:0/3912704812 >> v2:172.21.15.181:3300/0 conn(0x7f4d0415cba0 0x7f4d04161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.172+0000 7f4d09600700 1 -- 172.21.15.50:0/3912704812 >> 172.21.15.50:0/3912704812 conn(0x7f4d040b0e90 msgr2=0x7f4d040b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.176+0000 7f4d09600700 1 -- 172.21.15.50:0/3912704812 shutdown_connections 2024-09-13T15:11:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.176+0000 7f4d09600700 1 -- 172.21.15.50:0/3912704812 wait complete. 2024-09-13T15:11:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 Processor -- start 2024-09-13T15:11:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 -- start start 2024-09-13T15:11:47.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 0x7f4d04156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d04073a90 0x7f4d04158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d0415cba0 0x7f4d0414bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041f6430 con 0x7f4d040704c0 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041f6710 con 0x7f4d04073a90 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d09600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041f69f0 con 0x7f4d0415cba0 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 0x7f4d04156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 0x7f4d04156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60492/0 (socket says 172.21.15.50:60492) 2024-09-13T15:11:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 -- 172.21.15.50:0/3894801691 learned_addr learned my addr 172.21.15.50:0/3894801691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03400700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d04073a90 0x7f4d04158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d08c00700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d0415cba0 0x7f4d0414bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 -- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d0415cba0 msgr2=0x7f4d0414bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d0415cba0 0x7f4d0414bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 -- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d04073a90 msgr2=0x7f4d04158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d04073a90 0x7f4d04158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 -- 172.21.15.50:0/3894801691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf0009570 con 0x7f4d040704c0 2024-09-13T15:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.180+0000 7f4d03e00700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 0x7f4d04156c10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400d800 tx=0x7f4cf400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.184+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40125f0 con 0x7f4d040704c0 2024-09-13T15:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.184+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d041f6cd0 con 0x7f4d040704c0 2024-09-13T15:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.184+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4012750 con 0x7f4d040704c0 2024-09-13T15:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.184+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4012ac0 con 0x7f4d040704c0 2024-09-13T15:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.184+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d040ceeb0 con 0x7f4d040704c0 2024-09-13T15:11:47.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.184+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d040677c0 con 0x7f4d040704c0 2024-09-13T15:11:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.188+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4cf4012c20 con 0x7f4d040704c0 2024-09-13T15:11:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.188+0000 7f4cfbe00700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4ce4066760 0x7f4ce4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.188+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4cf40842e0 con 0x7f4d040704c0 2024-09-13T15:11:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.188+0000 7f4d03400700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4ce4066760 0x7f4ce4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.188+0000 7f4d03400700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4ce4066760 0x7f4ce4068c20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4d040d0160 tx=0x7f4cf0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:47.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.196+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4cf4051530 con 0x7f4d040704c0 2024-09-13T15:11:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.412+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4d04161240 con 0x7f4d040704c0 2024-09-13T15:11:47.419 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:11:47.416+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:11:47.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.428+0000 7f4cfbe00700 1 -- 172.21.15.50:0/3894801691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4cf4054b50 con 0x7f4d040704c0 2024-09-13T15:11:47.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4ce4066760 msgr2=0x7f4ce4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4ce4066760 0x7f4ce4068c20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4d040d0160 tx=0x7f4cf0008030 comp rx=0 tx=0).stop 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 msgr2=0x7f4d04156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 0x7f4d04156c10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400d800 tx=0x7f4cf400db10 comp rx=0 tx=0).stop 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 shutdown_connections 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4ce4066760 0x7f4ce4068c20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4d0415cba0 0x7f4d0414bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d04073a90 0x7f4d04158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 --2- 172.21.15.50:0/3894801691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d040704c0 0x7f4d04156c10 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 >> 172.21.15.50:0/3894801691 conn(0x7f4d040b0e90 msgr2=0x7f4d04152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 shutdown_connections 2024-09-13T15:11:47.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.432+0000 7f4d09600700 1 -- 172.21.15.50:0/3894801691 wait complete. 2024-09-13T15:11:47.437 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:11:47.440 INFO:tasks.ceph.mds.c.smithi050.stderr: -1986> 2024-09-13T15:11:33.124+0000 7fb10a200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:11:47.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:11:47.500 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:11:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.640+0000 7f352fe00700 1 Processor -- start 2024-09-13T15:11:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.640+0000 7f352fe00700 1 -- start start 2024-09-13T15:11:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35301464c0 0x7f3530071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f35300b1980 0x7f35300b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352fe00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3530070da0 con 0x7f353006c960 2024-09-13T15:11:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352fe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300b2440 con 0x7f35301464c0 2024-09-13T15:11:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352fe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300b2720 con 0x7f35300b1980 2024-09-13T15:11:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35301464c0 0x7f3530071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35301464c0 0x7f3530071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60536/0 (socket says 172.21.15.50:60536) 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 -- 172.21.15.50:0/1824692808 learned_addr learned my addr 172.21.15.50:0/1824692808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352f400700 1 --1- 172.21.15.50:0/1824692808 >> v1:172.21.15.50:6789/0 conn(0x7f353006c960 0x7f35300ac890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35586/0 (socket says 172.21.15.50:35586) 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352e000700 1 --2- 172.21.15.50:0/1824692808 >> v2:172.21.15.181:3300/0 conn(0x7f35300b1980 0x7f35300b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 -- 172.21.15.50:0/1824692808 >> v2:172.21.15.181:3300/0 conn(0x7f35300b1980 msgr2=0x7f35300b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 --2- 172.21.15.50:0/1824692808 >> v2:172.21.15.181:3300/0 conn(0x7f35300b1980 0x7f35300b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 -- 172.21.15.50:0/1824692808 >> v1:172.21.15.50:6789/0 conn(0x7f353006c960 legacy=0x7f35300ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352ea00700 1 -- 172.21.15.50:0/1824692808 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530071060 con 0x7f35301464c0 2024-09-13T15:11:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.644+0000 7f352e000700 1 --2- 172.21.15.50:0/1824692808 >> v2:172.21.15.181:3300/0 conn(0x7f35300b1980 0x7f35300b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352ea00700 1 --2- 172.21.15.50:0/1824692808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35301464c0 0x7f3530071860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f353006dae0 tx=0x7f352000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f170721d54e9ded2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352d600700 1 -- 172.21.15.50:0/1824692808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000e070 con 0x7f35301464c0 2024-09-13T15:11:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352d600700 1 -- 172.21.15.50:0/1824692808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000b9c0 con 0x7f35301464c0 2024-09-13T15:11:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352d600700 1 -- 172.21.15.50:0/1824692808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000bd70 con 0x7f35301464c0 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 -- 172.21.15.50:0/1824692808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35301464c0 msgr2=0x7f3530071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 --2- 172.21.15.50:0/1824692808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35301464c0 0x7f3530071860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f353006dae0 tx=0x7f352000b330 comp rx=0 tx=0).stop 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 -- 172.21.15.50:0/1824692808 shutdown_connections 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 --2- 172.21.15.50:0/1824692808 >> v2:172.21.15.181:3300/0 conn(0x7f35300b1980 0x7f35300b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 --2- 172.21.15.50:0/1824692808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35301464c0 0x7f3530071860 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 -- 172.21.15.50:0/1824692808 >> 172.21.15.50:0/1824692808 conn(0x7f353006a390 msgr2=0x7f353006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 -- 172.21.15.50:0/1824692808 shutdown_connections 2024-09-13T15:11:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.648+0000 7f352fe00700 1 -- 172.21.15.50:0/1824692808 wait complete. 2024-09-13T15:11:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 Processor -- start 2024-09-13T15:11:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 -- start start 2024-09-13T15:11:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353006c960 0x7f353015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 0x7f35300c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35301464c0 0x7f35300c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c7030 con 0x7f35300b1980 2024-09-13T15:11:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353015f9e0 con 0x7f353006c960 2024-09-13T15:11:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c4090 con 0x7f35301464c0 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 0x7f35300c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 0x7f35300c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60542/0 (socket says 172.21.15.50:60542) 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 -- 172.21.15.50:0/3306580832 learned_addr learned my addr 172.21.15.50:0/3306580832 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352ea00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353006c960 0x7f353015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352f400700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35301464c0 0x7f35300c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 -- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35301464c0 msgr2=0x7f35300c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35301464c0 0x7f35300c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 -- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353006c960 msgr2=0x7f353015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353006c960 0x7f353015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 -- 172.21.15.50:0/3306580832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009b30 con 0x7f35300b1980 2024-09-13T15:11:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352ea00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353006c960 0x7f353015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352e000700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 0x7f35300c3b50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f351c00e810 tx=0x7f351c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c013610 con 0x7f35300b1980 2024-09-13T15:11:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c013770 con 0x7f35300b1980 2024-09-13T15:11:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35300c42c0 con 0x7f35300b1980 2024-09-13T15:11:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c013b00 con 0x7f35300b1980 2024-09-13T15:11:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.652+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35300c4880 con 0x7f35300b1980 2024-09-13T15:11:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.656+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353006b0a0 con 0x7f35300b1980 2024-09-13T15:11:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.656+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f351c013c60 con 0x7f35300b1980 2024-09-13T15:11:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.656+0000 7f3526a00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3510066730 0x7f3510068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.660+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f351c084070 con 0x7f35300b1980 2024-09-13T15:11:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.660+0000 7f352ea00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3510066730 0x7f3510068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:47.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.660+0000 7f352ea00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3510066730 0x7f3510068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3520000f80 tx=0x7f3520009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.664+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f351c0b5db0 con 0x7f35300b1980 2024-09-13T15:11:47.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:47.880+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35300b1df0 con 0x7f35300b1980 2024-09-13T15:11:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.436+0000 7f3526a00700 1 -- 172.21.15.50:0/3306580832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f351c051120 con 0x7f35300b1980 2024-09-13T15:11:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3510066730 msgr2=0x7f3510068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3510066730 0x7f3510068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3520000f80 tx=0x7f3520009000 comp rx=0 tx=0).stop 2024-09-13T15:11:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 msgr2=0x7f35300c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 0x7f35300c3b50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f351c00e810 tx=0x7f351c00ebd0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 shutdown_connections 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3510066730 0x7f3510068bf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f35301464c0 0x7f35300c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35300b1980 0x7f35300c3b50 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 --2- 172.21.15.50:0/3306580832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f353006c960 0x7f353015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 >> 172.21.15.50:0/3306580832 conn(0x7f353006a390 msgr2=0x7f353006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 shutdown_connections 2024-09-13T15:11:48.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.440+0000 7f352fe00700 1 -- 172.21.15.50:0/3306580832 wait complete. 2024-09-13T15:11:48.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:11:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.696+0000 7f54bce00700 1 Processor -- start 2024-09-13T15:11:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.696+0000 7f54bce00700 1 -- start start 2024-09-13T15:11:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54bce00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54b81586a0 0x7f54b806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54bce00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b806d920 con 0x7f54b80ccb20 2024-09-13T15:11:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54bce00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80b1300 con 0x7f54b80cc6f0 2024-09-13T15:11:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54bce00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b8070170 con 0x7f54b81586a0 2024-09-13T15:11:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54b81586a0 0x7f54b806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54b81586a0 0x7f54b806fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60556/0 (socket says 172.21.15.50:60556) 2024-09-13T15:11:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 -- 172.21.15.50:0/2430768785 learned_addr learned my addr 172.21.15.50:0/2430768785 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 -- 172.21.15.50:0/2430768785 >> v1:172.21.15.181:6789/0 conn(0x7f54b80cc6f0 legacy=0x7f54b806c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 -- 172.21.15.50:0/2430768785 >> v1:172.21.15.50:6789/0 conn(0x7f54b80ccb20 legacy=0x7f54b815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 -- 172.21.15.50:0/2430768785 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b806db90 con 0x7f54b81586a0 2024-09-13T15:11:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b7400700 1 --2- 172.21.15.50:0/2430768785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b81586a0 0x7f54b806fc30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009910 tx=0x7f54a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823878968a0a301f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b6a00700 1 -- 172.21.15.50:0/2430768785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800ba60 con 0x7f54b81586a0 2024-09-13T15:11:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b6a00700 1 -- 172.21.15.50:0/2430768785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800bbc0 con 0x7f54b81586a0 2024-09-13T15:11:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.700+0000 7f54b6a00700 1 -- 172.21.15.50:0/2430768785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8009e60 con 0x7f54b81586a0 2024-09-13T15:11:48.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 -- 172.21.15.50:0/2430768785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b81586a0 msgr2=0x7f54b806fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 --2- 172.21.15.50:0/2430768785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b81586a0 0x7f54b806fc30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009910 tx=0x7f54a8009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 -- 172.21.15.50:0/2430768785 shutdown_connections 2024-09-13T15:11:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 --2- 172.21.15.50:0/2430768785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b81586a0 0x7f54b806fc30 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 -- 172.21.15.50:0/2430768785 >> 172.21.15.50:0/2430768785 conn(0x7f54b80b05a0 msgr2=0x7f54b80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 -- 172.21.15.50:0/2430768785 shutdown_connections 2024-09-13T15:11:48.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 -- 172.21.15.50:0/2430768785 wait complete. 2024-09-13T15:11:48.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 Processor -- start 2024-09-13T15:11:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 -- start start 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 0x7f54b80acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54b80ccb20 0x7f54b8155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.704+0000 7f54bce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54b81586a0 0x7f54b8155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54bce00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b81f5bf0 con 0x7f54b80cc6f0 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54bce00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8155aa0 con 0x7f54b80ccb20 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54bce00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b81f3380 con 0x7f54b81586a0 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 0x7f54b80acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 0x7f54b80acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60570/0 (socket says 172.21.15.50:60570) 2024-09-13T15:11:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 -- 172.21.15.50:0/3527917196 learned_addr learned my addr 172.21.15.50:0/3527917196 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7e00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54b81586a0 0x7f54b8155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54afe00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54b80ccb20 0x7f54b8155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:48.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 -- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54b81586a0 msgr2=0x7f54b8155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54b81586a0 0x7f54b8155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 -- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54b80ccb20 msgr2=0x7f54b8155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54b80ccb20 0x7f54b8155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 -- 172.21.15.50:0/3527917196 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009570 con 0x7f54b80cc6f0 2024-09-13T15:11:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54b7400700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 0x7f54b80acb00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006f80 tx=0x7f54a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80036c0 con 0x7f54b80cc6f0 2024-09-13T15:11:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a801f070 con 0x7f54b80cc6f0 2024-09-13T15:11:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8003a80 con 0x7f54b80cc6f0 2024-09-13T15:11:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b81f5e00 con 0x7f54b80cc6f0 2024-09-13T15:11:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.708+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b81f63c0 con 0x7f54b80cc6f0 2024-09-13T15:11:48.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.712+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b815abb0 con 0x7f54b80cc6f0 2024-09-13T15:11:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.712+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f54a8003be0 con 0x7f54b80cc6f0 2024-09-13T15:11:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.716+0000 7f54af400700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5494066730 0x7f5494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.716+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f54a8021070 con 0x7f54b80cc6f0 2024-09-13T15:11:48.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.716+0000 7f54afe00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5494066730 0x7f5494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:48.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.716+0000 7f54afe00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5494066730 0x7f5494068bf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54b80ca3e0 tx=0x7f54a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:48.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.720+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f54a8052f70 con 0x7f54b80cc6f0 2024-09-13T15:11:48.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:48.900+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54b806fc30 con 0x7f54b80cc6f0 2024-09-13T15:11:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.448+0000 7f54af400700 1 -- 172.21.15.50:0/3527917196 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 181+0+0 (secure 0 0 0) 0x7f54a802b0d0 con 0x7f54b80cc6f0 2024-09-13T15:11:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5494066730 msgr2=0x7f5494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5494066730 0x7f5494068bf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54b80ca3e0 tx=0x7f54a0009040 comp rx=0 tx=0).stop 2024-09-13T15:11:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 msgr2=0x7f54b80acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 0x7f54b80acb00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006f80 tx=0x7f54a8004770 comp rx=0 tx=0).stop 2024-09-13T15:11:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 shutdown_connections 2024-09-13T15:11:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5494066730 0x7f5494068bf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54b81586a0 0x7f54b8155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54b80ccb20 0x7f54b8155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 --2- 172.21.15.50:0/3527917196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b80cc6f0 0x7f54b80acb00 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 >> 172.21.15.50:0/3527917196 conn(0x7f54b80b05a0 msgr2=0x7f54b8158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 shutdown_connections 2024-09-13T15:11:49.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.456+0000 7f54bce00700 1 -- 172.21.15.50:0/3527917196 wait complete. 2024-09-13T15:11:49.464 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:11:49.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:11:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.668+0000 7fe9d2600700 1 Processor -- start 2024-09-13T15:11:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.668+0000 7fe9d2600700 1 -- start start 2024-09-13T15:11:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d2600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9cc06c1a0 0x7fe9cc0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d2600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc071f50 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d2600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0b1470 con 0x7fe9cc071ac0 2024-09-13T15:11:49.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d2600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0cce00 con 0x7fe9cc06c1a0 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9cc15cfe0 0x7fe9cc0cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35610/0 (socket says 172.21.15.50:35610) 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1200700 1 -- 172.21.15.50:0/1328156148 learned_addr learned my addr 172.21.15.50:0/1328156148 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1c00700 1 --2- 172.21.15.50:0/1328156148 >> v2:172.21.15.50:3300/0 conn(0x7fe9cc06c1a0 0x7fe9cc0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1c00700 1 -- 172.21.15.50:0/1328156148 >> v1:172.21.15.181:6789/0 conn(0x7fe9cc071ac0 legacy=0x7fe9cc06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1c00700 1 -- 172.21.15.50:0/1328156148 >> v1:172.21.15.50:6789/0 conn(0x7fe9cc15cfe0 legacy=0x7fe9cc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9cb400700 1 -- 172.21.15.50:0/1328156148 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280976155 0 0) 0x7fe9cc071f50 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1c00700 1 -- 172.21.15.50:0/1328156148 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc15d3c0 con 0x7fe9cc06c1a0 2024-09-13T15:11:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9d1c00700 1 --2- 172.21.15.50:0/1328156148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc06c1a0 0x7fe9cc0b18a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009d90 tx=0x7fe9c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee460ea639c2f487 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9cb400700 1 -- 172.21.15.50:0/1328156148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400e070 con 0x7fe9cc06c1a0 2024-09-13T15:11:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9cb400700 1 -- 172.21.15.50:0/1328156148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400bbd0 con 0x7fe9cc06c1a0 2024-09-13T15:11:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.672+0000 7fe9cb400700 1 -- 172.21.15.50:0/1328156148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4012430 con 0x7fe9cc06c1a0 2024-09-13T15:11:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 -- 172.21.15.50:0/1328156148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc06c1a0 msgr2=0x7fe9cc0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 --2- 172.21.15.50:0/1328156148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc06c1a0 0x7fe9cc0b18a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009d90 tx=0x7fe9c400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 -- 172.21.15.50:0/1328156148 shutdown_connections 2024-09-13T15:11:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 --2- 172.21.15.50:0/1328156148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc06c1a0 0x7fe9cc0b18a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 -- 172.21.15.50:0/1328156148 >> 172.21.15.50:0/1328156148 conn(0x7fe9cc0b05a0 msgr2=0x7fe9cc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 -- 172.21.15.50:0/1328156148 shutdown_connections 2024-09-13T15:11:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.676+0000 7fe9d2600700 1 -- 172.21.15.50:0/1328156148 wait complete. 2024-09-13T15:11:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 Processor -- start 2024-09-13T15:11:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 -- start start 2024-09-13T15:11:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9cc06c1a0 0x7fe9cc14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9cc071ac0 0x7fe9cc1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 0x7fe9cc15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc14fb00 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc14fde0 con 0x7fe9cc071ac0 2024-09-13T15:11:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.680+0000 7fe9d2600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc1500c0 con 0x7fe9cc06c1a0 2024-09-13T15:11:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 0x7fe9cc15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 0x7fe9cc15b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60582/0 (socket says 172.21.15.50:60582) 2024-09-13T15:11:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 -- 172.21.15.50:0/3390449373 learned_addr learned my addr 172.21.15.50:0/3390449373 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1200700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9cc06c1a0 0x7fe9cc14e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9cbe00700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9cc071ac0 0x7fe9cc1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 -- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9cc06c1a0 msgr2=0x7fe9cc14e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9cc06c1a0 0x7fe9cc14e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 -- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9cc071ac0 msgr2=0x7fe9cc1f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9cc071ac0 0x7fe9cc1f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 -- 172.21.15.50:0/3390449373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009a70 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9cbe00700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9cc071ac0 0x7fe9cc1f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d1c00700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 0x7fe9cc15b010 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4014040 tx=0x7fe9c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c401b810 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c4020070 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c401bbb0 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc1503a0 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.684+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc1f3c00 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.688+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc0715a0 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.688+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9c401bd10 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.692+0000 7fe9c8c00700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe9ac066730 0x7fe9ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.692+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5677+0+0 (secure 0 0 0) 0x7fe9c4022070 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.692+0000 7fe9d1200700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe9ac066730 0x7fe9ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.692+0000 7fe9d1200700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe9ac066730 0x7fe9ac068bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c0004a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.696+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9c4057080 con 0x7fe9cc15cfe0 2024-09-13T15:11:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:49.888+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9cc06bc30 con 0x7fe9cc15cfe0 2024-09-13T15:11:50.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.456+0000 7fe9c8c00700 1 -- 172.21.15.50:0/3390449373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe9c4056c10 con 0x7fe9cc15cfe0 2024-09-13T15:11:50.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.464+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe9ac066730 msgr2=0x7fe9ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.464+0000 7fe9d2600700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe9ac066730 0x7fe9ac068bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c0004a70 comp rx=0 tx=0).stop 2024-09-13T15:11:50.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.464+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 msgr2=0x7fe9cc15b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.464+0000 7fe9d2600700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 0x7fe9cc15b010 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4014040 tx=0x7fe9c4004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.464+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 shutdown_connections 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.464+0000 7fe9d2600700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe9ac066730 0x7fe9ac068bf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.468+0000 7fe9d2600700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9cc15cfe0 0x7fe9cc15b010 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.468+0000 7fe9d2600700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9cc071ac0 0x7fe9cc1f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.468+0000 7fe9d2600700 1 --2- 172.21.15.50:0/3390449373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe9cc06c1a0 0x7fe9cc14e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.468+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 >> 172.21.15.50:0/3390449373 conn(0x7fe9cc0b05a0 msgr2=0x7fe9cc0ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:50.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.468+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 shutdown_connections 2024-09-13T15:11:50.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.468+0000 7fe9d2600700 1 -- 172.21.15.50:0/3390449373 wait complete. 2024-09-13T15:11:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:11:50.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T15:11:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.664+0000 7fbb88e00700 1 Processor -- start 2024-09-13T15:11:50.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.664+0000 7fbb88e00700 1 -- start start 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb88e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb8415cda0 0x7fbb8415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb88e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840b4830 con 0x7fbb840d1180 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb88e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8415e120 con 0x7fbb8415d6c0 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb88e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8415db60 con 0x7fbb8415cda0 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb82800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb840d1180 0x7fbb840b4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35620/0 (socket says 172.21.15.50:35620) 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb82800700 1 -- 172.21.15.50:0/4277150446 learned_addr learned my addr 172.21.15.50:0/4277150446 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:50.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb81e00700 1 --2- 172.21.15.50:0/4277150446 >> v2:172.21.15.181:3300/0 conn(0x7fbb8415cda0 0x7fbb8415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:50.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb80a00700 1 -- 172.21.15.50:0/4277150446 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101217224 0 0) 0x7fbb840b4830 con 0x7fbb840d1180 2024-09-13T15:11:50.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb80a00700 1 -- 172.21.15.50:0/4277150446 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb680035d0 con 0x7fbb840d1180 2024-09-13T15:11:50.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb80a00700 1 -- 172.21.15.50:0/4277150446 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694715624 0 0) 0x7fbb680035d0 con 0x7fbb840d1180 2024-09-13T15:11:50.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb81e00700 1 -- 172.21.15.50:0/4277150446 >> v1:172.21.15.181:6789/0 conn(0x7fbb8415d6c0 legacy=0x7fbb840d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb81e00700 1 -- 172.21.15.50:0/4277150446 >> v1:172.21.15.50:6789/0 conn(0x7fbb840d1180 legacy=0x7fbb840b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb81e00700 1 -- 172.21.15.50:0/4277150446 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8415de40 con 0x7fbb8415cda0 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.668+0000 7fbb81e00700 1 --2- 172.21.15.50:0/4277150446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb8415cda0 0x7fbb8415d180 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009850 tx=0x7fbb74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19436baecd980927 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb80a00700 1 -- 172.21.15.50:0/4277150446 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0019f0 con 0x7fbb8415cda0 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb80a00700 1 -- 172.21.15.50:0/4277150446 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74004030 con 0x7fbb8415cda0 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb80a00700 1 -- 172.21.15.50:0/4277150446 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740043c0 con 0x7fbb8415cda0 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 -- 172.21.15.50:0/4277150446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb8415cda0 msgr2=0x7fbb8415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 --2- 172.21.15.50:0/4277150446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb8415cda0 0x7fbb8415d180 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009850 tx=0x7fbb74009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 -- 172.21.15.50:0/4277150446 shutdown_connections 2024-09-13T15:11:50.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 --2- 172.21.15.50:0/4277150446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb8415cda0 0x7fbb8415d180 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 -- 172.21.15.50:0/4277150446 >> 172.21.15.50:0/4277150446 conn(0x7fbb8406e660 msgr2=0x7fbb8406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:50.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 -- 172.21.15.50:0/4277150446 shutdown_connections 2024-09-13T15:11:50.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.672+0000 7fbb88e00700 1 -- 172.21.15.50:0/4277150446 wait complete. 2024-09-13T15:11:50.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 Processor -- start 2024-09-13T15:11:50.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 -- start start 2024-09-13T15:11:50.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb840d1180 0x7fbb84157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:50.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb8415cda0 0x7fbb8414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:50.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 0x7fbb840cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:50.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8414b230 con 0x7fbb8415d6c0 2024-09-13T15:11:50.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841f2900 con 0x7fbb840d1180 2024-09-13T15:11:50.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb88e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841f2be0 con 0x7fbb8415cda0 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb82800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 0x7fbb840cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb82800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 0x7fbb840cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60594/0 (socket says 172.21.15.50:60594) 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb82800700 1 -- 172.21.15.50:0/1630361435 learned_addr learned my addr 172.21.15.50:0/1630361435 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb81e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb840d1180 0x7fbb84157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.676+0000 7fbb81400700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb8415cda0 0x7fbb8414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb82800700 1 -- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb8415cda0 msgr2=0x7fbb8414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb82800700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb8415cda0 0x7fbb8414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb82800700 1 -- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb840d1180 msgr2=0x7fbb84157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb82800700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb840d1180 0x7fbb84157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb82800700 1 -- 172.21.15.50:0/1630361435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740094b0 con 0x7fbb8415d6c0 2024-09-13T15:11:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb82800700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 0x7fbb840cc2d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c001ba0 tx=0x7fbb7c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00aac0 con 0x7fbb8415d6c0 2024-09-13T15:11:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c00ac20 con 0x7fbb8415d6c0 2024-09-13T15:11:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0070d0 con 0x7fbb8415d6c0 2024-09-13T15:11:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb841f2ec0 con 0x7fbb8415d6c0 2024-09-13T15:11:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb841f3480 con 0x7fbb8415d6c0 2024-09-13T15:11:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.680+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb84067a20 con 0x7fbb8415d6c0 2024-09-13T15:11:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.684+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb7c007230 con 0x7fbb8415d6c0 2024-09-13T15:11:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.684+0000 7fbb7a000700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb64066730 0x7fbb64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.684+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbb7c083b60 con 0x7fbb8415d6c0 2024-09-13T15:11:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.684+0000 7fbb81e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb64066730 0x7fbb64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.688+0000 7fbb81e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb64066730 0x7fbb64068bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb740090b0 tx=0x7fbb74008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:50.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.692+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb7c051080 con 0x7fbb8415d6c0 2024-09-13T15:11:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.876+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbb8415d180 con 0x7fbb8415d6c0 2024-09-13T15:11:50.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.888+0000 7fbb7a000700 1 -- 172.21.15.50:0/1630361435 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb7c018020 con 0x7fbb8415d6c0 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb64066730 msgr2=0x7fbb64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb64066730 0x7fbb64068bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb740090b0 tx=0x7fbb74008030 comp rx=0 tx=0).stop 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 msgr2=0x7fbb840cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 0x7fbb840cc2d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c001ba0 tx=0x7fbb7c00cf50 comp rx=0 tx=0).stop 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 shutdown_connections 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb64066730 0x7fbb64068bf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb8415d6c0 0x7fbb840cc2d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb8415cda0 0x7fbb8414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 --2- 172.21.15.50:0/1630361435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb840d1180 0x7fbb84157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 >> 172.21.15.50:0/1630361435 conn(0x7fbb8406e660 msgr2=0x7fbb8415b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 shutdown_connections 2024-09-13T15:11:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:50.896+0000 7fbb88e00700 1 -- 172.21.15.50:0/1630361435 wait complete. 2024-09-13T15:11:50.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-13T15:11:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 Processor -- start 2024-09-13T15:11:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 -- start start 2024-09-13T15:11:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18800cfcb0 0x7f18800d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f1880166bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006a390 con 0x7f188015cb30 2024-09-13T15:11:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188006b1f0 con 0x7f18800cfcb0 2024-09-13T15:11:51.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1885000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188006a5e0 con 0x7f18801647e0 2024-09-13T15:11:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f187f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f188015cb30 0x7f188006bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35626/0 (socket says 172.21.15.50:35626) 2024-09-13T15:11:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f187f400700 1 -- 172.21.15.50:0/3079254817 learned_addr learned my addr 172.21.15.50:0/3079254817 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.088+0000 7f1877e00700 1 --2- 172.21.15.50:0/3079254817 >> v2:172.21.15.50:3300/0 conn(0x7f18800cfcb0 0x7f18800d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187fe00700 1 --2- 172.21.15.50:0/3079254817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f1880166bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187ea00700 1 -- 172.21.15.50:0/3079254817 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87784616 0 0) 0x7f188006a390 con 0x7f188015cb30 2024-09-13T15:11:51.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187ea00700 1 -- 172.21.15.50:0/3079254817 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18640035d0 con 0x7f188015cb30 2024-09-13T15:11:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1877e00700 1 -- 172.21.15.50:0/3079254817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 msgr2=0x7f1880166bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1877e00700 1 --2- 172.21.15.50:0/3079254817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f1880166bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187ea00700 1 -- 172.21.15.50:0/3079254817 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2161167763 0 0) 0x7f18640035d0 con 0x7f188015cb30 2024-09-13T15:11:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1877e00700 1 -- 172.21.15.50:0/3079254817 >> v1:172.21.15.50:6789/0 conn(0x7f188015cb30 legacy=0x7f188006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1877e00700 1 -- 172.21.15.50:0/3079254817 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188006a8c0 con 0x7f18800cfcb0 2024-09-13T15:11:51.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1877e00700 1 --2- 172.21.15.50:0/3079254817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800d0100 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f1868009850 tx=0x7f1868009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5c3b2978f2cb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187ea00700 1 -- 172.21.15.50:0/3079254817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870001670 con 0x7f18800cfcb0 2024-09-13T15:11:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187ea00700 1 -- 172.21.15.50:0/3079254817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1868004030 con 0x7f18800cfcb0 2024-09-13T15:11:51.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f187ea00700 1 -- 172.21.15.50:0/3079254817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680043e0 con 0x7f18800cfcb0 2024-09-13T15:11:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 -- 172.21.15.50:0/3079254817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 msgr2=0x7f18800d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 --2- 172.21.15.50:0/3079254817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800d0100 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f1868009850 tx=0x7f1868009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 -- 172.21.15.50:0/3079254817 shutdown_connections 2024-09-13T15:11:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 --2- 172.21.15.50:0/3079254817 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f1880166bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 --2- 172.21.15.50:0/3079254817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800d0100 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 -- 172.21.15.50:0/3079254817 >> 172.21.15.50:0/3079254817 conn(0x7f1880071f00 msgr2=0x7f18800722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 -- 172.21.15.50:0/3079254817 shutdown_connections 2024-09-13T15:11:51.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.092+0000 7f1885000700 1 -- 172.21.15.50:0/3079254817 wait complete. 2024-09-13T15:11:51.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.096+0000 7f1885000700 1 Processor -- start 2024-09-13T15:11:51.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.096+0000 7f1885000700 1 -- start start 2024-09-13T15:11:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.096+0000 7f1885000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f188015cb30 0x7f18800c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f18800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b4e70 con 0x7f18800cfcb0 2024-09-13T15:11:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b5150 con 0x7f188015cb30 2024-09-13T15:11:51.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b5430 con 0x7f18801647e0 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60618/0 (socket says 172.21.15.50:60618) 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 -- 172.21.15.50:0/1783819807 learned_addr learned my addr 172.21.15.50:0/1783819807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1877e00700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f188015cb30 0x7f18800c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187fe00700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f18800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 -- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 msgr2=0x7f18800c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f18800c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 -- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f188015cb30 msgr2=0x7f18800c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f188015cb30 0x7f18800c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 -- 172.21.15.50:0/1783819807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680094b0 con 0x7f18800cfcb0 2024-09-13T15:11:51.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1877e00700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f188015cb30 0x7f18800c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f187f400700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800c7220 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f187000c780 tx=0x7f187000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870004ca0 con 0x7f18800cfcb0 2024-09-13T15:11:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870004e00 con 0x7f18800cfcb0 2024-09-13T15:11:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800b5710 con 0x7f18800cfcb0 2024-09-13T15:11:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700072d0 con 0x7f18800cfcb0 2024-09-13T15:11:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.100+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18800c7760 con 0x7f18800cfcb0 2024-09-13T15:11:51.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.104+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800b5c30 con 0x7f18800cfcb0 2024-09-13T15:11:51.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.104+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1870007430 con 0x7f18800cfcb0 2024-09-13T15:11:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.104+0000 7f1877400700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f185c066730 0x7f185c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.104+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f18700833d0 con 0x7f18800cfcb0 2024-09-13T15:11:51.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.108+0000 7f1877e00700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f185c066730 0x7f185c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.108+0000 7f1877e00700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f185c066730 0x7f185c068bf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f18680090b0 tx=0x7f1868008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:51.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.112+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18800b5c30 con 0x7f18800cfcb0 2024-09-13T15:11:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.364+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7f18800b5c30 con 0x7f18800cfcb0 2024-09-13T15:11:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.460+0000 7f1877400700 1 -- 172.21.15.50:0/1783819807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v261) v1 ==== 145+0+0 (secure 0 0 0) 0x7f18800b5c30 con 0x7f18800cfcb0 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f185c066730 msgr2=0x7f185c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f185c066730 0x7f185c068bf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f18680090b0 tx=0x7f1868008030 comp rx=0 tx=0).stop 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 msgr2=0x7f18800c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800c7220 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f187000c780 tx=0x7f187000cb40 comp rx=0 tx=0).stop 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 shutdown_connections 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f185c066730 0x7f185c068bf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f18801647e0 0x7f18800c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f188015cb30 0x7f18800c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 --2- 172.21.15.50:0/1783819807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18800cfcb0 0x7f18800c7220 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 >> 172.21.15.50:0/1783819807 conn(0x7f1880071f00 msgr2=0x7f188006ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 shutdown_connections 2024-09-13T15:11:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.464+0000 7f1885000700 1 -- 172.21.15.50:0/1783819807 wait complete. 2024-09-13T15:11:51.491 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-13T15:11:51.491 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2024-09-13T15:11:51.492 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T15:11:51.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.668+0000 7f2b8ac00700 1 Processor -- start 2024-09-13T15:11:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.668+0000 7f2b8ac00700 1 -- start start 2024-09-13T15:11:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b8ac00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b8415ad00 0x7f2b8415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b8ac00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b840ac890 0x7f2b84066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b8ac00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2b840665d0 0x7f2b840ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b8ac00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b84066a80 con 0x7f2b840ac890 2024-09-13T15:11:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b8ac00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b840b5690 con 0x7f2b840665d0 2024-09-13T15:11:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b8ac00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8415e490 con 0x7f2b8415ad00 2024-09-13T15:11:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b840ac890 0x7f2b84066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b840ac890 0x7f2b84066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60632/0 (socket says 172.21.15.50:60632) 2024-09-13T15:11:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 -- 172.21.15.50:0/1566862782 learned_addr learned my addr 172.21.15.50:0/1566862782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b83e00700 1 --2- 172.21.15.50:0/1566862782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b8415ad00 0x7f2b8415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b88c00700 1 --2- 172.21.15.50:0/1566862782 >> v2:172.21.15.181:3300/0 conn(0x7f2b840665d0 0x7f2b840ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 -- 172.21.15.50:0/1566862782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b8415ad00 msgr2=0x7f2b8415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 --2- 172.21.15.50:0/1566862782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b8415ad00 0x7f2b8415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 -- 172.21.15.50:0/1566862782 >> v2:172.21.15.181:3300/0 conn(0x7f2b840665d0 msgr2=0x7f2b840ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 --2- 172.21.15.50:0/1566862782 >> v2:172.21.15.181:3300/0 conn(0x7f2b840665d0 0x7f2b840ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 -- 172.21.15.50:0/1566862782 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8406a390 con 0x7f2b840ac890 2024-09-13T15:11:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b88c00700 1 --2- 172.21.15.50:0/1566862782 >> v2:172.21.15.181:3300/0 conn(0x7f2b840665d0 0x7f2b840ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b7be00700 1 --2- 172.21.15.50:0/1566862782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b84066090 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2b840af8d0 tx=0x7f2b6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942345d3def00ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b83400700 1 -- 172.21.15.50:0/1566862782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c011830 con 0x7f2b840ac890 2024-09-13T15:11:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b83400700 1 -- 172.21.15.50:0/1566862782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c011990 con 0x7f2b840ac890 2024-09-13T15:11:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.672+0000 7f2b83400700 1 -- 172.21.15.50:0/1566862782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c011d20 con 0x7f2b840ac890 2024-09-13T15:11:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 -- 172.21.15.50:0/1566862782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 msgr2=0x7f2b84066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/1566862782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b84066090 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2b840af8d0 tx=0x7f2b6c009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 -- 172.21.15.50:0/1566862782 shutdown_connections 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/1566862782 >> v2:172.21.15.181:3300/0 conn(0x7f2b840665d0 0x7f2b840ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/1566862782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b84066090 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/1566862782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b8415ad00 0x7f2b8415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 -- 172.21.15.50:0/1566862782 >> 172.21.15.50:0/1566862782 conn(0x7f2b840b19d0 msgr2=0x7f2b840b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 -- 172.21.15.50:0/1566862782 shutdown_connections 2024-09-13T15:11:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.676+0000 7f2b8ac00700 1 -- 172.21.15.50:0/1566862782 wait complete. 2024-09-13T15:11:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 Processor -- start 2024-09-13T15:11:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 -- start start 2024-09-13T15:11:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b840665d0 0x7f2b841f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b841444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b8414d430 0x7f2b840afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8414dc10 con 0x7f2b840ac890 2024-09-13T15:11:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8414eac0 con 0x7f2b8414d430 2024-09-13T15:11:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b8ac00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841f7200 con 0x7f2b840665d0 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b7be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b841444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b7be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b841444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60646/0 (socket says 172.21.15.50:60646) 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b7be00700 1 -- 172.21.15.50:0/2017085992 learned_addr learned my addr 172.21.15.50:0/2017085992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b83e00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b840665d0 0x7f2b841f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.680+0000 7f2b88c00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b8414d430 0x7f2b840afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b7be00700 1 -- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b840665d0 msgr2=0x7f2b841f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b7be00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b840665d0 0x7f2b841f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b7be00700 1 -- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b8414d430 msgr2=0x7f2b840afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b7be00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b8414d430 0x7f2b840afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b7be00700 1 -- 172.21.15.50:0/2017085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c009570 con 0x7f2b840ac890 2024-09-13T15:11:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b88c00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b8414d430 0x7f2b840afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b7be00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b841444e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c000c00 tx=0x7f2b6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c004450 con 0x7f2b840ac890 2024-09-13T15:11:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0045b0 con 0x7f2b840ac890 2024-09-13T15:11:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c003900 con 0x7f2b840ac890 2024-09-13T15:11:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8414f040 con 0x7f2b840ac890 2024-09-13T15:11:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8415cf10 con 0x7f2b840ac890 2024-09-13T15:11:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.684+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8415d0d0 con 0x7f2b840ac890 2024-09-13T15:11:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.688+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b6c003a60 con 0x7f2b840ac890 2024-09-13T15:11:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.688+0000 7f2b80c00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b60066730 0x7f2b60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:51.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.688+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2b6c021030 con 0x7f2b840ac890 2024-09-13T15:11:51.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.688+0000 7f2b83e00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b60066730 0x7f2b60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.692+0000 7f2b83e00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b60066730 0x7f2b60068bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009b50 tx=0x7f2b74009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.696+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b6c052970 con 0x7f2b840ac890 2024-09-13T15:11:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.884+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b840af3a0 con 0x7f2b840ac890 2024-09-13T15:11:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.888+0000 7f2b80c00700 1 -- 172.21.15.50:0/2017085992 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f2b6c055f90 con 0x7f2b840ac890 2024-09-13T15:11:51.891 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:51.891 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":92,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:50.445944+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/2602636353":"2024-09-14T15:11:47.417980+0000","172.21.15.50:6834/2602636353":"2024-09-14T15:11:47.417980+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b60066730 msgr2=0x7f2b60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b60066730 0x7f2b60068bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009b50 tx=0x7f2b74009240 comp rx=0 tx=0).stop 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 msgr2=0x7f2b841444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b841444e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c000c00 tx=0x7f2b6c004770 comp rx=0 tx=0).stop 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 shutdown_connections 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2b60066730 0x7f2b60068bf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b8414d430 0x7f2b840afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b840ac890 0x7f2b841444e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 --2- 172.21.15.50:0/2017085992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b840665d0 0x7f2b841f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 >> 172.21.15.50:0/2017085992 conn(0x7f2b840b19d0 msgr2=0x7f2b84158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:51.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 shutdown_connections 2024-09-13T15:11:51.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:51.892+0000 7f2b8ac00700 1 -- 172.21.15.50:0/2017085992 wait complete. 2024-09-13T15:11:51.918 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:51.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.096+0000 7f4af3000700 1 Processor -- start 2024-09-13T15:11:52.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.096+0000 7f4af3000700 1 -- start start 2024-09-13T15:11:52.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af3000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec160f40 0x7f4aec072430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af3000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4aec06f480 0x7f4aec164f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af3000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec0b3b50 con 0x7f4aec164b30 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af3000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec1654b0 con 0x7f4aec06f480 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af3000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec072970 con 0x7f4aec160f40 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4aec06f480 0x7f4aec164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4aec06f480 0x7f4aec164f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60662/0 (socket says 172.21.15.50:60662) 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4aebe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec160f40 0x7f4aec072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 -- 172.21.15.50:0/3798283391 learned_addr learned my addr 172.21.15.50:0/3798283391 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 -- 172.21.15.50:0/3798283391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec160f40 msgr2=0x7f4aec072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 --2- 172.21.15.50:0/3798283391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec160f40 0x7f4aec072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 -- 172.21.15.50:0/3798283391 >> v1:172.21.15.50:6789/0 conn(0x7f4aec164b30 legacy=0x7f4aec06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 -- 172.21.15.50:0/3798283391 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec1656a0 con 0x7f4aec06f480 2024-09-13T15:11:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4aeaa00700 1 -- 172.21.15.50:0/3798283391 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862416074 0 0) 0x7f4aec0b3b50 con 0x7f4aec164b30 2024-09-13T15:11:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.100+0000 7f4af1000700 1 --2- 172.21.15.50:0/3798283391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec06f480 0x7f4aec164f70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009e50 tx=0x7f4ae400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2e30ef7468867d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4aeaa00700 1 -- 172.21.15.50:0/3798283391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400e070 con 0x7f4aec06f480 2024-09-13T15:11:52.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4aeaa00700 1 -- 172.21.15.50:0/3798283391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae400b910 con 0x7f4aec06f480 2024-09-13T15:11:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4aeaa00700 1 -- 172.21.15.50:0/3798283391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400bcc0 con 0x7f4aec06f480 2024-09-13T15:11:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 -- 172.21.15.50:0/3798283391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec06f480 msgr2=0x7f4aec164f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 --2- 172.21.15.50:0/3798283391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec06f480 0x7f4aec164f70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009e50 tx=0x7f4ae400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 -- 172.21.15.50:0/3798283391 shutdown_connections 2024-09-13T15:11:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 --2- 172.21.15.50:0/3798283391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec06f480 0x7f4aec164f70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 --2- 172.21.15.50:0/3798283391 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec160f40 0x7f4aec072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 -- 172.21.15.50:0/3798283391 >> 172.21.15.50:0/3798283391 conn(0x7f4aec0b1e10 msgr2=0x7f4aec06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 -- 172.21.15.50:0/3798283391 shutdown_connections 2024-09-13T15:11:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.104+0000 7f4af3000700 1 -- 172.21.15.50:0/3798283391 wait complete. 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 Processor -- start 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 -- start start 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec06f480 0x7f4aec0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aec160f40 0x7f4aec149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 0x7f4aec1ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec146670 con 0x7f4aec164b30 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec14a330 con 0x7f4aec160f40 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af3000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec146aa0 con 0x7f4aec06f480 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 0x7f4aec1ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 0x7f4aec1ec3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60678/0 (socket says 172.21.15.50:60678) 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4af1000700 1 -- 172.21.15.50:0/1908136180 learned_addr learned my addr 172.21.15.50:0/1908136180 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4aebe00700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec06f480 0x7f4aec0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.108+0000 7f4aeb400700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aec160f40 0x7f4aec149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af1000700 1 -- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec06f480 msgr2=0x7f4aec0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af1000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec06f480 0x7f4aec0cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af1000700 1 -- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aec160f40 msgr2=0x7f4aec149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af1000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aec160f40 0x7f4aec149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af1000700 1 -- 172.21.15.50:0/1908136180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009b30 con 0x7f4aec164b30 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4aebe00700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec06f480 0x7f4aec0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4aeb400700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aec160f40 0x7f4aec149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af1000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 0x7f4aec1ec3d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0670d0 tx=0x7f4ae4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40092e0 con 0x7f4aec164b30 2024-09-13T15:11:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae401c440 con 0x7f4aec164b30 2024-09-13T15:11:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec146d80 con 0x7f4aec164b30 2024-09-13T15:11:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae401c810 con 0x7f4aec164b30 2024-09-13T15:11:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec147340 con 0x7f4aec164b30 2024-09-13T15:11:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.112+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec0b3470 con 0x7f4aec164b30 2024-09-13T15:11:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.116+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ae401c970 con 0x7f4aec164b30 2024-09-13T15:11:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.116+0000 7f4ae3e00700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4acc066730 0x7f4acc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.116+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4ae40859b0 con 0x7f4aec164b30 2024-09-13T15:11:52.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.116+0000 7f4aebe00700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4acc066730 0x7f4acc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.120+0000 7f4aebe00700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4acc066730 0x7f4acc068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009c40 tx=0x7f4adc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.120+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ae4052ed0 con 0x7f4aec164b30 2024-09-13T15:11:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.304+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4aec161320 con 0x7f4aec164b30 2024-09-13T15:11:52.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.304+0000 7f4ae3e00700 1 -- 172.21.15.50:0/1908136180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ae40564f0 con 0x7f4aec164b30 2024-09-13T15:11:52.309 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:52.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4acc066730 msgr2=0x7f4acc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4acc066730 0x7f4acc068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009c40 tx=0x7f4adc008040 comp rx=0 tx=0).stop 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 msgr2=0x7f4aec1ec3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 0x7f4aec1ec3d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0670d0 tx=0x7f4ae4004af0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 shutdown_connections 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4acc066730 0x7f4acc068bf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aec164b30 0x7f4aec1ec3d0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aec160f40 0x7f4aec149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 --2- 172.21.15.50:0/1908136180 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4aec06f480 0x7f4aec0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 >> 172.21.15.50:0/1908136180 conn(0x7f4aec0b1e10 msgr2=0x7f4aec0668b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 shutdown_connections 2024-09-13T15:11:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.308+0000 7f4af3000700 1 -- 172.21.15.50:0/1908136180 wait complete. 2024-09-13T15:11:52.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-13T15:11:52.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.504+0000 7fdce9600700 1 Processor -- start 2024-09-13T15:11:52.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.504+0000 7fdce9600700 1 -- start start 2024-09-13T15:11:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdce415cc50 0x7fdce4161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce9600700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40ac890 con 0x7fdce406b870 2024-09-13T15:11:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce9600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40af2a0 con 0x7fdce40667a0 2024-09-13T15:11:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce9600700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce4161800 con 0x7fdce415cc50 2024-09-13T15:11:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdce415cc50 0x7fdce4161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdce415cc50 0x7fdce4161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60684/0 (socket says 172.21.15.50:60684) 2024-09-13T15:11:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 -- 172.21.15.50:0/3268748493 learned_addr learned my addr 172.21.15.50:0/3268748493 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 -- 172.21.15.50:0/3268748493 >> v1:172.21.15.181:6789/0 conn(0x7fdce40667a0 legacy=0x7fdce406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 -- 172.21.15.50:0/3268748493 >> v1:172.21.15.50:6789/0 conn(0x7fdce406b870 legacy=0x7fdce4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 -- 172.21.15.50:0/3268748493 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce406bce0 con 0x7fdce415cc50 2024-09-13T15:11:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3e00700 1 --2- 172.21.15.50:0/3268748493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce4161220 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009910 tx=0x7fdcd4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d400938013a88cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3400700 1 -- 172.21.15.50:0/3268748493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400ba60 con 0x7fdce415cc50 2024-09-13T15:11:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3400700 1 -- 172.21.15.50:0/3268748493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400bbc0 con 0x7fdce415cc50 2024-09-13T15:11:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.508+0000 7fdce3400700 1 -- 172.21.15.50:0/3268748493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4009e60 con 0x7fdce415cc50 2024-09-13T15:11:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 -- 172.21.15.50:0/3268748493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 msgr2=0x7fdce4161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 --2- 172.21.15.50:0/3268748493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce4161220 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009910 tx=0x7fdcd4009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 -- 172.21.15.50:0/3268748493 shutdown_connections 2024-09-13T15:11:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 --2- 172.21.15.50:0/3268748493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce4161220 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 -- 172.21.15.50:0/3268748493 >> 172.21.15.50:0/3268748493 conn(0x7fdce406ca10 msgr2=0x7fdce406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 -- 172.21.15.50:0/3268748493 shutdown_connections 2024-09-13T15:11:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 -- 172.21.15.50:0/3268748493 wait complete. 2024-09-13T15:11:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 Processor -- start 2024-09-13T15:11:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.512+0000 7fdce9600700 1 -- start start 2024-09-13T15:11:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce40667a0 0x7fdce414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdce406b870 0x7fdce41506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce415f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce414e940 con 0x7fdce415cc50 2024-09-13T15:11:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41515c0 con 0x7fdce40667a0 2024-09-13T15:11:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4151000 con 0x7fdce406b870 2024-09-13T15:11:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce415f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60692/0 (socket says 172.21.15.50:60692) 2024-09-13T15:11:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 -- 172.21.15.50:0/178518148 learned_addr learned my addr 172.21.15.50:0/178518148 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce3e00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce40667a0 0x7fdce414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdcdb400700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdce406b870 0x7fdce41506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 -- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdce406b870 msgr2=0x7fdce41506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdce406b870 0x7fdce41506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 -- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce40667a0 msgr2=0x7fdce414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce40667a0 0x7fdce414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 -- 172.21.15.50:0/178518148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4009570 con 0x7fdce415cc50 2024-09-13T15:11:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce3e00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce40667a0 0x7fdce414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce8c00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce415f930 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00cbc0 tx=0x7fdcdc00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc003c20 con 0x7fdce415cc50 2024-09-13T15:11:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc003d80 con 0x7fdce415cc50 2024-09-13T15:11:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00abf0 con 0x7fdce415cc50 2024-09-13T15:11:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce41512e0 con 0x7fdce415cc50 2024-09-13T15:11:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.516+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce40b0870 con 0x7fdce415cc50 2024-09-13T15:11:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.520+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4072480 con 0x7fdce415cc50 2024-09-13T15:11:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.520+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdcdc00ad50 con 0x7fdce415cc50 2024-09-13T15:11:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.520+0000 7fdce0c00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdcc0066730 0x7fdcc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.520+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdcdc0840b0 con 0x7fdce415cc50 2024-09-13T15:11:52.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.524+0000 7fdce3e00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdcc0066730 0x7fdcc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.524+0000 7fdce3e00700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdcc0066730 0x7fdcc0068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4006f80 tx=0x7fdcd4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.528+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdcdc0515e0 con 0x7fdce415cc50 2024-09-13T15:11:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:52.780+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7fdce40672a0 con 0x7fdce415cc50 2024-09-13T15:11:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.472+0000 7fdce0c00700 1 -- 172.21.15.50:0/178518148 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v263) v1 ==== 148+0+0 (secure 0 0 0) 0x7fdcdc054c00 con 0x7fdce415cc50 2024-09-13T15:11:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdcc0066730 msgr2=0x7fdcc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdcc0066730 0x7fdcc0068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4006f80 tx=0x7fdcd4008030 comp rx=0 tx=0).stop 2024-09-13T15:11:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 msgr2=0x7fdce415f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce415f930 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00cbc0 tx=0x7fdcdc00cf80 comp rx=0 tx=0).stop 2024-09-13T15:11:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 shutdown_connections 2024-09-13T15:11:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fdcc0066730 0x7fdcc0068bf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415cc50 0x7fdce415f930 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdce406b870 0x7fdce41506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 --2- 172.21.15.50:0/178518148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce40667a0 0x7fdce414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 >> 172.21.15.50:0/178518148 conn(0x7fdce406ca10 msgr2=0x7fdce4071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 shutdown_connections 2024-09-13T15:11:53.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.476+0000 7fdce9600700 1 -- 172.21.15.50:0/178518148 wait complete. 2024-09-13T15:11:53.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T15:11:53.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 Processor -- start 2024-09-13T15:11:53.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 -- start start 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f588006d620 0x7f588006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 0x7f58800b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800b1980 con 0x7f5880143b70 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800b2500 con 0x7f588006d620 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f5884a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588006d2f0 con 0x7f588006cea0 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f587e800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5880143b70 0x7f58800cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38646/0 (socket says 172.21.15.50:38646) 2024-09-13T15:11:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.696+0000 7f587e800700 1 -- 172.21.15.50:0/3835705289 learned_addr learned my addr 172.21.15.50:0/3835705289 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f5877e00700 1 --2- 172.21.15.50:0/3835705289 >> v2:172.21.15.181:3300/0 conn(0x7f588006d620 0x7f588006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587f200700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 0x7f58800b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379529099 0 0) 0x7f58800b1980 con 0x7f5880143b70 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58640035d0 con 0x7f5880143b70 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774176446 0 0) 0x7f58640035d0 con 0x7f5880143b70 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 msgr2=0x7f58800b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 0x7f58800b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 >> v2:172.21.15.181:3300/0 conn(0x7f588006d620 msgr2=0x7f588006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 --2- 172.21.15.50:0/3835705289 >> v2:172.21.15.181:3300/0 conn(0x7f588006d620 0x7f588006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800b1bd0 con 0x7f5880143b70 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f5870001670 con 0x7f5880143b70 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 >> v1:172.21.15.50:6789/0 conn(0x7f5880143b70 legacy=0x7f58800cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5864003a20 0x7f5864003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 0x7f5864004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864004db0 0x7f5864005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800b2500 con 0x7f5864003a20 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588006d2f0 con 0x7f5864004db0 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586400ba30 con 0x7f588006cea0 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f5877e00700 1 --2- 172.21.15.50:0/3835705289 >> v2:172.21.15.181:3300/0 conn(0x7f588006d620 0x7f588006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5864003a20 0x7f5864003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f5877e00700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 0x7f5864004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587f200700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864004db0 0x7f5864005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 -- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 msgr2=0x7f5864004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588006cea0 0x7f5864004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 -- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864004db0 msgr2=0x7f5864005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864004db0 0x7f5864005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 -- 172.21.15.50:0/3835705289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640035d0 con 0x7f5864003a20 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587e800700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5864003a20 0x7f5864003e40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f587000c320 tx=0x7f58640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a632e60e193000 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000ce60 con 0x7f5864003a20 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870005980 con 0x7f5864003a20 2024-09-13T15:11:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.700+0000 7f587de00700 1 -- 172.21.15.50:0/3835705289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870005d10 con 0x7f5864003a20 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 -- 172.21.15.50:0/3835705289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5864003a20 msgr2=0x7f5864003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 --2- 172.21.15.50:0/3835705289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5864003a20 0x7f5864003e40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f587000c320 tx=0x7f58640058a0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f587f200700 1 -- 172.21.15.50:0/3835705289 reap_dead start 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 -- 172.21.15.50:0/3835705289 shutdown_connections 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 -- 172.21.15.50:0/3835705289 >> 172.21.15.50:0/3835705289 conn(0x7f588006a390 msgr2=0x7f588006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 -- 172.21.15.50:0/3835705289 shutdown_connections 2024-09-13T15:11:53.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 -- 172.21.15.50:0/3835705289 wait complete. 2024-09-13T15:11:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 Processor -- start 2024-09-13T15:11:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.704+0000 7f5884a00700 1 -- start start 2024-09-13T15:11:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864003a20 0x7f5880155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 0x7f5880159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588015a0b0 0x7f588015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58801431d0 con 0x7f588015c280 2024-09-13T15:11:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880142300 con 0x7f5864003a20 2024-09-13T15:11:53.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5880142550 con 0x7f588015a0b0 2024-09-13T15:11:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 0x7f5880159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 0x7f5880159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52116/0 (socket says 172.21.15.50:52116) 2024-09-13T15:11:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 -- 172.21.15.50:0/465375188 learned_addr learned my addr 172.21.15.50:0/465375188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f587e800700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864003a20 0x7f5880155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f587f200700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588015a0b0 0x7f588015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 -- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588015a0b0 msgr2=0x7f588015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588015a0b0 0x7f588015a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 -- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864003a20 msgr2=0x7f5880155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864003a20 0x7f5880155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 -- 172.21.15.50:0/465375188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880142830 con 0x7f588015c280 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5877e00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 0x7f5880159b70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5868011d00 tx=0x7f586800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800fb30 con 0x7f588015c280 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800fc90 con 0x7f588015c280 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880142b10 con 0x7f588015c280 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868014440 con 0x7f588015c280 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.708+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58801557a0 con 0x7f588015c280 2024-09-13T15:11:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.712+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588006c960 con 0x7f588015c280 2024-09-13T15:11:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.712+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58680145a0 con 0x7f588015c280 2024-09-13T15:11:53.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.716+0000 7f5876a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f585c066760 0x7f585c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:53.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.716+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5868084780 con 0x7f588015c280 2024-09-13T15:11:53.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.716+0000 7f587e800700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f585c066760 0x7f585c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:53.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.716+0000 7f587e800700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f585c066760 0x7f585c068c20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5870008fd0 tx=0x7f587000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:53.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.724+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5868051cb0 con 0x7f588015c280 2024-09-13T15:11:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.908+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5880071f60 con 0x7f588015c280 2024-09-13T15:11:53.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5876a00700 1 -- 172.21.15.50:0/465375188 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5868006ce0 con 0x7f588015c280 2024-09-13T15:11:53.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f585c066760 msgr2=0x7f585c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f585c066760 0x7f585c068c20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5870008fd0 tx=0x7f587000a000 comp rx=0 tx=0).stop 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 msgr2=0x7f5880159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 0x7f5880159b70 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5868011d00 tx=0x7f586800f520 comp rx=0 tx=0).stop 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 shutdown_connections 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f585c066760 0x7f585c068c20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f588015a0b0 0x7f588015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588015c280 0x7f5880159b70 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 --2- 172.21.15.50:0/465375188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5864003a20 0x7f5880155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 >> 172.21.15.50:0/465375188 conn(0x7f588006a390 msgr2=0x7f58800ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 shutdown_connections 2024-09-13T15:11:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:53.916+0000 7f5884a00700 1 -- 172.21.15.50:0/465375188 wait complete. 2024-09-13T15:11:53.947 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:11:53.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:53.989 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:11:54.036 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:11:54.037 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:54.037 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:54.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:54.055 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:54.056 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:54.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:54.100 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:11:54.100 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:54.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:11:54.121 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:11:54.121 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:11:54.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:11:54.162 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T15:11:54.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:54.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 Processor -- start 2024-09-13T15:11:54.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 -- start start 2024-09-13T15:11:54.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa5815b700 0x7ffa5815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffa5806c460 0x7ffa5806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa580cdd90 con 0x7ffa5806a5d0 2024-09-13T15:11:54.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5806ce10 con 0x7ffa5815b700 2024-09-13T15:11:54.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa5ea00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5815c020 con 0x7ffa5806c460 2024-09-13T15:11:54.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.348+0000 7ffa57e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa5815b700 0x7ffa5815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa5815b700 0x7ffa5815bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52128/0 (socket says 172.21.15.50:52128) 2024-09-13T15:11:54.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 -- 172.21.15.50:0/979825363 learned_addr learned my addr 172.21.15.50:0/979825363 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:54.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57400700 1 --2- 172.21.15.50:0/979825363 >> v2:172.21.15.181:3300/0 conn(0x7ffa5806c460 0x7ffa5806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 -- 172.21.15.50:0/979825363 >> v2:172.21.15.181:3300/0 conn(0x7ffa5806c460 msgr2=0x7ffa5806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:54.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 --2- 172.21.15.50:0/979825363 >> v2:172.21.15.181:3300/0 conn(0x7ffa5806c460 0x7ffa5806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 -- 172.21.15.50:0/979825363 >> v1:172.21.15.181:6789/0 conn(0x7ffa5806a5d0 legacy=0x7ffa580b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 -- 172.21.15.50:0/979825363 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5806d7e0 con 0x7ffa5815b700 2024-09-13T15:11:54.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa56a00700 1 -- 172.21.15.50:0/979825363 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834210595 0 0) 0x7ffa580cdd90 con 0x7ffa5806a5d0 2024-09-13T15:11:54.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa57e00700 1 --2- 172.21.15.50:0/979825363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa5815bae0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ffa5806dcd0 tx=0x7ffa48009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185bb911fa380fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:54.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa56a00700 1 -- 172.21.15.50:0/979825363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48011830 con 0x7ffa5815b700 2024-09-13T15:11:54.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa56a00700 1 -- 172.21.15.50:0/979825363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa48011990 con 0x7ffa5815b700 2024-09-13T15:11:54.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa56a00700 1 -- 172.21.15.50:0/979825363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48011d20 con 0x7ffa5815b700 2024-09-13T15:11:54.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 -- 172.21.15.50:0/979825363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 msgr2=0x7ffa5815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/979825363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa5815bae0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ffa5806dcd0 tx=0x7ffa48009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 -- 172.21.15.50:0/979825363 shutdown_connections 2024-09-13T15:11:54.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/979825363 >> v2:172.21.15.181:3300/0 conn(0x7ffa5806c460 0x7ffa5806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/979825363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa5815bae0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 -- 172.21.15.50:0/979825363 >> 172.21.15.50:0/979825363 conn(0x7ffa580b08d0 msgr2=0x7ffa580b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:54.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 -- 172.21.15.50:0/979825363 shutdown_connections 2024-09-13T15:11:54.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.352+0000 7ffa5ea00700 1 -- 172.21.15.50:0/979825363 wait complete. 2024-09-13T15:11:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 Processor -- start 2024-09-13T15:11:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 -- start start 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa5806a5d0 0x7ffa58150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa5806c460 0x7ffa58152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa58159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58152730 con 0x7ffa5815b700 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58150dc0 con 0x7ffa5806a5d0 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa581e8ac0 con 0x7ffa5806c460 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa58159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa58159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52140/0 (socket says 172.21.15.50:52140) 2024-09-13T15:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 -- 172.21.15.50:0/140585718 learned_addr learned my addr 172.21.15.50:0/140585718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa57e00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa5806a5d0 0x7ffa58150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 -- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa5806c460 msgr2=0x7ffa58152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa5806c460 0x7ffa58152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 -- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa5806a5d0 msgr2=0x7ffa58150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa5806a5d0 0x7ffa58150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa5ca00700 1 -- 172.21.15.50:0/140585718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009570 con 0x7ffa5815b700 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.356+0000 7ffa57e00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa5806a5d0 0x7ffa58150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa5ca00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa58159d00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000cc70 tx=0x7ffa5000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50003e50 con 0x7ffa5815b700 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000ce70 con 0x7ffa5815b700 2024-09-13T15:11:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5815d8a0 con 0x7ffa5815b700 2024-09-13T15:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000abf0 con 0x7ffa5815b700 2024-09-13T15:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58152350 con 0x7ffa5815b700 2024-09-13T15:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.360+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa58152870 con 0x7ffa5815b700 2024-09-13T15:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.364+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa5000ad50 con 0x7ffa5815b700 2024-09-13T15:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.364+0000 7ffa4fe00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa38066730 0x7ffa38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.364+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ffa50083b80 con 0x7ffa5815b700 2024-09-13T15:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.364+0000 7ffa57e00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa38066730 0x7ffa38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.368+0000 7ffa57e00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa38066730 0x7ffa38068bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000c00 tx=0x7ffa48008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.368+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa58152870 con 0x7ffa5815b700 2024-09-13T15:11:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.600+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa58152870 con 0x7ffa5815b700 2024-09-13T15:11:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.604+0000 7ffa4fe00700 1 -- 172.21.15.50:0/140585718 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ffa50083e60 con 0x7ffa5815b700 2024-09-13T15:11:54.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:54.607 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2125317543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2125317543},{"type":"v1","addr":"172.21.15.181:6835","nonce":2125317543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1302760865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1302760865},{"type":"v1","addr":"172.21.15.50:6833","nonce":1302760865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3390795465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3390795465},{"type":"v1","addr":"172.21.15.181:6837","nonce":3390795465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3486572546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3486572546},{"type":"v1","addr":"172.21.15.50:6835","nonce":3486572546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[]} 2024-09-13T15:11:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa38066730 msgr2=0x7ffa38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa38066730 0x7ffa38068bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000c00 tx=0x7ffa48008030 comp rx=0 tx=0).stop 2024-09-13T15:11:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 msgr2=0x7ffa58159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa58159d00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000cc70 tx=0x7ffa5000a340 comp rx=0 tx=0).stop 2024-09-13T15:11:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 shutdown_connections 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ffa38066730 0x7ffa38068bf0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa5815b700 0x7ffa58159d00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa5806c460 0x7ffa58152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 --2- 172.21.15.50:0/140585718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa5806a5d0 0x7ffa58150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 >> 172.21.15.50:0/140585718 conn(0x7ffa580b08d0 msgr2=0x7ffa5815c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 shutdown_connections 2024-09-13T15:11:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.608+0000 7ffa5ea00700 1 -- 172.21.15.50:0/140585718 wait complete. 2024-09-13T15:11:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 48 2024-09-13T15:11:54.634 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:11:54.634 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T15:11:54.634 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:11:54.634 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:54.635 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:11:54.635 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T15:11:54.635 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:11:54.635 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:54.635 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:11:54.635 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T15:11:54.635 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:11:54.635 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:54.636 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:11:54.636 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T15:11:54.636 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:11:54.636 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:54.658 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:11:54.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:11:54.658 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:11:54.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:11:54.660 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:11:54.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:11:54.662 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:11:54.662 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:11:54.706 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:11:54.707 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:54.708 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:11:54.709 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:54.709 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:11:54.710 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:54.713 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:11:54.714 DEBUG:teuthology.parallel:result is None 2024-09-13T15:11:54.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T15:11:54.825 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:11:54.827 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:11:54.830 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:11:54.835 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:11:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.880+0000 7fa48f200700 1 Processor -- start 2024-09-13T15:11:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.880+0000 7fa48f200700 1 -- start start 2024-09-13T15:11:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4900719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48f200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa49006aaa0 0x7fa49006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48f200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4900b3560 con 0x7fa4900b2670 2024-09-13T15:11:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48f200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa490070b30 con 0x7fa49006aaa0 2024-09-13T15:11:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49006b420 con 0x7fa4901610b0 2024-09-13T15:11:54.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48de00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4900719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48e800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4900b2670 0x7fa4900cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38684/0 (socket says 172.21.15.50:38684) 2024-09-13T15:11:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48e800700 1 -- 172.21.15.50:0/2595138816 learned_addr learned my addr 172.21.15.50:0/2595138816 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa487e00700 1 --2- 172.21.15.50:0/2595138816 >> v2:172.21.15.181:3300/0 conn(0x7fa49006aaa0 0x7fa49006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48de00700 1 -- 172.21.15.50:0/2595138816 >> v2:172.21.15.181:3300/0 conn(0x7fa49006aaa0 msgr2=0x7fa49006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48de00700 1 --2- 172.21.15.50:0/2595138816 >> v2:172.21.15.181:3300/0 conn(0x7fa49006aaa0 0x7fa49006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48de00700 1 -- 172.21.15.50:0/2595138816 >> v1:172.21.15.50:6789/0 conn(0x7fa4900b2670 legacy=0x7fa4900cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48de00700 1 -- 172.21.15.50:0/2595138816 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900b3280 con 0x7fa4901610b0 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48d400700 1 -- 172.21.15.50:0/2595138816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896949538 0 0) 0x7fa4900b3560 con 0x7fa4900b2670 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48de00700 1 --2- 172.21.15.50:0/2595138816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4900719c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa480009850 tx=0x7fa480009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2862a9a429f110 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:54.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48d400700 1 -- 172.21.15.50:0/2595138816 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480011830 con 0x7fa4901610b0 2024-09-13T15:11:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48d400700 1 -- 172.21.15.50:0/2595138816 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480011990 con 0x7fa4901610b0 2024-09-13T15:11:54.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.884+0000 7fa48d400700 1 -- 172.21.15.50:0/2595138816 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480011d40 con 0x7fa4901610b0 2024-09-13T15:11:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 -- 172.21.15.50:0/2595138816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 msgr2=0x7fa4900719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 --2- 172.21.15.50:0/2595138816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4900719c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa480009850 tx=0x7fa480009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 -- 172.21.15.50:0/2595138816 shutdown_connections 2024-09-13T15:11:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 --2- 172.21.15.50:0/2595138816 >> v2:172.21.15.181:3300/0 conn(0x7fa49006aaa0 0x7fa49006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 --2- 172.21.15.50:0/2595138816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4900719c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 -- 172.21.15.50:0/2595138816 >> 172.21.15.50:0/2595138816 conn(0x7fa4900b0c40 msgr2=0x7fa49006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 -- 172.21.15.50:0/2595138816 shutdown_connections 2024-09-13T15:11:54.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.888+0000 7fa48f200700 1 -- 172.21.15.50:0/2595138816 wait complete. 2024-09-13T15:11:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 Processor -- start 2024-09-13T15:11:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 -- start start 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 0x7fa4900acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4900b2670 0x7fa49014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4901fb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4901503c0 con 0x7fa49006aaa0 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4901fb540 con 0x7fa4900b2670 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa490150f00 con 0x7fa4901610b0 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 0x7fa4900acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 0x7fa4900acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52180/0 (socket says 172.21.15.50:52180) 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 -- 172.21.15.50:0/4064882691 learned_addr learned my addr 172.21.15.50:0/4064882691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48e800700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4901fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa487e00700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4900b2670 0x7fa49014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 -- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 msgr2=0x7fa4901fb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4901fb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 -- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4900b2670 msgr2=0x7fa49014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4900b2670 0x7fa49014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 -- 172.21.15.50:0/4064882691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800094b0 con 0x7fa49006aaa0 2024-09-13T15:11:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.892+0000 7fa48de00700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 0x7fa4900acda0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa4800090b0 tx=0x7fa480004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48001abb0 con 0x7fa49006aaa0 2024-09-13T15:11:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48001f070 con 0x7fa49006aaa0 2024-09-13T15:11:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48001b430 con 0x7fa49006aaa0 2024-09-13T15:11:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4900ad480 con 0x7fa49006aaa0 2024-09-13T15:11:54.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4901505d0 con 0x7fa49006aaa0 2024-09-13T15:11:54.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4900719c0 con 0x7fa49006aaa0 2024-09-13T15:11:54.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.896+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa48001b590 con 0x7fa49006aaa0 2024-09-13T15:11:54.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.900+0000 7fa486000700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa46c066730 0x7fa46c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:54.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.900+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa480085150 con 0x7fa49006aaa0 2024-09-13T15:11:54.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.900+0000 7fa487e00700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa46c066730 0x7fa46c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:54.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.900+0000 7fa487e00700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa46c066730 0x7fa46c068bf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa4900a9f10 tx=0x7fa478008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:54.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:54.904+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa480052710 con 0x7fa49006aaa0 2024-09-13T15:11:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.100+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa49006d910 con 0x7fa49006aaa0 2024-09-13T15:11:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.924+0000 7fa486000700 1 -- 172.21.15.50:0/4064882691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa480021080 con 0x7fa49006aaa0 2024-09-13T15:11:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa46c066730 msgr2=0x7fa46c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa46c066730 0x7fa46c068bf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa4900a9f10 tx=0x7fa478008040 comp rx=0 tx=0).stop 2024-09-13T15:11:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 msgr2=0x7fa4900acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 0x7fa4900acda0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa4800090b0 tx=0x7fa480004770 comp rx=0 tx=0).stop 2024-09-13T15:11:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 shutdown_connections 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa46c066730 0x7fa46c068bf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa4901610b0 0x7fa4901fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4900b2670 0x7fa49014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 --2- 172.21.15.50:0/4064882691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa49006aaa0 0x7fa4900acda0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 >> 172.21.15.50:0/4064882691 conn(0x7fa4900b0c40 msgr2=0x7fa4900b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 shutdown_connections 2024-09-13T15:11:55.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:55.928+0000 7fa48f200700 1 -- 172.21.15.50:0/4064882691 wait complete. 2024-09-13T15:11:55.933 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-13T15:11:55.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T15:11:56.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.140+0000 7fefb7e00700 1 Processor -- start 2024-09-13T15:11:56.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.140+0000 7fefb7e00700 1 -- start start 2024-09-13T15:11:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefb80cc6f0 0x7fefb815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefb806aaa0 0x7fefb806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80ccb40 con 0x7fefb80cb020 2024-09-13T15:11:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb806b430 con 0x7fefb80cc6f0 2024-09-13T15:11:56.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb80b2ad0 con 0x7fefb806aaa0 2024-09-13T15:11:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefb80cc6f0 0x7fefb815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fefb80cb020 0x7fefb815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38700/0 (socket says 172.21.15.50:38700) 2024-09-13T15:11:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6a00700 1 -- 172.21.15.50:0/269166451 learned_addr learned my addr 172.21.15.50:0/269166451 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7400700 1 --2- 172.21.15.50:0/269166451 >> v2:172.21.15.181:3300/0 conn(0x7fefb806aaa0 0x7fefb806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6000700 1 -- 172.21.15.50:0/269166451 >> v2:172.21.15.181:3300/0 conn(0x7fefb806aaa0 msgr2=0x7fefb806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6000700 1 --2- 172.21.15.50:0/269166451 >> v2:172.21.15.181:3300/0 conn(0x7fefb806aaa0 0x7fefb806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6000700 1 -- 172.21.15.50:0/269166451 >> v1:172.21.15.50:6789/0 conn(0x7fefb80cb020 legacy=0x7fefb815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6000700 1 -- 172.21.15.50:0/269166451 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb815b960 con 0x7fefb80cc6f0 2024-09-13T15:11:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb6000700 1 --2- 172.21.15.50:0/269166451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb815b0e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cd7e0 tx=0x7fefa4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822d8008e9adad07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb5600700 1 -- 172.21.15.50:0/269166451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4011830 con 0x7fefb80cc6f0 2024-09-13T15:11:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb5600700 1 -- 172.21.15.50:0/269166451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4011990 con 0x7fefb80cc6f0 2024-09-13T15:11:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb5600700 1 -- 172.21.15.50:0/269166451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4011d40 con 0x7fefb80cc6f0 2024-09-13T15:11:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- 172.21.15.50:0/269166451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 msgr2=0x7fefb815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 --2- 172.21.15.50:0/269166451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb815b0e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cd7e0 tx=0x7fefa4009b30 comp rx=0 tx=0).stop 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- 172.21.15.50:0/269166451 shutdown_connections 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 --2- 172.21.15.50:0/269166451 >> v2:172.21.15.181:3300/0 conn(0x7fefb806aaa0 0x7fefb806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 --2- 172.21.15.50:0/269166451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb815b0e0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- 172.21.15.50:0/269166451 >> 172.21.15.50:0/269166451 conn(0x7fefb80b0c40 msgr2=0x7fefb806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- 172.21.15.50:0/269166451 shutdown_connections 2024-09-13T15:11:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.144+0000 7fefb7e00700 1 -- 172.21.15.50:0/269166451 wait complete. 2024-09-13T15:11:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 Processor -- start 2024-09-13T15:11:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 -- start start 2024-09-13T15:11:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb806aaa0 0x7fefb8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb80cb020 0x7fefb80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb80c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8155760 con 0x7fefb80cc6f0 2024-09-13T15:11:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81559b0 con 0x7fefb80cb020 2024-09-13T15:11:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8155c90 con 0x7fefb806aaa0 2024-09-13T15:11:56.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb80c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb80c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52210/0 (socket says 172.21.15.50:52210) 2024-09-13T15:11:56.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb7400700 1 -- 172.21.15.50:0/759079882 learned_addr learned my addr 172.21.15.50:0/759079882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:56.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb6a00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb806aaa0 0x7fefb8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.148+0000 7fefb6000700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb80cb020 0x7fefb80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7400700 1 -- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb806aaa0 msgr2=0x7fefb8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7400700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb806aaa0 0x7fefb8157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7400700 1 -- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb80cb020 msgr2=0x7fefb80c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7400700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb80cb020 0x7fefb80c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7400700 1 -- 172.21.15.50:0/759079882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa40094b0 con 0x7fefb80cc6f0 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7400700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb80c81d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fefb0007e40 tx=0x7fefb000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000ed30 con 0x7fefb80cc6f0 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb0014420 con 0x7fefb80cc6f0 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00147d0 con 0x7fefb80cc6f0 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb8155f70 con 0x7fefb80cc6f0 2024-09-13T15:11:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8156530 con 0x7fefb80cc6f0 2024-09-13T15:11:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.152+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb80cb400 con 0x7fefb80cc6f0 2024-09-13T15:11:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.156+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefb0014930 con 0x7fefb80cc6f0 2024-09-13T15:11:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.156+0000 7fefaea00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef98066730 0x7fef98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.156+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fefb0084720 con 0x7fefb80cc6f0 2024-09-13T15:11:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.156+0000 7fefb6a00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef98066730 0x7fef98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.160+0000 7fefb6a00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef98066730 0x7fef98068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005930 tx=0x7fefa8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.164+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fefb0051b80 con 0x7fefb80cc6f0 2024-09-13T15:11:56.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.424+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fefb815b570 con 0x7fefb80cc6f0 2024-09-13T15:11:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefaea00700 1 -- 172.21.15.50:0/759079882 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fefb00551a0 con 0x7fefb80cc6f0 2024-09-13T15:11:56.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:56.430 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:11:56.430 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-13T15:11:56.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRXcyDBAAfPtIzYd2ihLj1XUs7Gdm3w==", 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-13T15:11:56.431 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmTeE5HxAAyDYkjXFmogJ8bgcJdI4oIQ==", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmBojBFhAAC6Mu7fe0Ti3KlOjd60fcAw==", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmxevCKRAAD70tR5cb++KxerWMagRwRQ==", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAVeRmWluwHBAAo5W0xhj4XmwXK2QZPGIUzw==", 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQADVeRmVZ4rKhAAhmfUuiKDZdI3SBpWwlUquw==", 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAGVeRmkgSgORAAeVIP2w9DXWmoBNS/teKo5g==", 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAKVeRm5LPfDBAAHPvE2bZmTgqp0cmivC40wg==", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQVeRm+gpxIxAA66RFRpXqYAoXJANc2Cx/Dg==", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.436 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQATVeRmVWfpMhAAofyeZIH0dLts6yxHYoGYLw==", 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAXVeRmYRMsBxAAnZmMyjCjbkAlUqJnuaLdyA==", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAaVeRmRb2aFhAAH2G9DvNpa8vjhCmph5QL9g==", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-13T15:11:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmCw2gMBAAxBm0TuMC1UKw2BPhbPMwIg==", 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.439 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmQzXbABAAzXwtBDCfjfNxJRzkF1gk4A==", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmz4LDNhAAgXHin3sjX1DODiJG05LvFw==", 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.440 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD/VORmbk22BhAAG+rxAuQQwn2u+dV+srKm9g==", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-13T15:11:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORmfQGsHhAAoWi5rerqSyo7H67168RTZw==", 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-13T15:11:56.442 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD+VORmRJYjBRAAkokmvQpb+KjKrU1n4/XcCg==", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9VORm5r2SOhAAUaL4ATbzGzS4V7NyrTTf/w==", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-13T15:11:56.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:56.444 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:11:56.444 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:11:56.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef98066730 msgr2=0x7fef98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef98066730 0x7fef98068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005930 tx=0x7fefa8009040 comp rx=0 tx=0).stop 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 msgr2=0x7fefb80c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb80c81d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fefb0007e40 tx=0x7fefb000e3c0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 shutdown_connections 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef98066730 0x7fef98068bf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefb80cc6f0 0x7fefb80c81d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefb80cb020 0x7fefb80c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 --2- 172.21.15.50:0/759079882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefb806aaa0 0x7fefb8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 >> 172.21.15.50:0/759079882 conn(0x7fefb80b0c40 msgr2=0x7fefb8070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 shutdown_connections 2024-09-13T15:11:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.428+0000 7fefb7e00700 1 -- 172.21.15.50:0/759079882 wait complete. 2024-09-13T15:11:56.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:11:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.628+0000 7f4443200700 1 Processor -- start 2024-09-13T15:11:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.628+0000 7f4443200700 1 -- start start 2024-09-13T15:11:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4443200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44440cb020 0x7f44440cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4443200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444415c2a0 0x7f444415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4443200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f444406aaa0 0x7f444406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4443200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444406b450 con 0x7f444415c2a0 2024-09-13T15:11:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4443200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44440b2ad0 con 0x7f444406aaa0 2024-09-13T15:11:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4443200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444415b960 con 0x7f44440cb020 2024-09-13T15:11:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444415c2a0 0x7f444415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f444415c2a0 0x7f444415b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52218/0 (socket says 172.21.15.50:52218) 2024-09-13T15:11:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 -- 172.21.15.50:0/2016901006 learned_addr learned my addr 172.21.15.50:0/2016901006 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441e00700 1 --2- 172.21.15.50:0/2016901006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44440cb020 0x7f44440cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4442800700 1 --2- 172.21.15.50:0/2016901006 >> v2:172.21.15.181:3300/0 conn(0x7f444406aaa0 0x7f444406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 -- 172.21.15.50:0/2016901006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44440cb020 msgr2=0x7f44440cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 --2- 172.21.15.50:0/2016901006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44440cb020 0x7f44440cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 -- 172.21.15.50:0/2016901006 >> v2:172.21.15.181:3300/0 conn(0x7f444406aaa0 msgr2=0x7f444406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 --2- 172.21.15.50:0/2016901006 >> v2:172.21.15.181:3300/0 conn(0x7f444406aaa0 0x7f444406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 -- 172.21.15.50:0/2016901006 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444415bc40 con 0x7f444415c2a0 2024-09-13T15:11:56.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4441400700 1 --2- 172.21.15.50:0/2016901006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415c2a0 0x7f444415b0e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4444158cb0 tx=0x7f4430009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e59866875ce567 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:56.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4440a00700 1 -- 172.21.15.50:0/2016901006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430011830 con 0x7f444415c2a0 2024-09-13T15:11:56.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4440a00700 1 -- 172.21.15.50:0/2016901006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430011990 con 0x7f444415c2a0 2024-09-13T15:11:56.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.632+0000 7f4440a00700 1 -- 172.21.15.50:0/2016901006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430011d20 con 0x7f444415c2a0 2024-09-13T15:11:56.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 -- 172.21.15.50:0/2016901006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415c2a0 msgr2=0x7f444415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 --2- 172.21.15.50:0/2016901006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415c2a0 0x7f444415b0e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4444158cb0 tx=0x7f4430009bf0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 -- 172.21.15.50:0/2016901006 shutdown_connections 2024-09-13T15:11:56.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 --2- 172.21.15.50:0/2016901006 >> v2:172.21.15.181:3300/0 conn(0x7f444406aaa0 0x7f444406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 --2- 172.21.15.50:0/2016901006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444415c2a0 0x7f444415b0e0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 --2- 172.21.15.50:0/2016901006 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f44440cb020 0x7f44440cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 -- 172.21.15.50:0/2016901006 >> 172.21.15.50:0/2016901006 conn(0x7f44440b0c40 msgr2=0x7f444406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 -- 172.21.15.50:0/2016901006 shutdown_connections 2024-09-13T15:11:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.636+0000 7f4443200700 1 -- 172.21.15.50:0/2016901006 wait complete. 2024-09-13T15:11:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 Processor -- start 2024-09-13T15:11:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 -- start start 2024-09-13T15:11:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444406aaa0 0x7f444406d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 0x7f4444137640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f444415c2a0 0x7f444415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44441319b0 con 0x7f44440cb020 2024-09-13T15:11:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4444138a10 con 0x7f444406aaa0 2024-09-13T15:11:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4443200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4444138cf0 con 0x7f444415c2a0 2024-09-13T15:11:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4441400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 0x7f4444137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4441400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 0x7f4444137640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52224/0 (socket says 172.21.15.50:52224) 2024-09-13T15:11:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4441400700 1 -- 172.21.15.50:0/4215308545 learned_addr learned my addr 172.21.15.50:0/4215308545 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4441e00700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444406aaa0 0x7f444406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.640+0000 7f4442800700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f444415c2a0 0x7f444415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4441400700 1 -- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f444415c2a0 msgr2=0x7f444415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4441400700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f444415c2a0 0x7f444415a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4441400700 1 -- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444406aaa0 msgr2=0x7f444406d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4441400700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444406aaa0 0x7f444406d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4441400700 1 -- 172.21.15.50:0/4215308545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430009570 con 0x7f44440cb020 2024-09-13T15:11:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4441400700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 0x7f4444137640 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4430013000 tx=0x7f4430004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:56.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430004460 con 0x7f44440cb020 2024-09-13T15:11:56.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44300045c0 con 0x7f44440cb020 2024-09-13T15:11:56.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430003900 con 0x7f44440cb020 2024-09-13T15:11:56.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4444138fd0 con 0x7f44440cb020 2024-09-13T15:11:56.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4444139590 con 0x7f44440cb020 2024-09-13T15:11:56.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.644+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444415c6c0 con 0x7f44440cb020 2024-09-13T15:11:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.648+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4430021070 con 0x7f44440cb020 2024-09-13T15:11:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.648+0000 7f443a000700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4424066730 0x7f4424068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.648+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4430085340 con 0x7f44440cb020 2024-09-13T15:11:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.648+0000 7f4441e00700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4424066730 0x7f4424068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.652+0000 7f4441e00700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4424066730 0x7f4424068bf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4434009bf0 tx=0x7f4434009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.656+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4430052a70 con 0x7f44440cb020 2024-09-13T15:11:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.844+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44440ce1d0 con 0x7f44440cb020 2024-09-13T15:11:56.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f443a000700 1 -- 172.21.15.50:0/4215308545 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13051 (secure 0 0 0) 0x7f4430056090 con 0x7f44440cb020 2024-09-13T15:11:56.850 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:56.850 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":97,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:11:55.918332+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:11:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4424066730 msgr2=0x7f4424068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4424066730 0x7f4424068bf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4434009bf0 tx=0x7f4434009240 comp rx=0 tx=0).stop 2024-09-13T15:11:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 msgr2=0x7f4444137640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 0x7f4444137640 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4430013000 tx=0x7f4430004770 comp rx=0 tx=0).stop 2024-09-13T15:11:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 shutdown_connections 2024-09-13T15:11:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4424066730 0x7f4424068bf0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f444415c2a0 0x7f444415a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440cb020 0x7f4444137640 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 --2- 172.21.15.50:0/4215308545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444406aaa0 0x7f444406d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 >> 172.21.15.50:0/4215308545 conn(0x7f44440b0c40 msgr2=0x7f444406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 shutdown_connections 2024-09-13T15:11:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:56.848+0000 7f4443200700 1 -- 172.21.15.50:0/4215308545 wait complete. 2024-09-13T15:11:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:11:56.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:11:57.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.048+0000 7ff214e00700 1 Processor -- start 2024-09-13T15:11:57.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.048+0000 7ff214e00700 1 -- start start 2024-09-13T15:11:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff214e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff21006be10 0x7ff2100ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff214e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2100cf0b0 0x7ff2101618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff214e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21006d000 con 0x7ff210160fc0 2024-09-13T15:11:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff214e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100cf520 con 0x7ff21006be10 2024-09-13T15:11:57.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff214e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21006c3f0 con 0x7ff2100cf0b0 2024-09-13T15:11:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff207e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff21006be10 0x7ff2100ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff20de00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff210160fc0 0x7ff2100b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:44092/0 (socket says 172.21.15.50:44092) 2024-09-13T15:11:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff20de00700 1 -- 172.21.15.50:0/2172939141 learned_addr learned my addr 172.21.15.50:0/2172939141 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:57.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff20e800700 1 --2- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2100cf0b0 0x7ff2101618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff207e00700 1 -- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2100cf0b0 msgr2=0x7ff2101618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff207e00700 1 --2- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2100cf0b0 0x7ff2101618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff207e00700 1 -- 172.21.15.50:0/2172939141 >> v1:172.21.15.181:6789/0 conn(0x7ff210160fc0 legacy=0x7ff2100b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff207e00700 1 -- 172.21.15.50:0/2172939141 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21006c6d0 con 0x7ff21006be10 2024-09-13T15:11:57.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.052+0000 7ff207e00700 1 --2- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff2100ceb70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009850 tx=0x7ff1f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7da002a33394e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff20d400700 1 -- 172.21.15.50:0/2172939141 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8011830 con 0x7ff21006be10 2024-09-13T15:11:57.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff20d400700 1 -- 172.21.15.50:0/2172939141 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8011990 con 0x7ff21006be10 2024-09-13T15:11:57.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff20d400700 1 -- 172.21.15.50:0/2172939141 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8011d40 con 0x7ff21006be10 2024-09-13T15:11:57.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 -- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 msgr2=0x7ff2100ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 --2- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff2100ceb70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009850 tx=0x7ff1f8009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:57.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 -- 172.21.15.50:0/2172939141 shutdown_connections 2024-09-13T15:11:57.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 --2- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2100cf0b0 0x7ff2101618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 --2- 172.21.15.50:0/2172939141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff2100ceb70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 -- 172.21.15.50:0/2172939141 >> 172.21.15.50:0/2172939141 conn(0x7ff21006a570 msgr2=0x7ff21006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 -- 172.21.15.50:0/2172939141 shutdown_connections 2024-09-13T15:11:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.056+0000 7ff214e00700 1 -- 172.21.15.50:0/2172939141 wait complete. 2024-09-13T15:11:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 Processor -- start 2024-09-13T15:11:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 -- start start 2024-09-13T15:11:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff210159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 0x7ff210157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff210160fc0 0x7ff2101f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101e9a30 con 0x7ff2100cf0b0 2024-09-13T15:11:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210157b60 con 0x7ff21006be10 2024-09-13T15:11:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff214e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101f70c0 con 0x7ff210160fc0 2024-09-13T15:11:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff207e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 0x7ff210157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff20de00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff210159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff207e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 0x7ff210157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52238/0 (socket says 172.21.15.50:52238) 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff207e00700 1 -- 172.21.15.50:0/2602474892 learned_addr learned my addr 172.21.15.50:0/2602474892 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.060+0000 7ff20e800700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff210160fc0 0x7ff2101f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff20e800700 1 -- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 msgr2=0x7ff210159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff20e800700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff210159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff20e800700 1 -- 172.21.15.50:0/2602474892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 msgr2=0x7ff210157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff20e800700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 0x7ff210157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff20e800700 1 -- 172.21.15.50:0/2602474892 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80094b0 con 0x7ff210160fc0 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff207e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 0x7ff210157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:57.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff20e800700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff210160fc0 0x7ff2101f6590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff20800efc0 tx=0x7ff208009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800ca60 con 0x7ff210160fc0 2024-09-13T15:11:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20800f040 con 0x7ff210160fc0 2024-09-13T15:11:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800ce20 con 0x7ff210160fc0 2024-09-13T15:11:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2101f73a0 con 0x7ff210160fc0 2024-09-13T15:11:57.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2101e9f20 con 0x7ff210160fc0 2024-09-13T15:11:57.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.064+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2101f7590 con 0x7ff210160fc0 2024-09-13T15:11:57.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.068+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff208014480 con 0x7ff210160fc0 2024-09-13T15:11:57.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.068+0000 7ff206000700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1ec066780 0x7ff1ec068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.068+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff208084ae0 con 0x7ff210160fc0 2024-09-13T15:11:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.068+0000 7ff20de00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1ec066780 0x7ff1ec068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.072+0000 7ff20de00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1ec066780 0x7ff1ec068c40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff200005930 tx=0x7ff200009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.076+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff208052040 con 0x7ff210160fc0 2024-09-13T15:11:57.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.260+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2101f7590 con 0x7ff210160fc0 2024-09-13T15:11:57.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.260+0000 7ff206000700 1 -- 172.21.15.50:0/2602474892 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2101f7590 con 0x7ff210160fc0 2024-09-13T15:11:57.265 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:11:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1ec066780 msgr2=0x7ff1ec068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1ec066780 0x7ff1ec068c40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff200005930 tx=0x7ff200009040 comp rx=0 tx=0).stop 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff210160fc0 msgr2=0x7ff2101f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff210160fc0 0x7ff2101f6590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff20800efc0 tx=0x7ff208009f90 comp rx=0 tx=0).stop 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 shutdown_connections 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff1ec066780 0x7ff1ec068c40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff210160fc0 0x7ff2101f6590 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2100cf0b0 0x7ff210157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 --2- 172.21.15.50:0/2602474892 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21006be10 0x7ff210159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 >> 172.21.15.50:0/2602474892 conn(0x7ff21006a570 msgr2=0x7ff21015ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 shutdown_connections 2024-09-13T15:11:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.264+0000 7ff214e00700 1 -- 172.21.15.50:0/2602474892 wait complete. 2024-09-13T15:11:57.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:11:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.468+0000 7f9230c00700 1 Processor -- start 2024-09-13T15:11:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.468+0000 7f9230c00700 1 -- start start 2024-09-13T15:11:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f9230c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f922c15e070 0x7f922c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f9230c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d10f0 0x7f922c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f9230c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c0cd970 con 0x7f922c0d1540 2024-09-13T15:11:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f9230c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c15e450 con 0x7f922c15e070 2024-09-13T15:11:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f9230c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0d0050 con 0x7f922c0d10f0 2024-09-13T15:11:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f922c0d1540 0x7f922c0b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38706/0 (socket says 172.21.15.50:38706) 2024-09-13T15:11:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922be00700 1 -- 172.21.15.50:0/2206844814 learned_addr learned my addr 172.21.15.50:0/2206844814 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922aa00700 1 --2- 172.21.15.50:0/2206844814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d10f0 0x7f922c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922b400700 1 --2- 172.21.15.50:0/2206844814 >> v2:172.21.15.181:3300/0 conn(0x7f922c15e070 0x7f922c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922aa00700 1 -- 172.21.15.50:0/2206844814 >> v2:172.21.15.181:3300/0 conn(0x7f922c15e070 msgr2=0x7f922c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922aa00700 1 --2- 172.21.15.50:0/2206844814 >> v2:172.21.15.181:3300/0 conn(0x7f922c15e070 0x7f922c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922aa00700 1 -- 172.21.15.50:0/2206844814 >> v1:172.21.15.50:6789/0 conn(0x7f922c0d1540 legacy=0x7f922c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922aa00700 1 -- 172.21.15.50:0/2206844814 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0d0330 con 0x7f922c0d10f0 2024-09-13T15:11:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.472+0000 7f922a000700 1 -- 172.21.15.50:0/2206844814 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254857632 0 0) 0x7f9224001490 con 0x7f922c0d1540 2024-09-13T15:11:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f922aa00700 1 --2- 172.21.15.50:0/2206844814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d10f0 0x7f922c0b2540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9218009850 tx=0x7f9218009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4204ada17a6fd90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f922a000700 1 -- 172.21.15.50:0/2206844814 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011830 con 0x7f922c0d10f0 2024-09-13T15:11:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f922a000700 1 -- 172.21.15.50:0/2206844814 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218011990 con 0x7f922c0d10f0 2024-09-13T15:11:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f922a000700 1 -- 172.21.15.50:0/2206844814 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011d20 con 0x7f922c0d10f0 2024-09-13T15:11:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 -- 172.21.15.50:0/2206844814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d10f0 msgr2=0x7f922c0b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 --2- 172.21.15.50:0/2206844814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d10f0 0x7f922c0b2540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9218009850 tx=0x7f9218009b60 comp rx=0 tx=0).stop 2024-09-13T15:11:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 -- 172.21.15.50:0/2206844814 shutdown_connections 2024-09-13T15:11:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 --2- 172.21.15.50:0/2206844814 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d10f0 0x7f922c0b2540 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 --2- 172.21.15.50:0/2206844814 >> v2:172.21.15.181:3300/0 conn(0x7f922c15e070 0x7f922c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 -- 172.21.15.50:0/2206844814 >> 172.21.15.50:0/2206844814 conn(0x7f922c071f00 msgr2=0x7f922c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 -- 172.21.15.50:0/2206844814 shutdown_connections 2024-09-13T15:11:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.476+0000 7f9230c00700 1 -- 172.21.15.50:0/2206844814 wait complete. 2024-09-13T15:11:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 Processor -- start 2024-09-13T15:11:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 -- start start 2024-09-13T15:11:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0d10f0 0x7f922c0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d1540 0x7f922c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 0x7f922c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0b4b10 con 0x7f922c15e070 2024-09-13T15:11:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0c5d20 con 0x7f922c0d10f0 2024-09-13T15:11:57.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.480+0000 7f9230c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c15a270 con 0x7f922c0d1540 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 0x7f922c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 0x7f922c0b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52254/0 (socket says 172.21.15.50:52254) 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 -- 172.21.15.50:0/918416310 learned_addr learned my addr 172.21.15.50:0/918416310 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922aa00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d1540 0x7f922c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922b400700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0d10f0 0x7f922c0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 -- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d1540 msgr2=0x7f922c06a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d1540 0x7f922c06a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 -- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0d10f0 msgr2=0x7f922c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0d10f0 0x7f922c0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 -- 172.21.15.50:0/918416310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180094b0 con 0x7f922c15e070 2024-09-13T15:11:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f922be00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 0x7f922c0b3a70 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f922400cbd0 tx=0x7f922400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400aa60 con 0x7f922c15e070 2024-09-13T15:11:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922400abe0 con 0x7f922c15e070 2024-09-13T15:11:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c0b3fb0 con 0x7f922c15e070 2024-09-13T15:11:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240070d0 con 0x7f922c15e070 2024-09-13T15:11:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c0c56d0 con 0x7f922c15e070 2024-09-13T15:11:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.484+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c0c5e90 con 0x7f922c15e070 2024-09-13T15:11:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.488+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9224007230 con 0x7f922c15e070 2024-09-13T15:11:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.488+0000 7f9223400700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f920c066730 0x7f920c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.488+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9224083b00 con 0x7f922c15e070 2024-09-13T15:11:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.492+0000 7f922b400700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f920c066730 0x7f920c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.492+0000 7f922b400700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f920c066730 0x7f920c068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f921c007a60 tx=0x7f921c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.496+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9224085e60 con 0x7f922c15e070 2024-09-13T15:11:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.684+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f922c0cd970 con 0x7f922c15e070 2024-09-13T15:11:57.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.684+0000 7f9223400700 1 -- 172.21.15.50:0/918416310 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+65 (secure 0 0 0) 0x7f922c0cd970 con 0x7f922c15e070 2024-09-13T15:11:57.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:11:57.689 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-13T15:11:57.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:11:57.689 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-13T15:11:57.689 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-13T15:11:57.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:11:57.689 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-13T15:11:57.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f920c066730 msgr2=0x7f920c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f920c066730 0x7f920c068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f921c007a60 tx=0x7f921c008040 comp rx=0 tx=0).stop 2024-09-13T15:11:57.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 msgr2=0x7f922c0b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 0x7f922c0b3a70 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f922400cbd0 tx=0x7f922400cee0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 shutdown_connections 2024-09-13T15:11:57.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f920c066730 0x7f920c068bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f922c15e070 0x7f922c0b3a70 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f922c0d1540 0x7f922c06a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 --2- 172.21.15.50:0/918416310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f922c0d10f0 0x7f922c0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 >> 172.21.15.50:0/918416310 conn(0x7f922c071f00 msgr2=0x7f922c0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:57.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 shutdown_connections 2024-09-13T15:11:57.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.688+0000 7f9230c00700 1 -- 172.21.15.50:0/918416310 wait complete. 2024-09-13T15:11:57.710 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:11:57.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:11:57.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.892+0000 7f2141800700 1 Processor -- start 2024-09-13T15:11:57.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.892+0000 7f2141800700 1 -- start start 2024-09-13T15:11:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2141800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f213c158570 0x7f213c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2141800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c073660 0x7f213c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2141800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c072460 con 0x7f213c15b970 2024-09-13T15:11:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2141800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c06de30 con 0x7f213c158570 2024-09-13T15:11:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2141800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c15be70 con 0x7f213c073660 2024-09-13T15:11:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213b400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f213c15b970 0x7f213c15e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38716/0 (socket says 172.21.15.50:38716) 2024-09-13T15:11:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213b400700 1 -- 172.21.15.50:0/3600954575 learned_addr learned my addr 172.21.15.50:0/3600954575 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213be00700 1 --2- 172.21.15.50:0/3600954575 >> v2:172.21.15.181:3300/0 conn(0x7f213c158570 0x7f213c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2140e00700 1 --2- 172.21.15.50:0/3600954575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c073660 0x7f213c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213aa00700 1 -- 172.21.15.50:0/3600954575 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287452064 0 0) 0x7f213c072460 con 0x7f213c15b970 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213aa00700 1 -- 172.21.15.50:0/3600954575 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21200035d0 con 0x7f213c15b970 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2140e00700 1 -- 172.21.15.50:0/3600954575 >> v2:172.21.15.181:3300/0 conn(0x7f213c158570 msgr2=0x7f213c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2140e00700 1 --2- 172.21.15.50:0/3600954575 >> v2:172.21.15.181:3300/0 conn(0x7f213c158570 0x7f213c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2140e00700 1 -- 172.21.15.50:0/3600954575 >> v1:172.21.15.50:6789/0 conn(0x7f213c15b970 legacy=0x7f213c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2140e00700 1 -- 172.21.15.50:0/3600954575 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0728f0 con 0x7f213c073660 2024-09-13T15:11:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f2140e00700 1 --2- 172.21.15.50:0/3600954575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c073660 0x7f213c070990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2134009d90 tx=0x7f213400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba31b08f3fedd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213aa00700 1 -- 172.21.15.50:0/3600954575 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400e070 con 0x7f213c073660 2024-09-13T15:11:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213aa00700 1 -- 172.21.15.50:0/3600954575 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213400bb20 con 0x7f213c073660 2024-09-13T15:11:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.896+0000 7f213aa00700 1 -- 172.21.15.50:0/3600954575 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134012430 con 0x7f213c073660 2024-09-13T15:11:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- 172.21.15.50:0/3600954575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c073660 msgr2=0x7f213c070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 --2- 172.21.15.50:0/3600954575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c073660 0x7f213c070990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2134009d90 tx=0x7f213400b330 comp rx=0 tx=0).stop 2024-09-13T15:11:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- 172.21.15.50:0/3600954575 shutdown_connections 2024-09-13T15:11:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 --2- 172.21.15.50:0/3600954575 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c073660 0x7f213c070990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 --2- 172.21.15.50:0/3600954575 >> v2:172.21.15.181:3300/0 conn(0x7f213c158570 0x7f213c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- 172.21.15.50:0/3600954575 >> 172.21.15.50:0/3600954575 conn(0x7f213c0b0c30 msgr2=0x7f213c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- 172.21.15.50:0/3600954575 shutdown_connections 2024-09-13T15:11:57.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- 172.21.15.50:0/3600954575 wait complete. 2024-09-13T15:11:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 Processor -- start 2024-09-13T15:11:57.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- start start 2024-09-13T15:11:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 0x7f213c09bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f213c158570 0x7f213c0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c15b970 0x7f213c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c09ac80 con 0x7f213c073660 2024-09-13T15:11:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c09af60 con 0x7f213c158570 2024-09-13T15:11:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.900+0000 7f2141800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c09b240 con 0x7f213c15b970 2024-09-13T15:11:57.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 0x7f213c09bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 0x7f213c09bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52264/0 (socket says 172.21.15.50:52264) 2024-09-13T15:11:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 -- 172.21.15.50:0/588581097 learned_addr learned my addr 172.21.15.50:0/588581097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f2140e00700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c15b970 0x7f213c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213b400700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f213c158570 0x7f213c0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 -- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c15b970 msgr2=0x7f213c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c15b970 0x7f213c0b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 -- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f213c158570 msgr2=0x7f213c0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f213c158570 0x7f213c0af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 -- 172.21.15.50:0/588581097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134009a70 con 0x7f213c073660 2024-09-13T15:11:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f213be00700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 0x7f213c09bd20 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f212c00e9d0 tx=0x7f212c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c009720 con 0x7f213c073660 2024-09-13T15:11:57.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c00ee70 con 0x7f213c073660 2024-09-13T15:11:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c09b520 con 0x7f213c073660 2024-09-13T15:11:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c00ca50 con 0x7f213c073660 2024-09-13T15:11:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.904+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c09a930 con 0x7f213c073660 2024-09-13T15:11:57.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.908+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c0710d0 con 0x7f213c073660 2024-09-13T15:11:57.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.908+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f212c00cbb0 con 0x7f213c073660 2024-09-13T15:11:57.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.908+0000 7f2133e00700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f211c066730 0x7f211c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:57.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.908+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f212c083ff0 con 0x7f213c073660 2024-09-13T15:11:57.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.908+0000 7f213b400700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f211c066730 0x7f211c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.912+0000 7f213b400700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f211c066730 0x7f211c068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f213c0ceba0 tx=0x7f2128007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:57.916+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f212c0514d0 con 0x7f213c073660 2024-09-13T15:11:58.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.112+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f213c158cd0 con 0x7f213c073660 2024-09-13T15:11:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.504+0000 7f2133e00700 1 -- 172.21.15.50:0/588581097 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) v1 ==== 138+0+0 (secure 0 0 0) 0x7f212c00ce60 con 0x7f213c073660 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f211c066730 msgr2=0x7f211c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f211c066730 0x7f211c068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f213c0ceba0 tx=0x7f2128007de0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 msgr2=0x7f213c09bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 0x7f213c09bd20 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f212c00e9d0 tx=0x7f212c00ece0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 shutdown_connections 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f211c066730 0x7f211c068bf0 secure :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f213c0ceba0 tx=0x7f2128007de0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f213c15b970 0x7f213c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f213c158570 0x7f213c0af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 --2- 172.21.15.50:0/588581097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f213c073660 0x7f213c09bd20 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 >> 172.21.15.50:0/588581097 conn(0x7f213c0b0c30 msgr2=0x7f213c070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 shutdown_connections 2024-09-13T15:11:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.512+0000 7f2141800700 1 -- 172.21.15.50:0/588581097 wait complete. 2024-09-13T15:11:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-13T15:11:58.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:11:58.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 Processor -- start 2024-09-13T15:11:58.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 -- start start 2024-09-13T15:11:58.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff48c160520 0x7ff48c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 0x7ff48c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c0d0070 con 0x7ff48c0cfc50 2024-09-13T15:11:58.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c0d12b0 con 0x7ff48c160520 2024-09-13T15:11:58.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.724+0000 7ff493800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c160900 con 0x7ff48c0ceb70 2024-09-13T15:11:58.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff490e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff48c160520 0x7ff48c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 0x7ff48c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 0x7ff48c0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:57344/0 (socket says 172.21.15.50:57344) 2024-09-13T15:11:58.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 -- 172.21.15.50:0/3769926990 learned_addr learned my addr 172.21.15.50:0/3769926990 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:58.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 -- 172.21.15.50:0/3769926990 >> v2:172.21.15.50:3300/0 conn(0x7ff48c160520 msgr2=0x7ff48c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:58.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 --2- 172.21.15.50:0/3769926990 >> v2:172.21.15.50:3300/0 conn(0x7ff48c160520 0x7ff48c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 -- 172.21.15.50:0/3769926990 >> v1:172.21.15.50:6789/0 conn(0x7ff48c0cfc50 legacy=0x7ff48c0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 -- 172.21.15.50:0/3769926990 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0d1530 con 0x7ff48c0ceb70 2024-09-13T15:11:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff491800700 1 --2- 172.21.15.50:0/3769926990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 0x7ff48c0b3330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff484009910 tx=0x7ff484009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be16ea9f2cb240c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff48be00700 1 -- 172.21.15.50:0/3769926990 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484011830 con 0x7ff48c0ceb70 2024-09-13T15:11:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff48be00700 1 -- 172.21.15.50:0/3769926990 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff484011990 con 0x7ff48c0ceb70 2024-09-13T15:11:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff48be00700 1 -- 172.21.15.50:0/3769926990 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484011d40 con 0x7ff48c0ceb70 2024-09-13T15:11:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 -- 172.21.15.50:0/3769926990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 msgr2=0x7ff48c0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 --2- 172.21.15.50:0/3769926990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 0x7ff48c0b3330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff484009910 tx=0x7ff484009c20 comp rx=0 tx=0).stop 2024-09-13T15:11:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 -- 172.21.15.50:0/3769926990 shutdown_connections 2024-09-13T15:11:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 --2- 172.21.15.50:0/3769926990 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c0ceb70 0x7ff48c0b3330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 --2- 172.21.15.50:0/3769926990 >> v2:172.21.15.50:3300/0 conn(0x7ff48c160520 0x7ff48c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 -- 172.21.15.50:0/3769926990 >> 172.21.15.50:0/3769926990 conn(0x7ff48c0d2d00 msgr2=0x7ff48c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 -- 172.21.15.50:0/3769926990 shutdown_connections 2024-09-13T15:11:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.728+0000 7ff493800700 1 -- 172.21.15.50:0/3769926990 wait complete. 2024-09-13T15:11:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.732+0000 7ff493800700 1 Processor -- start 2024-09-13T15:11:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.732+0000 7ff493800700 1 -- start start 2024-09-13T15:11:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 0x7ff48c0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff48c0cfc50 0x7ff48c0b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c160520 0x7ff48c1f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0b1290 con 0x7ff48c0ceb70 2024-09-13T15:11:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0b08c0 con 0x7ff48c0cfc50 2024-09-13T15:11:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0afcb0 con 0x7ff48c160520 2024-09-13T15:11:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 0x7ff48c0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 0x7ff48c0b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52286/0 (socket says 172.21.15.50:52286) 2024-09-13T15:11:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 -- 172.21.15.50:0/4001702516 learned_addr learned my addr 172.21.15.50:0/4001702516 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:58.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff491800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c160520 0x7ff48c1f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff483e00700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff48c0cfc50 0x7ff48c0b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 -- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c160520 msgr2=0x7ff48c1f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c160520 0x7ff48c1f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 -- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff48c0cfc50 msgr2=0x7ff48c0b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff48c0cfc50 0x7ff48c0b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 -- 172.21.15.50:0/4001702516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff484009570 con 0x7ff48c0ceb70 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff491800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c160520 0x7ff48c1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff490e00700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 0x7ff48c0b0d50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009d10 tx=0x7ff47c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c009b80 con 0x7ff48c0ceb70 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00f040 con 0x7ff48c0ceb70 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48c0aff90 con 0x7ff48c0ceb70 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c014480 con 0x7ff48c0ceb70 2024-09-13T15:11:58.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.736+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c0b0550 con 0x7ff48c0ceb70 2024-09-13T15:11:58.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.740+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c0672a0 con 0x7ff48c0ceb70 2024-09-13T15:11:58.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.740+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff47c0145e0 con 0x7ff48c0ceb70 2024-09-13T15:11:58.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.744+0000 7ff489600700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff468066730 0x7ff468068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.744+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5547+0+0 (secure 0 0 0) 0x7ff47c084ce0 con 0x7ff48c0ceb70 2024-09-13T15:11:58.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.744+0000 7ff483e00700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff468066730 0x7ff468068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.744+0000 7ff483e00700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff468066730 0x7ff468068bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff48c06d8d0 tx=0x7ff474009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.752+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff47c052050 con 0x7ff48c0ceb70 2024-09-13T15:11:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:58.936+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff48c0cf000 con 0x7ff48c0ceb70 2024-09-13T15:11:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.520+0000 7ff489600700 1 -- 172.21.15.50:0/4001702516 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff47c055670 con 0x7ff48c0ceb70 2024-09-13T15:11:59.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff468066730 msgr2=0x7ff468068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff468066730 0x7ff468068bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff48c06d8d0 tx=0x7ff474009040 comp rx=0 tx=0).stop 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 msgr2=0x7ff48c0b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 0x7ff48c0b0d50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009d10 tx=0x7ff47c00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 shutdown_connections 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff468066730 0x7ff468068bf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff48c160520 0x7ff48c1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff48c0cfc50 0x7ff48c0b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 --2- 172.21.15.50:0/4001702516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff48c0ceb70 0x7ff48c0b0d50 secure :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009d10 tx=0x7ff47c00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 >> 172.21.15.50:0/4001702516 conn(0x7ff48c0d2d00 msgr2=0x7ff48c15efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 shutdown_connections 2024-09-13T15:11:59.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.532+0000 7ff493800700 1 -- 172.21.15.50:0/4001702516 wait complete. 2024-09-13T15:11:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-13T15:11:59.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:11:59.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.756+0000 7f3121e00700 1 Processor -- start 2024-09-13T15:11:59.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.756+0000 7f3121e00700 1 -- start start 2024-09-13T15:11:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f3121e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 0x7f311c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f3121e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c071f70 con 0x7f311c1464c0 2024-09-13T15:11:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f3121e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c070da0 con 0x7f311c06c960 2024-09-13T15:11:59.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f3121e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0b2440 con 0x7f311c0b1980 2024-09-13T15:11:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f3120a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f311c1464c0 0x7f311c071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38724/0 (socket says 172.21.15.50:38724) 2024-09-13T15:11:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f3120a00700 1 -- 172.21.15.50:0/2861996216 learned_addr learned my addr 172.21.15.50:0/2861996216 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:11:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311be00700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 0x7f311c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483121916 0 0) 0x7f311c071f70 con 0x7f311c1464c0 2024-09-13T15:11:59.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31040035d0 con 0x7f311c1464c0 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1515423090 0 0) 0x7f31040035d0 con 0x7f311c1464c0 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 msgr2=0x7f311c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 0x7f311c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 >> v1:172.21.15.181:6789/0 conn(0x7f311c06c960 legacy=0x7f311c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0b2720 con 0x7f311c1464c0 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f3110001670 con 0x7f311c1464c0 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 >> v1:172.21.15.50:6789/0 conn(0x7f311c1464c0 legacy=0x7f311c071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 0x7f3104003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104003f90 0x7f3104004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f3104005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0b2440 con 0x7f3104004db0 2024-09-13T15:11:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310400bb40 con 0x7f3104003f90 2024-09-13T15:11:59.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.760+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310400bd00 con 0x7f311c0b1980 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f3104005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f311be00700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104003f90 0x7f3104004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3120a00700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 0x7f3104003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 -- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 msgr2=0x7f3104003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c0b1980 0x7f3104003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 -- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104003f90 msgr2=0x7f3104004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104003f90 0x7f3104004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 -- 172.21.15.50:0/2861996216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040035d0 con 0x7f3104004db0 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f311be00700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3104003f90 0x7f3104004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:59.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f3104005230 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f311400c290 tx=0x7f31040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1840ae761c260b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114001e70 con 0x7f3104004db0 2024-09-13T15:11:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311400ce50 con 0x7f3104004db0 2024-09-13T15:11:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f311b400700 1 -- 172.21.15.50:0/2861996216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114012660 con 0x7f3104004db0 2024-09-13T15:11:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121e00700 1 -- 172.21.15.50:0/2861996216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 msgr2=0x7f3104005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121e00700 1 --2- 172.21.15.50:0/2861996216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f3104005230 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f311400c290 tx=0x7f31040058a0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.764+0000 7f3121400700 1 -- 172.21.15.50:0/2861996216 reap_dead start 2024-09-13T15:11:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.768+0000 7f3121e00700 1 -- 172.21.15.50:0/2861996216 shutdown_connections 2024-09-13T15:11:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.768+0000 7f3121e00700 1 -- 172.21.15.50:0/2861996216 >> 172.21.15.50:0/2861996216 conn(0x7f311c06a390 msgr2=0x7f311c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:59.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.768+0000 7f3121e00700 1 -- 172.21.15.50:0/2861996216 shutdown_connections 2024-09-13T15:11:59.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.768+0000 7f3121e00700 1 -- 172.21.15.50:0/2861996216 wait complete. 2024-09-13T15:11:59.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.768+0000 7f3121e00700 1 Processor -- start 2024-09-13T15:11:59.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.768+0000 7f3121e00700 1 -- start start 2024-09-13T15:11:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f311c141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c1f2370 0x7f311c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c1f27f0 0x7f311c144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c141750 con 0x7f3104004db0 2024-09-13T15:11:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0c4f20 con 0x7f311c1f2370 2024-09-13T15:11:59.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0c51c0 con 0x7f311c1f27f0 2024-09-13T15:11:59.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f311c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f311c141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52302/0 (socket says 172.21.15.50:52302) 2024-09-13T15:11:59.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 -- 172.21.15.50:0/3912630939 learned_addr learned my addr 172.21.15.50:0/3912630939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:11:59.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f311be00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c1f2370 0x7f311c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121400700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c1f27f0 0x7f311c144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 -- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c1f27f0 msgr2=0x7f311c144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c1f27f0 0x7f311c144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 -- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c1f2370 msgr2=0x7f311c1445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c1f2370 0x7f311c1445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 -- 172.21.15.50:0/3912630939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0c54a0 con 0x7f3104004db0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3120a00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f311c141210 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3110007290 tx=0x7f31100075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000f620 con 0x7f3104004db0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311000f7a0 con 0x7f3104004db0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000fb50 con 0x7f3104004db0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c0c5780 con 0x7f3104004db0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.772+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c0c5f80 con 0x7f3104004db0 2024-09-13T15:11:59.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.776+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c072600 con 0x7f3104004db0 2024-09-13T15:11:59.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.776+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f311000fcb0 con 0x7f3104004db0 2024-09-13T15:11:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.776+0000 7f3118c00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30fc066760 0x7f30fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.776+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f3110084bc0 con 0x7f3104004db0 2024-09-13T15:11:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.780+0000 7f311be00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30fc066760 0x7f30fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.780+0000 7f311be00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30fc066760 0x7f30fc068c20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f311c0ae280 tx=0x7f3108009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:59.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:11:59.784+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3110051f30 con 0x7f3104004db0 2024-09-13T15:12:00.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.003+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f311c0b1dc0 con 0x7f3104004db0 2024-09-13T15:12:00.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.019+0000 7f3118c00700 1 -- 172.21.15.50:0/3912630939 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3110055550 con 0x7f3104004db0 2024-09-13T15:12:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.027+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30fc066760 msgr2=0x7f30fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.027+0000 7f3121e00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30fc066760 0x7f30fc068c20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f311c0ae280 tx=0x7f3108009240 comp rx=0 tx=0).stop 2024-09-13T15:12:00.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.027+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 msgr2=0x7f311c141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.027+0000 7f3121e00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f311c141210 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3110007290 tx=0x7f31100075a0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.027+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 shutdown_connections 2024-09-13T15:12:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.031+0000 7f3121e00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f30fc066760 0x7f30fc068c20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.031+0000 7f3121e00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f311c1f27f0 0x7f311c144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.031+0000 7f3121e00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f311c1f2370 0x7f311c1445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.031+0000 7f3121e00700 1 --2- 172.21.15.50:0/3912630939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3104004db0 0x7f311c141210 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.031+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 >> 172.21.15.50:0/3912630939 conn(0x7f311c06a390 msgr2=0x7f311c06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.031+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 shutdown_connections 2024-09-13T15:12:00.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.035+0000 7f3121e00700 1 -- 172.21.15.50:0/3912630939 wait complete. 2024-09-13T15:12:00.042 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 15 and data pool 16 2024-09-13T15:12:00.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.227+0000 7f49ff200700 1 Processor -- start 2024-09-13T15:12:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49ff200700 1 -- start start 2024-09-13T15:12:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49ff200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49f815cb30 0x7f49f806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49ff200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49f806c040 0x7f49f806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49ff200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f806b140 con 0x7f49f806cf90 2024-09-13T15:12:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49ff200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f80cd7a0 con 0x7f49f806c040 2024-09-13T15:12:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49ff200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f806d420 con 0x7f49f815cb30 2024-09-13T15:12:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49f7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49f806c040 0x7f49f806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49fd200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49f806cf90 0x7f49f80b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38734/0 (socket says 172.21.15.50:38734) 2024-09-13T15:12:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49fd200700 1 -- 172.21.15.50:0/538833637 learned_addr learned my addr 172.21.15.50:0/538833637 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.231+0000 7f49f7e00700 1 --2- 172.21.15.50:0/538833637 >> v2:172.21.15.181:3300/0 conn(0x7f49f815cb30 0x7f49f806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f7400700 1 -- 172.21.15.50:0/538833637 >> v2:172.21.15.181:3300/0 conn(0x7f49f815cb30 msgr2=0x7f49f806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f7400700 1 --2- 172.21.15.50:0/538833637 >> v2:172.21.15.181:3300/0 conn(0x7f49f815cb30 0x7f49f806bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f7400700 1 -- 172.21.15.50:0/538833637 >> v1:172.21.15.50:6789/0 conn(0x7f49f806cf90 legacy=0x7f49f80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f7400700 1 -- 172.21.15.50:0/538833637 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f806a530 con 0x7f49f806c040 2024-09-13T15:12:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f7400700 1 --2- 172.21.15.50:0/538833637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f806ca50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f49f80d0a70 tx=0x7f49e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398cba2325eeb718 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f6a00700 1 -- 172.21.15.50:0/538833637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011830 con 0x7f49f806c040 2024-09-13T15:12:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f6a00700 1 -- 172.21.15.50:0/538833637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4011990 con 0x7f49f806c040 2024-09-13T15:12:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49f6a00700 1 -- 172.21.15.50:0/538833637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011d20 con 0x7f49f806c040 2024-09-13T15:12:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 -- 172.21.15.50:0/538833637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 msgr2=0x7f49f806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 --2- 172.21.15.50:0/538833637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f806ca50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f49f80d0a70 tx=0x7f49e4009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 -- 172.21.15.50:0/538833637 shutdown_connections 2024-09-13T15:12:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 --2- 172.21.15.50:0/538833637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f806ca50 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 --2- 172.21.15.50:0/538833637 >> v2:172.21.15.181:3300/0 conn(0x7f49f815cb30 0x7f49f806bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 -- 172.21.15.50:0/538833637 >> 172.21.15.50:0/538833637 conn(0x7f49f8071f00 msgr2=0x7f49f80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 -- 172.21.15.50:0/538833637 shutdown_connections 2024-09-13T15:12:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.235+0000 7f49ff200700 1 -- 172.21.15.50:0/538833637 wait complete. 2024-09-13T15:12:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.239+0000 7f49ff200700 1 Processor -- start 2024-09-13T15:12:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.239+0000 7f49ff200700 1 -- start start 2024-09-13T15:12:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f8155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49f806cf90 0x7f49f815d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49f815cb30 0x7f49f80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f81562b0 con 0x7f49f806c040 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80ad8f0 con 0x7f49f815cb30 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f815db70 con 0x7f49f806cf90 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f8155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f8155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52316/0 (socket says 172.21.15.50:52316) 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 -- 172.21.15.50:0/2456092374 learned_addr learned my addr 172.21.15.50:0/2456092374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49fd200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49f815cb30 0x7f49f80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7400700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49f806cf90 0x7f49f815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 -- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49f806cf90 msgr2=0x7f49f815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49f806cf90 0x7f49f815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 -- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49f815cb30 msgr2=0x7f49f80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49f815cb30 0x7f49f80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 -- 172.21.15.50:0/2456092374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40094b0 con 0x7f49f806c040 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49f7e00700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f8155d70 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f49e800e870 tx=0x7f49e800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80095a0 con 0x7f49f806c040 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8013680 con 0x7f49f806c040 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80139f0 con 0x7f49f806c040 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f815de50 con 0x7f49f806c040 2024-09-13T15:12:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.243+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f80adb40 con 0x7f49f806c040 2024-09-13T15:12:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.247+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f815cf10 con 0x7f49f806c040 2024-09-13T15:12:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.247+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49e8013b50 con 0x7f49f806c040 2024-09-13T15:12:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.251+0000 7f49efe00700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f49d8066730 0x7f49d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.251+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f49e8084210 con 0x7f49f806c040 2024-09-13T15:12:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.251+0000 7f49f7400700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f49d8066730 0x7f49d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.251+0000 7f49f7400700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f49d8066730 0x7f49d8068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f49e4000c00 tx=0x7f49e4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:00.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.255+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49e8051430 con 0x7f49f806c040 2024-09-13T15:12:00.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.443+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f80b33a0 con 0x7f49f806c040 2024-09-13T15:12:00.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.447+0000 7f49efe00700 1 -- 172.21.15.50:0/2456092374 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16709 (secure 0 0 0) 0x7f49e8054a50 con 0x7f49f806c040 2024-09-13T15:12:00.451 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:00.452 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":100,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:00.009191+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f49d8066730 msgr2=0x7f49d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f49d8066730 0x7f49d8068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f49e4000c00 tx=0x7f49e4008030 comp rx=0 tx=0).stop 2024-09-13T15:12:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 msgr2=0x7f49f8155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f8155d70 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f49e800e870 tx=0x7f49e800eb80 comp rx=0 tx=0).stop 2024-09-13T15:12:00.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 shutdown_connections 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f49d8066730 0x7f49d8068bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49f815cb30 0x7f49f80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f49f806cf90 0x7f49f815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 --2- 172.21.15.50:0/2456092374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806c040 0x7f49f8155d70 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 >> 172.21.15.50:0/2456092374 conn(0x7f49f8071f00 msgr2=0x7f49f80c8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 shutdown_connections 2024-09-13T15:12:00.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.451+0000 7f49ff200700 1 -- 172.21.15.50:0/2456092374 wait complete. 2024-09-13T15:12:00.478 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:00.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.647+0000 7f371da00700 1 Processor -- start 2024-09-13T15:12:00.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f371da00700 1 -- start start 2024-09-13T15:12:00.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f371da00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371806aaa0 0x7f371815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f371da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f37180b3980 0x7f371806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f371da00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371815e560 con 0x7f371806cbb0 2024-09-13T15:12:00.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f371da00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180adf90 con 0x7f371806aaa0 2024-09-13T15:12:00.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f371da00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371806b3c0 con 0x7f37180b3980 2024-09-13T15:12:00.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371806aaa0 0x7f371815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f371806aaa0 0x7f371815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52328/0 (socket says 172.21.15.50:52328) 2024-09-13T15:12:00.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 -- 172.21.15.50:0/2301839916 learned_addr learned my addr 172.21.15.50:0/2301839916 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:00.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717400700 1 --2- 172.21.15.50:0/2301839916 >> v2:172.21.15.181:3300/0 conn(0x7f37180b3980 0x7f371806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 -- 172.21.15.50:0/2301839916 >> v2:172.21.15.181:3300/0 conn(0x7f37180b3980 msgr2=0x7f371806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 --2- 172.21.15.50:0/2301839916 >> v2:172.21.15.181:3300/0 conn(0x7f37180b3980 0x7f371806ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 -- 172.21.15.50:0/2301839916 >> v1:172.21.15.181:6789/0 conn(0x7f371806cbb0 legacy=0x7f371806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 -- 172.21.15.50:0/2301839916 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371815d920 con 0x7f371806aaa0 2024-09-13T15:12:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717400700 1 --2- 172.21.15.50:0/2301839916 >> v2:172.21.15.181:3300/0 conn(0x7f37180b3980 0x7f371806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:00.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.651+0000 7f3717e00700 1 --2- 172.21.15.50:0/2301839916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806aaa0 0x7f371815d310 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f37180cb010 tx=0x7f3708009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e022e332245bfa7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:00.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f3716a00700 1 -- 172.21.15.50:0/2301839916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370800b8a0 con 0x7f371806aaa0 2024-09-13T15:12:00.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f3716a00700 1 -- 172.21.15.50:0/2301839916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370800ba00 con 0x7f371806aaa0 2024-09-13T15:12:00.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f3716a00700 1 -- 172.21.15.50:0/2301839916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370800bd90 con 0x7f371806aaa0 2024-09-13T15:12:00.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 -- 172.21.15.50:0/2301839916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806aaa0 msgr2=0x7f371815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 --2- 172.21.15.50:0/2301839916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806aaa0 0x7f371815d310 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f37180cb010 tx=0x7f3708009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 -- 172.21.15.50:0/2301839916 shutdown_connections 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 --2- 172.21.15.50:0/2301839916 >> v2:172.21.15.181:3300/0 conn(0x7f37180b3980 0x7f371806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 --2- 172.21.15.50:0/2301839916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806aaa0 0x7f371815d310 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 -- 172.21.15.50:0/2301839916 >> 172.21.15.50:0/2301839916 conn(0x7f37180b0c40 msgr2=0x7f371806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 -- 172.21.15.50:0/2301839916 shutdown_connections 2024-09-13T15:12:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.655+0000 7f371da00700 1 -- 172.21.15.50:0/2301839916 wait complete. 2024-09-13T15:12:00.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 Processor -- start 2024-09-13T15:12:00.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 -- start start 2024-09-13T15:12:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f371806aaa0 0x7f37181f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806cbb0 0x7f37180cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37180b3980 0x7f371813ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180cca40 con 0x7f371806cbb0 2024-09-13T15:12:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180cbdc0 con 0x7f371806aaa0 2024-09-13T15:12:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371da00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180cc0a0 con 0x7f37180b3980 2024-09-13T15:12:00.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f3717e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f371806aaa0 0x7f37181f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f3717e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f371806aaa0 0x7f37181f6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:59846/0 (socket says 172.21.15.50:59846) 2024-09-13T15:12:00.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f3717400700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806cbb0 0x7f37180cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f3717e00700 1 -- 172.21.15.50:0/3896641292 learned_addr learned my addr 172.21.15.50:0/3896641292 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:00.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.659+0000 7f371d000700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37180b3980 0x7f371813ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f3717400700 1 -- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37180b3980 msgr2=0x7f371813ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f3717400700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37180b3980 0x7f371813ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f3717400700 1 -- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f371806aaa0 msgr2=0x7f37181f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f3717400700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f371806aaa0 0x7f37181f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f3717400700 1 -- 172.21.15.50:0/3896641292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009570 con 0x7f371806cbb0 2024-09-13T15:12:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f3717400700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806cbb0 0x7f37180cd150 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f370400e810 tx=0x7f370400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400c070 con 0x7f371806cbb0 2024-09-13T15:12:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704004230 con 0x7f371806cbb0 2024-09-13T15:12:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37180cc380 con 0x7f371806cbb0 2024-09-13T15:12:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040045c0 con 0x7f371806cbb0 2024-09-13T15:12:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37180cba50 con 0x7f371806cbb0 2024-09-13T15:12:00.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.663+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3718143540 con 0x7f371806cbb0 2024-09-13T15:12:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.667+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37040036c0 con 0x7f371806cbb0 2024-09-13T15:12:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.667+0000 7f370fe00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f8066760 0x7f36f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.667+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3704083f20 con 0x7f371806cbb0 2024-09-13T15:12:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.667+0000 7f3717e00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f8066760 0x7f36f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:00.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.671+0000 7f3717e00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f8066760 0x7f36f8068c20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3708009150 tx=0x7f3708008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.671+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37040510b0 con 0x7f371806cbb0 2024-09-13T15:12:00.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.859+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f371806ae80 con 0x7f371806cbb0 2024-09-13T15:12:00.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.859+0000 7f370fe00700 1 -- 172.21.15.50:0/3896641292 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16709 (secure 0 0 0) 0x7f3704081160 con 0x7f371806cbb0 2024-09-13T15:12:00.865 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:00.865 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":100,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:00.009191+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.863+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f8066760 msgr2=0x7f36f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.863+0000 7f371da00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f8066760 0x7f36f8068c20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3708009150 tx=0x7f3708008030 comp rx=0 tx=0).stop 2024-09-13T15:12:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806cbb0 msgr2=0x7f37180cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806cbb0 0x7f37180cd150 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f370400e810 tx=0x7f370400eb20 comp rx=0 tx=0).stop 2024-09-13T15:12:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 shutdown_connections 2024-09-13T15:12:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f36f8066760 0x7f36f8068c20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f37180b3980 0x7f371813ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f371806cbb0 0x7f37180cd150 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 --2- 172.21.15.50:0/3896641292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f371806aaa0 0x7f37181f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 >> 172.21.15.50:0/3896641292 conn(0x7f37180b0c40 msgr2=0x7f371806cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 shutdown_connections 2024-09-13T15:12:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:00.867+0000 7f371da00700 1 -- 172.21.15.50:0/3896641292 wait complete. 2024-09-13T15:12:00.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:12:01.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7653e00700 1 Processor -- start 2024-09-13T15:12:01.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7653e00700 1 -- start start 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7653e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76541464c0 0x7f7654071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7653e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7654070da0 con 0x7f76540b1980 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7653e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76540b2440 con 0x7f765406d070 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7653e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540b2720 con 0x7f76541464c0 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7652000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f76540b1980 0x7f765406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38744/0 (socket says 172.21.15.50:38744) 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7652000700 1 -- 172.21.15.50:0/2550546838 learned_addr learned my addr 172.21.15.50:0/2550546838 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.071+0000 7f7652a00700 1 --2- 172.21.15.50:0/2550546838 >> v2:172.21.15.50:3300/0 conn(0x7f76541464c0 0x7f7654071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7652a00700 1 -- 172.21.15.50:0/2550546838 >> v1:172.21.15.181:6789/0 conn(0x7f765406d070 legacy=0x7f76540ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7652a00700 1 -- 172.21.15.50:0/2550546838 >> v1:172.21.15.50:6789/0 conn(0x7f76540b1980 legacy=0x7f765406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7651600700 1 -- 172.21.15.50:0/2550546838 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337772685 0 0) 0x7f7654070da0 con 0x7f76540b1980 2024-09-13T15:12:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7652a00700 1 -- 172.21.15.50:0/2550546838 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654071060 con 0x7f76541464c0 2024-09-13T15:12:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7652a00700 1 --2- 172.21.15.50:0/2550546838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f7654071860 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7644009850 tx=0x7f7644009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbcc43470fb6b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7651600700 1 -- 172.21.15.50:0/2550546838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644011830 con 0x7f76541464c0 2024-09-13T15:12:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7651600700 1 -- 172.21.15.50:0/2550546838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644011990 con 0x7f76541464c0 2024-09-13T15:12:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7651600700 1 -- 172.21.15.50:0/2550546838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644011d20 con 0x7f76541464c0 2024-09-13T15:12:01.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 -- 172.21.15.50:0/2550546838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 msgr2=0x7f7654071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 --2- 172.21.15.50:0/2550546838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f7654071860 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7644009850 tx=0x7f7644009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 -- 172.21.15.50:0/2550546838 shutdown_connections 2024-09-13T15:12:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 --2- 172.21.15.50:0/2550546838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f7654071860 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 -- 172.21.15.50:0/2550546838 >> 172.21.15.50:0/2550546838 conn(0x7f765406a390 msgr2=0x7f765406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 -- 172.21.15.50:0/2550546838 shutdown_connections 2024-09-13T15:12:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.075+0000 7f7653e00700 1 -- 172.21.15.50:0/2550546838 wait complete. 2024-09-13T15:12:01.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 Processor -- start 2024-09-13T15:12:01.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 -- start start 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f765406d070 0x7f76541f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76540b1980 0x7f76541f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f76540b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c4320 con 0x7f76541464c0 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541f3180 con 0x7f76540b1980 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7654142900 con 0x7f765406d070 2024-09-13T15:12:01.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f76540b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f76540b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52346/0 (socket says 172.21.15.50:52346) 2024-09-13T15:12:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7653400700 1 -- 172.21.15.50:0/2219847956 learned_addr learned my addr 172.21.15.50:0/2219847956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7652a00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f765406d070 0x7f76541f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.079+0000 7f7652000700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76540b1980 0x7f76541f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653400700 1 -- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f765406d070 msgr2=0x7f76541f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653400700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f765406d070 0x7f76541f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653400700 1 -- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76540b1980 msgr2=0x7f76541f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653400700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76540b1980 0x7f76541f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653400700 1 -- 172.21.15.50:0/2219847956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440094b0 con 0x7f76541464c0 2024-09-13T15:12:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7652000700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76540b1980 0x7f76541f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653400700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f76540b3280 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f764c00cb20 tx=0x7f764c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c003c20 con 0x7f76541464c0 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c003d80 con 0x7f76541464c0 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00aaa0 con 0x7f76541464c0 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7654142be0 con 0x7f76541464c0 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76541431a0 con 0x7f76541464c0 2024-09-13T15:12:01.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.083+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7654071860 con 0x7f76541464c0 2024-09-13T15:12:01.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.087+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f764c00ac00 con 0x7f76541464c0 2024-09-13T15:12:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.087+0000 7f764aa00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.087+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f764c0841a0 con 0x7f76541464c0 2024-09-13T15:12:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.087+0000 7f7652a00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:01.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.091+0000 7f7652a00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7634066730 0x7f7634068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f76440090b0 tx=0x7f7644008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:01.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.095+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f764c051460 con 0x7f76541464c0 2024-09-13T15:12:01.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:01.315+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7654143360 con 0x7f76541464c0 2024-09-13T15:12:02.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.031+0000 7f764aa00700 1 -- 172.21.15.50:0/2219847956 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f764c054a80 con 0x7f76541464c0 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7634066730 msgr2=0x7f7634068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7634066730 0x7f7634068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f76440090b0 tx=0x7f7644008030 comp rx=0 tx=0).stop 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 msgr2=0x7f76540b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f76540b3280 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f764c00cb20 tx=0x7f764c00cee0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 shutdown_connections 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76541464c0 0x7f76540b3280 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76540b1980 0x7f76541f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 --2- 172.21.15.50:0/2219847956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f765406d070 0x7f76541f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 >> 172.21.15.50:0/2219847956 conn(0x7f765406a390 msgr2=0x7f76540cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 shutdown_connections 2024-09-13T15:12:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.035+0000 7f7653e00700 1 -- 172.21.15.50:0/2219847956 wait complete. 2024-09-13T15:12:02.066 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:12:02.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:12:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 Processor -- start 2024-09-13T15:12:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 -- start start 2024-09-13T15:12:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79e0143b70 0x7f79e00cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79e006d070 0x7f79e00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00b1980 con 0x7f79e006d620 2024-09-13T15:12:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00b2500 con 0x7f79e006d070 2024-09-13T15:12:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79df200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00b1bd0 con 0x7f79e0143b70 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79de800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79e006d070 0x7f79e00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79de800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79e006d070 0x7f79e00b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52350/0 (socket says 172.21.15.50:52350) 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79de800700 1 -- 172.21.15.50:0/1731927489 learned_addr learned my addr 172.21.15.50:0/1731927489 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.239+0000 7f79dde00700 1 --2- 172.21.15.50:0/1731927489 >> v2:172.21.15.181:3300/0 conn(0x7f79e0143b70 0x7f79e00cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79de800700 1 -- 172.21.15.50:0/1731927489 >> v2:172.21.15.181:3300/0 conn(0x7f79e0143b70 msgr2=0x7f79e00cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79de800700 1 --2- 172.21.15.50:0/1731927489 >> v2:172.21.15.181:3300/0 conn(0x7f79e0143b70 0x7f79e00cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79de800700 1 -- 172.21.15.50:0/1731927489 >> v1:172.21.15.50:6789/0 conn(0x7f79e006d620 legacy=0x7f79e006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79de800700 1 -- 172.21.15.50:0/1731927489 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00b1eb0 con 0x7f79e006d070 2024-09-13T15:12:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79de800700 1 --2- 172.21.15.50:0/1731927489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e00b2990 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f79e00725d0 tx=0x7f79d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4710b4e91768d5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:02.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79dd400700 1 -- 172.21.15.50:0/1731927489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800e070 con 0x7f79e006d070 2024-09-13T15:12:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79dd400700 1 -- 172.21.15.50:0/1731927489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8003a40 con 0x7f79e006d070 2024-09-13T15:12:02.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79dd400700 1 -- 172.21.15.50:0/1731927489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8003df0 con 0x7f79e006d070 2024-09-13T15:12:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 -- 172.21.15.50:0/1731927489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 msgr2=0x7f79e00b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 --2- 172.21.15.50:0/1731927489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e00b2990 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f79e00725d0 tx=0x7f79d800b330 comp rx=0 tx=0).stop 2024-09-13T15:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 -- 172.21.15.50:0/1731927489 shutdown_connections 2024-09-13T15:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 --2- 172.21.15.50:0/1731927489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e00b2990 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 --2- 172.21.15.50:0/1731927489 >> v2:172.21.15.181:3300/0 conn(0x7f79e0143b70 0x7f79e00cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 -- 172.21.15.50:0/1731927489 >> 172.21.15.50:0/1731927489 conn(0x7f79e006a390 msgr2=0x7f79e006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 -- 172.21.15.50:0/1731927489 shutdown_connections 2024-09-13T15:12:02.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.243+0000 7f79df200700 1 -- 172.21.15.50:0/1731927489 wait complete. 2024-09-13T15:12:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 Processor -- start 2024-09-13T15:12:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 -- start start 2024-09-13T15:12:02.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e0142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e006d620 0x7f79e01390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e0143b70 0x7f79e015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0135c70 con 0x7f79e006d070 2024-09-13T15:12:02.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01397d0 con 0x7f79e0143b70 2024-09-13T15:12:02.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.247+0000 7f79df200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0139ab0 con 0x7f79e006d620 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e0142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e0142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52354/0 (socket says 172.21.15.50:52354) 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 -- 172.21.15.50:0/2265686754 learned_addr learned my addr 172.21.15.50:0/2265686754 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79d5400700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e006d620 0x7f79e01390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79de800700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e0143b70 0x7f79e015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 -- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e006d620 msgr2=0x7f79e01390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e006d620 0x7f79e01390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 -- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e0143b70 msgr2=0x7f79e015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e0143b70 0x7f79e015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 -- 172.21.15.50:0/2265686754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8009b30 con 0x7f79e006d070 2024-09-13T15:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79dde00700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e0142f70 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f79d000d800 tx=0x7f79d000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00125f0 con 0x7f79e006d070 2024-09-13T15:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0012750 con 0x7f79e006d070 2024-09-13T15:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0012ac0 con 0x7f79e006d070 2024-09-13T15:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e0139d90 con 0x7f79e006d070 2024-09-13T15:12:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e015da50 con 0x7f79e006d070 2024-09-13T15:12:02.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.251+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e00cde20 con 0x7f79e006d070 2024-09-13T15:12:02.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.255+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79d0012c20 con 0x7f79e006d070 2024-09-13T15:12:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.255+0000 7f79d6a00700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79bc06ab70 0x7f79bc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.255+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f79d0084290 con 0x7f79e006d070 2024-09-13T15:12:02.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.255+0000 7f79d5400700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79bc06ab70 0x7f79bc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.259+0000 7f79d5400700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79bc06ab70 0x7f79bc06d030 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79e00caea0 tx=0x7f79c8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:02.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.263+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79d0051430 con 0x7f79e006d070 2024-09-13T15:12:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:02.487+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f79e0071f60 con 0x7f79e006d070 2024-09-13T15:12:03.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.039+0000 7f79d6a00700 1 -- 172.21.15.50:0/2265686754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7f79d0054a50 con 0x7f79e006d070 2024-09-13T15:12:03.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79bc06ab70 msgr2=0x7f79bc06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79bc06ab70 0x7f79bc06d030 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79e00caea0 tx=0x7f79c8009040 comp rx=0 tx=0).stop 2024-09-13T15:12:03.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 msgr2=0x7f79e0142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e0142f70 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f79d000d800 tx=0x7f79d000db10 comp rx=0 tx=0).stop 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 shutdown_connections 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f79bc06ab70 0x7f79bc06d030 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79e0143b70 0x7f79e015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79e006d620 0x7f79e01390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 --2- 172.21.15.50:0/2265686754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e006d070 0x7f79e0142f70 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 >> 172.21.15.50:0/2265686754 conn(0x7f79e006a390 msgr2=0x7f79e00af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 shutdown_connections 2024-09-13T15:12:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.043+0000 7f79df200700 1 -- 172.21.15.50:0/2265686754 wait complete. 2024-09-13T15:12:03.074 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:12:03.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:03.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 Processor -- start 2024-09-13T15:12:03.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 -- start start 2024-09-13T15:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806aaa0 0x7f521815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f52180b3980 0x7f521806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f521806cbb0 0x7f521806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180adf90 con 0x7f521806cbb0 2024-09-13T15:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521815e560 con 0x7f52180b3980 2024-09-13T15:12:03.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.243+0000 7f521da00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521806b3c0 con 0x7f521806aaa0 2024-09-13T15:12:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f521806cbb0 0x7f521806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f521806cbb0 0x7f521806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50036/0 (socket says 172.21.15.50:50036) 2024-09-13T15:12:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 -- 172.21.15.50:0/4064797473 learned_addr learned my addr 172.21.15.50:0/4064797473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:03.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f520f400700 1 --2- 172.21.15.50:0/4064797473 >> v2:172.21.15.181:3300/0 conn(0x7f52180b3980 0x7f521806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f5217e00700 1 --2- 172.21.15.50:0/4064797473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806aaa0 0x7f521815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 -- 172.21.15.50:0/4064797473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806aaa0 msgr2=0x7f521815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:03.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 --2- 172.21.15.50:0/4064797473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806aaa0 0x7f521815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 -- 172.21.15.50:0/4064797473 >> v2:172.21.15.181:3300/0 conn(0x7f52180b3980 msgr2=0x7f521806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:03.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 --2- 172.21.15.50:0/4064797473 >> v2:172.21.15.181:3300/0 conn(0x7f52180b3980 0x7f521806ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 -- 172.21.15.50:0/4064797473 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521815d920 con 0x7f521806cbb0 2024-09-13T15:12:03.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521d000700 1 --2- 172.21.15.50:0/4064797473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f521806cbb0 0x7f521806d060 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f521806ddf0 tx=0x7f521000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757ea18b4346d597 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:03.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f5217400700 1 -- 172.21.15.50:0/4064797473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000e070 con 0x7f521806cbb0 2024-09-13T15:12:03.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f5217400700 1 -- 172.21.15.50:0/4064797473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000b910 con 0x7f521806cbb0 2024-09-13T15:12:03.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f5217400700 1 -- 172.21.15.50:0/4064797473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000bcc0 con 0x7f521806cbb0 2024-09-13T15:12:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 -- 172.21.15.50:0/4064797473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f521806cbb0 msgr2=0x7f521806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 --2- 172.21.15.50:0/4064797473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f521806cbb0 0x7f521806d060 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f521806ddf0 tx=0x7f521000b330 comp rx=0 tx=0).stop 2024-09-13T15:12:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 -- 172.21.15.50:0/4064797473 shutdown_connections 2024-09-13T15:12:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 --2- 172.21.15.50:0/4064797473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f521806cbb0 0x7f521806d060 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 --2- 172.21.15.50:0/4064797473 >> v2:172.21.15.181:3300/0 conn(0x7f52180b3980 0x7f521806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 --2- 172.21.15.50:0/4064797473 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806aaa0 0x7f521815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.247+0000 7f521da00700 1 -- 172.21.15.50:0/4064797473 >> 172.21.15.50:0/4064797473 conn(0x7f52180b0c40 msgr2=0x7f521806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.251+0000 7f521da00700 1 -- 172.21.15.50:0/4064797473 shutdown_connections 2024-09-13T15:12:03.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.251+0000 7f521da00700 1 -- 172.21.15.50:0/4064797473 wait complete. 2024-09-13T15:12:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.251+0000 7f521da00700 1 Processor -- start 2024-09-13T15:12:03.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.251+0000 7f521da00700 1 -- start start 2024-09-13T15:12:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f521806aaa0 0x7f521812ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806cbb0 0x7f52180cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 0x7f5218131000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180cd600 con 0x7f52180b3980 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180ccff0 con 0x7f521806aaa0 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5218131f30 con 0x7f521806cbb0 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 0x7f5218131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 0x7f5218131000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50044/0 (socket says 172.21.15.50:50044) 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 -- 172.21.15.50:0/3719172813 learned_addr learned my addr 172.21.15.50:0/3719172813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f5217e00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f521806aaa0 0x7f521812ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f520f400700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806cbb0 0x7f52180cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 -- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806cbb0 msgr2=0x7f52180cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806cbb0 0x7f52180cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 -- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f521806aaa0 msgr2=0x7f521812ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f521806aaa0 0x7f521812ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 -- 172.21.15.50:0/3719172813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210009b30 con 0x7f52180b3980 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521d000700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 0x7f5218131000 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f52180b1690 tx=0x7f5210004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100099b0 con 0x7f52180b3980 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000ce80 con 0x7f52180b3980 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5218131970 con 0x7f52180b3980 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210004490 con 0x7f52180b3980 2024-09-13T15:12:03.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.255+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52180cd220 con 0x7f52180b3980 2024-09-13T15:12:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.259+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52180cd740 con 0x7f52180b3980 2024-09-13T15:12:03.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.259+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52100045f0 con 0x7f52180b3980 2024-09-13T15:12:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.263+0000 7f5214c00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f51f4066730 0x7f51f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.263+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5210085630 con 0x7f52180b3980 2024-09-13T15:12:03.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.263+0000 7f5217e00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f51f4066730 0x7f51f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.263+0000 7f5217e00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f51f4066730 0x7f51f4068bf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5208009b70 tx=0x7f5208009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:03.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.267+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52180cd740 con 0x7f52180b3980 2024-09-13T15:12:03.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.495+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52180cd740 con 0x7f52180b3980 2024-09-13T15:12:03.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f5214c00700 1 -- 172.21.15.50:0/3719172813 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f52180cd740 con 0x7f52180b3980 2024-09-13T15:12:03.503 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:03.503 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2773604329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2773604329},{"type":"v1","addr":"172.21.15.181:6835","nonce":2773604329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1242078789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1242078789},{"type":"v1","addr":"172.21.15.181:6837","nonce":1242078789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3644270501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3644270501},{"type":"v1","addr":"172.21.15.50:6833","nonce":3644270501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:03.031244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2577107387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2577107387},{"type":"v1","addr":"172.21.15.50:6835","nonce":2577107387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f51f4066730 msgr2=0x7f51f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f51f4066730 0x7f51f4068bf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5208009b70 tx=0x7f5208009240 comp rx=0 tx=0).stop 2024-09-13T15:12:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 msgr2=0x7f5218131000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 0x7f5218131000 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f52180b1690 tx=0x7f5210004af0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 shutdown_connections 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f51f4066730 0x7f51f4068bf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52180b3980 0x7f5218131000 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f521806cbb0 0x7f52180cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.499+0000 7f521da00700 1 --2- 172.21.15.50:0/3719172813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f521806aaa0 0x7f521812ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.503+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 >> 172.21.15.50:0/3719172813 conn(0x7f52180b0c40 msgr2=0x7f5218070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.503+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 shutdown_connections 2024-09-13T15:12:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.503+0000 7f521da00700 1 -- 172.21.15.50:0/3719172813 wait complete. 2024-09-13T15:12:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 54 2024-09-13T15:12:03.529 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 Processor -- start 2024-09-13T15:12:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 -- start start 2024-09-13T15:12:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1b406a5d0 0x7fe1b406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b40cdd90 con 0x7fe1b406c460 2024-09-13T15:12:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b406afc0 con 0x7fe1b406a5d0 2024-09-13T15:12:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b9e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b406ce10 con 0x7fe1b415b700 2024-09-13T15:12:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b2000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe1b406c460 0x7fe1b406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58520/0 (socket says 172.21.15.50:58520) 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b2000700 1 -- 172.21.15.50:0/856224305 learned_addr learned my addr 172.21.15.50:0/856224305 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b3400700 1 --2- 172.21.15.50:0/856224305 >> v2:172.21.15.50:3300/0 conn(0x7fe1b406a5d0 0x7fe1b406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.711+0000 7fe1b2a00700 1 --2- 172.21.15.50:0/856224305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b3400700 1 -- 172.21.15.50:0/856224305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 msgr2=0x7fe1b415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b3400700 1 --2- 172.21.15.50:0/856224305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b3400700 1 -- 172.21.15.50:0/856224305 >> v1:172.21.15.50:6789/0 conn(0x7fe1b406c460 legacy=0x7fe1b406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b3400700 1 -- 172.21.15.50:0/856224305 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b415c020 con 0x7fe1b406a5d0 2024-09-13T15:12:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b3400700 1 --2- 172.21.15.50:0/856224305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b406aa80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d0201f589a2321 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b1600700 1 -- 172.21.15.50:0/856224305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00e070 con 0x7fe1b406a5d0 2024-09-13T15:12:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b1600700 1 -- 172.21.15.50:0/856224305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00bb20 con 0x7fe1b406a5d0 2024-09-13T15:12:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b1600700 1 -- 172.21.15.50:0/856224305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac012430 con 0x7fe1b406a5d0 2024-09-13T15:12:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 -- 172.21.15.50:0/856224305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 msgr2=0x7fe1b406aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/856224305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b406aa80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac00b330 comp rx=0 tx=0).stop 2024-09-13T15:12:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 -- 172.21.15.50:0/856224305 shutdown_connections 2024-09-13T15:12:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/856224305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b406aa80 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/856224305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 -- 172.21.15.50:0/856224305 >> 172.21.15.50:0/856224305 conn(0x7fe1b40b08d0 msgr2=0x7fe1b40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 -- 172.21.15.50:0/856224305 shutdown_connections 2024-09-13T15:12:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.715+0000 7fe1b9e00700 1 -- 172.21.15.50:0/856224305 wait complete. 2024-09-13T15:12:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.719+0000 7fe1b9e00700 1 Processor -- start 2024-09-13T15:12:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.719+0000 7fe1b9e00700 1 -- start start 2024-09-13T15:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1b406c460 0x7fe1b4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b4159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b406fe20 con 0x7fe1b406a5d0 2024-09-13T15:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4153790 con 0x7fe1b406c460 2024-09-13T15:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4153a70 con 0x7fe1b415b700 2024-09-13T15:12:03.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b414ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50066/0 (socket says 172.21.15.50:50066) 2024-09-13T15:12:03.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 -- 172.21.15.50:0/2303641775 learned_addr learned my addr 172.21.15.50:0/2303641775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:03.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b3400700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b4159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2000700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1b406c460 0x7fe1b4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 -- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 msgr2=0x7fe1b4159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b4159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 -- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1b406c460 msgr2=0x7fe1b4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1b406c460 0x7fe1b4154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 -- 172.21.15.50:0/2303641775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009a70 con 0x7fe1b406a5d0 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b2a00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b414ed40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400e840 tx=0x7fe1a400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:03.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40095a0 con 0x7fe1b406a5d0 2024-09-13T15:12:03.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400c690 con 0x7fe1b406a5d0 2024-09-13T15:12:03.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b4153d50 con 0x7fe1b406a5d0 2024-09-13T15:12:03.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400ca00 con 0x7fe1b406a5d0 2024-09-13T15:12:03.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.723+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b414f280 con 0x7fe1b406a5d0 2024-09-13T15:12:03.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.727+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b40ce300 con 0x7fe1b406a5d0 2024-09-13T15:12:03.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.727+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1a400cb60 con 0x7fe1b406a5d0 2024-09-13T15:12:03.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.731+0000 7fe1ab400700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe194066730 0x7fe194068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.731+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe1a4084230 con 0x7fe1b406a5d0 2024-09-13T15:12:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.731+0000 7fe1b2000700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe194066730 0x7fe194068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.735+0000 7fe1b2000700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe194066730 0x7fe194068bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe1b406c070 tx=0x7fe1a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.739+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe1a4051450 con 0x7fe1b406a5d0 2024-09-13T15:12:03.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.935+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1b406aa80 con 0x7fe1b406a5d0 2024-09-13T15:12:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.935+0000 7fe1ab400700 1 -- 172.21.15.50:0/2303641775 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16696 (secure 0 0 0) 0x7fe1a4059e60 con 0x7fe1b406a5d0 2024-09-13T15:12:03.942 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:01.015565+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe194066730 msgr2=0x7fe194068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe194066730 0x7fe194068bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe1b406c070 tx=0x7fe1a0009040 comp rx=0 tx=0).stop 2024-09-13T15:12:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 msgr2=0x7fe1b414ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b414ed40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400e840 tx=0x7fe1a400ec00 comp rx=0 tx=0).stop 2024-09-13T15:12:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 shutdown_connections 2024-09-13T15:12:03.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe194066730 0x7fe194068bf0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe1b415b700 0x7fe1b4159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1b406c460 0x7fe1b4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 --2- 172.21.15.50:0/2303641775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b406a5d0 0x7fe1b414ed40 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 >> 172.21.15.50:0/2303641775 conn(0x7fe1b40b08d0 msgr2=0x7fe1b40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 shutdown_connections 2024-09-13T15:12:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:03.943+0000 7fe1b9e00700 1 -- 172.21.15.50:0/2303641775 wait complete. 2024-09-13T15:12:03.975 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:12:03.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:12:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.139+0000 7f0556400700 1 Processor -- start 2024-09-13T15:12:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.139+0000 7f0556400700 1 -- start start 2024-09-13T15:12:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0556400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f055015dbd0 0x7f055006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0556400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500ce9b0 con 0x7f05500cf450 2024-09-13T15:12:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0556400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500b5870 con 0x7f0550159970 2024-09-13T15:12:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0556400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05500cf8b0 con 0x7f055015dbd0 2024-09-13T15:12:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f054fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f05500cf450 0x7f055015d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58536/0 (socket says 172.21.15.50:58536) 2024-09-13T15:12:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f054fe00700 1 -- 172.21.15.50:0/3036719096 learned_addr learned my addr 172.21.15.50:0/3036719096 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0555a00700 1 --2- 172.21.15.50:0/3036719096 >> v2:172.21.15.181:3300/0 conn(0x7f055015dbd0 0x7f055006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569377939 0 0) 0x7f05500ce9b0 con 0x7f05500cf450 2024-09-13T15:12:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05380057e0 con 0x7f05500cf450 2024-09-13T15:12:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996789692 0 0) 0x7f05500b5870 con 0x7f0550159970 2024-09-13T15:12:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05500ce9b0 con 0x7f0550159970 2024-09-13T15:12:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0555a00700 1 -- 172.21.15.50:0/3036719096 >> v1:172.21.15.181:6789/0 conn(0x7f0550159970 legacy=0x7f05500cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0555a00700 1 -- 172.21.15.50:0/3036719096 >> v1:172.21.15.50:6789/0 conn(0x7f05500cf450 legacy=0x7f055015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.143+0000 7f0555a00700 1 -- 172.21.15.50:0/3036719096 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500cec50 con 0x7f055015dbd0 2024-09-13T15:12:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0555a00700 1 --2- 172.21.15.50:0/3036719096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f055015dbd0 0x7f055006a390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0548009d90 tx=0x7f054800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3bf6d0faa27deab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054800e070 con 0x7f055015dbd0 2024-09-13T15:12:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054800bb20 con 0x7f055015dbd0 2024-09-13T15:12:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f054f400700 1 -- 172.21.15.50:0/3036719096 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548012430 con 0x7f055015dbd0 2024-09-13T15:12:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 -- 172.21.15.50:0/3036719096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f055015dbd0 msgr2=0x7f055006a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 --2- 172.21.15.50:0/3036719096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f055015dbd0 0x7f055006a390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0548009d90 tx=0x7f054800b330 comp rx=0 tx=0).stop 2024-09-13T15:12:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 -- 172.21.15.50:0/3036719096 shutdown_connections 2024-09-13T15:12:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 --2- 172.21.15.50:0/3036719096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f055015dbd0 0x7f055006a390 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 -- 172.21.15.50:0/3036719096 >> 172.21.15.50:0/3036719096 conn(0x7f0550070d10 msgr2=0x7f05500710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 -- 172.21.15.50:0/3036719096 shutdown_connections 2024-09-13T15:12:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.147+0000 7f0556400700 1 -- 172.21.15.50:0/3036719096 wait complete. 2024-09-13T15:12:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 Processor -- start 2024-09-13T15:12:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 -- start start 2024-09-13T15:12:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05500cf450 0x7f055014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0550159970 0x7f055006a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 0x7f055006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05501f4800 con 0x7f055015dbd0 2024-09-13T15:12:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05501f4ae0 con 0x7f05500cf450 2024-09-13T15:12:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0556400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05501f4dc0 con 0x7f0550159970 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 0x7f055006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 0x7f055006a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50076/0 (socket says 172.21.15.50:50076) 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 -- 172.21.15.50:0/3564077212 learned_addr learned my addr 172.21.15.50:0/3564077212 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f054fe00700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0550159970 0x7f055006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555000700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05500cf450 0x7f055014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 -- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0550159970 msgr2=0x7f055006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0550159970 0x7f055006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 -- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05500cf450 msgr2=0x7f055014eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05500cf450 0x7f055014eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 -- 172.21.15.50:0/3564077212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009a70 con 0x7f055015dbd0 2024-09-13T15:12:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555000700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05500cf450 0x7f055014eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.151+0000 7f0555a00700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 0x7f055006a8d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f055006bf60 tx=0x7f0548004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.155+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054801b810 con 0x7f055015dbd0 2024-09-13T15:12:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.155+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0548020070 con 0x7f055015dbd0 2024-09-13T15:12:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.155+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054801bbb0 con 0x7f055015dbd0 2024-09-13T15:12:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.155+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05501f50a0 con 0x7f055015dbd0 2024-09-13T15:12:04.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.155+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05501f4370 con 0x7f055015dbd0 2024-09-13T15:12:04.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.155+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05501f4580 con 0x7f055015dbd0 2024-09-13T15:12:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.159+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f054801bd10 con 0x7f055015dbd0 2024-09-13T15:12:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.159+0000 7f054cc00700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0530066730 0x7f0530068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.159+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0548022070 con 0x7f055015dbd0 2024-09-13T15:12:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.159+0000 7f0555000700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0530066730 0x7f0530068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.159+0000 7f0555000700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0530066730 0x7f0530068bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f05440011e0 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.167+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05480537a0 con 0x7f055015dbd0 2024-09-13T15:12:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.359+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0550159d50 con 0x7f0530066730 2024-09-13T15:12:04.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.375+0000 7f054cc00700 1 -- 172.21.15.50:0/3564077212 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287198 (secure 0 0 0) 0x7f0544001cf0 con 0x7f0530066730 2024-09-13T15:12:04.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0530066730 msgr2=0x7f0530068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0530066730 0x7f0530068bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f05440011e0 tx=0x7f0544009040 comp rx=0 tx=0).stop 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 msgr2=0x7f055006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 0x7f055006a8d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f055006bf60 tx=0x7f0548004af0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 shutdown_connections 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0530066730 0x7f0530068bf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055015dbd0 0x7f055006a8d0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0550159970 0x7f055006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 --2- 172.21.15.50:0/3564077212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05500cf450 0x7f055014eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 >> 172.21.15.50:0/3564077212 conn(0x7f0550070d10 msgr2=0x7f05500b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 shutdown_connections 2024-09-13T15:12:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.383+0000 7f0556400700 1 -- 172.21.15.50:0/3564077212 wait complete. 2024-09-13T15:12:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:12:04.413 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-13T15:12:04.102826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255800,"kb_used_data":10908,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754718920,"statfs":{"total":773094113280,"available":772832174080,"internally_reserved":0,"allocated":11169792,"data_stored":5677459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":250596920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.598828"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.045638+0000","last_change":"2024-09-13T15:12:00.041328+0000","last_active":"2024-09-13T15:12:00.045638+0000","last_peered":"2024-09-13T15:12:00.045638+0000","last_clean":"2024-09-13T15:12:00.045638+0000","last_became_active":"2024-09-13T15:12:00.041068+0000","last_became_peered":"2024-09-13T15:12:00.041068+0000","last_unstale":"2024-09-13T15:12:00.045638+0000","last_undegraded":"2024-09-13T15:12:00.045638+0000","last_fullsized":"2024-09-13T15:12:00.045638+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:41.795155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058307+0000","last_change":"2024-09-13T15:12:00.051723+0000","last_active":"2024-09-13T15:12:00.058307+0000","last_peered":"2024-09-13T15:12:00.058307+0000","last_clean":"2024-09-13T15:12:00.058307+0000","last_became_active":"2024-09-13T15:12:00.051494+0000","last_became_peered":"2024-09-13T15:12:00.051494+0000","last_unstale":"2024-09-13T15:12:00.058307+0000","last_undegraded":"2024-09-13T15:12:00.058307+0000","last_fullsized":"2024-09-13T15:12:00.058307+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:59.621013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058088+0000","last_change":"2024-09-13T15:12:00.054108+0000","last_active":"2024-09-13T15:12:00.058088+0000","last_peered":"2024-09-13T15:12:00.058088+0000","last_clean":"2024-09-13T15:12:00.058088+0000","last_became_active":"2024-09-13T15:12:00.053451+0000","last_became_peered":"2024-09-13T15:12:00.053451+0000","last_unstale":"2024-09-13T15:12:00.058088+0000","last_undegraded":"2024-09-13T15:12:00.058088+0000","last_fullsized":"2024-09-13T15:12:00.058088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:37.123985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030063+0000","last_change":"2024-09-13T15:12:00.034883+0000","last_active":"2024-09-13T15:12:01.030063+0000","last_peered":"2024-09-13T15:12:01.030063+0000","last_clean":"2024-09-13T15:12:01.030063+0000","last_became_active":"2024-09-13T15:12:00.034659+0000","last_became_peered":"2024-09-13T15:12:00.034659+0000","last_unstale":"2024-09-13T15:12:01.030063+0000","last_undegraded":"2024-09-13T15:12:01.030063+0000","last_fullsized":"2024-09-13T15:12:01.030063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:10.268016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033539+0000","last_change":"2024-09-13T15:12:00.047458+0000","last_active":"2024-09-13T15:12:01.033539+0000","last_peered":"2024-09-13T15:12:01.033539+0000","last_clean":"2024-09-13T15:12:01.033539+0000","last_became_active":"2024-09-13T15:12:00.040428+0000","last_became_peered":"2024-09-13T15:12:00.040428+0000","last_unstale":"2024-09-13T15:12:01.033539+0000","last_undegraded":"2024-09-13T15:12:01.033539+0000","last_fullsized":"2024-09-13T15:12:01.033539+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.057244+0000","last_change":"2024-09-13T15:12:00.044583+0000","last_active":"2024-09-13T15:12:00.057244+0000","last_peered":"2024-09-13T15:12:00.057244+0000","last_clean":"2024-09-13T15:12:00.057244+0000","last_became_active":"2024-09-13T15:12:00.044299+0000","last_became_peered":"2024-09-13T15:12:00.044299+0000","last_unstale":"2024-09-13T15:12:00.057244+0000","last_undegraded":"2024-09-13T15:12:00.057244+0000","last_fullsized":"2024-09-13T15:12:00.057244+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:35.441465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.052705+0000","last_change":"2024-09-13T15:12:00.043448+0000","last_active":"2024-09-13T15:12:00.052705+0000","last_peered":"2024-09-13T15:12:00.052705+0000","last_clean":"2024-09-13T15:12:00.052705+0000","last_became_active":"2024-09-13T15:12:00.043199+0000","last_became_peered":"2024-09-13T15:12:00.043199+0000","last_unstale":"2024-09-13T15:12:00.052705+0000","last_undegraded":"2024-09-13T15:12:00.052705+0000","last_fullsized":"2024-09-13T15:12:00.052705+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.048211+0000","last_change":"2024-09-13T15:12:00.035895+0000","last_active":"2024-09-13T15:12:00.048211+0000","last_peered":"2024-09-13T15:12:00.048211+0000","last_clean":"2024-09-13T15:12:00.048211+0000","last_became_active":"2024-09-13T15:12:00.034657+0000","last_became_peered":"2024-09-13T15:12:00.034657+0000","last_unstale":"2024-09-13T15:12:00.048211+0000","last_undegraded":"2024-09-13T15:12:00.048211+0000","last_fullsized":"2024-09-13T15:12:00.048211+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:35.245497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058825+0000","last_change":"2024-09-13T15:12:00.052654+0000","last_active":"2024-09-13T15:12:00.058825+0000","last_peered":"2024-09-13T15:12:00.058825+0000","last_clean":"2024-09-13T15:12:00.058825+0000","last_became_active":"2024-09-13T15:12:00.052372+0000","last_became_peered":"2024-09-13T15:12:00.052372+0000","last_unstale":"2024-09-13T15:12:00.058825+0000","last_undegraded":"2024-09-13T15:12:00.058825+0000","last_fullsized":"2024-09-13T15:12:00.058825+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:19.101846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033919+0000","last_change":"2024-09-13T15:12:00.052675+0000","last_active":"2024-09-13T15:12:01.033919+0000","last_peered":"2024-09-13T15:12:01.033919+0000","last_clean":"2024-09-13T15:12:01.033919+0000","last_became_active":"2024-09-13T15:12:00.051961+0000","last_became_peered":"2024-09-13T15:12:00.051961+0000","last_unstale":"2024-09-13T15:12:01.033919+0000","last_undegraded":"2024-09-13T15:12:01.033919+0000","last_fullsized":"2024-09-13T15:12:01.033919+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.069243+0000","last_change":"2024-09-13T15:12:00.062963+0000","last_active":"2024-09-13T15:12:00.069243+0000","last_peered":"2024-09-13T15:12:00.069243+0000","last_clean":"2024-09-13T15:12:00.069243+0000","last_became_active":"2024-09-13T15:12:00.062707+0000","last_became_peered":"2024-09-13T15:12:00.062707+0000","last_unstale":"2024-09-13T15:12:00.069243+0000","last_undegraded":"2024-09-13T15:12:00.069243+0000","last_fullsized":"2024-09-13T15:12:00.069243+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.047952+0000","last_change":"2024-09-13T15:12:00.040360+0000","last_active":"2024-09-13T15:12:00.047952+0000","last_peered":"2024-09-13T15:12:00.047952+0000","last_clean":"2024-09-13T15:12:00.047952+0000","last_became_active":"2024-09-13T15:12:00.040090+0000","last_became_peered":"2024-09-13T15:12:00.040090+0000","last_unstale":"2024-09-13T15:12:00.047952+0000","last_undegraded":"2024-09-13T15:12:00.047952+0000","last_fullsized":"2024-09-13T15:12:00.047952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:28.176497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029655+0000","last_change":"2024-09-13T15:12:00.058403+0000","last_active":"2024-09-13T15:12:01.029655+0000","last_peered":"2024-09-13T15:12:01.029655+0000","last_clean":"2024-09-13T15:12:01.029655+0000","last_became_active":"2024-09-13T15:12:00.058016+0000","last_became_peered":"2024-09-13T15:12:00.058016+0000","last_unstale":"2024-09-13T15:12:01.029655+0000","last_undegraded":"2024-09-13T15:12:01.029655+0000","last_fullsized":"2024-09-13T15:12:01.029655+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:28.176497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030749+0000","last_change":"2024-09-13T15:12:00.040494+0000","last_active":"2024-09-13T15:12:01.030749+0000","last_peered":"2024-09-13T15:12:01.030749+0000","last_clean":"2024-09-13T15:12:01.030749+0000","last_became_active":"2024-09-13T15:12:00.040222+0000","last_became_peered":"2024-09-13T15:12:00.040222+0000","last_unstale":"2024-09-13T15:12:01.030749+0000","last_undegraded":"2024-09-13T15:12:01.030749+0000","last_fullsized":"2024-09-13T15:12:01.030749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030690+0000","last_change":"2024-09-13T15:12:00.049549+0000","last_active":"2024-09-13T15:12:01.030690+0000","last_peered":"2024-09-13T15:12:01.030690+0000","last_clean":"2024-09-13T15:12:01.030690+0000","last_became_active":"2024-09-13T15:12:00.049141+0000","last_became_peered":"2024-09-13T15:12:00.049141+0000","last_unstale":"2024-09-13T15:12:01.030690+0000","last_undegraded":"2024-09-13T15:12:01.030690+0000","last_fullsized":"2024-09-13T15:12:01.030690+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:35.441465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030845+0000","last_change":"2024-09-13T15:12:00.041083+0000","last_active":"2024-09-13T15:12:01.030845+0000","last_peered":"2024-09-13T15:12:01.030845+0000","last_clean":"2024-09-13T15:12:01.030845+0000","last_became_active":"2024-09-13T15:12:00.040768+0000","last_became_peered":"2024-09-13T15:12:00.040768+0000","last_unstale":"2024-09-13T15:12:01.030845+0000","last_undegraded":"2024-09-13T15:12:01.030845+0000","last_fullsized":"2024-09-13T15:12:01.030845+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.059725+0000","last_change":"2024-09-13T15:12:00.057390+0000","last_active":"2024-09-13T15:12:00.059725+0000","last_peered":"2024-09-13T15:12:00.059725+0000","last_clean":"2024-09-13T15:12:00.059725+0000","last_became_active":"2024-09-13T15:12:00.056771+0000","last_became_peered":"2024-09-13T15:12:00.056771+0000","last_unstale":"2024-09-13T15:12:00.059725+0000","last_undegraded":"2024-09-13T15:12:00.059725+0000","last_fullsized":"2024-09-13T15:12:00.059725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:42.465594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.056598+0000","last_change":"2024-09-13T15:12:00.049079+0000","last_active":"2024-09-13T15:12:00.056598+0000","last_peered":"2024-09-13T15:12:00.056598+0000","last_clean":"2024-09-13T15:12:00.056598+0000","last_became_active":"2024-09-13T15:12:00.048798+0000","last_became_peered":"2024-09-13T15:12:00.048798+0000","last_unstale":"2024-09-13T15:12:00.056598+0000","last_undegraded":"2024-09-13T15:12:00.056598+0000","last_fullsized":"2024-09-13T15:12:00.056598+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:23.570177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055584+0000","last_change":"2024-09-13T15:12:00.054284+0000","last_active":"2024-09-13T15:12:00.055584+0000","last_peered":"2024-09-13T15:12:00.055584+0000","last_clean":"2024-09-13T15:12:00.055584+0000","last_became_active":"2024-09-13T15:12:00.053872+0000","last_became_peered":"2024-09-13T15:12:00.053872+0000","last_unstale":"2024-09-13T15:12:00.055584+0000","last_undegraded":"2024-09-13T15:12:00.055584+0000","last_fullsized":"2024-09-13T15:12:00.055584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:43.257819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.047823+0000","last_change":"2024-09-13T15:12:00.038773+0000","last_active":"2024-09-13T15:12:00.047823+0000","last_peered":"2024-09-13T15:12:00.047823+0000","last_clean":"2024-09-13T15:12:00.047823+0000","last_became_active":"2024-09-13T15:12:00.038418+0000","last_became_peered":"2024-09-13T15:12:00.038418+0000","last_unstale":"2024-09-13T15:12:00.047823+0000","last_undegraded":"2024-09-13T15:12:00.047823+0000","last_fullsized":"2024-09-13T15:12:00.047823+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:27.097104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058937+0000","last_change":"2024-09-13T15:12:00.057294+0000","last_active":"2024-09-13T15:12:00.058937+0000","last_peered":"2024-09-13T15:12:00.058937+0000","last_clean":"2024-09-13T15:12:00.058937+0000","last_became_active":"2024-09-13T15:12:00.056982+0000","last_became_peered":"2024-09-13T15:12:00.056982+0000","last_unstale":"2024-09-13T15:12:00.058937+0000","last_undegraded":"2024-09-13T15:12:00.058937+0000","last_fullsized":"2024-09-13T15:12:00.058937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:35.367849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033418+0000","last_change":"2024-09-13T15:12:00.054340+0000","last_active":"2024-09-13T15:12:01.033418+0000","last_peered":"2024-09-13T15:12:01.033418+0000","last_clean":"2024-09-13T15:12:01.033418+0000","last_became_active":"2024-09-13T15:12:00.053099+0000","last_became_peered":"2024-09-13T15:12:00.053099+0000","last_unstale":"2024-09-13T15:12:01.033418+0000","last_undegraded":"2024-09-13T15:12:01.033418+0000","last_fullsized":"2024-09-13T15:12:01.033418+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.057865+0000","last_change":"2024-09-13T15:12:00.052915+0000","last_active":"2024-09-13T15:12:00.057865+0000","last_peered":"2024-09-13T15:12:00.057865+0000","last_clean":"2024-09-13T15:12:00.057865+0000","last_became_active":"2024-09-13T15:12:00.052666+0000","last_became_peered":"2024-09-13T15:12:00.052666+0000","last_unstale":"2024-09-13T15:12:00.057865+0000","last_undegraded":"2024-09-13T15:12:00.057865+0000","last_fullsized":"2024-09-13T15:12:00.057865+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:14.080358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033141+0000","last_change":"2024-09-13T15:12:00.045746+0000","last_active":"2024-09-13T15:12:01.033141+0000","last_peered":"2024-09-13T15:12:01.033141+0000","last_clean":"2024-09-13T15:12:01.033141+0000","last_became_active":"2024-09-13T15:12:00.045502+0000","last_became_peered":"2024-09-13T15:12:00.045502+0000","last_unstale":"2024-09-13T15:12:01.033141+0000","last_undegraded":"2024-09-13T15:12:01.033141+0000","last_fullsized":"2024-09-13T15:12:01.033141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:59.621013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055193+0000","last_change":"2024-09-13T15:12:00.052134+0000","last_active":"2024-09-13T15:12:00.055193+0000","last_peered":"2024-09-13T15:12:00.055193+0000","last_clean":"2024-09-13T15:12:00.055193+0000","last_became_active":"2024-09-13T15:12:00.051868+0000","last_became_peered":"2024-09-13T15:12:00.051868+0000","last_unstale":"2024-09-13T15:12:00.055193+0000","last_undegraded":"2024-09-13T15:12:00.055193+0000","last_fullsized":"2024-09-13T15:12:00.055193+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:04.458627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061982+0000","last_change":"2024-09-13T15:12:00.056986+0000","last_active":"2024-09-13T15:12:00.061982+0000","last_peered":"2024-09-13T15:12:00.061982+0000","last_clean":"2024-09-13T15:12:00.061982+0000","last_became_active":"2024-09-13T15:12:00.055493+0000","last_became_peered":"2024-09-13T15:12:00.055493+0000","last_unstale":"2024-09-13T15:12:00.061982+0000","last_undegraded":"2024-09-13T15:12:00.061982+0000","last_fullsized":"2024-09-13T15:12:00.061982+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:01.931912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.060806+0000","last_change":"2024-09-13T15:12:00.050413+0000","last_active":"2024-09-13T15:12:00.060806+0000","last_peered":"2024-09-13T15:12:00.060806+0000","last_clean":"2024-09-13T15:12:00.060806+0000","last_became_active":"2024-09-13T15:12:00.050168+0000","last_became_peered":"2024-09-13T15:12:00.050168+0000","last_unstale":"2024-09-13T15:12:00.060806+0000","last_undegraded":"2024-09-13T15:12:00.060806+0000","last_fullsized":"2024-09-13T15:12:00.060806+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.062840+0000","last_change":"2024-09-13T15:12:00.061314+0000","last_active":"2024-09-13T15:12:00.062840+0000","last_peered":"2024-09-13T15:12:00.062840+0000","last_clean":"2024-09-13T15:12:00.062840+0000","last_became_active":"2024-09-13T15:12:00.060972+0000","last_became_peered":"2024-09-13T15:12:00.060972+0000","last_unstale":"2024-09-13T15:12:00.062840+0000","last_undegraded":"2024-09-13T15:12:00.062840+0000","last_fullsized":"2024-09-13T15:12:00.062840+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051850+0000","last_change":"2024-09-13T15:12:00.043192+0000","last_active":"2024-09-13T15:12:00.051850+0000","last_peered":"2024-09-13T15:12:00.051850+0000","last_clean":"2024-09-13T15:12:00.051850+0000","last_became_active":"2024-09-13T15:12:00.042969+0000","last_became_peered":"2024-09-13T15:12:00.042969+0000","last_unstale":"2024-09-13T15:12:00.051850+0000","last_undegraded":"2024-09-13T15:12:00.051850+0000","last_fullsized":"2024-09-13T15:12:00.051850+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:16.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.053242+0000","last_change":"2024-09-13T15:12:00.051432+0000","last_active":"2024-09-13T15:12:00.053242+0000","last_peered":"2024-09-13T15:12:00.053242+0000","last_clean":"2024-09-13T15:12:00.053242+0000","last_became_active":"2024-09-13T15:12:00.051199+0000","last_became_peered":"2024-09-13T15:12:00.051199+0000","last_unstale":"2024-09-13T15:12:00.053242+0000","last_undegraded":"2024-09-13T15:12:00.053242+0000","last_fullsized":"2024-09-13T15:12:00.053242+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:28.314382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.056502+0000","last_change":"2024-09-13T15:12:00.048437+0000","last_active":"2024-09-13T15:12:00.056502+0000","last_peered":"2024-09-13T15:12:00.056502+0000","last_clean":"2024-09-13T15:12:00.056502+0000","last_became_active":"2024-09-13T15:12:00.048144+0000","last_became_peered":"2024-09-13T15:12:00.048144+0000","last_unstale":"2024-09-13T15:12:00.056502+0000","last_undegraded":"2024-09-13T15:12:00.056502+0000","last_fullsized":"2024-09-13T15:12:00.056502+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:46.465439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.040748+0000","last_change":"2024-09-13T15:12:00.032968+0000","last_active":"2024-09-13T15:12:00.040748+0000","last_peered":"2024-09-13T15:12:00.040748+0000","last_clean":"2024-09-13T15:12:00.040748+0000","last_became_active":"2024-09-13T15:12:00.032736+0000","last_became_peered":"2024-09-13T15:12:00.032736+0000","last_unstale":"2024-09-13T15:12:00.040748+0000","last_undegraded":"2024-09-13T15:12:00.040748+0000","last_fullsized":"2024-09-13T15:12:00.040748+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:03.794341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058772+0000","last_change":"2024-09-13T15:12:00.056325+0000","last_active":"2024-09-13T15:12:00.058772+0000","last_peered":"2024-09-13T15:12:00.058772+0000","last_clean":"2024-09-13T15:12:00.058772+0000","last_became_active":"2024-09-13T15:12:00.055981+0000","last_became_peered":"2024-09-13T15:12:00.055981+0000","last_unstale":"2024-09-13T15:12:00.058772+0000","last_undegraded":"2024-09-13T15:12:00.058772+0000","last_fullsized":"2024-09-13T15:12:00.058772+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:48.150657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"100'4","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030261+0000","last_change":"2024-09-13T15:11:59.545043+0000","last_active":"2024-09-13T15:12:01.030261+0000","last_peered":"2024-09-13T15:12:01.030261+0000","last_clean":"2024-09-13T15:12:01.030261+0000","last_became_active":"2024-09-13T15:11:59.544429+0000","last_became_peered":"2024-09-13T15:11:59.544429+0000","last_unstale":"2024-09-13T15:12:01.030261+0000","last_undegraded":"2024-09-13T15:12:01.030261+0000","last_fullsized":"2024-09-13T15:12:01.030261+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:45.055176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.048506+0000","last_change":"2024-09-13T15:12:00.035454+0000","last_active":"2024-09-13T15:12:00.048506+0000","last_peered":"2024-09-13T15:12:00.048506+0000","last_clean":"2024-09-13T15:12:00.048506+0000","last_became_active":"2024-09-13T15:12:00.035168+0000","last_became_peered":"2024-09-13T15:12:00.035168+0000","last_unstale":"2024-09-13T15:12:00.048506+0000","last_undegraded":"2024-09-13T15:12:00.048506+0000","last_fullsized":"2024-09-13T15:12:00.048506+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:46.865120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055280+0000","last_change":"2024-09-13T15:11:59.540959+0000","last_active":"2024-09-13T15:12:00.055280+0000","last_peered":"2024-09-13T15:12:00.055280+0000","last_clean":"2024-09-13T15:12:00.055280+0000","last_became_active":"2024-09-13T15:11:59.540672+0000","last_became_peered":"2024-09-13T15:11:59.540672+0000","last_unstale":"2024-09-13T15:12:00.055280+0000","last_undegraded":"2024-09-13T15:12:00.055280+0000","last_fullsized":"2024-09-13T15:12:00.055280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.811879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.048562+0000","last_change":"2024-09-13T15:12:00.036896+0000","last_active":"2024-09-13T15:12:00.048562+0000","last_peered":"2024-09-13T15:12:00.048562+0000","last_clean":"2024-09-13T15:12:00.048562+0000","last_became_active":"2024-09-13T15:12:00.035999+0000","last_became_peered":"2024-09-13T15:12:00.035999+0000","last_unstale":"2024-09-13T15:12:00.048562+0000","last_undegraded":"2024-09-13T15:12:00.048562+0000","last_fullsized":"2024-09-13T15:12:00.048562+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:47.913308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055170+0000","last_change":"2024-09-13T15:11:59.545360+0000","last_active":"2024-09-13T15:12:00.055170+0000","last_peered":"2024-09-13T15:12:00.055170+0000","last_clean":"2024-09-13T15:12:00.055170+0000","last_became_active":"2024-09-13T15:11:59.544368+0000","last_became_peered":"2024-09-13T15:11:59.544368+0000","last_unstale":"2024-09-13T15:12:00.055170+0000","last_undegraded":"2024-09-13T15:12:00.055170+0000","last_fullsized":"2024-09-13T15:12:00.055170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:04.442189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061793+0000","last_change":"2024-09-13T15:12:00.057197+0000","last_active":"2024-09-13T15:12:00.061793+0000","last_peered":"2024-09-13T15:12:00.061793+0000","last_clean":"2024-09-13T15:12:00.061793+0000","last_became_active":"2024-09-13T15:12:00.056093+0000","last_became_peered":"2024-09-13T15:12:00.056093+0000","last_unstale":"2024-09-13T15:12:00.061793+0000","last_undegraded":"2024-09-13T15:12:00.061793+0000","last_fullsized":"2024-09-13T15:12:00.061793+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:59.621013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"100'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033599+0000","last_change":"2024-09-13T15:11:59.552447+0000","last_active":"2024-09-13T15:12:01.033599+0000","last_peered":"2024-09-13T15:12:01.033599+0000","last_clean":"2024-09-13T15:12:01.033599+0000","last_became_active":"2024-09-13T15:11:59.552130+0000","last_became_peered":"2024-09-13T15:11:59.552130+0000","last_unstale":"2024-09-13T15:12:01.033599+0000","last_undegraded":"2024-09-13T15:12:01.033599+0000","last_fullsized":"2024-09-13T15:12:01.033599+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:12.917799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030258+0000","last_change":"2024-09-13T15:12:00.040131+0000","last_active":"2024-09-13T15:12:01.030258+0000","last_peered":"2024-09-13T15:12:01.030258+0000","last_clean":"2024-09-13T15:12:01.030258+0000","last_became_active":"2024-09-13T15:12:00.039881+0000","last_became_peered":"2024-09-13T15:12:00.039881+0000","last_unstale":"2024-09-13T15:12:01.030258+0000","last_undegraded":"2024-09-13T15:12:01.030258+0000","last_fullsized":"2024-09-13T15:12:01.030258+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:01.931912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"100'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.031250+0000","last_change":"2024-09-13T15:11:59.545820+0000","last_active":"2024-09-13T15:12:01.031250+0000","last_peered":"2024-09-13T15:12:01.031250+0000","last_clean":"2024-09-13T15:12:01.031250+0000","last_became_active":"2024-09-13T15:11:59.545422+0000","last_became_peered":"2024-09-13T15:11:59.545422+0000","last_unstale":"2024-09-13T15:12:01.031250+0000","last_undegraded":"2024-09-13T15:12:01.031250+0000","last_fullsized":"2024-09-13T15:12:01.031250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:32.846115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055563+0000","last_change":"2024-09-13T15:12:00.054120+0000","last_active":"2024-09-13T15:12:00.055563+0000","last_peered":"2024-09-13T15:12:00.055563+0000","last_clean":"2024-09-13T15:12:00.055563+0000","last_became_active":"2024-09-13T15:12:00.053841+0000","last_became_peered":"2024-09-13T15:12:00.053841+0000","last_unstale":"2024-09-13T15:12:00.055563+0000","last_undegraded":"2024-09-13T15:12:00.055563+0000","last_fullsized":"2024-09-13T15:12:00.055563+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:22.517529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.057391+0000","last_change":"2024-09-13T15:11:59.541143+0000","last_active":"2024-09-13T15:12:00.057391+0000","last_peered":"2024-09-13T15:12:00.057391+0000","last_clean":"2024-09-13T15:12:00.057391+0000","last_became_active":"2024-09-13T15:11:59.537183+0000","last_became_peered":"2024-09-13T15:11:59.537183+0000","last_unstale":"2024-09-13T15:12:00.057391+0000","last_undegraded":"2024-09-13T15:12:00.057391+0000","last_fullsized":"2024-09-13T15:12:00.057391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:12.917799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.063349+0000","last_change":"2024-09-13T15:12:00.062636+0000","last_active":"2024-09-13T15:12:00.063349+0000","last_peered":"2024-09-13T15:12:00.063349+0000","last_clean":"2024-09-13T15:12:00.063349+0000","last_became_active":"2024-09-13T15:12:00.061620+0000","last_became_peered":"2024-09-13T15:12:00.061620+0000","last_unstale":"2024-09-13T15:12:00.063349+0000","last_undegraded":"2024-09-13T15:12:00.063349+0000","last_fullsized":"2024-09-13T15:12:00.063349+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.027367+0000","last_change":"2024-09-13T15:11:59.544744+0000","last_active":"2024-09-13T15:12:00.027367+0000","last_peered":"2024-09-13T15:12:00.027367+0000","last_clean":"2024-09-13T15:12:00.027367+0000","last_became_active":"2024-09-13T15:11:59.544432+0000","last_became_peered":"2024-09-13T15:11:59.544432+0000","last_unstale":"2024-09-13T15:12:00.027367+0000","last_undegraded":"2024-09-13T15:12:00.027367+0000","last_fullsized":"2024-09-13T15:12:00.027367+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:58.607521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030212+0000","last_change":"2024-09-13T15:12:00.048314+0000","last_active":"2024-09-13T15:12:01.030212+0000","last_peered":"2024-09-13T15:12:01.030212+0000","last_clean":"2024-09-13T15:12:01.030212+0000","last_became_active":"2024-09-13T15:12:00.048085+0000","last_became_peered":"2024-09-13T15:12:00.048085+0000","last_unstale":"2024-09-13T15:12:01.030212+0000","last_undegraded":"2024-09-13T15:12:01.030212+0000","last_fullsized":"2024-09-13T15:12:01.030212+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:27.097104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029364+0000","last_change":"2024-09-13T15:11:59.543043+0000","last_active":"2024-09-13T15:12:01.029364+0000","last_peered":"2024-09-13T15:12:01.029364+0000","last_clean":"2024-09-13T15:12:01.029364+0000","last_became_active":"2024-09-13T15:11:59.542771+0000","last_became_peered":"2024-09-13T15:11:59.542771+0000","last_unstale":"2024-09-13T15:12:01.029364+0000","last_undegraded":"2024-09-13T15:12:01.029364+0000","last_fullsized":"2024-09-13T15:12:01.029364+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:35.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058755+0000","last_change":"2024-09-13T15:12:00.056218+0000","last_active":"2024-09-13T15:12:00.058755+0000","last_peered":"2024-09-13T15:12:00.058755+0000","last_clean":"2024-09-13T15:12:00.058755+0000","last_became_active":"2024-09-13T15:12:00.055662+0000","last_became_peered":"2024-09-13T15:12:00.055662+0000","last_unstale":"2024-09-13T15:12:00.058755+0000","last_undegraded":"2024-09-13T15:12:00.058755+0000","last_fullsized":"2024-09-13T15:12:00.058755+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:45.811185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026442+0000","last_change":"2024-09-13T15:11:59.548424+0000","last_active":"2024-09-13T15:12:00.026442+0000","last_peered":"2024-09-13T15:12:00.026442+0000","last_clean":"2024-09-13T15:12:00.026442+0000","last_became_active":"2024-09-13T15:11:59.548108+0000","last_became_peered":"2024-09-13T15:11:59.548108+0000","last_unstale":"2024-09-13T15:12:00.026442+0000","last_undegraded":"2024-09-13T15:12:00.026442+0000","last_fullsized":"2024-09-13T15:12:00.026442+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:35.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033333+0000","last_change":"2024-09-13T15:12:00.045485+0000","last_active":"2024-09-13T15:12:01.033333+0000","last_peered":"2024-09-13T15:12:01.033333+0000","last_clean":"2024-09-13T15:12:01.033333+0000","last_became_active":"2024-09-13T15:12:00.045229+0000","last_became_peered":"2024-09-13T15:12:00.045229+0000","last_unstale":"2024-09-13T15:12:01.033333+0000","last_undegraded":"2024-09-13T15:12:01.033333+0000","last_fullsized":"2024-09-13T15:12:01.033333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:35.441465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026824+0000","last_change":"2024-09-13T15:11:59.550289+0000","last_active":"2024-09-13T15:12:00.026824+0000","last_peered":"2024-09-13T15:12:00.026824+0000","last_clean":"2024-09-13T15:12:00.026824+0000","last_became_active":"2024-09-13T15:11:59.549969+0000","last_became_peered":"2024-09-13T15:11:59.549969+0000","last_unstale":"2024-09-13T15:12:00.026824+0000","last_undegraded":"2024-09-13T15:12:00.026824+0000","last_fullsized":"2024-09-13T15:12:00.026824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:49.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051043+0000","last_change":"2024-09-13T15:12:00.039491+0000","last_active":"2024-09-13T15:12:00.051043+0000","last_peered":"2024-09-13T15:12:00.051043+0000","last_clean":"2024-09-13T15:12:00.051043+0000","last_became_active":"2024-09-13T15:12:00.038364+0000","last_became_peered":"2024-09-13T15:12:00.038364+0000","last_unstale":"2024-09-13T15:12:00.051043+0000","last_undegraded":"2024-09-13T15:12:00.051043+0000","last_fullsized":"2024-09-13T15:12:00.051043+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:29.490755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"100'3","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030994+0000","last_change":"2024-09-13T15:11:59.544743+0000","last_active":"2024-09-13T15:12:01.030994+0000","last_peered":"2024-09-13T15:12:01.030994+0000","last_clean":"2024-09-13T15:12:01.030994+0000","last_became_active":"2024-09-13T15:11:59.544415+0000","last_became_peered":"2024-09-13T15:11:59.544415+0000","last_unstale":"2024-09-13T15:12:01.030994+0000","last_undegraded":"2024-09-13T15:12:01.030994+0000","last_fullsized":"2024-09-13T15:12:01.030994+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:30.234669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033663+0000","last_change":"2024-09-13T15:12:00.047632+0000","last_active":"2024-09-13T15:12:01.033663+0000","last_peered":"2024-09-13T15:12:01.033663+0000","last_clean":"2024-09-13T15:12:01.033663+0000","last_became_active":"2024-09-13T15:12:00.046870+0000","last_became_peered":"2024-09-13T15:12:00.046870+0000","last_unstale":"2024-09-13T15:12:01.033663+0000","last_undegraded":"2024-09-13T15:12:01.033663+0000","last_fullsized":"2024-09-13T15:12:01.033663+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:23.570177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.064599+0000","last_change":"2024-09-13T15:11:59.545072+0000","last_active":"2024-09-13T15:12:00.064599+0000","last_peered":"2024-09-13T15:12:00.064599+0000","last_clean":"2024-09-13T15:12:00.064599+0000","last_became_active":"2024-09-13T15:11:59.544827+0000","last_became_peered":"2024-09-13T15:11:59.544827+0000","last_unstale":"2024-09-13T15:12:00.064599+0000","last_undegraded":"2024-09-13T15:12:00.064599+0000","last_fullsized":"2024-09-13T15:12:00.064599+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:21.710431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.060924+0000","last_change":"2024-09-13T15:12:00.051040+0000","last_active":"2024-09-13T15:12:00.060924+0000","last_peered":"2024-09-13T15:12:00.060924+0000","last_clean":"2024-09-13T15:12:00.060924+0000","last_became_active":"2024-09-13T15:12:00.050772+0000","last_became_peered":"2024-09-13T15:12:00.050772+0000","last_unstale":"2024-09-13T15:12:00.060924+0000","last_undegraded":"2024-09-13T15:12:00.060924+0000","last_fullsized":"2024-09-13T15:12:00.060924+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:19.101846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"100'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033743+0000","last_change":"2024-09-13T15:11:59.552315+0000","last_active":"2024-09-13T15:12:01.033743+0000","last_peered":"2024-09-13T15:12:01.033743+0000","last_clean":"2024-09-13T15:12:01.033743+0000","last_became_active":"2024-09-13T15:11:59.552010+0000","last_became_peered":"2024-09-13T15:11:59.552010+0000","last_unstale":"2024-09-13T15:12:01.033743+0000","last_undegraded":"2024-09-13T15:12:01.033743+0000","last_fullsized":"2024-09-13T15:12:01.033743+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:34.635724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058625+0000","last_change":"2024-09-13T15:12:00.052059+0000","last_active":"2024-09-13T15:12:00.058625+0000","last_peered":"2024-09-13T15:12:00.058625+0000","last_clean":"2024-09-13T15:12:00.058625+0000","last_became_active":"2024-09-13T15:12:00.051771+0000","last_became_peered":"2024-09-13T15:12:00.051771+0000","last_unstale":"2024-09-13T15:12:00.058625+0000","last_undegraded":"2024-09-13T15:12:00.058625+0000","last_fullsized":"2024-09-13T15:12:00.058625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:31.248161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029759+0000","last_change":"2024-09-13T15:11:59.542869+0000","last_active":"2024-09-13T15:12:01.029759+0000","last_peered":"2024-09-13T15:12:01.029759+0000","last_clean":"2024-09-13T15:12:01.029759+0000","last_became_active":"2024-09-13T15:11:59.542551+0000","last_became_peered":"2024-09-13T15:11:59.542551+0000","last_unstale":"2024-09-13T15:12:01.029759+0000","last_undegraded":"2024-09-13T15:12:01.029759+0000","last_fullsized":"2024-09-13T15:12:01.029759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:34.427973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.040370+0000","last_change":"2024-09-13T15:12:00.033912+0000","last_active":"2024-09-13T15:12:00.040370+0000","last_peered":"2024-09-13T15:12:00.040370+0000","last_clean":"2024-09-13T15:12:00.040370+0000","last_became_active":"2024-09-13T15:12:00.033671+0000","last_became_peered":"2024-09-13T15:12:00.033671+0000","last_unstale":"2024-09-13T15:12:00.040370+0000","last_undegraded":"2024-09-13T15:12:00.040370+0000","last_fullsized":"2024-09-13T15:12:00.040370+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:32.141378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.020068+0000","last_change":"2024-09-13T15:11:59.539208+0000","last_active":"2024-09-13T15:12:00.020068+0000","last_peered":"2024-09-13T15:12:00.020068+0000","last_clean":"2024-09-13T15:12:00.020068+0000","last_became_active":"2024-09-13T15:11:59.538916+0000","last_became_peered":"2024-09-13T15:11:59.538916+0000","last_unstale":"2024-09-13T15:12:00.020068+0000","last_undegraded":"2024-09-13T15:12:00.020068+0000","last_fullsized":"2024-09-13T15:12:00.020068+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:19.713117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.059743+0000","last_change":"2024-09-13T15:12:00.057544+0000","last_active":"2024-09-13T15:12:00.059743+0000","last_peered":"2024-09-13T15:12:00.059743+0000","last_clean":"2024-09-13T15:12:00.059743+0000","last_became_active":"2024-09-13T15:12:00.057161+0000","last_became_peered":"2024-09-13T15:12:00.057161+0000","last_unstale":"2024-09-13T15:12:00.059743+0000","last_undegraded":"2024-09-13T15:12:00.059743+0000","last_fullsized":"2024-09-13T15:12:00.059743+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:57.961856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.059502+0000","last_change":"2024-09-13T15:11:59.545042+0000","last_active":"2024-09-13T15:12:00.059502+0000","last_peered":"2024-09-13T15:12:00.059502+0000","last_clean":"2024-09-13T15:12:00.059502+0000","last_became_active":"2024-09-13T15:11:59.544318+0000","last_became_peered":"2024-09-13T15:11:59.544318+0000","last_unstale":"2024-09-13T15:12:00.059502+0000","last_undegraded":"2024-09-13T15:12:00.059502+0000","last_fullsized":"2024-09-13T15:12:00.059502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:18.088355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051532+0000","last_change":"2024-09-13T15:12:00.042451+0000","last_active":"2024-09-13T15:12:00.051532+0000","last_peered":"2024-09-13T15:12:00.051532+0000","last_clean":"2024-09-13T15:12:00.051532+0000","last_became_active":"2024-09-13T15:12:00.042224+0000","last_became_peered":"2024-09-13T15:12:00.042224+0000","last_unstale":"2024-09-13T15:12:00.051532+0000","last_undegraded":"2024-09-13T15:12:00.051532+0000","last_fullsized":"2024-09-13T15:12:00.051532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:45.952606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058511+0000","last_change":"2024-09-13T15:11:59.547449+0000","last_active":"2024-09-13T15:12:00.058511+0000","last_peered":"2024-09-13T15:12:00.058511+0000","last_clean":"2024-09-13T15:12:00.058511+0000","last_became_active":"2024-09-13T15:11:59.547121+0000","last_became_peered":"2024-09-13T15:11:59.547121+0000","last_unstale":"2024-09-13T15:12:00.058511+0000","last_undegraded":"2024-09-13T15:12:00.058511+0000","last_fullsized":"2024-09-13T15:12:00.058511+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:35.300868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058410+0000","last_change":"2024-09-13T15:12:00.051935+0000","last_active":"2024-09-13T15:12:00.058410+0000","last_peered":"2024-09-13T15:12:00.058410+0000","last_clean":"2024-09-13T15:12:00.058410+0000","last_became_active":"2024-09-13T15:12:00.051461+0000","last_became_peered":"2024-09-13T15:12:00.051461+0000","last_unstale":"2024-09-13T15:12:00.058410+0000","last_undegraded":"2024-09-13T15:12:00.058410+0000","last_fullsized":"2024-09-13T15:12:00.058410+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"100'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.031133+0000","last_change":"2024-09-13T15:11:59.550590+0000","last_active":"2024-09-13T15:12:01.031133+0000","last_peered":"2024-09-13T15:12:01.031133+0000","last_clean":"2024-09-13T15:12:01.031133+0000","last_became_active":"2024-09-13T15:11:59.550248+0000","last_became_peered":"2024-09-13T15:11:59.550248+0000","last_unstale":"2024-09-13T15:12:01.031133+0000","last_undegraded":"2024-09-13T15:12:01.031133+0000","last_fullsized":"2024-09-13T15:12:01.031133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:23.976064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033618+0000","last_change":"2024-09-13T15:12:00.047779+0000","last_active":"2024-09-13T15:12:01.033618+0000","last_peered":"2024-09-13T15:12:01.033618+0000","last_clean":"2024-09-13T15:12:01.033618+0000","last_became_active":"2024-09-13T15:12:00.047224+0000","last_became_peered":"2024-09-13T15:12:00.047224+0000","last_unstale":"2024-09-13T15:12:01.033618+0000","last_undegraded":"2024-09-13T15:12:01.033618+0000","last_fullsized":"2024-09-13T15:12:01.033618+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:19.101846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.045107+0000","last_change":"2024-09-13T15:11:59.540549+0000","last_active":"2024-09-13T15:12:00.045107+0000","last_peered":"2024-09-13T15:12:00.045107+0000","last_clean":"2024-09-13T15:12:00.045107+0000","last_became_active":"2024-09-13T15:11:59.540301+0000","last_became_peered":"2024-09-13T15:11:59.540301+0000","last_unstale":"2024-09-13T15:12:00.045107+0000","last_undegraded":"2024-09-13T15:12:00.045107+0000","last_fullsized":"2024-09-13T15:12:00.045107+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:34.635724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.050299+0000","last_change":"2024-09-13T15:12:00.047239+0000","last_active":"2024-09-13T15:12:00.050299+0000","last_peered":"2024-09-13T15:12:00.050299+0000","last_clean":"2024-09-13T15:12:00.050299+0000","last_became_active":"2024-09-13T15:12:00.044687+0000","last_became_peered":"2024-09-13T15:12:00.044687+0000","last_unstale":"2024-09-13T15:12:00.050299+0000","last_undegraded":"2024-09-13T15:12:00.050299+0000","last_fullsized":"2024-09-13T15:12:00.050299+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:38:40.003963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051871+0000","last_change":"2024-09-13T15:11:59.545273+0000","last_active":"2024-09-13T15:12:00.051871+0000","last_peered":"2024-09-13T15:12:00.051871+0000","last_clean":"2024-09-13T15:12:00.051871+0000","last_became_active":"2024-09-13T15:11:59.544983+0000","last_became_peered":"2024-09-13T15:11:59.544983+0000","last_unstale":"2024-09-13T15:12:00.051871+0000","last_undegraded":"2024-09-13T15:12:00.051871+0000","last_fullsized":"2024-09-13T15:12:00.051871+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.507124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.044423+0000","last_change":"2024-09-13T15:12:00.041318+0000","last_active":"2024-09-13T15:12:00.044423+0000","last_peered":"2024-09-13T15:12:00.044423+0000","last_clean":"2024-09-13T15:12:00.044423+0000","last_became_active":"2024-09-13T15:12:00.041046+0000","last_became_peered":"2024-09-13T15:12:00.041046+0000","last_unstale":"2024-09-13T15:12:00.044423+0000","last_undegraded":"2024-09-13T15:12:00.044423+0000","last_fullsized":"2024-09-13T15:12:00.044423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:57.681151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.020245+0000","last_change":"2024-09-13T15:11:59.539350+0000","last_active":"2024-09-13T15:12:00.020245+0000","last_peered":"2024-09-13T15:12:00.020245+0000","last_clean":"2024-09-13T15:12:00.020245+0000","last_became_active":"2024-09-13T15:11:59.539043+0000","last_became_peered":"2024-09-13T15:11:59.539043+0000","last_unstale":"2024-09-13T15:12:00.020245+0000","last_undegraded":"2024-09-13T15:12:00.020245+0000","last_fullsized":"2024-09-13T15:12:00.020245+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:46.872782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029994+0000","last_change":"2024-09-13T15:12:00.054992+0000","last_active":"2024-09-13T15:12:01.029994+0000","last_peered":"2024-09-13T15:12:01.029994+0000","last_clean":"2024-09-13T15:12:01.029994+0000","last_became_active":"2024-09-13T15:12:00.054704+0000","last_became_peered":"2024-09-13T15:12:00.054704+0000","last_unstale":"2024-09-13T15:12:01.029994+0000","last_undegraded":"2024-09-13T15:12:01.029994+0000","last_fullsized":"2024-09-13T15:12:01.029994+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:28.314382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041620+0000","last_change":"2024-09-13T15:11:59.544815+0000","last_active":"2024-09-13T15:12:00.041620+0000","last_peered":"2024-09-13T15:12:00.041620+0000","last_clean":"2024-09-13T15:12:00.041620+0000","last_became_active":"2024-09-13T15:11:59.544407+0000","last_became_peered":"2024-09-13T15:11:59.544407+0000","last_unstale":"2024-09-13T15:12:00.041620+0000","last_undegraded":"2024-09-13T15:12:00.041620+0000","last_fullsized":"2024-09-13T15:12:00.041620+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:10.248001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051051+0000","last_change":"2024-09-13T15:12:00.038023+0000","last_active":"2024-09-13T15:12:00.051051+0000","last_peered":"2024-09-13T15:12:00.051051+0000","last_clean":"2024-09-13T15:12:00.051051+0000","last_became_active":"2024-09-13T15:12:00.037351+0000","last_became_peered":"2024-09-13T15:12:00.037351+0000","last_unstale":"2024-09-13T15:12:00.051051+0000","last_undegraded":"2024-09-13T15:12:00.051051+0000","last_fullsized":"2024-09-13T15:12:00.051051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:24.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.019492+0000","last_change":"2024-09-13T15:11:59.540837+0000","last_active":"2024-09-13T15:12:00.019492+0000","last_peered":"2024-09-13T15:12:00.019492+0000","last_clean":"2024-09-13T15:12:00.019492+0000","last_became_active":"2024-09-13T15:11:59.539945+0000","last_became_peered":"2024-09-13T15:11:59.539945+0000","last_unstale":"2024-09-13T15:12:00.019492+0000","last_undegraded":"2024-09-13T15:12:00.019492+0000","last_fullsized":"2024-09-13T15:12:00.019492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:22.196459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.046998+0000","last_change":"2024-09-13T15:12:00.041587+0000","last_active":"2024-09-13T15:12:00.046998+0000","last_peered":"2024-09-13T15:12:00.046998+0000","last_clean":"2024-09-13T15:12:00.046998+0000","last_became_active":"2024-09-13T15:12:00.041308+0000","last_became_peered":"2024-09-13T15:12:00.041308+0000","last_unstale":"2024-09-13T15:12:00.046998+0000","last_undegraded":"2024-09-13T15:12:00.046998+0000","last_fullsized":"2024-09-13T15:12:00.046998+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:09.572393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"100'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033987+0000","last_change":"2024-09-13T15:11:59.552328+0000","last_active":"2024-09-13T15:12:01.033987+0000","last_peered":"2024-09-13T15:12:01.033987+0000","last_clean":"2024-09-13T15:12:01.033987+0000","last_became_active":"2024-09-13T15:11:59.551358+0000","last_became_peered":"2024-09-13T15:11:59.551358+0000","last_unstale":"2024-09-13T15:12:01.033987+0000","last_undegraded":"2024-09-13T15:12:01.033987+0000","last_fullsized":"2024-09-13T15:12:01.033987+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:52.745190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041481+0000","last_change":"2024-09-13T15:12:00.032186+0000","last_active":"2024-09-13T15:12:00.041481+0000","last_peered":"2024-09-13T15:12:00.041481+0000","last_clean":"2024-09-13T15:12:00.041481+0000","last_became_active":"2024-09-13T15:12:00.031936+0000","last_became_peered":"2024-09-13T15:12:00.031936+0000","last_unstale":"2024-09-13T15:12:00.041481+0000","last_undegraded":"2024-09-13T15:12:00.041481+0000","last_fullsized":"2024-09-13T15:12:00.041481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.486988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026931+0000","last_change":"2024-09-13T15:11:59.546511+0000","last_active":"2024-09-13T15:12:00.026931+0000","last_peered":"2024-09-13T15:12:00.026931+0000","last_clean":"2024-09-13T15:12:00.026931+0000","last_became_active":"2024-09-13T15:11:59.546226+0000","last_became_peered":"2024-09-13T15:11:59.546226+0000","last_unstale":"2024-09-13T15:12:00.026931+0000","last_undegraded":"2024-09-13T15:12:00.026931+0000","last_fullsized":"2024-09-13T15:12:00.026931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:35.744655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029629+0000","last_change":"2024-09-13T15:12:00.047687+0000","last_active":"2024-09-13T15:12:01.029629+0000","last_peered":"2024-09-13T15:12:01.029629+0000","last_clean":"2024-09-13T15:12:01.029629+0000","last_became_active":"2024-09-13T15:12:00.047448+0000","last_became_peered":"2024-09-13T15:12:00.047448+0000","last_unstale":"2024-09-13T15:12:01.029629+0000","last_undegraded":"2024-09-13T15:12:01.029629+0000","last_fullsized":"2024-09-13T15:12:01.029629+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.486988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041895+0000","last_change":"2024-09-13T15:11:59.543102+0000","last_active":"2024-09-13T15:12:00.041895+0000","last_peered":"2024-09-13T15:12:00.041895+0000","last_clean":"2024-09-13T15:12:00.041895+0000","last_became_active":"2024-09-13T15:11:59.542829+0000","last_became_peered":"2024-09-13T15:11:59.542829+0000","last_unstale":"2024-09-13T15:12:00.041895+0000","last_undegraded":"2024-09-13T15:12:00.041895+0000","last_fullsized":"2024-09-13T15:12:00.041895+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:21.824256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061103+0000","last_change":"2024-09-13T15:12:00.053434+0000","last_active":"2024-09-13T15:12:00.061103+0000","last_peered":"2024-09-13T15:12:00.061103+0000","last_clean":"2024-09-13T15:12:00.061103+0000","last_became_active":"2024-09-13T15:12:00.053149+0000","last_became_peered":"2024-09-13T15:12:00.053149+0000","last_unstale":"2024-09-13T15:12:00.061103+0000","last_undegraded":"2024-09-13T15:12:00.061103+0000","last_fullsized":"2024-09-13T15:12:00.061103+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033668+0000","last_change":"2024-09-13T15:11:59.549853+0000","last_active":"2024-09-13T15:12:01.033668+0000","last_peered":"2024-09-13T15:12:01.033668+0000","last_clean":"2024-09-13T15:12:01.033668+0000","last_became_active":"2024-09-13T15:11:59.549092+0000","last_became_peered":"2024-09-13T15:11:59.549092+0000","last_unstale":"2024-09-13T15:12:01.033668+0000","last_undegraded":"2024-09-13T15:12:01.033668+0000","last_fullsized":"2024-09-13T15:12:01.033668+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:45.932744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.050147+0000","last_change":"2024-09-13T15:12:00.035331+0000","last_active":"2024-09-13T15:12:00.050147+0000","last_peered":"2024-09-13T15:12:00.050147+0000","last_clean":"2024-09-13T15:12:00.050147+0000","last_became_active":"2024-09-13T15:12:00.035084+0000","last_became_peered":"2024-09-13T15:12:00.035084+0000","last_unstale":"2024-09-13T15:12:00.050147+0000","last_undegraded":"2024-09-13T15:12:00.050147+0000","last_fullsized":"2024-09-13T15:12:00.050147+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:17.742523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026439+0000","last_change":"2024-09-13T15:11:59.539724+0000","last_active":"2024-09-13T15:12:00.026439+0000","last_peered":"2024-09-13T15:12:00.026439+0000","last_clean":"2024-09-13T15:12:00.026439+0000","last_became_active":"2024-09-13T15:11:59.539405+0000","last_became_peered":"2024-09-13T15:11:59.539405+0000","last_unstale":"2024-09-13T15:12:00.026439+0000","last_undegraded":"2024-09-13T15:12:00.026439+0000","last_fullsized":"2024-09-13T15:12:00.026439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:00.152779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041686+0000","last_change":"2024-09-13T15:12:00.034021+0000","last_active":"2024-09-13T15:12:00.041686+0000","last_peered":"2024-09-13T15:12:00.041686+0000","last_clean":"2024-09-13T15:12:00.041686+0000","last_became_active":"2024-09-13T15:12:00.033769+0000","last_became_peered":"2024-09-13T15:12:00.033769+0000","last_unstale":"2024-09-13T15:12:00.041686+0000","last_undegraded":"2024-09-13T15:12:00.041686+0000","last_fullsized":"2024-09-13T15:12:00.041686+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:15.092681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.020896+0000","last_change":"2024-09-13T15:11:59.539325+0000","last_active":"2024-09-13T15:12:00.020896+0000","last_peered":"2024-09-13T15:12:00.020896+0000","last_clean":"2024-09-13T15:12:00.020896+0000","last_became_active":"2024-09-13T15:11:59.539016+0000","last_became_peered":"2024-09-13T15:11:59.539016+0000","last_unstale":"2024-09-13T15:12:00.020896+0000","last_undegraded":"2024-09-13T15:12:00.020896+0000","last_fullsized":"2024-09-13T15:12:00.020896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:56.698231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.031167+0000","last_change":"2024-09-13T15:12:00.057510+0000","last_active":"2024-09-13T15:12:01.031167+0000","last_peered":"2024-09-13T15:12:01.031167+0000","last_clean":"2024-09-13T15:12:01.031167+0000","last_became_active":"2024-09-13T15:12:00.057226+0000","last_became_peered":"2024-09-13T15:12:00.057226+0000","last_unstale":"2024-09-13T15:12:01.031167+0000","last_undegraded":"2024-09-13T15:12:01.031167+0000","last_fullsized":"2024-09-13T15:12:01.031167+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041730+0000","last_change":"2024-09-13T15:11:59.540864+0000","last_active":"2024-09-13T15:12:00.041730+0000","last_peered":"2024-09-13T15:12:00.041730+0000","last_clean":"2024-09-13T15:12:00.041730+0000","last_became_active":"2024-09-13T15:11:59.540602+0000","last_became_peered":"2024-09-13T15:11:59.540602+0000","last_unstale":"2024-09-13T15:12:00.041730+0000","last_undegraded":"2024-09-13T15:12:00.041730+0000","last_fullsized":"2024-09-13T15:12:00.041730+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:09.621287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061489+0000","last_change":"2024-09-13T15:12:00.055093+0000","last_active":"2024-09-13T15:12:00.061489+0000","last_peered":"2024-09-13T15:12:00.061489+0000","last_clean":"2024-09-13T15:12:00.061489+0000","last_became_active":"2024-09-13T15:12:00.054850+0000","last_became_peered":"2024-09-13T15:12:00.054850+0000","last_unstale":"2024-09-13T15:12:00.061489+0000","last_undegraded":"2024-09-13T15:12:00.061489+0000","last_fullsized":"2024-09-13T15:12:00.061489+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:23.758115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.019644+0000","last_change":"2024-09-13T15:11:59.541075+0000","last_active":"2024-09-13T15:12:00.019644+0000","last_peered":"2024-09-13T15:12:00.019644+0000","last_clean":"2024-09-13T15:12:00.019644+0000","last_became_active":"2024-09-13T15:11:59.540537+0000","last_became_peered":"2024-09-13T15:11:59.540537+0000","last_unstale":"2024-09-13T15:12:00.019644+0000","last_undegraded":"2024-09-13T15:12:00.019644+0000","last_fullsized":"2024-09-13T15:12:00.019644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:02.994784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061162+0000","last_change":"2024-09-13T15:12:00.053674+0000","last_active":"2024-09-13T15:12:00.061162+0000","last_peered":"2024-09-13T15:12:00.061162+0000","last_clean":"2024-09-13T15:12:00.061162+0000","last_became_active":"2024-09-13T15:12:00.047926+0000","last_became_peered":"2024-09-13T15:12:00.047926+0000","last_unstale":"2024-09-13T15:12:00.061162+0000","last_undegraded":"2024-09-13T15:12:00.061162+0000","last_fullsized":"2024-09-13T15:12:00.061162+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051601+0000","last_change":"2024-09-13T15:11:59.542410+0000","last_active":"2024-09-13T15:12:00.051601+0000","last_peered":"2024-09-13T15:12:00.051601+0000","last_clean":"2024-09-13T15:12:00.051601+0000","last_became_active":"2024-09-13T15:11:59.542091+0000","last_became_peered":"2024-09-13T15:11:59.542091+0000","last_unstale":"2024-09-13T15:12:00.051601+0000","last_undegraded":"2024-09-13T15:12:00.051601+0000","last_fullsized":"2024-09-13T15:12:00.051601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:58.377654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":231,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.028434+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:12:00.028434+0000","last_peered":"2024-09-13T15:12:00.028434+0000","last_clean":"2024-09-13T15:12:00.028434+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:12:00.028434+0000","last_undegraded":"2024-09-13T15:12:00.028434+0000","last_fullsized":"2024-09-13T15:12:00.028434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1843200,"data_stored":1152410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1599999999999999,"15min":1.1830000000000001},"min":{"1min":0.78600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.601,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.878},{"interface":"front","average":{"1min":1.181,"5min":1.234,"15min":1.2749999999999999},"min":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6379999999999999,"5min":1.839,"15min":1.839},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2689999999999999,"15min":1.349},"min":{"1min":0.94799999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.571,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1859999999999999,"15min":1.2490000000000001},"min":{"1min":0.83699999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.3819999999999999,"5min":1.577,"15min":1.577},"last":1.732}]},{"osd":2,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.284,"15min":1.3759999999999999},"min":{"1min":0.96299999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.5229999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3120000000000001,"15min":1.3580000000000001},"min":{"1min":0.96499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5900000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.4690000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.337,"15min":1.417},"min":{"1min":0.73599999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.528,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.022},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.411,"15min":1.5149999999999999},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.71,"5min":2.081,"15min":2.081},"last":1.6839999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2410000000000001,"15min":1.353},"min":{"1min":0.83199999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.462,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.3109999999999999,"15min":1.4179999999999999},"min":{"1min":0.63400000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.631,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.633}]},{"osd":5,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4399999999999999,"15min":1.5660000000000001},"min":{"1min":1.0089999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.758,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3839999999999999,"15min":1.4910000000000001},"min":{"1min":0.90100000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5700000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.8200000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4490000000000001,"15min":1.583},"min":{"1min":1.1759999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5249999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.492,"15min":1.625},"min":{"1min":0.95299999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.716,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.29}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1257472,"data_stored":563031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1359999999999999,"15min":1.1899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.8480000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.135,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.131,"15min":1.1359999999999999},"min":{"1min":0.78500000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6659999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.05},{"interface":"front","average":{"1min":1.343,"5min":1.2789999999999999,"15min":1.343},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.218}]},{"osd":2,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2430000000000001,"15min":1.29},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.895,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3340000000000001,"15min":1.3879999999999999},"min":{"1min":1.05,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7709999999999999,"5min":1.986,"15min":1.986},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3120000000000001,"15min":1.323},"min":{"1min":1.0660000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":1.121},{"interface":"front","average":{"1min":1.282,"5min":1.3140000000000001,"15min":1.3819999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.3180000000000001,"5min":2.371,"15min":2.371},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.284,"15min":1.3680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.9730000000000001,"5min":2.835,"15min":2.835},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.2589999999999999,"15min":1.361},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0089999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.2669999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2809999999999999,"15min":1.3049999999999999},"min":{"1min":0.78900000000000003,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8759999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.365},{"interface":"front","average":{"1min":1.393,"5min":1.49,"15min":1.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.0600000000000001,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.87}]},{"osd":7,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.81100000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.8149999999999999,"5min":2.444,"15min":2.444},"last":1.329},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.474,"15min":1.5389999999999999},"min":{"1min":1.018,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.1110000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.1890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1241088,"data_stored":561882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1930000000000001,"15min":1.2889999999999999},"min":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7090000000000001,"5min":1.869,"15min":1.869},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2090000000000001,"15min":1.349},"min":{"1min":0.65100000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.2070000000000001,"15min":1.2709999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1839999999999999,"15min":1.2490000000000001},"min":{"1min":0.80400000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.514,"5min":2.665,"15min":2.665},"last":1.284}]},{"osd":2,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.21,"15min":1.2609999999999999},"min":{"1min":0.78800000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.151},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.296,"15min":1.3660000000000001},"min":{"1min":0.77800000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2210000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2529999999999999,"15min":1.3320000000000001},"min":{"1min":0.81200000000000006,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8149999999999999,"5min":2.524,"15min":2.524},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4019999999999999,"15min":1.492},"min":{"1min":0.879,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.3380000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.304,"15min":1.3839999999999999},"min":{"1min":0.82299999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6279999999999999,"5min":2.012,"15min":2.012},"last":1.306},{"interface":"front","average":{"1min":1.284,"5min":1.375,"15min":1.478},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.1179999999999999,"5min":3.117,"15min":3.117},"last":0.97899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.3740000000000001,"15min":1.52},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.8200000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.016},{"interface":"front","average":{"1min":1.351,"5min":1.4359999999999999,"15min":1.569},"min":{"1min":0.99199999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.0600000000000001,"5min":2.411,"15min":2.411},"last":1.129}]},{"osd":7,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.421,"15min":1.5429999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2170000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.5109999999999999,"15min":1.659},"min":{"1min":0.80400000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3260000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.246}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1249280,"data_stored":561974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1120000000000001,"15min":1.1579999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.579,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.167,"15min":1.1970000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.627,"5min":1.78,"15min":1.78},"last":1.6259999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2070000000000001,"15min":1.2490000000000001},"min":{"1min":0.88500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5569999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1819999999999999,"15min":1.2250000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6559999999999999,"5min":1.794,"15min":1.794},"last":1.02}]},{"osd":2,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.171,"15min":1.1870000000000001},"min":{"1min":0.76400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.589,"5min":1.621,"15min":1.621},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3,"15min":1.3360000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5960000000000001,"5min":1.887,"15min":1.887},"last":1.7909999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2350000000000001,"15min":1.262},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.49,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.258,"15min":1.3280000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.75,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.5840000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3180000000000001,"15min":1.3700000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.389},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3440000000000001,"15min":1.389},"min":{"1min":0.75700000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7889999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2370000000000001,"15min":1.294},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.843,"5min":2.214,"15min":2.214},"last":1.677},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3759999999999999,"15min":1.4359999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6699999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3640000000000001,"15min":1.4339999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7150000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4139999999999999,"15min":1.484},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9470000000000001,"5min":2.524,"15min":2.524},"last":1.7589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1241088,"data_stored":561445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99399999999999999,"15min":1.0529999999999999},"min":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.3140000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.163},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.0740000000000001,"15min":1.085},"min":{"1min":0.81100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.272}]},{"osd":1,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.99299999999999999,"15min":1.0640000000000001},"min":{"1min":0.56499999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.8700000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.133,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.5510000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.097,"15min":1.1910000000000001},"min":{"1min":0.75900000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.6320000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.3460000000000001},"min":{"1min":0.81999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.8009999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.0600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.333,"15min":1.381},"min":{"1min":0.96499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.046},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.361,"15min":1.429},"min":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6930000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.103}]},{"osd":5,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4079999999999999,"15min":1.502},"min":{"1min":0.80200000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7629999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.294},{"interface":"front","average":{"1min":1.401,"5min":1.5169999999999999,"15min":1.653},"min":{"1min":1.0640000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.1560000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4159999999999999,"15min":1.4890000000000001},"min":{"1min":1.075,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.839,"5min":2.839,"15min":2.839},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4710000000000001,"15min":1.5569999999999999},"min":{"1min":1.1479999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.8090000000000002,"5min":3.786,"15min":3.786},"last":1.395}]},{"osd":7,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.6180000000000001,"15min":1.76},"min":{"1min":1.05,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.2559999999999998,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.333},{"interface":"front","average":{"1min":1.502,"5min":1.5569999999999999,"15min":1.657},"min":{"1min":1.141,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1245184,"data_stored":561916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.57199999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.155,"5min":1.393,"15min":1.393},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.004,"15min":1.048},"min":{"1min":0.68899999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.048}]},{"osd":1,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.52300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.599,"15min":1.599},"last":1.097},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3660000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.3460000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.369,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.159},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.022,"15min":1.0720000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3129999999999999,"15min":1.3740000000000001},"min":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.913,"5min":2.657,"15min":2.657},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.4019999999999999,"15min":1.484},"min":{"1min":0.93600000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8169999999999999,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.298,"15min":1.3129999999999999},"min":{"1min":0.91100000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6619999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.361,"15min":1.387},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7450000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.999}]},{"osd":6,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.4039999999999999,"15min":1.472},"min":{"1min":0.86699999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.637,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4159999999999999,"15min":1.462},"min":{"1min":0.999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.958,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.222}]},{"osd":7,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.486,"15min":1.5449999999999999},"min":{"1min":0.80300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5960000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.302},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.504,"15min":1.55},"min":{"1min":1.143,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.833,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.2769999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1245184,"data_stored":561916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91100000000000003,"15min":0.87},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.427,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.351},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":1.0109999999999999},"min":{"1min":0.75600000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5209999999999999,"5min":1.722,"15min":1.722},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.88700000000000001},"min":{"1min":0.58699999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2070000000000001,"5min":1.502,"15min":1.502},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0429999999999999,"15min":1.0529999999999999},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.169}]},{"osd":3,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1160000000000001,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5640000000000001,"5min":1.764,"15min":1.764},"last":1.593},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.129},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":3.254,"15min":3.254},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.177,"15min":1.1930000000000001},"min":{"1min":0.81399999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.341,"15min":1.371},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.681,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.786}]},{"osd":5,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":1,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5960000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2949999999999999,"15min":1.357},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3879999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.448,"15min":1.5069999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.8720000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.4339999999999999,"15min":1.546},"min":{"1min":0.93999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.746,"5min":4.843,"15min":4.843},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.532,"15min":1.679},"min":{"1min":1.161,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.821,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4219999999999999,"15min":1.49},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.895,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.468}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1847296,"data_stored":1152885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.86099999999999999,"15min":0.92900000000000005},"min":{"1min":0.51900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.284,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.748},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.90400000000000003},"min":{"1min":0.59599999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.181}]},{"osd":2,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1719999999999999,"15min":1.292},"min":{"1min":0.66500000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8540000000000001,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.085,"15min":1.2849999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2310000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.107,"15min":1.155},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.7949999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3129999999999999,"15min":1.3080000000000001},"min":{"1min":1.0389999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.766,"5min":2.157,"15min":2.157},"last":1.5169999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.266,"15min":1.304},"min":{"1min":0.90900000000000003,"5min":0.875,"15min":0.875},"max":{"1min":1.5489999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.022},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3620000000000001,"15min":1.371},"min":{"1min":0.96599999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.323,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6439999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.3560000000000001,"15min":1.387},"min":{"1min":1.0609999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.806,"5min":2.367,"15min":2.367},"last":1.4299999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4710000000000001,"15min":1.4870000000000001},"min":{"1min":1.1359999999999999,"5min":1.05,"15min":1.05},"max":{"1min":2.052,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.379,"15min":1.462},"min":{"1min":1.0289999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6439999999999999,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.45,"15min":1.524},"min":{"1min":0.90400000000000003,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":3.302,"15min":3.302},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.425,"15min":1.4650000000000001},"min":{"1min":1.0700000000000001,"5min":0.874,"15min":0.874},"max":{"1min":1.6910000000000001,"5min":2.266,"15min":2.266},"last":1.2949999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:12:04.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:12:04.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.623+0000 7fe231e00700 1 Processor -- start 2024-09-13T15:12:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe231e00700 1 -- start start 2024-09-13T15:12:04.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe231e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe22c0b3980 0x7fe22c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe231e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c15e560 con 0x7fe22c06aaa0 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe231e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0b3e10 con 0x7fe22c15d310 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe231e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c0adf90 con 0x7fe22c0b3980 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe230a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe22c06aaa0 0x7fe22c06ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58544/0 (socket says 172.21.15.50:58544) 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.627+0000 7fe230a00700 1 -- 172.21.15.50:0/1526602498 learned_addr learned my addr 172.21.15.50:0/1526602498 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231400700 1 --2- 172.21.15.50:0/1526602498 >> v2:172.21.15.50:3300/0 conn(0x7fe22c0b3980 0x7fe22c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe22be00700 1 -- 172.21.15.50:0/1526602498 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735017650 0 0) 0x7fe22c15e560 con 0x7fe22c06aaa0 2024-09-13T15:12:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe22be00700 1 -- 172.21.15.50:0/1526602498 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2100035d0 con 0x7fe22c06aaa0 2024-09-13T15:12:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231400700 1 -- 172.21.15.50:0/1526602498 >> v1:172.21.15.181:6789/0 conn(0x7fe22c15d310 legacy=0x7fe22c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231400700 1 -- 172.21.15.50:0/1526602498 >> v1:172.21.15.50:6789/0 conn(0x7fe22c06aaa0 legacy=0x7fe22c06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231400700 1 -- 172.21.15.50:0/1526602498 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c15d920 con 0x7fe22c0b3980 2024-09-13T15:12:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231400700 1 --2- 172.21.15.50:0/1526602498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c15f100 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe224009850 tx=0x7fe224009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8434cafbbb23b25a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe22be00700 1 -- 172.21.15.50:0/1526602498 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224011830 con 0x7fe22c0b3980 2024-09-13T15:12:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe22be00700 1 -- 172.21.15.50:0/1526602498 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224011990 con 0x7fe22c0b3980 2024-09-13T15:12:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe22be00700 1 -- 172.21.15.50:0/1526602498 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224011d40 con 0x7fe22c0b3980 2024-09-13T15:12:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 -- 172.21.15.50:0/1526602498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 msgr2=0x7fe22c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 --2- 172.21.15.50:0/1526602498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c15f100 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe224009850 tx=0x7fe224009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 -- 172.21.15.50:0/1526602498 shutdown_connections 2024-09-13T15:12:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 --2- 172.21.15.50:0/1526602498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c15f100 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 -- 172.21.15.50:0/1526602498 >> 172.21.15.50:0/1526602498 conn(0x7fe22c0b0c40 msgr2=0x7fe22c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 -- 172.21.15.50:0/1526602498 shutdown_connections 2024-09-13T15:12:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.631+0000 7fe231e00700 1 -- 172.21.15.50:0/1526602498 wait complete. 2024-09-13T15:12:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 Processor -- start 2024-09-13T15:12:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 -- start start 2024-09-13T15:12:04.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe22c06aaa0 0x7fe22c1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c13d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe22c15d310 0x7fe22c13b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c14e600 con 0x7fe22c0b3980 2024-09-13T15:12:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c150630 con 0x7fe22c06aaa0 2024-09-13T15:12:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c13de10 con 0x7fe22c15d310 2024-09-13T15:12:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe223e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c13d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe223e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c13d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50096/0 (socket says 172.21.15.50:50096) 2024-09-13T15:12:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe223e00700 1 -- 172.21.15.50:0/1737269921 learned_addr learned my addr 172.21.15.50:0/1737269921 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe230a00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe22c06aaa0 0x7fe22c1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.635+0000 7fe231400700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe22c15d310 0x7fe22c13b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe223e00700 1 -- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe22c15d310 msgr2=0x7fe22c13b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe223e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe22c15d310 0x7fe22c13b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe223e00700 1 -- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe22c06aaa0 msgr2=0x7fe22c1500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe223e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe22c06aaa0 0x7fe22c1500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe223e00700 1 -- 172.21.15.50:0/1737269921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240094b0 con 0x7fe22c0b3980 2024-09-13T15:12:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe223e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c13d8d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c500 tx=0x7fe21400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140052d0 con 0x7fe22c0b3980 2024-09-13T15:12:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214005430 con 0x7fe22c0b3980 2024-09-13T15:12:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140055a0 con 0x7fe22c0b3980 2024-09-13T15:12:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c14d980 con 0x7fe22c0b3980 2024-09-13T15:12:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c14df40 con 0x7fe22c0b3980 2024-09-13T15:12:04.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.639+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c06ae80 con 0x7fe22c0b3980 2024-09-13T15:12:04.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.643+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2140038e0 con 0x7fe22c0b3980 2024-09-13T15:12:04.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.643+0000 7fe229600700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe208066730 0x7fe208068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.643+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2140835a0 con 0x7fe22c0b3980 2024-09-13T15:12:04.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.643+0000 7fe230a00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe208066730 0x7fe208068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.643+0000 7fe230a00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe208066730 0x7fe208068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe21c001560 tx=0x7fe21c001a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.651+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2140507c0 con 0x7fe22c0b3980 2024-09-13T15:12:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.839+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe22c15e1c0 con 0x7fe208066730 2024-09-13T15:12:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.855+0000 7fe229600700 1 -- 172.21.15.50:0/1737269921 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287198 (secure 0 0 0) 0x7fe21c0077e0 con 0x7fe208066730 2024-09-13T15:12:04.865 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe208066730 msgr2=0x7fe208068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe208066730 0x7fe208068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe21c001560 tx=0x7fe21c001a90 comp rx=0 tx=0).stop 2024-09-13T15:12:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 msgr2=0x7fe22c13d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c13d8d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c500 tx=0x7fe21400c810 comp rx=0 tx=0).stop 2024-09-13T15:12:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 shutdown_connections 2024-09-13T15:12:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe208066730 0x7fe208068bf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe22c15d310 0x7fe22c13b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe22c0b3980 0x7fe22c13d8d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 --2- 172.21.15.50:0/1737269921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe22c06aaa0 0x7fe22c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 >> 172.21.15.50:0/1737269921 conn(0x7fe22c0b0c40 msgr2=0x7fe22c0afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 shutdown_connections 2024-09-13T15:12:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:04.863+0000 7fe231e00700 1 -- 172.21.15.50:0/1737269921 wait complete. 2024-09-13T15:12:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:12:04.893 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-13T15:12:04.102826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255800,"kb_used_data":10908,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754718920,"statfs":{"total":773094113280,"available":772832174080,"internally_reserved":0,"allocated":11169792,"data_stored":5677459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":250596920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.598828"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.045638+0000","last_change":"2024-09-13T15:12:00.041328+0000","last_active":"2024-09-13T15:12:00.045638+0000","last_peered":"2024-09-13T15:12:00.045638+0000","last_clean":"2024-09-13T15:12:00.045638+0000","last_became_active":"2024-09-13T15:12:00.041068+0000","last_became_peered":"2024-09-13T15:12:00.041068+0000","last_unstale":"2024-09-13T15:12:00.045638+0000","last_undegraded":"2024-09-13T15:12:00.045638+0000","last_fullsized":"2024-09-13T15:12:00.045638+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:41.795155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058307+0000","last_change":"2024-09-13T15:12:00.051723+0000","last_active":"2024-09-13T15:12:00.058307+0000","last_peered":"2024-09-13T15:12:00.058307+0000","last_clean":"2024-09-13T15:12:00.058307+0000","last_became_active":"2024-09-13T15:12:00.051494+0000","last_became_peered":"2024-09-13T15:12:00.051494+0000","last_unstale":"2024-09-13T15:12:00.058307+0000","last_undegraded":"2024-09-13T15:12:00.058307+0000","last_fullsized":"2024-09-13T15:12:00.058307+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:59.621013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058088+0000","last_change":"2024-09-13T15:12:00.054108+0000","last_active":"2024-09-13T15:12:00.058088+0000","last_peered":"2024-09-13T15:12:00.058088+0000","last_clean":"2024-09-13T15:12:00.058088+0000","last_became_active":"2024-09-13T15:12:00.053451+0000","last_became_peered":"2024-09-13T15:12:00.053451+0000","last_unstale":"2024-09-13T15:12:00.058088+0000","last_undegraded":"2024-09-13T15:12:00.058088+0000","last_fullsized":"2024-09-13T15:12:00.058088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:37.123985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030063+0000","last_change":"2024-09-13T15:12:00.034883+0000","last_active":"2024-09-13T15:12:01.030063+0000","last_peered":"2024-09-13T15:12:01.030063+0000","last_clean":"2024-09-13T15:12:01.030063+0000","last_became_active":"2024-09-13T15:12:00.034659+0000","last_became_peered":"2024-09-13T15:12:00.034659+0000","last_unstale":"2024-09-13T15:12:01.030063+0000","last_undegraded":"2024-09-13T15:12:01.030063+0000","last_fullsized":"2024-09-13T15:12:01.030063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:10.268016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033539+0000","last_change":"2024-09-13T15:12:00.047458+0000","last_active":"2024-09-13T15:12:01.033539+0000","last_peered":"2024-09-13T15:12:01.033539+0000","last_clean":"2024-09-13T15:12:01.033539+0000","last_became_active":"2024-09-13T15:12:00.040428+0000","last_became_peered":"2024-09-13T15:12:00.040428+0000","last_unstale":"2024-09-13T15:12:01.033539+0000","last_undegraded":"2024-09-13T15:12:01.033539+0000","last_fullsized":"2024-09-13T15:12:01.033539+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.057244+0000","last_change":"2024-09-13T15:12:00.044583+0000","last_active":"2024-09-13T15:12:00.057244+0000","last_peered":"2024-09-13T15:12:00.057244+0000","last_clean":"2024-09-13T15:12:00.057244+0000","last_became_active":"2024-09-13T15:12:00.044299+0000","last_became_peered":"2024-09-13T15:12:00.044299+0000","last_unstale":"2024-09-13T15:12:00.057244+0000","last_undegraded":"2024-09-13T15:12:00.057244+0000","last_fullsized":"2024-09-13T15:12:00.057244+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:35.441465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.052705+0000","last_change":"2024-09-13T15:12:00.043448+0000","last_active":"2024-09-13T15:12:00.052705+0000","last_peered":"2024-09-13T15:12:00.052705+0000","last_clean":"2024-09-13T15:12:00.052705+0000","last_became_active":"2024-09-13T15:12:00.043199+0000","last_became_peered":"2024-09-13T15:12:00.043199+0000","last_unstale":"2024-09-13T15:12:00.052705+0000","last_undegraded":"2024-09-13T15:12:00.052705+0000","last_fullsized":"2024-09-13T15:12:00.052705+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.048211+0000","last_change":"2024-09-13T15:12:00.035895+0000","last_active":"2024-09-13T15:12:00.048211+0000","last_peered":"2024-09-13T15:12:00.048211+0000","last_clean":"2024-09-13T15:12:00.048211+0000","last_became_active":"2024-09-13T15:12:00.034657+0000","last_became_peered":"2024-09-13T15:12:00.034657+0000","last_unstale":"2024-09-13T15:12:00.048211+0000","last_undegraded":"2024-09-13T15:12:00.048211+0000","last_fullsized":"2024-09-13T15:12:00.048211+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:35.245497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058825+0000","last_change":"2024-09-13T15:12:00.052654+0000","last_active":"2024-09-13T15:12:00.058825+0000","last_peered":"2024-09-13T15:12:00.058825+0000","last_clean":"2024-09-13T15:12:00.058825+0000","last_became_active":"2024-09-13T15:12:00.052372+0000","last_became_peered":"2024-09-13T15:12:00.052372+0000","last_unstale":"2024-09-13T15:12:00.058825+0000","last_undegraded":"2024-09-13T15:12:00.058825+0000","last_fullsized":"2024-09-13T15:12:00.058825+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:19.101846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033919+0000","last_change":"2024-09-13T15:12:00.052675+0000","last_active":"2024-09-13T15:12:01.033919+0000","last_peered":"2024-09-13T15:12:01.033919+0000","last_clean":"2024-09-13T15:12:01.033919+0000","last_became_active":"2024-09-13T15:12:00.051961+0000","last_became_peered":"2024-09-13T15:12:00.051961+0000","last_unstale":"2024-09-13T15:12:01.033919+0000","last_undegraded":"2024-09-13T15:12:01.033919+0000","last_fullsized":"2024-09-13T15:12:01.033919+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.069243+0000","last_change":"2024-09-13T15:12:00.062963+0000","last_active":"2024-09-13T15:12:00.069243+0000","last_peered":"2024-09-13T15:12:00.069243+0000","last_clean":"2024-09-13T15:12:00.069243+0000","last_became_active":"2024-09-13T15:12:00.062707+0000","last_became_peered":"2024-09-13T15:12:00.062707+0000","last_unstale":"2024-09-13T15:12:00.069243+0000","last_undegraded":"2024-09-13T15:12:00.069243+0000","last_fullsized":"2024-09-13T15:12:00.069243+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.047952+0000","last_change":"2024-09-13T15:12:00.040360+0000","last_active":"2024-09-13T15:12:00.047952+0000","last_peered":"2024-09-13T15:12:00.047952+0000","last_clean":"2024-09-13T15:12:00.047952+0000","last_became_active":"2024-09-13T15:12:00.040090+0000","last_became_peered":"2024-09-13T15:12:00.040090+0000","last_unstale":"2024-09-13T15:12:00.047952+0000","last_undegraded":"2024-09-13T15:12:00.047952+0000","last_fullsized":"2024-09-13T15:12:00.047952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:28.176497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029655+0000","last_change":"2024-09-13T15:12:00.058403+0000","last_active":"2024-09-13T15:12:01.029655+0000","last_peered":"2024-09-13T15:12:01.029655+0000","last_clean":"2024-09-13T15:12:01.029655+0000","last_became_active":"2024-09-13T15:12:00.058016+0000","last_became_peered":"2024-09-13T15:12:00.058016+0000","last_unstale":"2024-09-13T15:12:01.029655+0000","last_undegraded":"2024-09-13T15:12:01.029655+0000","last_fullsized":"2024-09-13T15:12:01.029655+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:28.176497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030749+0000","last_change":"2024-09-13T15:12:00.040494+0000","last_active":"2024-09-13T15:12:01.030749+0000","last_peered":"2024-09-13T15:12:01.030749+0000","last_clean":"2024-09-13T15:12:01.030749+0000","last_became_active":"2024-09-13T15:12:00.040222+0000","last_became_peered":"2024-09-13T15:12:00.040222+0000","last_unstale":"2024-09-13T15:12:01.030749+0000","last_undegraded":"2024-09-13T15:12:01.030749+0000","last_fullsized":"2024-09-13T15:12:01.030749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030690+0000","last_change":"2024-09-13T15:12:00.049549+0000","last_active":"2024-09-13T15:12:01.030690+0000","last_peered":"2024-09-13T15:12:01.030690+0000","last_clean":"2024-09-13T15:12:01.030690+0000","last_became_active":"2024-09-13T15:12:00.049141+0000","last_became_peered":"2024-09-13T15:12:00.049141+0000","last_unstale":"2024-09-13T15:12:01.030690+0000","last_undegraded":"2024-09-13T15:12:01.030690+0000","last_fullsized":"2024-09-13T15:12:01.030690+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:35.441465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030845+0000","last_change":"2024-09-13T15:12:00.041083+0000","last_active":"2024-09-13T15:12:01.030845+0000","last_peered":"2024-09-13T15:12:01.030845+0000","last_clean":"2024-09-13T15:12:01.030845+0000","last_became_active":"2024-09-13T15:12:00.040768+0000","last_became_peered":"2024-09-13T15:12:00.040768+0000","last_unstale":"2024-09-13T15:12:01.030845+0000","last_undegraded":"2024-09-13T15:12:01.030845+0000","last_fullsized":"2024-09-13T15:12:01.030845+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.059725+0000","last_change":"2024-09-13T15:12:00.057390+0000","last_active":"2024-09-13T15:12:00.059725+0000","last_peered":"2024-09-13T15:12:00.059725+0000","last_clean":"2024-09-13T15:12:00.059725+0000","last_became_active":"2024-09-13T15:12:00.056771+0000","last_became_peered":"2024-09-13T15:12:00.056771+0000","last_unstale":"2024-09-13T15:12:00.059725+0000","last_undegraded":"2024-09-13T15:12:00.059725+0000","last_fullsized":"2024-09-13T15:12:00.059725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:42.465594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.056598+0000","last_change":"2024-09-13T15:12:00.049079+0000","last_active":"2024-09-13T15:12:00.056598+0000","last_peered":"2024-09-13T15:12:00.056598+0000","last_clean":"2024-09-13T15:12:00.056598+0000","last_became_active":"2024-09-13T15:12:00.048798+0000","last_became_peered":"2024-09-13T15:12:00.048798+0000","last_unstale":"2024-09-13T15:12:00.056598+0000","last_undegraded":"2024-09-13T15:12:00.056598+0000","last_fullsized":"2024-09-13T15:12:00.056598+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:23.570177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055584+0000","last_change":"2024-09-13T15:12:00.054284+0000","last_active":"2024-09-13T15:12:00.055584+0000","last_peered":"2024-09-13T15:12:00.055584+0000","last_clean":"2024-09-13T15:12:00.055584+0000","last_became_active":"2024-09-13T15:12:00.053872+0000","last_became_peered":"2024-09-13T15:12:00.053872+0000","last_unstale":"2024-09-13T15:12:00.055584+0000","last_undegraded":"2024-09-13T15:12:00.055584+0000","last_fullsized":"2024-09-13T15:12:00.055584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:43.257819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.047823+0000","last_change":"2024-09-13T15:12:00.038773+0000","last_active":"2024-09-13T15:12:00.047823+0000","last_peered":"2024-09-13T15:12:00.047823+0000","last_clean":"2024-09-13T15:12:00.047823+0000","last_became_active":"2024-09-13T15:12:00.038418+0000","last_became_peered":"2024-09-13T15:12:00.038418+0000","last_unstale":"2024-09-13T15:12:00.047823+0000","last_undegraded":"2024-09-13T15:12:00.047823+0000","last_fullsized":"2024-09-13T15:12:00.047823+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:27.097104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058937+0000","last_change":"2024-09-13T15:12:00.057294+0000","last_active":"2024-09-13T15:12:00.058937+0000","last_peered":"2024-09-13T15:12:00.058937+0000","last_clean":"2024-09-13T15:12:00.058937+0000","last_became_active":"2024-09-13T15:12:00.056982+0000","last_became_peered":"2024-09-13T15:12:00.056982+0000","last_unstale":"2024-09-13T15:12:00.058937+0000","last_undegraded":"2024-09-13T15:12:00.058937+0000","last_fullsized":"2024-09-13T15:12:00.058937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:35.367849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033418+0000","last_change":"2024-09-13T15:12:00.054340+0000","last_active":"2024-09-13T15:12:01.033418+0000","last_peered":"2024-09-13T15:12:01.033418+0000","last_clean":"2024-09-13T15:12:01.033418+0000","last_became_active":"2024-09-13T15:12:00.053099+0000","last_became_peered":"2024-09-13T15:12:00.053099+0000","last_unstale":"2024-09-13T15:12:01.033418+0000","last_undegraded":"2024-09-13T15:12:01.033418+0000","last_fullsized":"2024-09-13T15:12:01.033418+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.057865+0000","last_change":"2024-09-13T15:12:00.052915+0000","last_active":"2024-09-13T15:12:00.057865+0000","last_peered":"2024-09-13T15:12:00.057865+0000","last_clean":"2024-09-13T15:12:00.057865+0000","last_became_active":"2024-09-13T15:12:00.052666+0000","last_became_peered":"2024-09-13T15:12:00.052666+0000","last_unstale":"2024-09-13T15:12:00.057865+0000","last_undegraded":"2024-09-13T15:12:00.057865+0000","last_fullsized":"2024-09-13T15:12:00.057865+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:14.080358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033141+0000","last_change":"2024-09-13T15:12:00.045746+0000","last_active":"2024-09-13T15:12:01.033141+0000","last_peered":"2024-09-13T15:12:01.033141+0000","last_clean":"2024-09-13T15:12:01.033141+0000","last_became_active":"2024-09-13T15:12:00.045502+0000","last_became_peered":"2024-09-13T15:12:00.045502+0000","last_unstale":"2024-09-13T15:12:01.033141+0000","last_undegraded":"2024-09-13T15:12:01.033141+0000","last_fullsized":"2024-09-13T15:12:01.033141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:59.621013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055193+0000","last_change":"2024-09-13T15:12:00.052134+0000","last_active":"2024-09-13T15:12:00.055193+0000","last_peered":"2024-09-13T15:12:00.055193+0000","last_clean":"2024-09-13T15:12:00.055193+0000","last_became_active":"2024-09-13T15:12:00.051868+0000","last_became_peered":"2024-09-13T15:12:00.051868+0000","last_unstale":"2024-09-13T15:12:00.055193+0000","last_undegraded":"2024-09-13T15:12:00.055193+0000","last_fullsized":"2024-09-13T15:12:00.055193+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:04.458627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061982+0000","last_change":"2024-09-13T15:12:00.056986+0000","last_active":"2024-09-13T15:12:00.061982+0000","last_peered":"2024-09-13T15:12:00.061982+0000","last_clean":"2024-09-13T15:12:00.061982+0000","last_became_active":"2024-09-13T15:12:00.055493+0000","last_became_peered":"2024-09-13T15:12:00.055493+0000","last_unstale":"2024-09-13T15:12:00.061982+0000","last_undegraded":"2024-09-13T15:12:00.061982+0000","last_fullsized":"2024-09-13T15:12:00.061982+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:01.931912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.060806+0000","last_change":"2024-09-13T15:12:00.050413+0000","last_active":"2024-09-13T15:12:00.060806+0000","last_peered":"2024-09-13T15:12:00.060806+0000","last_clean":"2024-09-13T15:12:00.060806+0000","last_became_active":"2024-09-13T15:12:00.050168+0000","last_became_peered":"2024-09-13T15:12:00.050168+0000","last_unstale":"2024-09-13T15:12:00.060806+0000","last_undegraded":"2024-09-13T15:12:00.060806+0000","last_fullsized":"2024-09-13T15:12:00.060806+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.062840+0000","last_change":"2024-09-13T15:12:00.061314+0000","last_active":"2024-09-13T15:12:00.062840+0000","last_peered":"2024-09-13T15:12:00.062840+0000","last_clean":"2024-09-13T15:12:00.062840+0000","last_became_active":"2024-09-13T15:12:00.060972+0000","last_became_peered":"2024-09-13T15:12:00.060972+0000","last_unstale":"2024-09-13T15:12:00.062840+0000","last_undegraded":"2024-09-13T15:12:00.062840+0000","last_fullsized":"2024-09-13T15:12:00.062840+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051850+0000","last_change":"2024-09-13T15:12:00.043192+0000","last_active":"2024-09-13T15:12:00.051850+0000","last_peered":"2024-09-13T15:12:00.051850+0000","last_clean":"2024-09-13T15:12:00.051850+0000","last_became_active":"2024-09-13T15:12:00.042969+0000","last_became_peered":"2024-09-13T15:12:00.042969+0000","last_unstale":"2024-09-13T15:12:00.051850+0000","last_undegraded":"2024-09-13T15:12:00.051850+0000","last_fullsized":"2024-09-13T15:12:00.051850+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:16.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.053242+0000","last_change":"2024-09-13T15:12:00.051432+0000","last_active":"2024-09-13T15:12:00.053242+0000","last_peered":"2024-09-13T15:12:00.053242+0000","last_clean":"2024-09-13T15:12:00.053242+0000","last_became_active":"2024-09-13T15:12:00.051199+0000","last_became_peered":"2024-09-13T15:12:00.051199+0000","last_unstale":"2024-09-13T15:12:00.053242+0000","last_undegraded":"2024-09-13T15:12:00.053242+0000","last_fullsized":"2024-09-13T15:12:00.053242+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:28.314382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.056502+0000","last_change":"2024-09-13T15:12:00.048437+0000","last_active":"2024-09-13T15:12:00.056502+0000","last_peered":"2024-09-13T15:12:00.056502+0000","last_clean":"2024-09-13T15:12:00.056502+0000","last_became_active":"2024-09-13T15:12:00.048144+0000","last_became_peered":"2024-09-13T15:12:00.048144+0000","last_unstale":"2024-09-13T15:12:00.056502+0000","last_undegraded":"2024-09-13T15:12:00.056502+0000","last_fullsized":"2024-09-13T15:12:00.056502+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:46.465439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.040748+0000","last_change":"2024-09-13T15:12:00.032968+0000","last_active":"2024-09-13T15:12:00.040748+0000","last_peered":"2024-09-13T15:12:00.040748+0000","last_clean":"2024-09-13T15:12:00.040748+0000","last_became_active":"2024-09-13T15:12:00.032736+0000","last_became_peered":"2024-09-13T15:12:00.032736+0000","last_unstale":"2024-09-13T15:12:00.040748+0000","last_undegraded":"2024-09-13T15:12:00.040748+0000","last_fullsized":"2024-09-13T15:12:00.040748+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:03.794341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058772+0000","last_change":"2024-09-13T15:12:00.056325+0000","last_active":"2024-09-13T15:12:00.058772+0000","last_peered":"2024-09-13T15:12:00.058772+0000","last_clean":"2024-09-13T15:12:00.058772+0000","last_became_active":"2024-09-13T15:12:00.055981+0000","last_became_peered":"2024-09-13T15:12:00.055981+0000","last_unstale":"2024-09-13T15:12:00.058772+0000","last_undegraded":"2024-09-13T15:12:00.058772+0000","last_fullsized":"2024-09-13T15:12:00.058772+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:48.150657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"100'4","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030261+0000","last_change":"2024-09-13T15:11:59.545043+0000","last_active":"2024-09-13T15:12:01.030261+0000","last_peered":"2024-09-13T15:12:01.030261+0000","last_clean":"2024-09-13T15:12:01.030261+0000","last_became_active":"2024-09-13T15:11:59.544429+0000","last_became_peered":"2024-09-13T15:11:59.544429+0000","last_unstale":"2024-09-13T15:12:01.030261+0000","last_undegraded":"2024-09-13T15:12:01.030261+0000","last_fullsized":"2024-09-13T15:12:01.030261+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:45.055176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.048506+0000","last_change":"2024-09-13T15:12:00.035454+0000","last_active":"2024-09-13T15:12:00.048506+0000","last_peered":"2024-09-13T15:12:00.048506+0000","last_clean":"2024-09-13T15:12:00.048506+0000","last_became_active":"2024-09-13T15:12:00.035168+0000","last_became_peered":"2024-09-13T15:12:00.035168+0000","last_unstale":"2024-09-13T15:12:00.048506+0000","last_undegraded":"2024-09-13T15:12:00.048506+0000","last_fullsized":"2024-09-13T15:12:00.048506+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:46.865120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055280+0000","last_change":"2024-09-13T15:11:59.540959+0000","last_active":"2024-09-13T15:12:00.055280+0000","last_peered":"2024-09-13T15:12:00.055280+0000","last_clean":"2024-09-13T15:12:00.055280+0000","last_became_active":"2024-09-13T15:11:59.540672+0000","last_became_peered":"2024-09-13T15:11:59.540672+0000","last_unstale":"2024-09-13T15:12:00.055280+0000","last_undegraded":"2024-09-13T15:12:00.055280+0000","last_fullsized":"2024-09-13T15:12:00.055280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.811879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.048562+0000","last_change":"2024-09-13T15:12:00.036896+0000","last_active":"2024-09-13T15:12:00.048562+0000","last_peered":"2024-09-13T15:12:00.048562+0000","last_clean":"2024-09-13T15:12:00.048562+0000","last_became_active":"2024-09-13T15:12:00.035999+0000","last_became_peered":"2024-09-13T15:12:00.035999+0000","last_unstale":"2024-09-13T15:12:00.048562+0000","last_undegraded":"2024-09-13T15:12:00.048562+0000","last_fullsized":"2024-09-13T15:12:00.048562+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:47.913308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055170+0000","last_change":"2024-09-13T15:11:59.545360+0000","last_active":"2024-09-13T15:12:00.055170+0000","last_peered":"2024-09-13T15:12:00.055170+0000","last_clean":"2024-09-13T15:12:00.055170+0000","last_became_active":"2024-09-13T15:11:59.544368+0000","last_became_peered":"2024-09-13T15:11:59.544368+0000","last_unstale":"2024-09-13T15:12:00.055170+0000","last_undegraded":"2024-09-13T15:12:00.055170+0000","last_fullsized":"2024-09-13T15:12:00.055170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:04.442189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061793+0000","last_change":"2024-09-13T15:12:00.057197+0000","last_active":"2024-09-13T15:12:00.061793+0000","last_peered":"2024-09-13T15:12:00.061793+0000","last_clean":"2024-09-13T15:12:00.061793+0000","last_became_active":"2024-09-13T15:12:00.056093+0000","last_became_peered":"2024-09-13T15:12:00.056093+0000","last_unstale":"2024-09-13T15:12:00.061793+0000","last_undegraded":"2024-09-13T15:12:00.061793+0000","last_fullsized":"2024-09-13T15:12:00.061793+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:59.621013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"100'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033599+0000","last_change":"2024-09-13T15:11:59.552447+0000","last_active":"2024-09-13T15:12:01.033599+0000","last_peered":"2024-09-13T15:12:01.033599+0000","last_clean":"2024-09-13T15:12:01.033599+0000","last_became_active":"2024-09-13T15:11:59.552130+0000","last_became_peered":"2024-09-13T15:11:59.552130+0000","last_unstale":"2024-09-13T15:12:01.033599+0000","last_undegraded":"2024-09-13T15:12:01.033599+0000","last_fullsized":"2024-09-13T15:12:01.033599+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:12.917799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030258+0000","last_change":"2024-09-13T15:12:00.040131+0000","last_active":"2024-09-13T15:12:01.030258+0000","last_peered":"2024-09-13T15:12:01.030258+0000","last_clean":"2024-09-13T15:12:01.030258+0000","last_became_active":"2024-09-13T15:12:00.039881+0000","last_became_peered":"2024-09-13T15:12:00.039881+0000","last_unstale":"2024-09-13T15:12:01.030258+0000","last_undegraded":"2024-09-13T15:12:01.030258+0000","last_fullsized":"2024-09-13T15:12:01.030258+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:01.931912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"100'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.031250+0000","last_change":"2024-09-13T15:11:59.545820+0000","last_active":"2024-09-13T15:12:01.031250+0000","last_peered":"2024-09-13T15:12:01.031250+0000","last_clean":"2024-09-13T15:12:01.031250+0000","last_became_active":"2024-09-13T15:11:59.545422+0000","last_became_peered":"2024-09-13T15:11:59.545422+0000","last_unstale":"2024-09-13T15:12:01.031250+0000","last_undegraded":"2024-09-13T15:12:01.031250+0000","last_fullsized":"2024-09-13T15:12:01.031250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:32.846115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.055563+0000","last_change":"2024-09-13T15:12:00.054120+0000","last_active":"2024-09-13T15:12:00.055563+0000","last_peered":"2024-09-13T15:12:00.055563+0000","last_clean":"2024-09-13T15:12:00.055563+0000","last_became_active":"2024-09-13T15:12:00.053841+0000","last_became_peered":"2024-09-13T15:12:00.053841+0000","last_unstale":"2024-09-13T15:12:00.055563+0000","last_undegraded":"2024-09-13T15:12:00.055563+0000","last_fullsized":"2024-09-13T15:12:00.055563+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:22.517529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.057391+0000","last_change":"2024-09-13T15:11:59.541143+0000","last_active":"2024-09-13T15:12:00.057391+0000","last_peered":"2024-09-13T15:12:00.057391+0000","last_clean":"2024-09-13T15:12:00.057391+0000","last_became_active":"2024-09-13T15:11:59.537183+0000","last_became_peered":"2024-09-13T15:11:59.537183+0000","last_unstale":"2024-09-13T15:12:00.057391+0000","last_undegraded":"2024-09-13T15:12:00.057391+0000","last_fullsized":"2024-09-13T15:12:00.057391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:12.917799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.063349+0000","last_change":"2024-09-13T15:12:00.062636+0000","last_active":"2024-09-13T15:12:00.063349+0000","last_peered":"2024-09-13T15:12:00.063349+0000","last_clean":"2024-09-13T15:12:00.063349+0000","last_became_active":"2024-09-13T15:12:00.061620+0000","last_became_peered":"2024-09-13T15:12:00.061620+0000","last_unstale":"2024-09-13T15:12:00.063349+0000","last_undegraded":"2024-09-13T15:12:00.063349+0000","last_fullsized":"2024-09-13T15:12:00.063349+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:05.455681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.027367+0000","last_change":"2024-09-13T15:11:59.544744+0000","last_active":"2024-09-13T15:12:00.027367+0000","last_peered":"2024-09-13T15:12:00.027367+0000","last_clean":"2024-09-13T15:12:00.027367+0000","last_became_active":"2024-09-13T15:11:59.544432+0000","last_became_peered":"2024-09-13T15:11:59.544432+0000","last_unstale":"2024-09-13T15:12:00.027367+0000","last_undegraded":"2024-09-13T15:12:00.027367+0000","last_fullsized":"2024-09-13T15:12:00.027367+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:58.607521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030212+0000","last_change":"2024-09-13T15:12:00.048314+0000","last_active":"2024-09-13T15:12:01.030212+0000","last_peered":"2024-09-13T15:12:01.030212+0000","last_clean":"2024-09-13T15:12:01.030212+0000","last_became_active":"2024-09-13T15:12:00.048085+0000","last_became_peered":"2024-09-13T15:12:00.048085+0000","last_unstale":"2024-09-13T15:12:01.030212+0000","last_undegraded":"2024-09-13T15:12:01.030212+0000","last_fullsized":"2024-09-13T15:12:01.030212+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:27.097104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029364+0000","last_change":"2024-09-13T15:11:59.543043+0000","last_active":"2024-09-13T15:12:01.029364+0000","last_peered":"2024-09-13T15:12:01.029364+0000","last_clean":"2024-09-13T15:12:01.029364+0000","last_became_active":"2024-09-13T15:11:59.542771+0000","last_became_peered":"2024-09-13T15:11:59.542771+0000","last_unstale":"2024-09-13T15:12:01.029364+0000","last_undegraded":"2024-09-13T15:12:01.029364+0000","last_fullsized":"2024-09-13T15:12:01.029364+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:35.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058755+0000","last_change":"2024-09-13T15:12:00.056218+0000","last_active":"2024-09-13T15:12:00.058755+0000","last_peered":"2024-09-13T15:12:00.058755+0000","last_clean":"2024-09-13T15:12:00.058755+0000","last_became_active":"2024-09-13T15:12:00.055662+0000","last_became_peered":"2024-09-13T15:12:00.055662+0000","last_unstale":"2024-09-13T15:12:00.058755+0000","last_undegraded":"2024-09-13T15:12:00.058755+0000","last_fullsized":"2024-09-13T15:12:00.058755+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:45.811185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026442+0000","last_change":"2024-09-13T15:11:59.548424+0000","last_active":"2024-09-13T15:12:00.026442+0000","last_peered":"2024-09-13T15:12:00.026442+0000","last_clean":"2024-09-13T15:12:00.026442+0000","last_became_active":"2024-09-13T15:11:59.548108+0000","last_became_peered":"2024-09-13T15:11:59.548108+0000","last_unstale":"2024-09-13T15:12:00.026442+0000","last_undegraded":"2024-09-13T15:12:00.026442+0000","last_fullsized":"2024-09-13T15:12:00.026442+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:35.196516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033333+0000","last_change":"2024-09-13T15:12:00.045485+0000","last_active":"2024-09-13T15:12:01.033333+0000","last_peered":"2024-09-13T15:12:01.033333+0000","last_clean":"2024-09-13T15:12:01.033333+0000","last_became_active":"2024-09-13T15:12:00.045229+0000","last_became_peered":"2024-09-13T15:12:00.045229+0000","last_unstale":"2024-09-13T15:12:01.033333+0000","last_undegraded":"2024-09-13T15:12:01.033333+0000","last_fullsized":"2024-09-13T15:12:01.033333+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:35.441465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026824+0000","last_change":"2024-09-13T15:11:59.550289+0000","last_active":"2024-09-13T15:12:00.026824+0000","last_peered":"2024-09-13T15:12:00.026824+0000","last_clean":"2024-09-13T15:12:00.026824+0000","last_became_active":"2024-09-13T15:11:59.549969+0000","last_became_peered":"2024-09-13T15:11:59.549969+0000","last_unstale":"2024-09-13T15:12:00.026824+0000","last_undegraded":"2024-09-13T15:12:00.026824+0000","last_fullsized":"2024-09-13T15:12:00.026824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:49.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051043+0000","last_change":"2024-09-13T15:12:00.039491+0000","last_active":"2024-09-13T15:12:00.051043+0000","last_peered":"2024-09-13T15:12:00.051043+0000","last_clean":"2024-09-13T15:12:00.051043+0000","last_became_active":"2024-09-13T15:12:00.038364+0000","last_became_peered":"2024-09-13T15:12:00.038364+0000","last_unstale":"2024-09-13T15:12:00.051043+0000","last_undegraded":"2024-09-13T15:12:00.051043+0000","last_fullsized":"2024-09-13T15:12:00.051043+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:29.490755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"100'3","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.030994+0000","last_change":"2024-09-13T15:11:59.544743+0000","last_active":"2024-09-13T15:12:01.030994+0000","last_peered":"2024-09-13T15:12:01.030994+0000","last_clean":"2024-09-13T15:12:01.030994+0000","last_became_active":"2024-09-13T15:11:59.544415+0000","last_became_peered":"2024-09-13T15:11:59.544415+0000","last_unstale":"2024-09-13T15:12:01.030994+0000","last_undegraded":"2024-09-13T15:12:01.030994+0000","last_fullsized":"2024-09-13T15:12:01.030994+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:30.234669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033663+0000","last_change":"2024-09-13T15:12:00.047632+0000","last_active":"2024-09-13T15:12:01.033663+0000","last_peered":"2024-09-13T15:12:01.033663+0000","last_clean":"2024-09-13T15:12:01.033663+0000","last_became_active":"2024-09-13T15:12:00.046870+0000","last_became_peered":"2024-09-13T15:12:00.046870+0000","last_unstale":"2024-09-13T15:12:01.033663+0000","last_undegraded":"2024-09-13T15:12:01.033663+0000","last_fullsized":"2024-09-13T15:12:01.033663+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:23.570177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.064599+0000","last_change":"2024-09-13T15:11:59.545072+0000","last_active":"2024-09-13T15:12:00.064599+0000","last_peered":"2024-09-13T15:12:00.064599+0000","last_clean":"2024-09-13T15:12:00.064599+0000","last_became_active":"2024-09-13T15:11:59.544827+0000","last_became_peered":"2024-09-13T15:11:59.544827+0000","last_unstale":"2024-09-13T15:12:00.064599+0000","last_undegraded":"2024-09-13T15:12:00.064599+0000","last_fullsized":"2024-09-13T15:12:00.064599+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:21.710431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.060924+0000","last_change":"2024-09-13T15:12:00.051040+0000","last_active":"2024-09-13T15:12:00.060924+0000","last_peered":"2024-09-13T15:12:00.060924+0000","last_clean":"2024-09-13T15:12:00.060924+0000","last_became_active":"2024-09-13T15:12:00.050772+0000","last_became_peered":"2024-09-13T15:12:00.050772+0000","last_unstale":"2024-09-13T15:12:00.060924+0000","last_undegraded":"2024-09-13T15:12:00.060924+0000","last_fullsized":"2024-09-13T15:12:00.060924+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:19.101846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"100'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033743+0000","last_change":"2024-09-13T15:11:59.552315+0000","last_active":"2024-09-13T15:12:01.033743+0000","last_peered":"2024-09-13T15:12:01.033743+0000","last_clean":"2024-09-13T15:12:01.033743+0000","last_became_active":"2024-09-13T15:11:59.552010+0000","last_became_peered":"2024-09-13T15:11:59.552010+0000","last_unstale":"2024-09-13T15:12:01.033743+0000","last_undegraded":"2024-09-13T15:12:01.033743+0000","last_fullsized":"2024-09-13T15:12:01.033743+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:34.635724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058625+0000","last_change":"2024-09-13T15:12:00.052059+0000","last_active":"2024-09-13T15:12:00.058625+0000","last_peered":"2024-09-13T15:12:00.058625+0000","last_clean":"2024-09-13T15:12:00.058625+0000","last_became_active":"2024-09-13T15:12:00.051771+0000","last_became_peered":"2024-09-13T15:12:00.051771+0000","last_unstale":"2024-09-13T15:12:00.058625+0000","last_undegraded":"2024-09-13T15:12:00.058625+0000","last_fullsized":"2024-09-13T15:12:00.058625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:31.248161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029759+0000","last_change":"2024-09-13T15:11:59.542869+0000","last_active":"2024-09-13T15:12:01.029759+0000","last_peered":"2024-09-13T15:12:01.029759+0000","last_clean":"2024-09-13T15:12:01.029759+0000","last_became_active":"2024-09-13T15:11:59.542551+0000","last_became_peered":"2024-09-13T15:11:59.542551+0000","last_unstale":"2024-09-13T15:12:01.029759+0000","last_undegraded":"2024-09-13T15:12:01.029759+0000","last_fullsized":"2024-09-13T15:12:01.029759+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:34.427973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.040370+0000","last_change":"2024-09-13T15:12:00.033912+0000","last_active":"2024-09-13T15:12:00.040370+0000","last_peered":"2024-09-13T15:12:00.040370+0000","last_clean":"2024-09-13T15:12:00.040370+0000","last_became_active":"2024-09-13T15:12:00.033671+0000","last_became_peered":"2024-09-13T15:12:00.033671+0000","last_unstale":"2024-09-13T15:12:00.040370+0000","last_undegraded":"2024-09-13T15:12:00.040370+0000","last_fullsized":"2024-09-13T15:12:00.040370+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:32.141378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.020068+0000","last_change":"2024-09-13T15:11:59.539208+0000","last_active":"2024-09-13T15:12:00.020068+0000","last_peered":"2024-09-13T15:12:00.020068+0000","last_clean":"2024-09-13T15:12:00.020068+0000","last_became_active":"2024-09-13T15:11:59.538916+0000","last_became_peered":"2024-09-13T15:11:59.538916+0000","last_unstale":"2024-09-13T15:12:00.020068+0000","last_undegraded":"2024-09-13T15:12:00.020068+0000","last_fullsized":"2024-09-13T15:12:00.020068+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:19.713117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.059743+0000","last_change":"2024-09-13T15:12:00.057544+0000","last_active":"2024-09-13T15:12:00.059743+0000","last_peered":"2024-09-13T15:12:00.059743+0000","last_clean":"2024-09-13T15:12:00.059743+0000","last_became_active":"2024-09-13T15:12:00.057161+0000","last_became_peered":"2024-09-13T15:12:00.057161+0000","last_unstale":"2024-09-13T15:12:00.059743+0000","last_undegraded":"2024-09-13T15:12:00.059743+0000","last_fullsized":"2024-09-13T15:12:00.059743+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:57.961856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.059502+0000","last_change":"2024-09-13T15:11:59.545042+0000","last_active":"2024-09-13T15:12:00.059502+0000","last_peered":"2024-09-13T15:12:00.059502+0000","last_clean":"2024-09-13T15:12:00.059502+0000","last_became_active":"2024-09-13T15:11:59.544318+0000","last_became_peered":"2024-09-13T15:11:59.544318+0000","last_unstale":"2024-09-13T15:12:00.059502+0000","last_undegraded":"2024-09-13T15:12:00.059502+0000","last_fullsized":"2024-09-13T15:12:00.059502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:18.088355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051532+0000","last_change":"2024-09-13T15:12:00.042451+0000","last_active":"2024-09-13T15:12:00.051532+0000","last_peered":"2024-09-13T15:12:00.051532+0000","last_clean":"2024-09-13T15:12:00.051532+0000","last_became_active":"2024-09-13T15:12:00.042224+0000","last_became_peered":"2024-09-13T15:12:00.042224+0000","last_unstale":"2024-09-13T15:12:00.051532+0000","last_undegraded":"2024-09-13T15:12:00.051532+0000","last_fullsized":"2024-09-13T15:12:00.051532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:45.952606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058511+0000","last_change":"2024-09-13T15:11:59.547449+0000","last_active":"2024-09-13T15:12:00.058511+0000","last_peered":"2024-09-13T15:12:00.058511+0000","last_clean":"2024-09-13T15:12:00.058511+0000","last_became_active":"2024-09-13T15:11:59.547121+0000","last_became_peered":"2024-09-13T15:11:59.547121+0000","last_unstale":"2024-09-13T15:12:00.058511+0000","last_undegraded":"2024-09-13T15:12:00.058511+0000","last_fullsized":"2024-09-13T15:12:00.058511+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:35.300868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.058410+0000","last_change":"2024-09-13T15:12:00.051935+0000","last_active":"2024-09-13T15:12:00.058410+0000","last_peered":"2024-09-13T15:12:00.058410+0000","last_clean":"2024-09-13T15:12:00.058410+0000","last_became_active":"2024-09-13T15:12:00.051461+0000","last_became_peered":"2024-09-13T15:12:00.051461+0000","last_unstale":"2024-09-13T15:12:00.058410+0000","last_undegraded":"2024-09-13T15:12:00.058410+0000","last_fullsized":"2024-09-13T15:12:00.058410+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.166270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"100'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.031133+0000","last_change":"2024-09-13T15:11:59.550590+0000","last_active":"2024-09-13T15:12:01.031133+0000","last_peered":"2024-09-13T15:12:01.031133+0000","last_clean":"2024-09-13T15:12:01.031133+0000","last_became_active":"2024-09-13T15:11:59.550248+0000","last_became_peered":"2024-09-13T15:11:59.550248+0000","last_unstale":"2024-09-13T15:12:01.031133+0000","last_undegraded":"2024-09-13T15:12:01.031133+0000","last_fullsized":"2024-09-13T15:12:01.031133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:23.976064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033618+0000","last_change":"2024-09-13T15:12:00.047779+0000","last_active":"2024-09-13T15:12:01.033618+0000","last_peered":"2024-09-13T15:12:01.033618+0000","last_clean":"2024-09-13T15:12:01.033618+0000","last_became_active":"2024-09-13T15:12:00.047224+0000","last_became_peered":"2024-09-13T15:12:00.047224+0000","last_unstale":"2024-09-13T15:12:01.033618+0000","last_undegraded":"2024-09-13T15:12:01.033618+0000","last_fullsized":"2024-09-13T15:12:01.033618+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:19.101846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.045107+0000","last_change":"2024-09-13T15:11:59.540549+0000","last_active":"2024-09-13T15:12:00.045107+0000","last_peered":"2024-09-13T15:12:00.045107+0000","last_clean":"2024-09-13T15:12:00.045107+0000","last_became_active":"2024-09-13T15:11:59.540301+0000","last_became_peered":"2024-09-13T15:11:59.540301+0000","last_unstale":"2024-09-13T15:12:00.045107+0000","last_undegraded":"2024-09-13T15:12:00.045107+0000","last_fullsized":"2024-09-13T15:12:00.045107+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:34.635724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.050299+0000","last_change":"2024-09-13T15:12:00.047239+0000","last_active":"2024-09-13T15:12:00.050299+0000","last_peered":"2024-09-13T15:12:00.050299+0000","last_clean":"2024-09-13T15:12:00.050299+0000","last_became_active":"2024-09-13T15:12:00.044687+0000","last_became_peered":"2024-09-13T15:12:00.044687+0000","last_unstale":"2024-09-13T15:12:00.050299+0000","last_undegraded":"2024-09-13T15:12:00.050299+0000","last_fullsized":"2024-09-13T15:12:00.050299+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:38:40.003963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051871+0000","last_change":"2024-09-13T15:11:59.545273+0000","last_active":"2024-09-13T15:12:00.051871+0000","last_peered":"2024-09-13T15:12:00.051871+0000","last_clean":"2024-09-13T15:12:00.051871+0000","last_became_active":"2024-09-13T15:11:59.544983+0000","last_became_peered":"2024-09-13T15:11:59.544983+0000","last_unstale":"2024-09-13T15:12:00.051871+0000","last_undegraded":"2024-09-13T15:12:00.051871+0000","last_fullsized":"2024-09-13T15:12:00.051871+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.507124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.044423+0000","last_change":"2024-09-13T15:12:00.041318+0000","last_active":"2024-09-13T15:12:00.044423+0000","last_peered":"2024-09-13T15:12:00.044423+0000","last_clean":"2024-09-13T15:12:00.044423+0000","last_became_active":"2024-09-13T15:12:00.041046+0000","last_became_peered":"2024-09-13T15:12:00.041046+0000","last_unstale":"2024-09-13T15:12:00.044423+0000","last_undegraded":"2024-09-13T15:12:00.044423+0000","last_fullsized":"2024-09-13T15:12:00.044423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:53:57.681151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.020245+0000","last_change":"2024-09-13T15:11:59.539350+0000","last_active":"2024-09-13T15:12:00.020245+0000","last_peered":"2024-09-13T15:12:00.020245+0000","last_clean":"2024-09-13T15:12:00.020245+0000","last_became_active":"2024-09-13T15:11:59.539043+0000","last_became_peered":"2024-09-13T15:11:59.539043+0000","last_unstale":"2024-09-13T15:12:00.020245+0000","last_undegraded":"2024-09-13T15:12:00.020245+0000","last_fullsized":"2024-09-13T15:12:00.020245+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:46.872782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029994+0000","last_change":"2024-09-13T15:12:00.054992+0000","last_active":"2024-09-13T15:12:01.029994+0000","last_peered":"2024-09-13T15:12:01.029994+0000","last_clean":"2024-09-13T15:12:01.029994+0000","last_became_active":"2024-09-13T15:12:00.054704+0000","last_became_peered":"2024-09-13T15:12:00.054704+0000","last_unstale":"2024-09-13T15:12:01.029994+0000","last_undegraded":"2024-09-13T15:12:01.029994+0000","last_fullsized":"2024-09-13T15:12:01.029994+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:28.314382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041620+0000","last_change":"2024-09-13T15:11:59.544815+0000","last_active":"2024-09-13T15:12:00.041620+0000","last_peered":"2024-09-13T15:12:00.041620+0000","last_clean":"2024-09-13T15:12:00.041620+0000","last_became_active":"2024-09-13T15:11:59.544407+0000","last_became_peered":"2024-09-13T15:11:59.544407+0000","last_unstale":"2024-09-13T15:12:00.041620+0000","last_undegraded":"2024-09-13T15:12:00.041620+0000","last_fullsized":"2024-09-13T15:12:00.041620+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:10.248001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051051+0000","last_change":"2024-09-13T15:12:00.038023+0000","last_active":"2024-09-13T15:12:00.051051+0000","last_peered":"2024-09-13T15:12:00.051051+0000","last_clean":"2024-09-13T15:12:00.051051+0000","last_became_active":"2024-09-13T15:12:00.037351+0000","last_became_peered":"2024-09-13T15:12:00.037351+0000","last_unstale":"2024-09-13T15:12:00.051051+0000","last_undegraded":"2024-09-13T15:12:00.051051+0000","last_fullsized":"2024-09-13T15:12:00.051051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:24.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.019492+0000","last_change":"2024-09-13T15:11:59.540837+0000","last_active":"2024-09-13T15:12:00.019492+0000","last_peered":"2024-09-13T15:12:00.019492+0000","last_clean":"2024-09-13T15:12:00.019492+0000","last_became_active":"2024-09-13T15:11:59.539945+0000","last_became_peered":"2024-09-13T15:11:59.539945+0000","last_unstale":"2024-09-13T15:12:00.019492+0000","last_undegraded":"2024-09-13T15:12:00.019492+0000","last_fullsized":"2024-09-13T15:12:00.019492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:22.196459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.046998+0000","last_change":"2024-09-13T15:12:00.041587+0000","last_active":"2024-09-13T15:12:00.046998+0000","last_peered":"2024-09-13T15:12:00.046998+0000","last_clean":"2024-09-13T15:12:00.046998+0000","last_became_active":"2024-09-13T15:12:00.041308+0000","last_became_peered":"2024-09-13T15:12:00.041308+0000","last_unstale":"2024-09-13T15:12:00.046998+0000","last_undegraded":"2024-09-13T15:12:00.046998+0000","last_fullsized":"2024-09-13T15:12:00.046998+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:09.572393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"100'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033987+0000","last_change":"2024-09-13T15:11:59.552328+0000","last_active":"2024-09-13T15:12:01.033987+0000","last_peered":"2024-09-13T15:12:01.033987+0000","last_clean":"2024-09-13T15:12:01.033987+0000","last_became_active":"2024-09-13T15:11:59.551358+0000","last_became_peered":"2024-09-13T15:11:59.551358+0000","last_unstale":"2024-09-13T15:12:01.033987+0000","last_undegraded":"2024-09-13T15:12:01.033987+0000","last_fullsized":"2024-09-13T15:12:01.033987+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:52.745190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041481+0000","last_change":"2024-09-13T15:12:00.032186+0000","last_active":"2024-09-13T15:12:00.041481+0000","last_peered":"2024-09-13T15:12:00.041481+0000","last_clean":"2024-09-13T15:12:00.041481+0000","last_became_active":"2024-09-13T15:12:00.031936+0000","last_became_peered":"2024-09-13T15:12:00.031936+0000","last_unstale":"2024-09-13T15:12:00.041481+0000","last_undegraded":"2024-09-13T15:12:00.041481+0000","last_fullsized":"2024-09-13T15:12:00.041481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.486988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026931+0000","last_change":"2024-09-13T15:11:59.546511+0000","last_active":"2024-09-13T15:12:00.026931+0000","last_peered":"2024-09-13T15:12:00.026931+0000","last_clean":"2024-09-13T15:12:00.026931+0000","last_became_active":"2024-09-13T15:11:59.546226+0000","last_became_peered":"2024-09-13T15:11:59.546226+0000","last_unstale":"2024-09-13T15:12:00.026931+0000","last_undegraded":"2024-09-13T15:12:00.026931+0000","last_fullsized":"2024-09-13T15:12:00.026931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:35.744655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.029629+0000","last_change":"2024-09-13T15:12:00.047687+0000","last_active":"2024-09-13T15:12:01.029629+0000","last_peered":"2024-09-13T15:12:01.029629+0000","last_clean":"2024-09-13T15:12:01.029629+0000","last_became_active":"2024-09-13T15:12:00.047448+0000","last_became_peered":"2024-09-13T15:12:00.047448+0000","last_unstale":"2024-09-13T15:12:01.029629+0000","last_undegraded":"2024-09-13T15:12:01.029629+0000","last_fullsized":"2024-09-13T15:12:01.029629+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:33.486988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041895+0000","last_change":"2024-09-13T15:11:59.543102+0000","last_active":"2024-09-13T15:12:00.041895+0000","last_peered":"2024-09-13T15:12:00.041895+0000","last_clean":"2024-09-13T15:12:00.041895+0000","last_became_active":"2024-09-13T15:11:59.542829+0000","last_became_peered":"2024-09-13T15:11:59.542829+0000","last_unstale":"2024-09-13T15:12:00.041895+0000","last_undegraded":"2024-09-13T15:12:00.041895+0000","last_fullsized":"2024-09-13T15:12:00.041895+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:21.824256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061103+0000","last_change":"2024-09-13T15:12:00.053434+0000","last_active":"2024-09-13T15:12:00.061103+0000","last_peered":"2024-09-13T15:12:00.061103+0000","last_clean":"2024-09-13T15:12:00.061103+0000","last_became_active":"2024-09-13T15:12:00.053149+0000","last_became_peered":"2024-09-13T15:12:00.053149+0000","last_unstale":"2024-09-13T15:12:00.061103+0000","last_undegraded":"2024-09-13T15:12:00.061103+0000","last_fullsized":"2024-09-13T15:12:00.061103+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:36.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.033668+0000","last_change":"2024-09-13T15:11:59.549853+0000","last_active":"2024-09-13T15:12:01.033668+0000","last_peered":"2024-09-13T15:12:01.033668+0000","last_clean":"2024-09-13T15:12:01.033668+0000","last_became_active":"2024-09-13T15:11:59.549092+0000","last_became_peered":"2024-09-13T15:11:59.549092+0000","last_unstale":"2024-09-13T15:12:01.033668+0000","last_undegraded":"2024-09-13T15:12:01.033668+0000","last_fullsized":"2024-09-13T15:12:01.033668+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:45.932744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.050147+0000","last_change":"2024-09-13T15:12:00.035331+0000","last_active":"2024-09-13T15:12:00.050147+0000","last_peered":"2024-09-13T15:12:00.050147+0000","last_clean":"2024-09-13T15:12:00.050147+0000","last_became_active":"2024-09-13T15:12:00.035084+0000","last_became_peered":"2024-09-13T15:12:00.035084+0000","last_unstale":"2024-09-13T15:12:00.050147+0000","last_undegraded":"2024-09-13T15:12:00.050147+0000","last_fullsized":"2024-09-13T15:12:00.050147+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:17.742523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.026439+0000","last_change":"2024-09-13T15:11:59.539724+0000","last_active":"2024-09-13T15:12:00.026439+0000","last_peered":"2024-09-13T15:12:00.026439+0000","last_clean":"2024-09-13T15:12:00.026439+0000","last_became_active":"2024-09-13T15:11:59.539405+0000","last_became_peered":"2024-09-13T15:11:59.539405+0000","last_unstale":"2024-09-13T15:12:00.026439+0000","last_undegraded":"2024-09-13T15:12:00.026439+0000","last_fullsized":"2024-09-13T15:12:00.026439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:00.152779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041686+0000","last_change":"2024-09-13T15:12:00.034021+0000","last_active":"2024-09-13T15:12:00.041686+0000","last_peered":"2024-09-13T15:12:00.041686+0000","last_clean":"2024-09-13T15:12:00.041686+0000","last_became_active":"2024-09-13T15:12:00.033769+0000","last_became_peered":"2024-09-13T15:12:00.033769+0000","last_unstale":"2024-09-13T15:12:00.041686+0000","last_undegraded":"2024-09-13T15:12:00.041686+0000","last_fullsized":"2024-09-13T15:12:00.041686+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:15.092681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.020896+0000","last_change":"2024-09-13T15:11:59.539325+0000","last_active":"2024-09-13T15:12:00.020896+0000","last_peered":"2024-09-13T15:12:00.020896+0000","last_clean":"2024-09-13T15:12:00.020896+0000","last_became_active":"2024-09-13T15:11:59.539016+0000","last_became_peered":"2024-09-13T15:11:59.539016+0000","last_unstale":"2024-09-13T15:12:00.020896+0000","last_undegraded":"2024-09-13T15:12:00.020896+0000","last_fullsized":"2024-09-13T15:12:00.020896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:56.698231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T15:12:01.031167+0000","last_change":"2024-09-13T15:12:00.057510+0000","last_active":"2024-09-13T15:12:01.031167+0000","last_peered":"2024-09-13T15:12:01.031167+0000","last_clean":"2024-09-13T15:12:01.031167+0000","last_became_active":"2024-09-13T15:12:00.057226+0000","last_became_peered":"2024-09-13T15:12:00.057226+0000","last_unstale":"2024-09-13T15:12:01.031167+0000","last_undegraded":"2024-09-13T15:12:01.031167+0000","last_fullsized":"2024-09-13T15:12:01.031167+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.041730+0000","last_change":"2024-09-13T15:11:59.540864+0000","last_active":"2024-09-13T15:12:00.041730+0000","last_peered":"2024-09-13T15:12:00.041730+0000","last_clean":"2024-09-13T15:12:00.041730+0000","last_became_active":"2024-09-13T15:11:59.540602+0000","last_became_peered":"2024-09-13T15:11:59.540602+0000","last_unstale":"2024-09-13T15:12:00.041730+0000","last_undegraded":"2024-09-13T15:12:00.041730+0000","last_fullsized":"2024-09-13T15:12:00.041730+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:09.621287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061489+0000","last_change":"2024-09-13T15:12:00.055093+0000","last_active":"2024-09-13T15:12:00.061489+0000","last_peered":"2024-09-13T15:12:00.061489+0000","last_clean":"2024-09-13T15:12:00.061489+0000","last_became_active":"2024-09-13T15:12:00.054850+0000","last_became_peered":"2024-09-13T15:12:00.054850+0000","last_unstale":"2024-09-13T15:12:00.061489+0000","last_undegraded":"2024-09-13T15:12:00.061489+0000","last_fullsized":"2024-09-13T15:12:00.061489+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:23.758115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.019644+0000","last_change":"2024-09-13T15:11:59.541075+0000","last_active":"2024-09-13T15:12:00.019644+0000","last_peered":"2024-09-13T15:12:00.019644+0000","last_clean":"2024-09-13T15:12:00.019644+0000","last_became_active":"2024-09-13T15:11:59.540537+0000","last_became_peered":"2024-09-13T15:11:59.540537+0000","last_unstale":"2024-09-13T15:12:00.019644+0000","last_undegraded":"2024-09-13T15:12:00.019644+0000","last_fullsized":"2024-09-13T15:12:00.019644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:02.994784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.061162+0000","last_change":"2024-09-13T15:12:00.053674+0000","last_active":"2024-09-13T15:12:00.061162+0000","last_peered":"2024-09-13T15:12:00.061162+0000","last_clean":"2024-09-13T15:12:00.061162+0000","last_became_active":"2024-09-13T15:12:00.047926+0000","last_became_peered":"2024-09-13T15:12:00.047926+0000","last_unstale":"2024-09-13T15:12:00.061162+0000","last_undegraded":"2024-09-13T15:12:00.061162+0000","last_fullsized":"2024-09-13T15:12:00.061162+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:59.504951+0000","last_clean_scrub_stamp":"2024-09-13T15:11:59.504951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.068668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.051601+0000","last_change":"2024-09-13T15:11:59.542410+0000","last_active":"2024-09-13T15:12:00.051601+0000","last_peered":"2024-09-13T15:12:00.051601+0000","last_clean":"2024-09-13T15:12:00.051601+0000","last_became_active":"2024-09-13T15:11:59.542091+0000","last_became_peered":"2024-09-13T15:11:59.542091+0000","last_unstale":"2024-09-13T15:12:00.051601+0000","last_undegraded":"2024-09-13T15:12:00.051601+0000","last_fullsized":"2024-09-13T15:12:00.051601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:11:58.491459+0000","last_clean_scrub_stamp":"2024-09-13T15:11:58.491459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:58.377654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":231,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T15:12:00.028434+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:12:00.028434+0000","last_peered":"2024-09-13T15:12:00.028434+0000","last_clean":"2024-09-13T15:12:00.028434+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:12:00.028434+0000","last_undegraded":"2024-09-13T15:12:00.028434+0000","last_fullsized":"2024-09-13T15:12:00.028434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1843200,"data_stored":1152410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1599999999999999,"15min":1.1830000000000001},"min":{"1min":0.78600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.601,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.878},{"interface":"front","average":{"1min":1.181,"5min":1.234,"15min":1.2749999999999999},"min":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6379999999999999,"5min":1.839,"15min":1.839},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2689999999999999,"15min":1.349},"min":{"1min":0.94799999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.571,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.9930000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1859999999999999,"15min":1.2490000000000001},"min":{"1min":0.83699999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.3819999999999999,"5min":1.577,"15min":1.577},"last":1.732}]},{"osd":2,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.284,"15min":1.3759999999999999},"min":{"1min":0.96299999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.5229999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3120000000000001,"15min":1.3580000000000001},"min":{"1min":0.96499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5900000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.4690000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.337,"15min":1.417},"min":{"1min":0.73599999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.528,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.022},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.411,"15min":1.5149999999999999},"min":{"1min":0.85399999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.71,"5min":2.081,"15min":2.081},"last":1.6839999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2410000000000001,"15min":1.353},"min":{"1min":0.83199999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.462,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.3109999999999999,"15min":1.4179999999999999},"min":{"1min":0.63400000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.631,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.633}]},{"osd":5,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4399999999999999,"15min":1.5660000000000001},"min":{"1min":1.0089999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.758,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3839999999999999,"15min":1.4910000000000001},"min":{"1min":0.90100000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5700000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.8200000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:11:41 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4490000000000001,"15min":1.583},"min":{"1min":1.1759999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5249999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.492,"15min":1.625},"min":{"1min":0.95299999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.716,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.29}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1257472,"data_stored":563031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1359999999999999,"15min":1.1899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.8480000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.135,"15min":1.161},"min":{"1min":0.83599999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.131,"15min":1.1359999999999999},"min":{"1min":0.78500000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6659999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.05},{"interface":"front","average":{"1min":1.343,"5min":1.2789999999999999,"15min":1.343},"min":{"1min":0.83299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.218}]},{"osd":2,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2430000000000001,"15min":1.29},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.895,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3340000000000001,"15min":1.3879999999999999},"min":{"1min":1.05,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7709999999999999,"5min":1.986,"15min":1.986},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3120000000000001,"15min":1.323},"min":{"1min":1.0660000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":1.121},{"interface":"front","average":{"1min":1.282,"5min":1.3140000000000001,"15min":1.3819999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.3180000000000001,"5min":2.371,"15min":2.371},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.284,"15min":1.3680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.9730000000000001,"5min":2.835,"15min":2.835},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.2589999999999999,"15min":1.361},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0089999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.2669999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2809999999999999,"15min":1.3049999999999999},"min":{"1min":0.78900000000000003,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8759999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.365},{"interface":"front","average":{"1min":1.393,"5min":1.49,"15min":1.5880000000000001},"min":{"1min":0.92700000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.0600000000000001,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.87}]},{"osd":7,"last update":"Fri Sep 13 15:11:38 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.369,"15min":1.4299999999999999},"min":{"1min":0.81100000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.8149999999999999,"5min":2.444,"15min":2.444},"last":1.329},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.474,"15min":1.5389999999999999},"min":{"1min":1.018,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.1110000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.1890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1241088,"data_stored":561882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1930000000000001,"15min":1.2889999999999999},"min":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7090000000000001,"5min":1.869,"15min":1.869},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2090000000000001,"15min":1.349},"min":{"1min":0.65100000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9390000000000001,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.2070000000000001,"15min":1.2709999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1839999999999999,"15min":1.2490000000000001},"min":{"1min":0.80400000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.514,"5min":2.665,"15min":2.665},"last":1.284}]},{"osd":2,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.21,"15min":1.2609999999999999},"min":{"1min":0.78800000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.151},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.296,"15min":1.3660000000000001},"min":{"1min":0.77800000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2210000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2529999999999999,"15min":1.3320000000000001},"min":{"1min":0.81200000000000006,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8149999999999999,"5min":2.524,"15min":2.524},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4019999999999999,"15min":1.492},"min":{"1min":0.879,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.3380000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.304,"15min":1.3839999999999999},"min":{"1min":0.82299999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6279999999999999,"5min":2.012,"15min":2.012},"last":1.306},{"interface":"front","average":{"1min":1.284,"5min":1.375,"15min":1.478},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.1179999999999999,"5min":3.117,"15min":3.117},"last":0.97899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.3740000000000001,"15min":1.52},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.8200000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.016},{"interface":"front","average":{"1min":1.351,"5min":1.4359999999999999,"15min":1.569},"min":{"1min":0.99199999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.0600000000000001,"5min":2.411,"15min":2.411},"last":1.129}]},{"osd":7,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.421,"15min":1.5429999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2170000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.5109999999999999,"15min":1.659},"min":{"1min":0.80400000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3260000000000001,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.246}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1249280,"data_stored":561974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1120000000000001,"15min":1.1579999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.579,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.167,"15min":1.1970000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.627,"5min":1.78,"15min":1.78},"last":1.6259999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2070000000000001,"15min":1.2490000000000001},"min":{"1min":0.88500000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5569999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1819999999999999,"15min":1.2250000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6559999999999999,"5min":1.794,"15min":1.794},"last":1.02}]},{"osd":2,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.171,"15min":1.1870000000000001},"min":{"1min":0.76400000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.589,"5min":1.621,"15min":1.621},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3,"15min":1.3360000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5960000000000001,"5min":1.887,"15min":1.887},"last":1.7909999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2350000000000001,"15min":1.262},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.49,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.258,"15min":1.3280000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.75,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.5840000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3180000000000001,"15min":1.3700000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.389},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3440000000000001,"15min":1.389},"min":{"1min":0.75700000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7889999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2370000000000001,"15min":1.294},"min":{"1min":0.67300000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.843,"5min":2.214,"15min":2.214},"last":1.677},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3759999999999999,"15min":1.4359999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6699999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:11:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3640000000000001,"15min":1.4339999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7150000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4139999999999999,"15min":1.484},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.9470000000000001,"5min":2.524,"15min":2.524},"last":1.7589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1241088,"data_stored":561445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.99399999999999999,"15min":1.0529999999999999},"min":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.3140000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.163},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.0740000000000001,"15min":1.085},"min":{"1min":0.81100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.272}]},{"osd":1,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.99299999999999999,"15min":1.0640000000000001},"min":{"1min":0.56499999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.8700000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.133,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.5510000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.097,"15min":1.1910000000000001},"min":{"1min":0.75900000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.6320000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.252,"15min":1.3460000000000001},"min":{"1min":0.81999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.8009999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.0600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.333,"15min":1.381},"min":{"1min":0.96499999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.046},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.361,"15min":1.429},"min":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6930000000000001,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.103}]},{"osd":5,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4079999999999999,"15min":1.502},"min":{"1min":0.80200000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7629999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.294},{"interface":"front","average":{"1min":1.401,"5min":1.5169999999999999,"15min":1.653},"min":{"1min":1.0640000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.1560000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4159999999999999,"15min":1.4890000000000001},"min":{"1min":1.075,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.839,"5min":2.839,"15min":2.839},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4710000000000001,"15min":1.5569999999999999},"min":{"1min":1.1479999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.8090000000000002,"5min":3.786,"15min":3.786},"last":1.395}]},{"osd":7,"last update":"Fri Sep 13 15:11:36 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.6180000000000001,"15min":1.76},"min":{"1min":1.05,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.2559999999999998,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.333},{"interface":"front","average":{"1min":1.502,"5min":1.5569999999999999,"15min":1.657},"min":{"1min":1.141,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1245184,"data_stored":561916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86099999999999999,"15min":0.877},"min":{"1min":0.57199999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.155,"5min":1.393,"15min":1.393},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.004,"15min":1.048},"min":{"1min":0.68899999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.048}]},{"osd":1,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.52300000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.599,"15min":1.599},"last":1.097},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3660000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.3460000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.097},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.369,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.159},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.022,"15min":1.0720000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3129999999999999,"15min":1.3740000000000001},"min":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.913,"5min":2.657,"15min":2.657},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.4019999999999999,"15min":1.484},"min":{"1min":0.93600000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8169999999999999,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.298,"15min":1.3129999999999999},"min":{"1min":0.91100000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6619999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.361,"15min":1.387},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7450000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.999}]},{"osd":6,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.4039999999999999,"15min":1.472},"min":{"1min":0.86699999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.637,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4159999999999999,"15min":1.462},"min":{"1min":0.999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.958,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.222}]},{"osd":7,"last update":"Fri Sep 13 15:11:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.486,"15min":1.5449999999999999},"min":{"1min":0.80300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.5960000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.302},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.504,"15min":1.55},"min":{"1min":1.143,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.833,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.2769999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1245184,"data_stored":561916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91100000000000003,"15min":0.87},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.427,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.351},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":1.0109999999999999},"min":{"1min":0.75600000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5209999999999999,"5min":1.722,"15min":1.722},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.88700000000000001},"min":{"1min":0.58699999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2070000000000001,"5min":1.502,"15min":1.502},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0429999999999999,"15min":1.0529999999999999},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.169}]},{"osd":3,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1160000000000001,"15min":1.1299999999999999},"min":{"1min":0.66600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5640000000000001,"5min":1.764,"15min":1.764},"last":1.593},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.129},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":3.254,"15min":3.254},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.177,"15min":1.1930000000000001},"min":{"1min":0.81399999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.341,"15min":1.371},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.681,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.786}]},{"osd":5,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":1,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.5960000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2949999999999999,"15min":1.357},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.79,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3879999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.448,"15min":1.5069999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.8720000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.4339999999999999,"15min":1.546},"min":{"1min":0.93999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.746,"5min":4.843,"15min":4.843},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:11:34 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.532,"15min":1.679},"min":{"1min":1.161,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.821,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4219999999999999,"15min":1.49},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.895,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.468}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1847296,"data_stored":1152885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.86099999999999999,"15min":0.92900000000000005},"min":{"1min":0.51900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.284,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.748},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.90400000000000003},"min":{"1min":0.59599999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.181}]},{"osd":2,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1719999999999999,"15min":1.292},"min":{"1min":0.66500000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8540000000000001,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.085,"15min":1.2849999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2310000000000001,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.107,"15min":1.155},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.7949999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3129999999999999,"15min":1.3080000000000001},"min":{"1min":1.0389999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.766,"5min":2.157,"15min":2.157},"last":1.5169999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.266,"15min":1.304},"min":{"1min":0.90900000000000003,"5min":0.875,"15min":0.875},"max":{"1min":1.5489999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.022},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3620000000000001,"15min":1.371},"min":{"1min":0.96599999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.323,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6439999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.3560000000000001,"15min":1.387},"min":{"1min":1.0609999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.806,"5min":2.367,"15min":2.367},"last":1.4299999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4710000000000001,"15min":1.4870000000000001},"min":{"1min":1.1359999999999999,"5min":1.05,"15min":1.05},"max":{"1min":2.052,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.379,"15min":1.462},"min":{"1min":1.0289999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6439999999999999,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:11:33 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.45,"15min":1.524},"min":{"1min":0.90400000000000003,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":3.302,"15min":3.302},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.425,"15min":1.4650000000000001},"min":{"1min":1.0700000000000001,"5min":0.874,"15min":0.874},"max":{"1min":1.6910000000000001,"5min":2.266,"15min":2.266},"last":1.2949999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:12:04.952 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:12:04.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T15:12:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.135+0000 7f28baa00700 1 Processor -- start 2024-09-13T15:12:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.135+0000 7f28baa00700 1 -- start start 2024-09-13T15:12:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28baa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28b415c9f0 0x7f28b406b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28baa00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f28b4072710 0x7f28b40cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28baa00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b40af0c0 con 0x7f28b40d00d0 2024-09-13T15:12:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28baa00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b40d0580 con 0x7f28b415c9f0 2024-09-13T15:12:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28baa00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b4071b60 con 0x7f28b4072710 2024-09-13T15:12:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28b415c9f0 0x7f28b406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28b415c9f0 0x7f28b406b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50104/0 (socket says 172.21.15.50:50104) 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 -- 172.21.15.50:0/2335455395 learned_addr learned my addr 172.21.15.50:0/2335455395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b8c00700 1 --2- 172.21.15.50:0/2335455395 >> v2:172.21.15.181:3300/0 conn(0x7f28b4072710 0x7f28b40cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 -- 172.21.15.50:0/2335455395 >> v2:172.21.15.181:3300/0 conn(0x7f28b4072710 msgr2=0x7f28b40cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 --2- 172.21.15.50:0/2335455395 >> v2:172.21.15.181:3300/0 conn(0x7f28b4072710 0x7f28b40cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 -- 172.21.15.50:0/2335455395 >> v1:172.21.15.181:6789/0 conn(0x7f28b40d00d0 legacy=0x7f28b4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 -- 172.21.15.50:0/2335455395 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b406b8e0 con 0x7f28b415c9f0 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b8c00700 1 --2- 172.21.15.50:0/2335455395 >> v2:172.21.15.181:3300/0 conn(0x7f28b4072710 0x7f28b40cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b9600700 1 --2- 172.21.15.50:0/2335455395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b406b000 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009910 tx=0x7f28a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fa29252960269d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.139+0000 7f28b3e00700 1 -- 172.21.15.50:0/2335455395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800ba20 con 0x7f28b415c9f0 2024-09-13T15:12:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28b3e00700 1 -- 172.21.15.50:0/2335455395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800bb80 con 0x7f28b415c9f0 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28b3e00700 1 -- 172.21.15.50:0/2335455395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8009e60 con 0x7f28b415c9f0 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 -- 172.21.15.50:0/2335455395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 msgr2=0x7f28b406b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 --2- 172.21.15.50:0/2335455395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b406b000 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009910 tx=0x7f28a8009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 -- 172.21.15.50:0/2335455395 shutdown_connections 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 --2- 172.21.15.50:0/2335455395 >> v2:172.21.15.181:3300/0 conn(0x7f28b4072710 0x7f28b40cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 --2- 172.21.15.50:0/2335455395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b406b000 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 -- 172.21.15.50:0/2335455395 >> 172.21.15.50:0/2335455395 conn(0x7f28b406cbf0 msgr2=0x7f28b406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 -- 172.21.15.50:0/2335455395 shutdown_connections 2024-09-13T15:12:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.143+0000 7f28baa00700 1 -- 172.21.15.50:0/2335455395 wait complete. 2024-09-13T15:12:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 Processor -- start 2024-09-13T15:12:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 -- start start 2024-09-13T15:12:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28b4072710 0x7f28b40c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 0x7f28b415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c9570 con 0x7f28b415c9f0 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c4870 con 0x7f28b40d00d0 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28baa00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c4b50 con 0x7f28b4072710 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28ba000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28b8c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 0x7f28b415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28b8c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 0x7f28b415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:52408/0 (socket says 172.21.15.50:52408) 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28b8c00700 1 -- 172.21.15.50:0/4175325889 learned_addr learned my addr 172.21.15.50:0/4175325889 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28ba000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b414efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50120/0 (socket says 172.21.15.50:50120) 2024-09-13T15:12:05.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.147+0000 7f28b9600700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28b4072710 0x7f28b40c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28ba000700 1 -- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28b4072710 msgr2=0x7f28b40c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28ba000700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28b4072710 0x7f28b40c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28ba000700 1 -- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 msgr2=0x7f28b415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28ba000700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 0x7f28b415f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28ba000700 1 -- 172.21.15.50:0/4175325889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a8009570 con 0x7f28b415c9f0 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28b8c00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 0x7f28b415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28ba000700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b414efa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00cb90 tx=0x7f28ac00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac003c20 con 0x7f28b415c9f0 2024-09-13T15:12:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac003d80 con 0x7f28b415c9f0 2024-09-13T15:12:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b40c4e30 con 0x7f28b415c9f0 2024-09-13T15:12:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac00aa80 con 0x7f28b415c9f0 2024-09-13T15:12:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b40c53f0 con 0x7f28b415c9f0 2024-09-13T15:12:05.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.151+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b415df50 con 0x7f28b415c9f0 2024-09-13T15:12:05.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.155+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28ac00abe0 con 0x7f28b415c9f0 2024-09-13T15:12:05.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.155+0000 7f28b1600700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2894066730 0x7f2894068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.155+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f28ac084180 con 0x7f28b415c9f0 2024-09-13T15:12:05.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.155+0000 7f28b9600700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2894066730 0x7f2894068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.155+0000 7f28b9600700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2894066730 0x7f2894068bf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000c00 tx=0x7f28a8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.159+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28ac0513b0 con 0x7f28b415c9f0 2024-09-13T15:12:05.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.403+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f28b40ada10 con 0x7f28b415c9f0 2024-09-13T15:12:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.411+0000 7f28b1600700 1 -- 172.21.15.50:0/4175325889 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f28ac0549d0 con 0x7f28b415c9f0 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2894066730 msgr2=0x7f2894068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2894066730 0x7f2894068bf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000c00 tx=0x7f28a8008030 comp rx=0 tx=0).stop 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 msgr2=0x7f28b414efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b414efa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00cb90 tx=0x7f28ac00cea0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 shutdown_connections 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2894066730 0x7f2894068bf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b415c9f0 0x7f28b414efa0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28b40d00d0 0x7f28b415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 --2- 172.21.15.50:0/4175325889 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f28b4072710 0x7f28b40c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 >> 172.21.15.50:0/4175325889 conn(0x7f28b406cbf0 msgr2=0x7f28b406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 shutdown_connections 2024-09-13T15:12:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.415+0000 7f28baa00700 1 -- 172.21.15.50:0/4175325889 wait complete. 2024-09-13T15:12:05.423 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-13T15:12:05.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:05.494 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-13T15:12:05.487+0000 7faabda00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:12:05.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.615+0000 7f1627200700 1 Processor -- start 2024-09-13T15:12:05.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.615+0000 7f1627200700 1 -- start start 2024-09-13T15:12:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1627200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16200b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1627200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200d1390 con 0x7f16200cdfe0 2024-09-13T15:12:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1627200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200d1670 con 0x7f162015d170 2024-09-13T15:12:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1627200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200b2530 con 0x7f162015cd90 2024-09-13T15:12:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1626800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16200cdfe0 0x7f162006bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58554/0 (socket says 172.21.15.50:58554) 2024-09-13T15:12:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1626800700 1 -- 172.21.15.50:0/4095945402 learned_addr learned my addr 172.21.15.50:0/4095945402 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1625e00700 1 --2- 172.21.15.50:0/4095945402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16200b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1624a00700 1 -- 172.21.15.50:0/4095945402 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707116778 0 0) 0x7f16200d1390 con 0x7f16200cdfe0 2024-09-13T15:12:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.619+0000 7f1624a00700 1 -- 172.21.15.50:0/4095945402 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16080035d0 con 0x7f16200cdfe0 2024-09-13T15:12:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1625e00700 1 -- 172.21.15.50:0/4095945402 >> v1:172.21.15.181:6789/0 conn(0x7f162015d170 legacy=0x7f16200cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1625e00700 1 -- 172.21.15.50:0/4095945402 >> v1:172.21.15.50:6789/0 conn(0x7f16200cdfe0 legacy=0x7f162006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1624a00700 1 -- 172.21.15.50:0/4095945402 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1189494460 0 0) 0x7f16080035d0 con 0x7f16200cdfe0 2024-09-13T15:12:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1625e00700 1 -- 172.21.15.50:0/4095945402 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200d1950 con 0x7f162015cd90 2024-09-13T15:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1625e00700 1 --2- 172.21.15.50:0/4095945402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16200b1f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1614009880 tx=0x7f1614009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e12e9bfdf14f88e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1624a00700 1 -- 172.21.15.50:0/4095945402 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0019f0 con 0x7f162015cd90 2024-09-13T15:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1624a00700 1 -- 172.21.15.50:0/4095945402 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614004030 con 0x7f162015cd90 2024-09-13T15:12:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1624a00700 1 -- 172.21.15.50:0/4095945402 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16140043c0 con 0x7f162015cd90 2024-09-13T15:12:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 -- 172.21.15.50:0/4095945402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 msgr2=0x7f16200b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 --2- 172.21.15.50:0/4095945402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16200b1f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1614009880 tx=0x7f1614009b90 comp rx=0 tx=0).stop 2024-09-13T15:12:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 -- 172.21.15.50:0/4095945402 shutdown_connections 2024-09-13T15:12:05.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 --2- 172.21.15.50:0/4095945402 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16200b1f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 -- 172.21.15.50:0/4095945402 >> 172.21.15.50:0/4095945402 conn(0x7f16200d2c10 msgr2=0x7f16200d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:05.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 -- 172.21.15.50:0/4095945402 shutdown_connections 2024-09-13T15:12:05.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.623+0000 7f1627200700 1 -- 172.21.15.50:0/4095945402 wait complete. 2024-09-13T15:12:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 Processor -- start 2024-09-13T15:12:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 -- start start 2024-09-13T15:12:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16200cdfe0 0x7f16200a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16201f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 0x7f162015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200b6ca0 con 0x7f162015d170 2024-09-13T15:12:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200b7b00 con 0x7f16200cdfe0 2024-09-13T15:12:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1627200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200ca010 con 0x7f162015cd90 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1626800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 0x7f162015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1626800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 0x7f162015ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50132/0 (socket says 172.21.15.50:50132) 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.627+0000 7f1626800700 1 -- 172.21.15.50:0/2371275139 learned_addr learned my addr 172.21.15.50:0/2371275139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1625e00700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16200cdfe0 0x7f16200a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1625400700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16201f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1626800700 1 -- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 msgr2=0x7f16201f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1626800700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16201f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1626800700 1 -- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16200cdfe0 msgr2=0x7f16200a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1626800700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16200cdfe0 0x7f16200a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1626800700 1 -- 172.21.15.50:0/2371275139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140094b0 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1626800700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 0x7f162015ea30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f161c00cc90 tx=0x7f161c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00aad0 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00ac30 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16200b6e80 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0070d0 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16200b7440 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.631+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16200b7c40 con 0x7f162015d170 2024-09-13T15:12:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.635+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f161c007230 con 0x7f162015d170 2024-09-13T15:12:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.635+0000 7f161a000700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1604066730 0x7f1604068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.635+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f161c083da0 con 0x7f162015d170 2024-09-13T15:12:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.639+0000 7f1625e00700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1604066730 0x7f1604068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.639+0000 7f1625e00700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1604066730 0x7f1604068bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f16140090b0 tx=0x7f1614010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.643+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16200b7c40 con 0x7f162015d170 2024-09-13T15:12:05.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.883+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16200b7c40 con 0x7f162015d170 2024-09-13T15:12:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.883+0000 7f161a000700 1 -- 172.21.15.50:0/2371275139 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f16200b7c40 con 0x7f162015d170 2024-09-13T15:12:05.890 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:05.890 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/2773604329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2773604329},{"type":"v1","addr":"172.21.15.181:6835","nonce":2773604329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1242078789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1242078789},{"type":"v1","addr":"172.21.15.181:6837","nonce":1242078789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3644270501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3644270501},{"type":"v1","addr":"172.21.15.50:6833","nonce":3644270501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:03.031244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2577107387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2577107387},{"type":"v1","addr":"172.21.15.50:6835","nonce":2577107387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1604066730 msgr2=0x7f1604068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1604066730 0x7f1604068bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f16140090b0 tx=0x7f1614010000 comp rx=0 tx=0).stop 2024-09-13T15:12:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 msgr2=0x7f162015ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 0x7f162015ea30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f161c00cc90 tx=0x7f161c00a060 comp rx=0 tx=0).stop 2024-09-13T15:12:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 shutdown_connections 2024-09-13T15:12:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1604066730 0x7f1604068bf0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f162015d170 0x7f162015ea30 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f162015cd90 0x7f16201f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 --2- 172.21.15.50:0/2371275139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16200cdfe0 0x7f16200a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 >> 172.21.15.50:0/2371275139 conn(0x7f16200d2c10 msgr2=0x7f1620068160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 shutdown_connections 2024-09-13T15:12:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:05.891+0000 7f1627200700 1 -- 172.21.15.50:0/2371275139 wait complete. 2024-09-13T15:12:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 54 2024-09-13T15:12:05.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:12:05.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:12:06.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:12:00.010021+0000', 'modified': '2024-09-13T15:12:03.031244+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7389': {'gid': 7389, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/2577107387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2577107387}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2577107387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:12:06.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:12:06.322 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T15:12:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.495+0000 7f8fa7200700 1 Processor -- start 2024-09-13T15:12:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.495+0000 7f8fa7200700 1 -- start start 2024-09-13T15:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa7200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fa8154e40 0x7f8fa815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa7200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8fa80667a0 0x7f8fa806abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa7200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa815bfe0 con 0x7f8fa80cf330 2024-09-13T15:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa7200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa815b450 con 0x7f8fa8154e40 2024-09-13T15:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa7200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa815b730 con 0x7f8fa80667a0 2024-09-13T15:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fa8154e40 0x7f8fa815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fa8154e40 0x7f8fa815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50136/0 (socket says 172.21.15.50:50136) 2024-09-13T15:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 -- 172.21.15.50:0/2446708755 learned_addr learned my addr 172.21.15.50:0/2446708755 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa6800700 1 --2- 172.21.15.50:0/2446708755 >> v2:172.21.15.181:3300/0 conn(0x7f8fa80667a0 0x7f8fa806abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 -- 172.21.15.50:0/2446708755 >> v2:172.21.15.181:3300/0 conn(0x7f8fa80667a0 msgr2=0x7f8fa806abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2446708755 >> v2:172.21.15.181:3300/0 conn(0x7f8fa80667a0 0x7f8fa806abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 -- 172.21.15.50:0/2446708755 >> v1:172.21.15.181:6789/0 conn(0x7f8fa80cf330 legacy=0x7f8fa8066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 -- 172.21.15.50:0/2446708755 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa815ba10 con 0x7f8fa8154e40 2024-09-13T15:12:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.499+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2446708755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8154e40 0x7f8fa815ae20 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009910 tx=0x7f8f98009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f169080b077dbdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa4a00700 1 -- 172.21.15.50:0/2446708755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9800ba20 con 0x7f8fa8154e40 2024-09-13T15:12:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa4a00700 1 -- 172.21.15.50:0/2446708755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9800bb80 con 0x7f8fa8154e40 2024-09-13T15:12:06.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa4a00700 1 -- 172.21.15.50:0/2446708755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98009e60 con 0x7f8fa8154e40 2024-09-13T15:12:06.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 -- 172.21.15.50:0/2446708755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8154e40 msgr2=0x7f8fa815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 --2- 172.21.15.50:0/2446708755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8154e40 0x7f8fa815ae20 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009910 tx=0x7f8f98009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:06.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 -- 172.21.15.50:0/2446708755 shutdown_connections 2024-09-13T15:12:06.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 --2- 172.21.15.50:0/2446708755 >> v2:172.21.15.181:3300/0 conn(0x7f8fa80667a0 0x7f8fa806abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 --2- 172.21.15.50:0/2446708755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa8154e40 0x7f8fa815ae20 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 -- 172.21.15.50:0/2446708755 >> 172.21.15.50:0/2446708755 conn(0x7f8fa806e660 msgr2=0x7f8fa806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 -- 172.21.15.50:0/2446708755 shutdown_connections 2024-09-13T15:12:06.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.503+0000 7f8fa7200700 1 -- 172.21.15.50:0/2446708755 wait complete. 2024-09-13T15:12:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 Processor -- start 2024-09-13T15:12:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 -- start start 2024-09-13T15:12:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 0x7f8fa814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fa80cf330 0x7f8fa8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8fa8154e40 0x7f8fa8157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80b4b50 con 0x7f8fa80667a0 2024-09-13T15:12:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa81f5ee0 con 0x7f8fa80cf330 2024-09-13T15:12:06.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.507+0000 7f8fa7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa81f61c0 con 0x7f8fa8154e40 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 0x7f8fa814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 0x7f8fa814a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50138/0 (socket says 172.21.15.50:50138) 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 -- 172.21.15.50:0/3339801505 learned_addr learned my addr 172.21.15.50:0/3339801505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fa80cf330 0x7f8fa8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa6800700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8fa8154e40 0x7f8fa8157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 -- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8fa8154e40 msgr2=0x7f8fa8157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8fa8154e40 0x7f8fa8157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 -- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fa80cf330 msgr2=0x7f8fa8157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fa80cf330 0x7f8fa8157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 -- 172.21.15.50:0/3339801505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009570 con 0x7f8fa80667a0 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fa80cf330 0x7f8fa8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:06.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa6800700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8fa8154e40 0x7f8fa8157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:06.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 0x7f8fa814a4a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8f98000c00 tx=0x7f8f98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8f9e000700 1 -- 172.21.15.50:0/3339801505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98004520 con 0x7f8fa80667a0 2024-09-13T15:12:06.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8f9e000700 1 -- 172.21.15.50:0/3339801505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9801e070 con 0x7f8fa80667a0 2024-09-13T15:12:06.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa81f64a0 con 0x7f8fa80667a0 2024-09-13T15:12:06.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8f9e000700 1 -- 172.21.15.50:0/3339801505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98003900 con 0x7f8fa80667a0 2024-09-13T15:12:06.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.511+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa81f6ca0 con 0x7f8fa80667a0 2024-09-13T15:12:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.515+0000 7f8f9e000700 1 -- 172.21.15.50:0/3339801505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f98003a60 con 0x7f8fa80667a0 2024-09-13T15:12:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.515+0000 7f8f9e000700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f88066730 0x7f8f88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.515+0000 7f8f9e000700 1 -- 172.21.15.50:0/3339801505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f98020070 con 0x7f8fa80667a0 2024-09-13T15:12:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f88066730 0x7f8f88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 Processor -- start 2024-09-13T15:12:06.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 -- start start 2024-09-13T15:12:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f88066730 0x7f8f88068bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8fa815ab50 tx=0x7f8f94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f6fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f6c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f6c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f621d80 con 0x3f6d8d00 2024-09-13T15:12:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f61f510 con 0x3f6fa6c0 2024-09-13T15:12:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f61ae00 con 0x3f6f9da0 2024-09-13T15:12:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f6c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f6c2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50150/0 (socket says 172.21.15.50:50150) 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 -- 172.21.15.50:0/3111520809 learned_addr learned my addr 172.21.15.50:0/3111520809 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa6800700 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f6c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f6fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 -- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 msgr2=0x3f6fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f6fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 -- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 msgr2=0x3f6c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f6c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.519+0000 7f8fa5400700 1 -- 172.21.15.50:0/3111520809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3f48d960 con 0x3f6d8d00 2024-09-13T15:12:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fa5400700 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f6c2890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000f60 tx=0x7f8f94011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6de5b6c8511ab38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8f92600700 1 -- 172.21.15.50:0/3111520809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94003a30 con 0x3f6d8d00 2024-09-13T15:12:06.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8f92600700 1 -- 172.21.15.50:0/3111520809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94003b90 con 0x3f6d8d00 2024-09-13T15:12:06.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8f92600700 1 -- 172.21.15.50:0/3111520809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400e620 con 0x3f6d8d00 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 -- 172.21.15.50:0/3111520809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 msgr2=0x3f6c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f6c2890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000f60 tx=0x7f8f94011000 comp rx=0 tx=0).stop 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 -- 172.21.15.50:0/3111520809 shutdown_connections 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f6c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f6c2890 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 --2- 172.21.15.50:0/3111520809 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f6fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 -- 172.21.15.50:0/3111520809 >> 172.21.15.50:0/3111520809 conn(0x3f4424d0 msgr2=0x3f6dbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 -- 172.21.15.50:0/3111520809 shutdown_connections 2024-09-13T15:12:06.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 -- 172.21.15.50:0/3111520809 wait complete. 2024-09-13T15:12:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 -- start start 2024-09-13T15:12:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.523+0000 7f8fafed2740 1 Processor -- start 2024-09-13T15:12:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f6d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f6b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f6b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f5d8730 con 0x3f6f9da0 2024-09-13T15:12:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f5de5b0 con 0x3f6d8d00 2024-09-13T15:12:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f4c6aa0 con 0x3f6fa6c0 2024-09-13T15:12:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 10 client.0 _ll_register_callbacks cb 0x3f614610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f6b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f6b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50156/0 (socket says 172.21.15.50:50156) 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 -- 172.21.15.50:0/2369567253 learned_addr learned my addr 172.21.15.50:0/2369567253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa6800700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f6b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f6d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 -- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 msgr2=0x3f6b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f6b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 -- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 msgr2=0x3f6d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f6d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 -- 172.21.15.50:0/2369567253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9400f040 con 0x3f6f9da0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fa5400700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f6b2100 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f8f94005690 tx=0x7f8f94005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec1d081f1bc3026 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8f86a00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8f86a00700 1 -- 172.21.15.50:0/2369567253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94028040 con 0x3f6f9da0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3f44f1e0 con 0x3f6f9da0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8f86a00700 1 -- 172.21.15.50:0/2369567253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f9400e830 con 0x3f6f9da0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8f86a00700 1 -- 172.21.15.50:0/2369567253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9400e9f0 con 0x3f6f9da0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 10 client.7527 fetch_fsmap learned FSMap version 54 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.527+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x3f5e1220 con 0x3f6f9da0 2024-09-13T15:12:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8f86a00700 1 -- 172.21.15.50:0/2369567253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3f44f1e0 con 0x3f6f9da0 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8f86a00700 1 -- 172.21.15.50:0/2369567253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8f9400eb50 con 0x3f6f9da0 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 10 client.7527 fetch_fsmap finished waiting for FSMap version 54 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 10 client.7527 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 20 client.7527 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f6da150 0x3f6b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 4 client.7527 mds_command: new command op to 7389 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 --> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3f499460 con 0x3f6da150 2024-09-13T15:12:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f6da150 0x3f6b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f6da150 0x3f6b00c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9391ab86339f82 server_cookie=59b515d498856f8a in_seq=0 out_seq=0 2024-09-13T15:12:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8f86a00700 10 client.7527 ms_handle_connect on v2:172.21.15.50:6834/2577107387 2024-09-13T15:12:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8f86a00700 1 -- 172.21.15.50:0/2369567253 <== mds.0 v2:172.21.15.50:6834/2577107387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x3f499460 con 0x3f6da150 2024-09-13T15:12:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8f86a00700 10 client.7527 handle_command_reply: tid=0 2024-09-13T15:12:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 client.7527 shutdown 2024-09-13T15:12:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 msgr2=0x3f6b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f6b2100 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f8f94005690 tx=0x7f8f94005000 comp rx=0 tx=0).stop 2024-09-13T15:12:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 shutdown_connections 2024-09-13T15:12:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f6da150 0x3f6b00c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f6b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f6b2100 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2369567253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f6d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8f86a00700 0 client.7527 ms_handle_reset on v2:172.21.15.50:6834/2577107387 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 >> 172.21.15.50:0/2369567253 conn(0x3f4424d0 msgr2=0x3f6d5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 shutdown_connections 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.531+0000 7f8fafed2740 1 -- 172.21.15.50:0/2369567253 wait complete. 2024-09-13T15:12:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.535+0000 7f8fafed2740 20 client.7527 trim_cache size 0 max 16384 2024-09-13T15:12:06.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 Processor -- start 2024-09-13T15:12:06.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 -- start start 2024-09-13T15:12:06.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f7138a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f70d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f70da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f649ec0 con 0x3f6f9da0 2024-09-13T15:12:06.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f6b4df0 con 0x3f6d8d00 2024-09-13T15:12:06.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f61e670 con 0x3f6fa6c0 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f70d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f70d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50162/0 (socket says 172.21.15.50:50162) 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 -- 172.21.15.50:0/2383302260 learned_addr learned my addr 172.21.15.50:0/2383302260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa6800700 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f70da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f7138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 -- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 msgr2=0x3f70da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f70da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 -- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 msgr2=0x3f7138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f7138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 -- 172.21.15.50:0/2383302260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3f5c7450 con 0x3f6f9da0 2024-09-13T15:12:06.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f7138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:06.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.555+0000 7f8fa5400700 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f70d4e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8f940050a0 tx=0x7f8f94012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104af3bf10658493 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8f93000700 1 -- 172.21.15.50:0/2383302260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94028040 con 0x3f6f9da0 2024-09-13T15:12:06.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8f93000700 1 -- 172.21.15.50:0/2383302260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94019070 con 0x3f6f9da0 2024-09-13T15:12:06.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8f93000700 1 -- 172.21.15.50:0/2383302260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94003a30 con 0x3f6f9da0 2024-09-13T15:12:06.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 -- 172.21.15.50:0/2383302260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 msgr2=0x3f70d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f70d4e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8f940050a0 tx=0x7f8f94012000 comp rx=0 tx=0).stop 2024-09-13T15:12:06.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 -- 172.21.15.50:0/2383302260 shutdown_connections 2024-09-13T15:12:06.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6fa6c0 0x3f70da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6f9da0 0x3f70d4e0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 --2- 172.21.15.50:0/2383302260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6d8d00 0x3f7138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 -- 172.21.15.50:0/2383302260 >> 172.21.15.50:0/2383302260 conn(0x3f4424d0 msgr2=0x3f6d7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 -- 172.21.15.50:0/2383302260 shutdown_connections 2024-09-13T15:12:06.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 -- 172.21.15.50:0/2383302260 wait complete. 2024-09-13T15:12:06.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 -- start start 2024-09-13T15:12:06.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.559+0000 7f8fafed2740 1 Processor -- start 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f711d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f75b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f75b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f6142f0 con 0x3f6d8d00 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f713460 con 0x3f6fa6c0 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f713700 con 0x3f6f9da0 2024-09-13T15:12:06.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fafed2740 10 client.0 _ll_register_callbacks cb 0x3f671710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f711d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f711d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50164/0 (socket says 172.21.15.50:50164) 2024-09-13T15:12:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 -- 172.21.15.50:0/1115914396 learned_addr learned my addr 172.21.15.50:0/1115914396 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 -- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 msgr2=0x3f75b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5400700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f75b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa6800700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f75b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f75b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 -- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 msgr2=0x3f75b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f75b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 -- 172.21.15.50:0/1115914396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3f5e1220 con 0x3f6d8d00 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5400700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f75b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa6800700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f75b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8fa5e00700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f711d20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8f9805e590 tx=0x7f8f9801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a53a13f07c6127 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8f86a00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.563+0000 7f8f86a00700 1 -- 172.21.15.50:0/1115914396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9805eac0 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f94003b90 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 1 -- 172.21.15.50:0/1115914396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f9802ee30 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 1 -- 172.21.15.50:0/1115914396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9805a0c0 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 10 client.7533 fetch_fsmap learned FSMap version 54 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x3f5bb720 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 1 -- 172.21.15.50:0/1115914396 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94003b90 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 1 -- 172.21.15.50:0/1115914396 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8f98056930 con 0x3f6d8d00 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 10 client.7533 fetch_fsmap finished waiting for FSMap version 54 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 10 client.7533 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 20 client.7533 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f710640 0x3f710a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 4 client.7533 mds_command: new command op to 7389 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:12:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 --> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] -- command(tid 0: {"prefix": "status"}) v1 -- 0x3f4be1e0 con 0x3f710640 2024-09-13T15:12:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fa5400700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f710640 0x3f710a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fa5400700 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f710640 0x3f710a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45815f49cb2975a3 server_cookie=c549ab3639eb7a77 in_seq=0 out_seq=0 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 10 client.7533 ms_handle_connect on v2:172.21.15.50:6834/2577107387 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 1 -- 172.21.15.50:0/1115914396 <== mds.0 v2:172.21.15.50:6834/2577107387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x3f4be1e0 con 0x3f710640 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 10 client.7533 handle_command_reply: tid=0 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 client.7533 shutdown 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 msgr2=0x3f711d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f711d20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8f9805e590 tx=0x7f8f9801c040 comp rx=0 tx=0).stop 2024-09-13T15:12:06.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 shutdown_connections 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:6834/2577107387,v1:172.21.15.50:6835/2577107387] conn(0x3f710640 0x3f710a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x3f6fa6c0 0x3f75b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x3f6f9da0 0x3f75b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 --2- 172.21.15.50:0/1115914396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x3f6d8d00 0x3f711d20 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 >> 172.21.15.50:0/1115914396 conn(0x3f4424d0 msgr2=0x3f6b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8f86a00700 0 client.7533 ms_handle_reset on v2:172.21.15.50:6834/2577107387 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 shutdown_connections 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 1 -- 172.21.15.50:0/1115914396 wait complete. 2024-09-13T15:12:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.567+0000 7f8fafed2740 20 client.7533 trim_cache size 0 max 16384 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7389, 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.5567818850000004, 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 54, 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 101, 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 101, 2024-09-13T15:12:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 11.730943766999999 2024-09-13T15:12:06.577 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f88066730 msgr2=0x7f8f88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f88066730 0x7f8f88068bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8fa815ab50 tx=0x7f8f94009040 comp rx=0 tx=0).stop 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 msgr2=0x7f8fa814a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 0x7f8fa814a4a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8f98000c00 tx=0x7f8f98004770 comp rx=0 tx=0).stop 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 shutdown_connections 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8f88066730 0x7f8f88068bf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8fa8154e40 0x7f8fa8157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fa80cf330 0x7f8fa8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 --2- 172.21.15.50:0/3339801505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fa80667a0 0x7f8fa814a4a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 >> 172.21.15.50:0/3339801505 conn(0x7f8fa806e660 msgr2=0x7f8fa8153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 shutdown_connections 2024-09-13T15:12:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.571+0000 7f8fa7200700 1 -- 172.21.15.50:0/3339801505 wait complete. 2024-09-13T15:12:06.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:12:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.775+0000 7efecc800700 1 Processor -- start 2024-09-13T15:12:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.775+0000 7efecc800700 1 -- start start 2024-09-13T15:12:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efecc800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efec41446c0 0x7efec40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efecc800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec40cfcf0 0x7efec40cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efecc800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efec40cc650 0x7efec40d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efecc800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40b4d10 con 0x7efec41446c0 2024-09-13T15:12:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efecc800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec4144aa0 con 0x7efec40cc650 2024-09-13T15:12:06.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efecc800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b4100 con 0x7efec40cfcf0 2024-09-13T15:12:06.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efec41446c0 0x7efec40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efec41446c0 0x7efec40b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50172/0 (socket says 172.21.15.50:50172) 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 -- 172.21.15.50:0/380289956 learned_addr learned my addr 172.21.15.50:0/380289956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9400700 1 --2- 172.21.15.50:0/380289956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec40cfcf0 0x7efec40cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efeca800700 1 --2- 172.21.15.50:0/380289956 >> v2:172.21.15.181:3300/0 conn(0x7efec40cc650 0x7efec40d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 -- 172.21.15.50:0/380289956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec40cfcf0 msgr2=0x7efec40cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 --2- 172.21.15.50:0/380289956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec40cfcf0 0x7efec40cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 -- 172.21.15.50:0/380289956 >> v2:172.21.15.181:3300/0 conn(0x7efec40cc650 msgr2=0x7efec40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 --2- 172.21.15.50:0/380289956 >> v2:172.21.15.181:3300/0 conn(0x7efec40cc650 0x7efec40d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 -- 172.21.15.50:0/380289956 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40b43e0 con 0x7efec41446c0 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efeca800700 1 --2- 172.21.15.50:0/380289956 >> v2:172.21.15.181:3300/0 conn(0x7efec40cc650 0x7efec40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec9e00700 1 --2- 172.21.15.50:0/380289956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec41446c0 0x7efec40b3a70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7efec406f510 tx=0x7efeb8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15702e7c9a377d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec8a00700 1 -- 172.21.15.50:0/380289956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8011830 con 0x7efec41446c0 2024-09-13T15:12:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec8a00700 1 -- 172.21.15.50:0/380289956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8011990 con 0x7efec41446c0 2024-09-13T15:12:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.779+0000 7efec8a00700 1 -- 172.21.15.50:0/380289956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8011d20 con 0x7efec41446c0 2024-09-13T15:12:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 -- 172.21.15.50:0/380289956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec41446c0 msgr2=0x7efec40b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 --2- 172.21.15.50:0/380289956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec41446c0 0x7efec40b3a70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7efec406f510 tx=0x7efeb8009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 -- 172.21.15.50:0/380289956 shutdown_connections 2024-09-13T15:12:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 --2- 172.21.15.50:0/380289956 >> v2:172.21.15.181:3300/0 conn(0x7efec40cc650 0x7efec40d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 --2- 172.21.15.50:0/380289956 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec40cfcf0 0x7efec40cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 --2- 172.21.15.50:0/380289956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec41446c0 0x7efec40b3a70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 -- 172.21.15.50:0/380289956 >> 172.21.15.50:0/380289956 conn(0x7efec40726d0 msgr2=0x7efec406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 -- 172.21.15.50:0/380289956 shutdown_connections 2024-09-13T15:12:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 -- 172.21.15.50:0/380289956 wait complete. 2024-09-13T15:12:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 Processor -- start 2024-09-13T15:12:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.783+0000 7efecc800700 1 -- start start 2024-09-13T15:12:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec40cc650 0x7efec415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 0x7efec41e3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec41446c0 0x7efec413d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec41e3e80 con 0x7efec40cfcf0 2024-09-13T15:12:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec415dcf0 con 0x7efec40cc650 2024-09-13T15:12:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec414a2c0 con 0x7efec41446c0 2024-09-13T15:12:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 0x7efec41e3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 0x7efec41e3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50186/0 (socket says 172.21.15.50:50186) 2024-09-13T15:12:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 -- 172.21.15.50:0/4097497201 learned_addr learned my addr 172.21.15.50:0/4097497201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9e00700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec40cc650 0x7efec415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efeca800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec41446c0 0x7efec413d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 -- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec41446c0 msgr2=0x7efec413d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec41446c0 0x7efec413d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 -- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec40cc650 msgr2=0x7efec415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec40cc650 0x7efec415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 -- 172.21.15.50:0/4097497201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8009570 con 0x7efec40cfcf0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9e00700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec40cc650 0x7efec415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efec9400700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 0x7efec41e3940 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e980 tx=0x7efeb400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4009700 con 0x7efec40cfcf0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4004020 con 0x7efec40cfcf0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec415d450 con 0x7efec40cfcf0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40043b0 con 0x7efec40cfcf0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec415da10 con 0x7efec40cfcf0 2024-09-13T15:12:06.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.787+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40cc110 con 0x7efec40cfcf0 2024-09-13T15:12:06.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.791+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efeb400c850 con 0x7efec40cfcf0 2024-09-13T15:12:06.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.791+0000 7efebe000700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efea8066730 0x7efea8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:06.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.791+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efeb4084370 con 0x7efec40cfcf0 2024-09-13T15:12:06.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.791+0000 7efec9e00700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efea8066730 0x7efea8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:06.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.795+0000 7efec9e00700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efea8066730 0x7efea8068bf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efeb8000c00 tx=0x7efeb8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:06.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:06.799+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efeb4051650 con 0x7efec40cfcf0 2024-09-13T15:12:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.031+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efec4067730 con 0x7efec40cfcf0 2024-09-13T15:12:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.031+0000 7efebe000700 1 -- 172.21.15.50:0/4097497201 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7efeb4054c70 con 0x7efec40cfcf0 2024-09-13T15:12:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:12:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efea8066730 msgr2=0x7efea8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efea8066730 0x7efea8068bf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efeb8000c00 tx=0x7efeb8008030 comp rx=0 tx=0).stop 2024-09-13T15:12:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 msgr2=0x7efec41e3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 0x7efec41e3940 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e980 tx=0x7efeb400ed40 comp rx=0 tx=0).stop 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 shutdown_connections 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7efea8066730 0x7efea8068bf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efec41446c0 0x7efec413d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efec40cfcf0 0x7efec41e3940 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 --2- 172.21.15.50:0/4097497201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec40cc650 0x7efec415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 >> 172.21.15.50:0/4097497201 conn(0x7efec40726d0 msgr2=0x7efec4070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 shutdown_connections 2024-09-13T15:12:07.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:07.039+0000 7efecc800700 1 -- 172.21.15.50:0/4097497201 wait complete. 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:12:07.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:12:07.065 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:12:07.065 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:12:07.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.069 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:12:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:12:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:12:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:12:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:12:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:12:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:12:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:12:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:12:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42180sec preferred_lft 42180sec 2024-09-13T15:12:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:12:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:12:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:12:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:12:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:12:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:07.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.092 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:12:07.169 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:12:07.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.172 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:12:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:12:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:12:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:12:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:12:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:12:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:12:07.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.236 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:12:07.236 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:12:07.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:12:07.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:12:07.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:12:07.236 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:12:07.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.370 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:12:07.387 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:12:07.388 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:12:07.389 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:12:07.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:12:07.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:07.466 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:07.531 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:12:07.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:07.709 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:07.728 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:12:07.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:07.857 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:07.857 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:07.881 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:07.881 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:07.881 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:12:07.881 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:12:07.881 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:12:07.887 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:12:07.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:07.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:07.923 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:12:08.008 INFO:teuthology.orchestra.run.smithi050.stdout:client7426 2024-09-13T15:12:08.008 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:08.008 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:08.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:12:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.291+0000 7f2f3f200700 1 Processor -- start 2024-09-13T15:12:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.291+0000 7f2f3f200700 1 -- start start 2024-09-13T15:12:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.291+0000 7f2f3f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f400cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3f200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f400abea0 0x7f2f400ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3f200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f400ccfd0 con 0x7f2f400ca670 2024-09-13T15:12:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3f200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f400ae170 con 0x7f2f400abea0 2024-09-13T15:12:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400cb790 con 0x7f2f400cae70 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3e800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2f400ca670 0x7f2f400ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58566/0 (socket says 172.21.15.50:58566) 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3e800700 1 -- 172.21.15.50:0/3487738168 learned_addr learned my addr 172.21.15.50:0/3487738168 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3de00700 1 --2- 172.21.15.50:0/3487738168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f400cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3d400700 1 --2- 172.21.15.50:0/3487738168 >> v2:172.21.15.181:3300/0 conn(0x7f2f400abea0 0x7f2f400ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3de00700 1 -- 172.21.15.50:0/3487738168 >> v2:172.21.15.181:3300/0 conn(0x7f2f400abea0 msgr2=0x7f2f400ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3de00700 1 --2- 172.21.15.50:0/3487738168 >> v2:172.21.15.181:3300/0 conn(0x7f2f400abea0 0x7f2f400ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3de00700 1 -- 172.21.15.50:0/3487738168 >> v1:172.21.15.50:6789/0 conn(0x7f2f400ca670 legacy=0x7f2f400ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3de00700 1 -- 172.21.15.50:0/3487738168 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f400cd270 con 0x7f2f400cae70 2024-09-13T15:12:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3de00700 1 --2- 172.21.15.50:0/3487738168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f400cb250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009850 tx=0x7f2f30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62d05e1530931ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3ca00700 1 -- 172.21.15.50:0/3487738168 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011830 con 0x7f2f400cae70 2024-09-13T15:12:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3ca00700 1 -- 172.21.15.50:0/3487738168 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30011990 con 0x7f2f400cae70 2024-09-13T15:12:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3ca00700 1 -- 172.21.15.50:0/3487738168 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011d40 con 0x7f2f400cae70 2024-09-13T15:12:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3f200700 1 -- 172.21.15.50:0/3487738168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 msgr2=0x7f2f400cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.295+0000 7f2f3f200700 1 --2- 172.21.15.50:0/3487738168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f400cb250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009850 tx=0x7f2f30009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- 172.21.15.50:0/3487738168 shutdown_connections 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 --2- 172.21.15.50:0/3487738168 >> v2:172.21.15.181:3300/0 conn(0x7f2f400abea0 0x7f2f400ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 --2- 172.21.15.50:0/3487738168 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f400cb250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- 172.21.15.50:0/3487738168 >> 172.21.15.50:0/3487738168 conn(0x7f2f400cf0d0 msgr2=0x7f2f400cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- 172.21.15.50:0/3487738168 shutdown_connections 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- 172.21.15.50:0/3487738168 wait complete. 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 Processor -- start 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- start start 2024-09-13T15:12:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f400abea0 0x7f2f400c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 0x7f2f401f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f401f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400c8ba0 con 0x7f2f400ca670 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400b23a0 con 0x7f2f400abea0 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400c85e0 con 0x7f2f400cae70 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.299+0000 7f2f3d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 0x7f2f401f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 0x7f2f401f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50200/0 (socket says 172.21.15.50:50200) 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 -- 172.21.15.50:0/1550269582 learned_addr learned my addr 172.21.15.50:0/1550269582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3de00700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f400abea0 0x7f2f400c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3e800700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f401f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 -- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 msgr2=0x7f2f401f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f401f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 -- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f400abea0 msgr2=0x7f2f400c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f400abea0 0x7f2f400c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 -- 172.21.15.50:0/1550269582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300094b0 con 0x7f2f400ca670 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3de00700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f400abea0 0x7f2f400c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3d400700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 0x7f2f401f5c60 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00e9d0 tx=0x7f2f2c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c009720 con 0x7f2f400ca670 2024-09-13T15:12:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c00c850 con 0x7f2f400ca670 2024-09-13T15:12:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c00cbe0 con 0x7f2f400ca670 2024-09-13T15:12:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f400c88c0 con 0x7f2f400ca670 2024-09-13T15:12:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f400b18f0 con 0x7f2f400ca670 2024-09-13T15:12:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.303+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4015e420 con 0x7f2f400ca670 2024-09-13T15:12:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.307+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f2c00cd40 con 0x7f2f400ca670 2024-09-13T15:12:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.307+0000 7f2f36000700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f20066760 0x7f2f20068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.307+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f2c084400 con 0x7f2f400ca670 2024-09-13T15:12:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.307+0000 7f2f3de00700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f20066760 0x7f2f20068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.311+0000 7f2f3de00700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f20066760 0x7f2f20068c20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2f300090b0 tx=0x7f2f30008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.315+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f2c0515a0 con 0x7f2f400ca670 2024-09-13T15:12:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.551+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f400ad7e0 con 0x7f2f400ca670 2024-09-13T15:12:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f36000700 1 -- 172.21.15.50:0/1550269582 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f2c054bc0 con 0x7f2f400ca670 2024-09-13T15:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f20066760 msgr2=0x7f2f20068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f20066760 0x7f2f20068c20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2f300090b0 tx=0x7f2f30008030 comp rx=0 tx=0).stop 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 msgr2=0x7f2f401f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 0x7f2f401f5c60 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00e9d0 tx=0x7f2f2c00ed90 comp rx=0 tx=0).stop 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 shutdown_connections 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2f20066760 0x7f2f20068c20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f400cae70 0x7f2f401f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f400ca670 0x7f2f401f5c60 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 --2- 172.21.15.50:0/1550269582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f400abea0 0x7f2f400c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.555+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 >> 172.21.15.50:0/1550269582 conn(0x7f2f400cf0d0 msgr2=0x7f2f4006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.559+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 shutdown_connections 2024-09-13T15:12:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:08.559+0000 7f2f3f200700 1 -- 172.21.15.50:0/1550269582 wait complete. 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:12:08.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:12:08.588 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:12:08.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:08.588 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:12:08.605 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:12:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:12:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:12:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:12:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42168sec preferred_lft 42168sec 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:12:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:08.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:08.609 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:12:08.688 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:12:08.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:08.691 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:12:08.751 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:12:08.752 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:12:08.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:08.753 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:12:08.753 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:12:08.753 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:12:08.753 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:12:08.753 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:12:08.754 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:12:08.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:08.885 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:12:08.901 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:12:08.901 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:12:08.902 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:12:08.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:08.903 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:12:08.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:08.977 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:09.042 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:12:09.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:09.042 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:09.099 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:12:09.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:09.099 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:09.232 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:09.233 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:09.261 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:09.261 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:09.261 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:12:09.261 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:12:09.261 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:12:09.267 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:12:09.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:09.267 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:09.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:09.298 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:12:09.367 INFO:teuthology.orchestra.run.smithi181.stdout:client7548 2024-09-13T15:12:09.367 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:09.367 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:09.424 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:09.424 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:09.443 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:09.444 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:09.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.731+0000 7f8cece00700 1 Processor -- start 2024-09-13T15:12:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.731+0000 7f8cece00700 1 -- start start 2024-09-13T15:12:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8cece00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ce8161150 0x7f8ce80cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8cece00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce80cc740 0x7f8ce806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8cece00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80cb1a0 con 0x7f8ce806a8d0 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8cece00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce806ad80 con 0x7f8ce8161150 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8cece00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80cb440 con 0x7f8ce80cc740 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ce8161150 0x7f8ce80cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ce8161150 0x7f8ce80cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50204/0 (socket says 172.21.15.50:50204) 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 -- 172.21.15.50:0/3635895636 learned_addr learned my addr 172.21.15.50:0/3635895636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce6a00700 1 --2- 172.21.15.50:0/3635895636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce80cc740 0x7f8ce806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 -- 172.21.15.50:0/3635895636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce80cc740 msgr2=0x7f8ce806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 --2- 172.21.15.50:0/3635895636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce80cc740 0x7f8ce806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 -- 172.21.15.50:0/3635895636 >> v1:172.21.15.181:6789/0 conn(0x7f8ce806a8d0 legacy=0x7f8ce80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 -- 172.21.15.50:0/3635895636 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80cb720 con 0x7f8ce8161150 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce7400700 1 --2- 172.21.15.50:0/3635895636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce8161150 0x7f8ce80cc200 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009910 tx=0x7f8cd8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ac08a38e28ddd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce6000700 1 -- 172.21.15.50:0/3635895636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800ba60 con 0x7f8ce8161150 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce6000700 1 -- 172.21.15.50:0/3635895636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800bbc0 con 0x7f8ce8161150 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.735+0000 7f8ce6000700 1 -- 172.21.15.50:0/3635895636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8009e60 con 0x7f8ce8161150 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- 172.21.15.50:0/3635895636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce8161150 msgr2=0x7f8ce80cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 --2- 172.21.15.50:0/3635895636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce8161150 0x7f8ce80cc200 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009910 tx=0x7f8cd8009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- 172.21.15.50:0/3635895636 shutdown_connections 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 --2- 172.21.15.50:0/3635895636 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce80cc740 0x7f8ce806a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 --2- 172.21.15.50:0/3635895636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce8161150 0x7f8ce80cc200 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- 172.21.15.50:0/3635895636 >> 172.21.15.50:0/3635895636 conn(0x7f8ce8071f00 msgr2=0x7f8ce80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- 172.21.15.50:0/3635895636 shutdown_connections 2024-09-13T15:12:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- 172.21.15.50:0/3635895636 wait complete. 2024-09-13T15:12:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 Processor -- start 2024-09-13T15:12:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- start start 2024-09-13T15:12:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ce806a8d0 0x7f8ce80c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 0x7f8ce80c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce8161150 0x7f8ce815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c8200 con 0x7f8ce80cc740 2024-09-13T15:12:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c84e0 con 0x7f8ce806a8d0 2024-09-13T15:12:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.739+0000 7f8cece00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c87c0 con 0x7f8ce8161150 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 0x7f8ce80c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 0x7f8ce80c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50206/0 (socket says 172.21.15.50:50206) 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 -- 172.21.15.50:0/4286559068 learned_addr learned my addr 172.21.15.50:0/4286559068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce7400700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ce806a8d0 0x7f8ce80c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce7e00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce8161150 0x7f8ce815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 -- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce8161150 msgr2=0x7f8ce815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce8161150 0x7f8ce815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 -- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ce806a8d0 msgr2=0x7f8ce80c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ce806a8d0 0x7f8ce80c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 -- 172.21.15.50:0/4286559068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009570 con 0x7f8ce80cc740 2024-09-13T15:12:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8ce6a00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 0x7f8ce80c7af0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400d800 tx=0x7f8cd400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40125f0 con 0x7f8ce80cc740 2024-09-13T15:12:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4012750 con 0x7f8ce80cc740 2024-09-13T15:12:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4012b00 con 0x7f8ce80cc740 2024-09-13T15:12:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce80c8aa0 con 0x7f8ce80cc740 2024-09-13T15:12:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.743+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce815e8f0 con 0x7f8ce80cc740 2024-09-13T15:12:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.747+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80c8fc0 con 0x7f8ce80cc740 2024-09-13T15:12:09.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.747+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cd4012c60 con 0x7f8ce80cc740 2024-09-13T15:12:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.747+0000 7f8cdf400700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cc8066730 0x7f8cc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.751+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8cd4084320 con 0x7f8ce80cc740 2024-09-13T15:12:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.751+0000 7f8ce7400700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cc8066730 0x7f8cc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.751+0000 7f8ce7400700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cc8066730 0x7f8cc8068bf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8000c00 tx=0x7f8cd8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:09.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.755+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ce80c8fc0 con 0x7f8ce80cc740 2024-09-13T15:12:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.943+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ce80c8fc0 con 0x7f8ce80cc740 2024-09-13T15:12:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.947+0000 7f8cdf400700 1 -- 172.21.15.50:0/4286559068 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16696 (secure 0 0 0) 0x7f8ce80c8fc0 con 0x7f8ce80cc740 2024-09-13T15:12:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:09.953 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:01.015565+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cc8066730 msgr2=0x7f8cc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cc8066730 0x7f8cc8068bf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8000c00 tx=0x7f8cd8008030 comp rx=0 tx=0).stop 2024-09-13T15:12:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 msgr2=0x7f8ce80c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 0x7f8ce80c7af0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400d800 tx=0x7f8cd400db10 comp rx=0 tx=0).stop 2024-09-13T15:12:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 shutdown_connections 2024-09-13T15:12:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8cc8066730 0x7f8cc8068bf0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ce8161150 0x7f8ce815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ce80cc740 0x7f8ce80c7af0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 --2- 172.21.15.50:0/4286559068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ce806a8d0 0x7f8ce80c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.951+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 >> 172.21.15.50:0/4286559068 conn(0x7f8ce8071f00 msgr2=0x7f8ce80b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.955+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 shutdown_connections 2024-09-13T15:12:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:09.955+0000 7f8cece00700 1 -- 172.21.15.50:0/4286559068 wait complete. 2024-09-13T15:12:09.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:58.177796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:59.008477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:12:09.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:12:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.147+0000 7f82df200700 1 Processor -- start 2024-09-13T15:12:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.147+0000 7f82df200700 1 -- start start 2024-09-13T15:12:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82df200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f82e015acb0 0x7f82e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82df200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82e015c0a0 0x7f82e006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82df200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e015b090 con 0x7f82e00cd600 2024-09-13T15:12:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82df200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00ce160 con 0x7f82e015c0a0 2024-09-13T15:12:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82df200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e015b2e0 con 0x7f82e015acb0 2024-09-13T15:12:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82de800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82e00cd600 0x7f82e00cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58582/0 (socket says 172.21.15.50:58582) 2024-09-13T15:12:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82de800700 1 -- 172.21.15.50:0/4063889912 learned_addr learned my addr 172.21.15.50:0/4063889912 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82dde00700 1 --2- 172.21.15.50:0/4063889912 >> v2:172.21.15.181:3300/0 conn(0x7f82e015acb0 0x7f82e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.151+0000 7f82dd400700 1 --2- 172.21.15.50:0/4063889912 >> v2:172.21.15.50:3300/0 conn(0x7f82e015c0a0 0x7f82e006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dca00700 1 -- 172.21.15.50:0/4063889912 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735981789 0 0) 0x7f82e015b090 con 0x7f82e00cd600 2024-09-13T15:12:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dca00700 1 -- 172.21.15.50:0/4063889912 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c40035d0 con 0x7f82e00cd600 2024-09-13T15:12:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dde00700 1 -- 172.21.15.50:0/4063889912 >> v2:172.21.15.50:3300/0 conn(0x7f82e015c0a0 msgr2=0x7f82e006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:10.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dde00700 1 --2- 172.21.15.50:0/4063889912 >> v2:172.21.15.50:3300/0 conn(0x7f82e015c0a0 0x7f82e006cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dde00700 1 -- 172.21.15.50:0/4063889912 >> v1:172.21.15.50:6789/0 conn(0x7f82e00cd600 legacy=0x7f82e00cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dde00700 1 -- 172.21.15.50:0/4063889912 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e015b5c0 con 0x7f82e015acb0 2024-09-13T15:12:10.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dde00700 1 --2- 172.21.15.50:0/4063889912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015acb0 0x7f82e006c5a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f82e00729e0 tx=0x7f82d0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73aaf380ea07252e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dca00700 1 -- 172.21.15.50:0/4063889912 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0011830 con 0x7f82e015acb0 2024-09-13T15:12:10.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dca00700 1 -- 172.21.15.50:0/4063889912 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0011990 con 0x7f82e015acb0 2024-09-13T15:12:10.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82dca00700 1 -- 172.21.15.50:0/4063889912 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0011d20 con 0x7f82e015acb0 2024-09-13T15:12:10.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 -- 172.21.15.50:0/4063889912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015acb0 msgr2=0x7f82e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 --2- 172.21.15.50:0/4063889912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015acb0 0x7f82e006c5a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f82e00729e0 tx=0x7f82d0009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 -- 172.21.15.50:0/4063889912 shutdown_connections 2024-09-13T15:12:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 --2- 172.21.15.50:0/4063889912 >> v2:172.21.15.50:3300/0 conn(0x7f82e015c0a0 0x7f82e006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 --2- 172.21.15.50:0/4063889912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015acb0 0x7f82e006c5a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 -- 172.21.15.50:0/4063889912 >> 172.21.15.50:0/4063889912 conn(0x7f82e0072530 msgr2=0x7f82e00b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 -- 172.21.15.50:0/4063889912 shutdown_connections 2024-09-13T15:12:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.155+0000 7f82df200700 1 -- 172.21.15.50:0/4063889912 wait complete. 2024-09-13T15:12:10.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.159+0000 7f82df200700 1 Processor -- start 2024-09-13T15:12:10.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.159+0000 7f82df200700 1 -- start start 2024-09-13T15:12:10.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.159+0000 7f82df200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82e00cd600 0x7f82e01465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.159+0000 7f82df200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 0x7f82e00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82df200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015c0a0 0x7f82e0147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82df200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0146af0 con 0x7f82e015acb0 2024-09-13T15:12:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82df200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0146ce0 con 0x7f82e015c0a0 2024-09-13T15:12:10.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82df200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0146fc0 con 0x7f82e00cd600 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 0x7f82e00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 0x7f82e00b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50228/0 (socket says 172.21.15.50:50228) 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 -- 172.21.15.50:0/498688819 learned_addr learned my addr 172.21.15.50:0/498688819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dde00700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82e00cd600 0x7f82e01465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82de800700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015c0a0 0x7f82e0147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 -- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82e00cd600 msgr2=0x7f82e01465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82e00cd600 0x7f82e01465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 -- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015c0a0 msgr2=0x7f82e0147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015c0a0 0x7f82e0147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 -- 172.21.15.50:0/498688819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00094b0 con 0x7f82e015acb0 2024-09-13T15:12:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.163+0000 7f82dd400700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 0x7f82e00b2030 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009fd0 tx=0x7f82cc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.167+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0095a0 con 0x7f82e015acb0 2024-09-13T15:12:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.167+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc013680 con 0x7f82e015acb0 2024-09-13T15:12:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.167+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e01472a0 con 0x7f82e015acb0 2024-09-13T15:12:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.167+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc013a30 con 0x7f82e015acb0 2024-09-13T15:12:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.167+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e0147860 con 0x7f82e015acb0 2024-09-13T15:12:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.171+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e00cda50 con 0x7f82e015acb0 2024-09-13T15:12:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.171+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82cc013b90 con 0x7f82e015acb0 2024-09-13T15:12:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.171+0000 7f82d6000700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f82c0066780 0x7f82c0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.171+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82cc0841b0 con 0x7f82e015acb0 2024-09-13T15:12:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.175+0000 7f82dde00700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f82c0066780 0x7f82c0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.175+0000 7f82dde00700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f82c0066780 0x7f82c0068c40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f82d0000c00 tx=0x7f82d0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.183+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82cc0513c0 con 0x7f82e015acb0 2024-09-13T15:12:10.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.367+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82e006fe70 con 0x7f82e015acb0 2024-09-13T15:12:10.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.367+0000 7f82d6000700 1 -- 172.21.15.50:0/498688819 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82cc0549e0 con 0x7f82e015acb0 2024-09-13T15:12:10.372 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f82c0066780 msgr2=0x7f82c0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f82c0066780 0x7f82c0068c40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f82d0000c00 tx=0x7f82d0008030 comp rx=0 tx=0).stop 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 msgr2=0x7f82e00b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 0x7f82e00b2030 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009fd0 tx=0x7f82cc00eb20 comp rx=0 tx=0).stop 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 shutdown_connections 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f82c0066780 0x7f82c0068c40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82e015c0a0 0x7f82e0147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e015acb0 0x7f82e00b2030 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 --2- 172.21.15.50:0/498688819 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82e00cd600 0x7f82e01465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 >> 172.21.15.50:0/498688819 conn(0x7f82e0072530 msgr2=0x7f82e00b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 shutdown_connections 2024-09-13T15:12:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.371+0000 7f82df200700 1 -- 172.21.15.50:0/498688819 wait complete. 2024-09-13T15:12:10.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:12:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.575+0000 7fa450a00700 1 Processor -- start 2024-09-13T15:12:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.575+0000 7fa450a00700 1 -- start start 2024-09-13T15:12:10.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa450a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa44c15ca20 0x7fa44c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa450a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c06b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa450a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c160680 con 0x7fa44c06cd80 2024-09-13T15:12:10.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa450a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c0b4a20 con 0x7fa44c15ca20 2024-09-13T15:12:10.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa450a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c06b750 con 0x7fa44c06ada0 2024-09-13T15:12:10.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa441e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa44c06cd80 0x7fa44c0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58596/0 (socket says 172.21.15.50:58596) 2024-09-13T15:12:10.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa441e00700 1 -- 172.21.15.50:0/1001968214 learned_addr learned my addr 172.21.15.50:0/1001968214 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44a800700 1 --2- 172.21.15.50:0/1001968214 >> v2:172.21.15.50:3300/0 conn(0x7fa44c15ca20 0x7fa44c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44b200700 1 --2- 172.21.15.50:0/1001968214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa449e00700 1 -- 172.21.15.50:0/1001968214 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481430493 0 0) 0x7fa44c160680 con 0x7fa44c06cd80 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa449e00700 1 -- 172.21.15.50:0/1001968214 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4300035d0 con 0x7fa44c06cd80 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44a800700 1 -- 172.21.15.50:0/1001968214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 msgr2=0x7fa44c06b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44a800700 1 --2- 172.21.15.50:0/1001968214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c06b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44a800700 1 -- 172.21.15.50:0/1001968214 >> v1:172.21.15.50:6789/0 conn(0x7fa44c06cd80 legacy=0x7fa44c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44a800700 1 -- 172.21.15.50:0/1001968214 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c15d670 con 0x7fa44c15ca20 2024-09-13T15:12:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa44a800700 1 --2- 172.21.15.50:0/1001968214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c15ce00 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e4a4600c37fb20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa449e00700 1 -- 172.21.15.50:0/1001968214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00e070 con 0x7fa44c15ca20 2024-09-13T15:12:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa449e00700 1 -- 172.21.15.50:0/1001968214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00bb20 con 0x7fa44c15ca20 2024-09-13T15:12:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.579+0000 7fa449e00700 1 -- 172.21.15.50:0/1001968214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00be90 con 0x7fa44c15ca20 2024-09-13T15:12:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 -- 172.21.15.50:0/1001968214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 msgr2=0x7fa44c15ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 --2- 172.21.15.50:0/1001968214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c15ce00 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).stop 2024-09-13T15:12:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 -- 172.21.15.50:0/1001968214 shutdown_connections 2024-09-13T15:12:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 --2- 172.21.15.50:0/1001968214 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c06b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 --2- 172.21.15.50:0/1001968214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c15ce00 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 -- 172.21.15.50:0/1001968214 >> 172.21.15.50:0/1001968214 conn(0x7fa44c071d20 msgr2=0x7fa44c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 -- 172.21.15.50:0/1001968214 shutdown_connections 2024-09-13T15:12:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 -- 172.21.15.50:0/1001968214 wait complete. 2024-09-13T15:12:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 Processor -- start 2024-09-13T15:12:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.583+0000 7fa450a00700 1 -- start start 2024-09-13T15:12:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44c06cd80 0x7fa44c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c1f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0ce7e0 con 0x7fa44c15ca20 2024-09-13T15:12:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c151a20 con 0x7fa44c06cd80 2024-09-13T15:12:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0cf5f0 con 0x7fa44c06ada0 2024-09-13T15:12:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c1f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c1f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50238/0 (socket says 172.21.15.50:50238) 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 -- 172.21.15.50:0/1840379439 learned_addr learned my addr 172.21.15.50:0/1840379439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44a800700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa441e00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44c06cd80 0x7fa44c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 -- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 msgr2=0x7fa44c0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 -- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44c06cd80 msgr2=0x7fa44c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44c06cd80 0x7fa44c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 -- 172.21.15.50:0/1840379439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009a70 con 0x7fa44c15ca20 2024-09-13T15:12:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa44b200700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c1f22f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa44400e840 tx=0x7fa44400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44400c070 con 0x7fa44c15ca20 2024-09-13T15:12:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa444013650 con 0x7fa44c15ca20 2024-09-13T15:12:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.587+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c0cdf40 con 0x7fa44c15ca20 2024-09-13T15:12:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.591+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444013a00 con 0x7fa44c15ca20 2024-09-13T15:12:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.591+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c0ce500 con 0x7fa44c15ca20 2024-09-13T15:12:10.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.591+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c06d1c0 con 0x7fa44c15ca20 2024-09-13T15:12:10.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.591+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa444013b60 con 0x7fa44c15ca20 2024-09-13T15:12:10.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.595+0000 7fa443400700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa428066730 0x7fa428068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.595+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa444083f70 con 0x7fa44c15ca20 2024-09-13T15:12:10.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.595+0000 7fa44a800700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa428066730 0x7fa428068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.595+0000 7fa44a800700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa428066730 0x7fa428068bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa43c014040 tx=0x7fa43c011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.599+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa444051190 con 0x7fa44c15ca20 2024-09-13T15:12:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.779+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa44c06ab80 con 0x7fa44c15ca20 2024-09-13T15:12:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.779+0000 7fa443400700 1 -- 172.21.15.50:0/1840379439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4440547b0 con 0x7fa44c15ca20 2024-09-13T15:12:10.786 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:12:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa428066730 msgr2=0x7fa428068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa428066730 0x7fa428068bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa43c014040 tx=0x7fa43c011000 comp rx=0 tx=0).stop 2024-09-13T15:12:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 msgr2=0x7fa44c1f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c1f22f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa44400e840 tx=0x7fa44400eb50 comp rx=0 tx=0).stop 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 shutdown_connections 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa428066730 0x7fa428068bf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa44c15ca20 0x7fa44c1f22f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44c06cd80 0x7fa44c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 --2- 172.21.15.50:0/1840379439 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44c06ada0 0x7fa44c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 >> 172.21.15.50:0/1840379439 conn(0x7fa44c071d20 msgr2=0x7fa44c15e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 shutdown_connections 2024-09-13T15:12:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.787+0000 7fa450a00700 1 -- 172.21.15.50:0/1840379439 wait complete. 2024-09-13T15:12:10.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:12:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 Processor -- start 2024-09-13T15:12:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 -- start start 2024-09-13T15:12:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f000667a0 0x7f7f00161300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f0015d200 0x7f7f0015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0015dbb0 con 0x7f7f000b4540 2024-09-13T15:12:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f00161840 con 0x7f7f000667a0 2024-09-13T15:12:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.987+0000 7f7f05c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00160840 con 0x7f7f0015d200 2024-09-13T15:12:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f000667a0 0x7f7f00161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f000667a0 0x7f7f00161300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50250/0 (socket says 172.21.15.50:50250) 2024-09-13T15:12:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 -- 172.21.15.50:0/2259157248 learned_addr learned my addr 172.21.15.50:0/2259157248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7eff400700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f0015d200 0x7f7f0015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 -- 172.21.15.50:0/2259157248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f0015d200 msgr2=0x7f7f0015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f0015d200 0x7f7f0015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 -- 172.21.15.50:0/2259157248 >> v1:172.21.15.181:6789/0 conn(0x7f7f000b4540 legacy=0x7f7f00066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 -- 172.21.15.50:0/2259157248 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0015de10 con 0x7f7f000667a0 2024-09-13T15:12:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7eff400700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f0015d200 0x7f7f0015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7ef7e00700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f000667a0 0x7f7f00161300 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009910 tx=0x7f7ee8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a535ad983ca5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7efe000700 1 -- 172.21.15.50:0/2259157248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800ba60 con 0x7f7f000667a0 2024-09-13T15:12:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7efe000700 1 -- 172.21.15.50:0/2259157248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee800bbc0 con 0x7f7f000667a0 2024-09-13T15:12:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7efe000700 1 -- 172.21.15.50:0/2259157248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8009e60 con 0x7f7f000667a0 2024-09-13T15:12:11.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 -- 172.21.15.50:0/2259157248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f000667a0 msgr2=0x7f7f00161300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f000667a0 0x7f7f00161300 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009910 tx=0x7f7ee8009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 -- 172.21.15.50:0/2259157248 shutdown_connections 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f0015d200 0x7f7f0015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 --2- 172.21.15.50:0/2259157248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f000667a0 0x7f7f00161300 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 -- 172.21.15.50:0/2259157248 >> 172.21.15.50:0/2259157248 conn(0x7f7f0006db90 msgr2=0x7f7f000b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 -- 172.21.15.50:0/2259157248 shutdown_connections 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.991+0000 7f7f05c00700 1 -- 172.21.15.50:0/2259157248 wait complete. 2024-09-13T15:12:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 Processor -- start 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 -- start start 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0015d200 0x7f7f001f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 0x7f7f00153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f000ade90 0x7f7f000ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000ae850 con 0x7f7f00155010 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00155490 con 0x7f7f0015d200 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7f05c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001556f0 con 0x7f7f000ade90 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 0x7f7f00153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 0x7f7f00153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50256/0 (socket says 172.21.15.50:50256) 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 -- 172.21.15.50:0/4241381854 learned_addr learned my addr 172.21.15.50:0/4241381854 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7efea00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0015d200 0x7f7f001f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7eff400700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f000ade90 0x7f7f000ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 -- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f000ade90 msgr2=0x7f7f000ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f000ade90 0x7f7f000ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 -- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0015d200 msgr2=0x7f7f001f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0015d200 0x7f7f001f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 -- 172.21.15.50:0/4241381854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8009570 con 0x7f7f00155010 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.995+0000 7f7ef7e00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 0x7f7f00153f10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8013000 tx=0x7f7ee8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee801a840 con 0x7f7f00155010 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee801f070 con 0x7f7f00155010 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee801aba0 con 0x7f7f00155010 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f001559d0 con 0x7f7f00155010 2024-09-13T15:12:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f00155f90 con 0x7f7f00155010 2024-09-13T15:12:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f000b4920 con 0x7f7f00155010 2024-09-13T15:12:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:10.999+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ee801ad00 con 0x7f7f00155010 2024-09-13T15:12:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.003+0000 7f7ef6a00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7edc066730 0x7f7edc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.003+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ee8021070 con 0x7f7f00155010 2024-09-13T15:12:11.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.003+0000 7f7efea00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7edc066730 0x7f7edc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.003+0000 7f7efea00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7edc066730 0x7f7edc068bf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0000f60 tx=0x7f7ef0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.011+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ee8052cc0 con 0x7f7f00155010 2024-09-13T15:12:11.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.191+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f0006a5b0 con 0x7f7f00155010 2024-09-13T15:12:11.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.191+0000 7f7ef6a00700 1 -- 172.21.15.50:0/4241381854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ee802b0a0 con 0x7f7f00155010 2024-09-13T15:12:11.197 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:12:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7edc066730 msgr2=0x7f7edc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7edc066730 0x7f7edc068bf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0000f60 tx=0x7f7ef0009040 comp rx=0 tx=0).stop 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 msgr2=0x7f7f00153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 0x7f7f00153f10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8013000 tx=0x7f7ee8004770 comp rx=0 tx=0).stop 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 shutdown_connections 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7edc066730 0x7f7edc068bf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7f000ade90 0x7f7f000ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f00155010 0x7f7f00153f10 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 --2- 172.21.15.50:0/4241381854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0015d200 0x7f7f001f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 >> 172.21.15.50:0/4241381854 conn(0x7f7f000b4540 msgr2=0x7f7f001592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 shutdown_connections 2024-09-13T15:12:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.195+0000 7f7f05c00700 1 -- 172.21.15.50:0/4241381854 wait complete. 2024-09-13T15:12:11.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:12:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.387+0000 7f193f200700 1 Processor -- start 2024-09-13T15:12:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.387+0000 7f193f200700 1 -- start start 2024-09-13T15:12:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193f200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f193815cd90 0x7f19380b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f193815d170 0x7f19380cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193f200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19380d1390 con 0x7f19380cde10 2024-09-13T15:12:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193f200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380b2530 con 0x7f193815cd90 2024-09-13T15:12:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19380d05f0 con 0x7f193815d170 2024-09-13T15:12:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f193815cd90 0x7f19380b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f193815cd90 0x7f19380b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50266/0 (socket says 172.21.15.50:50266) 2024-09-13T15:12:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 -- 172.21.15.50:0/2531681799 learned_addr learned my addr 172.21.15.50:0/2531681799 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193d400700 1 --2- 172.21.15.50:0/2531681799 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f193815d170 0x7f19380cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 -- 172.21.15.50:0/2531681799 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f193815d170 msgr2=0x7f19380cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 --2- 172.21.15.50:0/2531681799 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f193815d170 0x7f19380cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 -- 172.21.15.50:0/2531681799 >> v1:172.21.15.181:6789/0 conn(0x7f19380cde10 legacy=0x7f19380ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193ca00700 1 -- 172.21.15.50:0/2531681799 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792200086 0 0) 0x7f19380d1390 con 0x7f19380cde10 2024-09-13T15:12:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.391+0000 7f193de00700 1 -- 172.21.15.50:0/2531681799 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19380d1670 con 0x7f193815cd90 2024-09-13T15:12:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193de00700 1 --2- 172.21.15.50:0/2531681799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815cd90 0x7f19380b1f50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f192c009910 tx=0x7f192c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff689d9edce9c515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193ca00700 1 -- 172.21.15.50:0/2531681799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011830 con 0x7f193815cd90 2024-09-13T15:12:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193ca00700 1 -- 172.21.15.50:0/2531681799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c011990 con 0x7f193815cd90 2024-09-13T15:12:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193ca00700 1 -- 172.21.15.50:0/2531681799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011d40 con 0x7f193815cd90 2024-09-13T15:12:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 -- 172.21.15.50:0/2531681799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815cd90 msgr2=0x7f19380b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 --2- 172.21.15.50:0/2531681799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815cd90 0x7f19380b1f50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f192c009910 tx=0x7f192c009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 -- 172.21.15.50:0/2531681799 shutdown_connections 2024-09-13T15:12:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 --2- 172.21.15.50:0/2531681799 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f193815d170 0x7f19380cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 --2- 172.21.15.50:0/2531681799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815cd90 0x7f19380b1f50 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 -- 172.21.15.50:0/2531681799 >> 172.21.15.50:0/2531681799 conn(0x7f19380d2c10 msgr2=0x7f19380d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 -- 172.21.15.50:0/2531681799 shutdown_connections 2024-09-13T15:12:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.395+0000 7f193f200700 1 -- 172.21.15.50:0/2531681799 wait complete. 2024-09-13T15:12:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 Processor -- start 2024-09-13T15:12:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 -- start start 2024-09-13T15:12:11.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19380cde10 0x7f193814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193815cd90 0x7f19380b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815d170 0x7f19380b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19380b5a40 con 0x7f193815d170 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19380b6a50 con 0x7f193815cd90 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193f200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193814ac80 con 0x7f19380cde10 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193de00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19380cde10 0x7f193814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193e800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815d170 0x7f19380b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193de00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19380cde10 0x7f193814a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:45366/0 (socket says 172.21.15.50:45366) 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193de00700 1 -- 172.21.15.50:0/4021470505 learned_addr learned my addr 172.21.15.50:0/4021470505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.399+0000 7f193d400700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193815cd90 0x7f19380b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193e800700 1 -- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19380cde10 msgr2=0x7f193814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193e800700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19380cde10 0x7f193814a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193e800700 1 -- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193815cd90 msgr2=0x7f19380b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193e800700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193815cd90 0x7f19380b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193e800700 1 -- 172.21.15.50:0/4021470505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009570 con 0x7f193815d170 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193e800700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815d170 0x7f19380b5160 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f193400cbe0 tx=0x7f193400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003e50 con 0x7f193815d170 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400a650 con 0x7f193815d170 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19380b5c90 con 0x7f193815d170 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400aa00 con 0x7f193815d170 2024-09-13T15:12:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19380b6250 con 0x7f193815d170 2024-09-13T15:12:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.403+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19380b1f50 con 0x7f193815d170 2024-09-13T15:12:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.407+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f193400ab60 con 0x7f193815d170 2024-09-13T15:12:11.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.407+0000 7f1932000700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f191c066730 0x7f191c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.407+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1934083ca0 con 0x7f193815d170 2024-09-13T15:12:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.407+0000 7f193de00700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f191c066730 0x7f191c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.411+0000 7f193de00700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f191c066730 0x7f191c068bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f192c009c60 tx=0x7f192c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.415+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1934050e40 con 0x7f193815d170 2024-09-13T15:12:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.607+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19380b14c0 con 0x7f193815d170 2024-09-13T15:12:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f1932000700 1 -- 172.21.15.50:0/4021470505 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1934017080 con 0x7f193815d170 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f191c066730 msgr2=0x7f191c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f191c066730 0x7f191c068bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f192c009c60 tx=0x7f192c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815d170 msgr2=0x7f19380b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815d170 0x7f19380b5160 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f193400cbe0 tx=0x7f193400cef0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 shutdown_connections 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f191c066730 0x7f191c068bf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193815d170 0x7f19380b5160 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f193815cd90 0x7f19380b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 --2- 172.21.15.50:0/4021470505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19380cde10 0x7f193814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.611+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 >> 172.21.15.50:0/4021470505 conn(0x7f19380d2c10 msgr2=0x7f193815f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.615+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 shutdown_connections 2024-09-13T15:12:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.615+0000 7f193f200700 1 -- 172.21.15.50:0/4021470505 wait complete. 2024-09-13T15:12:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:12:11.638 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:12:11.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:11.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:11.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:12:11.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:11.687 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:12:11.703 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:11.703 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:11.722 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:11.722 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:11.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:11.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 Processor -- start 2024-09-13T15:12:11.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 -- start start 2024-09-13T15:12:11.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb7c1610b0 0x7feb7c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feb7c06aaa0 0x7feb7c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0b3560 con 0x7feb7c0b2670 2024-09-13T15:12:11.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c070b30 con 0x7feb7c1610b0 2024-09-13T15:12:11.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c06b450 con 0x7feb7c06aaa0 2024-09-13T15:12:11.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb81a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb7c1610b0 0x7feb7c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feb7c0b2670 0x7feb7c0b2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58604/0 (socket says 172.21.15.50:58604) 2024-09-13T15:12:11.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.971+0000 7feb82400700 1 -- 172.21.15.50:0/539724550 learned_addr learned my addr 172.21.15.50:0/539724550 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:11.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81000700 1 --2- 172.21.15.50:0/539724550 >> v2:172.21.15.181:3300/0 conn(0x7feb7c06aaa0 0x7feb7c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81a00700 1 -- 172.21.15.50:0/539724550 >> v2:172.21.15.181:3300/0 conn(0x7feb7c06aaa0 msgr2=0x7feb7c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81a00700 1 --2- 172.21.15.50:0/539724550 >> v2:172.21.15.181:3300/0 conn(0x7feb7c06aaa0 0x7feb7c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81a00700 1 -- 172.21.15.50:0/539724550 >> v1:172.21.15.50:6789/0 conn(0x7feb7c0b2670 legacy=0x7feb7c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81a00700 1 -- 172.21.15.50:0/539724550 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0b3280 con 0x7feb7c1610b0 2024-09-13T15:12:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81000700 1 --2- 172.21.15.50:0/539724550 >> v2:172.21.15.181:3300/0 conn(0x7feb7c06aaa0 0x7feb7c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:11.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb81a00700 1 --2- 172.21.15.50:0/539724550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c1610b0 0x7feb7c0719c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7feb70009880 tx=0x7feb70009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df76f856797b8236 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb7be00700 1 -- 172.21.15.50:0/539724550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70011830 con 0x7feb7c1610b0 2024-09-13T15:12:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb7be00700 1 -- 172.21.15.50:0/539724550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70011990 con 0x7feb7c1610b0 2024-09-13T15:12:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb7be00700 1 -- 172.21.15.50:0/539724550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70011d20 con 0x7feb7c1610b0 2024-09-13T15:12:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 -- 172.21.15.50:0/539724550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c1610b0 msgr2=0x7feb7c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 --2- 172.21.15.50:0/539724550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c1610b0 0x7feb7c0719c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7feb70009880 tx=0x7feb70009b90 comp rx=0 tx=0).stop 2024-09-13T15:12:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 -- 172.21.15.50:0/539724550 shutdown_connections 2024-09-13T15:12:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 --2- 172.21.15.50:0/539724550 >> v2:172.21.15.181:3300/0 conn(0x7feb7c06aaa0 0x7feb7c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 --2- 172.21.15.50:0/539724550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c1610b0 0x7feb7c0719c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 -- 172.21.15.50:0/539724550 >> 172.21.15.50:0/539724550 conn(0x7feb7c0b0c40 msgr2=0x7feb7c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 -- 172.21.15.50:0/539724550 shutdown_connections 2024-09-13T15:12:11.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.975+0000 7feb82e00700 1 -- 172.21.15.50:0/539724550 wait complete. 2024-09-13T15:12:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.979+0000 7feb82e00700 1 Processor -- start 2024-09-13T15:12:11.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.979+0000 7feb82e00700 1 -- start start 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 0x7feb7c0acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb7c0b2670 0x7feb7c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb7c1610b0 0x7feb7c0aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0ab810 con 0x7feb7c06aaa0 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0aac00 con 0x7feb7c0b2670 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0aaee0 con 0x7feb7c1610b0 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 0x7feb7c0acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 0x7feb7c0acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50292/0 (socket says 172.21.15.50:50292) 2024-09-13T15:12:11.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 -- 172.21.15.50:0/1597113665 learned_addr learned my addr 172.21.15.50:0/1597113665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:11.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81000700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb7c0b2670 0x7feb7c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82400700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb7c1610b0 0x7feb7c0aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 -- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb7c1610b0 msgr2=0x7feb7c0aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb7c1610b0 0x7feb7c0aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 -- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb7c0b2670 msgr2=0x7feb7c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb7c0b2670 0x7feb7c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 -- 172.21.15.50:0/1597113665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700094b0 con 0x7feb7c06aaa0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81000700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb7c0b2670 0x7feb7c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82400700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb7c1610b0 0x7feb7c0aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb81a00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 0x7feb7c0acaa0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7feb70009bd0 tx=0x7feb70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700036c0 con 0x7feb7c06aaa0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7001e070 con 0x7feb7c06aaa0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70003a20 con 0x7feb7c06aaa0 2024-09-13T15:12:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c0ab1c0 con 0x7feb7c06aaa0 2024-09-13T15:12:11.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.983+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c0aa8f0 con 0x7feb7c06aaa0 2024-09-13T15:12:11.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.987+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c161490 con 0x7feb7c06aaa0 2024-09-13T15:12:11.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.987+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb70003b80 con 0x7feb7c06aaa0 2024-09-13T15:12:11.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.987+0000 7feb79600700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb5c066730 0x7feb5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:11.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.987+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb700852f0 con 0x7feb7c06aaa0 2024-09-13T15:12:11.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.991+0000 7feb81000700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb5c066730 0x7feb5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:11.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.991+0000 7feb81000700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb5c066730 0x7feb5c068bf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feb7c15e060 tx=0x7feb68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:11.995+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb70052510 con 0x7feb7c06aaa0 2024-09-13T15:12:12.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.183+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb7c073660 con 0x7feb7c06aaa0 2024-09-13T15:12:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.183+0000 7feb79600700 1 -- 172.21.15.50:0/1597113665 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16696 (secure 0 0 0) 0x7feb70055b30 con 0x7feb7c06aaa0 2024-09-13T15:12:12.190 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:12.190 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:01.015565+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb5c066730 msgr2=0x7feb5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb5c066730 0x7feb5c068bf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feb7c15e060 tx=0x7feb68008040 comp rx=0 tx=0).stop 2024-09-13T15:12:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 msgr2=0x7feb7c0acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 0x7feb7c0acaa0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7feb70009bd0 tx=0x7feb70004770 comp rx=0 tx=0).stop 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 shutdown_connections 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7feb5c066730 0x7feb5c068bf0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feb7c1610b0 0x7feb7c0aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feb7c0b2670 0x7feb7c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 --2- 172.21.15.50:0/1597113665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb7c06aaa0 0x7feb7c0acaa0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 >> 172.21.15.50:0/1597113665 conn(0x7feb7c0b0c40 msgr2=0x7feb7c0cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 shutdown_connections 2024-09-13T15:12:12.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.191+0000 7feb82e00700 1 -- 172.21.15.50:0/1597113665 wait complete. 2024-09-13T15:12:12.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:58.177796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:59.008477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:12:12.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:12:12.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.387+0000 7f6b44a00700 1 Processor -- start 2024-09-13T15:12:12.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.387+0000 7f6b44a00700 1 -- start start 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b44a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40161110 0x7f6b4006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b44a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b4006b170 0x7f6b400b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b44a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4006b5c0 con 0x7f6b40160d30 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b44a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400b0020 con 0x7f6b4006b170 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b44a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400d1770 con 0x7f6b40161110 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6b40160d30 0x7f6b4006cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58606/0 (socket says 172.21.15.50:58606) 2024-09-13T15:12:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3f400700 1 -- 172.21.15.50:0/2752391317 learned_addr learned my addr 172.21.15.50:0/2752391317 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3fe00700 1 --2- 172.21.15.50:0/2752391317 >> v2:172.21.15.50:3300/0 conn(0x7f6b4006b170 0x7f6b400b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3ea00700 1 --2- 172.21.15.50:0/2752391317 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40161110 0x7f6b4006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3e000700 1 -- 172.21.15.50:0/2752391317 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433805302 0 0) 0x7f6b30001110 con 0x7f6b40160d30 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3e000700 1 -- 172.21.15.50:0/2752391317 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b240035d0 con 0x7f6b40160d30 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3ea00700 1 -- 172.21.15.50:0/2752391317 >> v2:172.21.15.50:3300/0 conn(0x7f6b4006b170 msgr2=0x7f6b400b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3ea00700 1 --2- 172.21.15.50:0/2752391317 >> v2:172.21.15.50:3300/0 conn(0x7f6b4006b170 0x7f6b400b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3ea00700 1 -- 172.21.15.50:0/2752391317 >> v1:172.21.15.50:6789/0 conn(0x7f6b40160d30 legacy=0x7f6b4006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3ea00700 1 -- 172.21.15.50:0/2752391317 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400d03f0 con 0x7f6b40161110 2024-09-13T15:12:12.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3ea00700 1 --2- 172.21.15.50:0/2752391317 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40161110 0x7f6b4006ac30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009850 tx=0x7f6b2c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f1ce7d628fedd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3e000700 1 -- 172.21.15.50:0/2752391317 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011830 con 0x7f6b40161110 2024-09-13T15:12:12.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3e000700 1 -- 172.21.15.50:0/2752391317 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c011990 con 0x7f6b40161110 2024-09-13T15:12:12.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.391+0000 7f6b3e000700 1 -- 172.21.15.50:0/2752391317 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011d40 con 0x7f6b40161110 2024-09-13T15:12:12.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 -- 172.21.15.50:0/2752391317 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40161110 msgr2=0x7f6b4006ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 --2- 172.21.15.50:0/2752391317 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40161110 0x7f6b4006ac30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009850 tx=0x7f6b2c009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:12.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 -- 172.21.15.50:0/2752391317 shutdown_connections 2024-09-13T15:12:12.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 --2- 172.21.15.50:0/2752391317 >> v2:172.21.15.50:3300/0 conn(0x7f6b4006b170 0x7f6b400b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 --2- 172.21.15.50:0/2752391317 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40161110 0x7f6b4006ac30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 -- 172.21.15.50:0/2752391317 >> 172.21.15.50:0/2752391317 conn(0x7f6b40071d20 msgr2=0x7f6b40072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:12.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 -- 172.21.15.50:0/2752391317 shutdown_connections 2024-09-13T15:12:12.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.395+0000 7f6b44a00700 1 -- 172.21.15.50:0/2752391317 wait complete. 2024-09-13T15:12:12.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 Processor -- start 2024-09-13T15:12:12.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 -- start start 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 0x7f6b401f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40160d30 0x7f6b400aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b40161110 0x7f6b400b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b401498d0 con 0x7f6b4006b170 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4014baa0 con 0x7f6b40161110 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b44a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4014bd80 con 0x7f6b40160d30 2024-09-13T15:12:12.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 0x7f6b401f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 0x7f6b401f6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50310/0 (socket says 172.21.15.50:50310) 2024-09-13T15:12:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 -- 172.21.15.50:0/1086543952 learned_addr learned my addr 172.21.15.50:0/1086543952 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3ea00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40160d30 0x7f6b400aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3fe00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b40161110 0x7f6b400b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 -- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40160d30 msgr2=0x7f6b400aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40160d30 0x7f6b400aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 -- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b40161110 msgr2=0x7f6b400b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b40161110 0x7f6b400b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 -- 172.21.15.50:0/1086543952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0094b0 con 0x7f6b4006b170 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3fe00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b40161110 0x7f6b400b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:12.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.399+0000 7f6b3f400700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 0x7f6b401f6540 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6b30001270 tx=0x7f6b3000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30005d90 con 0x7f6b4006b170 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b300070d0 con 0x7f6b4006b170 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4014c060 con 0x7f6b4006b170 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30007480 con 0x7f6b4006b170 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4014c620 con 0x7f6b4006b170 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4014c810 con 0x7f6b4006b170 2024-09-13T15:12:12.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.403+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b300075e0 con 0x7f6b4006b170 2024-09-13T15:12:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.407+0000 7f6b37400700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b20066730 0x7f6b20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.407+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6b30083750 con 0x7f6b4006b170 2024-09-13T15:12:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.407+0000 7f6b3ea00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b20066730 0x7f6b20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.407+0000 7f6b3ea00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b20066730 0x7f6b20068bf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6b400b04f0 tx=0x7f6b2c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.411+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b300508e0 con 0x7f6b4006b170 2024-09-13T15:12:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.591+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b4006b5c0 con 0x7f6b4006b170 2024-09-13T15:12:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.591+0000 7f6b37400700 1 -- 172.21.15.50:0/1086543952 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b4006b5c0 con 0x7f6b4006b170 2024-09-13T15:12:12.597 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b20066730 msgr2=0x7f6b20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b20066730 0x7f6b20068bf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6b400b04f0 tx=0x7f6b2c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 msgr2=0x7f6b401f6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 0x7f6b401f6540 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6b30001270 tx=0x7f6b3000ca90 comp rx=0 tx=0).stop 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 shutdown_connections 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b20066730 0x7f6b20068bf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b40161110 0x7f6b400b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b40160d30 0x7f6b400aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 --2- 172.21.15.50:0/1086543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b4006b170 0x7f6b401f6540 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 >> 172.21.15.50:0/1086543952 conn(0x7f6b40071d20 msgr2=0x7f6b400b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:12.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 shutdown_connections 2024-09-13T15:12:12.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.595+0000 7f6b44a00700 1 -- 172.21.15.50:0/1086543952 wait complete. 2024-09-13T15:12:12.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:12:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.799+0000 7ff27e600700 1 Processor -- start 2024-09-13T15:12:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.799+0000 7ff27e600700 1 -- start start 2024-09-13T15:12:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff27e600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff27806be10 0x7ff2780ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff27e600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff27e600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27806d000 con 0x7ff278160fc0 2024-09-13T15:12:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff27e600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780cf520 con 0x7ff27806be10 2024-09-13T15:12:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff27e600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27806c3f0 con 0x7ff2780cf0b0 2024-09-13T15:12:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff27806be10 0x7ff2780ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff277e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff27806be10 0x7ff2780ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:52606/0 (socket says 172.21.15.50:52606) 2024-09-13T15:12:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 -- 172.21.15.50:0/3814618995 learned_addr learned my addr 172.21.15.50:0/3814618995 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 -- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 msgr2=0x7ff2781618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 --2- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 -- 172.21.15.50:0/3814618995 >> v1:172.21.15.181:6789/0 conn(0x7ff278160fc0 legacy=0x7ff2780b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 -- 172.21.15.50:0/3814618995 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27806c6d0 con 0x7ff27806be10 2024-09-13T15:12:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff277e00700 1 --2- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:12.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.803+0000 7ff26fe00700 1 --2- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff27806be10 0x7ff2780ceb70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff260009910 tx=0x7ff260009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144cfae3c2a38862 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff276a00700 1 -- 172.21.15.50:0/3814618995 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260011830 con 0x7ff27806be10 2024-09-13T15:12:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff276a00700 1 -- 172.21.15.50:0/3814618995 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff260011990 con 0x7ff27806be10 2024-09-13T15:12:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff276a00700 1 -- 172.21.15.50:0/3814618995 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260011d40 con 0x7ff27806be10 2024-09-13T15:12:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 -- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff27806be10 msgr2=0x7ff2780ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 --2- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff27806be10 0x7ff2780ceb70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff260009910 tx=0x7ff260009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 -- 172.21.15.50:0/3814618995 shutdown_connections 2024-09-13T15:12:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 --2- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 --2- 172.21.15.50:0/3814618995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff27806be10 0x7ff2780ceb70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 -- 172.21.15.50:0/3814618995 >> 172.21.15.50:0/3814618995 conn(0x7ff27806a570 msgr2=0x7ff27806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 -- 172.21.15.50:0/3814618995 shutdown_connections 2024-09-13T15:12:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.807+0000 7ff27e600700 1 -- 172.21.15.50:0/3814618995 wait complete. 2024-09-13T15:12:12.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 Processor -- start 2024-09-13T15:12:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 -- start start 2024-09-13T15:12:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 0x7ff27815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff278160fc0 0x7ff2781f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781ebca0 con 0x7ff27806be10 2024-09-13T15:12:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781eb2e0 con 0x7ff278160fc0 2024-09-13T15:12:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff27e600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781eb5c0 con 0x7ff2780cf0b0 2024-09-13T15:12:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 0x7ff27815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 0x7ff27815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50320/0 (socket says 172.21.15.50:50320) 2024-09-13T15:12:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 -- 172.21.15.50:0/1553546089 learned_addr learned my addr 172.21.15.50:0/1553546089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff26fe00700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277e00700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff278160fc0 0x7ff2781f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 -- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 msgr2=0x7ff2781f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 -- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff278160fc0 msgr2=0x7ff2781f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff278160fc0 0x7ff2781f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 -- 172.21.15.50:0/1553546089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009a70 con 0x7ff27806be10 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277e00700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff278160fc0 0x7ff2781f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.811+0000 7ff277400700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 0x7ff27815aed0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff26800c500 tx=0x7ff26800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680052d0 con 0x7ff27806be10 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268005430 con 0x7ff27806be10 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff260009570 con 0x7ff27806be10 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680055a0 con 0x7ff27806be10 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780a9250 con 0x7ff27806be10 2024-09-13T15:12:12.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2780ceb70 con 0x7ff27806be10 2024-09-13T15:12:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.815+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2680038e0 con 0x7ff27806be10 2024-09-13T15:12:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.819+0000 7ff26f400700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff254066730 0x7ff254068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.819+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff268083710 con 0x7ff27806be10 2024-09-13T15:12:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.819+0000 7ff26fe00700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff254066730 0x7ff254068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:12.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.819+0000 7ff26fe00700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff254066730 0x7ff254068bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff2780cde70 tx=0x7ff260008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:12.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:12.823+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff268050930 con 0x7ff27806be10 2024-09-13T15:12:13.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.003+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2780b1e50 con 0x7ff27806be10 2024-09-13T15:12:13.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.003+0000 7ff26f400700 1 -- 172.21.15.50:0/1553546089 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff268053f50 con 0x7ff27806be10 2024-09-13T15:12:13.009 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:12:13.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff254066730 msgr2=0x7ff254068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff254066730 0x7ff254068bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff2780cde70 tx=0x7ff260008030 comp rx=0 tx=0).stop 2024-09-13T15:12:13.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 msgr2=0x7ff27815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 0x7ff27815aed0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff26800c500 tx=0x7ff26800c8c0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 shutdown_connections 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff254066730 0x7ff254068bf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff278160fc0 0x7ff2781f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2780cf0b0 0x7ff2781f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 --2- 172.21.15.50:0/1553546089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff27806be10 0x7ff27815aed0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 >> 172.21.15.50:0/1553546089 conn(0x7ff27806a570 msgr2=0x7ff2780b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 shutdown_connections 2024-09-13T15:12:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.007+0000 7ff27e600700 1 -- 172.21.15.50:0/1553546089 wait complete. 2024-09-13T15:12:13.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:12:13.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.211+0000 7f0655e00700 1 Processor -- start 2024-09-13T15:12:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.211+0000 7f0655e00700 1 -- start start 2024-09-13T15:12:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0655e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06500b3c70 0x7f0650165420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0655e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f065006d140 0x7f06501610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0655e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06501649d0 con 0x7f06500b0920 2024-09-13T15:12:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0655e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650165960 con 0x7f06500b3c70 2024-09-13T15:12:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0655e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065006d950 con 0x7f065006d140 2024-09-13T15:12:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0654a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06500b0920 0x7f06500b0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56008/0 (socket says 172.21.15.50:56008) 2024-09-13T15:12:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0654a00700 1 -- 172.21.15.50:0/2809815074 learned_addr learned my addr 172.21.15.50:0/2809815074 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064fe00700 1 --2- 172.21.15.50:0/2809815074 >> v2:172.21.15.50:3300/0 conn(0x7f06500b3c70 0x7f0650165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f0655400700 1 --2- 172.21.15.50:0/2809815074 >> v2:172.21.15.181:3300/0 conn(0x7f065006d140 0x7f06501610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064fe00700 1 -- 172.21.15.50:0/2809815074 >> v2:172.21.15.181:3300/0 conn(0x7f065006d140 msgr2=0x7f06501610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064fe00700 1 --2- 172.21.15.50:0/2809815074 >> v2:172.21.15.181:3300/0 conn(0x7f065006d140 0x7f06501610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064fe00700 1 -- 172.21.15.50:0/2809815074 >> v1:172.21.15.50:6789/0 conn(0x7f06500b0920 legacy=0x7f06500b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064fe00700 1 -- 172.21.15.50:0/2809815074 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065006dc30 con 0x7f06500b3c70 2024-09-13T15:12:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064f400700 1 -- 172.21.15.50:0/2809815074 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702570912 0 0) 0x7f06501649d0 con 0x7f06500b0920 2024-09-13T15:12:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064fe00700 1 --2- 172.21.15.50:0/2809815074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b3c70 0x7f0650165420 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0650073310 tx=0x7f063c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab706fee97ca237c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064f400700 1 -- 172.21.15.50:0/2809815074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011830 con 0x7f06500b3c70 2024-09-13T15:12:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064f400700 1 -- 172.21.15.50:0/2809815074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c011990 con 0x7f06500b3c70 2024-09-13T15:12:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.215+0000 7f064f400700 1 -- 172.21.15.50:0/2809815074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011d20 con 0x7f06500b3c70 2024-09-13T15:12:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 -- 172.21.15.50:0/2809815074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b3c70 msgr2=0x7f0650165420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 --2- 172.21.15.50:0/2809815074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b3c70 0x7f0650165420 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0650073310 tx=0x7f063c009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 -- 172.21.15.50:0/2809815074 shutdown_connections 2024-09-13T15:12:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 --2- 172.21.15.50:0/2809815074 >> v2:172.21.15.181:3300/0 conn(0x7f065006d140 0x7f06501610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 --2- 172.21.15.50:0/2809815074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b3c70 0x7f0650165420 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 -- 172.21.15.50:0/2809815074 >> 172.21.15.50:0/2809815074 conn(0x7f065006a390 msgr2=0x7f065006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 -- 172.21.15.50:0/2809815074 shutdown_connections 2024-09-13T15:12:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 -- 172.21.15.50:0/2809815074 wait complete. 2024-09-13T15:12:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 Processor -- start 2024-09-13T15:12:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.219+0000 7f0655e00700 1 -- start start 2024-09-13T15:12:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f065006d140 0x7f065015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 0x7f06500ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06500b3c70 0x7f06500aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500cb7a0 con 0x7f06500b0920 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500cba80 con 0x7f06500b3c70 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500cbd60 con 0x7f065006d140 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 0x7f06500ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 0x7f06500ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36188/0 (socket says 172.21.15.50:36188) 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 -- 172.21.15.50:0/3741298571 learned_addr learned my addr 172.21.15.50:0/3741298571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0654a00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f065006d140 0x7f065015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655400700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06500b3c70 0x7f06500aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 -- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f065006d140 msgr2=0x7f065015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f065006d140 0x7f065015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 -- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06500b3c70 msgr2=0x7f06500aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06500b3c70 0x7f06500aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 -- 172.21.15.50:0/3741298571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0094b0 con 0x7f06500b0920 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064fe00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 0x7f06500ac4e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f063c014040 tx=0x7f063c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c004610 con 0x7f06500b0920 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c01e070 con 0x7f06500b0920 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06500cc040 con 0x7f06500b0920 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c0038e0 con 0x7f06500b0920 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.223+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06500cd000 con 0x7f06500b0920 2024-09-13T15:12:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.227+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06500cc560 con 0x7f06500b0920 2024-09-13T15:12:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.227+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f063c003a40 con 0x7f06500b0920 2024-09-13T15:12:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.227+0000 7f064cc00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0630066730 0x7f0630068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.227+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f063c085050 con 0x7f06500b0920 2024-09-13T15:12:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.227+0000 7f0654a00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0630066730 0x7f0630068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.231+0000 7f0654a00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0630066730 0x7f0630068bf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0644000f60 tx=0x7f0644007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.235+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f063c0b6db0 con 0x7f06500b0920 2024-09-13T15:12:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.415+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0650165420 con 0x7f06500b0920 2024-09-13T15:12:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.415+0000 7f064cc00700 1 -- 172.21.15.50:0/3741298571 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+11 (secure 0 0 0) 0x7f063c0200a0 con 0x7f06500b0920 2024-09-13T15:12:13.422 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:12:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0630066730 msgr2=0x7f0630068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0630066730 0x7f0630068bf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0644000f60 tx=0x7f0644007e00 comp rx=0 tx=0).stop 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 msgr2=0x7f06500ac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 0x7f06500ac4e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f063c014040 tx=0x7f063c004770 comp rx=0 tx=0).stop 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 shutdown_connections 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0630066730 0x7f0630068bf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06500b3c70 0x7f06500aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06500b0920 0x7f06500ac4e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 --2- 172.21.15.50:0/3741298571 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f065006d140 0x7f065015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 >> 172.21.15.50:0/3741298571 conn(0x7f065006a390 msgr2=0x7f06500b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 shutdown_connections 2024-09-13T15:12:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.423+0000 7f0655e00700 1 -- 172.21.15.50:0/3741298571 wait complete. 2024-09-13T15:12:13.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:12:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 Processor -- start 2024-09-13T15:12:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 -- start start 2024-09-13T15:12:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 0x7f62840719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f628406aaa0 0x7f628406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840b3560 con 0x7f62840b2670 2024-09-13T15:12:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6284070b30 con 0x7f628406aaa0 2024-09-13T15:12:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f628a000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628406b420 con 0x7f62841610b0 2024-09-13T15:12:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f6288c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 0x7f62840719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f6288c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 0x7f62840719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:59288/0 (socket says 172.21.15.50:59288) 2024-09-13T15:12:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f6288c00700 1 -- 172.21.15.50:0/3888974933 learned_addr learned my addr 172.21.15.50:0/3888974933 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.623+0000 7f627be00700 1 --2- 172.21.15.50:0/3888974933 >> v2:172.21.15.181:3300/0 conn(0x7f628406aaa0 0x7f628406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6288c00700 1 -- 172.21.15.50:0/3888974933 >> v2:172.21.15.181:3300/0 conn(0x7f628406aaa0 msgr2=0x7f628406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6288c00700 1 --2- 172.21.15.50:0/3888974933 >> v2:172.21.15.181:3300/0 conn(0x7f628406aaa0 0x7f628406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6288c00700 1 -- 172.21.15.50:0/3888974933 >> v1:172.21.15.181:6789/0 conn(0x7f62840b2670 legacy=0x7f62840cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6288c00700 1 -- 172.21.15.50:0/3888974933 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840b3280 con 0x7f62841610b0 2024-09-13T15:12:13.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6288c00700 1 --2- 172.21.15.50:0/3888974933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 0x7f62840719c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6274009910 tx=0x7f6274009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc6d1bc94cc5f9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6283e00700 1 -- 172.21.15.50:0/3888974933 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274011830 con 0x7f62841610b0 2024-09-13T15:12:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6283e00700 1 -- 172.21.15.50:0/3888974933 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6274011990 con 0x7f62841610b0 2024-09-13T15:12:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f6283e00700 1 -- 172.21.15.50:0/3888974933 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274011d40 con 0x7f62841610b0 2024-09-13T15:12:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f628a000700 1 -- 172.21.15.50:0/3888974933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 msgr2=0x7f62840719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f628a000700 1 --2- 172.21.15.50:0/3888974933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 0x7f62840719c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6274009910 tx=0x7f6274009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f628a000700 1 -- 172.21.15.50:0/3888974933 shutdown_connections 2024-09-13T15:12:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f628a000700 1 --2- 172.21.15.50:0/3888974933 >> v2:172.21.15.181:3300/0 conn(0x7f628406aaa0 0x7f628406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f628a000700 1 --2- 172.21.15.50:0/3888974933 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62841610b0 0x7f62840719c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.627+0000 7f628a000700 1 -- 172.21.15.50:0/3888974933 >> 172.21.15.50:0/3888974933 conn(0x7f62840b0c40 msgr2=0x7f628406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.631+0000 7f628a000700 1 -- 172.21.15.50:0/3888974933 shutdown_connections 2024-09-13T15:12:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.631+0000 7f628a000700 1 -- 172.21.15.50:0/3888974933 wait complete. 2024-09-13T15:12:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.631+0000 7f628a000700 1 Processor -- start 2024-09-13T15:12:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 -- start start 2024-09-13T15:12:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628406aaa0 0x7f62841584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62840b2670 0x7f6284162c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 0x7f6284149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6284148760 con 0x7f62841610b0 2024-09-13T15:12:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62841489b0 con 0x7f628406aaa0 2024-09-13T15:12:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f628a000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6284148c90 con 0x7f62840b2670 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 0x7f6284149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 0x7f6284149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36204/0 (socket says 172.21.15.50:36204) 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 -- 172.21.15.50:0/3654629634 learned_addr learned my addr 172.21.15.50:0/3654629634 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f627be00700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62840b2670 0x7f6284162c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6288c00700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628406aaa0 0x7f62841584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 -- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62840b2670 msgr2=0x7f6284162c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62840b2670 0x7f6284162c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 -- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628406aaa0 msgr2=0x7f62841584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628406aaa0 0x7f62841584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 -- 172.21.15.50:0/3654629634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274009570 con 0x7f62841610b0 2024-09-13T15:12:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6289600700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 0x7f6284149a50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f627c00cc50 tx=0x7f627c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c003c20 con 0x7f62841610b0 2024-09-13T15:12:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c003d80 con 0x7f62841610b0 2024-09-13T15:12:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.635+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c00aab0 con 0x7f62841610b0 2024-09-13T15:12:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.639+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6284148f70 con 0x7f62841610b0 2024-09-13T15:12:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.639+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6284149530 con 0x7f62841610b0 2024-09-13T15:12:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.639+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6284149750 con 0x7f62841610b0 2024-09-13T15:12:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.639+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f627c00ac10 con 0x7f62841610b0 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.643+0000 7f6281600700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6260066760 0x7f6260068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.643+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f627c084220 con 0x7f62841610b0 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.643+0000 7f6288c00700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6260066760 0x7f6260068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.647+0000 7f6288c00700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6260066760 0x7f6260068c20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6274014040 tx=0x7f6274008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.651+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f627c051440 con 0x7f62841610b0 2024-09-13T15:12:13.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.843+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6284161490 con 0x7f62841610b0 2024-09-13T15:12:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f6281600700 1 -- 172.21.15.50:0/3654629634 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) v1 ==== 80+0+0 (secure 0 0 0) 0x7f627c054a60 con 0x7f62841610b0 2024-09-13T15:12:13.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6260066760 msgr2=0x7f6260068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6260066760 0x7f6260068c20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6274014040 tx=0x7f6274008030 comp rx=0 tx=0).stop 2024-09-13T15:12:13.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 msgr2=0x7f6284149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 0x7f6284149a50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f627c00cc50 tx=0x7f627c00cf60 comp rx=0 tx=0).stop 2024-09-13T15:12:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 shutdown_connections 2024-09-13T15:12:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6260066760 0x7f6260068c20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62841610b0 0x7f6284149a50 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f62840b2670 0x7f6284162c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 --2- 172.21.15.50:0/3654629634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628406aaa0 0x7f62841584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.847+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 >> 172.21.15.50:0/3654629634 conn(0x7f62840b0c40 msgr2=0x7f628415f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.851+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 shutdown_connections 2024-09-13T15:12:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:13.851+0000 7f628a000700 1 -- 172.21.15.50:0/3654629634 wait complete. 2024-09-13T15:12:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-13T15:12:13.880 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:12:13.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:13.880 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:13.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:12:13.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:13.928 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:12:13.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:12:13.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:12:14.068 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-13T15:12:14.068 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-13T15:12:14.068 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:12:14.068 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-13T15:12:14.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-13T15:12:14.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:12:14.070 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-09-13T15:12:14.071 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.072 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:12:14.074 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:14.075 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-13T15:12:14.076 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.077 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:14.078 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-09-13T15:12:14.079 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-13T15:12:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: mds_sessionmap_keys_per_op = 1 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-09-13T15:12:14.105 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:12:14.106 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.107 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on skipped message = False 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:12:14.108 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-09-13T15:12:14.109 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-09-13T15:12:14.110 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:12:14.111 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.112 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.113 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:12:14.114 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on pool no app = False 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = "" 2024-09-13T15:12:14.115 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:14.116 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-13T15:12:14.117 INFO:teuthology.orchestra.run.smithi181.stdout: mds_sessionmap_keys_per_op = 1 2024-09-13T15:12:14.130 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:12:14.130 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:12:14.131 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:12:14.131 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:12:14.131 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:12:14.131 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:12:14.131 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:12:14.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:12:14.152 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:12:14.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-13T15:12:14.154 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:12:14.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-13T15:12:14.159 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:12:14.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-13T15:12:14.162 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:12:14.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-13T15:12:14.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 Processor -- start 2024-09-13T15:12:14.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 -- start start 2024-09-13T15:12:14.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fc417e00700 1 Processor -- start 2024-09-13T15:12:14.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fc417e00700 1 -- start start 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb28146580 0x7fcb2806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb2806b2e0 0x7fcb280acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280b37f0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2806e500 con 0x7fcb28146580 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2e400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28146960 con 0x7fcb2806b2e0 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2d000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb28146580 0x7fcb2806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2d000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb28146580 0x7fcb2806dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36206/0 (socket says 172.21.15.50:36206) 2024-09-13T15:12:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2d000700 1 -- 172.21.15.50:0/2666772978 learned_addr learned my addr 172.21.15.50:0/2666772978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.319+0000 7fcb2da00700 1 --2- 172.21.15.50:0/2666772978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb2806b2e0 0x7fcb280acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2d000700 1 -- 172.21.15.50:0/2666772978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb2806b2e0 msgr2=0x7fcb280acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2d000700 1 --2- 172.21.15.50:0/2666772978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb2806b2e0 0x7fcb280acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2d000700 1 -- 172.21.15.50:0/2666772978 >> v1:172.21.15.181:6789/0 conn(0x7fcb2806ccf0 legacy=0x7fcb2806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2d000700 1 -- 172.21.15.50:0/2666772978 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280aeda0 con 0x7fcb28146580 2024-09-13T15:12:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2d000700 1 --2- 172.21.15.50:0/2666772978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb28146580 0x7fcb2806dfc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806e640 tx=0x7fcb1c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dd22201a65fb2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180c9ed0 0x7fc418071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4180722e0 0x7fc4180cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180cbb40 con 0x7fc418146120 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc418072750 con 0x7fc4180722e0 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180b4b30 con 0x7fc4180c9ed0 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb27400700 1 -- 172.21.15.50:0/2666772978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c004230 con 0x7fcb28146580 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb27400700 1 -- 172.21.15.50:0/2666772978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c004390 con 0x7fcb28146580 2024-09-13T15:12:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb27400700 1 -- 172.21.15.50:0/2666772978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0036c0 con 0x7fcb28146580 2024-09-13T15:12:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4180722e0 0x7fc4180cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc416000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180c9ed0 0x7fc418071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4180722e0 0x7fc4180cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36220/0 (socket says 172.21.15.50:36220) 2024-09-13T15:12:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 -- 172.21.15.50:0/1859885284 learned_addr learned my addr 172.21.15.50:0/1859885284 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc416a00700 1 --1- 172.21.15.50:0/1859885284 >> v1:172.21.15.181:6789/0 conn(0x7fc418146120 0x7fc4180b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:35114/0 (socket says 172.21.15.50:35114) 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 -- 172.21.15.50:0/1859885284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180c9ed0 msgr2=0x7fc418071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 --2- 172.21.15.50:0/1859885284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180c9ed0 0x7fc418071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 -- 172.21.15.50:0/1859885284 >> v1:172.21.15.181:6789/0 conn(0x7fc418146120 legacy=0x7fc4180b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 -- 172.21.15.50:0/1859885284 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180ca4b0 con 0x7fc4180722e0 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc415600700 1 -- 172.21.15.50:0/1859885284 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055078380 0 0) 0x7fc4180cbb40 con 0x7fc418146120 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 -- 172.21.15.50:0/2666772978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb28146580 msgr2=0x7fcb2806dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2666772978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb28146580 0x7fcb2806dfc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806e640 tx=0x7fcb1c009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc417400700 1 --2- 172.21.15.50:0/1859885284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180722e0 0x7fc4180cbfb0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fc410009e50 tx=0x7fc41000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3baebe87ae09f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 -- 172.21.15.50:0/2666772978 shutdown_connections 2024-09-13T15:12:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2666772978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb2806b2e0 0x7fcb280acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2666772978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb28146580 0x7fcb2806dfc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 -- 172.21.15.50:0/2666772978 >> 172.21.15.50:0/2666772978 conn(0x7fcb28071c50 msgr2=0x7fcb28072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 -- 172.21.15.50:0/2666772978 shutdown_connections 2024-09-13T15:12:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fcb2e400700 1 -- 172.21.15.50:0/2666772978 wait complete. 2024-09-13T15:12:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc415600700 1 -- 172.21.15.50:0/1859885284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000e070 con 0x7fc4180722e0 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc415600700 1 -- 172.21.15.50:0/1859885284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41000b910 con 0x7fc4180722e0 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.323+0000 7fc415600700 1 -- 172.21.15.50:0/1859885284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000bcc0 con 0x7fc4180722e0 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 -- 172.21.15.50:0/1859885284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180722e0 msgr2=0x7fc4180cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 --2- 172.21.15.50:0/1859885284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180722e0 0x7fc4180cbfb0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fc410009e50 tx=0x7fc41000b330 comp rx=0 tx=0).stop 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 -- 172.21.15.50:0/1859885284 shutdown_connections 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 --2- 172.21.15.50:0/1859885284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180722e0 0x7fc4180cbfb0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 --2- 172.21.15.50:0/1859885284 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180c9ed0 0x7fc418071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 -- 172.21.15.50:0/1859885284 >> 172.21.15.50:0/1859885284 conn(0x7fc41806a340 msgr2=0x7fc41806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 -- 172.21.15.50:0/1859885284 shutdown_connections 2024-09-13T15:12:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 -- 172.21.15.50:0/1859885284 wait complete. 2024-09-13T15:12:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 Processor -- start 2024-09-13T15:12:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 -- start start 2024-09-13T15:12:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fc417e00700 1 Processor -- start 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb2806b2e0 0x7fcb28160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 0x7fcb2813c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb28146580 0x7fcb281e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2815fdf0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281600d0 con 0x7fcb2806b2e0 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.327+0000 7fcb2e400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281603b0 con 0x7fcb28146580 2024-09-13T15:12:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 -- start start 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 0x7fcb2813c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 0x7fcb2813c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36234/0 (socket says 172.21.15.50:36234) 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 -- 172.21.15.50:0/2042342240 learned_addr learned my addr 172.21.15.50:0/2042342240 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb2d000700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb2806b2e0 0x7fcb28160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb2da00700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb28146580 0x7fcb281e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 -- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb28146580 msgr2=0x7fcb281e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb28146580 0x7fcb281e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 -- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb2806b2e0 msgr2=0x7fcb28160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb2806b2e0 0x7fcb28160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 -- 172.21.15.50:0/2042342240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c009570 con 0x7fcb2806ccf0 2024-09-13T15:12:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180722e0 0x7fc4180b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 0x7fc4180b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc418146120 0x7fc41815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180b2b90 con 0x7fc4180c9ed0 2024-09-13T15:12:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc418139e10 con 0x7fc418146120 2024-09-13T15:12:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb2d000700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb2806b2e0 0x7fcb28160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:14.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180b1320 con 0x7fc4180722e0 2024-09-13T15:12:14.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 0x7fc4180b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 0x7fc4180b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36244/0 (socket says 172.21.15.50:36244) 2024-09-13T15:12:14.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 -- 172.21.15.50:0/1994026711 learned_addr learned my addr 172.21.15.50:0/1994026711 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:14.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb27e00700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 0x7fcb2813c6e0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400c500 tx=0x7fcb1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416a00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180722e0 0x7fc4180b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140052d0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb14005430 con 0x7fcb2806ccf0 2024-09-13T15:12:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28160690 con 0x7fcb2806ccf0 2024-09-13T15:12:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140055a0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2815c190 con 0x7fcb2806ccf0 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417400700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc418146120 0x7fc41815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 -- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180722e0 msgr2=0x7fc4180b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180722e0 0x7fc4180b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 -- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc418146120 msgr2=0x7fc41815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc418146120 0x7fc41815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 -- 172.21.15.50:0/1994026711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410009b30 con 0x7fc4180c9ed0 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc416000700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 0x7fc4180b2650 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc40400e9d0 tx=0x7fc40400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404009720 con 0x7fc4180c9ed0 2024-09-13T15:12:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40400c850 con 0x7fc4180c9ed0 2024-09-13T15:12:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.331+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4180b1600 con 0x7fc4180c9ed0 2024-09-13T15:12:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400cbc0 con 0x7fc4180c9ed0 2024-09-13T15:12:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4180b1bc0 con 0x7fc4180c9ed0 2024-09-13T15:12:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28160bb0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb140038e0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f0005310 con 0x7fc4180c9ed0 2024-09-13T15:12:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fcb24c00700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcb08066780 0x7fcb08068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcb14083850 con 0x7fcb2806ccf0 2024-09-13T15:12:14.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fcb2d000700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcb08066780 0x7fcb08068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.335+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc40400cd20 con 0x7fc4180c9ed0 2024-09-13T15:12:14.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.339+0000 7fc40f400700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3f8066730 0x7fc3f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.339+0000 7fcb2d000700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcb08066780 0x7fcb08068c40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806e640 tx=0x7fcb1c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.339+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc4040842a0 con 0x7fc4180c9ed0 2024-09-13T15:12:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.339+0000 7fc416a00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3f8066730 0x7fc3f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.339+0000 7fc416a00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3f8066730 0x7fc3f8068bf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc408000f60 tx=0x7fc408007eb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.343+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcb28160bb0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.351+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc404051560 con 0x7fc4180c9ed0 2024-09-13T15:12:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.363+0000 7fc2f2400700 1 Processor -- start 2024-09-13T15:12:14.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.363+0000 7fc2f2400700 1 -- start start 2024-09-13T15:12:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f2400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06bbf0 0x7fc2ec0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f2400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc2ec0b5e30 0x7fc2ec0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f2400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec0cf3b0 con 0x7fc2ec06af70 2024-09-13T15:12:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f2400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec0cf0e0 con 0x7fc2ec0b5e30 2024-09-13T15:12:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f2400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0d0c30 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f1000700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc2ec06af70 0x7fc2ec06b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:35118/0 (socket says 172.21.15.50:35118) 2024-09-13T15:12:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f1000700 1 -- 172.21.15.50:0/2522790309 learned_addr learned my addr 172.21.15.50:0/2522790309 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:14.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2ebe00700 1 --2- 172.21.15.50:0/2522790309 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06bbf0 0x7fc2ec0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2f1a00700 1 --2- 172.21.15.50:0/2522790309 >> v2:172.21.15.181:3300/0 conn(0x7fc2ec0b5e30 0x7fc2ec0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2ebe00700 1 -- 172.21.15.50:0/2522790309 >> v2:172.21.15.181:3300/0 conn(0x7fc2ec0b5e30 msgr2=0x7fc2ec0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2ebe00700 1 --2- 172.21.15.50:0/2522790309 >> v2:172.21.15.181:3300/0 conn(0x7fc2ec0b5e30 0x7fc2ec0d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2ebe00700 1 -- 172.21.15.50:0/2522790309 >> v1:172.21.15.181:6789/0 conn(0x7fc2ec06af70 legacy=0x7fc2ec06b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2ebe00700 1 -- 172.21.15.50:0/2522790309 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0d0f10 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.367+0000 7fc2ebe00700 1 --2- 172.21.15.50:0/2522790309 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06bbf0 0x7fc2ec0ceba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009850 tx=0x7fc2d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78258e9af2d64d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2eb400700 1 -- 172.21.15.50:0/2522790309 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011830 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2eb400700 1 -- 172.21.15.50:0/2522790309 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8011990 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2eb400700 1 -- 172.21.15.50:0/2522790309 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011d40 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 -- 172.21.15.50:0/2522790309 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06bbf0 msgr2=0x7fc2ec0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 --2- 172.21.15.50:0/2522790309 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06bbf0 0x7fc2ec0ceba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009850 tx=0x7fc2d8009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 -- 172.21.15.50:0/2522790309 shutdown_connections 2024-09-13T15:12:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 --2- 172.21.15.50:0/2522790309 >> v2:172.21.15.181:3300/0 conn(0x7fc2ec0b5e30 0x7fc2ec0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 --2- 172.21.15.50:0/2522790309 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06bbf0 0x7fc2ec0ceba0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 -- 172.21.15.50:0/2522790309 >> 172.21.15.50:0/2522790309 conn(0x7fc2ec0d2c00 msgr2=0x7fc2ec0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 -- 172.21.15.50:0/2522790309 shutdown_connections 2024-09-13T15:12:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7fc2f2400700 1 -- 172.21.15.50:0/2522790309 wait complete. 2024-09-13T15:12:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7faeacc00700 1 Processor -- start 2024-09-13T15:12:14.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.371+0000 7faeacc00700 1 -- start start 2024-09-13T15:12:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 Processor -- start 2024-09-13T15:12:14.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 -- start start 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faeacc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faea00e0b00 0x7faea0035950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faeacc00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00516c0 con 0x7faea0054b90 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faeacc00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea0055710 con 0x7faea000be50 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faeacc00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea000c290 con 0x7faea00e0b00 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea7e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faea0054b90 0x7faea0055000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56020/0 (socket says 172.21.15.50:56020) 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea7e00700 1 -- 172.21.15.50:0/882004266 learned_addr learned my addr 172.21.15.50:0/882004266 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea7400700 1 --2- 172.21.15.50:0/882004266 >> v2:172.21.15.181:3300/0 conn(0x7faea00e0b00 0x7faea0035950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea6000700 1 -- 172.21.15.50:0/882004266 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859085320 0 0) 0x7faea00516c0 con 0x7faea0054b90 2024-09-13T15:12:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea6000700 1 -- 172.21.15.50:0/882004266 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae900035d0 con 0x7faea0054b90 2024-09-13T15:12:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea7400700 1 -- 172.21.15.50:0/882004266 >> v1:172.21.15.181:6789/0 conn(0x7faea000be50 legacy=0x7faea0056f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea7400700 1 -- 172.21.15.50:0/882004266 >> v1:172.21.15.50:6789/0 conn(0x7faea0054b90 legacy=0x7faea0055000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7faea7400700 1 -- 172.21.15.50:0/882004266 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00545d0 con 0x7faea00e0b00 2024-09-13T15:12:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06af70 0x7fc2ec15fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 0x7fc2ec1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2ec0b5e30 0x7fc2ec0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1f68e0 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1f5cd0 con 0x7fc2ec0b5e30 2024-09-13T15:12:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.375+0000 7fc2f2400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1f5fb0 con 0x7fc2ec06af70 2024-09-13T15:12:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faea7400700 1 --2- 172.21.15.50:0/882004266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea00e0b00 0x7faea0035950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009840 tx=0x7fae9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e017ded0fdf5fff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 0x7fc2ec1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 0x7fc2ec1f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36260/0 (socket says 172.21.15.50:36260) 2024-09-13T15:12:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 -- 172.21.15.50:0/4189297988 learned_addr learned my addr 172.21.15.50:0/4189297988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2f1000700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06af70 0x7fc2ec15fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2f1a00700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2ec0b5e30 0x7fc2ec0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faea6000700 1 -- 172.21.15.50:0/882004266 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c005e50 con 0x7faea00e0b00 2024-09-13T15:12:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faea6000700 1 -- 172.21.15.50:0/882004266 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c006030 con 0x7faea00e0b00 2024-09-13T15:12:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faea6000700 1 -- 172.21.15.50:0/882004266 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0063c0 con 0x7faea00e0b00 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 -- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06af70 msgr2=0x7fc2ec15fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06af70 0x7fc2ec15fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 -- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2ec0b5e30 msgr2=0x7fc2ec0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2ec0b5e30 0x7fc2ec0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 -- 172.21.15.50:0/4189297988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80094b0 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2f1a00700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2ec0b5e30 0x7fc2ec0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2ebe00700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 0x7fc2ec1f2c20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8014040 tx=0x7fc2d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8004510 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d801e070 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8003900 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec1f6290 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 -- 172.21.15.50:0/882004266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea00e0b00 msgr2=0x7faea0035950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 --2- 172.21.15.50:0/882004266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea00e0b00 0x7faea0035950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009840 tx=0x7fae9c009b50 comp rx=0 tx=0).stop 2024-09-13T15:12:14.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec160170 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 -- 172.21.15.50:0/882004266 shutdown_connections 2024-09-13T15:12:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 --2- 172.21.15.50:0/882004266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea00e0b00 0x7faea0035950 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 -- 172.21.15.50:0/882004266 >> 172.21.15.50:0/882004266 conn(0x7faea001fbf0 msgr2=0x7faea0056860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 -- 172.21.15.50:0/882004266 shutdown_connections 2024-09-13T15:12:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7faeacc00700 1 -- 172.21.15.50:0/882004266 wait complete. 2024-09-13T15:12:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.379+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec160300 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 Processor -- start 2024-09-13T15:12:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2d8003a60 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 -- start start 2024-09-13T15:12:14.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7fc2e8c00700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2cc066730 0x7fc2cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faea000be50 0x7faea00d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0054b90 0x7faea003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 0x7faea004d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea0037af0 con 0x7faea00e0b00 2024-09-13T15:12:14.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00d4280 con 0x7faea0054b90 2024-09-13T15:12:14.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faeacc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea003b170 con 0x7faea000be50 2024-09-13T15:12:14.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc2d80850f0 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faea7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 0x7faea004d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faea7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 0x7faea004d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36272/0 (socket says 172.21.15.50:36272) 2024-09-13T15:12:14.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faea7e00700 1 -- 172.21.15.50:0/1740099953 learned_addr learned my addr 172.21.15.50:0/1740099953 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:14.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7fc2f1000700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2cc066730 0x7fc2cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.383+0000 7faea7400700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faea000be50 0x7faea00d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea6a00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0054b90 0x7faea003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea7e00700 1 -- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faea000be50 msgr2=0x7faea00d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea7e00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faea000be50 0x7faea00d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea7e00700 1 -- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0054b90 msgr2=0x7faea003a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea7e00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0054b90 0x7faea003a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea7e00700 1 -- 172.21.15.50:0/1740099953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c009450 con 0x7faea00e0b00 2024-09-13T15:12:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea6a00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0054b90 0x7faea003a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faea7e00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 0x7faea004d930 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7faea80641b0 tx=0x7faea80740a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7fc2f1000700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2cc066730 0x7fc2cc068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0005930 tx=0x7fc2e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8073ab0 con 0x7faea00e0b00 2024-09-13T15:12:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8073c10 con 0x7faea00e0b00 2024-09-13T15:12:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8072fe0 con 0x7faea00e0b00 2024-09-13T15:12:14.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.387+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea0037d40 con 0x7faea00e0b00 2024-09-13T15:12:14.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.391+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea0038300 con 0x7faea00e0b00 2024-09-13T15:12:14.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.391+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2ec160300 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.391+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea00384f0 con 0x7faea00e0b00 2024-09-13T15:12:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.391+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faea8090020 con 0x7faea00e0b00 2024-09-13T15:12:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.391+0000 7fae9b400700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae88066730 0x7fae88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.391+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faea80fe590 con 0x7faea00e0b00 2024-09-13T15:12:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.395+0000 7faea7400700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae88066730 0x7fae88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.395+0000 7faea7400700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae88066730 0x7fae88068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fae9c006000 tx=0x7fae9c008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:14.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.403+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faea80cb850 con 0x7faea00e0b00 2024-09-13T15:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.639+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fc2ec160300 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.651+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7faea0035950 con 0x7faea00e0b00 2024-09-13T15:12:14.657 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:12:14.651+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:12:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.663+0000 7fc2e8c00700 1 -- 172.21.15.50:0/4189297988 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7383 v55) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc2ec160300 con 0x7fc2ec06bbf0 2024-09-13T15:12:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.663+0000 7fae9b400700 1 -- 172.21.15.50:0/1740099953 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7389 v55) v1 ==== 95+0+0 (secure 0 0 0) 0x7faea80cee70 con 0x7faea00e0b00 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2cc066730 msgr2=0x7fc2cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2cc066730 0x7fc2cc068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0005930 tx=0x7fc2e0009040 comp rx=0 tx=0).stop 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 msgr2=0x7fc2ec1f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 0x7fc2ec1f2c20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8014040 tx=0x7fc2d8004770 comp rx=0 tx=0).stop 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 shutdown_connections 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc2cc066730 0x7fc2cc068bf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2ec0b5e30 0x7fc2ec0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2ec06bbf0 0x7fc2ec1f2c20 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 --2- 172.21.15.50:0/4189297988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc2ec06af70 0x7fc2ec15fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 >> 172.21.15.50:0/4189297988 conn(0x7fc2ec0d2c00 msgr2=0x7fc2ec0d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 shutdown_connections 2024-09-13T15:12:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7fc2f2400700 1 -- 172.21.15.50:0/4189297988 wait complete. 2024-09-13T15:12:14.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae88066730 msgr2=0x7fae88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae88066730 0x7fae88068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fae9c006000 tx=0x7fae9c008070 comp rx=0 tx=0).stop 2024-09-13T15:12:14.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 msgr2=0x7faea004d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 0x7faea004d930 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7faea80641b0 tx=0x7faea80740a0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 shutdown_connections 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae88066730 0x7fae88068bf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faea00e0b00 0x7faea004d930 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0054b90 0x7faea003a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 --2- 172.21.15.50:0/1740099953 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faea000be50 0x7faea00d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 >> 172.21.15.50:0/1740099953 conn(0x7faea001fbf0 msgr2=0x7faea0035030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 shutdown_connections 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.667+0000 7faeacc00700 1 -- 172.21.15.50:0/1740099953 wait complete. 2024-09-13T15:12:14.675 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 7383 2024-09-13T15:12:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 7389 2024-09-13T15:12:14.699 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:12:14.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:12:14.701 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:12:14.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:12:14.746 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:12:14.746 DEBUG:teuthology.parallel:result is None 2024-09-13T15:12:14.749 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:12:14.749 DEBUG:teuthology.parallel:result is None 2024-09-13T15:12:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.779+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7fcb28160bb0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.784 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:12:14.779+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:12:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.795+0000 7fcb24c00700 1 -- 172.21.15.50:0/2042342240 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7285 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fcb28160bb0 con 0x7fcb2806ccf0 2024-09-13T15:12:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcb08066780 msgr2=0x7fcb08068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcb08066780 0x7fcb08068c40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806e640 tx=0x7fcb1c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 msgr2=0x7fcb2813c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 0x7fcb2813c6e0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400c500 tx=0x7fcb1400c8c0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 shutdown_connections 2024-09-13T15:12:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fcb08066780 0x7fcb08068c40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcb28146580 0x7fcb281e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb2806ccf0 0x7fcb2813c6e0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 --2- 172.21.15.50:0/2042342240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb2806b2e0 0x7fcb28160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 >> 172.21.15.50:0/2042342240 conn(0x7fcb28071c50 msgr2=0x7fcb280acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 shutdown_connections 2024-09-13T15:12:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.799+0000 7fcb2e400700 1 -- 172.21.15.50:0/2042342240 wait complete. 2024-09-13T15:12:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 7285 2024-09-13T15:12:14.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.811+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fc3f0005890 con 0x7fc4180c9ed0 2024-09-13T15:12:14.815 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:12:14.811+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:12:14.822 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:12:14.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:12:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.819+0000 7fc40f400700 1 -- 172.21.15.50:0/1994026711 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6464 v59) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc404054b80 con 0x7fc4180c9ed0 2024-09-13T15:12:14.826 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:12:14.826 DEBUG:teuthology.parallel:result is None 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3f8066730 msgr2=0x7fc3f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3f8066730 0x7fc3f8068bf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc408000f60 tx=0x7fc408007eb0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 msgr2=0x7fc4180b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 0x7fc4180b2650 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc40400e9d0 tx=0x7fc40400ece0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 shutdown_connections 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc3f8066730 0x7fc3f8068bf0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc418146120 0x7fc41815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4180c9ed0 0x7fc4180b2650 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 --2- 172.21.15.50:0/1994026711 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4180722e0 0x7fc4180b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 >> 172.21.15.50:0/1994026711 conn(0x7fc41806a340 msgr2=0x7fc4180cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 shutdown_connections 2024-09-13T15:12:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:14.827+0000 7fc417e00700 1 -- 172.21.15.50:0/1994026711 wait complete. 2024-09-13T15:12:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6464 2024-09-13T15:12:14.854 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:12:14.855 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:12:14.858 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:12:14.858 DEBUG:teuthology.parallel:result is None 2024-09-13T15:12:14.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:14.865 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:12:14.870 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:12:14.944 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-09-13T15:12:14.980 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-09-13T15:12:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.035+0000 7f67aae00700 1 Processor -- start 2024-09-13T15:12:15.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.035+0000 7f67aae00700 1 -- start start 2024-09-13T15:12:15.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67aae00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67a4071420 0x7f67a40b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67aae00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f67a406d280 0x7f67a4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67aae00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a4071d40 con 0x7f67a40cd6c0 2024-09-13T15:12:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67aae00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a40b3200 con 0x7f67a4071420 2024-09-13T15:12:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67aae00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a40b34e0 con 0x7f67a406d280 2024-09-13T15:12:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67a4071420 0x7f67a40b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67a4071420 0x7f67a40b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36328/0 (socket says 172.21.15.50:36328) 2024-09-13T15:12:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 -- 172.21.15.50:0/1536441365 learned_addr learned my addr 172.21.15.50:0/1536441365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9000700 1 --2- 172.21.15.50:0/1536441365 >> v2:172.21.15.181:3300/0 conn(0x7f67a406d280 0x7f67a4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 -- 172.21.15.50:0/1536441365 >> v2:172.21.15.181:3300/0 conn(0x7f67a406d280 msgr2=0x7f67a4071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:15.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 --2- 172.21.15.50:0/1536441365 >> v2:172.21.15.181:3300/0 conn(0x7f67a406d280 0x7f67a4071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 -- 172.21.15.50:0/1536441365 >> v1:172.21.15.50:6789/0 conn(0x7f67a40cd6c0 legacy=0x7f67a40cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:15.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9a00700 1 -- 172.21.15.50:0/1536441365 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a40b37c0 con 0x7f67a4071420 2024-09-13T15:12:15.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.039+0000 7f67a9000700 1 --2- 172.21.15.50:0/1536441365 >> v2:172.21.15.181:3300/0 conn(0x7f67a406d280 0x7f67a4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:15.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67a9a00700 1 --2- 172.21.15.50:0/1536441365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a4071420 0x7f67a40b2b70 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f67a40b1d30 tx=0x7f679800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e11f11b1faf050 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:15.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67a3e00700 1 -- 172.21.15.50:0/1536441365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800e070 con 0x7f67a4071420 2024-09-13T15:12:15.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67a3e00700 1 -- 172.21.15.50:0/1536441365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800b9c0 con 0x7f67a4071420 2024-09-13T15:12:15.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67a3e00700 1 -- 172.21.15.50:0/1536441365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800bd70 con 0x7f67a4071420 2024-09-13T15:12:15.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 -- 172.21.15.50:0/1536441365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a4071420 msgr2=0x7f67a40b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 --2- 172.21.15.50:0/1536441365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a4071420 0x7f67a40b2b70 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f67a40b1d30 tx=0x7f679800b330 comp rx=0 tx=0).stop 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 -- 172.21.15.50:0/1536441365 shutdown_connections 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 --2- 172.21.15.50:0/1536441365 >> v2:172.21.15.181:3300/0 conn(0x7f67a406d280 0x7f67a4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 --2- 172.21.15.50:0/1536441365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a4071420 0x7f67a40b2b70 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 -- 172.21.15.50:0/1536441365 >> 172.21.15.50:0/1536441365 conn(0x7f67a40b0d90 msgr2=0x7f67a406fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 -- 172.21.15.50:0/1536441365 shutdown_connections 2024-09-13T15:12:15.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.043+0000 7f67aae00700 1 -- 172.21.15.50:0/1536441365 wait complete. 2024-09-13T15:12:15.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 Processor -- start 2024-09-13T15:12:15.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 -- start start 2024-09-13T15:12:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 0x7f67a413b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a4071420 0x7f67a4142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a40cd6c0 0x7f67a414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4142040 con 0x7f67a406d280 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4153ab0 con 0x7f67a40cd6c0 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41425b0 con 0x7f67a4071420 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 0x7f67a413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 0x7f67a413b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36330/0 (socket says 172.21.15.50:36330) 2024-09-13T15:12:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 -- 172.21.15.50:0/693515048 learned_addr learned my addr 172.21.15.50:0/693515048 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9000700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a4071420 0x7f67a4142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67aa400700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a40cd6c0 0x7f67a414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 -- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a4071420 msgr2=0x7f67a4142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a4071420 0x7f67a4142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 -- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a40cd6c0 msgr2=0x7f67a414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a40cd6c0 0x7f67a414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9a00700 1 -- 172.21.15.50:0/693515048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798009b30 con 0x7f67a406d280 2024-09-13T15:12:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.047+0000 7f67a9000700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a4071420 0x7f67a4142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67a9a00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 0x7f67a413b980 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f67a40ce790 tx=0x7f6798004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980092e0 con 0x7f67a406d280 2024-09-13T15:12:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679801c440 con 0x7f67a406d280 2024-09-13T15:12:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679801c810 con 0x7f67a406d280 2024-09-13T15:12:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a413ed30 con 0x7f67a406d280 2024-09-13T15:12:15.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a413efa0 con 0x7f67a406d280 2024-09-13T15:12:15.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.051+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4071800 con 0x7f67a406d280 2024-09-13T15:12:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.055+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f679801c970 con 0x7f67a406d280 2024-09-13T15:12:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.055+0000 7f67a1600700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6784066760 0x7f6784068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.055+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f6798085df0 con 0x7f67a406d280 2024-09-13T15:12:15.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.059+0000 7f67a9000700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6784066760 0x7f6784068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.059+0000 7f67a9000700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6784066760 0x7f6784068c20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f67a415a9b0 tx=0x7f6790008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.063+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6798052f10 con 0x7f67a406d280 2024-09-13T15:12:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.303+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67a415ca50 con 0x7f67a406d280 2024-09-13T15:12:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67a1600700 1 -- 172.21.15.50:0/693515048 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+1702 (secure 0 0 0) 0x7f6798056530 con 0x7f67a406d280 2024-09-13T15:12:15.310 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:15.310 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:14.815826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6784066760 msgr2=0x7f6784068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6784066760 0x7f6784068c20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f67a415a9b0 tx=0x7f6790008040 comp rx=0 tx=0).stop 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 msgr2=0x7f67a413b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 0x7f67a413b980 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f67a40ce790 tx=0x7f6798004af0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 shutdown_connections 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6784066760 0x7f6784068c20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67a40cd6c0 0x7f67a414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f67a4071420 0x7f67a4142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 --2- 172.21.15.50:0/693515048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67a406d280 0x7f67a413b980 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 >> 172.21.15.50:0/693515048 conn(0x7f67a40b0d90 msgr2=0x7f67a415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 shutdown_connections 2024-09-13T15:12:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:15.307+0000 7f67aae00700 1 -- 172.21.15.50:0/693515048 wait complete. 2024-09-13T15:12:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 59 2024-09-13T15:12:15.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:12:00.010021+0000', 'modified': '2024-09-13T15:12:14.815826+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 105, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:12:15.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-13T15:12:16.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:16.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.907+0000 7f47a5400700 1 Processor -- start 2024-09-13T15:12:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.907+0000 7f47a5400700 1 -- start start 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47a0144090 0x7f47a0146800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f47a00b2830 0x7f47a00b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a0144470 con 0x7f47a01621a0 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00b3200 con 0x7f47a0144090 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00b4b00 con 0x7f47a00b2830 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47a0144090 0x7f47a0146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47a0144090 0x7f47a0146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36340/0 (socket says 172.21.15.50:36340) 2024-09-13T15:12:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 -- 172.21.15.50:0/1619689534 learned_addr learned my addr 172.21.15.50:0/1619689534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a4a00700 1 --2- 172.21.15.50:0/1619689534 >> v2:172.21.15.181:3300/0 conn(0x7f47a00b2830 0x7f47a00b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 -- 172.21.15.50:0/1619689534 >> v2:172.21.15.181:3300/0 conn(0x7f47a00b2830 msgr2=0x7f47a00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 --2- 172.21.15.50:0/1619689534 >> v2:172.21.15.181:3300/0 conn(0x7f47a00b2830 0x7f47a00b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 -- 172.21.15.50:0/1619689534 >> v1:172.21.15.181:6789/0 conn(0x7f47a01621a0 legacy=0x7f47a00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 -- 172.21.15.50:0/1619689534 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a01476a0 con 0x7f47a0144090 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479fe00700 1 --2- 172.21.15.50:0/1619689534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a0146800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f47a006f3f0 tx=0x7f4790009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e3234de6b9728c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479ea00700 1 -- 172.21.15.50:0/1619689534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790004230 con 0x7f47a0144090 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479ea00700 1 -- 172.21.15.50:0/1619689534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790004390 con 0x7f47a0144090 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f479ea00700 1 -- 172.21.15.50:0/1619689534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900036c0 con 0x7f47a0144090 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- 172.21.15.50:0/1619689534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 msgr2=0x7f47a0146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 --2- 172.21.15.50:0/1619689534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a0146800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f47a006f3f0 tx=0x7f4790009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- 172.21.15.50:0/1619689534 shutdown_connections 2024-09-13T15:12:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 --2- 172.21.15.50:0/1619689534 >> v2:172.21.15.181:3300/0 conn(0x7f47a00b2830 0x7f47a00b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 --2- 172.21.15.50:0/1619689534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a0146800 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- 172.21.15.50:0/1619689534 >> 172.21.15.50:0/1619689534 conn(0x7f47a0071d80 msgr2=0x7f47a0072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- 172.21.15.50:0/1619689534 shutdown_connections 2024-09-13T15:12:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.911+0000 7f47a5400700 1 -- 172.21.15.50:0/1619689534 wait complete. 2024-09-13T15:12:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.915+0000 7f47a5400700 1 Processor -- start 2024-09-13T15:12:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.915+0000 7f47a5400700 1 -- start start 2024-09-13T15:12:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47a00b2830 0x7f47a015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a00cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47a01621a0 0x7f47a00d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a015b990 con 0x7f47a0144090 2024-09-13T15:12:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01613e0 con 0x7f47a00b2830 2024-09-13T15:12:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01616c0 con 0x7f47a01621a0 2024-09-13T15:12:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a00cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a00cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36350/0 (socket says 172.21.15.50:36350) 2024-09-13T15:12:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 -- 172.21.15.50:0/1942948656 learned_addr learned my addr 172.21.15.50:0/1942948656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479fe00700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47a00b2830 0x7f47a015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a4a00700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47a01621a0 0x7f47a00d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 -- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47a01621a0 msgr2=0x7f47a00d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47a01621a0 0x7f47a00d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 -- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47a00b2830 msgr2=0x7f47a015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47a00b2830 0x7f47a015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 -- 172.21.15.50:0/1942948656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790009570 con 0x7f47a0144090 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f479f400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a00cff80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c4e0 tx=0x7f478c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c011790 con 0x7f47a0144090 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c011910 con 0x7f47a0144090 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a01619a0 con 0x7f47a0144090 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c011cc0 con 0x7f47a0144090 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.919+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a0160620 con 0x7f47a0144090 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.923+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a0161ec0 con 0x7f47a0144090 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.923+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f478c01c460 con 0x7f47a0144090 2024-09-13T15:12:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.927+0000 7f4797e00700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4780066730 0x7f4780068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.927+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f478c0840a0 con 0x7f47a0144090 2024-09-13T15:12:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.927+0000 7f479fe00700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4780066730 0x7f4780068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.927+0000 7f479fe00700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4780066730 0x7f4780068bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47a006f3f0 tx=0x7f4790008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:16.931+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f478c0511c0 con 0x7f47a0144090 2024-09-13T15:12:17.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.171+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47a00b2cc0 con 0x7f47a0144090 2024-09-13T15:12:17.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f4797e00700 1 -- 172.21.15.50:0/1942948656 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f478c0547e0 con 0x7f47a0144090 2024-09-13T15:12:17.179 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:17.179 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:16.835627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4780066730 msgr2=0x7f4780068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4780066730 0x7f4780068bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47a006f3f0 tx=0x7f4790008030 comp rx=0 tx=0).stop 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 msgr2=0x7f47a00cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a00cff80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c4e0 tx=0x7f478c00c7f0 comp rx=0 tx=0).stop 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 shutdown_connections 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f4780066730 0x7f4780068bf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47a01621a0 0x7f47a00d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a0144090 0x7f47a00cff80 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 --2- 172.21.15.50:0/1942948656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47a00b2830 0x7f47a015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.175+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 >> 172.21.15.50:0/1942948656 conn(0x7f47a0071d80 msgr2=0x7f47a0146610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.179+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 shutdown_connections 2024-09-13T15:12:17.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:17.179+0000 7f47a5400700 1 -- 172.21.15.50:0/1942948656 wait complete. 2024-09-13T15:12:17.184 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 62 2024-09-13T15:12:17.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:12:00.010021+0000', 'modified': '2024-09-13T15:12:16.835627+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 105, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7650}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7650': {'gid': 7650, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.50:6835/359103955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 359103955}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 359103955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:12:17.607 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7650:up:reconnect 2024-09-13T15:12:18.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:18.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.783+0000 7fc15ee00700 1 Processor -- start 2024-09-13T15:12:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.783+0000 7fc15ee00700 1 -- start start 2024-09-13T15:12:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15ee00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc158157fb0 0x7fc1580b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15ee00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580b3700 con 0x7fc1580b1fa0 2024-09-13T15:12:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15ee00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580b2410 con 0x7fc158071b30 2024-09-13T15:12:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15ee00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc158162610 con 0x7fc158157fb0 2024-09-13T15:12:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15d000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc1580b1fa0 0x7fc158071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56036/0 (socket says 172.21.15.50:56036) 2024-09-13T15:12:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15d000700 1 -- 172.21.15.50:0/2546810828 learned_addr learned my addr 172.21.15.50:0/2546810828 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15da00700 1 --2- 172.21.15.50:0/2546810828 >> v2:172.21.15.181:3300/0 conn(0x7fc158157fb0 0x7fc1580b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281767097 0 0) 0x7fc1580b3700 con 0x7fc1580b1fa0 2024-09-13T15:12:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1400035d0 con 0x7fc1580b1fa0 2024-09-13T15:12:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813806710 0 0) 0x7fc1580b2410 con 0x7fc158071b30 2024-09-13T15:12:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1580b3700 con 0x7fc158071b30 2024-09-13T15:12:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15da00700 1 -- 172.21.15.50:0/2546810828 >> v1:172.21.15.181:6789/0 conn(0x7fc158071b30 legacy=0x7fc158163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15da00700 1 -- 172.21.15.50:0/2546810828 >> v1:172.21.15.50:6789/0 conn(0x7fc1580b1fa0 legacy=0x7fc158071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.787+0000 7fc15da00700 1 -- 172.21.15.50:0/2546810828 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158158390 con 0x7fc158157fb0 2024-09-13T15:12:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15da00700 1 --2- 172.21.15.50:0/2546810828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc1580b1a60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009850 tx=0x7fc14c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68fa4e196e5353cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c011830 con 0x7fc158157fb0 2024-09-13T15:12:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c011990 con 0x7fc158157fb0 2024-09-13T15:12:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc157e00700 1 -- 172.21.15.50:0/2546810828 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c011d40 con 0x7fc158157fb0 2024-09-13T15:12:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 -- 172.21.15.50:0/2546810828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 msgr2=0x7fc1580b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 --2- 172.21.15.50:0/2546810828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc1580b1a60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009850 tx=0x7fc14c009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 -- 172.21.15.50:0/2546810828 shutdown_connections 2024-09-13T15:12:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 --2- 172.21.15.50:0/2546810828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc1580b1a60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 -- 172.21.15.50:0/2546810828 >> 172.21.15.50:0/2546810828 conn(0x7fc1580b0d90 msgr2=0x7fc15806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 -- 172.21.15.50:0/2546810828 shutdown_connections 2024-09-13T15:12:18.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.791+0000 7fc15ee00700 1 -- 172.21.15.50:0/2546810828 wait complete. 2024-09-13T15:12:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.795+0000 7fc15ee00700 1 Processor -- start 2024-09-13T15:12:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.795+0000 7fc15ee00700 1 -- start start 2024-09-13T15:12:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.795+0000 7fc15ee00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc158071b30 0x7fc15814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.795+0000 7fc15ee00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 0x7fc1581e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15ee00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc158156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15ee00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581f6df0 con 0x7fc1580b1fa0 2024-09-13T15:12:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15ee00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581eb550 con 0x7fc158157fb0 2024-09-13T15:12:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15ee00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581ea9d0 con 0x7fc158071b30 2024-09-13T15:12:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 0x7fc1581e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 0x7fc1581e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36360/0 (socket says 172.21.15.50:36360) 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 -- 172.21.15.50:0/1989986163 learned_addr learned my addr 172.21.15.50:0/1989986163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15e400700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc158156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15da00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc158071b30 0x7fc15814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 -- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc158071b30 msgr2=0x7fc15814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc158071b30 0x7fc15814e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 -- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 msgr2=0x7fc158156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc158156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 -- 172.21.15.50:0/1989986163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0094b0 con 0x7fc1580b1fa0 2024-09-13T15:12:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15d000700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 0x7fc1581e9ff0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c560 tx=0x7fc14400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144005d90 con 0x7fc1580b1fa0 2024-09-13T15:12:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1440070d0 con 0x7fc1580b1fa0 2024-09-13T15:12:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1581eacb0 con 0x7fc1580b1fa0 2024-09-13T15:12:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144007460 con 0x7fc1580b1fa0 2024-09-13T15:12:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.799+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1581eb270 con 0x7fc1580b1fa0 2024-09-13T15:12:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.803+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1580b1a60 con 0x7fc1580b1fa0 2024-09-13T15:12:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.803+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1440075c0 con 0x7fc1580b1fa0 2024-09-13T15:12:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.807+0000 7fc155600700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc138066730 0x7fc138068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.807+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7fc144083980 con 0x7fc1580b1fa0 2024-09-13T15:12:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.807+0000 7fc15da00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc138066730 0x7fc138068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.807+0000 7fc15da00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc138066730 0x7fc138068bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0090b0 tx=0x7fc14c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:18.811+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc144050a10 con 0x7fc1580b1fa0 2024-09-13T15:12:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.047+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc158157760 con 0x7fc1580b1fa0 2024-09-13T15:12:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.051+0000 7fc155600700 1 -- 172.21.15.50:0/1989986163 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fc144017090 con 0x7fc1580b1fa0 2024-09-13T15:12:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:19.055 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7647,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:18.843103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7650},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.051+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc138066730 msgr2=0x7fc138068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.051+0000 7fc15ee00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc138066730 0x7fc138068bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0090b0 tx=0x7fc14c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.051+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 msgr2=0x7fc1581e9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.051+0000 7fc15ee00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 0x7fc1581e9ff0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c560 tx=0x7fc14400c870 comp rx=0 tx=0).stop 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 shutdown_connections 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc138066730 0x7fc138068bf0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc158157fb0 0x7fc158156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1580b1fa0 0x7fc1581e9ff0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 --2- 172.21.15.50:0/1989986163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc158071b30 0x7fc15814e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 >> 172.21.15.50:0/1989986163 conn(0x7fc1580b0d90 msgr2=0x7fc15806b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 shutdown_connections 2024-09-13T15:12:19.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.055+0000 7fc15ee00700 1 -- 172.21.15.50:0/1989986163 wait complete. 2024-09-13T15:12:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 64 2024-09-13T15:12:19.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:12:00.010021+0000', 'modified': '2024-09-13T15:12:18.843103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 105, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7650}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7650': {'gid': 7650, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6835/359103955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 359103955}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 359103955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:12:19.484 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:12:19.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T15:12:19.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.659+0000 7f16eea00700 1 Processor -- start 2024-09-13T15:12:19.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.659+0000 7f16eea00700 1 -- start start 2024-09-13T15:12:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16eea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f16e8071370 0x7f16e80cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16eea00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80cd1c0 con 0x7f16e8156df0 2024-09-13T15:12:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16eea00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80b3640 con 0x7f16e8070f10 2024-09-13T15:12:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16eea00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80b3920 con 0x7f16e8071370 2024-09-13T15:12:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16ed600700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16e8156df0 0x7f16e80b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56052/0 (socket says 172.21.15.50:56052) 2024-09-13T15:12:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16ed600700 1 -- 172.21.15.50:0/492806595 learned_addr learned my addr 172.21.15.50:0/492806595 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16ee000700 1 --2- 172.21.15.50:0/492806595 >> v2:172.21.15.181:3300/0 conn(0x7f16e8071370 0x7f16e80cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16e7e00700 1 -- 172.21.15.50:0/492806595 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112314648 0 0) 0x7f16e80cd1c0 con 0x7f16e8156df0 2024-09-13T15:12:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16e7e00700 1 -- 172.21.15.50:0/492806595 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d00034f0 con 0x7f16e8156df0 2024-09-13T15:12:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16ee000700 1 -- 172.21.15.50:0/492806595 >> v1:172.21.15.181:6789/0 conn(0x7f16e8070f10 legacy=0x7f16e80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16ee000700 1 -- 172.21.15.50:0/492806595 >> v1:172.21.15.50:6789/0 conn(0x7f16e8156df0 legacy=0x7f16e80b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.663+0000 7f16ee000700 1 -- 172.21.15.50:0/492806595 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80b3c00 con 0x7f16e8071370 2024-09-13T15:12:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16ee000700 1 --2- 172.21.15.50:0/492806595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8071370 0x7f16e80cdd60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009d90 tx=0x7f16e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f783e1c208bf244 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16e7e00700 1 -- 172.21.15.50:0/492806595 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000e070 con 0x7f16e8071370 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16e7e00700 1 -- 172.21.15.50:0/492806595 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000bb20 con 0x7f16e8071370 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16e7e00700 1 -- 172.21.15.50:0/492806595 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0012430 con 0x7f16e8071370 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 -- 172.21.15.50:0/492806595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8071370 msgr2=0x7f16e80cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 --2- 172.21.15.50:0/492806595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8071370 0x7f16e80cdd60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009d90 tx=0x7f16e000b330 comp rx=0 tx=0).stop 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 -- 172.21.15.50:0/492806595 shutdown_connections 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 --2- 172.21.15.50:0/492806595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8071370 0x7f16e80cdd60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 -- 172.21.15.50:0/492806595 >> 172.21.15.50:0/492806595 conn(0x7f16e80b0f40 msgr2=0x7f16e80b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 -- 172.21.15.50:0/492806595 shutdown_connections 2024-09-13T15:12:19.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.667+0000 7f16eea00700 1 -- 172.21.15.50:0/492806595 wait complete. 2024-09-13T15:12:19.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 Processor -- start 2024-09-13T15:12:19.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 -- start start 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8070f10 0x7f16e8151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 0x7f16e81f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16e8156df0 0x7f16e80adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80aeb90 con 0x7f16e8071370 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81f2f30 con 0x7f16e8070f10 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16eea00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80ae5d0 con 0x7f16e8156df0 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 0x7f16e81f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 0x7f16e81f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36372/0 (socket says 172.21.15.50:36372) 2024-09-13T15:12:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 -- 172.21.15.50:0/1144204068 learned_addr learned my addr 172.21.15.50:0/1144204068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ee000700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16e8156df0 0x7f16e80adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ed600700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8070f10 0x7f16e8151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 -- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16e8156df0 msgr2=0x7f16e80adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16e8156df0 0x7f16e80adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 -- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8070f10 msgr2=0x7f16e8151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8070f10 0x7f16e8151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.671+0000 7f16ecc00700 1 -- 172.21.15.50:0/1144204068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009a70 con 0x7f16e8071370 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.675+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 0x7f16e81f29f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c500 tx=0x7f16d400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.675+0000 7f16e5600700 1 -- 172.21.15.50:0/1144204068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40052d0 con 0x7f16e8071370 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.675+0000 7f16e5600700 1 -- 172.21.15.50:0/1144204068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4005430 con 0x7f16e8071370 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.675+0000 7f16e5600700 1 -- 172.21.15.50:0/1144204068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40055a0 con 0x7f16e8071370 2024-09-13T15:12:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.675+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e80ae8b0 con 0x7f16e8071370 2024-09-13T15:12:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.675+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e8159b50 con 0x7f16e8071370 2024-09-13T15:12:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.679+0000 7f16e5600700 1 -- 172.21.15.50:0/1144204068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16d40038e0 con 0x7f16e8071370 2024-09-13T15:12:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.679+0000 7f16e5600700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f16c8066730 0x7f16c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.679+0000 7f16e5600700 1 -- 172.21.15.50:0/1144204068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f16d4083800 con 0x7f16e8071370 2024-09-13T15:12:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.679+0000 7f16ed600700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f16c8066730 0x7f16c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.679+0000 7f16f3320740 1 Processor -- start 2024-09-13T15:12:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.679+0000 7f16f3320740 1 -- start start 2024-09-13T15:12:19.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f16c8066730 0x7f16c8068bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f16dc007fd0 tx=0x7f16dc007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16f3320740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e660610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e63ee90 0x1e628890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660b50 0x1e628dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16f3320740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e587d80 con 0x1e660230 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e585510 con 0x1e63ee90 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e580e00 con 0x1e660b50 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e660610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e660610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36386/0 (socket says 172.21.15.50:36386) 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 -- 172.21.15.50:0/2093435633 learned_addr learned my addr 172.21.15.50:0/2093435633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ecc00700 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e63ee90 0x1e628890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ee000700 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660b50 0x1e628dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 -- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660b50 msgr2=0x1e628dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660b50 0x1e628dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 -- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e63ee90 msgr2=0x1e628890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e63ee90 0x1e628890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 -- 172.21.15.50:0/2093435633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e3f3960 con 0x1e660230 2024-09-13T15:12:19.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ecc00700 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e63ee90 0x1e628890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16ed600700 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e660610 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f16dc007970 tx=0x7f16dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31758a5d71d9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16d9c00700 1 -- 172.21.15.50:0/2093435633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0062c0 con 0x1e660230 2024-09-13T15:12:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16d9c00700 1 -- 172.21.15.50:0/2093435633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc006420 con 0x1e660230 2024-09-13T15:12:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.683+0000 7f16d9c00700 1 -- 172.21.15.50:0/2093435633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0067b0 con 0x1e660230 2024-09-13T15:12:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- 172.21.15.50:0/2093435633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 msgr2=0x1e660610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e660610 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f16dc007970 tx=0x7f16dc012000 comp rx=0 tx=0).stop 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- 172.21.15.50:0/2093435633 shutdown_connections 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660b50 0x1e628dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e63ee90 0x1e628890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- 172.21.15.50:0/2093435633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e660610 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- 172.21.15.50:0/2093435633 >> 172.21.15.50:0/2093435633 conn(0x1e3a84d0 msgr2=0x1e641e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- 172.21.15.50:0/2093435633 shutdown_connections 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- 172.21.15.50:0/2093435633 wait complete. 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- start start 2024-09-13T15:12:19.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 Processor -- start 2024-09-13T15:12:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e63ee90 0x1e65fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e62af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e618d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e53e730 con 0x1e660230 2024-09-13T15:12:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e5445b0 con 0x1e660b50 2024-09-13T15:12:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e42caa0 con 0x1e63ee90 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.687+0000 7f16f3320740 10 client.0 _ll_register_callbacks cb 0x1e57a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e62af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e62af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36396/0 (socket says 172.21.15.50:36396) 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 -- 172.21.15.50:0/3555953297 learned_addr learned my addr 172.21.15.50:0/3555953297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ed600700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e63ee90 0x1e65fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ee000700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e618d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 -- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e63ee90 msgr2=0x1e65fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e63ee90 0x1e65fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 -- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 msgr2=0x1e618d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e618d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 -- 172.21.15.50:0/3555953297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d00034f0 con 0x1e660230 2024-09-13T15:12:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ee000700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e618d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ecc00700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e62af50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f16d400cb60 tx=0x7f16d4053f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccbffcfd6e119f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 1 -- 172.21.15.50:0/3555953297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4053bc0 con 0x1e660230 2024-09-13T15:12:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 1 -- 172.21.15.50:0/3555953297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f16d4058300 con 0x1e660230 2024-09-13T15:12:19.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e3b51e0 con 0x1e660230 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 1 -- 172.21.15.50:0/3555953297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d4058120 con 0x1e660230 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 10 client.7695 fetch_fsmap learned FSMap version 64 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x1e547220 con 0x1e660230 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 1 -- 172.21.15.50:0/3555953297 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e3b51e0 con 0x1e660230 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 1 -- 172.21.15.50:0/3555953297 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 64) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f16d405c430 con 0x1e660230 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 10 client.7695 fetch_fsmap finished waiting for FSMap version 64 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 10 client.7695 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:12:19.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 20 client.7695 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e615c00 0x1e615fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 4 client.7695 mds_command: new command op to 7650 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:12:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 --> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e3ff460 con 0x1e615c00 2024-09-13T15:12:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ed600700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e615c00 0x1e615fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ed600700 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e615c00 0x1e615fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3a915f8d544dd9 server_cookie=c46925c094b9c51a in_seq=0 out_seq=0 2024-09-13T15:12:19.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.691+0000 7f16ce000700 10 client.7695 ms_handle_connect on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:19.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16ce000700 1 -- 172.21.15.50:0/3555953297 <== mds.0 v2:172.21.15.50:6833/359103955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x1e3ff460 con 0x1e615c00 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16ce000700 10 client.7695 handle_command_reply: tid=0 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 client.7695 shutdown 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 msgr2=0x1e62af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e62af50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f16d400cb60 tx=0x7f16d4053f20 comp rx=0 tx=0).stop 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 shutdown_connections 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e615c00 0x1e615fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e618d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e660230 0x1e62af50 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 --2- 172.21.15.50:0/3555953297 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e63ee90 0x1e65fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 >> 172.21.15.50:0/3555953297 conn(0x1e3a84d0 msgr2=0x1e6592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16ce000700 0 client.7695 ms_handle_reset on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 shutdown_connections 2024-09-13T15:12:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 1 -- 172.21.15.50:0/3555953297 wait complete. 2024-09-13T15:12:19.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.695+0000 7f16f3320740 20 client.7695 trim_cache size 0 max 16384 2024-09-13T15:12:19.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 Processor -- start 2024-09-13T15:12:19.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 -- start start 2024-09-13T15:12:19.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e62a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e62a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e66efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e53ac30 con 0x1e63ee90 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e5afec0 con 0x1e660b50 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.715+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e610320 con 0x1e660230 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e62a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e62a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36412/0 (socket says 172.21.15.50:36412) 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 -- 172.21.15.50:0/909158065 learned_addr learned my addr 172.21.15.50:0/909158065 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ecc00700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e62a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ee000700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e66efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 -- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 msgr2=0x1e62a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e62a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 -- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 msgr2=0x1e66efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e66efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 -- 172.21.15.50:0/909158065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e52d450 con 0x1e63ee90 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ecc00700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e62a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ee000700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e66efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16ed600700 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e62a210 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x1e542fb0 tx=0x7f16dc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba6f57bade43785 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16da600700 1 -- 172.21.15.50:0/909158065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0062c0 con 0x1e63ee90 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16da600700 1 -- 172.21.15.50:0/909158065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc006690 con 0x1e63ee90 2024-09-13T15:12:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16da600700 1 -- 172.21.15.50:0/909158065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc034d00 con 0x1e63ee90 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 -- 172.21.15.50:0/909158065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 msgr2=0x1e62a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e62a210 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x1e542fb0 tx=0x7f16dc013000 comp rx=0 tx=0).stop 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 -- 172.21.15.50:0/909158065 shutdown_connections 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e66efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e62a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 --2- 172.21.15.50:0/909158065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e62a210 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 -- 172.21.15.50:0/909158065 >> 172.21.15.50:0/909158065 conn(0x1e3a84d0 msgr2=0x1e614700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 -- 172.21.15.50:0/909158065 shutdown_connections 2024-09-13T15:12:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 -- 172.21.15.50:0/909158065 wait complete. 2024-09-13T15:12:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.719+0000 7f16f3320740 1 -- start start 2024-09-13T15:12:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 Processor -- start 2024-09-13T15:12:19.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e6c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e67fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e67ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e677c00 con 0x1e63ee90 2024-09-13T15:12:19.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e61a750 con 0x1e660b50 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e61a4b0 con 0x1e660230 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 10 client.0 _ll_register_callbacks cb 0x1e532ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e6c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e6c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36420/0 (socket says 172.21.15.50:36420) 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 -- 172.21.15.50:0/1878903549 learned_addr learned my addr 172.21.15.50:0/1878903549 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e67fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ee000700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e67ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 -- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 msgr2=0x1e67fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e67fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 -- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 msgr2=0x1e67ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e67ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 -- 172.21.15.50:0/1878903549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e3f3960 con 0x1e63ee90 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e67fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ce000700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ed600700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e6c3fc0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0011e0 tx=0x7f16dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31955e43c46ac1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ce000700 1 -- 172.21.15.50:0/1878903549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc034dd0 con 0x1e63ee90 2024-09-13T15:12:19.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16ce000700 1 -- 172.21.15.50:0/1878903549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f16dc01b050 con 0x1e63ee90 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.723+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16dc006420 con 0x1e63ee90 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 1 -- 172.21.15.50:0/1878903549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16dc0342a0 con 0x1e63ee90 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 10 client.7701 fetch_fsmap learned FSMap version 64 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x1e521720 con 0x1e63ee90 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 1 -- 172.21.15.50:0/1878903549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc006420 con 0x1e63ee90 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 1 -- 172.21.15.50:0/1878903549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 64) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f16dc012070 con 0x1e63ee90 2024-09-13T15:12:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 10 client.7701 fetch_fsmap finished waiting for FSMap version 64 2024-09-13T15:12:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 10 client.7701 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:12:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 20 client.7701 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e6804f0 0x1e6808d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 4 client.7701 mds_command: new command op to 7650 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:12:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 --> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1e4241e0 con 0x1e6804f0 2024-09-13T15:12:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e6804f0 0x1e6808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ecc00700 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e6804f0 0x1e6808d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb88457ed131071 server_cookie=b2c460afaa4085ca in_seq=0 out_seq=0 2024-09-13T15:12:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 10 client.7701 ms_handle_connect on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 1 -- 172.21.15.50:0/1878903549 <== mds.0 v2:172.21.15.50:6833/359103955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x1e4241e0 con 0x1e6804f0 2024-09-13T15:12:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 10 client.7701 handle_command_reply: tid=0 2024-09-13T15:12:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 client.7701 shutdown 2024-09-13T15:12:19.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 msgr2=0x1e6c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e6c3fc0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0011e0 tx=0x7f16dc000ed0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 shutdown_connections 2024-09-13T15:12:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0x1e6804f0 0x1e6808d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x1e660b50 0x1e67ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x1e660230 0x1e67fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 --2- 172.21.15.50:0/1878903549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e63ee90 0x1e6c3fc0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 >> 172.21.15.50:0/1878903549 conn(0x1e3a84d0 msgr2=0x1e63d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16ce000700 0 client.7701 ms_handle_reset on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 shutdown_connections 2024-09-13T15:12:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.727+0000 7f16f3320740 1 -- 172.21.15.50:0/1878903549 wait complete. 2024-09-13T15:12:19.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16f3320740 20 client.7701 trim_cache size 0 max 16384 2024-09-13T15:12:19.744 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7650, 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 3.891281953, 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 64, 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 105, 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 105, 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 4.8615886289999999 2024-09-13T15:12:19.745 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f16c8066730 msgr2=0x7f16c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f16c8066730 0x7f16c8068bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f16dc007fd0 tx=0x7f16dc007de0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 msgr2=0x7f16e81f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 0x7f16e81f29f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c500 tx=0x7f16d400c810 comp rx=0 tx=0).stop 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 shutdown_connections 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f16c8066730 0x7f16c8068bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f16e8156df0 0x7f16e80adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e8071370 0x7f16e81f29f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 --2- 172.21.15.50:0/1144204068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16e8070f10 0x7f16e8151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 >> 172.21.15.50:0/1144204068 conn(0x7f16e80b0f40 msgr2=0x7f16e80afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 shutdown_connections 2024-09-13T15:12:19.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.731+0000 7f16eea00700 1 -- 172.21.15.50:0/1144204068 wait complete. 2024-09-13T15:12:19.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:12:19.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 Processor -- start 2024-09-13T15:12:19.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 -- start start 2024-09-13T15:12:19.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1764143db0 0x7f176406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17640b4f50 0x7f176415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176406f210 con 0x7f176406edd0 2024-09-13T15:12:19.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640b5380 con 0x7f17640b4f50 2024-09-13T15:12:19.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1769400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1764144190 con 0x7f1764143db0 2024-09-13T15:12:19.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1763400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f176406edd0 0x7f17640b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56066/0 (socket says 172.21.15.50:56066) 2024-09-13T15:12:19.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.935+0000 7f1763400700 1 -- 172.21.15.50:0/2468137790 learned_addr learned my addr 172.21.15.50:0/2468137790 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:19.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1768a00700 1 --2- 172.21.15.50:0/2468137790 >> v2:172.21.15.50:3300/0 conn(0x7f17640b4f50 0x7f176415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1763e00700 1 --2- 172.21.15.50:0/2468137790 >> v2:172.21.15.181:3300/0 conn(0x7f1764143db0 0x7f176406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1762a00700 1 -- 172.21.15.50:0/2468137790 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190075258 0 0) 0x7f176406f210 con 0x7f176406edd0 2024-09-13T15:12:19.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1762a00700 1 -- 172.21.15.50:0/2468137790 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17480035d0 con 0x7f176406edd0 2024-09-13T15:12:19.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1768a00700 1 -- 172.21.15.50:0/2468137790 >> v2:172.21.15.181:3300/0 conn(0x7f1764143db0 msgr2=0x7f176406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1768a00700 1 --2- 172.21.15.50:0/2468137790 >> v2:172.21.15.181:3300/0 conn(0x7f1764143db0 0x7f176406e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1768a00700 1 -- 172.21.15.50:0/2468137790 >> v1:172.21.15.50:6789/0 conn(0x7f176406edd0 legacy=0x7f17640b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1768a00700 1 -- 172.21.15.50:0/2468137790 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640b55e0 con 0x7f17640b4f50 2024-09-13T15:12:19.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1768a00700 1 --2- 172.21.15.50:0/2468137790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17640b4f50 0x7f176415b5e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f176406bb10 tx=0x7f175c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e73814e88c6e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1762a00700 1 -- 172.21.15.50:0/2468137790 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00e070 con 0x7f17640b4f50 2024-09-13T15:12:19.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1762a00700 1 -- 172.21.15.50:0/2468137790 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c00bb20 con 0x7f17640b4f50 2024-09-13T15:12:19.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1762a00700 1 -- 172.21.15.50:0/2468137790 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00be90 con 0x7f17640b4f50 2024-09-13T15:12:19.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 -- 172.21.15.50:0/2468137790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17640b4f50 msgr2=0x7f176415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 --2- 172.21.15.50:0/2468137790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17640b4f50 0x7f176415b5e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f176406bb10 tx=0x7f175c00b330 comp rx=0 tx=0).stop 2024-09-13T15:12:19.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 -- 172.21.15.50:0/2468137790 shutdown_connections 2024-09-13T15:12:19.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 --2- 172.21.15.50:0/2468137790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17640b4f50 0x7f176415b5e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 --2- 172.21.15.50:0/2468137790 >> v2:172.21.15.181:3300/0 conn(0x7f1764143db0 0x7f176406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 -- 172.21.15.50:0/2468137790 >> 172.21.15.50:0/2468137790 conn(0x7f1764071d80 msgr2=0x7f1764072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 -- 172.21.15.50:0/2468137790 shutdown_connections 2024-09-13T15:12:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.939+0000 7f1769400700 1 -- 172.21.15.50:0/2468137790 wait complete. 2024-09-13T15:12:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 Processor -- start 2024-09-13T15:12:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 -- start start 2024-09-13T15:12:19.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176406edd0 0x7f17640d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17640b4f50 0x7f17641f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 0x7f1764157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640cffc0 con 0x7f1764143db0 2024-09-13T15:12:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640b19b0 con 0x7f176406edd0 2024-09-13T15:12:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1769400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17641f7450 con 0x7f17640b4f50 2024-09-13T15:12:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.943+0000 7f1768a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 0x7f1764157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 0x7f1764157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36436/0 (socket says 172.21.15.50:36436) 2024-09-13T15:12:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 -- 172.21.15.50:0/3652026643 learned_addr learned my addr 172.21.15.50:0/3652026643 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1763e00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176406edd0 0x7f17640d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1763400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17640b4f50 0x7f17641f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 -- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17640b4f50 msgr2=0x7f17641f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17640b4f50 0x7f17641f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 -- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176406edd0 msgr2=0x7f17640d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176406edd0 0x7f17640d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 -- 172.21.15.50:0/3652026643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009a70 con 0x7f1764143db0 2024-09-13T15:12:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1763400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17640b4f50 0x7f17641f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1768a00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 0x7f1764157ea0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f175c014040 tx=0x7f175c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c004930 con 0x7f1764143db0 2024-09-13T15:12:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c020070 con 0x7f1764143db0 2024-09-13T15:12:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0276c0 con 0x7f1764143db0 2024-09-13T15:12:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17640b2d00 con 0x7f1764143db0 2024-09-13T15:12:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17640b1640 con 0x7f1764143db0 2024-09-13T15:12:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.947+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17640b1b40 con 0x7f1764143db0 2024-09-13T15:12:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.951+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f175c012430 con 0x7f1764143db0 2024-09-13T15:12:19.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.951+0000 7f175be00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1744066730 0x7f1744068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.951+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f175c022070 con 0x7f1764143db0 2024-09-13T15:12:19.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.951+0000 7f1763e00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1744066730 0x7f1744068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.955+0000 7f1763e00700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1744066730 0x7f1744068bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1754009b50 tx=0x7f1754009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:19.959+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f175c0530a0 con 0x7f1764143db0 2024-09-13T15:12:20.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.187+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f176406e890 con 0x7f1764143db0 2024-09-13T15:12:20.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.187+0000 7f175be00700 1 -- 172.21.15.50:0/3652026643 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7f175c02c020 con 0x7f1764143db0 2024-09-13T15:12:20.192 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:12:20.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1744066730 msgr2=0x7f1744068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1744066730 0x7f1744068bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1754009b50 tx=0x7f1754009240 comp rx=0 tx=0).stop 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 msgr2=0x7f1764157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 0x7f1764157ea0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f175c014040 tx=0x7f175c004af0 comp rx=0 tx=0).stop 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 shutdown_connections 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1744066730 0x7f1744068bf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1764143db0 0x7f1764157ea0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17640b4f50 0x7f17641f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 --2- 172.21.15.50:0/3652026643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176406edd0 0x7f17640d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 >> 172.21.15.50:0/3652026643 conn(0x7f1764071d80 msgr2=0x7f176406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 shutdown_connections 2024-09-13T15:12:20.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:20.191+0000 7f1769400700 1 -- 172.21.15.50:0/3652026643 wait complete. 2024-09-13T15:12:20.219 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:12:20.219 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:12:20.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-13T15:12:20.221 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:12:20.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:20.221 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:12:20.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:12:20.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:12:20.221 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:12:20.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.221 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-13T15:12:20.240 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:12:20.240 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:12:20.241 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42167sec preferred_lft 42167sec 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-13T15:12:20.242 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:7a:cb:b3:80 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f3:dfff:fe3d:e5b9/64 scope link 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ce:da:8e:29:20:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:12:20.243 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ccda:8eff:fe29:2028/64 scope link 2024-09-13T15:12:20.244 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.244 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:20.244 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 46:cf:be:10:c2:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:12:20.244 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::44cf:beff:fe10:c291/64 scope link 2024-09-13T15:12:20.244 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:20.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.245 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:12:20.327 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-13T15:12:20.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.330 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-13T15:12:20.396 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-13T15:12:20.396 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:12:20.396 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:12:20.396 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:12:20.396 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:12:20.397 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:12:20.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.397 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2024-09-13T15:12:20.398 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-13T15:12:20.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:12:20.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:12:20.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:12:20.398 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-13T15:12:20.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.531 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:12:20.548 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:12:20.548 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:12:20.549 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:12:20.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-13T15:12:20.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:20.627 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:20.687 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:12:20.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:20.688 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:20.749 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T15:12:20.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:20.845 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-13T15:12:20.839+0000 7fb3a9a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:12:20.891 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:20.892 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:20.921 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:20.921 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:20.921 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:12:20.921 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:12:20.921 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:12:20.930 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:12:20.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:20.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:21.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.007 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:12:21.076 INFO:teuthology.orchestra.run.smithi050.stdout:client7713 2024-09-13T15:12:21.076 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:21.076 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:21.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:12:21.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.347+0000 7f9e03200700 1 Processor -- start 2024-09-13T15:12:21.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.347+0000 7f9e03200700 1 -- start start 2024-09-13T15:12:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e03200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e04072450 0x7f9e040cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e03200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e040cdb10 0x7f9e040b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e03200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e040cee70 con 0x7f9e0415ca30 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e03200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040b3970 con 0x7f9e04072450 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e03200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040cdfc0 con 0x7f9e040cdb10 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e04072450 0x7f9e040cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e04072450 0x7f9e040cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36448/0 (socket says 172.21.15.50:36448) 2024-09-13T15:12:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 -- 172.21.15.50:0/1965136951 learned_addr learned my addr 172.21.15.50:0/1965136951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:21.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e02800700 1 --2- 172.21.15.50:0/1965136951 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e040cdb10 0x7f9e040b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:21.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 -- 172.21.15.50:0/1965136951 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e040cdb10 msgr2=0x7f9e040b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:21.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 --2- 172.21.15.50:0/1965136951 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e040cdb10 0x7f9e040b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 -- 172.21.15.50:0/1965136951 >> v1:172.21.15.181:6789/0 conn(0x7f9e0415ca30 legacy=0x7f9e04071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:21.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.351+0000 7f9e01400700 1 -- 172.21.15.50:0/1965136951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040ce260 con 0x7f9e04072450 2024-09-13T15:12:21.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e01400700 1 --2- 172.21.15.50:0/1965136951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e04072450 0x7f9e040cf300 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009910 tx=0x7f9df0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f723d448c88a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:21.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e00a00700 1 -- 172.21.15.50:0/1965136951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df000ba60 con 0x7f9e04072450 2024-09-13T15:12:21.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e00a00700 1 -- 172.21.15.50:0/1965136951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df000bbc0 con 0x7f9e04072450 2024-09-13T15:12:21.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e00a00700 1 -- 172.21.15.50:0/1965136951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0009e60 con 0x7f9e04072450 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 -- 172.21.15.50:0/1965136951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e04072450 msgr2=0x7f9e040cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 --2- 172.21.15.50:0/1965136951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e04072450 0x7f9e040cf300 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009910 tx=0x7f9df0009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 -- 172.21.15.50:0/1965136951 shutdown_connections 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 --2- 172.21.15.50:0/1965136951 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e040cdb10 0x7f9e040b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 --2- 172.21.15.50:0/1965136951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e04072450 0x7f9e040cf300 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 -- 172.21.15.50:0/1965136951 >> 172.21.15.50:0/1965136951 conn(0x7f9e040b1770 msgr2=0x7f9e040b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 -- 172.21.15.50:0/1965136951 shutdown_connections 2024-09-13T15:12:21.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 -- 172.21.15.50:0/1965136951 wait complete. 2024-09-13T15:12:21.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 Processor -- start 2024-09-13T15:12:21.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.355+0000 7f9e03200700 1 -- start start 2024-09-13T15:12:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e04072450 0x7f9e04146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e040cdb10 0x7f9e0406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 0x7f9e0406d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040acf40 con 0x7f9e0415ca30 2024-09-13T15:12:21.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040ad150 con 0x7f9e040cdb10 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040ad430 con 0x7f9e04072450 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 0x7f9e0406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 0x7f9e0406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36450/0 (socket says 172.21.15.50:36450) 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 -- 172.21.15.50:0/3090756639 learned_addr learned my addr 172.21.15.50:0/3090756639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e01400700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e040cdb10 0x7f9e0406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e01e00700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e04072450 0x7f9e04146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 -- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e04072450 msgr2=0x7f9e04146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e04072450 0x7f9e04146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 -- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e040cdb10 msgr2=0x7f9e0406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:21.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e040cdb10 0x7f9e0406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 -- 172.21.15.50:0/3090756639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0009570 con 0x7f9e0415ca30 2024-09-13T15:12:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e02800700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 0x7f9e0406d170 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc007e40 tx=0x7f9dfc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00ed30 con 0x7f9e0415ca30 2024-09-13T15:12:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc014420 con 0x7f9e0415ca30 2024-09-13T15:12:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0147d0 con 0x7f9e0415ca30 2024-09-13T15:12:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e040ad710 con 0x7f9e0415ca30 2024-09-13T15:12:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.359+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0406bff0 con 0x7f9e0415ca30 2024-09-13T15:12:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.363+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040adc30 con 0x7f9e0415ca30 2024-09-13T15:12:21.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.363+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9dfc014930 con 0x7f9e0415ca30 2024-09-13T15:12:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.367+0000 7f9dfa000700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9de4066730 0x7f9de4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.367+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f9dfc084b90 con 0x7f9e0415ca30 2024-09-13T15:12:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.367+0000 7f9e01e00700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9de4066730 0x7f9de4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.367+0000 7f9e01e00700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9de4066730 0x7f9de4068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9e041584d0 tx=0x7f9df4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.371+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9dfc051b80 con 0x7f9e0415ca30 2024-09-13T15:12:21.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.607+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e040cf300 con 0x7f9e0415ca30 2024-09-13T15:12:21.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.607+0000 7f9dfa000700 1 -- 172.21.15.50:0/3090756639 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9dfc0551a0 con 0x7f9e0415ca30 2024-09-13T15:12:21.614 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:12:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9de4066730 msgr2=0x7f9de4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9de4066730 0x7f9de4068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9e041584d0 tx=0x7f9df4009040 comp rx=0 tx=0).stop 2024-09-13T15:12:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 msgr2=0x7f9e0406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 0x7f9e0406d170 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc007e40 tx=0x7f9dfc00e3c0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 shutdown_connections 2024-09-13T15:12:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f9de4066730 0x7f9de4068bf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e0415ca30 0x7f9e0406d170 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e040cdb10 0x7f9e0406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 --2- 172.21.15.50:0/3090756639 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9e04072450 0x7f9e04146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 >> 172.21.15.50:0/3090756639 conn(0x7f9e040b1770 msgr2=0x7f9e040b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 shutdown_connections 2024-09-13T15:12:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:21.611+0000 7f9e03200700 1 -- 172.21.15.50:0/3090756639 wait complete. 2024-09-13T15:12:21.638 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:12:21.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi181.front.sepia.ceph.com 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:12:21.641 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:12:21.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.641 DEBUG:teuthology.orchestra.run.smithi181:> ip addr 2024-09-13T15:12:21.662 INFO:teuthology.orchestra.run.smithi181.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:12:21.662 INFO:teuthology.orchestra.run.smithi181.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 ::1/128 scope host 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f0 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:d9:39:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: altname enp7s0f1 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9c brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:12:21.663 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 0c:c4:7a:88:7b:9d brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.21.15.181/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft 42155sec preferred_lft 42155sec 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::ec4:7aff:fe88:7b9d/64 scope link 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:42:2c:7a:1e:c3 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.664 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::c0be:bbff:fe76:6228/64 scope link 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether d6:eb:19:d3:05:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::d4eb:19ff:fed3:5fd/64 scope link 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: link/ether 02:6a:be:ce:0a:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: inet6 fe80::6a:beff:fece:a61/64 scope link 2024-09-13T15:12:21.665 INFO:teuthology.orchestra.run.smithi181.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:12:21.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.666 DEBUG:teuthology.orchestra.run.smithi181:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:12:21.743 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-13T15:12:21.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.747 DEBUG:teuthology.orchestra.run.smithi181:> route 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:Kernel IP routing table 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run.smithi181.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:12:21.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.812 DEBUG:teuthology.orchestra.run.smithi181:> (cd / && exec bash -c ' 2024-09-13T15:12:21.812 DEBUG:teuthology.orchestra.run.smithi181:> set -e 2024-09-13T15:12:21.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T15:12:21.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T15:12:21.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T15:12:21.812 DEBUG:teuthology.orchestra.run.smithi181:> ') 2024-09-13T15:12:21.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.938 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:12:21.952 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:12:21.952 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:12:21.953 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:12:21.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:21.953 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link set brx.0 up 2024-09-13T15:12:22.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:22.030 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:22.093 INFO:teuthology.orchestra.run.smithi181.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:12:22.093 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:12:22.093 DEBUG:teuthology.orchestra.run.smithi181:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:22.150 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T15:12:22.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:22.151 DEBUG:teuthology.orchestra.run.smithi181:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:22.279 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:22.279 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:22.307 INFO:teuthology.orchestra.run.smithi181.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T15:12:22.307 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T15:12:22.307 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.181:3300,172.21.15.181:3301" 2024-09-13T15:12:22.307 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: trying mount with new device syntax: 1@73923987-4656-4194-a4fe-9d4ec875d2d3.cephfs=/ 2024-09-13T15:12:22.307 INFO:teuthology.orchestra.run.smithi181.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.181:3300/172.21.15.181:3301" will pass to kernel 2024-09-13T15:12:22.313 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:12:22.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:22.314 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:22.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:22.342 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:12:22.413 INFO:teuthology.orchestra.run.smithi181.stdout:client7591 2024-09-13T15:12:22.414 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:22.414 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:22.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T15:12:22.672 INFO:teuthology.orchestra.run.smithi050.stdout:[{"id":7591,"entity":{"name":{"type":"client","num":7591},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3892694958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":2,"uptime":0.35599161600000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99919629135197197,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7591 192.168.0.1:0/3892694958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi181","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}},{"id":7713,"entity":{"name":{"type":"client","num":7713},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2959632825}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":2,"uptime":1.74395893,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.9959971157507671,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7713 192.168.0.1:0/2959632825","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi050","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}}] 2024-09-13T15:12:22.673 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "1", "hostname": "smithi181", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3892694958, "type": "any" }, "name": { "num": 7591, "type": "client" } }, "id": 7591, "inst": "client.7591 192.168.0.1:0/3892694958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.999196291351972 }, "state": "open", "uptime": 0.355991616 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "0", "hostname": "smithi050", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2959632825, "type": "any" }, "name": { "num": 7713, "type": "client" } }, "id": 7713, "inst": "client.7713 192.168.0.1:0/2959632825", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9959971157507671 }, "state": "open", "uptime": 1.74395893 } ] 2024-09-13T15:12:22.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-13T15:12:22.883 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2024-09-13T15:12:22.899 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T15:12:22.899 DEBUG:teuthology.orchestra.run.smithi050:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-13T15:12:22.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 -- start start 2024-09-13T15:12:22.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 Processor -- start 2024-09-13T15:12:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef037800 0x55d4ef0dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef037400 0x55d4ef0dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 0x55d4ef0dd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8780 con 0x55d4ef037000 2024-09-13T15:12:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8a00 con 0x55d4ef037400 2024-09-13T15:12:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f2e85500 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8640 con 0x55d4ef037800 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f1a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 0x55d4ef0dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f1a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 0x55d4ef0dd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36460/0 (socket says 172.21.15.50:36460) 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.955+0000 7f58f1a00700 1 -- 172.21.15.50:0/3972651362 learned_addr learned my addr 172.21.15.50:0/3972651362 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f0600700 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef037400 0x55d4ef0dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1000700 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef037800 0x55d4ef0dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1a00700 1 -- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef037800 msgr2=0x55d4ef0dc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1a00700 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef037800 0x55d4ef0dc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1a00700 1 -- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef037400 msgr2=0x55d4ef0dcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1a00700 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef037400 0x55d4ef0dcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1a00700 1 -- 172.21.15.50:0/3972651362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ef05a9c0 con 0x55d4ef037000 2024-09-13T15:12:22.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f0600700 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef037400 0x55d4ef0dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:22.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f1a00700 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 0x55d4ef0dd080 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x55d4efe12d50 tx=0x55d4ef10d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2858eb752cc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58ede00700 1 -- 172.21.15.50:0/3972651362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ef087080 con 0x55d4ef037000 2024-09-13T15:12:22.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58ede00700 1 -- 172.21.15.50:0/3972651362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4ef082180 con 0x55d4ef037000 2024-09-13T15:12:22.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58ede00700 1 -- 172.21.15.50:0/3972651362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ef087600 con 0x55d4ef037000 2024-09-13T15:12:22.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ef05a1a0 con 0x55d4ef037000 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d4ef05a9c0 con 0x55d4ef037000 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 4 waiting for MDS map... 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58ede00700 1 -- 172.21.15.50:0/3972651362 <== mon.0 v2:172.21.15.50:3300/0 4 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x55d4ef070c40 con 0x55d4ef037000 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58ede00700 1 -- 172.21.15.50:0/3972651362 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 64) v1 ==== 3114+0+0 (secure 0 0 0) 0x55d4ef078f00 con 0x55d4ef037000 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 4 Got MDS map 64 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 10 main: main 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 4 main: connecting to RADOS... 2024-09-13T15:12:22.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 1 Processor -- start 2024-09-13T15:12:22.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.959+0000 7f58f2e85500 1 -- start start 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 0x55d4ef0ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328c00 0x55d4ef0de100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef06de00 con 0x55d4ef328800 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8a00 con 0x55d4ef328400 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8780 con 0x55d4ef328c00 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 0x55d4ef0ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 0x55d4ef0ddb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36462/0 (socket says 172.21.15.50:36462) 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 -- 172.21.15.50:0/4137195400 learned_addr learned my addr 172.21.15.50:0/4137195400 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f0600700 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f0600700 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328c00 0x55d4ef0de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 -- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328c00 msgr2=0x55d4ef0de100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328c00 0x55d4ef0de100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 -- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 msgr2=0x55d4ef0dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0dd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 -- 172.21.15.50:0/4137195400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ef05ab60 con 0x55d4ef328800 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f0600700 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328c00 0x55d4ef0de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f1000700 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 0x55d4ef0ddb80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x55d4efe102a0 tx=0x55d4ef340d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57794a985a66c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58eb600700 1 -- 172.21.15.50:0/4137195400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ef087080 con 0x55d4ef328800 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58eb600700 1 -- 172.21.15.50:0/4137195400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4ef082480 con 0x55d4ef328800 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58eb600700 1 -- 172.21.15.50:0/4137195400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ef087600 con 0x55d4ef328800 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- 172.21.15.50:0/4137195400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 msgr2=0x55d4ef0ddb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 0x55d4ef0ddb80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x55d4efe102a0 tx=0x55d4ef340d20 comp rx=0 tx=0).stop 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- 172.21.15.50:0/4137195400 shutdown_connections 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328c00 0x55d4ef0de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328800 0x55d4ef0ddb80 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 --2- 172.21.15.50:0/4137195400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- 172.21.15.50:0/4137195400 >> 172.21.15.50:0/4137195400 conn(0x55d4ef036c00 msgr2=0x55d4ef105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- 172.21.15.50:0/4137195400 shutdown_connections 2024-09-13T15:12:22.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.963+0000 7f58f2e85500 1 -- 172.21.15.50:0/4137195400 wait complete. 2024-09-13T15:12:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 Processor -- start 2024-09-13T15:12:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 -- start start 2024-09-13T15:12:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0df180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328800 0x55d4ef0dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328c00 0x55d4ef0de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8500 con 0x55d4ef328c00 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b83c0 con 0x55d4ef328400 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f2e85500 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ef0b8280 con 0x55d4ef328800 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328c00 0x55d4ef0de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328c00 0x55d4ef0de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36470/0 (socket says 172.21.15.50:36470) 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 learned_addr learned my addr 172.21.15.50:0/3500820349 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:22.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f1000700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328800 0x55d4ef0dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328800 msgr2=0x55d4ef0dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef328800 0x55d4ef0dec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 msgr2=0x55d4ef0df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef328400 0x55d4ef0df180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ef05a340 con 0x55d4ef328c00 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.967+0000 7f58f0600700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328c00 0x55d4ef0de680 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x55d4efe10f90 tx=0x55d4ef10d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58e9800700 1 -- 172.21.15.50:0/3500820349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ef087080 con 0x55d4ef328c00 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58e9800700 1 -- 172.21.15.50:0/3500820349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4ef082180 con 0x55d4ef328c00 2024-09-13T15:12:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4ef05a000 con 0x55d4ef328c00 2024-09-13T15:12:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58e9800700 1 -- 172.21.15.50:0/3500820349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ef087600 con 0x55d4ef328c00 2024-09-13T15:12:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ef05aea0 con 0x55d4ef328c00 2024-09-13T15:12:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58f2e85500 4 main: resolving pool 15 2024-09-13T15:12:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.971+0000 7f58e9800700 1 -- 172.21.15.50:0/3500820349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55d4ef096840 con 0x55d4ef328c00 2024-09-13T15:12:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58e9800700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x55d4ef488000 0x55d4ef0df700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58e9800700 1 -- 172.21.15.50:0/3500820349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x55d4ef070a80 con 0x55d4ef328c00 2024-09-13T15:12:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f2e85500 4 main: creating IoCtx.. 2024-09-13T15:12:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x55d4ef329000 0x55d4ef0de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- osd_op(unknown.0.0:1 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) v8 -- 0x55d4ef329400 con 0x55d4ef329000 2024-09-13T15:12:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f1000700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x55d4ef488000 0x55d4ef0df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f0600700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x55d4ef329000 0x55d4ef0de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f0600700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x55d4ef329000 0x55d4ef0de100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f1000700 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x55d4ef488000 0x55d4ef0df700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55d4efe102a0 tx=0x55d4efe34cc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 <== osd.2 v2:172.21.15.50:6809/1292655960 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x55d4efe26b40 con 0x55d4ef329000 2024-09-13T15:12:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- osd_op(unknown.0.0:2 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) v8 -- 0x55d4ef329800 con 0x55d4ef329000 2024-09-13T15:12:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 <== osd.2 v2:172.21.15.50:6809/1292655960 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=477b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+477 (crc 0 0 0) 0x55d4efe26b40 con 0x55d4ef329000 2024-09-13T15:12:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- osd_op(unknown.0.0:3 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) v8 -- 0x55d4ef488400 con 0x55d4ef329000 2024-09-13T15:12:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.975+0000 7f58f0600700 1 -- 172.21.15.50:0/3500820349 <== osd.2 v2:172.21.15.50:6809/1292655960 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x55d4efe26b40 con 0x55d4ef329000 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "0": { 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "data": { 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions": [ 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7713, 2024-09-13T15:12:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": { 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 7713 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "any", 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2959632825 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "open", 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "num_leases": 0, 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "num_caps": 0, 2024-09-13T15:12:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "request_load_avg": 0, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 0.0039999060000000001, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "requests_in_flight": 0, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "num_completed_requests": 0, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "num_completed_flushes": 0, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "reconnecting": false, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "recall_caps": { 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 60 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "release_caps": { 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 60 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "recall_caps_throttle": { 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 1.5 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "recall_caps_throttle2o": { 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 0.5 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "session_cache_liveness": { 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 300 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition": { 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 30 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "last_trim_completed_requests_tid": 0, 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "delegated_inos": [], 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": "client.7713 192.168.0.1:0/2959632825", 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "completed_requests": [], 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "prealloc_inos": [], 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "client_metadata": { 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "client_features": { 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "feature_bits": "0x000000000037fbff" 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.986 INFO:teuthology.orchestra.run.smithi050.stdout: "metric_spec": { 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "metric_flags": { 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "feature_bits": "0x000000000080ffff" 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7591, 2024-09-13T15:12:22.987 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": { 2024-09-13T15:12:22.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-09-13T15:12:22.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-09-13T15:12:22.988 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 7591 2024-09-13T15:12:22.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.988 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-09-13T15:12:22.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "any", 2024-09-13T15:12:22.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:12:22.989 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3892694958 2024-09-13T15:12:22.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "open", 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "num_leases": 0, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "num_caps": 0, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "request_load_avg": 0, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 0.0039999060000000001, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "requests_in_flight": 0, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "num_completed_requests": 0, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "num_completed_flushes": 0, 2024-09-13T15:12:22.990 INFO:teuthology.orchestra.run.smithi050.stdout: "reconnecting": false, 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "recall_caps": { 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 60 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "release_caps": { 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 60 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "recall_caps_throttle": { 2024-09-13T15:12:22.991 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 1.5 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "recall_caps_throttle2o": { 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 0.5 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "session_cache_liveness": { 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 300 2024-09-13T15:12:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition": { 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "value": 0, 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "halflife": 30 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "last_trim_completed_requests_tid": 0, 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "delegated_inos": [], 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": "client.7591 192.168.0.1:0/3892694958", 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "completed_requests": [], 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "prealloc_inos": [], 2024-09-13T15:12:22.993 INFO:teuthology.orchestra.run.smithi050.stdout: "client_metadata": { 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client_features": { 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "feature_bits": "0x000000000037fbff" 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "metric_spec": { 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "metric_flags": { 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "feature_bits": "0x000000000080ffff" 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "1", 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi181", 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-09-13T15:12:22.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout: "result": 0 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:22.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x55d4ef329000 msgr2=0x55d4ef0de100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x55d4ef329000 0x55d4ef0de100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x55d4ef488000 msgr2=0x55d4ef0df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x55d4ef488000 0x55d4ef0df700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55d4efe102a0 tx=0x55d4efe34cc0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328c00 msgr2=0x55d4ef0de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3500820349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef328c00 0x55d4ef0de680 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x55d4efe10f90 tx=0x55d4ef10d260 comp rx=0 tx=0).stop 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f1000700 1 -- 172.21.15.50:0/3500820349 reap_dead start 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 shutdown_connections 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 >> 172.21.15.50:0/3500820349 conn(0x55d4ef036c00 msgr2=0x55d4ef105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 shutdown_connections 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3500820349 wait complete. 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 msgr2=0x55d4ef0dd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 0x55d4ef0dd080 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x55d4efe12d50 tx=0x55d4ef10d5c0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 shutdown_connections 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4ef037000 0x55d4ef0dd080 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d4ef037400 0x55d4ef0dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 --2- 172.21.15.50:0/3972651362 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55d4ef037800 0x55d4ef0dc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 >> 172.21.15.50:0/3972651362 conn(0x55d4ef037c00 msgr2=0x55d4ef105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 shutdown_connections 2024-09-13T15:12:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:22.979+0000 7f58f2e85500 1 -- 172.21.15.50:0/3972651362 wait complete. 2024-09-13T15:12:23.000 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.100620, result: { "0": { "data": { "sessions": [ { "id": 7713, "entity": { "name": { "type": "client", "num": 7713 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 2959632825 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.0039999060000000001, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7713 192.168.0.1:0/2959632825", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi050", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } }, { "id": 7591, "entity": { "name": { "type": "client", "num": 7591 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3892694958 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.0039999060000000001, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7591 192.168.0.1:0/3892694958", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi181", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } } ] }, "result": 0 } } 2024-09-13T15:12:23.000 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 7713, "entity": { "name": { "type": "client", "num": 7713 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 2959632825 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.003999906, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7713 192.168.0.1:0/2959632825", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi050", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } }, { "id": 7591, "entity": { "name": { "type": "client", "num": 7591 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3892694958 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.003999906, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7591 192.168.0.1:0/3892694958", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi181", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } } ] }, "result": 0 } } 2024-09-13T15:12:23.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:23.000 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2024-09-13T15:12:23.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:23.030 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2024-09-13T15:12:23.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:23.101 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2024-09-13T15:12:23.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-13T15:12:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.323+0000 7f172ae00700 1 Processor -- start 2024-09-13T15:12:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.323+0000 7f172ae00700 1 -- start start 2024-09-13T15:12:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172ae00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1724146120 0x7f17240c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172ae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 0x7f1724071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172ae00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17240722e0 0x7f17240d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172ae00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1724072750 con 0x7f17240722e0 2024-09-13T15:12:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172ae00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240cbb40 con 0x7f1724146120 2024-09-13T15:12:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172ae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240b4b30 con 0x7f17240b5b10 2024-09-13T15:12:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172a400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17240722e0 0x7f17240d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f1729000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 0x7f1724071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f1729000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 0x7f1724071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38070/0 (socket says 172.21.15.50:38070) 2024-09-13T15:12:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f1729000700 1 -- 172.21.15.50:0/550975929 learned_addr learned my addr 172.21.15.50:0/550975929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f1729a00700 1 --2- 172.21.15.50:0/550975929 >> v2:172.21.15.181:3300/0 conn(0x7f1724146120 0x7f17240c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172a400700 1 -- 172.21.15.50:0/550975929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 msgr2=0x7f1724071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172a400700 1 --2- 172.21.15.50:0/550975929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 0x7f1724071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172a400700 1 -- 172.21.15.50:0/550975929 >> v2:172.21.15.181:3300/0 conn(0x7f1724146120 msgr2=0x7f17240c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172a400700 1 --2- 172.21.15.50:0/550975929 >> v2:172.21.15.181:3300/0 conn(0x7f1724146120 0x7f17240c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f172a400700 1 -- 172.21.15.50:0/550975929 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240ca4b0 con 0x7f17240722e0 2024-09-13T15:12:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.327+0000 7f1729000700 1 --2- 172.21.15.50:0/550975929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 0x7f1724071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172a400700 1 --2- 172.21.15.50:0/550975929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17240d09f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f17240711a0 tx=0x7f171c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826ce2536b4cfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f1723e00700 1 -- 172.21.15.50:0/550975929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c00e070 con 0x7f17240722e0 2024-09-13T15:12:23.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f1723e00700 1 -- 172.21.15.50:0/550975929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c00bb20 con 0x7f17240722e0 2024-09-13T15:12:23.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f1723e00700 1 -- 172.21.15.50:0/550975929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c012430 con 0x7f17240722e0 2024-09-13T15:12:23.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 -- 172.21.15.50:0/550975929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 msgr2=0x7f17240d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 --2- 172.21.15.50:0/550975929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17240d09f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f17240711a0 tx=0x7f171c00b330 comp rx=0 tx=0).stop 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 -- 172.21.15.50:0/550975929 shutdown_connections 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 --2- 172.21.15.50:0/550975929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17240d09f0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 --2- 172.21.15.50:0/550975929 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f17240b5b10 0x7f1724071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 --2- 172.21.15.50:0/550975929 >> v2:172.21.15.181:3300/0 conn(0x7f1724146120 0x7f17240c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 -- 172.21.15.50:0/550975929 >> 172.21.15.50:0/550975929 conn(0x7f172406a340 msgr2=0x7f172406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 -- 172.21.15.50:0/550975929 shutdown_connections 2024-09-13T15:12:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.331+0000 7f172ae00700 1 -- 172.21.15.50:0/550975929 wait complete. 2024-09-13T15:12:23.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 Processor -- start 2024-09-13T15:12:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 -- start start 2024-09-13T15:12:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17241f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17240b5b10 0x7f1724143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1724146120 0x7f1724143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17241f3640 con 0x7f17240722e0 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172415cdf0 con 0x7f17240b5b10 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172ae00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17241f5dc0 con 0x7f1724146120 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f1729a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17241f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f1729a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17241f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38328/0 (socket says 172.21.15.50:38328) 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f1729a00700 1 -- 172.21.15.50:0/1713046709 learned_addr learned my addr 172.21.15.50:0/1713046709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f1729000700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17240b5b10 0x7f1724143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.335+0000 7f172a400700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1724146120 0x7f1724143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1729a00700 1 -- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1724146120 msgr2=0x7f1724143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1729a00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1724146120 0x7f1724143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1729a00700 1 -- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17240b5b10 msgr2=0x7f1724143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1729a00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17240b5b10 0x7f1724143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1729a00700 1 -- 172.21.15.50:0/1713046709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710009570 con 0x7f17240722e0 2024-09-13T15:12:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1729a00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17241f3100 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f171800e870 tx=0x7f171800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180095a0 con 0x7f17240722e0 2024-09-13T15:12:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718013680 con 0x7f17240722e0 2024-09-13T15:12:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180139f0 con 0x7f17240722e0 2024-09-13T15:12:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c009a70 con 0x7f17240722e0 2024-09-13T15:12:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241f6060 con 0x7f17240722e0 2024-09-13T15:12:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.339+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1724071da0 con 0x7f17240722e0 2024-09-13T15:12:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.343+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1718013b50 con 0x7f17240722e0 2024-09-13T15:12:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.343+0000 7f1721600700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1704066730 0x7f1704068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.343+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f17180841b0 con 0x7f17240722e0 2024-09-13T15:12:23.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.343+0000 7f1729000700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1704066730 0x7f1704068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.347+0000 7f1729000700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1704066730 0x7f1704068bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1724144980 tx=0x7f17100092e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:23.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.351+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1718051230 con 0x7f17240722e0 2024-09-13T15:12:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.575+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f17240cb090 con 0x7f17240722e0 2024-09-13T15:12:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.899+0000 7f1721600700 1 -- 172.21.15.50:0/1713046709 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v65) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1718054850 con 0x7f17240722e0 2024-09-13T15:12:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1704066730 msgr2=0x7f1704068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1704066730 0x7f1704068bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1724144980 tx=0x7f17100092e0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 msgr2=0x7f17241f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17241f3100 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f171800e870 tx=0x7f171800eb80 comp rx=0 tx=0).stop 2024-09-13T15:12:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 shutdown_connections 2024-09-13T15:12:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1704066730 0x7f1704068bf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1724146120 0x7f1724143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17240b5b10 0x7f1724143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 --2- 172.21.15.50:0/1713046709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17240722e0 0x7f17241f3100 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 >> 172.21.15.50:0/1713046709 conn(0x7f172406a340 msgr2=0x7f17240cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 shutdown_connections 2024-09-13T15:12:23.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:23.903+0000 7f172ae00700 1 -- 172.21.15.50:0/1713046709 wait complete. 2024-09-13T15:12:23.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.115+0000 7f5de8e00700 1 Processor -- start 2024-09-13T15:12:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.115+0000 7f5de8e00700 1 -- start start 2024-09-13T15:12:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de41551c0 0x7f5de415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5de415c1a0 0x7f5de406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de415c5e0 con 0x7f5de40b0d10 2024-09-13T15:12:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de415b610 con 0x7f5de415c1a0 2024-09-13T15:12:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415b8f0 con 0x7f5de41551c0 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5de415c1a0 0x7f5de406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de2800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5de40b0d10 0x7f5de406b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47736/0 (socket says 172.21.15.50:47736) 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de2800700 1 -- 172.21.15.50:0/390084481 learned_addr learned my addr 172.21.15.50:0/390084481 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1e00700 1 --2- 172.21.15.50:0/390084481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de41551c0 0x7f5de415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1400700 1 -- 172.21.15.50:0/390084481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de41551c0 msgr2=0x7f5de415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1400700 1 --2- 172.21.15.50:0/390084481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de41551c0 0x7f5de415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1400700 1 -- 172.21.15.50:0/390084481 >> v1:172.21.15.50:6789/0 conn(0x7f5de40b0d10 legacy=0x7f5de406b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1400700 1 -- 172.21.15.50:0/390084481 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de415bbd0 con 0x7f5de415c1a0 2024-09-13T15:12:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de1400700 1 --2- 172.21.15.50:0/390084481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de415c1a0 0x7f5de406d8c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009850 tx=0x7f5dd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4954237fc07dd32b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de0a00700 1 -- 172.21.15.50:0/390084481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0011830 con 0x7f5de415c1a0 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de0a00700 1 -- 172.21.15.50:0/390084481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd0011990 con 0x7f5de415c1a0 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de0a00700 1 -- 172.21.15.50:0/390084481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0011d20 con 0x7f5de415c1a0 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 -- 172.21.15.50:0/390084481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de415c1a0 msgr2=0x7f5de406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 --2- 172.21.15.50:0/390084481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de415c1a0 0x7f5de406d8c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009850 tx=0x7f5dd0009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 -- 172.21.15.50:0/390084481 shutdown_connections 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 --2- 172.21.15.50:0/390084481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de415c1a0 0x7f5de406d8c0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 --2- 172.21.15.50:0/390084481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de41551c0 0x7f5de415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.119+0000 7f5de8e00700 1 -- 172.21.15.50:0/390084481 >> 172.21.15.50:0/390084481 conn(0x7f5de40af8f0 msgr2=0x7f5de40b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 -- 172.21.15.50:0/390084481 shutdown_connections 2024-09-13T15:12:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 -- 172.21.15.50:0/390084481 wait complete. 2024-09-13T15:12:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 Processor -- start 2024-09-13T15:12:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 -- start start 2024-09-13T15:12:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de40b0d10 0x7f5de40cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 0x7f5de4146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de415c1a0 0x7f5de414cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4147140 con 0x7f5de41551c0 2024-09-13T15:12:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4146df0 con 0x7f5de40b0d10 2024-09-13T15:12:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de8e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41f3060 con 0x7f5de415c1a0 2024-09-13T15:12:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 0x7f5de4146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 0x7f5de4146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38342/0 (socket says 172.21.15.50:38342) 2024-09-13T15:12:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.123+0000 7f5de1400700 1 -- 172.21.15.50:0/661900105 learned_addr learned my addr 172.21.15.50:0/661900105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de40b0d10 0x7f5de40cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de2800700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de415c1a0 0x7f5de414cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1400700 1 -- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de415c1a0 msgr2=0x7f5de414cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1400700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de415c1a0 0x7f5de414cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1400700 1 -- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de40b0d10 msgr2=0x7f5de40cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1400700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de40b0d10 0x7f5de40cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1400700 1 -- 172.21.15.50:0/661900105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00094b0 con 0x7f5de41551c0 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de40b0d10 0x7f5de40cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de2800700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de415c1a0 0x7f5de414cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de1400700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 0x7f5de4146640 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0014040 tx=0x7f5dd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00038c0 con 0x7f5de41551c0 2024-09-13T15:12:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd001e070 con 0x7f5de41551c0 2024-09-13T15:12:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0003c60 con 0x7f5de41551c0 2024-09-13T15:12:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de41f3340 con 0x7f5de41551c0 2024-09-13T15:12:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de4146b80 con 0x7f5de41551c0 2024-09-13T15:12:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.127+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de4147280 con 0x7f5de41551c0 2024-09-13T15:12:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.131+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5dd002d450 con 0x7f5de41551c0 2024-09-13T15:12:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.131+0000 7f5dda000700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5dc4066730 0x7f5dc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.131+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f5dd00853f0 con 0x7f5de41551c0 2024-09-13T15:12:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.131+0000 7f5de1e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5dc4066730 0x7f5dc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.131+0000 7f5de1e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5dc4066730 0x7f5dc4068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009a20 tx=0x7f5dd4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.139+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5de4147280 con 0x7f5de41551c0 2024-09-13T15:12:24.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.363+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5de4147280 con 0x7f5de41551c0 2024-09-13T15:12:24.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.363+0000 7f5dda000700 1 -- 172.21.15.50:0/661900105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f5de4147280 con 0x7f5de41551c0 2024-09-13T15:12:24.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:24.368 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:23.903846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7650,"mds_1":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":1,"incarnation":66,"state":"up:creating","state_seq":1,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:24.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5dc4066730 msgr2=0x7f5dc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:24.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5dc4066730 0x7f5dc4068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009a20 tx=0x7f5dd4008040 comp rx=0 tx=0).stop 2024-09-13T15:12:24.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 msgr2=0x7f5de4146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:24.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 0x7f5de4146640 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0014040 tx=0x7f5dd0004770 comp rx=0 tx=0).stop 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 shutdown_connections 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5dc4066730 0x7f5dc4068bf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5de415c1a0 0x7f5de414cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de41551c0 0x7f5de4146640 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 --2- 172.21.15.50:0/661900105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de40b0d10 0x7f5de40cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 >> 172.21.15.50:0/661900105 conn(0x7f5de40af8f0 msgr2=0x7f5de40b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 shutdown_connections 2024-09-13T15:12:24.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:24.367+0000 7f5de8e00700 1 -- 172.21.15.50:0/661900105 wait complete. 2024-09-13T15:12:24.373 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 66 2024-09-13T15:12:24.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:12:00.010021+0000', 'modified': '2024-09-13T15:12:23.903846+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 105, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7650, 'mds_1': 7647}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7647': {'gid': 7647, 'name': 'c', 'rank': 1, 'incarnation': 66, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.50:6834/3584876987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 3584876987}, {'type': 'v1', 'addr': '172.21.15.50:6834', 'nonce': 3584876987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7650': {'gid': 7650, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6835/359103955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 359103955}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 359103955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:12:24.795 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7647:up:creating 2024-09-13T15:12:25.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:25.845 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-13T15:12:25.839+0000 7fb3a9a00700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T15:12:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 Processor -- start 2024-09-13T15:12:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 -- start start 2024-09-13T15:12:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec4071420 0x7f8ec40b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec406d280 0x7f8ec4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec4071d40 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec40b3200 con 0x7f8ec406d280 2024-09-13T15:12:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40b34e0 con 0x7f8ec4071420 2024-09-13T15:12:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec406d280 0x7f8ec4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec406d280 0x7f8ec4071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38346/0 (socket says 172.21.15.50:38346) 2024-09-13T15:12:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 -- 172.21.15.50:0/91604732 learned_addr learned my addr 172.21.15.50:0/91604732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2a00700 1 --2- 172.21.15.50:0/91604732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec4071420 0x7f8ec40b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 -- 172.21.15.50:0/91604732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec4071420 msgr2=0x7f8ec40b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 --2- 172.21.15.50:0/91604732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec4071420 0x7f8ec40b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 -- 172.21.15.50:0/91604732 >> v1:172.21.15.181:6789/0 conn(0x7f8ec40cd6c0 legacy=0x7f8ec40cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.979+0000 7f8ec2000700 1 -- 172.21.15.50:0/91604732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40b37c0 con 0x7f8ec406d280 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec2000700 1 --2- 172.21.15.50:0/91604732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec406d280 0x7f8ec4071800 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009910 tx=0x7f8eb0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cbc6ee41b5fcec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec1600700 1 -- 172.21.15.50:0/91604732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0011830 con 0x7f8ec406d280 2024-09-13T15:12:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec1600700 1 -- 172.21.15.50:0/91604732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb0011990 con 0x7f8ec406d280 2024-09-13T15:12:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec1600700 1 -- 172.21.15.50:0/91604732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0011d40 con 0x7f8ec406d280 2024-09-13T15:12:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 -- 172.21.15.50:0/91604732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec406d280 msgr2=0x7f8ec4071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/91604732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec406d280 0x7f8ec4071800 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009910 tx=0x7f8eb0009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 -- 172.21.15.50:0/91604732 shutdown_connections 2024-09-13T15:12:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/91604732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec406d280 0x7f8ec4071800 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/91604732 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec4071420 0x7f8ec40b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 -- 172.21.15.50:0/91604732 >> 172.21.15.50:0/91604732 conn(0x7f8ec40b0d90 msgr2=0x7f8ec406fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 -- 172.21.15.50:0/91604732 shutdown_connections 2024-09-13T15:12:25.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.983+0000 7f8ec3e00700 1 -- 172.21.15.50:0/91604732 wait complete. 2024-09-13T15:12:25.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.987+0000 7f8ec3e00700 1 Processor -- start 2024-09-13T15:12:25.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.987+0000 7f8ec3e00700 1 -- start start 2024-09-13T15:12:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.987+0000 7f8ec3e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ec406d280 0x7f8ec41596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 0x7f8ec413c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec40cd6c0 0x7f8ec413f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40cb7c0 con 0x7f8ec4071420 2024-09-13T15:12:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec413c9b0 con 0x7f8ec406d280 2024-09-13T15:12:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec413c080 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 0x7f8ec413c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec2000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 0x7f8ec413c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38360/0 (socket says 172.21.15.50:38360) 2024-09-13T15:12:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec2000700 1 -- 172.21.15.50:0/3133125312 learned_addr learned my addr 172.21.15.50:0/3133125312 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec40cd6c0 0x7f8ec413f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec2a00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ec406d280 0x7f8ec41596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 -- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ec406d280 msgr2=0x7f8ec41596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ec406d280 0x7f8ec41596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 -- 172.21.15.50:0/3133125312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 msgr2=0x7f8ec413c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 0x7f8ec413c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 -- 172.21.15.50:0/3133125312 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009570 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec2000700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 0x7f8ec413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3400700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec40cd6c0 0x7f8ec413f1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00cae0 tx=0x7f8ebc00cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc003c20 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc003d80 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec40cba10 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00aa20 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.991+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec40cbfd0 con 0x7f8ec40cd6c0 2024-09-13T15:12:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.995+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4071800 con 0x7f8ec40cd6c0 2024-09-13T15:12:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.995+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ebc00ab80 con 0x7f8ec40cd6c0 2024-09-13T15:12:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.999+0000 7f8ebb400700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8ea4066730 0x7f8ea4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.999+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f8ebc084230 con 0x7f8ec40cd6c0 2024-09-13T15:12:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.999+0000 7f8ec2a00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8ea4066730 0x7f8ea4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:25.999+0000 7f8ec2a00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8ea4066730 0x7f8ea4068bf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40cabf0 tx=0x7f8eb4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.007+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ebc051330 con 0x7f8ec40cd6c0 2024-09-13T15:12:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.247+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ec4140930 con 0x7f8ec40cd6c0 2024-09-13T15:12:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.247+0000 7f8ebb400700 1 -- 172.21.15.50:0/3133125312 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f8ebc054950 con 0x7f8ec40cd6c0 2024-09-13T15:12:26.252 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:26.252 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:24.909451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7650,"mds_1":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":1,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:26.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8ea4066730 msgr2=0x7f8ea4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8ea4066730 0x7f8ea4068bf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40cabf0 tx=0x7f8eb4009240 comp rx=0 tx=0).stop 2024-09-13T15:12:26.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec40cd6c0 msgr2=0x7f8ec413f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec40cd6c0 0x7f8ec413f1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00cae0 tx=0x7f8ebc00cdf0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 shutdown_connections 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8ea4066730 0x7f8ea4068bf0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8ec40cd6c0 0x7f8ec413f1a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec4071420 0x7f8ec413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 --2- 172.21.15.50:0/3133125312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ec406d280 0x7f8ec41596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 >> 172.21.15.50:0/3133125312 conn(0x7f8ec40b0d90 msgr2=0x7f8ec415a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 shutdown_connections 2024-09-13T15:12:26.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.251+0000 7f8ec3e00700 1 -- 172.21.15.50:0/3133125312 wait complete. 2024-09-13T15:12:26.259 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 67 2024-09-13T15:12:26.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:12:00.010021+0000', 'modified': '2024-09-13T15:12:24.909451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 105, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7650, 'mds_1': 7647}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7647': {'gid': 7647, 'name': 'c', 'rank': 1, 'incarnation': 66, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6834/3584876987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 3584876987}, {'type': 'v1', 'addr': '172.21.15.50:6834', 'nonce': 3584876987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7650': {'gid': 7650, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6835/359103955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 359103955}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 359103955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:12:26.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-13T15:12:26.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T15:12:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.851+0000 7fefb2c00700 1 Processor -- start 2024-09-13T15:12:26.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.851+0000 7fefb2c00700 1 -- start start 2024-09-13T15:12:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.851+0000 7fefb2c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fefac06dd20 0x7fefac0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.851+0000 7fefb2c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefac0cc640 0x7fefac06a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0ccc00 con 0x7fefac0ae490 2024-09-13T15:12:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0b40f0 con 0x7fefac0cc640 2024-09-13T15:12:26.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0b43d0 con 0x7fefac06dd20 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefa3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefac0cc640 0x7fefac06a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb0c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fefac0ae490 0x7fefac071a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47748/0 (socket says 172.21.15.50:47748) 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb0c00700 1 -- 172.21.15.50:0/1629171126 learned_addr learned my addr 172.21.15.50:0/1629171126 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefabe00700 1 --2- 172.21.15.50:0/1629171126 >> v2:172.21.15.181:3300/0 conn(0x7fefac06dd20 0x7fefac0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefa3e00700 1 -- 172.21.15.50:0/1629171126 >> v2:172.21.15.181:3300/0 conn(0x7fefac06dd20 msgr2=0x7fefac0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefa3e00700 1 --2- 172.21.15.50:0/1629171126 >> v2:172.21.15.181:3300/0 conn(0x7fefac06dd20 0x7fefac0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefa3e00700 1 -- 172.21.15.50:0/1629171126 >> v1:172.21.15.50:6789/0 conn(0x7fefac0ae490 legacy=0x7fefac071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefa3e00700 1 -- 172.21.15.50:0/1629171126 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0b46b0 con 0x7fefac0cc640 2024-09-13T15:12:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefa3e00700 1 --2- 172.21.15.50:0/1629171126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac0cc640 0x7fefac06a340 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fef94009850 tx=0x7fef94009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af94ac47d525661b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefab400700 1 -- 172.21.15.50:0/1629171126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94011830 con 0x7fefac0cc640 2024-09-13T15:12:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefab400700 1 -- 172.21.15.50:0/1629171126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94011990 con 0x7fefac0cc640 2024-09-13T15:12:26.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefab400700 1 -- 172.21.15.50:0/1629171126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94011d20 con 0x7fefac0cc640 2024-09-13T15:12:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- 172.21.15.50:0/1629171126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac0cc640 msgr2=0x7fefac06a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 --2- 172.21.15.50:0/1629171126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac0cc640 0x7fefac06a340 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fef94009850 tx=0x7fef94009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- 172.21.15.50:0/1629171126 shutdown_connections 2024-09-13T15:12:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 --2- 172.21.15.50:0/1629171126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac0cc640 0x7fefac06a340 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 --2- 172.21.15.50:0/1629171126 >> v2:172.21.15.181:3300/0 conn(0x7fefac06dd20 0x7fefac0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- 172.21.15.50:0/1629171126 >> 172.21.15.50:0/1629171126 conn(0x7fefac0b0e60 msgr2=0x7fefac0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- 172.21.15.50:0/1629171126 shutdown_connections 2024-09-13T15:12:26.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.855+0000 7fefb2c00700 1 -- 172.21.15.50:0/1629171126 wait complete. 2024-09-13T15:12:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.859+0000 7fefb2c00700 1 Processor -- start 2024-09-13T15:12:26.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.859+0000 7fefb2c00700 1 -- start start 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 0x7fefac0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0ae490 0x7fefac15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac0cc640 0x7fefac1e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1e8350 con 0x7fefac06dd20 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac06c490 con 0x7fefac0cc640 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac15b210 con 0x7fefac0ae490 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 0x7fefac0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 0x7fefac0c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38388/0 (socket says 172.21.15.50:38388) 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 -- 172.21.15.50:0/2803022603 learned_addr learned my addr 172.21.15.50:0/2803022603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb0c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac0cc640 0x7fefac1e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefa3e00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0ae490 0x7fefac15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 -- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0ae490 msgr2=0x7fefac15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0ae490 0x7fefac15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 -- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac0cc640 msgr2=0x7fefac1e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac0cc640 0x7fefac1e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 -- 172.21.15.50:0/2803022603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef940094b0 con 0x7fefac06dd20 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefabe00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 0x7fefac0c86c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00e760 tx=0x7fef9c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefa8c00700 1 -- 172.21.15.50:0/2803022603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00c070 con 0x7fefac06dd20 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefa8c00700 1 -- 172.21.15.50:0/2803022603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c013610 con 0x7fefac06dd20 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac1e7dd0 con 0x7fefac06dd20 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.863+0000 7fefa8c00700 1 -- 172.21.15.50:0/2803022603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c013980 con 0x7fefac06dd20 2024-09-13T15:12:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.867+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac06bdd0 con 0x7fefac06dd20 2024-09-13T15:12:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.867+0000 7fefa8c00700 1 -- 172.21.15.50:0/2803022603 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef9c013ae0 con 0x7fefac06dd20 2024-09-13T15:12:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.871+0000 7fefa8c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef88066730 0x7fef88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.871+0000 7fefa8c00700 1 -- 172.21.15.50:0/2803022603 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fef9c0841c0 con 0x7fefac06dd20 2024-09-13T15:12:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.871+0000 7fefa3e00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef88066730 0x7fef88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.871+0000 7fefa3e00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef88066730 0x7fef88068bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fef94009fd0 tx=0x7fef94008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.871+0000 7fefb5fc4740 1 Processor -- start 2024-09-13T15:12:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.871+0000 7fefb5fc4740 1 -- start start 2024-09-13T15:12:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24138180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24100890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2405fd80 con 0x24137da0 2024-09-13T15:12:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2405d510 con 0x24116d00 2024-09-13T15:12:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x24058e00 con 0x241386c0 2024-09-13T15:12:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24138180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38398/0 (socket says 172.21.15.50:38398) 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 -- 172.21.15.50:0/3888525289 learned_addr learned my addr 172.21.15.50:0/3888525289 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb0c00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefa3e00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24100890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 -- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 msgr2=0x24100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 -- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 msgr2=0x24100890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24100890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 -- 172.21.15.50:0/3888525289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23ecb960 con 0x24137da0 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb0c00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefa3e00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefabe00700 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24138180 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00efd0 tx=0x7fef9c0556d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b305495b742a9e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fef9be00700 1 -- 172.21.15.50:0/3888525289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c058d30 con 0x24137da0 2024-09-13T15:12:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fef9be00700 1 -- 172.21.15.50:0/3888525289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c05d2f0 con 0x24137da0 2024-09-13T15:12:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fef9be00700 1 -- 172.21.15.50:0/3888525289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0543f0 con 0x24137da0 2024-09-13T15:12:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3888525289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 msgr2=0x24138180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.875+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24138180 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00efd0 tx=0x7fef9c0556d0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3888525289 shutdown_connections 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3888525289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24138180 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3888525289 >> 172.21.15.50:0/3888525289 conn(0x23e804d0 msgr2=0x24119c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3888525289 shutdown_connections 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3888525289 wait complete. 2024-09-13T15:12:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- start start 2024-09-13T15:12:26.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 Processor -- start 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24138180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24137570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x24016730 con 0x24137da0 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2401c5b0 con 0x24116d00 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x23f04aa0 con 0x241386c0 2024-09-13T15:12:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefb5fc4740 10 client.0 _ll_register_callbacks cb 0x24052610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:26.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefa3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.879+0000 7fefa3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38414/0 (socket says 172.21.15.50:38414) 2024-09-13T15:12:26.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 -- 172.21.15.50:0/3321558384 learned_addr learned my addr 172.21.15.50:0/3321558384 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:26.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefabe00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb0c00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 -- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 msgr2=0x241334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 -- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 msgr2=0x24138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 -- 172.21.15.50:0/3321558384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac06bdd0 con 0x24137da0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefa3e00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24137570 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fefac072ab0 tx=0x7fef940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aee5bb541d4c03e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fef98c00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fef98c00700 1 -- 172.21.15.50:0/3321558384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9401f070 con 0x24137da0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fef98c00700 1 -- 172.21.15.50:0/3321558384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fef94003950 con 0x24137da0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23e8d1e0 con 0x24137da0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fef98c00700 1 -- 172.21.15.50:0/3321558384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef94003b10 con 0x24137da0 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 10 client.7767 fetch_fsmap learned FSMap version 67 2024-09-13T15:12:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x2401f220 con 0x24137da0 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fef98c00700 1 -- 172.21.15.50:0/3321558384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23e8d1e0 con 0x24137da0 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fef98c00700 1 -- 172.21.15.50:0/3321558384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 67) v1 ==== 3126+0+0 (secure 0 0 0) 0x7fef9402e070 con 0x24137da0 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 10 client.7767 fetch_fsmap finished waiting for FSMap version 67 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 10 client.7767 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 20 client.7767 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x240f0000 0x240f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 4 client.7767 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 --> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23ed7460 con 0x240f0000 2024-09-13T15:12:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.883+0000 7fefabe00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x240f0000 0x240f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefabe00700 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x240f0000 0x240f03e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18d3d6ba941ddc87 server_cookie=1fb302e044381890 in_seq=0 out_seq=0 2024-09-13T15:12:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fef98c00700 10 client.7767 ms_handle_connect on v2:172.21.15.50:6832/3584876987 2024-09-13T15:12:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fef98c00700 1 -- 172.21.15.50:0/3321558384 <== mds.1 v2:172.21.15.50:6832/3584876987 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x23ed7460 con 0x240f0000 2024-09-13T15:12:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fef98c00700 10 client.7767 handle_command_reply: tid=0 2024-09-13T15:12:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 client.7767 shutdown 2024-09-13T15:12:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 msgr2=0x24137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24137570 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fefac072ab0 tx=0x7fef940047e0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 shutdown_connections 2024-09-13T15:12:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x240f0000 0x240f03e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24137570 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/3321558384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x24138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 >> 172.21.15.50:0/3321558384 conn(0x23e804d0 msgr2=0x24113680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fef98c00700 0 client.7767 ms_handle_reset on v2:172.21.15.50:6832/3584876987 2024-09-13T15:12:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 shutdown_connections 2024-09-13T15:12:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 1 -- 172.21.15.50:0/3321558384 wait complete. 2024-09-13T15:12:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.887+0000 7fefb5fc4740 20 client.7767 trim_cache size 0 max 16384 2024-09-13T15:12:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 Processor -- start 2024-09-13T15:12:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 -- start start 2024-09-13T15:12:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24137060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x24058610 con 0x24137da0 2024-09-13T15:12:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2405c670 con 0x24116d00 2024-09-13T15:12:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x2401ae90 con 0x241386c0 2024-09-13T15:12:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24136b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38426/0 (socket says 172.21.15.50:38426) 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 -- 172.21.15.50:0/4052497761 learned_addr learned my addr 172.21.15.50:0/4052497761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefabe00700 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefb0c00700 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 -- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 msgr2=0x24137060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24137060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 -- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 msgr2=0x241365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 -- 172.21.15.50:0/4052497761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24005450 con 0x24137da0 2024-09-13T15:12:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefabe00700 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:26.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa3e00700 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24136b20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fef94009f60 tx=0x7fef94027070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187a37739db47ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa1200700 1 -- 172.21.15.50:0/4052497761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94003f90 con 0x24137da0 2024-09-13T15:12:26.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa1200700 1 -- 172.21.15.50:0/4052497761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9402b040 con 0x24137da0 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.911+0000 7fefa1200700 1 -- 172.21.15.50:0/4052497761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94037590 con 0x24137da0 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- 172.21.15.50:0/4052497761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 msgr2=0x24136b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24136b20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fef94009f60 tx=0x7fef94027070 comp rx=0 tx=0).stop 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- 172.21.15.50:0/4052497761 shutdown_connections 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x24137060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x24136b20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/4052497761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- 172.21.15.50:0/4052497761 >> 172.21.15.50:0/4052497761 conn(0x23e804d0 msgr2=0x240eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- 172.21.15.50:0/4052497761 shutdown_connections 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- 172.21.15.50:0/4052497761 wait complete. 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- start start 2024-09-13T15:12:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 Processor -- start 2024-09-13T15:12:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241a4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x241a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x241a2d30 con 0x24137da0 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x2415ec90 con 0x24116d00 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x241378d0 con 0x241386c0 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb5fc4740 10 client.0 _ll_register_callbacks cb 0x240af710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefa3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x241a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefa3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x241a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38440/0 (socket says 172.21.15.50:38440) 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefa3e00700 1 -- 172.21.15.50:0/1041171600 learned_addr learned my addr 172.21.15.50:0/1041171600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.915+0000 7fefb0c00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefabe00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefa3e00700 1 -- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 msgr2=0x241a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefa3e00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefa3e00700 1 -- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 msgr2=0x241a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefa3e00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefa3e00700 1 -- 172.21.15.50:0/1041171600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2401f220 con 0x24137da0 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fefa3e00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x241a4ab0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fef94011e50 tx=0x7fef94009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c82650ad773fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.919+0000 7fef98c00700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 1 -- 172.21.15.50:0/1041171600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94003cc0 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef9c05d2f0 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 1 -- 172.21.15.50:0/1041171600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fef9404cd50 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 1 -- 172.21.15.50:0/1041171600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef94003f90 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 10 client.7773 fetch_fsmap learned FSMap version 67 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x23ff9720 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 1 -- 172.21.15.50:0/1041171600 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c05d2f0 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 1 -- 172.21.15.50:0/1041171600 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 67) v1 ==== 3126+0+0 (secure 0 0 0) 0x7fef94052020 con 0x24137da0 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 10 client.7773 fetch_fsmap finished waiting for FSMap version 67 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 10 client.7773 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 20 client.7773 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x241a34f0 0x241a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 4 client.7773 mds_command: new command op to 7647 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:12:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 --> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] -- command(tid 0: {"prefix": "status"}) v1 -- 0x23efc1e0 con 0x241a34f0 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefabe00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x241a34f0 0x241a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefabe00700 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x241a34f0 0x241a38d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c2cab69e0a325f8 server_cookie=ab775b992462824c in_seq=0 out_seq=0 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 10 client.7773 ms_handle_connect on v2:172.21.15.50:6832/3584876987 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 1 -- 172.21.15.50:0/1041171600 <== mds.1 v2:172.21.15.50:6832/3584876987 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x23efc1e0 con 0x241a34f0 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 10 client.7773 handle_command_reply: tid=0 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 client.7773 shutdown 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 msgr2=0x241a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x241a4ab0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fef94011e50 tx=0x7fef94009240 comp rx=0 tx=0).stop 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 shutdown_connections 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:6832/3584876987,v1:172.21.15.50:6834/3584876987] conn(0x241a34f0 0x241a38d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x241386c0 0x241a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x24137da0 0x241a4ab0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 --2- 172.21.15.50:0/1041171600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x24116d00 0x241a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 >> 172.21.15.50:0/1041171600 conn(0x23e804d0 msgr2=0x240ee710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.923+0000 7fef98c00700 0 client.7773 ms_handle_reset on v2:172.21.15.50:6832/3584876987 2024-09-13T15:12:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 shutdown_connections 2024-09-13T15:12:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb5fc4740 1 -- 172.21.15.50:0/1041171600 wait complete. 2024-09-13T15:12:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb5fc4740 20 client.7773 trim_cache size 0 max 16384 2024-09-13T15:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7647, 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 3.0193761879999998, 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 67, 2024-09-13T15:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 107, 2024-09-13T15:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T15:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.059565276000001 2024-09-13T15:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef88066730 msgr2=0x7fef88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef88066730 0x7fef88068bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fef94009fd0 tx=0x7fef94008030 comp rx=0 tx=0).stop 2024-09-13T15:12:26.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 msgr2=0x7fefac0c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 0x7fefac0c86c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00e760 tx=0x7fef9c00ea70 comp rx=0 tx=0).stop 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 shutdown_connections 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef88066730 0x7fef88068bf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefac0cc640 0x7fefac1e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fefac0ae490 0x7fefac15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 --2- 172.21.15.50:0/2803022603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefac06dd20 0x7fefac0c86c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 >> 172.21.15.50:0/2803022603 conn(0x7fefac0b0e60 msgr2=0x7fefac0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 shutdown_connections 2024-09-13T15:12:26.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:26.927+0000 7fefb2c00700 1 -- 172.21.15.50:0/2803022603 wait complete. 2024-09-13T15:12:26.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T15:12:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.127+0000 7fc162400700 1 Processor -- start 2024-09-13T15:12:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.131+0000 7fc162400700 1 -- start start 2024-09-13T15:12:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.131+0000 7fc162400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc15c0724b0 0x7fc15c165670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.131+0000 7fc162400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c162340 0x7fc15c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.131+0000 7fc162400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15c0b4f00 con 0x7fc15c147610 2024-09-13T15:12:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.131+0000 7fc162400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c161670 con 0x7fc15c0724b0 2024-09-13T15:12:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.131+0000 7fc162400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c165bb0 con 0x7fc15c162340 2024-09-13T15:12:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc161000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc15c147610 0x7fc15c071da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47758/0 (socket says 172.21.15.50:47758) 2024-09-13T15:12:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc161000700 1 -- 172.21.15.50:0/718844516 learned_addr learned my addr 172.21.15.50:0/718844516 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15be00700 1 --2- 172.21.15.50:0/718844516 >> v2:172.21.15.50:3300/0 conn(0x7fc15c0724b0 0x7fc15c165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc161a00700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c162340 0x7fc15c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15b400700 1 -- 172.21.15.50:0/718844516 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515786576 0 0) 0x7fc150001110 con 0x7fc15c147610 2024-09-13T15:12:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15b400700 1 -- 172.21.15.50:0/718844516 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1440035d0 con 0x7fc15c147610 2024-09-13T15:12:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15be00700 1 -- 172.21.15.50:0/718844516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c162340 msgr2=0x7fc15c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15be00700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c162340 0x7fc15c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15be00700 1 -- 172.21.15.50:0/718844516 >> v1:172.21.15.50:6789/0 conn(0x7fc15c147610 legacy=0x7fc15c071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15be00700 1 -- 172.21.15.50:0/718844516 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c1479f0 con 0x7fc15c0724b0 2024-09-13T15:12:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc161a00700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c162340 0x7fc15c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15be00700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0724b0 0x7fc15c165670 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc148009880 tx=0x7fc148009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2adfdb12f4872c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15b400700 1 -- 172.21.15.50:0/718844516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148011830 con 0x7fc15c0724b0 2024-09-13T15:12:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15b400700 1 -- 172.21.15.50:0/718844516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148011990 con 0x7fc15c0724b0 2024-09-13T15:12:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc15b400700 1 -- 172.21.15.50:0/718844516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148011d20 con 0x7fc15c0724b0 2024-09-13T15:12:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 -- 172.21.15.50:0/718844516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0724b0 msgr2=0x7fc15c165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0724b0 0x7fc15c165670 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc148009880 tx=0x7fc148009b90 comp rx=0 tx=0).stop 2024-09-13T15:12:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 -- 172.21.15.50:0/718844516 shutdown_connections 2024-09-13T15:12:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c162340 0x7fc15c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 --2- 172.21.15.50:0/718844516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0724b0 0x7fc15c165670 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 -- 172.21.15.50:0/718844516 >> 172.21.15.50:0/718844516 conn(0x7fc15c06a340 msgr2=0x7fc15c06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 -- 172.21.15.50:0/718844516 shutdown_connections 2024-09-13T15:12:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.135+0000 7fc162400700 1 -- 172.21.15.50:0/718844516 wait complete. 2024-09-13T15:12:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 Processor -- start 2024-09-13T15:12:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 -- start start 2024-09-13T15:12:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c0724b0 0x7fc15c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc15c147610 0x7fc15c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 0x7fc15c146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1eb7c0 con 0x7fc15c162340 2024-09-13T15:12:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1eab40 con 0x7fc15c147610 2024-09-13T15:12:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc162400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1eae20 con 0x7fc15c0724b0 2024-09-13T15:12:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 0x7fc15c146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc161000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c0724b0 0x7fc15c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc15be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc15c147610 0x7fc15c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 0x7fc15c146600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38468/0 (socket says 172.21.15.50:38468) 2024-09-13T15:12:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc161a00700 1 -- 172.21.15.50:0/2834388119 learned_addr learned my addr 172.21.15.50:0/2834388119 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.139+0000 7fc161000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c0724b0 0x7fc15c160a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:38184/0 (socket says 172.21.15.50:38184) 2024-09-13T15:12:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc161a00700 1 -- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c0724b0 msgr2=0x7fc15c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc161a00700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c0724b0 0x7fc15c160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc161a00700 1 -- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc15c147610 msgr2=0x7fc15c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc161a00700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc15c147610 0x7fc15c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc161a00700 1 -- 172.21.15.50:0/2834388119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009a70 con 0x7fc15c162340 2024-09-13T15:12:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc161a00700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 0x7fc15c146600 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc15400efc0 tx=0x7fc15400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc158c00700 1 -- 172.21.15.50:0/2834388119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400ca90 con 0x7fc15c162340 2024-09-13T15:12:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc158c00700 1 -- 172.21.15.50:0/2834388119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400f040 con 0x7fc15c162340 2024-09-13T15:12:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1480094b0 con 0x7fc15c162340 2024-09-13T15:12:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc158c00700 1 -- 172.21.15.50:0/2834388119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400ce10 con 0x7fc15c162340 2024-09-13T15:12:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.143+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c1eb3e0 con 0x7fc15c162340 2024-09-13T15:12:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.147+0000 7fc158c00700 1 -- 172.21.15.50:0/2834388119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc154014480 con 0x7fc15c162340 2024-09-13T15:12:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.147+0000 7fc158c00700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc13c066730 0x7fc13c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.147+0000 7fc158c00700 1 -- 172.21.15.50:0/2834388119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fc154084a80 con 0x7fc15c162340 2024-09-13T15:12:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.147+0000 7fc161000700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc13c066730 0x7fc13c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.147+0000 7fc166e5f740 1 Processor -- start 2024-09-13T15:12:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.147+0000 7fc166e5f740 1 -- start start 2024-09-13T15:12:27.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161000700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc13c066730 0x7fc13c068bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc150007fd0 tx=0x7fc150007c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd315180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd2dd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd2dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xd23cd80 con 0xd3156c0 2024-09-13T15:12:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xd23a510 con 0xd2f3d00 2024-09-13T15:12:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xd235e00 con 0xd314da0 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd2dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd2dddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38474/0 (socket says 172.21.15.50:38474) 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 -- 172.21.15.50:0/1240556310 learned_addr learned my addr 172.21.15.50:0/1240556310 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161000700 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd315180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc15be00700 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd2dd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 -- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 msgr2=0xd315180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd315180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 -- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 msgr2=0xd2dd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd2dd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 -- 172.21.15.50:0/1240556310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd0a8960 con 0xd3156c0 2024-09-13T15:12:27.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc161a00700 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd2dddd0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc15405d670 tx=0x7fc154055eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f5d08482c36229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc14d600700 1 -- 172.21.15.50:0/1240556310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1540595e0 con 0xd3156c0 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc14d600700 1 -- 172.21.15.50:0/1240556310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15405dba0 con 0xd3156c0 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc14d600700 1 -- 172.21.15.50:0/1240556310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154059160 con 0xd3156c0 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- 172.21.15.50:0/1240556310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 msgr2=0xd2dddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd2dddd0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc15405d670 tx=0x7fc154055eb0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- 172.21.15.50:0/1240556310 shutdown_connections 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd2dddd0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd2dd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 --2- 172.21.15.50:0/1240556310 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd315180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- 172.21.15.50:0/1240556310 >> 172.21.15.50:0/1240556310 conn(0xd05d4d0 msgr2=0xd2f6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- 172.21.15.50:0/1240556310 shutdown_connections 2024-09-13T15:12:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.151+0000 7fc166e5f740 1 -- 172.21.15.50:0/1240556310 wait complete. 2024-09-13T15:12:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 -- start start 2024-09-13T15:12:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 Processor -- start 2024-09-13T15:12:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd315180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd2ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd310dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1f3730 con 0xd3156c0 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1f95b0 con 0xd2f3d00 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xd0e1aa0 con 0xd314da0 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 10 client.0 _ll_register_callbacks cb 0xd22f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd310dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd310dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38482/0 (socket says 172.21.15.50:38482) 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 -- 172.21.15.50:0/3212125163 learned_addr learned my addr 172.21.15.50:0/3212125163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161000700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd315180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc15be00700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd2ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 -- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 msgr2=0xd2ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd2ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 -- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 msgr2=0xd315180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd315180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 -- 172.21.15.50:0/3212125163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c1eb3e0 con 0xd3156c0 2024-09-13T15:12:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc161a00700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd310dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc15405d670 tx=0x7fc15400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2415f6ca2ba35cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc142000700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc142000700 1 -- 172.21.15.50:0/3212125163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154051af0 con 0xd3156c0 2024-09-13T15:12:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc142000700 1 -- 172.21.15.50:0/3212125163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fc1540595e0 con 0xd3156c0 2024-09-13T15:12:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd06a1e0 con 0xd3156c0 2024-09-13T15:12:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc142000700 1 -- 172.21.15.50:0/3212125163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc154055a10 con 0xd3156c0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.155+0000 7fc166e5f740 10 client.7788 fetch_fsmap learned FSMap version 67 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0xd1fc220 con 0xd3156c0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc142000700 1 -- 172.21.15.50:0/3212125163 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd06a1e0 con 0xd3156c0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc142000700 1 -- 172.21.15.50:0/3212125163 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 67) v1 ==== 3126+0+0 (secure 0 0 0) 0x7fc154054ca0 con 0xd3156c0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 10 client.7788 fetch_fsmap finished waiting for FSMap version 67 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 10 client.7788 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 20 client.7788 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd2c9bf0 0xd2c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 4 client.7788 mds_command: new command op to 7650 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 --> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd0b4460 con 0xd2c9bf0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc161000700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd2c9bf0 0xd2c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc161000700 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd2c9bf0 0xd2c9fd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca81d1e0f81d506 server_cookie=219cf8d70ab698ed in_seq=0 out_seq=0 2024-09-13T15:12:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc142000700 10 client.7788 ms_handle_connect on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc142000700 1 -- 172.21.15.50:0/3212125163 <== mds.0 v2:172.21.15.50:6833/359103955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0xd0b4460 con 0xd2c9bf0 2024-09-13T15:12:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc142000700 10 client.7788 handle_command_reply: tid=0 2024-09-13T15:12:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 client.7788 shutdown 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 msgr2=0xd310dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd310dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc15405d670 tx=0x7fc15400cf90 comp rx=0 tx=0).stop 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 shutdown_connections 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd2c9bf0 0xd2c9fd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd310dd0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd314da0 0xd2ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc142000700 0 client.7788 ms_handle_reset on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3212125163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd2f3d00 0xd315180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 >> 172.21.15.50:0/3212125163 conn(0xd05d4d0 msgr2=0xd2f08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.159+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 shutdown_connections 2024-09-13T15:12:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.163+0000 7fc166e5f740 1 -- 172.21.15.50:0/3212125163 wait complete. 2024-09-13T15:12:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.163+0000 7fc166e5f740 20 client.7788 trim_cache size 0 max 16384 2024-09-13T15:12:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 Processor -- start 2024-09-13T15:12:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 -- start start 2024-09-13T15:12:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd2f3d00 0xd317ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd317ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd318530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xd264ec0 con 0xd3156c0 2024-09-13T15:12:27.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1f3730 con 0xd314da0 2024-09-13T15:12:27.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xd1f95b0 con 0xd2f3d00 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd318530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd318530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38496/0 (socket says 172.21.15.50:38496) 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 -- 172.21.15.50:0/2974927975 learned_addr learned my addr 172.21.15.50:0/2974927975 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161000700 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd2f3d00 0xd317ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc15be00700 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd317ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 -- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd2f3d00 msgr2=0xd317ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd2f3d00 0xd317ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 -- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 msgr2=0xd317ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd317ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161a00700 1 -- 172.21.15.50:0/2974927975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd311220 con 0xd3156c0 2024-09-13T15:12:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.183+0000 7fc161000700 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd2f3d00 0xd317ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc161a00700 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd318530 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc154053d80 tx=0x7fc15406b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d0fd9fec37032 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc14e000700 1 -- 172.21.15.50:0/2974927975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154051af0 con 0xd3156c0 2024-09-13T15:12:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc14e000700 1 -- 172.21.15.50:0/2974927975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1540595e0 con 0xd3156c0 2024-09-13T15:12:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc14e000700 1 -- 172.21.15.50:0/2974927975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154055a10 con 0xd3156c0 2024-09-13T15:12:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 -- 172.21.15.50:0/2974927975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 msgr2=0xd318530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd318530 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc154053d80 tx=0x7fc15406b070 comp rx=0 tx=0).stop 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 -- 172.21.15.50:0/2974927975 shutdown_connections 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd3156c0 0xd318530 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd317ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 --2- 172.21.15.50:0/2974927975 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd2f3d00 0xd317ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 -- 172.21.15.50:0/2974927975 >> 172.21.15.50:0/2974927975 conn(0xd05d4d0 msgr2=0xd324830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 -- 172.21.15.50:0/2974927975 shutdown_connections 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 -- 172.21.15.50:0/2974927975 wait complete. 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 -- start start 2024-09-13T15:12:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.187+0000 7fc166e5f740 1 Processor -- start 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 0xd3770c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd319c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd3156c0 0xd331fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xd23cd80 con 0xd2f3d00 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1e9e10 con 0xd314da0 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0xd2cfdc0 con 0xd3156c0 2024-09-13T15:12:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 10 client.0 _ll_register_callbacks cb 0xd28c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:12:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 0xd3770c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 0xd3770c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38510/0 (socket says 172.21.15.50:38510) 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 -- 172.21.15.50:0/3844160630 learned_addr learned my addr 172.21.15.50:0/3844160630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc15be00700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd319c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161a00700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd3156c0 0xd331fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 -- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd3156c0 msgr2=0xd331fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd3156c0 0xd331fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 -- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 msgr2=0xd319c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd319c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 -- 172.21.15.50:0/3844160630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd1fc220 con 0xd2f3d00 2024-09-13T15:12:27.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161a00700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd3156c0 0xd331fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc161000700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 0xd3770c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc150007e60 tx=0x7fc150000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4404a5060c8289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc142000700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc142000700 1 -- 172.21.15.50:0/3844160630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150028040 con 0xd2f3d00 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc142000700 1 -- 172.21.15.50:0/3844160630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fc15001c040 con 0xd2f3d00 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc15405dba0 con 0xd2f3d00 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc142000700 1 -- 172.21.15.50:0/3844160630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc150005b10 con 0xd2f3d00 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 10 client.7794 fetch_fsmap learned FSMap version 67 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0xd1e2450 con 0xd2f3d00 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc142000700 1 -- 172.21.15.50:0/3844160630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15405dba0 con 0xd2f3d00 2024-09-13T15:12:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc142000700 1 -- 172.21.15.50:0/3844160630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 67) v1 ==== 3126+0+0 (secure 0 0 0) 0x7fc150032d20 con 0xd2f3d00 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 10 client.7794 fetch_fsmap finished waiting for FSMap version 67 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 10 client.7794 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.191+0000 7fc166e5f740 20 client.7794 populate_metadata read hostname 'smithi050' 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd31a140 0xd332500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 4 client.7794 mds_command: new command op to 7650 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 --> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] -- command(tid 0: {"prefix": "status"}) v1 -- 0xd0d91e0 con 0xd31a140 2024-09-13T15:12:27.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc15be00700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd31a140 0xd332500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc15be00700 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd31a140 0xd332500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beb4b88e1ab11580 server_cookie=5ad93827ea881759 in_seq=0 out_seq=0 2024-09-13T15:12:27.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc142000700 10 client.7794 ms_handle_connect on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc142000700 1 -- 172.21.15.50:0/3844160630 <== mds.0 v2:172.21.15.50:6833/359103955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0xd0d91e0 con 0xd31a140 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc142000700 10 client.7794 handle_command_reply: tid=0 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 client.7794 shutdown 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 msgr2=0xd3770c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 0xd3770c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc150007e60 tx=0x7fc150000ed0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 shutdown_connections 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:6833/359103955,v1:172.21.15.50:6835/359103955] conn(0xd31a140 0xd332500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0xd3156c0 0xd331fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0xd314da0 0xd319c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 --2- 172.21.15.50:0/3844160630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xd2f3d00 0xd3770c0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 >> 172.21.15.50:0/3844160630 conn(0xd05d4d0 msgr2=0xd325050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc142000700 0 client.7794 ms_handle_reset on v2:172.21.15.50:6833/359103955 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 shutdown_connections 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 1 -- 172.21.15.50:0/3844160630 wait complete. 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc166e5f740 20 client.7794 trim_cache size 0 max 16384 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "73923987-4656-4194-a4fe-9d4ec875d2d3", 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7650, 2024-09-13T15:12:27.202 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 11.357841621, 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 67, 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 107, 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 12.328138967999999 2024-09-13T15:12:27.203 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc13c066730 msgr2=0x7fc13c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc13c066730 0x7fc13c068bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc150007fd0 tx=0x7fc150007c60 comp rx=0 tx=0).stop 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 msgr2=0x7fc15c146600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 0x7fc15c146600 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc15400efc0 tx=0x7fc15400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 shutdown_connections 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc13c066730 0x7fc13c068bf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c162340 0x7fc15c146600 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc15c147610 0x7fc15c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 --2- 172.21.15.50:0/2834388119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc15c0724b0 0x7fc15c160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.195+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 >> 172.21.15.50:0/2834388119 conn(0x7fc15c06a340 msgr2=0x7fc15c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.199+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 shutdown_connections 2024-09-13T15:12:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:27.199+0000 7fc162400700 1 -- 172.21.15.50:0/2834388119 wait complete. 2024-09-13T15:12:27.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-13T15:12:27.429 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2024-09-13T15:12:27.430 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T15:12:27.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-09-13T15:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":38,"op_send_bytes":11382,"op_resend":27,"op_reply":38,"op_latency":{"avgcount":38,"sum":0.375991154,"avgtime":0.009894504},"op_inflight":0,"oplen_avg":{"avgcount":38,"sum":60},"op":38,"op_r":0,"op_w":38,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":14,"omap_rd":0,"omap_del":1}} 2024-09-13T15:12:27.619 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 14, "op": 38, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 38, "avgtime": 0.009894504, "sum": 0.375991154 }, "op_pg": 0, "op_r": 0, "op_reply": 38, "op_resend": 27, "op_rmw": 0, "op_send": 38, "op_send_bytes": 11382, "op_w": 38, "oplen_avg": { "avgcount": 38, "sum": 60 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T15:12:27.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json export dir /bravo 1 2024-09-13T15:12:27.813 INFO:teuthology.orchestra.run.smithi050.stdout:{"return_code":0} 2024-09-13T15:12:27.813 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-09-13T15:12:27.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-09-13T15:12:28.006 INFO:teuthology.orchestra.run.smithi050.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":38,"op_send_bytes":11382,"op_resend":27,"op_reply":38,"op_latency":{"avgcount":38,"sum":0.375991154,"avgtime":0.009894504},"op_inflight":0,"oplen_avg":{"avgcount":38,"sum":60},"op":38,"op_r":0,"op_w":38,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":14,"omap_rd":0,"omap_del":1}} 2024-09-13T15:12:28.006 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 14, "op": 38, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 38, "avgtime": 0.009894504, "sum": 0.375991154 }, "op_pg": 0, "op_r": 0, "op_reply": 38, "op_resend": 27, "op_rmw": 0, "op_send": 38, "op_send_bytes": 11382, "op_w": 38, "oplen_avg": { "avgcount": 38, "sum": 60 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T15:12:28.007 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-13T15:12:33.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-09-13T15:12:33.212 INFO:teuthology.orchestra.run.smithi050.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":40,"op_send_bytes":14521,"op_resend":27,"op_reply":40,"op_latency":{"avgcount":40,"sum":0.379991059,"avgtime":0.009499776},"op_inflight":0,"oplen_avg":{"avgcount":40,"sum":63},"op":40,"op_r":0,"op_w":40,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":3,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":0,"omap_del":1}} 2024-09-13T15:12:33.212 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 16, "op": 40, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 40, "avgtime": 0.009499776, "sum": 0.379991059 }, "op_pg": 0, "op_r": 0, "op_reply": 40, "op_resend": 27, "op_rmw": 0, "op_send": 40, "op_send_bytes": 14521, "op_w": 40, "oplen_avg": { "avgcount": 40, "sum": 63 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T15:12:33.212 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-13T15:12:35.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:12:35.999 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:12:38.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-09-13T15:12:38.442 INFO:teuthology.orchestra.run.smithi050.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":14855,"op_resend":27,"op_reply":42,"op_latency":{"avgcount":42,"sum":0.387990873,"avgtime":0.009237877},"op_inflight":0,"oplen_avg":{"avgcount":42,"sum":66},"op":42,"op_r":0,"op_w":42,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":4,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":18,"omap_rd":0,"omap_del":1}} 2024-09-13T15:12:38.442 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 18, "op": 42, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 42, "avgtime": 0.009237877, "sum": 0.387990873 }, "op_pg": 0, "op_r": 0, "op_reply": 42, "op_resend": 27, "op_rmw": 0, "op_send": 42, "op_send_bytes": 14855, "op_w": 42, "oplen_avg": { "avgcount": 42, "sum": 66 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T15:12:38.442 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-13T15:12:38.443 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:38.443 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:38.462 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:38.463 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:38.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:38.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.743+0000 7f131dc00700 1 Processor -- start 2024-09-13T15:12:38.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.743+0000 7f131dc00700 1 -- start start 2024-09-13T15:12:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131dc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 0x7f13180b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131dc00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f131806d280 0x7f1318071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131dc00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13180cd6c0 0x7f13180cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131dc00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1318071d40 con 0x7f13180cd6c0 2024-09-13T15:12:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131dc00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180b3200 con 0x7f131806d280 2024-09-13T15:12:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131dc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b34e0 con 0x7f1318071420 2024-09-13T15:12:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131d200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13180cd6c0 0x7f13180cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f1317e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 0x7f13180b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f1317e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 0x7f13180b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:48354/0 (socket says 172.21.15.50:48354) 2024-09-13T15:12:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f130f400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f131806d280 0x7f1318071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f1317e00700 1 -- 172.21.15.50:0/1058404378 learned_addr learned my addr 172.21.15.50:0/1058404378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131d200700 1 -- 172.21.15.50:0/1058404378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 msgr2=0x7f13180b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131d200700 1 --2- 172.21.15.50:0/1058404378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 0x7f13180b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131d200700 1 -- 172.21.15.50:0/1058404378 >> v2:172.21.15.181:3300/0 conn(0x7f131806d280 msgr2=0x7f1318071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131d200700 1 --2- 172.21.15.50:0/1058404378 >> v2:172.21.15.181:3300/0 conn(0x7f131806d280 0x7f1318071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f131d200700 1 -- 172.21.15.50:0/1058404378 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180b37c0 con 0x7f13180cd6c0 2024-09-13T15:12:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.747+0000 7f1317e00700 1 --2- 172.21.15.50:0/1058404378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 0x7f13180b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131d200700 1 --2- 172.21.15.50:0/1058404378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13180cd6c0 0x7f13180cdb70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f13180b1820 tx=0x7f1310009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c650ab1b9ae3e45c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f1317400700 1 -- 172.21.15.50:0/1058404378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310011830 con 0x7f13180cd6c0 2024-09-13T15:12:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f1317400700 1 -- 172.21.15.50:0/1058404378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310011990 con 0x7f13180cd6c0 2024-09-13T15:12:38.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f1317400700 1 -- 172.21.15.50:0/1058404378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310011d20 con 0x7f13180cd6c0 2024-09-13T15:12:38.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 -- 172.21.15.50:0/1058404378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13180cd6c0 msgr2=0x7f13180cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 --2- 172.21.15.50:0/1058404378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13180cd6c0 0x7f13180cdb70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f13180b1820 tx=0x7f1310009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 -- 172.21.15.50:0/1058404378 shutdown_connections 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 --2- 172.21.15.50:0/1058404378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13180cd6c0 0x7f13180cdb70 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 --2- 172.21.15.50:0/1058404378 >> v2:172.21.15.181:3300/0 conn(0x7f131806d280 0x7f1318071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 --2- 172.21.15.50:0/1058404378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1318071420 0x7f13180b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 -- 172.21.15.50:0/1058404378 >> 172.21.15.50:0/1058404378 conn(0x7f13180b0d90 msgr2=0x7f131806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 -- 172.21.15.50:0/1058404378 shutdown_connections 2024-09-13T15:12:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.751+0000 7f131dc00700 1 -- 172.21.15.50:0/1058404378 wait complete. 2024-09-13T15:12:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 Processor -- start 2024-09-13T15:12:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 -- start start 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f131806d280 0x7f13180adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 0x7f1318142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13180cd6c0 0x7f1318158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131813ed60 con 0x7f1318071420 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131813e150 con 0x7f131806d280 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131dc00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131813e430 con 0x7f13180cd6c0 2024-09-13T15:12:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 0x7f1318142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 0x7f1318142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36834/0 (socket says 172.21.15.50:36834) 2024-09-13T15:12:38.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 -- 172.21.15.50:0/2304816834 learned_addr learned my addr 172.21.15.50:0/2304816834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f1317e00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f131806d280 0x7f13180adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f131d200700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13180cd6c0 0x7f1318158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 -- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13180cd6c0 msgr2=0x7f1318158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13180cd6c0 0x7f1318158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 -- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f131806d280 msgr2=0x7f13180adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f131806d280 0x7f13180adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 -- 172.21.15.50:0/2304816834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308009b30 con 0x7f1318071420 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f1317e00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f131806d280 0x7f13180adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.755+0000 7f130f400700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 0x7f1318142df0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f130000e910 tx=0x7f130000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130000ee60 con 0x7f1318071420 2024-09-13T15:12:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130000c850 con 0x7f1318071420 2024-09-13T15:12:38.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130000cbe0 con 0x7f1318071420 2024-09-13T15:12:38.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13100094b0 con 0x7f1318071420 2024-09-13T15:12:38.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131813e9f0 con 0x7f1318071420 2024-09-13T15:12:38.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318071800 con 0x7f1318071420 2024-09-13T15:12:38.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.759+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f130000cd40 con 0x7f1318071420 2024-09-13T15:12:38.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.763+0000 7f1314c00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12f4066730 0x7f12f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:38.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.763+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f13000840b0 con 0x7f1318071420 2024-09-13T15:12:38.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.763+0000 7f1317e00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12f4066730 0x7f12f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:38.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.763+0000 7f1317e00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12f4066730 0x7f12f4068bf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1308009360 tx=0x7f130800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.771+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1300051120 con 0x7f1318071420 2024-09-13T15:12:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.963+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1318143a50 con 0x7f1318071420 2024-09-13T15:12:38.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.967+0000 7f1314c00700 1 -- 172.21.15.50:0/2304816834 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17139 (secure 0 0 0) 0x7f1300054740 con 0x7f1318071420 2024-09-13T15:12:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:38.973 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":107,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:21.866926+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6834/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6835/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6837/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.181:6836/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6835/2577107387":"2024-09-14T15:12:14.657185+0000","172.21.15.50:6834/2577107387":"2024-09-14T15:12:14.657185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12f4066730 msgr2=0x7f12f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12f4066730 0x7f12f4068bf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1308009360 tx=0x7f130800b040 comp rx=0 tx=0).stop 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 msgr2=0x7f1318142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 0x7f1318142df0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f130000e910 tx=0x7f130000ec20 comp rx=0 tx=0).stop 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 shutdown_connections 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f12f4066730 0x7f12f4068bf0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f13180cd6c0 0x7f1318158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318071420 0x7f1318142df0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 --2- 172.21.15.50:0/2304816834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f131806d280 0x7f13180adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 >> 172.21.15.50:0/2304816834 conn(0x7f13180b0d90 msgr2=0x7f1318070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 shutdown_connections 2024-09-13T15:12:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:38.971+0000 7f131dc00700 1 -- 172.21.15.50:0/2304816834 wait complete. 2024-09-13T15:12:38.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:58.177796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:59.008477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:12:38.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:12:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.175+0000 7fbb56600700 1 Processor -- start 2024-09-13T15:12:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.175+0000 7fbb56600700 1 -- start start 2024-09-13T15:12:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb56600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 0x7fbb5015f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb56600700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb500ccb60 0x7fbb500d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb56600700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb500d1880 con 0x7fbb500d1430 2024-09-13T15:12:39.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb56600700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5015b1d0 con 0x7fbb500ccb60 2024-09-13T15:12:39.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb56600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500cd390 con 0x7fbb500d05b0 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4ea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb500ccb60 0x7fbb500d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 0x7fbb5015f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 0x7fbb5015f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:48368/0 (socket says 172.21.15.50:48368) 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4ea00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbb500ccb60 0x7fbb500d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:42606/0 (socket says 172.21.15.50:42606) 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 -- 172.21.15.50:0/1501901038 learned_addr learned my addr 172.21.15.50:0/1501901038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 -- 172.21.15.50:0/1501901038 >> v2:172.21.15.181:3300/0 conn(0x7fbb500ccb60 msgr2=0x7fbb500d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 --2- 172.21.15.50:0/1501901038 >> v2:172.21.15.181:3300/0 conn(0x7fbb500ccb60 0x7fbb500d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 -- 172.21.15.50:0/1501901038 >> v1:172.21.15.181:6789/0 conn(0x7fbb500d1430 legacy=0x7fbb500cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 -- 172.21.15.50:0/1501901038 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5015c190 con 0x7fbb500d05b0 2024-09-13T15:12:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4f400700 1 --2- 172.21.15.50:0/1501901038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 0x7fbb5015f2e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009910 tx=0x7fbb40009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d3e44b21127f538 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.179+0000 7fbb4e000700 1 -- 172.21.15.50:0/1501901038 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011830 con 0x7fbb500d05b0 2024-09-13T15:12:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb4e000700 1 -- 172.21.15.50:0/1501901038 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40011990 con 0x7fbb500d05b0 2024-09-13T15:12:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb4e000700 1 -- 172.21.15.50:0/1501901038 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011d40 con 0x7fbb500d05b0 2024-09-13T15:12:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 -- 172.21.15.50:0/1501901038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 msgr2=0x7fbb5015f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 --2- 172.21.15.50:0/1501901038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 0x7fbb5015f2e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009910 tx=0x7fbb40009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 -- 172.21.15.50:0/1501901038 shutdown_connections 2024-09-13T15:12:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 --2- 172.21.15.50:0/1501901038 >> v2:172.21.15.181:3300/0 conn(0x7fbb500ccb60 0x7fbb500d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 --2- 172.21.15.50:0/1501901038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d05b0 0x7fbb5015f2e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 -- 172.21.15.50:0/1501901038 >> 172.21.15.50:0/1501901038 conn(0x7fbb5006a340 msgr2=0x7fbb5006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 -- 172.21.15.50:0/1501901038 shutdown_connections 2024-09-13T15:12:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 -- 172.21.15.50:0/1501901038 wait complete. 2024-09-13T15:12:39.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 Processor -- start 2024-09-13T15:12:39.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.183+0000 7fbb56600700 1 -- start start 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb500ccb60 0x7fbb5006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 0x7fbb50150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d1430 0x7fbb500cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500b4bb0 con 0x7fbb500d05b0 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501507c0 con 0x7fbb500ccb60 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500b3f30 con 0x7fbb500d1430 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 0x7fbb50150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 0x7fbb50150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36844/0 (socket says 172.21.15.50:36844) 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 -- 172.21.15.50:0/358611788 learned_addr learned my addr 172.21.15.50:0/358611788 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:39.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4f400700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb500ccb60 0x7fbb5006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4fe00700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d1430 0x7fbb500cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 -- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d1430 msgr2=0x7fbb500cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d1430 0x7fbb500cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 -- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb500ccb60 msgr2=0x7fbb5006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb500ccb60 0x7fbb5006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 -- 172.21.15.50:0/358611788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40009570 con 0x7fbb500d05b0 2024-09-13T15:12:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4f400700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb500ccb60 0x7fbb5006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb4ea00700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 0x7fbb50150280 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00e9d0 tx=0x7fbb3c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c009720 con 0x7fbb500d05b0 2024-09-13T15:12:39.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c00c850 con 0x7fbb500d05b0 2024-09-13T15:12:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb500b4210 con 0x7fbb500d05b0 2024-09-13T15:12:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00cbc0 con 0x7fbb500d05b0 2024-09-13T15:12:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.187+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb500b47d0 con 0x7fbb500d05b0 2024-09-13T15:12:39.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.191+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb50150aa0 con 0x7fbb500d05b0 2024-09-13T15:12:39.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.191+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb3c00cd20 con 0x7fbb500d05b0 2024-09-13T15:12:39.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.195+0000 7fbb47400700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb30066730 0x7fbb30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.195+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fbb3c0848a0 con 0x7fbb500d05b0 2024-09-13T15:12:39.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.195+0000 7fbb4f400700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb30066730 0x7fbb30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.195+0000 7fbb4f400700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb30066730 0x7fbb30068bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb40000c00 tx=0x7fbb40008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.199+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb3c0519a0 con 0x7fbb500d05b0 2024-09-13T15:12:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.383+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb500cbea0 con 0x7fbb500d05b0 2024-09-13T15:12:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb47400700 1 -- 172.21.15.50:0/358611788 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb3c054fc0 con 0x7fbb500d05b0 2024-09-13T15:12:39.390 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:12:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb30066730 msgr2=0x7fbb30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb30066730 0x7fbb30068bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb40000c00 tx=0x7fbb40008030 comp rx=0 tx=0).stop 2024-09-13T15:12:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 msgr2=0x7fbb50150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 0x7fbb50150280 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00e9d0 tx=0x7fbb3c00ed90 comp rx=0 tx=0).stop 2024-09-13T15:12:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 shutdown_connections 2024-09-13T15:12:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fbb30066730 0x7fbb30068bf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbb500d1430 0x7fbb500cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb500d05b0 0x7fbb50150280 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 --2- 172.21.15.50:0/358611788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb500ccb60 0x7fbb5006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 >> 172.21.15.50:0/358611788 conn(0x7fbb5006a340 msgr2=0x7fbb50153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 shutdown_connections 2024-09-13T15:12:39.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.387+0000 7fbb56600700 1 -- 172.21.15.50:0/358611788 wait complete. 2024-09-13T15:12:39.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:12:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 Processor -- start 2024-09-13T15:12:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 -- start start 2024-09-13T15:12:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b70161130 0x7f6b70164d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6b700d0590 0x7f6b700b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700cb270 con 0x7f6b700cd630 2024-09-13T15:12:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70165550 con 0x7f6b70161130 2024-09-13T15:12:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b76c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70165830 con 0x7f6b700d0590 2024-09-13T15:12:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b74c00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6b700cd630 0x7f6b700cba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44154/0 (socket says 172.21.15.50:44154) 2024-09-13T15:12:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b74c00700 1 -- 172.21.15.50:0/2530346319 learned_addr learned my addr 172.21.15.50:0/2530346319 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b6fe00700 1 --2- 172.21.15.50:0/2530346319 >> v2:172.21.15.50:3300/0 conn(0x7f6b70161130 0x7f6b70164d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.595+0000 7f6b6f400700 1 --2- 172.21.15.50:0/2530346319 >> v2:172.21.15.181:3300/0 conn(0x7f6b700d0590 0x7f6b700b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6ea00700 1 -- 172.21.15.50:0/2530346319 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556533834 0 0) 0x7f6b700cb270 con 0x7f6b700cd630 2024-09-13T15:12:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6ea00700 1 -- 172.21.15.50:0/2530346319 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b540035d0 con 0x7f6b700cd630 2024-09-13T15:12:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6fe00700 1 -- 172.21.15.50:0/2530346319 >> v2:172.21.15.181:3300/0 conn(0x7f6b700d0590 msgr2=0x7f6b700b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6fe00700 1 --2- 172.21.15.50:0/2530346319 >> v2:172.21.15.181:3300/0 conn(0x7f6b700d0590 0x7f6b700b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6fe00700 1 -- 172.21.15.50:0/2530346319 >> v1:172.21.15.50:6789/0 conn(0x7f6b700cd630 legacy=0x7f6b700cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6fe00700 1 -- 172.21.15.50:0/2530346319 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70165b10 con 0x7f6b70161130 2024-09-13T15:12:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6fe00700 1 --2- 172.21.15.50:0/2530346319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b70161130 0x7f6b70164d20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6b700c46e0 tx=0x7f6b60009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc2af5a5a04bf16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6ea00700 1 -- 172.21.15.50:0/2530346319 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60011830 con 0x7f6b70161130 2024-09-13T15:12:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6ea00700 1 -- 172.21.15.50:0/2530346319 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60011990 con 0x7f6b70161130 2024-09-13T15:12:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b6ea00700 1 -- 172.21.15.50:0/2530346319 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60011d20 con 0x7f6b70161130 2024-09-13T15:12:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 -- 172.21.15.50:0/2530346319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b70161130 msgr2=0x7f6b70164d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 --2- 172.21.15.50:0/2530346319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b70161130 0x7f6b70164d20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6b700c46e0 tx=0x7f6b60009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 -- 172.21.15.50:0/2530346319 shutdown_connections 2024-09-13T15:12:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 --2- 172.21.15.50:0/2530346319 >> v2:172.21.15.181:3300/0 conn(0x7f6b700d0590 0x7f6b700b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 --2- 172.21.15.50:0/2530346319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b70161130 0x7f6b70164d20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 -- 172.21.15.50:0/2530346319 >> 172.21.15.50:0/2530346319 conn(0x7f6b700b2750 msgr2=0x7f6b700b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:39.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 -- 172.21.15.50:0/2530346319 shutdown_connections 2024-09-13T15:12:39.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.599+0000 7f6b76c00700 1 -- 172.21.15.50:0/2530346319 wait complete. 2024-09-13T15:12:39.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 Processor -- start 2024-09-13T15:12:39.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 -- start start 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 0x7f6b700ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b700d0590 0x7f6b70150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b701512d0 0x7f6b70163350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700c8000 con 0x7f6b700cd630 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701f9d90 con 0x7f6b701512d0 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b76c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700c6c40 con 0x7f6b700d0590 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 0x7f6b700ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 0x7f6b700ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36862/0 (socket says 172.21.15.50:36862) 2024-09-13T15:12:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 -- 172.21.15.50:0/3410566432 learned_addr learned my addr 172.21.15.50:0/3410566432 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6f400700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b700d0590 0x7f6b70150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b74c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b701512d0 0x7f6b70163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 -- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b700d0590 msgr2=0x7f6b70150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b700d0590 0x7f6b70150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 -- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b701512d0 msgr2=0x7f6b70163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b701512d0 0x7f6b70163350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 -- 172.21.15.50:0/3410566432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600094b0 con 0x7f6b700cd630 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b74c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b701512d0 0x7f6b70163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.603+0000 7f6b6fe00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 0x7f6b700ca7d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6b600090b0 tx=0x7f6b60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600043c0 con 0x7f6b700cd630 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6001f070 con 0x7f6b700cd630 2024-09-13T15:12:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600036c0 con 0x7f6b700cd630 2024-09-13T15:12:39.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b70161690 con 0x7f6b700cd630 2024-09-13T15:12:39.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b701fa2c0 con 0x7f6b700cd630 2024-09-13T15:12:39.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b70164d20 con 0x7f6b700cd630 2024-09-13T15:12:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.607+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b60021030 con 0x7f6b700cd630 2024-09-13T15:12:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.611+0000 7f6b67e00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b50066730 0x7f6b50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.611+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f6b60085690 con 0x7f6b700cd630 2024-09-13T15:12:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.611+0000 7f6b6f400700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b50066730 0x7f6b50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.611+0000 7f6b6f400700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b50066730 0x7f6b50068bf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6b70151940 tx=0x7f6b5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.615+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b60052830 con 0x7f6b700cd630 2024-09-13T15:12:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.795+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b7015ff40 con 0x7f6b700cd630 2024-09-13T15:12:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.795+0000 7f6b67e00700 1 -- 172.21.15.50:0/3410566432 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b60055e50 con 0x7f6b700cd630 2024-09-13T15:12:39.801 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b50066730 msgr2=0x7f6b50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b50066730 0x7f6b50068bf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6b70151940 tx=0x7f6b5c008040 comp rx=0 tx=0).stop 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 msgr2=0x7f6b700ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 0x7f6b700ca7d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6b600090b0 tx=0x7f6b60004770 comp rx=0 tx=0).stop 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 shutdown_connections 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6b50066730 0x7f6b50068bf0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b701512d0 0x7f6b70163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6b700d0590 0x7f6b70150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 --2- 172.21.15.50:0/3410566432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b700cd630 0x7f6b700ca7d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 >> 172.21.15.50:0/3410566432 conn(0x7f6b700b2750 msgr2=0x7f6b7015f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 shutdown_connections 2024-09-13T15:12:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.799+0000 7f6b76c00700 1 -- 172.21.15.50:0/3410566432 wait complete. 2024-09-13T15:12:39.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:12:40.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.999+0000 7fa03be00700 1 Processor -- start 2024-09-13T15:12:40.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:39.999+0000 7fa03be00700 1 -- start start 2024-09-13T15:12:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa03c0ad410 0x7fa03c0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c15dc10 0x7fa03c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03be00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c15e0a0 con 0x7fa03c1570f0 2024-09-13T15:12:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03be00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0ae6c0 con 0x7fa03c0ad410 2024-09-13T15:12:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0ae9a0 con 0x7fa03c15dc10 2024-09-13T15:12:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa03c0ad410 0x7fa03c0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa03c0ad410 0x7fa03c0ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36864/0 (socket says 172.21.15.50:36864) 2024-09-13T15:12:40.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03a000700 1 -- 172.21.15.50:0/622628979 learned_addr learned my addr 172.21.15.50:0/622628979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:40.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.003+0000 7fa03b400700 1 --2- 172.21.15.50:0/622628979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c15dc10 0x7fa03c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03a000700 1 -- 172.21.15.50:0/622628979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c15dc10 msgr2=0x7fa03c0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03a000700 1 --2- 172.21.15.50:0/622628979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c15dc10 0x7fa03c0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03a000700 1 -- 172.21.15.50:0/622628979 >> v1:172.21.15.181:6789/0 conn(0x7fa03c1570f0 legacy=0x7fa03c0acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03a000700 1 -- 172.21.15.50:0/622628979 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0aec80 con 0x7fa03c0ad410 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03a000700 1 --2- 172.21.15.50:0/622628979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0ad410 0x7fa03c0ae020 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa028009910 tx=0x7fa028009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5440b4827714523e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa039600700 1 -- 172.21.15.50:0/622628979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028011830 con 0x7fa03c0ad410 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa039600700 1 -- 172.21.15.50:0/622628979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa028011990 con 0x7fa03c0ad410 2024-09-13T15:12:40.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa039600700 1 -- 172.21.15.50:0/622628979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028011d40 con 0x7fa03c0ad410 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 -- 172.21.15.50:0/622628979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0ad410 msgr2=0x7fa03c0ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 --2- 172.21.15.50:0/622628979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0ad410 0x7fa03c0ae020 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa028009910 tx=0x7fa028009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 -- 172.21.15.50:0/622628979 shutdown_connections 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 --2- 172.21.15.50:0/622628979 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c15dc10 0x7fa03c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 --2- 172.21.15.50:0/622628979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0ad410 0x7fa03c0ae020 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 -- 172.21.15.50:0/622628979 >> 172.21.15.50:0/622628979 conn(0x7fa03c0b1700 msgr2=0x7fa03c0b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:40.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 -- 172.21.15.50:0/622628979 shutdown_connections 2024-09-13T15:12:40.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.007+0000 7fa03be00700 1 -- 172.21.15.50:0/622628979 wait complete. 2024-09-13T15:12:40.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 Processor -- start 2024-09-13T15:12:40.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 -- start start 2024-09-13T15:12:40.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c0ad410 0x7fa03c144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa03c1570f0 0x7fa03c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 0x7fa03c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c145580 con 0x7fa03c15dc10 2024-09-13T15:12:40.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c145260 con 0x7fa03c1570f0 2024-09-13T15:12:40.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c145760 con 0x7fa03c0ad410 2024-09-13T15:12:40.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 0x7fa03c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 0x7fa03c0cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36878/0 (socket says 172.21.15.50:36878) 2024-09-13T15:12:40.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 -- 172.21.15.50:0/1614108081 learned_addr learned my addr 172.21.15.50:0/1614108081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:40.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03a000700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa03c1570f0 0x7fa03c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03aa00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c0ad410 0x7fa03c144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 -- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c0ad410 msgr2=0x7fa03c144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c0ad410 0x7fa03c144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 -- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa03c1570f0 msgr2=0x7fa03c158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa03c1570f0 0x7fa03c158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 -- 172.21.15.50:0/1614108081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009570 con 0x7fa03c15dc10 2024-09-13T15:12:40.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03a000700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa03c1570f0 0x7fa03c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:40.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.011+0000 7fa03b400700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 0x7fa03c0cea30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa03400efc0 tx=0x7fa03400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:40.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034009ba0 con 0x7fa03c15dc10 2024-09-13T15:12:40.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03400f040 con 0x7fa03c15dc10 2024-09-13T15:12:40.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034014480 con 0x7fa03c15dc10 2024-09-13T15:12:40.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c157650 con 0x7fa03c15dc10 2024-09-13T15:12:40.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c145d20 con 0x7fa03c15dc10 2024-09-13T15:12:40.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0ae020 con 0x7fa03c15dc10 2024-09-13T15:12:40.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.015+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0340145e0 con 0x7fa03c15dc10 2024-09-13T15:12:40.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.019+0000 7fa032a00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa01c066760 0x7fa01c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.019+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fa034084cb0 con 0x7fa03c15dc10 2024-09-13T15:12:40.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.019+0000 7fa03aa00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa01c066760 0x7fa01c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.019+0000 7fa03aa00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa01c066760 0x7fa01c068c20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000f60 tx=0x7fa02c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.027+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa034051d20 con 0x7fa03c15dc10 2024-09-13T15:12:40.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.215+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa03c160310 con 0x7fa03c15dc10 2024-09-13T15:12:40.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.215+0000 7fa032a00700 1 -- 172.21.15.50:0/1614108081 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa034018020 con 0x7fa03c15dc10 2024-09-13T15:12:40.221 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:12:40.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa01c066760 msgr2=0x7fa01c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa01c066760 0x7fa01c068c20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000f60 tx=0x7fa02c009040 comp rx=0 tx=0).stop 2024-09-13T15:12:40.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 msgr2=0x7fa03c0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 0x7fa03c0cea30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa03400efc0 tx=0x7fa03400c3a0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 shutdown_connections 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa01c066760 0x7fa01c068c20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c15dc10 0x7fa03c0cea30 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa03c1570f0 0x7fa03c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 --2- 172.21.15.50:0/1614108081 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa03c0ad410 0x7fa03c144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 >> 172.21.15.50:0/1614108081 conn(0x7fa03c0b1700 msgr2=0x7fa03c0714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 shutdown_connections 2024-09-13T15:12:40.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.219+0000 7fa03be00700 1 -- 172.21.15.50:0/1614108081 wait complete. 2024-09-13T15:12:40.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:12:40.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.431+0000 7f1ba9a00700 1 Processor -- start 2024-09-13T15:12:40.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.435+0000 7f1ba9a00700 1 -- start start 2024-09-13T15:12:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.435+0000 7f1ba9a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ba41571f0 0x7f1ba415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.435+0000 7f1ba9a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ba40ae020 0x7f1ba40acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.435+0000 7f1ba9a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba415e0b0 con 0x7f1ba40ad240 2024-09-13T15:12:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.435+0000 7f1ba9a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40cde20 con 0x7f1ba41571f0 2024-09-13T15:12:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.435+0000 7f1ba9a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40ad6b0 con 0x7f1ba40ae020 2024-09-13T15:12:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ba41571f0 0x7f1ba415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ba40ad240 0x7f1ba4160710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44166/0 (socket says 172.21.15.50:44166) 2024-09-13T15:12:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9000700 1 -- 172.21.15.50:0/2765312375 learned_addr learned my addr 172.21.15.50:0/2765312375 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3400700 1 --2- 172.21.15.50:0/2765312375 >> v2:172.21.15.181:3300/0 conn(0x7f1ba40ae020 0x7f1ba40acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3e00700 1 -- 172.21.15.50:0/2765312375 >> v2:172.21.15.181:3300/0 conn(0x7f1ba40ae020 msgr2=0x7f1ba40acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3e00700 1 --2- 172.21.15.50:0/2765312375 >> v2:172.21.15.181:3300/0 conn(0x7f1ba40ae020 0x7f1ba40acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3e00700 1 -- 172.21.15.50:0/2765312375 >> v1:172.21.15.50:6789/0 conn(0x7f1ba40ad240 legacy=0x7f1ba4160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3e00700 1 -- 172.21.15.50:0/2765312375 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba41575d0 con 0x7f1ba41571f0 2024-09-13T15:12:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba3e00700 1 --2- 172.21.15.50:0/2765312375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba41571f0 0x7f1ba415db70 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40703b0 tx=0x7f1b94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ca474a70f61d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba2a00700 1 -- 172.21.15.50:0/2765312375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94011830 con 0x7f1ba41571f0 2024-09-13T15:12:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba2a00700 1 -- 172.21.15.50:0/2765312375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b94011990 con 0x7f1ba41571f0 2024-09-13T15:12:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba2a00700 1 -- 172.21.15.50:0/2765312375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94011d20 con 0x7f1ba41571f0 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 -- 172.21.15.50:0/2765312375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba41571f0 msgr2=0x7f1ba415db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/2765312375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba41571f0 0x7f1ba415db70 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40703b0 tx=0x7f1b94009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 -- 172.21.15.50:0/2765312375 shutdown_connections 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/2765312375 >> v2:172.21.15.181:3300/0 conn(0x7f1ba40ae020 0x7f1ba40acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/2765312375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba41571f0 0x7f1ba415db70 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 -- 172.21.15.50:0/2765312375 >> 172.21.15.50:0/2765312375 conn(0x7f1ba40b1700 msgr2=0x7f1ba40b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 -- 172.21.15.50:0/2765312375 shutdown_connections 2024-09-13T15:12:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.439+0000 7f1ba9a00700 1 -- 172.21.15.50:0/2765312375 wait complete. 2024-09-13T15:12:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 Processor -- start 2024-09-13T15:12:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 -- start start 2024-09-13T15:12:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 0x7f1ba41f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba40ae020 0x7f1ba4160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ba41571f0 0x7f1ba4142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba415f310 con 0x7f1ba40ad240 2024-09-13T15:12:40.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba415f5e0 con 0x7f1ba40ae020 2024-09-13T15:12:40.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba415f8c0 con 0x7f1ba41571f0 2024-09-13T15:12:40.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 0x7f1ba41f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 0x7f1ba41f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36898/0 (socket says 172.21.15.50:36898) 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 -- 172.21.15.50:0/1985559037 learned_addr learned my addr 172.21.15.50:0/1985559037 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba9000700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ba41571f0 0x7f1ba4142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3400700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba40ae020 0x7f1ba4160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 -- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ba41571f0 msgr2=0x7f1ba4142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ba41571f0 0x7f1ba4142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 -- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba40ae020 msgr2=0x7f1ba4160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba40ae020 0x7f1ba4160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.443+0000 7f1ba3e00700 1 -- 172.21.15.50:0/1985559037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b940094b0 con 0x7f1ba40ad240 2024-09-13T15:12:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1ba3e00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 0x7f1ba41f2af0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1b94014040 tx=0x7f1b94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b940036c0 con 0x7f1ba40ad240 2024-09-13T15:12:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9401e070 con 0x7f1ba40ad240 2024-09-13T15:12:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba415fba0 con 0x7f1ba40ad240 2024-09-13T15:12:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94003a40 con 0x7f1ba40ad240 2024-09-13T15:12:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba4160160 con 0x7f1ba40ad240 2024-09-13T15:12:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.447+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba40af140 con 0x7f1ba40ad240 2024-09-13T15:12:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.451+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b94003ba0 con 0x7f1ba40ad240 2024-09-13T15:12:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.451+0000 7f1b9be00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1b84066760 0x7f1b84068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.451+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f1b94085430 con 0x7f1ba40ad240 2024-09-13T15:12:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.451+0000 7f1ba3400700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1b84066760 0x7f1b84068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.451+0000 7f1ba3400700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1b84066760 0x7f1b84068c20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1ba415df90 tx=0x7f1b90008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.455+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b94052550 con 0x7f1ba40ad240 2024-09-13T15:12:40.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.651+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1ba415d9e0 con 0x7f1ba40ad240 2024-09-13T15:12:40.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1b9be00700 1 -- 172.21.15.50:0/1985559037 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v107) v1 ==== 80+0+370 (secure 0 0 0) 0x7f1b94055b70 con 0x7f1ba40ad240 2024-09-13T15:12:40.658 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6834/2773604329 2024-09-14T15:12:14.815012+0000 2024-09-13T15:12:40.658 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6835/2773604329 2024-09-14T15:12:14.815012+0000 2024-09-13T15:12:40.658 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6837/1242078789 2024-09-14T15:12:14.783599+0000 2024-09-13T15:12:40.659 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6836/1242078789 2024-09-14T15:12:14.783599+0000 2024-09-13T15:12:40.659 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6835/2577107387 2024-09-14T15:12:14.657185+0000 2024-09-13T15:12:40.659 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6834/2577107387 2024-09-14T15:12:14.657185+0000 2024-09-13T15:12:40.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1b84066760 msgr2=0x7f1b84068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1b84066760 0x7f1b84068c20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1ba415df90 tx=0x7f1b90008040 comp rx=0 tx=0).stop 2024-09-13T15:12:40.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 msgr2=0x7f1ba41f2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:40.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 0x7f1ba41f2af0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1b94014040 tx=0x7f1b94004770 comp rx=0 tx=0).stop 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 shutdown_connections 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1b84066760 0x7f1b84068c20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ba41571f0 0x7f1ba4142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ba40ae020 0x7f1ba4160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 --2- 172.21.15.50:0/1985559037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ba40ad240 0x7f1ba41f2af0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 >> 172.21.15.50:0/1985559037 conn(0x7f1ba40b1700 msgr2=0x7f1ba415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.655+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 shutdown_connections 2024-09-13T15:12:40.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:40.659+0000 7f1ba9a00700 1 -- 172.21.15.50:0/1985559037 wait complete. 2024-09-13T15:12:40.664 INFO:teuthology.orchestra.run.smithi050.stderr:listed 6 entries 2024-09-13T15:12:40.683 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:12:40.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:40.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:12:40.746 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:12:40.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:40.747 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:12:40.763 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:40.763 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:40.776 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:40.776 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:40.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:41.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.019+0000 7f5433400700 1 Processor -- start 2024-09-13T15:12:41.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5433400700 1 -- start start 2024-09-13T15:12:41.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5433400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5433400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f542c15ab40 0x7f542c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5433400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0cd8f0 con 0x7f542c06b5f0 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5433400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c1543f0 con 0x7f542c15ab40 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5433400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c06ba80 con 0x7f542c154010 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.023+0000 7f5423e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f542c15ab40 0x7f542c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f542c15ab40 0x7f542c06b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36914/0 (socket says 172.21.15.50:36914) 2024-09-13T15:12:41.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 -- 172.21.15.50:0/717667093 learned_addr learned my addr 172.21.15.50:0/717667093 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:41.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5430a00700 1 --2- 172.21.15.50:0/717667093 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 -- 172.21.15.50:0/717667093 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 msgr2=0x7f542c0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 --2- 172.21.15.50:0/717667093 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c0ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 -- 172.21.15.50:0/717667093 >> v1:172.21.15.181:6789/0 conn(0x7f542c06b5f0 legacy=0x7f542c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 -- 172.21.15.50:0/717667093 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0cdbd0 con 0x7f542c15ab40 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5423e00700 1 --2- 172.21.15.50:0/717667093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c06b0b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5418009910 tx=0x7f5418009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d806e6aefa0da9aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f542be00700 1 -- 172.21.15.50:0/717667093 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418011830 con 0x7f542c15ab40 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f542be00700 1 -- 172.21.15.50:0/717667093 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5418011990 con 0x7f542c15ab40 2024-09-13T15:12:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f542be00700 1 -- 172.21.15.50:0/717667093 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418011d40 con 0x7f542c15ab40 2024-09-13T15:12:41.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 -- 172.21.15.50:0/717667093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 msgr2=0x7f542c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 --2- 172.21.15.50:0/717667093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c06b0b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5418009910 tx=0x7f5418009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:41.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 -- 172.21.15.50:0/717667093 shutdown_connections 2024-09-13T15:12:41.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 --2- 172.21.15.50:0/717667093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c06b0b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 --2- 172.21.15.50:0/717667093 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 -- 172.21.15.50:0/717667093 >> 172.21.15.50:0/717667093 conn(0x7f542c06a520 msgr2=0x7f542c06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 -- 172.21.15.50:0/717667093 shutdown_connections 2024-09-13T15:12:41.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.027+0000 7f5433400700 1 -- 172.21.15.50:0/717667093 wait complete. 2024-09-13T15:12:41.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.031+0000 7f5433400700 1 Processor -- start 2024-09-13T15:12:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.031+0000 7f5433400700 1 -- start start 2024-09-13T15:12:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c06b5f0 0x7f542c144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c152180 con 0x7f542c15ab40 2024-09-13T15:12:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c151ea0 con 0x7f542c06b5f0 2024-09-13T15:12:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c14f230 con 0x7f542c154010 2024-09-13T15:12:41.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36916/0 (socket says 172.21.15.50:36916) 2024-09-13T15:12:41.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 -- 172.21.15.50:0/3280761820 learned_addr learned my addr 172.21.15.50:0/3280761820 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:41.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5430a00700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c06b5f0 0x7f542c144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5423e00700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 -- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 msgr2=0x7f542c1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 -- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c06b5f0 msgr2=0x7f542c144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c06b5f0 0x7f542c144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 -- 172.21.15.50:0/3280761820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009570 con 0x7f542c15ab40 2024-09-13T15:12:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5431400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c158940 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f542400cb50 tx=0x7f542400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424003c20 con 0x7f542c15ab40 2024-09-13T15:12:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424003d80 con 0x7f542c15ab40 2024-09-13T15:12:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542400aa20 con 0x7f542c15ab40 2024-09-13T15:12:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.035+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c14f510 con 0x7f542c15ab40 2024-09-13T15:12:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.039+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c1454f0 con 0x7f542c15ab40 2024-09-13T15:12:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.039+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c152460 con 0x7f542c15ab40 2024-09-13T15:12:41.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.039+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f542400ab80 con 0x7f542c15ab40 2024-09-13T15:12:41.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.043+0000 7f5429600700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5400066730 0x7f5400068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.043+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f5424084440 con 0x7f542c15ab40 2024-09-13T15:12:41.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.043+0000 7f5430a00700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5400066730 0x7f5400068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.043+0000 7f5430a00700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5400066730 0x7f5400068bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5410005d50 tx=0x7f541000b750 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.047+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f54240514b0 con 0x7f542c15ab40 2024-09-13T15:12:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.255+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f542c14f090 con 0x7f542c15ab40 2024-09-13T15:12:41.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.255+0000 7f5429600700 1 -- 172.21.15.50:0/3280761820 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17139 (secure 0 0 0) 0x7f542c14f090 con 0x7f542c15ab40 2024-09-13T15:12:41.261 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:41.261 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":107,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:21.866926+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6834/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6835/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6837/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.181:6836/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6835/2577107387":"2024-09-14T15:12:14.657185+0000","172.21.15.50:6834/2577107387":"2024-09-14T15:12:14.657185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5400066730 msgr2=0x7f5400068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5400066730 0x7f5400068bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5410005d50 tx=0x7f541000b750 comp rx=0 tx=0).stop 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 msgr2=0x7f542c158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c158940 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f542400cb50 tx=0x7f542400ce60 comp rx=0 tx=0).stop 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 shutdown_connections 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5400066730 0x7f5400068bf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f542c15ab40 0x7f542c158940 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f542c154010 0x7f542c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 --2- 172.21.15.50:0/3280761820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c06b5f0 0x7f542c144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 >> 172.21.15.50:0/3280761820 conn(0x7f542c06a520 msgr2=0x7f542c0aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 shutdown_connections 2024-09-13T15:12:41.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.259+0000 7f5433400700 1 -- 172.21.15.50:0/3280761820 wait complete. 2024-09-13T15:12:41.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:58.177796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:59.008477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:12:41.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:12:41.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.463+0000 7f79b2800700 1 Processor -- start 2024-09-13T15:12:41.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.463+0000 7f79b2800700 1 -- start start 2024-09-13T15:12:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79b2800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac06d520 0x7f79ac0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79b2800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f79ac0ce130 0x7f79ac15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79b2800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac071c00 con 0x7f79ac0b2470 2024-09-13T15:12:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79b2800700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0cd030 con 0x7f79ac0ce130 2024-09-13T15:12:41.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79b2800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac071ee0 con 0x7f79ac06d520 2024-09-13T15:12:41.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aaa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f79ac0b2470 0x7f79ac0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44178/0 (socket says 172.21.15.50:44178) 2024-09-13T15:12:41.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aaa00700 1 -- 172.21.15.50:0/1165187815 learned_addr learned my addr 172.21.15.50:0/1165187815 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:41.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79ab400700 1 --2- 172.21.15.50:0/1165187815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac06d520 0x7f79ac0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79abe00700 1 --2- 172.21.15.50:0/1165187815 >> v2:172.21.15.181:3300/0 conn(0x7f79ac0ce130 0x7f79ac15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aa000700 1 -- 172.21.15.50:0/1165187815 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133186533 0 0) 0x7f79ac071c00 con 0x7f79ac0b2470 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aa000700 1 -- 172.21.15.50:0/1165187815 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79900035d0 con 0x7f79ac0b2470 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79ab400700 1 -- 172.21.15.50:0/1165187815 >> v2:172.21.15.181:3300/0 conn(0x7f79ac0ce130 msgr2=0x7f79ac15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79ab400700 1 --2- 172.21.15.50:0/1165187815 >> v2:172.21.15.181:3300/0 conn(0x7f79ac0ce130 0x7f79ac15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79ab400700 1 -- 172.21.15.50:0/1165187815 >> v1:172.21.15.50:6789/0 conn(0x7f79ac0b2470 legacy=0x7f79ac0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79ab400700 1 -- 172.21.15.50:0/1165187815 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0cd220 con 0x7f79ac06d520 2024-09-13T15:12:41.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79abe00700 1 --2- 172.21.15.50:0/1165187815 >> v2:172.21.15.181:3300/0 conn(0x7f79ac0ce130 0x7f79ac15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79ab400700 1 --2- 172.21.15.50:0/1165187815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac06d520 0x7f79ac0b1f30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f799c009850 tx=0x7f799c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77517fef32084c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aa000700 1 -- 172.21.15.50:0/1165187815 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011830 con 0x7f79ac06d520 2024-09-13T15:12:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aa000700 1 -- 172.21.15.50:0/1165187815 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c011990 con 0x7f79ac06d520 2024-09-13T15:12:41.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.467+0000 7f79aa000700 1 -- 172.21.15.50:0/1165187815 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011d00 con 0x7f79ac06d520 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 -- 172.21.15.50:0/1165187815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac06d520 msgr2=0x7f79ac0b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 --2- 172.21.15.50:0/1165187815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac06d520 0x7f79ac0b1f30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f799c009850 tx=0x7f799c009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 -- 172.21.15.50:0/1165187815 shutdown_connections 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 --2- 172.21.15.50:0/1165187815 >> v2:172.21.15.181:3300/0 conn(0x7f79ac0ce130 0x7f79ac15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 --2- 172.21.15.50:0/1165187815 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac06d520 0x7f79ac0b1f30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 -- 172.21.15.50:0/1165187815 >> 172.21.15.50:0/1165187815 conn(0x7f79ac06b230 msgr2=0x7f79ac06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 -- 172.21.15.50:0/1165187815 shutdown_connections 2024-09-13T15:12:41.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.471+0000 7f79b2800700 1 -- 172.21.15.50:0/1165187815 wait complete. 2024-09-13T15:12:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 Processor -- start 2024-09-13T15:12:41.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 -- start start 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ac06d520 0x7f79ac147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 0x7f79ac155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac0ce130 0x7f79ac158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac158a80 con 0x7f79ac0b2470 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac14b710 con 0x7f79ac06d520 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79b2800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac158c70 con 0x7f79ac0ce130 2024-09-13T15:12:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 0x7f79ac155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 0x7f79ac155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36928/0 (socket says 172.21.15.50:36928) 2024-09-13T15:12:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 -- 172.21.15.50:0/3372309263 learned_addr learned my addr 172.21.15.50:0/3372309263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79ab400700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ac06d520 0x7f79ac147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79abe00700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac0ce130 0x7f79ac158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 -- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac0ce130 msgr2=0x7f79ac158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac0ce130 0x7f79ac158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 -- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ac06d520 msgr2=0x7f79ac147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ac06d520 0x7f79ac147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 -- 172.21.15.50:0/3372309263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4009a70 con 0x7f79ac0b2470 2024-09-13T15:12:41.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.475+0000 7f79aaa00700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 0x7f79ac155e90 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f79980010e0 tx=0x7f799800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.479+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998005d90 con 0x7f79ac0b2470 2024-09-13T15:12:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.479+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980070d0 con 0x7f79ac0b2470 2024-09-13T15:12:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.479+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998007460 con 0x7f79ac0b2470 2024-09-13T15:12:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.479+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0094b0 con 0x7f79ac0b2470 2024-09-13T15:12:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.479+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac14b990 con 0x7f79ac0b2470 2024-09-13T15:12:41.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.479+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac071c00 con 0x7f79ac0b2470 2024-09-13T15:12:41.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.483+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79980075c0 con 0x7f79ac0b2470 2024-09-13T15:12:41.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.483+0000 7f79a3400700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f798c066730 0x7f798c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.483+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f79980838b0 con 0x7f79ac0b2470 2024-09-13T15:12:41.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.483+0000 7f79ab400700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f798c066730 0x7f798c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.487+0000 7f79ab400700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f798c066730 0x7f798c068bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f799c0090b0 tx=0x7f799c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.491+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79980509b0 con 0x7f79ac0b2470 2024-09-13T15:12:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.667+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79ac159130 con 0x7f79ac0b2470 2024-09-13T15:12:41.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.667+0000 7f79a3400700 1 -- 172.21.15.50:0/3372309263 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79980170a0 con 0x7f79ac0b2470 2024-09-13T15:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.671+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f798c066730 msgr2=0x7f798c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.671+0000 7f79b2800700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f798c066730 0x7f798c068bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f799c0090b0 tx=0x7f799c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.671+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 msgr2=0x7f79ac155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.671+0000 7f79b2800700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 0x7f79ac155e90 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f79980010e0 tx=0x7f799800c860 comp rx=0 tx=0).stop 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 shutdown_connections 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f798c066730 0x7f798c068bf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f79ac0ce130 0x7f79ac158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79ac0b2470 0x7f79ac155e90 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 --2- 172.21.15.50:0/3372309263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ac06d520 0x7f79ac147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 >> 172.21.15.50:0/3372309263 conn(0x7f79ac06b230 msgr2=0x7f79ac066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 shutdown_connections 2024-09-13T15:12:41.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.675+0000 7f79b2800700 1 -- 172.21.15.50:0/3372309263 wait complete. 2024-09-13T15:12:41.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:12:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.879+0000 7f853ac00700 1 Processor -- start 2024-09-13T15:12:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.879+0000 7f853ac00700 1 -- start start 2024-09-13T15:12:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f853ac00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8534144550 0x7f853415e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f853ac00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f8534071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f853ac00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853415f6b0 con 0x7f85340722e0 2024-09-13T15:12:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f853ac00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8534072770 con 0x7f8534144550 2024-09-13T15:12:41.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f853ac00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85340ce290 con 0x7f85340d09f0 2024-09-13T15:12:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8534144550 0x7f853415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8534144550 0x7f853415e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36932/0 (socket says 172.21.15.50:36932) 2024-09-13T15:12:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 -- 172.21.15.50:0/61511908 learned_addr learned my addr 172.21.15.50:0/61511908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f853a200700 1 --1- 172.21.15.50:0/61511908 >> v1:172.21.15.50:6789/0 conn(0x7f85340722e0 0x7f853406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44188/0 (socket says 172.21.15.50:44188) 2024-09-13T15:12:41.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8538e00700 1 --2- 172.21.15.50:0/61511908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f8534071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8533e00700 1 -- 172.21.15.50:0/61511908 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447852749 0 0) 0x7f853415f6b0 con 0x7f85340722e0 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8533e00700 1 -- 172.21.15.50:0/61511908 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f851c0035d0 con 0x7f85340722e0 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 -- 172.21.15.50:0/61511908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 msgr2=0x7f8534071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 --2- 172.21.15.50:0/61511908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f8534071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 -- 172.21.15.50:0/61511908 >> v1:172.21.15.50:6789/0 conn(0x7f85340722e0 legacy=0x7f853406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 -- 172.21.15.50:0/61511908 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853415ee10 con 0x7f8534144550 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8539800700 1 --2- 172.21.15.50:0/61511908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f853415e710 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8528009910 tx=0x7f8528009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5824626c18e41ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8533e00700 1 -- 172.21.15.50:0/61511908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528011830 con 0x7f8534144550 2024-09-13T15:12:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8533e00700 1 -- 172.21.15.50:0/61511908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528011990 con 0x7f8534144550 2024-09-13T15:12:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.883+0000 7f8533e00700 1 -- 172.21.15.50:0/61511908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528011d00 con 0x7f8534144550 2024-09-13T15:12:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 -- 172.21.15.50:0/61511908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 msgr2=0x7f853415e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 --2- 172.21.15.50:0/61511908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f853415e710 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8528009910 tx=0x7f8528009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 -- 172.21.15.50:0/61511908 shutdown_connections 2024-09-13T15:12:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 --2- 172.21.15.50:0/61511908 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f8534071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 --2- 172.21.15.50:0/61511908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f853415e710 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 -- 172.21.15.50:0/61511908 >> 172.21.15.50:0/61511908 conn(0x7f853406a340 msgr2=0x7f853406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 -- 172.21.15.50:0/61511908 shutdown_connections 2024-09-13T15:12:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.887+0000 7f853ac00700 1 -- 172.21.15.50:0/61511908 wait complete. 2024-09-13T15:12:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 Processor -- start 2024-09-13T15:12:41.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 -- start start 2024-09-13T15:12:41.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85340722e0 0x7f853415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f85341561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f85341566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85341f48f0 con 0x7f8534144550 2024-09-13T15:12:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853413b710 con 0x7f85340722e0 2024-09-13T15:12:41.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.891+0000 7f853ac00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853413b9f0 con 0x7f85340d09f0 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f85341566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f85341566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36942/0 (socket says 172.21.15.50:36942) 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 -- 172.21.15.50:0/660492797 learned_addr learned my addr 172.21.15.50:0/660492797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f8538e00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f85341561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f8539800700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85340722e0 0x7f853415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 -- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 msgr2=0x7f85341561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f85341561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 -- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85340722e0 msgr2=0x7f853415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85340722e0 0x7f853415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 -- 172.21.15.50:0/660492797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009570 con 0x7f8534144550 2024-09-13T15:12:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853a200700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f85341566e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f852c00cc50 tx=0x7f852c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c00ade0 con 0x7f8534144550 2024-09-13T15:12:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c00ce50 con 0x7f8534144550 2024-09-13T15:12:41.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c007290 con 0x7f8534144550 2024-09-13T15:12:41.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853413bcd0 con 0x7f8534144550 2024-09-13T15:12:41.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.895+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853415bb70 con 0x7f8534144550 2024-09-13T15:12:41.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.899+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853413c1f0 con 0x7f8534144550 2024-09-13T15:12:41.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.899+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f852c0073f0 con 0x7f8534144550 2024-09-13T15:12:41.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.899+0000 7f8531600700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8514066730 0x7f8514068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:41.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.899+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f852c084380 con 0x7f8534144550 2024-09-13T15:12:41.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.899+0000 7f8539800700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8514066730 0x7f8514068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:41.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.903+0000 7f8539800700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8514066730 0x7f8514068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8528014040 tx=0x7f8528008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:41.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:41.907+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f853413c1f0 con 0x7f8534144550 2024-09-13T15:12:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.087+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f853413c1f0 con 0x7f8534144550 2024-09-13T15:12:42.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.087+0000 7f8531600700 1 -- 172.21.15.50:0/660492797 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f853413c1f0 con 0x7f8534144550 2024-09-13T15:12:42.093 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8514066730 msgr2=0x7f8514068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8514066730 0x7f8514068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8528014040 tx=0x7f8528008030 comp rx=0 tx=0).stop 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 msgr2=0x7f85341566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f85341566e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f852c00cc50 tx=0x7f852c00a340 comp rx=0 tx=0).stop 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 shutdown_connections 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8514066730 0x7f8514068bf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8534144550 0x7f85341566e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85340d09f0 0x7f85341561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 --2- 172.21.15.50:0/660492797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85340722e0 0x7f853415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 >> 172.21.15.50:0/660492797 conn(0x7f853406a340 msgr2=0x7f85340d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 shutdown_connections 2024-09-13T15:12:42.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.091+0000 7f853ac00700 1 -- 172.21.15.50:0/660492797 wait complete. 2024-09-13T15:12:42.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:12:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.298+0000 7effd7a00700 1 Processor -- start 2024-09-13T15:12:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.298+0000 7effd7a00700 1 -- start start 2024-09-13T15:12:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd7a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd7a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effd00cd630 0x7effd00cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd7a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd015f670 con 0x7effd006def0 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd7a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd00b6530 con 0x7effd00cd630 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd7a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd00cdfe0 con 0x7effd015aae0 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effcfe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7effd006def0 0x7effd015ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44192/0 (socket says 172.21.15.50:44192) 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effcfe00700 1 -- 172.21.15.50:0/834517600 learned_addr learned my addr 172.21.15.50:0/834517600 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5000700 1 --2- 172.21.15.50:0/834517600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5a00700 1 --2- 172.21.15.50:0/834517600 >> v2:172.21.15.50:3300/0 conn(0x7effd00cd630 0x7effd00cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effcf400700 1 -- 172.21.15.50:0/834517600 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836863757 0 0) 0x7effd015f670 con 0x7effd006def0 2024-09-13T15:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5000700 1 -- 172.21.15.50:0/834517600 >> v2:172.21.15.50:3300/0 conn(0x7effd00cd630 msgr2=0x7effd00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5000700 1 --2- 172.21.15.50:0/834517600 >> v2:172.21.15.50:3300/0 conn(0x7effd00cd630 0x7effd00cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5000700 1 -- 172.21.15.50:0/834517600 >> v1:172.21.15.50:6789/0 conn(0x7effd006def0 legacy=0x7effd015ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5000700 1 -- 172.21.15.50:0/834517600 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd006e6d0 con 0x7effd015aae0 2024-09-13T15:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effd5000700 1 --2- 172.21.15.50:0/834517600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd006f9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effc4009850 tx=0x7effc4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe6d72db0da2f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effcf400700 1 -- 172.21.15.50:0/834517600 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4011830 con 0x7effd015aae0 2024-09-13T15:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effcf400700 1 -- 172.21.15.50:0/834517600 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4011990 con 0x7effd015aae0 2024-09-13T15:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.302+0000 7effcf400700 1 -- 172.21.15.50:0/834517600 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4011d40 con 0x7effd015aae0 2024-09-13T15:12:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 -- 172.21.15.50:0/834517600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 msgr2=0x7effd006f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 --2- 172.21.15.50:0/834517600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd006f9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effc4009850 tx=0x7effc4009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 -- 172.21.15.50:0/834517600 shutdown_connections 2024-09-13T15:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 --2- 172.21.15.50:0/834517600 >> v2:172.21.15.50:3300/0 conn(0x7effd00cd630 0x7effd00cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 --2- 172.21.15.50:0/834517600 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd006f9a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 -- 172.21.15.50:0/834517600 >> 172.21.15.50:0/834517600 conn(0x7effd00b2750 msgr2=0x7effd00b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 -- 172.21.15.50:0/834517600 shutdown_connections 2024-09-13T15:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.306+0000 7effd7a00700 1 -- 172.21.15.50:0/834517600 wait complete. 2024-09-13T15:12:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 Processor -- start 2024-09-13T15:12:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 -- start start 2024-09-13T15:12:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 0x7effd00afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd00cd630 0x7effd006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd015c880 con 0x7effd006def0 2024-09-13T15:12:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd015cb60 con 0x7effd00cd630 2024-09-13T15:12:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd7a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd015ce40 con 0x7effd015aae0 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 0x7effd00afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 0x7effd00afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36958/0 (socket says 172.21.15.50:36958) 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 -- 172.21.15.50:0/3155453725 learned_addr learned my addr 172.21.15.50:0/3155453725 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effcfe00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd00cd630 0x7effd006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 -- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 msgr2=0x7effd015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd015bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 -- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd00cd630 msgr2=0x7effd006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd00cd630 0x7effd006d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 -- 172.21.15.50:0/3155453725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40094b0 con 0x7effd006def0 2024-09-13T15:12:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.310+0000 7effd5000700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 0x7effd00afc10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7effc4014040 tx=0x7effc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4019ab0 con 0x7effd006def0 2024-09-13T15:12:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc401e070 con 0x7effd006def0 2024-09-13T15:12:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4019e50 con 0x7effd006def0 2024-09-13T15:12:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd015d1c0 con 0x7effd006def0 2024-09-13T15:12:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd00b0150 con 0x7effd006def0 2024-09-13T15:12:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd00b02e0 con 0x7effd006def0 2024-09-13T15:12:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.314+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effc401a420 con 0x7effd006def0 2024-09-13T15:12:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.318+0000 7effccc00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7effb0066730 0x7effb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.318+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7effc4085510 con 0x7effd006def0 2024-09-13T15:12:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.318+0000 7effcfe00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7effb0066730 0x7effb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.318+0000 7effcfe00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7effb0066730 0x7effb0068bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effbc007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.322+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effc4052590 con 0x7effd006def0 2024-09-13T15:12:42.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.510+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effd006e350 con 0x7effd006def0 2024-09-13T15:12:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.510+0000 7effccc00700 1 -- 172.21.15.50:0/3155453725 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7effc4055bb0 con 0x7effd006def0 2024-09-13T15:12:42.517 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:12:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7effb0066730 msgr2=0x7effb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7effb0066730 0x7effb0068bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7effbc007fd0 tx=0x7effbc007c20 comp rx=0 tx=0).stop 2024-09-13T15:12:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 msgr2=0x7effd00afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 0x7effd00afc10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7effc4014040 tx=0x7effc4004770 comp rx=0 tx=0).stop 2024-09-13T15:12:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 shutdown_connections 2024-09-13T15:12:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7effb0066730 0x7effb0068bf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effd015aae0 0x7effd015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effd00cd630 0x7effd006d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 --2- 172.21.15.50:0/3155453725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd006def0 0x7effd00afc10 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 >> 172.21.15.50:0/3155453725 conn(0x7effd00b2750 msgr2=0x7effd00b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 shutdown_connections 2024-09-13T15:12:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.514+0000 7effd7a00700 1 -- 172.21.15.50:0/3155453725 wait complete. 2024-09-13T15:12:42.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:12:42.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.714+0000 7fe79fe00700 1 Processor -- start 2024-09-13T15:12:42.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.714+0000 7fe79fe00700 1 -- start start 2024-09-13T15:12:42.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 0x7fe7a00b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79fe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7a00ae090 0x7fe7a006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79fe00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a00b4100 con 0x7fe7a0160fb0 2024-09-13T15:12:42.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79fe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a01623a0 con 0x7fe7a00ae090 2024-09-13T15:12:42.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79fe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00b2a20 con 0x7fe7a00aff60 2024-09-13T15:12:42.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 0x7fe7a00b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79f400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7a00ae090 0x7fe7a006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 0x7fe7a00b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:48504/0 (socket says 172.21.15.50:48504) 2024-09-13T15:12:42.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 -- 172.21.15.50:0/1271587463 learned_addr learned my addr 172.21.15.50:0/1271587463 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:42.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79ea00700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe7a0160fb0 0x7fe7a00af850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:34950/0 (socket says 172.21.15.50:34950) 2024-09-13T15:12:42.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 -- 172.21.15.50:0/1271587463 >> v2:172.21.15.50:3300/0 conn(0x7fe7a00ae090 msgr2=0x7fe7a006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:42.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 --2- 172.21.15.50:0/1271587463 >> v2:172.21.15.50:3300/0 conn(0x7fe7a00ae090 0x7fe7a006a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 -- 172.21.15.50:0/1271587463 >> v1:172.21.15.181:6789/0 conn(0x7fe7a0160fb0 legacy=0x7fe7a00af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 -- 172.21.15.50:0/1271587463 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00b2d00 con 0x7fe7a00aff60 2024-09-13T15:12:42.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.718+0000 7fe79e000700 1 --2- 172.21.15.50:0/1271587463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 0x7fe7a00b3bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009910 tx=0x7fe78c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e497a1efabce355 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:42.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79d600700 1 -- 172.21.15.50:0/1271587463 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c011830 con 0x7fe7a00aff60 2024-09-13T15:12:42.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79d600700 1 -- 172.21.15.50:0/1271587463 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c011990 con 0x7fe7a00aff60 2024-09-13T15:12:42.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79d600700 1 -- 172.21.15.50:0/1271587463 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c011d40 con 0x7fe7a00aff60 2024-09-13T15:12:42.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 -- 172.21.15.50:0/1271587463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 msgr2=0x7fe7a00b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 --2- 172.21.15.50:0/1271587463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 0x7fe7a00b3bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009910 tx=0x7fe78c009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 -- 172.21.15.50:0/1271587463 shutdown_connections 2024-09-13T15:12:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 --2- 172.21.15.50:0/1271587463 >> v2:172.21.15.50:3300/0 conn(0x7fe7a00ae090 0x7fe7a006a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 --2- 172.21.15.50:0/1271587463 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a00aff60 0x7fe7a00b3bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 -- 172.21.15.50:0/1271587463 >> 172.21.15.50:0/1271587463 conn(0x7fe7a00af470 msgr2=0x7fe7a0071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 -- 172.21.15.50:0/1271587463 shutdown_connections 2024-09-13T15:12:42.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.722+0000 7fe79fe00700 1 -- 172.21.15.50:0/1271587463 wait complete. 2024-09-13T15:12:42.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 Processor -- start 2024-09-13T15:12:42.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 -- start start 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 0x7fe7a0157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7a00aff60 0x7fe7a015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a0160fb0 0x7fe7a00cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a01581a0 con 0x7fe7a00ae090 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00a84d0 con 0x7fe7a00aff60 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a01589f0 con 0x7fe7a0160fb0 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 0x7fe7a0157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 0x7fe7a0157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36972/0 (socket says 172.21.15.50:36972) 2024-09-13T15:12:42.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 -- 172.21.15.50:0/993826593 learned_addr learned my addr 172.21.15.50:0/993826593 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79e000700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7a00aff60 0x7fe7a015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 -- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a0160fb0 msgr2=0x7fe7a00cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a0160fb0 0x7fe7a00cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 -- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7a00aff60 msgr2=0x7fe7a015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7a00aff60 0x7fe7a015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 -- 172.21.15.50:0/993826593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009570 con 0x7fe7a00ae090 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79e000700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7a00aff60 0x7fe7a015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79ea00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 0x7fe7a0157c60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c480 tx=0x7fe79000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790005cd0 con 0x7fe7a00ae090 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe790005e30 con 0x7fe7a00ae090 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a0158cd0 con 0x7fe7a00ae090 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.726+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900072d0 con 0x7fe7a00ae090 2024-09-13T15:12:42.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.730+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a0159290 con 0x7fe7a00ae090 2024-09-13T15:12:42.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.730+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a00b3bc0 con 0x7fe7a00ae090 2024-09-13T15:12:42.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.730+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe790007430 con 0x7fe7a00ae090 2024-09-13T15:12:42.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.734+0000 7fe796a00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe780066730 0x7fe780068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:42.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.734+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fe790083980 con 0x7fe7a00ae090 2024-09-13T15:12:42.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.734+0000 7fe79e000700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe780066730 0x7fe780068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:42.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.734+0000 7fe79e000700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe780066730 0x7fe780068bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00714f0 tx=0x7fe78c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:42.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.738+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe790050bb0 con 0x7fe7a00ae090 2024-09-13T15:12:42.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.934+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7a00b4100 con 0x7fe7a00ae090 2024-09-13T15:12:42.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.934+0000 7fe796a00700 1 -- 172.21.15.50:0/993826593 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v107) v1 ==== 80+0+370 (secure 0 0 0) 0x7fe7a00b4100 con 0x7fe7a00ae090 2024-09-13T15:12:42.940 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6834/2773604329 2024-09-14T15:12:14.815012+0000 2024-09-13T15:12:42.940 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6835/2773604329 2024-09-14T15:12:14.815012+0000 2024-09-13T15:12:42.940 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6837/1242078789 2024-09-14T15:12:14.783599+0000 2024-09-13T15:12:42.940 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.181:6836/1242078789 2024-09-14T15:12:14.783599+0000 2024-09-13T15:12:42.940 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6835/2577107387 2024-09-14T15:12:14.657185+0000 2024-09-13T15:12:42.941 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6834/2577107387 2024-09-14T15:12:14.657185+0000 2024-09-13T15:12:42.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe780066730 msgr2=0x7fe780068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe780066730 0x7fe780068bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00714f0 tx=0x7fe78c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 msgr2=0x7fe7a0157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 0x7fe7a0157c60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c480 tx=0x7fe79000c840 comp rx=0 tx=0).stop 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 shutdown_connections 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fe780066730 0x7fe780068bf0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe7a0160fb0 0x7fe7a00cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7a00aff60 0x7fe7a015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 --2- 172.21.15.50:0/993826593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7a00ae090 0x7fe7a0157c60 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 >> 172.21.15.50:0/993826593 conn(0x7fe7a00af470 msgr2=0x7fe7a00b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 shutdown_connections 2024-09-13T15:12:42.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:42.938+0000 7fe79fe00700 1 -- 172.21.15.50:0/993826593 wait complete. 2024-09-13T15:12:42.945 INFO:teuthology.orchestra.run.smithi050.stderr:listed 6 entries 2024-09-13T15:12:42.964 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T15:12:42.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:42.964 DEBUG:teuthology.orchestra.run.smithi181:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T15:12:43.016 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:12:43.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:43.016 DEBUG:teuthology.orchestra.run.smithi181:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:12:43.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T15:12:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-13T15:12:43.274 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T15:12:43.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-13T15:12:43.465 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2024-09-13T15:12:43.465 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T15:12:43.465 DEBUG:teuthology.orchestra.run.smithi050:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-13T15:12:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.522+0000 7f3c77c25500 1 -- start start 2024-09-13T15:12:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.522+0000 7f3c77c25500 1 Processor -- start 2024-09-13T15:12:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0327800 0x5610a03cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 0x5610a03ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0327000 0x5610a03cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8a00 con 0x5610a0327400 2024-09-13T15:12:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a035de00 con 0x5610a0327800 2024-09-13T15:12:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8640 con 0x5610a0327000 2024-09-13T15:12:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 0x5610a03ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c76600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0327000 0x5610a03cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 0x5610a03ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58794/0 (socket says 172.21.15.50:58794) 2024-09-13T15:12:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 -- 172.21.15.50:0/3862572358 learned_addr learned my addr 172.21.15.50:0/3862572358 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75c00700 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0327800 0x5610a03cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 -- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0327000 msgr2=0x5610a03cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0327000 0x5610a03cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 -- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0327800 msgr2=0x5610a03cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0327800 0x5610a03cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 -- 172.21.15.50:0/3862572358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610a034a9c0 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c75200700 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 0x5610a03ccb00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x5610a1094de0 tx=0x5610a119ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515cc0bc7b71860b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c72a00700 1 -- 172.21.15.50:0/3862572358 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610a0377600 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c72a00700 1 -- 172.21.15.50:0/3862572358 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610a110ea80 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c72a00700 1 -- 172.21.15.50:0/3862572358 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610a03771e0 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610a034ab60 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5610a034a340 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c77c25500 4 waiting for MDS map... 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c72a00700 1 -- 172.21.15.50:0/3862572358 <== mon.0 v2:172.21.15.50:3300/0 4 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x5610a0360c40 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.526+0000 7f3c72a00700 1 -- 172.21.15.50:0/3862572358 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 68) v1 ==== 3130+0+0 (secure 0 0 0) 0x5610a062a000 con 0x5610a0327400 2024-09-13T15:12:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 4 Got MDS map 68 2024-09-13T15:12:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 10 main: main 2024-09-13T15:12:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 4 main: connecting to RADOS... 2024-09-13T15:12:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 Processor -- start 2024-09-13T15:12:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 -- start start 2024-09-13T15:12:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 0x5610a03cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616800 0x5610a03cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616c00 0x5610a03ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8500 con 0x5610a0616400 2024-09-13T15:12:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a83c0 con 0x5610a0616800 2024-09-13T15:12:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c77c25500 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8280 con 0x5610a0616c00 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 0x5610a03cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 0x5610a03cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58800/0 (socket says 172.21.15.50:58800) 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 -- 172.21.15.50:0/1576552356 learned_addr learned my addr 172.21.15.50:0/1576552356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c75200700 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616c00 0x5610a03ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c75c00700 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616800 0x5610a03cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 -- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616c00 msgr2=0x5610a03ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616c00 0x5610a03ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 -- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616800 msgr2=0x5610a03cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616800 0x5610a03cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c76600700 1 -- 172.21.15.50:0/1576552356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610a034a000 con 0x5610a0616400 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.530+0000 7f3c75200700 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616c00 0x5610a03ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c76600700 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 0x5610a03cd600 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x5610a0486480 tx=0x5610a03fd5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21525711445b8364 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c70200700 1 -- 172.21.15.50:0/1576552356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610a0377080 con 0x5610a0616400 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c70200700 1 -- 172.21.15.50:0/1576552356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610a110f080 con 0x5610a0616400 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c70200700 1 -- 172.21.15.50:0/1576552356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610a0377600 con 0x5610a0616400 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- 172.21.15.50:0/1576552356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 msgr2=0x5610a03cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 0x5610a03cd600 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x5610a0486480 tx=0x5610a03fd5c0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- 172.21.15.50:0/1576552356 shutdown_connections 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616c00 0x5610a03ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616800 0x5610a03cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- 172.21.15.50:0/1576552356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616400 0x5610a03cd600 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- 172.21.15.50:0/1576552356 >> 172.21.15.50:0/1576552356 conn(0x5610a0326c00 msgr2=0x5610a03f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- 172.21.15.50:0/1576552356 shutdown_connections 2024-09-13T15:12:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- 172.21.15.50:0/1576552356 wait complete. 2024-09-13T15:12:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 Processor -- start 2024-09-13T15:12:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- start start 2024-09-13T15:12:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616400 0x5610a03cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616800 0x5610a03cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616c00 0x5610a03ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.534+0000 7f3c77c25500 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8780 con 0x5610a0616800 2024-09-13T15:12:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c77c25500 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8280 con 0x5610a0616c00 2024-09-13T15:12:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c77c25500 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a03a8640 con 0x5610a0616400 2024-09-13T15:12:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616800 0x5610a03cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616800 0x5610a03cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58808/0 (socket says 172.21.15.50:58808) 2024-09-13T15:12:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 -- 172.21.15.50:0/2913416995 learned_addr learned my addr 172.21.15.50:0/2913416995 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c76600700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616400 0x5610a03cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75200700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616c00 0x5610a03ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 -- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616400 msgr2=0x5610a03cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0616400 0x5610a03cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 -- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616c00 msgr2=0x5610a03ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616c00 0x5610a03ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 -- 172.21.15.50:0/2913416995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610a034a1a0 con 0x5610a0616800 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75200700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0616c00 0x5610a03ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c75c00700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616800 0x5610a03cec00 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x5610a04872c0 tx=0x5610a0630c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c6e400700 1 -- 172.21.15.50:0/2913416995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610a0377080 con 0x5610a0616800 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c6e400700 1 -- 172.21.15.50:0/2913416995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610a0372480 con 0x5610a0616800 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c6e400700 1 -- 172.21.15.50:0/2913416995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610a0377600 con 0x5610a0616800 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610a034a000 con 0x5610a0616800 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610a034a9c0 con 0x5610a0616800 2024-09-13T15:12:43.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.538+0000 7f3c77c25500 4 main: resolving pool 15 2024-09-13T15:12:43.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c6e400700 1 -- 172.21.15.50:0/2913416995 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5610a0386b00 con 0x5610a0616800 2024-09-13T15:12:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c6e400700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x5610a0776000 0x5610a03cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c6e400700 1 -- 172.21.15.50:0/2913416995 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x5610a0360a80 con 0x5610a0616800 2024-09-13T15:12:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c77c25500 4 main: creating IoCtx.. 2024-09-13T15:12:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c77c25500 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x5610a0617000 0x5610a03ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- osd_op(unknown.0.0:1 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) v8 -- 0x5610a0617400 con 0x5610a0617000 2024-09-13T15:12:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c76600700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x5610a0776000 0x5610a03cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c75200700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x5610a0617000 0x5610a03ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c75200700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x5610a0617000 0x5610a03ce100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.542+0000 7f3c76600700 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x5610a0776000 0x5610a03cf700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x5610a0486480 tx=0x5610a03fd2c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c75200700 1 -- 172.21.15.50:0/2913416995 <== osd.2 v2:172.21.15.50:6809/1292655960 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x5610a119cb40 con 0x5610a0617000 2024-09-13T15:12:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- osd_op(unknown.0.0:2 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) v8 -- 0x5610a0617800 con 0x5610a0617000 2024-09-13T15:12:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c75200700 1 -- 172.21.15.50:0/2913416995 <== osd.2 v2:172.21.15.50:6809/1292655960 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x5610a119cb40 con 0x5610a0617000 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: "0": { 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: "data": { 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions": [] 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: "result": 0 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:43.551 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x5610a0617000 msgr2=0x5610a03ce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x5610a0617000 0x5610a03ce100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x5610a0776000 msgr2=0x5610a03cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x5610a0776000 0x5610a03cf700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x5610a0486480 tx=0x5610a03fd2c0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616800 msgr2=0x5610a03cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/2913416995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0616800 0x5610a03cec00 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x5610a04872c0 tx=0x5610a0630c00 comp rx=0 tx=0).stop 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c75c00700 1 -- 172.21.15.50:0/2913416995 reap_dead start 2024-09-13T15:12:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 shutdown_connections 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 >> 172.21.15.50:0/2913416995 conn(0x5610a0326c00 msgr2=0x5610a03f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 shutdown_connections 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/2913416995 wait complete. 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 msgr2=0x5610a03ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 0x5610a03ccb00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x5610a1094de0 tx=0x5610a119ee40 comp rx=0 tx=0).stop 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 shutdown_connections 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x5610a0327000 0x5610a03cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610a0327400 0x5610a03ccb00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 --2- 172.21.15.50:0/3862572358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610a0327800 0x5610a03cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 >> 172.21.15.50:0/3862572358 conn(0x5610a0327c00 msgr2=0x5610a03f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 shutdown_connections 2024-09-13T15:12:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.546+0000 7f3c77c25500 1 -- 172.21.15.50:0/3862572358 wait complete. 2024-09-13T15:12:43.560 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.094384, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T15:12:43.560 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T15:12:43.560 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T15:12:43.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:12:43.597 DEBUG:teuthology.orchestra.run.smithi181:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T15:12:43.639 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T15:12:43.639 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:43.639 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:43.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:12:43.660 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:43.660 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:43.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:12:43.700 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:43.700 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:43.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:12:43.724 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:43.724 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:43.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:12:43.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.942+0000 7fef3e400700 1 Processor -- start 2024-09-13T15:12:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.942+0000 7fef3e400700 1 -- start start 2024-09-13T15:12:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3e400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef380c9490 0x7fef380b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3e400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fef3806e610 0x7fef380b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3e400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3815d180 con 0x7fef3815cda0 2024-09-13T15:12:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3e400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef380cbac0 con 0x7fef3806e610 2024-09-13T15:12:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3e400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef380cbda0 con 0x7fef380c9490 2024-09-13T15:12:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fef3806e610 0x7fef380b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3da00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fef3806e610 0x7fef380b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:34856/0 (socket says 172.21.15.50:34856) 2024-09-13T15:12:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef3da00700 1 -- 172.21.15.50:0/1992523527 learned_addr learned my addr 172.21.15.50:0/1992523527 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.946+0000 7fef37e00700 1 --2- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef380c9490 0x7fef380b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3da00700 1 -- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef380c9490 msgr2=0x7fef380b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3da00700 1 --2- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef380c9490 0x7fef380b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3da00700 1 -- 172.21.15.50:0/1992523527 >> v1:172.21.15.181:6789/0 conn(0x7fef3815cda0 legacy=0x7fef380c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3da00700 1 -- 172.21.15.50:0/1992523527 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef380b3c40 con 0x7fef3806e610 2024-09-13T15:12:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3da00700 1 --2- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef3806e610 0x7fef380b4f40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e50 tx=0x7fef3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1bc6d130c4ba81e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef37400700 1 -- 172.21.15.50:0/1992523527 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000e070 con 0x7fef3806e610 2024-09-13T15:12:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef37400700 1 -- 172.21.15.50:0/1992523527 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000b910 con 0x7fef3806e610 2024-09-13T15:12:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef37400700 1 -- 172.21.15.50:0/1992523527 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000bcc0 con 0x7fef3806e610 2024-09-13T15:12:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 -- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef3806e610 msgr2=0x7fef380b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 --2- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef3806e610 0x7fef380b4f40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e50 tx=0x7fef3000b330 comp rx=0 tx=0).stop 2024-09-13T15:12:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 -- 172.21.15.50:0/1992523527 shutdown_connections 2024-09-13T15:12:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 --2- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef3806e610 0x7fef380b4f40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 --2- 172.21.15.50:0/1992523527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef380c9490 0x7fef380b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 -- 172.21.15.50:0/1992523527 >> 172.21.15.50:0/1992523527 conn(0x7fef380cc450 msgr2=0x7fef380cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 -- 172.21.15.50:0/1992523527 shutdown_connections 2024-09-13T15:12:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.950+0000 7fef3e400700 1 -- 172.21.15.50:0/1992523527 wait complete. 2024-09-13T15:12:43.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.954+0000 7fef3e400700 1 Processor -- start 2024-09-13T15:12:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.954+0000 7fef3e400700 1 -- start start 2024-09-13T15:12:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef3806e610 0x7fef38151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef380c9490 0x7fef3806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 0x7fef3806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef38153470 con 0x7fef3815cda0 2024-09-13T15:12:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef381526b0 con 0x7fef380c9490 2024-09-13T15:12:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef38152990 con 0x7fef3806e610 2024-09-13T15:12:43.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 0x7fef3806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 0x7fef3806bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58818/0 (socket says 172.21.15.50:58818) 2024-09-13T15:12:43.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 -- 172.21.15.50:0/190714471 learned_addr learned my addr 172.21.15.50:0/190714471 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef37e00700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef380c9490 0x7fef3806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3d000700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef3806e610 0x7fef38151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 -- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef3806e610 msgr2=0x7fef38151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef3806e610 0x7fef38151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 -- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef380c9490 msgr2=0x7fef3806b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef380c9490 0x7fef3806b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:43.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 -- 172.21.15.50:0/190714471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009b30 con 0x7fef3815cda0 2024-09-13T15:12:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3da00700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 0x7fef3806bc30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fef380c9a40 tx=0x7fef30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300047c0 con 0x7fef3815cda0 2024-09-13T15:12:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30004940 con 0x7fef3815cda0 2024-09-13T15:12:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3001c680 con 0x7fef3815cda0 2024-09-13T15:12:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef38152c70 con 0x7fef3815cda0 2024-09-13T15:12:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.958+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef381517c0 con 0x7fef3815cda0 2024-09-13T15:12:43.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.962+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef380ca350 con 0x7fef3815cda0 2024-09-13T15:12:43.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.962+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef3001c7e0 con 0x7fef3815cda0 2024-09-13T15:12:43.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.966+0000 7fef34c00700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef18066730 0x7fef18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:43.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.966+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fef30085f50 con 0x7fef3815cda0 2024-09-13T15:12:43.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.966+0000 7fef3d000700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef18066730 0x7fef18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.966+0000 7fef3d000700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef18066730 0x7fef18068bf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fef38153610 tx=0x7fef2c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:43.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:43.974+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef30053050 con 0x7fef3815cda0 2024-09-13T15:12:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.202+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef38161780 con 0x7fef3815cda0 2024-09-13T15:12:44.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.202+0000 7fef34c00700 1 -- 172.21.15.50:0/190714471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4744 (secure 0 0 0) 0x7fef30056670 con 0x7fef3815cda0 2024-09-13T15:12:44.209 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:44.209 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:30.173706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7650,"mds_1":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":1,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef18066730 msgr2=0x7fef18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef18066730 0x7fef18068bf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fef38153610 tx=0x7fef2c009040 comp rx=0 tx=0).stop 2024-09-13T15:12:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 msgr2=0x7fef3806bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 0x7fef3806bc30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fef380c9a40 tx=0x7fef30004af0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 shutdown_connections 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fef18066730 0x7fef18068bf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3815cda0 0x7fef3806bc30 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef380c9490 0x7fef3806b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 --2- 172.21.15.50:0/190714471 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fef3806e610 0x7fef38151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 >> 172.21.15.50:0/190714471 conn(0x7fef380cc450 msgr2=0x7fef380b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 shutdown_connections 2024-09-13T15:12:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.206+0000 7fef3e400700 1 -- 172.21.15.50:0/190714471 wait complete. 2024-09-13T15:12:44.214 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 68 2024-09-13T15:12:44.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 Processor -- start 2024-09-13T15:12:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 -- start start 2024-09-13T15:12:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8334157fb0 0x7f83340b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83340b1fa0 0x7f8334071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83340b3700 con 0x7f8334071960 2024-09-13T15:12:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8334162610 con 0x7f83340b1fa0 2024-09-13T15:12:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.406+0000 7f8333e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8334158390 con 0x7f8334157fb0 2024-09-13T15:12:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83340b1fa0 0x7f8334071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83340b1fa0 0x7f8334071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58832/0 (socket says 172.21.15.50:58832) 2024-09-13T15:12:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 -- 172.21.15.50:0/3053513761 learned_addr learned my addr 172.21.15.50:0/3053513761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8332a00700 1 --2- 172.21.15.50:0/3053513761 >> v2:172.21.15.181:3300/0 conn(0x7f8334157fb0 0x7f83340b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 -- 172.21.15.50:0/3053513761 >> v2:172.21.15.181:3300/0 conn(0x7f8334157fb0 msgr2=0x7f83340b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 --2- 172.21.15.50:0/3053513761 >> v2:172.21.15.181:3300/0 conn(0x7f8334157fb0 0x7f83340b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 -- 172.21.15.50:0/3053513761 >> v1:172.21.15.50:6789/0 conn(0x7f8334071960 legacy=0x7f83340cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 -- 172.21.15.50:0/3053513761 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340b2410 con 0x7f83340b1fa0 2024-09-13T15:12:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f832a000700 1 --2- 172.21.15.50:0/3053513761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83340b1fa0 0x7f8334071420 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f83340b3170 tx=0x7f831c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f597ac039e9cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8332000700 1 -- 172.21.15.50:0/3053513761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00b8a0 con 0x7f83340b1fa0 2024-09-13T15:12:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8332000700 1 -- 172.21.15.50:0/3053513761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00ba00 con 0x7f83340b1fa0 2024-09-13T15:12:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8332000700 1 -- 172.21.15.50:0/3053513761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00bd90 con 0x7f83340b1fa0 2024-09-13T15:12:44.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8333e00700 1 -- 172.21.15.50:0/3053513761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83340b1fa0 msgr2=0x7f8334071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8333e00700 1 --2- 172.21.15.50:0/3053513761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83340b1fa0 0x7f8334071420 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f83340b3170 tx=0x7f831c009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8333e00700 1 -- 172.21.15.50:0/3053513761 shutdown_connections 2024-09-13T15:12:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8333e00700 1 --2- 172.21.15.50:0/3053513761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83340b1fa0 0x7f8334071420 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8333e00700 1 --2- 172.21.15.50:0/3053513761 >> v2:172.21.15.181:3300/0 conn(0x7f8334157fb0 0x7f83340b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.410+0000 7f8333e00700 1 -- 172.21.15.50:0/3053513761 >> 172.21.15.50:0/3053513761 conn(0x7f83340b0d90 msgr2=0x7f833406fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.414+0000 7f8333e00700 1 -- 172.21.15.50:0/3053513761 shutdown_connections 2024-09-13T15:12:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.414+0000 7f8333e00700 1 -- 172.21.15.50:0/3053513761 wait complete. 2024-09-13T15:12:44.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.414+0000 7f8333e00700 1 Processor -- start 2024-09-13T15:12:44.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 -- start start 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 0x7f83341e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83340b1fa0 0x7f83341fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8334157fb0 0x7f83341fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833415ab40 con 0x7f8334071960 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833415a210 con 0x7f8334157fb0 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833415a4f0 con 0x7f83340b1fa0 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 0x7f83341e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 0x7f83341e95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58840/0 (socket says 172.21.15.50:58840) 2024-09-13T15:12:44.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 -- 172.21.15.50:0/4071015124 learned_addr learned my addr 172.21.15.50:0/4071015124 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f832a000700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83340b1fa0 0x7f83341fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 -- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83340b1fa0 msgr2=0x7f83341fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83340b1fa0 0x7f83341fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333400700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8334157fb0 0x7f83341fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 -- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8334157fb0 msgr2=0x7f83341fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8334157fb0 0x7f83341fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 -- 172.21.15.50:0/4071015124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c009570 con 0x7f8334071960 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f832a000700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83340b1fa0 0x7f83341fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333400700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8334157fb0 0x7f83341fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8332a00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 0x7f83341e95e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f832400e760 tx=0x7f832400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324013610 con 0x7f8334071960 2024-09-13T15:12:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8324013770 con 0x7f8334071960 2024-09-13T15:12:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833415a7d0 con 0x7f8334071960 2024-09-13T15:12:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324013ae0 con 0x7f8334071960 2024-09-13T15:12:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.418+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83341e9b20 con 0x7f8334071960 2024-09-13T15:12:44.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.422+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8324013c40 con 0x7f8334071960 2024-09-13T15:12:44.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.422+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833415a960 con 0x7f8334071960 2024-09-13T15:12:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.422+0000 7f832be00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8310066730 0x7f8310068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.422+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f8324084110 con 0x7f8334071960 2024-09-13T15:12:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.422+0000 7f832a000700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8310066730 0x7f8310068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.426+0000 7f832a000700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8310066730 0x7f8310068bf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f833415b360 tx=0x7f831c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.430+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8324051220 con 0x7f8334071960 2024-09-13T15:12:44.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.626+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8334162b40 con 0x7f8334071960 2024-09-13T15:12:44.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.626+0000 7f832be00700 1 -- 172.21.15.50:0/4071015124 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17139 (secure 0 0 0) 0x7f8324054840 con 0x7f8334071960 2024-09-13T15:12:44.634 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:44.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":107,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:21.866926+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6834/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6835/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6837/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.181:6836/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6835/2577107387":"2024-09-14T15:12:14.657185+0000","172.21.15.50:6834/2577107387":"2024-09-14T15:12:14.657185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8310066730 msgr2=0x7f8310068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8310066730 0x7f8310068bf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f833415b360 tx=0x7f831c008030 comp rx=0 tx=0).stop 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 msgr2=0x7f83341e95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 0x7f83341e95e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f832400e760 tx=0x7f832400eb20 comp rx=0 tx=0).stop 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 shutdown_connections 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8310066730 0x7f8310068bf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8334157fb0 0x7f83341fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f83340b1fa0 0x7f83341fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 --2- 172.21.15.50:0/4071015124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8334071960 0x7f83341e95e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 >> 172.21.15.50:0/4071015124 conn(0x7f83340b0d90 msgr2=0x7f833406cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 shutdown_connections 2024-09-13T15:12:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.630+0000 7f8333e00700 1 -- 172.21.15.50:0/4071015124 wait complete. 2024-09-13T15:12:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:07:26.099979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:11:58.177796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:11:59.008477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:12:44.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:12:44.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.834+0000 7f854e000700 1 Processor -- start 2024-09-13T15:12:44.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.834+0000 7f854e000700 1 -- start start 2024-09-13T15:12:44.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.834+0000 7f854e000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8548146430 0x7f85480b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.834+0000 7f854e000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854815e250 con 0x7f854815d9e0 2024-09-13T15:12:44.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.834+0000 7f854e000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854815df70 con 0x7f85480b1af0 2024-09-13T15:12:44.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.834+0000 7f854e000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85480721d0 con 0x7f8548146430 2024-09-13T15:12:44.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f854815d9e0 0x7f8548070300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43168/0 (socket says 172.21.15.50:43168) 2024-09-13T15:12:44.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8548146430 0x7f85480b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547e00700 1 -- 172.21.15.50:0/239039265 learned_addr learned my addr 172.21.15.50:0/239039265 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:44.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8546a00700 1 -- 172.21.15.50:0/239039265 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481514294 0 0) 0x7f854815e250 con 0x7f854815d9e0 2024-09-13T15:12:44.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8546a00700 1 -- 172.21.15.50:0/239039265 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f852c0035d0 con 0x7f854815d9e0 2024-09-13T15:12:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547400700 1 -- 172.21.15.50:0/239039265 >> v1:172.21.15.181:6789/0 conn(0x7f85480b1af0 legacy=0x7f854815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547400700 1 -- 172.21.15.50:0/239039265 >> v1:172.21.15.50:6789/0 conn(0x7f854815d9e0 legacy=0x7f8548070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547400700 1 -- 172.21.15.50:0/239039265 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480b3b20 con 0x7f8548146430 2024-09-13T15:12:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8547400700 1 --2- 172.21.15.50:0/239039265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8548146430 0x7f85480b4600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8538009880 tx=0x7f8538009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110aaecf648b099d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8546a00700 1 -- 172.21.15.50:0/239039265 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538011830 con 0x7f8548146430 2024-09-13T15:12:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8546a00700 1 -- 172.21.15.50:0/239039265 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8538011990 con 0x7f8548146430 2024-09-13T15:12:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f8546a00700 1 -- 172.21.15.50:0/239039265 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538011d20 con 0x7f8548146430 2024-09-13T15:12:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f854e000700 1 -- 172.21.15.50:0/239039265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8548146430 msgr2=0x7f85480b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f854e000700 1 --2- 172.21.15.50:0/239039265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8548146430 0x7f85480b4600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8538009880 tx=0x7f8538009b90 comp rx=0 tx=0).stop 2024-09-13T15:12:44.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f854e000700 1 -- 172.21.15.50:0/239039265 shutdown_connections 2024-09-13T15:12:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.838+0000 7f854e000700 1 --2- 172.21.15.50:0/239039265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8548146430 0x7f85480b4600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- 172.21.15.50:0/239039265 >> 172.21.15.50:0/239039265 conn(0x7f854806b230 msgr2=0x7f854806b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- 172.21.15.50:0/239039265 shutdown_connections 2024-09-13T15:12:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- 172.21.15.50:0/239039265 wait complete. 2024-09-13T15:12:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 Processor -- start 2024-09-13T15:12:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- start start 2024-09-13T15:12:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 0x7f85480ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8548146430 0x7f85480abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f854815d9e0 0x7f85481fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480a97b0 con 0x7f854815d9e0 2024-09-13T15:12:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480ac060 con 0x7f8548146430 2024-09-13T15:12:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f854e000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85480a8e10 con 0x7f85480b1af0 2024-09-13T15:12:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.842+0000 7f8547e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f854815d9e0 0x7f85481fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f853fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8548146430 0x7f85480abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 0x7f85480ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 0x7f85480ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36508/0 (socket says 172.21.15.50:36508) 2024-09-13T15:12:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 -- 172.21.15.50:0/197533305 learned_addr learned my addr 172.21.15.50:0/197533305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 -- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8548146430 msgr2=0x7f85480abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8548146430 0x7f85480abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 -- 172.21.15.50:0/197533305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f854815d9e0 msgr2=0x7f85481fa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f854815d9e0 0x7f85481fa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 -- 172.21.15.50:0/197533305 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85380094b0 con 0x7f85480b1af0 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547e00700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f854815d9e0 0x7f85481fa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f8547400700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 0x7f85480ab5e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8538013040 tx=0x7f8538004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538004610 con 0x7f85480b1af0 2024-09-13T15:12:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380036c0 con 0x7f85480b1af0 2024-09-13T15:12:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85480a90f0 con 0x7f85480b1af0 2024-09-13T15:12:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538003a50 con 0x7f85480b1af0 2024-09-13T15:12:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85481fad60 con 0x7f85480b1af0 2024-09-13T15:12:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.846+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8548071520 con 0x7f85480b1af0 2024-09-13T15:12:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.850+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8538003bb0 con 0x7f85480b1af0 2024-09-13T15:12:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.850+0000 7f853f400700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8524066760 0x7f8524068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.850+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f8538085a50 con 0x7f85480b1af0 2024-09-13T15:12:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.850+0000 7f853fe00700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8524066760 0x7f8524068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.854+0000 7f853fe00700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8524066760 0x7f8524068c20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f8530009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:44.858+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8538052cf0 con 0x7f85480b1af0 2024-09-13T15:12:45.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.046+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85480a8f50 con 0x7f85480b1af0 2024-09-13T15:12:45.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.046+0000 7f853f400700 1 -- 172.21.15.50:0/197533305 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85480a8f50 con 0x7f85480b1af0 2024-09-13T15:12:45.054 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-13T15:12:45.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8524066760 msgr2=0x7f8524068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8524066760 0x7f8524068c20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f8530009040 comp rx=0 tx=0).stop 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 msgr2=0x7f85480ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 0x7f85480ab5e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8538013040 tx=0x7f8538004770 comp rx=0 tx=0).stop 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 shutdown_connections 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f8524066760 0x7f8524068c20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f854815d9e0 0x7f85481fa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8548146430 0x7f85480abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 --2- 172.21.15.50:0/197533305 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f85480b1af0 0x7f85480ab5e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 >> 172.21.15.50:0/197533305 conn(0x7f854806b230 msgr2=0x7f85481e7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 shutdown_connections 2024-09-13T15:12:45.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.054+0000 7f854e000700 1 -- 172.21.15.50:0/197533305 wait complete. 2024-09-13T15:12:45.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:12:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.258+0000 7f7b03e00700 1 Processor -- start 2024-09-13T15:12:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.258+0000 7f7b03e00700 1 -- start start 2024-09-13T15:12:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.258+0000 7f7b03e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b0415e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.258+0000 7f7b03e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0415f6b0 con 0x7f7b04144550 2024-09-13T15:12:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.258+0000 7f7b03e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040ce290 con 0x7f7b040d09f0 2024-09-13T15:12:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.258+0000 7f7b03e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415ee10 con 0x7f7b040724b0 2024-09-13T15:12:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b04144550 0x7f7b04071da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43182/0 (socket says 172.21.15.50:43182) 2024-09-13T15:12:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02a00700 1 -- 172.21.15.50:0/1123837517 learned_addr learned my addr 172.21.15.50:0/1123837517 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02000700 1 --2- 172.21.15.50:0/1123837517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b0415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043713858 0 0) 0x7f7b0415f6b0 con 0x7f7b04144550 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae80035d0 con 0x7f7b04144550 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171687887 0 0) 0x7f7b040ce290 con 0x7f7b040d09f0 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b0415f6b0 con 0x7f7b040d09f0 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02000700 1 -- 172.21.15.50:0/1123837517 >> v1:172.21.15.181:6789/0 conn(0x7f7b040d09f0 legacy=0x7f7b040b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02000700 1 -- 172.21.15.50:0/1123837517 >> v1:172.21.15.50:6789/0 conn(0x7f7b04144550 legacy=0x7f7b04071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02000700 1 -- 172.21.15.50:0/1123837517 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0415f0f0 con 0x7f7b040724b0 2024-09-13T15:12:45.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b02000700 1 --2- 172.21.15.50:0/1123837517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b0415e710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009880 tx=0x7f7af0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c230ee722c2c9aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0011830 con 0x7f7b040724b0 2024-09-13T15:12:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af0011990 con 0x7f7b040724b0 2024-09-13T15:12:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.262+0000 7f7b01600700 1 -- 172.21.15.50:0/1123837517 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0011d20 con 0x7f7b040724b0 2024-09-13T15:12:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 -- 172.21.15.50:0/1123837517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 msgr2=0x7f7b0415e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1123837517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b0415e710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009880 tx=0x7f7af0009b90 comp rx=0 tx=0).stop 2024-09-13T15:12:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 -- 172.21.15.50:0/1123837517 shutdown_connections 2024-09-13T15:12:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1123837517 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b0415e710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 -- 172.21.15.50:0/1123837517 >> 172.21.15.50:0/1123837517 conn(0x7f7b0406a340 msgr2=0x7f7b0406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 -- 172.21.15.50:0/1123837517 shutdown_connections 2024-09-13T15:12:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 -- 172.21.15.50:0/1123837517 wait complete. 2024-09-13T15:12:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 Processor -- start 2024-09-13T15:12:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.266+0000 7f7b03e00700 1 -- start start 2024-09-13T15:12:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b041594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 0x7f7b0413b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b04144550 0x7f7b040cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0413c070 con 0x7f7b040d09f0 2024-09-13T15:12:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041425f0 con 0x7f7b04144550 2024-09-13T15:12:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415d070 con 0x7f7b040724b0 2024-09-13T15:12:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 0x7f7b0413b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 0x7f7b0413b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58858/0 (socket says 172.21.15.50:58858) 2024-09-13T15:12:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 -- 172.21.15.50:0/1323795872 learned_addr learned my addr 172.21.15.50:0/1323795872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03400700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b04144550 0x7f7b040cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02a00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b041594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 -- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 msgr2=0x7f7b041594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b041594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 -- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b04144550 msgr2=0x7f7b040cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b04144550 0x7f7b040cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 -- 172.21.15.50:0/1323795872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af00094b0 con 0x7f7b040d09f0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b02000700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 0x7f7b0413b730 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7af0013040 tx=0x7f7af0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00198d0 con 0x7f7b040d09f0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af001e070 con 0x7f7b040d09f0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0019c50 con 0x7f7b040d09f0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0413b170 con 0x7f7b040d09f0 2024-09-13T15:12:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.270+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b04159a00 con 0x7f7b040d09f0 2024-09-13T15:12:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.274+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040cd4b0 con 0x7f7b040d09f0 2024-09-13T15:12:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.274+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7af002d450 con 0x7f7b040d09f0 2024-09-13T15:12:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.274+0000 7f7afaa00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ae4066730 0x7f7ae4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.274+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f7af0085410 con 0x7f7b040d09f0 2024-09-13T15:12:45.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.274+0000 7f7b02a00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ae4066730 0x7f7ae4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.278+0000 7f7b02a00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ae4066730 0x7f7ae4068bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000f60 tx=0x7f7af4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.282+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7af00525c0 con 0x7f7b040d09f0 2024-09-13T15:12:45.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.462+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b041427b0 con 0x7f7b040d09f0 2024-09-13T15:12:45.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.466+0000 7f7afaa00700 1 -- 172.21.15.50:0/1323795872 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7af0019db0 con 0x7f7b040d09f0 2024-09-13T15:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-13T15:12:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ae4066730 msgr2=0x7f7ae4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ae4066730 0x7f7ae4068bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000f60 tx=0x7f7af4009040 comp rx=0 tx=0).stop 2024-09-13T15:12:45.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 msgr2=0x7f7b0413b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 0x7f7b0413b730 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7af0013040 tx=0x7f7af0004770 comp rx=0 tx=0).stop 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 shutdown_connections 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ae4066730 0x7f7ae4068bf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b04144550 0x7f7b040cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b040d09f0 0x7f7b0413b730 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 --2- 172.21.15.50:0/1323795872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7b040724b0 0x7f7b041594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 >> 172.21.15.50:0/1323795872 conn(0x7f7b0406a340 msgr2=0x7f7b040d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 shutdown_connections 2024-09-13T15:12:45.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.470+0000 7f7b03e00700 1 -- 172.21.15.50:0/1323795872 wait complete. 2024-09-13T15:12:45.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:12:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 Processor -- start 2024-09-13T15:12:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 -- start start 2024-09-13T15:12:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06af70 0x7fae6c06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae6c06b350 0x7fae6c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae6c0b6370 0x7fae6c0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0cf3b0 con 0x7fae6c06b350 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0d0c30 con 0x7fae6c0b6370 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.674+0000 7fae70a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0d0f10 con 0x7fae6c06af70 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae6c06b350 0x7fae6c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae6c06b350 0x7fae6c0b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58862/0 (socket says 172.21.15.50:58862) 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 -- 172.21.15.50:0/2762357461 learned_addr learned my addr 172.21.15.50:0/2762357461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6b400700 1 --2- 172.21.15.50:0/2762357461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06af70 0x7fae6c06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6be00700 1 --2- 172.21.15.50:0/2762357461 >> v2:172.21.15.181:3300/0 conn(0x7fae6c0b6370 0x7fae6c0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 -- 172.21.15.50:0/2762357461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06af70 msgr2=0x7fae6c06bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 --2- 172.21.15.50:0/2762357461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06af70 0x7fae6c06bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 -- 172.21.15.50:0/2762357461 >> v2:172.21.15.181:3300/0 conn(0x7fae6c0b6370 msgr2=0x7fae6c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 --2- 172.21.15.50:0/2762357461 >> v2:172.21.15.181:3300/0 conn(0x7fae6c0b6370 0x7fae6c0d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 -- 172.21.15.50:0/2762357461 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0d11f0 con 0x7fae6c06b350 2024-09-13T15:12:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6aa00700 1 --2- 172.21.15.50:0/2762357461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06b350 0x7fae6c0b5e30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fae6c08c0b0 tx=0x7fae58009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b1cce9b744c6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6a000700 1 -- 172.21.15.50:0/2762357461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58011830 con 0x7fae6c06b350 2024-09-13T15:12:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6a000700 1 -- 172.21.15.50:0/2762357461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58011990 con 0x7fae6c06b350 2024-09-13T15:12:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae6a000700 1 -- 172.21.15.50:0/2762357461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58011d20 con 0x7fae6c06b350 2024-09-13T15:12:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 -- 172.21.15.50:0/2762357461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06b350 msgr2=0x7fae6c0b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 --2- 172.21.15.50:0/2762357461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06b350 0x7fae6c0b5e30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fae6c08c0b0 tx=0x7fae58009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 -- 172.21.15.50:0/2762357461 shutdown_connections 2024-09-13T15:12:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 --2- 172.21.15.50:0/2762357461 >> v2:172.21.15.181:3300/0 conn(0x7fae6c0b6370 0x7fae6c0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 --2- 172.21.15.50:0/2762357461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06b350 0x7fae6c0b5e30 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 --2- 172.21.15.50:0/2762357461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06af70 0x7fae6c06bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 -- 172.21.15.50:0/2762357461 >> 172.21.15.50:0/2762357461 conn(0x7fae6c0d2c00 msgr2=0x7fae6c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 -- 172.21.15.50:0/2762357461 shutdown_connections 2024-09-13T15:12:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.678+0000 7fae70a00700 1 -- 172.21.15.50:0/2762357461 wait complete. 2024-09-13T15:12:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.682+0000 7fae70a00700 1 Processor -- start 2024-09-13T15:12:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.682+0000 7fae70a00700 1 -- start start 2024-09-13T15:12:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 0x7fae6c15ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06b350 0x7fae6c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae6c0b6370 0x7fae6c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1513e0 con 0x7fae6c06af70 2024-09-13T15:12:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c152be0 con 0x7fae6c0b6370 2024-09-13T15:12:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c152e60 con 0x7fae6c06b350 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 0x7fae6c15ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 0x7fae6c15ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58874/0 (socket says 172.21.15.50:58874) 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 -- 172.21.15.50:0/2774369260 learned_addr learned my addr 172.21.15.50:0/2774369260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6be00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae6c0b6370 0x7fae6c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6aa00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06b350 0x7fae6c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 -- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06b350 msgr2=0x7fae6c150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06b350 0x7fae6c150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 -- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae6c0b6370 msgr2=0x7fae6c153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae6c0b6370 0x7fae6c153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 -- 172.21.15.50:0/2774369260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009570 con 0x7fae6c06af70 2024-09-13T15:12:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae6b400700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 0x7fae6c15ff20 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00ebe0 tx=0x7fae5c009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c009740 con 0x7fae6c06af70 2024-09-13T15:12:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00c8b0 con 0x7fae6c06af70 2024-09-13T15:12:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00cc40 con 0x7fae6c06af70 2024-09-13T15:12:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c153140 con 0x7fae6c06af70 2024-09-13T15:12:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.686+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c153700 con 0x7fae6c06af70 2024-09-13T15:12:45.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.690+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c06bbf0 con 0x7fae6c06af70 2024-09-13T15:12:45.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.690+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae5c013470 con 0x7fae6c06af70 2024-09-13T15:12:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.690+0000 7fae63400700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae4c066730 0x7fae4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.690+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fae5c084650 con 0x7fae6c06af70 2024-09-13T15:12:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.690+0000 7fae6aa00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae4c066730 0x7fae4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:45.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.694+0000 7fae6aa00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae4c066730 0x7fae4c068bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fae6c08c0b0 tx=0x7fae58008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:45.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.694+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae5c0516c0 con 0x7fae6c06af70 2024-09-13T15:12:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.874+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae6c0c8a00 con 0x7fae6c06af70 2024-09-13T15:12:45.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.874+0000 7fae63400700 1 -- 172.21.15.50:0/2774369260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae5c054ce0 con 0x7fae6c06af70 2024-09-13T15:12:45.881 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-13T15:12:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae4c066730 msgr2=0x7fae4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae4c066730 0x7fae4c068bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fae6c08c0b0 tx=0x7fae58008030 comp rx=0 tx=0).stop 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 msgr2=0x7fae6c15ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 0x7fae6c15ff20 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00ebe0 tx=0x7fae5c009e00 comp rx=0 tx=0).stop 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 shutdown_connections 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fae4c066730 0x7fae4c068bf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae6c0b6370 0x7fae6c153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae6c06b350 0x7fae6c150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 --2- 172.21.15.50:0/2774369260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae6c06af70 0x7fae6c15ff20 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 >> 172.21.15.50:0/2774369260 conn(0x7fae6c0d2c00 msgr2=0x7fae6c0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 shutdown_connections 2024-09-13T15:12:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:45.878+0000 7fae70a00700 1 -- 172.21.15.50:0/2774369260 wait complete. 2024-09-13T15:12:45.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.066+0000 7f91d7c00700 1 Processor -- start 2024-09-13T15:12:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.066+0000 7f91d7c00700 1 -- start start 2024-09-13T15:12:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91d7c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91d7c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f91d0070a50 0x7f91d0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91d7c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d00705c0 con 0x7f91d01444f0 2024-09-13T15:12:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91d7c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00ccd50 con 0x7f91d0070a50 2024-09-13T15:12:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91d7c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d006ba30 con 0x7f91d006b0b0 2024-09-13T15:12:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91d5c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f91d0070a50 0x7f91d0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d006b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36554/0 (socket says 172.21.15.50:36554) 2024-09-13T15:12:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 -- 172.21.15.50:0/4040804882 learned_addr learned my addr 172.21.15.50:0/4040804882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 -- 172.21.15.50:0/4040804882 >> v2:172.21.15.181:3300/0 conn(0x7f91d0070a50 msgr2=0x7f91d0070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 --2- 172.21.15.50:0/4040804882 >> v2:172.21.15.181:3300/0 conn(0x7f91d0070a50 0x7f91d0070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 -- 172.21.15.50:0/4040804882 >> v1:172.21.15.181:6789/0 conn(0x7f91d01444f0 legacy=0x7f91d00cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 -- 172.21.15.50:0/4040804882 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d01448d0 con 0x7f91d006b0b0 2024-09-13T15:12:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cf400700 1 -- 172.21.15.50:0/4040804882 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716749461 0 0) 0x7f91d00705c0 con 0x7f91d01444f0 2024-09-13T15:12:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.070+0000 7f91cfe00700 1 --2- 172.21.15.50:0/4040804882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d006b4f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009910 tx=0x7f91bc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d44fcd2e352c652 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91cf400700 1 -- 172.21.15.50:0/4040804882 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc011830 con 0x7f91d006b0b0 2024-09-13T15:12:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91cf400700 1 -- 172.21.15.50:0/4040804882 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc011990 con 0x7f91d006b0b0 2024-09-13T15:12:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91cf400700 1 -- 172.21.15.50:0/4040804882 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc011d40 con 0x7f91d006b0b0 2024-09-13T15:12:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 -- 172.21.15.50:0/4040804882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 msgr2=0x7f91d006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 --2- 172.21.15.50:0/4040804882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d006b4f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009910 tx=0x7f91bc009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 -- 172.21.15.50:0/4040804882 shutdown_connections 2024-09-13T15:12:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 --2- 172.21.15.50:0/4040804882 >> v2:172.21.15.181:3300/0 conn(0x7f91d0070a50 0x7f91d0070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 --2- 172.21.15.50:0/4040804882 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d006b4f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 -- 172.21.15.50:0/4040804882 >> 172.21.15.50:0/4040804882 conn(0x7f91d006a520 msgr2=0x7f91d006a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 -- 172.21.15.50:0/4040804882 shutdown_connections 2024-09-13T15:12:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.074+0000 7f91d7c00700 1 -- 172.21.15.50:0/4040804882 wait complete. 2024-09-13T15:12:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 Processor -- start 2024-09-13T15:12:46.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 -- start start 2024-09-13T15:12:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0070a50 0x7f91d015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 0x7f91d013da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d015de60 con 0x7f91d01444f0 2024-09-13T15:12:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d015ac90 con 0x7f91d0070a50 2024-09-13T15:12:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d7c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d01f61c0 con 0x7f91d006b0b0 2024-09-13T15:12:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 0x7f91d013da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 0x7f91d013da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58880/0 (socket says 172.21.15.50:58880) 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 -- 172.21.15.50:0/3797721619 learned_addr learned my addr 172.21.15.50:0/3797721619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91cfe00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0070a50 0x7f91d015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5200700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 -- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 msgr2=0x7f91d015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 -- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0070a50 msgr2=0x7f91d015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0070a50 0x7f91d015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.078+0000 7f91d5c00700 1 -- 172.21.15.50:0/3797721619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc009570 con 0x7f91d01444f0 2024-09-13T15:12:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91d5c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 0x7f91d013da00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f91c800efc0 tx=0x7f91c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8009ea0 con 0x7f91d01444f0 2024-09-13T15:12:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c800f040 con 0x7f91d01444f0 2024-09-13T15:12:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c800ced0 con 0x7f91d01444f0 2024-09-13T15:12:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d01f64a0 con 0x7f91d01444f0 2024-09-13T15:12:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d01f6a60 con 0x7f91d01444f0 2024-09-13T15:12:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d00b45b0 con 0x7f91d01444f0 2024-09-13T15:12:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.082+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91c8014480 con 0x7f91d01444f0 2024-09-13T15:12:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.086+0000 7f91ccc00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f91b0066730 0x7f91b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.086+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f91c8084c40 con 0x7f91d01444f0 2024-09-13T15:12:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.086+0000 7f91d5200700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f91b0066730 0x7f91b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.086+0000 7f91d5200700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f91b0066730 0x7f91b0068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000f60 tx=0x7f91c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.094+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91c8051d40 con 0x7f91d01444f0 2024-09-13T15:12:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.326+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d00af6d0 con 0x7f91d01444f0 2024-09-13T15:12:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.326+0000 7f91ccc00700 1 -- 172.21.15.50:0/3797721619 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4744 (secure 0 0 0) 0x7f91c8018020 con 0x7f91d01444f0 2024-09-13T15:12:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:46.332 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:30.173706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7650,"mds_1":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":1,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f91b0066730 msgr2=0x7f91b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f91b0066730 0x7f91b0068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000f60 tx=0x7f91c4009040 comp rx=0 tx=0).stop 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 msgr2=0x7f91d013da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 0x7f91d013da00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f91c800efc0 tx=0x7f91c800c3a0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 shutdown_connections 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f91b0066730 0x7f91b0068bf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91d01444f0 0x7f91d013da00 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0070a50 0x7f91d015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 --2- 172.21.15.50:0/3797721619 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f91d006b0b0 0x7f91d015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 >> 172.21.15.50:0/3797721619 conn(0x7f91d006a520 msgr2=0x7f91d00ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 shutdown_connections 2024-09-13T15:12:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.330+0000 7f91d7c00700 1 -- 172.21.15.50:0/3797721619 wait complete. 2024-09-13T15:12:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 68 2024-09-13T15:12:46.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:46.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.522+0000 7f02ad800700 1 Processor -- start 2024-09-13T15:12:46.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.522+0000 7f02ad800700 1 -- start start 2024-09-13T15:12:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ad800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02a8071b30 0x7f02a816ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ad800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a80b3700 con 0x7f02a80b2170 2024-09-13T15:12:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ad800700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a8162610 con 0x7f02a8157fb0 2024-09-13T15:12:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ad800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a8158390 con 0x7f02a8071b30 2024-09-13T15:12:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f029f400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02a80b2170 0x7f02a8071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43190/0 (socket says 172.21.15.50:43190) 2024-09-13T15:12:46.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f029f400700 1 -- 172.21.15.50:0/315963987 learned_addr learned my addr 172.21.15.50:0/315963987 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ace00700 1 --2- 172.21.15.50:0/315963987 >> v2:172.21.15.50:3300/0 conn(0x7f02a8071b30 0x7f02a816ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02a7400700 1 -- 172.21.15.50:0/315963987 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175713076 0 0) 0x7f02a80b3700 con 0x7f02a80b2170 2024-09-13T15:12:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02a7400700 1 -- 172.21.15.50:0/315963987 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c0035d0 con 0x7f02a80b2170 2024-09-13T15:12:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ace00700 1 -- 172.21.15.50:0/315963987 >> v1:172.21.15.181:6789/0 conn(0x7f02a8157fb0 legacy=0x7f02a80b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ace00700 1 -- 172.21.15.50:0/315963987 >> v1:172.21.15.50:6789/0 conn(0x7f02a80b2170 legacy=0x7f02a8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02a7400700 1 -- 172.21.15.50:0/315963987 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556659109 0 0) 0x7f02a8162610 con 0x7f02a8157fb0 2024-09-13T15:12:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ace00700 1 -- 172.21.15.50:0/315963987 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80b2640 con 0x7f02a8071b30 2024-09-13T15:12:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02ace00700 1 --2- 172.21.15.50:0/315963987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a8071b30 0x7f02a816ba80 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009850 tx=0x7f02a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c967eb1065f70a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02a7400700 1 -- 172.21.15.50:0/315963987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0011830 con 0x7f02a8071b30 2024-09-13T15:12:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02a7400700 1 -- 172.21.15.50:0/315963987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a0011990 con 0x7f02a8071b30 2024-09-13T15:12:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.526+0000 7f02a7400700 1 -- 172.21.15.50:0/315963987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0011d40 con 0x7f02a8071b30 2024-09-13T15:12:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 -- 172.21.15.50:0/315963987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a8071b30 msgr2=0x7f02a816ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 --2- 172.21.15.50:0/315963987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a8071b30 0x7f02a816ba80 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009850 tx=0x7f02a0009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 -- 172.21.15.50:0/315963987 shutdown_connections 2024-09-13T15:12:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 --2- 172.21.15.50:0/315963987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a8071b30 0x7f02a816ba80 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 -- 172.21.15.50:0/315963987 >> 172.21.15.50:0/315963987 conn(0x7f02a80b0d90 msgr2=0x7f02a806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 -- 172.21.15.50:0/315963987 shutdown_connections 2024-09-13T15:12:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.530+0000 7f02ad800700 1 -- 172.21.15.50:0/315963987 wait complete. 2024-09-13T15:12:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 Processor -- start 2024-09-13T15:12:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 -- start start 2024-09-13T15:12:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02a8071b30 0x7f02a8147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 0x7f02a815f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02a8157fb0 0x7f02a815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81604f0 con 0x7f02a80b2170 2024-09-13T15:12:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8160210 con 0x7f02a8157fb0 2024-09-13T15:12:46.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ad800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a815d160 con 0x7f02a8071b30 2024-09-13T15:12:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 0x7f02a815f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 0x7f02a815f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58900/0 (socket says 172.21.15.50:58900) 2024-09-13T15:12:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02a7e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02a8071b30 0x7f02a8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 -- 172.21.15.50:0/592646906 learned_addr learned my addr 172.21.15.50:0/592646906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f02ace00700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02a8157fb0 0x7f02a815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 -- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02a8071b30 msgr2=0x7f02a8147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02a8071b30 0x7f02a8147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 -- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02a8157fb0 msgr2=0x7f02a815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02a8157fb0 0x7f02a815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.534+0000 7f029f400700 1 -- 172.21.15.50:0/592646906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00094b0 con 0x7f02a80b2170 2024-09-13T15:12:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f029f400700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 0x7f02a815f770 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f02900010e0 tx=0x7f029000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290005d90 con 0x7f02a80b2170 2024-09-13T15:12:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900070d0 con 0x7f02a80b2170 2024-09-13T15:12:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a815d440 con 0x7f02a80b2170 2024-09-13T15:12:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290007460 con 0x7f02a80b2170 2024-09-13T15:12:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a815ca00 con 0x7f02a80b2170 2024-09-13T15:12:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.538+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a815cfc0 con 0x7f02a80b2170 2024-09-13T15:12:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.542+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02900075c0 con 0x7f02a80b2170 2024-09-13T15:12:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.542+0000 7f02a4c00700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0284066730 0x7f0284068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.542+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f0290083860 con 0x7f02a80b2170 2024-09-13T15:12:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.542+0000 7f02a7e00700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0284066730 0x7f0284068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.546+0000 7f02a7e00700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0284066730 0x7f0284068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f02980012e0 tx=0x7f0298009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.546+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02a815cfc0 con 0x7f02a80b2170 2024-09-13T15:12:46.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.738+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02a815d960 con 0x7f02a80b2170 2024-09-13T15:12:46.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.742+0000 7f02a4c00700 1 -- 172.21.15.50:0/592646906 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17139 (secure 0 0 0) 0x7f02a815d960 con 0x7f02a80b2170 2024-09-13T15:12:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:46.747 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":107,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:21.866926+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6834/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6835/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6837/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.181:6836/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6835/2577107387":"2024-09-14T15:12:14.657185+0000","172.21.15.50:6834/2577107387":"2024-09-14T15:12:14.657185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0284066730 msgr2=0x7f0284068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0284066730 0x7f0284068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f02980012e0 tx=0x7f0298009040 comp rx=0 tx=0).stop 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 msgr2=0x7f02a815f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 0x7f02a815f770 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f02900010e0 tx=0x7f029000c7d0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 shutdown_connections 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0284066730 0x7f0284068bf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02a8157fb0 0x7f02a815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a80b2170 0x7f02a815f770 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 --2- 172.21.15.50:0/592646906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f02a8071b30 0x7f02a8147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 >> 172.21.15.50:0/592646906 conn(0x7f02a80b0d90 msgr2=0x7f02a8155410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:46.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 shutdown_connections 2024-09-13T15:12:46.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.746+0000 7f02ad800700 1 -- 172.21.15.50:0/592646906 wait complete. 2024-09-13T15:12:46.774 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:12:46.774 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.938+0000 7ff658a00700 1 Processor -- start 2024-09-13T15:12:46.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.938+0000 7ff658a00700 1 -- start start 2024-09-13T15:12:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff658a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff654143db0 0x7ff65406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff658a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6540b4f50 0x7ff65415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff658a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65406f210 con 0x7ff65406edd0 2024-09-13T15:12:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff658a00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6540b5380 con 0x7ff654143db0 2024-09-13T15:12:46.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff658a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff654144190 con 0x7ff6540b4f50 2024-09-13T15:12:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff652800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff654143db0 0x7ff65406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff651e00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff65406edd0 0x7ff6540b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43198/0 (socket says 172.21.15.50:43198) 2024-09-13T15:12:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff651e00700 1 -- 172.21.15.50:0/3798393337 learned_addr learned my addr 172.21.15.50:0/3798393337 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff653200700 1 --2- 172.21.15.50:0/3798393337 >> v2:172.21.15.181:3300/0 conn(0x7ff6540b4f50 0x7ff65415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff651400700 1 -- 172.21.15.50:0/3798393337 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116385475 0 0) 0x7ff65406f210 con 0x7ff65406edd0 2024-09-13T15:12:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff651400700 1 -- 172.21.15.50:0/3798393337 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6380035d0 con 0x7ff65406edd0 2024-09-13T15:12:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff652800700 1 -- 172.21.15.50:0/3798393337 >> v2:172.21.15.181:3300/0 conn(0x7ff6540b4f50 msgr2=0x7ff65415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff652800700 1 --2- 172.21.15.50:0/3798393337 >> v2:172.21.15.181:3300/0 conn(0x7ff6540b4f50 0x7ff65415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff652800700 1 -- 172.21.15.50:0/3798393337 >> v1:172.21.15.50:6789/0 conn(0x7ff65406edd0 legacy=0x7ff6540b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.942+0000 7ff652800700 1 -- 172.21.15.50:0/3798393337 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540b55e0 con 0x7ff654143db0 2024-09-13T15:12:46.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff652800700 1 --2- 172.21.15.50:0/3798393337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65406e890 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff6540cd230 tx=0x7ff644009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0369c0ec1dc902 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff651400700 1 -- 172.21.15.50:0/3798393337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644011830 con 0x7ff654143db0 2024-09-13T15:12:46.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff651400700 1 -- 172.21.15.50:0/3798393337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644011990 con 0x7ff654143db0 2024-09-13T15:12:46.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff651400700 1 -- 172.21.15.50:0/3798393337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644011d20 con 0x7ff654143db0 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 -- 172.21.15.50:0/3798393337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 msgr2=0x7ff65406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 --2- 172.21.15.50:0/3798393337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65406e890 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff6540cd230 tx=0x7ff644009b30 comp rx=0 tx=0).stop 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 -- 172.21.15.50:0/3798393337 shutdown_connections 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 --2- 172.21.15.50:0/3798393337 >> v2:172.21.15.181:3300/0 conn(0x7ff6540b4f50 0x7ff65415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 --2- 172.21.15.50:0/3798393337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65406e890 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 -- 172.21.15.50:0/3798393337 >> 172.21.15.50:0/3798393337 conn(0x7ff654071d80 msgr2=0x7ff654072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 -- 172.21.15.50:0/3798393337 shutdown_connections 2024-09-13T15:12:46.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 -- 172.21.15.50:0/3798393337 wait complete. 2024-09-13T15:12:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 Processor -- start 2024-09-13T15:12:46.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.946+0000 7ff658a00700 1 -- start start 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff65406edd0 0x7ff654159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6540b4f50 0x7ff6541f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65413a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540cab50 con 0x7ff654143db0 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540cb9b0 con 0x7ff65406edd0 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540cada0 con 0x7ff6540b4f50 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65413a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65413a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58916/0 (socket says 172.21.15.50:58916) 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 -- 172.21.15.50:0/1928099036 learned_addr learned my addr 172.21.15.50:0/1928099036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:46.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff652800700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff65406edd0 0x7ff654159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff651e00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6540b4f50 0x7ff6541f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 -- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6540b4f50 msgr2=0x7ff6541f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6540b4f50 0x7ff6541f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 -- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff65406edd0 msgr2=0x7ff654159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff65406edd0 0x7ff654159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 -- 172.21.15.50:0/1928099036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440094b0 con 0x7ff654143db0 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff652800700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff65406edd0 0x7ff654159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff653200700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65413a7a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009dd0 tx=0x7ff64c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00cd40 con 0x7ff654143db0 2024-09-13T15:12:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00f040 con 0x7ff654143db0 2024-09-13T15:12:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6540cb080 con 0x7ff654143db0 2024-09-13T15:12:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0146c0 con 0x7ff654143db0 2024-09-13T15:12:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.950+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6540cb640 con 0x7ff654143db0 2024-09-13T15:12:46.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.954+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6540cbb40 con 0x7ff654143db0 2024-09-13T15:12:46.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.954+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff64c014820 con 0x7ff654143db0 2024-09-13T15:12:46.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.954+0000 7ff64aa00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff634066730 0x7ff634068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.958+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7ff64c085080 con 0x7ff654143db0 2024-09-13T15:12:46.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.958+0000 7ff652800700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff634066730 0x7ff634068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:46.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.958+0000 7ff652800700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff634066730 0x7ff634068bf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff644000c00 tx=0x7ff644008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:46.962+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff64c0b6db0 con 0x7ff654143db0 2024-09-13T15:12:47.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.190+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff65406e890 con 0x7ff654143db0 2024-09-13T15:12:47.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.190+0000 7ff64aa00700 1 -- 172.21.15.50:0/1928099036 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4744 (secure 0 0 0) 0x7ff64c018020 con 0x7ff654143db0 2024-09-13T15:12:47.197 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:47.197 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:30.173706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7650,"mds_1":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":1,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff634066730 msgr2=0x7ff634068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff634066730 0x7ff634068bf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff644000c00 tx=0x7ff644008030 comp rx=0 tx=0).stop 2024-09-13T15:12:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 msgr2=0x7ff65413a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65413a7a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009dd0 tx=0x7ff64c00c3a0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 shutdown_connections 2024-09-13T15:12:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff634066730 0x7ff634068bf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff654143db0 0x7ff65413a7a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6540b4f50 0x7ff6541f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 --2- 172.21.15.50:0/1928099036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff65406edd0 0x7ff654159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 >> 172.21.15.50:0/1928099036 conn(0x7ff654071d80 msgr2=0x7ff65415c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 shutdown_connections 2024-09-13T15:12:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.194+0000 7ff658a00700 1 -- 172.21.15.50:0/1928099036 wait complete. 2024-09-13T15:12:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 68 2024-09-13T15:12:47.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:47.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc7200700 1 Processor -- start 2024-09-13T15:12:47.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc7200700 1 -- start start 2024-09-13T15:12:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cc815b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc7200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc80b2fb0 con 0x7f7cc80b2b70 2024-09-13T15:12:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc7200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc80b3200 con 0x7f7cc8071420 2024-09-13T15:12:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80b34e0 con 0x7f7cc806d280 2024-09-13T15:12:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc5400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7cc80b2b70 0x7f7cc815b060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43214/0 (socket says 172.21.15.50:43214) 2024-09-13T15:12:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc5400700 1 -- 172.21.15.50:0/1976916527 learned_addr learned my addr 172.21.15.50:0/1976916527 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc6800700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cc815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546941097 0 0) 0x7f7cc80b2fb0 con 0x7f7cc80b2b70 2024-09-13T15:12:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cac0035d0 con 0x7f7cc80b2b70 2024-09-13T15:12:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2276370942 0 0) 0x7f7cac0035d0 con 0x7f7cc80b2b70 2024-09-13T15:12:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 msgr2=0x7f7cc815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cc815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 >> v1:172.21.15.181:6789/0 conn(0x7f7cc8071420 legacy=0x7f7cc8071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc80b37c0 con 0x7f7cc80b2b70 2024-09-13T15:12:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f7cb4001670 con 0x7f7cc80b2b70 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 >> v1:172.21.15.50:6789/0 conn(0x7f7cc80b2b70 legacy=0x7f7cc815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.398+0000 7f7cc4a00700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cac003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cac003f90 0x7f7cac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac004db0 0x7f7cac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80b34e0 con 0x7f7cac003f90 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac00fea0 con 0x7f7cac004db0 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac010060 con 0x7f7cc806d280 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cac003f90 0x7f7cac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc6800700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac004db0 0x7f7cac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5e00700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cac003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 -- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 msgr2=0x7f7cac003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cac003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 -- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac004db0 msgr2=0x7f7cac005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac004db0 0x7f7cac005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 -- 172.21.15.50:0/1976916527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0035d0 con 0x7f7cac003f90 2024-09-13T15:12:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5e00700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cc806d280 0x7f7cac003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc5400700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cac003f90 0x7f7cac004870 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c240 tx=0x7f7cac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40a066d8c32999b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400ccc0 con 0x7f7cac003f90 2024-09-13T15:12:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400ce20 con 0x7f7cac003f90 2024-09-13T15:12:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc4a00700 1 -- 172.21.15.50:0/1976916527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4005ba0 con 0x7f7cac003f90 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc7200700 1 -- 172.21.15.50:0/1976916527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cac003f90 msgr2=0x7f7cac004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.402+0000 7f7cc7200700 1 --2- 172.21.15.50:0/1976916527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cac003f90 0x7f7cac004870 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c240 tx=0x7f7cac0058a0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc6800700 1 -- 172.21.15.50:0/1976916527 reap_dead start 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc7200700 1 -- 172.21.15.50:0/1976916527 shutdown_connections 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc7200700 1 -- 172.21.15.50:0/1976916527 >> 172.21.15.50:0/1976916527 conn(0x7f7cc80b0d90 msgr2=0x7f7cc806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc7200700 1 -- 172.21.15.50:0/1976916527 shutdown_connections 2024-09-13T15:12:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc7200700 1 -- 172.21.15.50:0/1976916527 wait complete. 2024-09-13T15:12:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc7200700 1 Processor -- start 2024-09-13T15:12:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.406+0000 7f7cc7200700 1 -- start start 2024-09-13T15:12:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cac003f90 0x7f7cc815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cc81563d0 0x7f7cc81390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 0x7f7cc815c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc815c9a0 con 0x7f7cc815bfb0 2024-09-13T15:12:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8139b40 con 0x7f7cc81563d0 2024-09-13T15:12:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8139630 con 0x7f7cac003f90 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 0x7f7cc815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 0x7f7cc815c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58932/0 (socket says 172.21.15.50:58932) 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 -- 172.21.15.50:0/2152726247 learned_addr learned my addr 172.21.15.50:0/2152726247 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc5e00700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cac003f90 0x7f7cc815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc5400700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cc81563d0 0x7f7cc81390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 -- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cac003f90 msgr2=0x7f7cc815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cac003f90 0x7f7cc815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 -- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cc81563d0 msgr2=0x7f7cc81390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cc81563d0 0x7f7cc81390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 -- 172.21.15.50:0/2152726247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc813c2d0 con 0x7f7cc815bfb0 2024-09-13T15:12:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc6800700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 0x7f7cc815c460 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0011bf0 tx=0x7f7cc0011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000e040 con 0x7f7cc815bfb0 2024-09-13T15:12:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000f040 con 0x7f7cc815bfb0 2024-09-13T15:12:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000fd80 con 0x7f7cc815bfb0 2024-09-13T15:12:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8156830 con 0x7f7cc815bfb0 2024-09-13T15:12:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.410+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc813c570 con 0x7f7cc815bfb0 2024-09-13T15:12:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.414+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc80b3200 con 0x7f7cc815bfb0 2024-09-13T15:12:47.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.414+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7cc0015430 con 0x7f7cc815bfb0 2024-09-13T15:12:47.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.418+0000 7f7cbe000700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ca8066760 0x7f7ca8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.418+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f7cc00847f0 con 0x7f7cc815bfb0 2024-09-13T15:12:47.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.418+0000 7f7cc5e00700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ca8066760 0x7f7ca8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.418+0000 7f7cc5e00700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ca8066760 0x7f7ca8068c20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8007fd0 tx=0x7f7cb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:47.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.422+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7cc00518f0 con 0x7f7cc815bfb0 2024-09-13T15:12:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.654+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cc8066440 con 0x7f7cc815bfb0 2024-09-13T15:12:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.658+0000 7f7cbe000700 1 -- 172.21.15.50:0/2152726247 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4744 (secure 0 0 0) 0x7f7cc0054f10 con 0x7f7cc815bfb0 2024-09-13T15:12:47.663 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:47.663 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:12:00.010021+0000","modified":"2024-09-13T15:12:30.173706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7650,"mds_1":7647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7647":{"gid":7647,"name":"c","rank":1,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6834/3584876987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3584876987},{"type":"v1","addr":"172.21.15.50:6834","nonce":3584876987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7650":{"gid":7650,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/359103955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":359103955},{"type":"v1","addr":"172.21.15.50:6835","nonce":359103955}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ca8066760 msgr2=0x7f7ca8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ca8066760 0x7f7ca8068c20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8007fd0 tx=0x7f7cb8009040 comp rx=0 tx=0).stop 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 msgr2=0x7f7cc815c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 0x7f7cc815c460 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0011bf0 tx=0x7f7cc0011f00 comp rx=0 tx=0).stop 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 shutdown_connections 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7ca8066760 0x7f7ca8068c20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc815bfb0 0x7f7cc815c460 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cc81563d0 0x7f7cc81390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 --2- 172.21.15.50:0/2152726247 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cac003f90 0x7f7cc815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 >> 172.21.15.50:0/2152726247 conn(0x7f7cc80b0d90 msgr2=0x7f7cc80aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 shutdown_connections 2024-09-13T15:12:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.662+0000 7f7cc7200700 1 -- 172.21.15.50:0/2152726247 wait complete. 2024-09-13T15:12:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 68 2024-09-13T15:12:47.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 Processor -- start 2024-09-13T15:12:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 -- start start 2024-09-13T15:12:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd088071420 0x7fd0880b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08815b060 0x7fd08815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0880b3200 con 0x7fd08806d280 2024-09-13T15:12:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0880b34e0 con 0x7fd088071420 2024-09-13T15:12:47.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b37c0 con 0x7fd08815b060 2024-09-13T15:12:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd087e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd088071420 0x7fd0880b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd08ce00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08815b060 0x7fd08815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd087e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd088071420 0x7fd0880b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58938/0 (socket says 172.21.15.50:58938) 2024-09-13T15:12:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.854+0000 7fd087e00700 1 -- 172.21.15.50:0/1681964489 learned_addr learned my addr 172.21.15.50:0/1681964489 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd087e00700 1 -- 172.21.15.50:0/1681964489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08815b060 msgr2=0x7fd08815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd087e00700 1 --2- 172.21.15.50:0/1681964489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08815b060 0x7fd08815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd087e00700 1 -- 172.21.15.50:0/1681964489 >> v1:172.21.15.50:6789/0 conn(0x7fd08806d280 legacy=0x7fd088071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd087e00700 1 -- 172.21.15.50:0/1681964489 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880b3aa0 con 0x7fd088071420 2024-09-13T15:12:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd086a00700 1 -- 172.21.15.50:0/1681964489 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620685876 0 0) 0x7fd0880b3200 con 0x7fd08806d280 2024-09-13T15:12:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd087e00700 1 --2- 172.21.15.50:0/1681964489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd088071420 0x7fd0880b2b70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd078009910 tx=0x7fd078009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7870d5fc8ed0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd086a00700 1 -- 172.21.15.50:0/1681964489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078011830 con 0x7fd088071420 2024-09-13T15:12:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd086a00700 1 -- 172.21.15.50:0/1681964489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078011990 con 0x7fd088071420 2024-09-13T15:12:47.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd086a00700 1 -- 172.21.15.50:0/1681964489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078011d40 con 0x7fd088071420 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 -- 172.21.15.50:0/1681964489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd088071420 msgr2=0x7fd0880b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 --2- 172.21.15.50:0/1681964489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd088071420 0x7fd0880b2b70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd078009910 tx=0x7fd078009c20 comp rx=0 tx=0).stop 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 -- 172.21.15.50:0/1681964489 shutdown_connections 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 --2- 172.21.15.50:0/1681964489 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd08815b060 0x7fd08815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 --2- 172.21.15.50:0/1681964489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd088071420 0x7fd0880b2b70 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 -- 172.21.15.50:0/1681964489 >> 172.21.15.50:0/1681964489 conn(0x7fd0880b0d90 msgr2=0x7fd08806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:47.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 -- 172.21.15.50:0/1681964489 shutdown_connections 2024-09-13T15:12:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.858+0000 7fd08d800700 1 -- 172.21.15.50:0/1681964489 wait complete. 2024-09-13T15:12:47.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 Processor -- start 2024-09-13T15:12:47.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 -- start start 2024-09-13T15:12:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08806d280 0x7fd088132160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd088071420 0x7fd088132860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 0x7fd0880aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0881e31d0 con 0x7fd08815b060 2024-09-13T15:12:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088135740 con 0x7fd08806d280 2024-09-13T15:12:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08d800700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0881e2830 con 0x7fd088071420 2024-09-13T15:12:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 0x7fd0880aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 0x7fd0880aaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58946/0 (socket says 172.21.15.50:58946) 2024-09-13T15:12:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 -- 172.21.15.50:0/210061459 learned_addr learned my addr 172.21.15.50:0/210061459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd087e00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08806d280 0x7fd088132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd087400700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd088071420 0x7fd088132860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 -- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd088071420 msgr2=0x7fd088132860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd088071420 0x7fd088132860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 -- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08806d280 msgr2=0x7fd088132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08806d280 0x7fd088132160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 -- 172.21.15.50:0/210061459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078009570 con 0x7fd08815b060 2024-09-13T15:12:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.862+0000 7fd08ce00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 0x7fd0880aaee0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd08000efc0 tx=0x7fd08000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000cad0 con 0x7fd08815b060 2024-09-13T15:12:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000f040 con 0x7fd08815b060 2024-09-13T15:12:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0881e2b10 con 0x7fd08815b060 2024-09-13T15:12:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000ce70 con 0x7fd08815b060 2024-09-13T15:12:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd088132da0 con 0x7fd08815b060 2024-09-13T15:12:47.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0881e3310 con 0x7fd08815b060 2024-09-13T15:12:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.866+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd080014480 con 0x7fd08815b060 2024-09-13T15:12:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.870+0000 7fd07fe00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd068066730 0x7fd068068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.870+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fd080084b80 con 0x7fd08815b060 2024-09-13T15:12:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.870+0000 7fd087e00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd068066730 0x7fd068068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.870+0000 7fd087e00700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd068066730 0x7fd068068bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd078000c00 tx=0x7fd078008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:47.874+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd0881e3310 con 0x7fd08815b060 2024-09-13T15:12:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.062+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0881e3310 con 0x7fd08815b060 2024-09-13T15:12:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.066+0000 7fd07fe00700 1 -- 172.21.15.50:0/210061459 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17139 (secure 0 0 0) 0x7fd0881e3310 con 0x7fd08815b060 2024-09-13T15:12:48.073 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:48.073 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":107,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:21.866926+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:11:58.177796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T15:11:59.008477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.181:6834/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6835/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6837/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.181:6836/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6835/2577107387":"2024-09-14T15:12:14.657185+0000","172.21.15.50:6834/2577107387":"2024-09-14T15:12:14.657185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd068066730 msgr2=0x7fd068068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd068066730 0x7fd068068bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd078000c00 tx=0x7fd078008030 comp rx=0 tx=0).stop 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 msgr2=0x7fd0880aaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 0x7fd0880aaee0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd08000efc0 tx=0x7fd08000c0c0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 shutdown_connections 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fd068066730 0x7fd068068bf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08815b060 0x7fd0880aaee0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd088071420 0x7fd088132860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 --2- 172.21.15.50:0/210061459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd08806d280 0x7fd088132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 >> 172.21.15.50:0/210061459 conn(0x7fd0880b0d90 msgr2=0x7fd088141ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 shutdown_connections 2024-09-13T15:12:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.070+0000 7fd08d800700 1 -- 172.21.15.50:0/210061459 wait complete. 2024-09-13T15:12:48.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:12:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.266+0000 7f241be00700 1 Processor -- start 2024-09-13T15:12:48.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.266+0000 7f241be00700 1 -- start start 2024-09-13T15:12:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241be00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f241c1590c0 0x7f241c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241be00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f241c06b940 0x7f241c06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241be00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0b38a0 con 0x7f241c0cd570 2024-09-13T15:12:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241be00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0b4420 con 0x7f241c1590c0 2024-09-13T15:12:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241be00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c1594a0 con 0x7f241c06b940 2024-09-13T15:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f241c1590c0 0x7f241c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f241c1590c0 0x7f241c06c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58956/0 (socket says 172.21.15.50:58956) 2024-09-13T15:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 -- 172.21.15.50:0/24046981 learned_addr learned my addr 172.21.15.50:0/24046981 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f2412000700 1 --1- 172.21.15.50:0/24046981 >> v1:172.21.15.50:6789/0 conn(0x7f241c0cd570 0x7f241c0cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43232/0 (socket says 172.21.15.50:43232) 2024-09-13T15:12:48.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241b400700 1 --2- 172.21.15.50:0/24046981 >> v2:172.21.15.181:3300/0 conn(0x7f241c06b940 0x7f241c06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 -- 172.21.15.50:0/24046981 >> v2:172.21.15.181:3300/0 conn(0x7f241c06b940 msgr2=0x7f241c06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:48.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 --2- 172.21.15.50:0/24046981 >> v2:172.21.15.181:3300/0 conn(0x7f241c06b940 0x7f241c06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 -- 172.21.15.50:0/24046981 >> v1:172.21.15.50:6789/0 conn(0x7f241c0cd570 legacy=0x7f241c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 -- 172.21.15.50:0/24046981 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0b3b80 con 0x7f241c1590c0 2024-09-13T15:12:48.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241aa00700 1 --2- 172.21.15.50:0/24046981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c1590c0 0x7f241c06c520 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f241c0732a0 tx=0x7f240c00adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ee3b93675b15fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.270+0000 7f241a000700 1 -- 172.21.15.50:0/24046981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c00cb30 con 0x7f241c1590c0 2024-09-13T15:12:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241a000700 1 -- 172.21.15.50:0/24046981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c00cc90 con 0x7f241c1590c0 2024-09-13T15:12:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241a000700 1 -- 172.21.15.50:0/24046981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c018400 con 0x7f241c1590c0 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 -- 172.21.15.50:0/24046981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c1590c0 msgr2=0x7f241c06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 --2- 172.21.15.50:0/24046981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c1590c0 0x7f241c06c520 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f241c0732a0 tx=0x7f240c00adc0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 -- 172.21.15.50:0/24046981 shutdown_connections 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 --2- 172.21.15.50:0/24046981 >> v2:172.21.15.181:3300/0 conn(0x7f241c06b940 0x7f241c06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 --2- 172.21.15.50:0/24046981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c1590c0 0x7f241c06c520 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 -- 172.21.15.50:0/24046981 >> 172.21.15.50:0/24046981 conn(0x7f241c0af470 msgr2=0x7f241c071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 -- 172.21.15.50:0/24046981 shutdown_connections 2024-09-13T15:12:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.274+0000 7f241be00700 1 -- 172.21.15.50:0/24046981 wait complete. 2024-09-13T15:12:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 Processor -- start 2024-09-13T15:12:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 -- start start 2024-09-13T15:12:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f241c06b940 0x7f241c0a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 0x7f241c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f241c1590c0 0x7f241c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0aae70 con 0x7f241c0cd570 2024-09-13T15:12:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0a9de0 con 0x7f241c06b940 2024-09-13T15:12:48.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0a9820 con 0x7f241c1590c0 2024-09-13T15:12:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 0x7f241c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 0x7f241c0c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58962/0 (socket says 172.21.15.50:58962) 2024-09-13T15:12:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 -- 172.21.15.50:0/2154900322 learned_addr learned my addr 172.21.15.50:0/2154900322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241b400700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f241c1590c0 0x7f241c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241aa00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f241c06b940 0x7f241c0a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 -- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f241c1590c0 msgr2=0x7f241c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f241c1590c0 0x7f241c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 -- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f241c06b940 msgr2=0x7f241c0a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f241c06b940 0x7f241c0a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 -- 172.21.15.50:0/2154900322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c00a710 con 0x7f241c0cd570 2024-09-13T15:12:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2412000700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 0x7f241c0c43e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f240400c500 tx=0x7f240400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404005cd0 con 0x7f241c0cd570 2024-09-13T15:12:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2404005e30 con 0x7f241c0cd570 2024-09-13T15:12:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24040072f0 con 0x7f241c0cd570 2024-09-13T15:12:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c0a9b00 con 0x7f241c0cd570 2024-09-13T15:12:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.278+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c156730 con 0x7f241c0cd570 2024-09-13T15:12:48.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.282+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c156950 con 0x7f241c0cd570 2024-09-13T15:12:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.282+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2404007450 con 0x7f241c0cd570 2024-09-13T15:12:48.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.282+0000 7f2413400700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f23f8066730 0x7f23f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.286+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f2404083710 con 0x7f241c0cd570 2024-09-13T15:12:48.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.286+0000 7f241aa00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f23f8066730 0x7f23f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.286+0000 7f241aa00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f23f8066730 0x7f23f8068bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f240c000c00 tx=0x7f240c01b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:48.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.290+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f241c156950 con 0x7f241c0cd570 2024-09-13T15:12:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.514+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f241c0aafb0 con 0x7f241c0cd570 2024-09-13T15:12:48.521 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-13T15:12:48.514+0000 7f5f7ec00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:12:48.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f2413400700 1 -- 172.21.15.50:0/2154900322 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f241c0aafb0 con 0x7f241c0cd570 2024-09-13T15:12:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f23f8066730 msgr2=0x7f23f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f23f8066730 0x7f23f8068bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f240c000c00 tx=0x7f240c01b040 comp rx=0 tx=0).stop 2024-09-13T15:12:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 msgr2=0x7f241c0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 0x7f241c0c43e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f240400c500 tx=0x7f240400c810 comp rx=0 tx=0).stop 2024-09-13T15:12:48.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 shutdown_connections 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f23f8066730 0x7f23f8068bf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f241c1590c0 0x7f241c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f241c0cd570 0x7f241c0c43e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 --2- 172.21.15.50:0/2154900322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f241c06b940 0x7f241c0a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 >> 172.21.15.50:0/2154900322 conn(0x7f241c0af470 msgr2=0x7f241c06fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 shutdown_connections 2024-09-13T15:12:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.530+0000 7f241be00700 1 -- 172.21.15.50:0/2154900322 wait complete. 2024-09-13T15:12:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:12:48.551 INFO:tasks.ceph.mds.a.smithi050.stderr: -4803> 2024-09-13T15:12:20.839+0000 7fb3a9a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:12:48.557 INFO:tasks.ceph.mds.a.smithi050.stderr: -2836> 2024-09-13T15:12:25.839+0000 7fb3a9a00700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T15:12:48.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:12:48.611 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-13T15:12:48.613 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-13T15:12:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.734+0000 7f1cd0c00700 1 Processor -- start 2024-09-13T15:12:48.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.734+0000 7f1cd0c00700 1 -- start start 2024-09-13T15:12:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1cd0c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ccc0725f0 0x7f1ccc06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1cd0c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc15bc60 con 0x7f1ccc15f120 2024-09-13T15:12:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1cd0c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc15b070 con 0x7f1ccc0ce800 2024-09-13T15:12:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1cd0c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc155550 con 0x7f1ccc0725f0 2024-09-13T15:12:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1ccaa00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ccc15f120 0x7f1ccc071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43262/0 (socket says 172.21.15.50:43262) 2024-09-13T15:12:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1ccaa00700 1 -- 172.21.15.50:0/2448503149 learned_addr learned my addr 172.21.15.50:0/2448503149 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.738+0000 7f1ccbe00700 1 --2- 172.21.15.50:0/2448503149 >> v2:172.21.15.181:3300/0 conn(0x7f1ccc0725f0 0x7f1ccc06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cca000700 1 -- 172.21.15.50:0/2448503149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722821794 0 0) 0x7f1ccc15bc60 con 0x7f1ccc15f120 2024-09-13T15:12:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cca000700 1 -- 172.21.15.50:0/2448503149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb00035d0 con 0x7f1ccc15f120 2024-09-13T15:12:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1ccbe00700 1 -- 172.21.15.50:0/2448503149 >> v1:172.21.15.181:6789/0 conn(0x7f1ccc0ce800 legacy=0x7f1ccc06a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1ccbe00700 1 -- 172.21.15.50:0/2448503149 >> v1:172.21.15.50:6789/0 conn(0x7f1ccc15f120 legacy=0x7f1ccc071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1ccbe00700 1 -- 172.21.15.50:0/2448503149 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc15b330 con 0x7f1ccc0725f0 2024-09-13T15:12:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1ccbe00700 1 --2- 172.21.15.50:0/2448503149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc06cf10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009d90 tx=0x7f1cc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7135a9232f11897c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cca000700 1 -- 172.21.15.50:0/2448503149 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400e070 con 0x7f1ccc0725f0 2024-09-13T15:12:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cca000700 1 -- 172.21.15.50:0/2448503149 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400bb20 con 0x7f1ccc0725f0 2024-09-13T15:12:48.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cca000700 1 -- 172.21.15.50:0/2448503149 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4012430 con 0x7f1ccc0725f0 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 -- 172.21.15.50:0/2448503149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 msgr2=0x7f1ccc06cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/2448503149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc06cf10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009d90 tx=0x7f1cc400b330 comp rx=0 tx=0).stop 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 -- 172.21.15.50:0/2448503149 shutdown_connections 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/2448503149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc06cf10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 -- 172.21.15.50:0/2448503149 >> 172.21.15.50:0/2448503149 conn(0x7f1ccc0cbc20 msgr2=0x7f1ccc0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 -- 172.21.15.50:0/2448503149 shutdown_connections 2024-09-13T15:12:48.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.742+0000 7f1cd0c00700 1 -- 172.21.15.50:0/2448503149 wait complete. 2024-09-13T15:12:48.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 Processor -- start 2024-09-13T15:12:48.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 -- start start 2024-09-13T15:12:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ccc0ce800 0x7f1ccc148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 0x7f1ccc159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1493e0 con 0x7f1ccc15f120 2024-09-13T15:12:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1496c0 con 0x7f1ccc0725f0 2024-09-13T15:12:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1cd0c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1499a0 con 0x7f1ccc0ce800 2024-09-13T15:12:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 0x7f1ccc159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 0x7f1ccc159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59002/0 (socket says 172.21.15.50:59002) 2024-09-13T15:12:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 -- 172.21.15.50:0/3235100794 learned_addr learned my addr 172.21.15.50:0/3235100794 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccb400700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccaa00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ccc0ce800 0x7f1ccc148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 -- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ccc0ce800 msgr2=0x7f1ccc148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ccc0ce800 0x7f1ccc148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 -- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 msgr2=0x7f1ccc140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccbe00700 1 -- 172.21.15.50:0/3235100794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009a70 con 0x7f1ccc15f120 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.746+0000 7f1ccb400700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1ccbe00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 0x7f1ccc159ab0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4013000 tx=0x7f1cc4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4012430 con 0x7f1ccc15f120 2024-09-13T15:12:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4020070 con 0x7f1ccc15f120 2024-09-13T15:12:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc145a20 con 0x7f1ccc15f120 2024-09-13T15:12:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4004280 con 0x7f1ccc15f120 2024-09-13T15:12:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc149c80 con 0x7f1ccc15f120 2024-09-13T15:12:48.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.750+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc145880 con 0x7f1ccc15f120 2024-09-13T15:12:48.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.754+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1cc40043e0 con 0x7f1ccc15f120 2024-09-13T15:12:48.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.754+0000 7f1cc3400700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1cac066730 0x7f1cac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:48.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.754+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6488+0+0 (secure 0 0 0) 0x7f1cc4022070 con 0x7f1ccc15f120 2024-09-13T15:12:48.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.754+0000 7f1ccb400700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1cac066730 0x7f1cac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:48.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.754+0000 7f1ccb400700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1cac066730 0x7f1cac068bf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc000f60 tx=0x7f1cbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:48.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.762+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ccc145880 con 0x7f1ccc15f120 2024-09-13T15:12:48.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:48.978+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1ccc145880 con 0x7f1ccc15f120 2024-09-13T15:12:49.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.534+0000 7f1cc3400700 1 -- 172.21.15.50:0/3235100794 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ccc145880 con 0x7f1ccc15f120 2024-09-13T15:12:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1cac066730 msgr2=0x7f1cac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1cac066730 0x7f1cac068bf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc000f60 tx=0x7f1cbc009040 comp rx=0 tx=0).stop 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 msgr2=0x7f1ccc159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 0x7f1ccc159ab0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4013000 tx=0x7f1cc4004af0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 shutdown_connections 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f1cac066730 0x7f1cac068bf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ccc15f120 0x7f1ccc159ab0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ccc0ce800 0x7f1ccc148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 --2- 172.21.15.50:0/3235100794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ccc0725f0 0x7f1ccc140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 >> 172.21.15.50:0/3235100794 conn(0x7f1ccc0cbc20 msgr2=0x7f1ccc0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 shutdown_connections 2024-09-13T15:12:49.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.538+0000 7f1cd0c00700 1 -- 172.21.15.50:0/3235100794 wait complete. 2024-09-13T15:12:49.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:12:49.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.746+0000 7f2673200700 1 Processor -- start 2024-09-13T15:12:49.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.746+0000 7f2673200700 1 -- start start 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2673200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f267406ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2673200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26740726b0 0x7f26740cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2673200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267415bf50 con 0x7f267415bab0 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2673200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740cec00 con 0x7f26740726b0 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2673200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267406c0c0 con 0x7f2674158890 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2672800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26740726b0 0x7f26740cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:49.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2672800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26740726b0 0x7f26740cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59014/0 (socket says 172.21.15.50:59014) 2024-09-13T15:12:49.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2672800700 1 -- 172.21.15.50:0/3096482354 learned_addr learned my addr 172.21.15.50:0/3096482354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:49.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.750+0000 7f2671e00700 1 --2- 172.21.15.50:0/3096482354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f267406ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:49.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2672800700 1 -- 172.21.15.50:0/3096482354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 msgr2=0x7f267406ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:49.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2672800700 1 --2- 172.21.15.50:0/3096482354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f267406ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2672800700 1 -- 172.21.15.50:0/3096482354 >> v1:172.21.15.181:6789/0 conn(0x7f267415bab0 legacy=0x7f2674071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2672800700 1 -- 172.21.15.50:0/3096482354 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267406c3a0 con 0x7f26740726b0 2024-09-13T15:12:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2672800700 1 --2- 172.21.15.50:0/3096482354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26740726b0 0x7f26740cd020 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f266c009e50 tx=0x7f266c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e9550069f2370e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2670a00700 1 -- 172.21.15.50:0/3096482354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00e070 con 0x7f26740726b0 2024-09-13T15:12:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2670a00700 1 -- 172.21.15.50:0/3096482354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00b9c0 con 0x7f26740726b0 2024-09-13T15:12:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2670a00700 1 -- 172.21.15.50:0/3096482354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00bd70 con 0x7f26740726b0 2024-09-13T15:12:49.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 -- 172.21.15.50:0/3096482354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26740726b0 msgr2=0x7f26740cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:49.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 --2- 172.21.15.50:0/3096482354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26740726b0 0x7f26740cd020 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f266c009e50 tx=0x7f266c00b330 comp rx=0 tx=0).stop 2024-09-13T15:12:49.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 -- 172.21.15.50:0/3096482354 shutdown_connections 2024-09-13T15:12:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 --2- 172.21.15.50:0/3096482354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26740726b0 0x7f26740cd020 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 --2- 172.21.15.50:0/3096482354 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f267406ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 -- 172.21.15.50:0/3096482354 >> 172.21.15.50:0/3096482354 conn(0x7f26740cbc20 msgr2=0x7f26740cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 -- 172.21.15.50:0/3096482354 shutdown_connections 2024-09-13T15:12:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.754+0000 7f2673200700 1 -- 172.21.15.50:0/3096482354 wait complete. 2024-09-13T15:12:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 Processor -- start 2024-09-13T15:12:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 -- start start 2024-09-13T15:12:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 0x7f2674154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f2674154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f267415bab0 0x7f26740c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674154790 con 0x7f267415bab0 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674155880 con 0x7f26740726b0 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2673200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2674157490 con 0x7f2674158890 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2671e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 0x7f2674154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2671e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 0x7f2674154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:35088/0 (socket says 172.21.15.50:35088) 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2671e00700 1 -- 172.21.15.50:0/3646730182 learned_addr learned my addr 172.21.15.50:0/3646730182 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2671400700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f2674154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.758+0000 7f2672800700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f267415bab0 0x7f26740c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2671e00700 1 -- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 msgr2=0x7f2674154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2671e00700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f2674154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2671e00700 1 -- 172.21.15.50:0/3646730182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f267415bab0 msgr2=0x7f26740c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2671e00700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f267415bab0 0x7f26740c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2671e00700 1 -- 172.21.15.50:0/3646730182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c009b30 con 0x7f26740726b0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2671e00700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 0x7f2674154e50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f266400e760 tx=0x7f266400ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400c070 con 0x7f26740726b0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664013610 con 0x7f26740726b0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664013980 con 0x7f26740726b0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2674157770 con 0x7f26740726b0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2674155ad0 con 0x7f26740726b0 2024-09-13T15:12:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.762+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267406a340 con 0x7f26740726b0 2024-09-13T15:12:49.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.766+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2664013ae0 con 0x7f26740726b0 2024-09-13T15:12:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.766+0000 7f266a000700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2654066760 0x7f2654068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.766+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6488+0+0 (secure 0 0 0) 0x7f2664084440 con 0x7f26740726b0 2024-09-13T15:12:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.766+0000 7f2671400700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2654066760 0x7f2654068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.770+0000 7f2671400700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2654066760 0x7f2654068c20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2674158da0 tx=0x7f2660009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:49.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.778+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2664051480 con 0x7f26740726b0 2024-09-13T15:12:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:49.962+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2674158dd0 con 0x7f26740726b0 2024-09-13T15:12:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.546+0000 7f266a000700 1 -- 172.21.15.50:0/3646730182 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2664054aa0 con 0x7f26740726b0 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2654066760 msgr2=0x7f2654068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2654066760 0x7f2654068c20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2674158da0 tx=0x7f2660009040 comp rx=0 tx=0).stop 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 msgr2=0x7f2674154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 0x7f2674154e50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f266400e760 tx=0x7f266400ea70 comp rx=0 tx=0).stop 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 shutdown_connections 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2654066760 0x7f2654068c20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f267415bab0 0x7f26740c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2674158890 0x7f2674154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 --2- 172.21.15.50:0/3646730182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26740726b0 0x7f2674154e50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 >> 172.21.15.50:0/3646730182 conn(0x7f26740cbc20 msgr2=0x7f26740af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 shutdown_connections 2024-09-13T15:12:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.550+0000 7f2673200700 1 -- 172.21.15.50:0/3646730182 wait complete. 2024-09-13T15:12:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:12:50.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:12:50.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.762+0000 7f0433200700 1 Processor -- start 2024-09-13T15:12:50.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.762+0000 7f0433200700 1 -- start start 2024-09-13T15:12:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0433200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f043415a960 0x7f043415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0433200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f04340cdac0 0x7f043406e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0433200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043406e940 con 0x7f043406def0 2024-09-13T15:12:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0433200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043406ec20 con 0x7f043415a960 2024-09-13T15:12:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0433200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043406ef00 con 0x7f04340cdac0 2024-09-13T15:12:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f043415a960 0x7f043415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f043415a960 0x7f043415ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59032/0 (socket says 172.21.15.50:59032) 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 -- 172.21.15.50:0/2634725966 learned_addr learned my addr 172.21.15.50:0/2634725966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0432800700 1 --2- 172.21.15.50:0/2634725966 >> v2:172.21.15.181:3300/0 conn(0x7f04340cdac0 0x7f043406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 -- 172.21.15.50:0/2634725966 >> v2:172.21.15.181:3300/0 conn(0x7f04340cdac0 msgr2=0x7f043406e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 --2- 172.21.15.50:0/2634725966 >> v2:172.21.15.181:3300/0 conn(0x7f04340cdac0 0x7f043406e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 -- 172.21.15.50:0/2634725966 >> v1:172.21.15.50:6789/0 conn(0x7f043406def0 legacy=0x7f04340cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.766+0000 7f0431e00700 1 -- 172.21.15.50:0/2634725966 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340b5470 con 0x7f043415a960 2024-09-13T15:12:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0431e00700 1 --2- 172.21.15.50:0/2634725966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043415a960 0x7f043415ad40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f04340cfe10 tx=0x7f0424009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7146d7c4027719 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0430a00700 1 -- 172.21.15.50:0/2634725966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400b8a0 con 0x7f043415a960 2024-09-13T15:12:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0430a00700 1 -- 172.21.15.50:0/2634725966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042400ba00 con 0x7f043415a960 2024-09-13T15:12:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0430a00700 1 -- 172.21.15.50:0/2634725966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400bd90 con 0x7f043415a960 2024-09-13T15:12:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 -- 172.21.15.50:0/2634725966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043415a960 msgr2=0x7f043415ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 --2- 172.21.15.50:0/2634725966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043415a960 0x7f043415ad40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f04340cfe10 tx=0x7f0424009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 -- 172.21.15.50:0/2634725966 shutdown_connections 2024-09-13T15:12:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 --2- 172.21.15.50:0/2634725966 >> v2:172.21.15.181:3300/0 conn(0x7f04340cdac0 0x7f043406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 --2- 172.21.15.50:0/2634725966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f043415a960 0x7f043415ad40 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 -- 172.21.15.50:0/2634725966 >> 172.21.15.50:0/2634725966 conn(0x7f04340b26b0 msgr2=0x7f04340b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 -- 172.21.15.50:0/2634725966 shutdown_connections 2024-09-13T15:12:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.770+0000 7f0433200700 1 -- 172.21.15.50:0/2634725966 wait complete. 2024-09-13T15:12:50.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 Processor -- start 2024-09-13T15:12:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 -- start start 2024-09-13T15:12:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f043406def0 0x7f0434142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 0x7f0434143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f043415a960 0x7f0434158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04340ca2a0 con 0x7f04340cdac0 2024-09-13T15:12:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0434143950 con 0x7f043415a960 2024-09-13T15:12:50.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0433200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04340c6700 con 0x7f043406def0 2024-09-13T15:12:50.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 0x7f0434143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 0x7f0434143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59036/0 (socket says 172.21.15.50:59036) 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 -- 172.21.15.50:0/3475795758 learned_addr learned my addr 172.21.15.50:0/3475795758 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431e00700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f043406def0 0x7f0434142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0432800700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f043415a960 0x7f0434158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 -- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f043406def0 msgr2=0x7f0434142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f043406def0 0x7f0434142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 -- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f043415a960 msgr2=0x7f0434158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f043415a960 0x7f0434158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:50.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 -- 172.21.15.50:0/3475795758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0424009570 con 0x7f04340cdac0 2024-09-13T15:12:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f0431400700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 0x7f0434143410 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f042000c500 tx=0x7f042000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.774+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200052d0 con 0x7f04340cdac0 2024-09-13T15:12:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.778+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420005430 con 0x7f04340cdac0 2024-09-13T15:12:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.778+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04340cba10 con 0x7f04340cdac0 2024-09-13T15:12:50.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.778+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200055a0 con 0x7f04340cdac0 2024-09-13T15:12:50.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.778+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04340cbfd0 con 0x7f04340cdac0 2024-09-13T15:12:50.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.778+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043406e360 con 0x7f04340cdac0 2024-09-13T15:12:50.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.778+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04200036a0 con 0x7f04340cdac0 2024-09-13T15:12:50.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.782+0000 7f042a000700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0414066730 0x7f0414068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:50.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.782+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6050+0+0 (secure 0 0 0) 0x7f0420083490 con 0x7f04340cdac0 2024-09-13T15:12:50.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.782+0000 7f0431e00700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0414066730 0x7f0414068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:50.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.782+0000 7f0431e00700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0414066730 0x7f0414068bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0424000c00 tx=0x7f0424008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:50.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.786+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0420050690 con 0x7f04340cdac0 2024-09-13T15:12:50.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:50.970+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04340cc190 con 0x7f04340cdac0 2024-09-13T15:12:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.554+0000 7f042a000700 1 -- 172.21.15.50:0/3475795758 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0420053cb0 con 0x7f04340cdac0 2024-09-13T15:12:51.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0414066730 msgr2=0x7f0414068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0414066730 0x7f0414068bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0424000c00 tx=0x7f0424008030 comp rx=0 tx=0).stop 2024-09-13T15:12:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 msgr2=0x7f0434143410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 0x7f0434143410 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f042000c500 tx=0x7f042000c810 comp rx=0 tx=0).stop 2024-09-13T15:12:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 shutdown_connections 2024-09-13T15:12:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0414066730 0x7f0414068bf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f043415a960 0x7f0434158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04340cdac0 0x7f0434143410 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 --2- 172.21.15.50:0/3475795758 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f043406def0 0x7f0434142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 >> 172.21.15.50:0/3475795758 conn(0x7f04340b26b0 msgr2=0x7f04340701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 shutdown_connections 2024-09-13T15:12:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.558+0000 7f0433200700 1 -- 172.21.15.50:0/3475795758 wait complete. 2024-09-13T15:12:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-13T15:12:51.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:12:51.592 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:12:51.666 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.667 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-09-13T15:12:51.668 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.669 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on skipped message = False 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-09-13T15:12:51.670 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:12:51.671 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2024-09-13T15:12:51.672 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-09-13T15:12:51.673 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-09-13T15:12:51.674 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-09-13T15:12:51.675 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on pool no app = False 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-09-13T15:12:51.676 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = "" 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-09-13T15:12:51.677 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-13T15:12:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-13T15:12:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-13T15:12:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 73923987-4656-4194-a4fe-9d4ec875d2d3 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-13T15:12:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-13T15:12:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-13T15:12:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-13T15:12:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-13T15:12:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-13T15:12:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:12:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-13T15:12:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-09-13T15:12:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-09-13T15:12:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-09-13T15:12:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-09-13T15:12:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-13T15:12:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-13T15:12:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-13T15:12:51.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T15:12:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 Processor -- start 2024-09-13T15:12:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 -- start start 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe00b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabe00cf830 0x7fabe00cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00b4680 con 0x7fabe006c5a0 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe015aeb0 con 0x7fabe00cf830 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabe4c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b4960 con 0x7fabe015aa90 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabdf400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fabe006c5a0 0x7fabe006c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43290/0 (socket says 172.21.15.50:43290) 2024-09-13T15:12:51.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabdf400700 1 -- 172.21.15.50:0/2914024802 learned_addr learned my addr 172.21.15.50:0/2914024802 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:51.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.866+0000 7fabdfe00700 1 --2- 172.21.15.50:0/2914024802 >> v2:172.21.15.50:3300/0 conn(0x7fabe00cf830 0x7fabe00cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:51.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabdea00700 1 --2- 172.21.15.50:0/2914024802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe00b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:51.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabde000700 1 -- 172.21.15.50:0/2914024802 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928146628 0 0) 0x7fabe00b4680 con 0x7fabe006c5a0 2024-09-13T15:12:51.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabde000700 1 -- 172.21.15.50:0/2914024802 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc40035d0 con 0x7fabe006c5a0 2024-09-13T15:12:51.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabdfe00700 1 -- 172.21.15.50:0/2914024802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 msgr2=0x7fabe00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:51.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabdfe00700 1 --2- 172.21.15.50:0/2914024802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe00b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabdfe00700 1 -- 172.21.15.50:0/2914024802 >> v1:172.21.15.50:6789/0 conn(0x7fabe006c5a0 legacy=0x7fabe006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:51.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabdfe00700 1 -- 172.21.15.50:0/2914024802 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00cf030 con 0x7fabe00cf830 2024-09-13T15:12:51.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabdfe00700 1 --2- 172.21.15.50:0/2914024802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe00cf830 0x7fabe00cfc80 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04b1b5b64b87cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:51.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabde000700 1 -- 172.21.15.50:0/2914024802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800e070 con 0x7fabe00cf830 2024-09-13T15:12:51.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabde000700 1 -- 172.21.15.50:0/2914024802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800bb20 con 0x7fabe00cf830 2024-09-13T15:12:51.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabde000700 1 -- 172.21.15.50:0/2914024802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8012430 con 0x7fabe00cf830 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 -- 172.21.15.50:0/2914024802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe00cf830 msgr2=0x7fabe00cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2914024802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe00cf830 0x7fabe00cfc80 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd800b330 comp rx=0 tx=0).stop 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 -- 172.21.15.50:0/2914024802 shutdown_connections 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2914024802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe00cf830 0x7fabe00cfc80 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2914024802 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe00b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 -- 172.21.15.50:0/2914024802 >> 172.21.15.50:0/2914024802 conn(0x7fabe0071d20 msgr2=0x7fabe0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 -- 172.21.15.50:0/2914024802 shutdown_connections 2024-09-13T15:12:51.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.870+0000 7fabe4c00700 1 -- 172.21.15.50:0/2914024802 wait complete. 2024-09-13T15:12:51.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 Processor -- start 2024-09-13T15:12:51.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 -- start start 2024-09-13T15:12:51.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 0x7fabe0154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:51.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabe00cf830 0x7fabe00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0154550 con 0x7fabe006c5a0 2024-09-13T15:12:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00cb100 con 0x7fabe00cf830 2024-09-13T15:12:51.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.874+0000 7fabe4c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0145340 con 0x7fabe015aa90 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 0x7fabe0154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 0x7fabe0154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59056/0 (socket says 172.21.15.50:59056) 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 -- 172.21.15.50:0/2861015243 learned_addr learned my addr 172.21.15.50:0/2861015243 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdfe00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdea00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabe00cf830 0x7fabe00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 -- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 msgr2=0x7fabe014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 -- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabe00cf830 msgr2=0x7fabe00cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:51.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabe00cf830 0x7fabe00cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:51.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 -- 172.21.15.50:0/2861015243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009a70 con 0x7fabe006c5a0 2024-09-13T15:12:51.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdea00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabe00cf830 0x7fabe00cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:51.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabdf400700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 0x7fabe0154010 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c700 tx=0x7fabd000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:51.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0005d90 con 0x7fabe006c5a0 2024-09-13T15:12:51.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00070d0 con 0x7fabe006c5a0 2024-09-13T15:12:51.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe00cb3a0 con 0x7fabe006c5a0 2024-09-13T15:12:51.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007480 con 0x7fabe006c5a0 2024-09-13T15:12:51.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.878+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe00cb960 con 0x7fabe006c5a0 2024-09-13T15:12:51.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.882+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00b4ba0 con 0x7fabe006c5a0 2024-09-13T15:12:51.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.882+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fabd00075e0 con 0x7fabe006c5a0 2024-09-13T15:12:51.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.882+0000 7fabd7400700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabc0066730 0x7fabc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.882+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fabd00836c0 con 0x7fabe006c5a0 2024-09-13T15:12:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.882+0000 7fabdea00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabc0066730 0x7fabc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.886+0000 7fabdea00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabc0066730 0x7fabc0068bf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fabe01f5d40 tx=0x7fabcc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:51.890+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fabd00509f0 con 0x7fabe006c5a0 2024-09-13T15:12:52.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.070+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fabe006c980 con 0x7fabe006c5a0 2024-09-13T15:12:52.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.082+0000 7fabd7400700 1 -- 172.21.15.50:0/2861015243 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fabd0054010 con 0x7fabe006c5a0 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabc0066730 msgr2=0x7fabc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabc0066730 0x7fabc0068bf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fabe01f5d40 tx=0x7fabcc008040 comp rx=0 tx=0).stop 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 msgr2=0x7fabe0154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 0x7fabe0154010 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c700 tx=0x7fabd000ca10 comp rx=0 tx=0).stop 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 shutdown_connections 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fabc0066730 0x7fabc0068bf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fabe015aa90 0x7fabe014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabe00cf830 0x7fabe00cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 --2- 172.21.15.50:0/2861015243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe006c5a0 0x7fabe0154010 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 >> 172.21.15.50:0/2861015243 conn(0x7fabe0071d20 msgr2=0x7fabe006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:52.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 shutdown_connections 2024-09-13T15:12:52.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.086+0000 7fabe4c00700 1 -- 172.21.15.50:0/2861015243 wait complete. 2024-09-13T15:12:52.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-13T15:12:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.286+0000 7fa9f6c00700 1 Processor -- start 2024-09-13T15:12:52.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.286+0000 7fa9f6c00700 1 -- start start 2024-09-13T15:12:52.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f6c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9f006aaa0 0x7fa9f015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:52.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f6c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 0x7fa9f006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:52.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f6c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f015e560 con 0x7fa9f006cbb0 2024-09-13T15:12:52.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f6c00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00adf90 con 0x7fa9f006aaa0 2024-09-13T15:12:52.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f6c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f006b3c0 con 0x7fa9f00b3980 2024-09-13T15:12:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 0x7fa9f006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f5800700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9f006aaa0 0x7fa9f015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f4e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 0x7fa9f006ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:36712/0 (socket says 172.21.15.50:36712) 2024-09-13T15:12:52.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f4e00700 1 -- 172.21.15.50:0/943679204 learned_addr learned my addr 172.21.15.50:0/943679204 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f5800700 1 -- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 msgr2=0x7fa9f006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f5800700 1 --2- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 0x7fa9f006ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f5800700 1 -- 172.21.15.50:0/943679204 >> v1:172.21.15.181:6789/0 conn(0x7fa9f006cbb0 legacy=0x7fa9f006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f5800700 1 -- 172.21.15.50:0/943679204 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f015d920 con 0x7fa9f006aaa0 2024-09-13T15:12:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9efe00700 1 -- 172.21.15.50:0/943679204 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463621501 0 0) 0x7fa9f015e560 con 0x7fa9f006cbb0 2024-09-13T15:12:52.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.290+0000 7fa9f4e00700 1 --2- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 0x7fa9f006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f5800700 1 --2- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f006aaa0 0x7fa9f015d310 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009850 tx=0x7fa9e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa04182a5d908e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9efe00700 1 -- 172.21.15.50:0/943679204 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4011830 con 0x7fa9f006aaa0 2024-09-13T15:12:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9efe00700 1 -- 172.21.15.50:0/943679204 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e4011990 con 0x7fa9f006aaa0 2024-09-13T15:12:52.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9efe00700 1 -- 172.21.15.50:0/943679204 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4011d40 con 0x7fa9f006aaa0 2024-09-13T15:12:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 -- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f006aaa0 msgr2=0x7fa9f015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:52.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f006aaa0 0x7fa9f015d310 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009850 tx=0x7fa9e4009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 -- 172.21.15.50:0/943679204 shutdown_connections 2024-09-13T15:12:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f00b3980 0x7fa9f006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/943679204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f006aaa0 0x7fa9f015d310 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 -- 172.21.15.50:0/943679204 >> 172.21.15.50:0/943679204 conn(0x7fa9f00b0c40 msgr2=0x7fa9f006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 -- 172.21.15.50:0/943679204 shutdown_connections 2024-09-13T15:12:52.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.294+0000 7fa9f6c00700 1 -- 172.21.15.50:0/943679204 wait complete. 2024-09-13T15:12:52.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 Processor -- start 2024-09-13T15:12:52.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 -- start start 2024-09-13T15:12:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f006aaa0 0x7fa9f015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 0x7fa9f00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f00b3980 0x7fa9f01419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00ce600 con 0x7fa9f006cbb0 2024-09-13T15:12:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00cd9f0 con 0x7fa9f00b3980 2024-09-13T15:12:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f6c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00cdcd0 con 0x7fa9f006aaa0 2024-09-13T15:12:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 0x7fa9f00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f4e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 0x7fa9f00cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59072/0 (socket says 172.21.15.50:59072) 2024-09-13T15:12:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.298+0000 7fa9f4e00700 1 -- 172.21.15.50:0/3121454584 learned_addr learned my addr 172.21.15.50:0/3121454584 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f5800700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f006aaa0 0x7fa9f015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f6200700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f00b3980 0x7fa9f01419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f4e00700 1 -- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f006aaa0 msgr2=0x7fa9f015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f4e00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f006aaa0 0x7fa9f015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f4e00700 1 -- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f00b3980 msgr2=0x7fa9f01419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f4e00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f00b3980 0x7fa9f01419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f4e00700 1 -- 172.21.15.50:0/3121454584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc009570 con 0x7fa9f006cbb0 2024-09-13T15:12:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f4e00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 0x7fa9f00cd180 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00ebe0 tx=0x7fa9dc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00c850 con 0x7fa9f006cbb0 2024-09-13T15:12:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00c9b0 con 0x7fa9f006cbb0 2024-09-13T15:12:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e40094b0 con 0x7fa9f006cbb0 2024-09-13T15:12:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00cd60 con 0x7fa9f006cbb0 2024-09-13T15:12:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f00ce290 con 0x7fa9f006cbb0 2024-09-13T15:12:52.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.302+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f00730b0 con 0x7fa9f006cbb0 2024-09-13T15:12:52.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.306+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9dc013470 con 0x7fa9f006cbb0 2024-09-13T15:12:52.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.306+0000 7fa9ed600700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9d0066730 0x7fa9d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.306+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa9dc0841c0 con 0x7fa9f006cbb0 2024-09-13T15:12:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.310+0000 7fa9f5800700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9d0066730 0x7fa9d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.310+0000 7fa9f5800700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9d0066730 0x7fa9d0068bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40090b0 tx=0x7fa9e401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:52.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.310+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9dc051580 con 0x7fa9f006cbb0 2024-09-13T15:12:52.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:52.578+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7fa9f006b090 con 0x7fa9f006cbb0 2024-09-13T15:12:53.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.562+0000 7fa9ed600700 1 -- 172.21.15.50:0/3121454584 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v314) v1 ==== 145+0+0 (secure 0 0 0) 0x7fa9dc054ba0 con 0x7fa9f006cbb0 2024-09-13T15:12:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9d0066730 msgr2=0x7fa9d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9d0066730 0x7fa9d0068bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40090b0 tx=0x7fa9e401c040 comp rx=0 tx=0).stop 2024-09-13T15:12:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 msgr2=0x7fa9f00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 0x7fa9f00cd180 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00ebe0 tx=0x7fa9dc00eef0 comp rx=0 tx=0).stop 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 shutdown_connections 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa9d0066730 0x7fa9d0068bf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9f00b3980 0x7fa9f01419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9f006cbb0 0x7fa9f00cd180 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 --2- 172.21.15.50:0/3121454584 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa9f006aaa0 0x7fa9f015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 >> 172.21.15.50:0/3121454584 conn(0x7fa9f00b0c40 msgr2=0x7fa9f0070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 shutdown_connections 2024-09-13T15:12:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:53.566+0000 7fa9f6c00700 1 -- 172.21.15.50:0/3121454584 wait complete. 2024-09-13T15:12:53.597 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2024-09-13T15:12:53.597 INFO:tasks.cephfs_test_runner: 2024-09-13T15:12:53.597 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T15:12:53.598 INFO:tasks.cephfs_test_runner:Ran 6 tests in 257.995s 2024-09-13T15:12:53.598 INFO:tasks.cephfs_test_runner: 2024-09-13T15:12:53.598 INFO:tasks.cephfs_test_runner:OK (skipped=2) 2024-09-13T15:12:53.598 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T15:12:53.607 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T15:12:53.681 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T15:12:53.681 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:53.681 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:53.698 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:12:53.698 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-13T15:12:53.698 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:53.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349936k,nr_inodes=4087484,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T15:12:53.765 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:53.765 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:53.785 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:12:53.785 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T15:12:53.785 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:12:53.845 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346752k,nr_inodes=4086688,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6567 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T15:12:53.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:53.846 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:12:53.864 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:12:53.864 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:12:53.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:53.865 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:12:53.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:53.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:12:54.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:54.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-13T15:12:54.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:54.606 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-13T15:12:54.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:54.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-13T15:12:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-09-13T15:12:55.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:12:55.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:55.085 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:12:55.103 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:12:55.103 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T15:12:55.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:55.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:12:55.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:55.183 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T15:12:55.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:55.649 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-09-13T15:12:55.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:55.785 DEBUG:teuthology.orchestra.run.smithi181:> ip netns list 2024-09-13T15:12:55.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:12:55.803 DEBUG:teuthology.orchestra.run.smithi181:> sudo ip link delete ceph-brx 2024-09-13T15:12:56.254 INFO:teuthology.orchestra.run.smithi181.stderr:Cannot find device "ceph-brx" 2024-09-13T15:12:56.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:12:56.257 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T15:12:56.266 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T15:12:56.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:12:56.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.442+0000 7f3cfa400700 1 Processor -- start 2024-09-13T15:12:56.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.446+0000 7f3cfa400700 1 -- start start 2024-09-13T15:12:56.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.446+0000 7f3cfa400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3cf40cc6f0 0x7f3cf415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.446+0000 7f3cfa400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cf406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.446+0000 7f3cfa400700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40ccb40 con 0x7f3cf40cb020 2024-09-13T15:12:56.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cfa400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf406b430 con 0x7f3cf40cc6f0 2024-09-13T15:12:56.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cfa400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40b2ad0 con 0x7f3cf406aaa0 2024-09-13T15:12:56.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3cf40cb020 0x7f3cf415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36114/0 (socket says 172.21.15.50:36114) 2024-09-13T15:12:56.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 -- 172.21.15.50:0/3029598244 learned_addr learned my addr 172.21.15.50:0/3029598244 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cebe00700 1 --2- 172.21.15.50:0/3029598244 >> v2:172.21.15.181:3300/0 conn(0x7f3cf40cc6f0 0x7f3cf415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9a00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cf406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403132173 0 0) 0x7f3cf40ccb40 con 0x7f3cf40cb020 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd80035d0 con 0x7f3cf40cb020 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777047981 0 0) 0x7f3cd80035d0 con 0x7f3cf40cb020 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 msgr2=0x7f3cf406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cf406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 >> v2:172.21.15.181:3300/0 conn(0x7f3cf40cc6f0 msgr2=0x7f3cf415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 --2- 172.21.15.50:0/3029598244 >> v2:172.21.15.181:3300/0 conn(0x7f3cf40cc6f0 0x7f3cf415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf415b960 con 0x7f3cf40cb020 2024-09-13T15:12:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7f3ce4001670 con 0x7f3cf40cb020 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 >> v1:172.21.15.50:6789/0 conn(0x7f3cf40cb020 legacy=0x7f3cf415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd8003a90 0x7f3cd8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cd8004870 0x7f3cd8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cd8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf406b430 con 0x7f3cd8003a90 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40b2ad0 con 0x7f3cd8004870 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd800ba30 con 0x7f3cf406aaa0 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd8003a90 0x7f3cd8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9a00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cd8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cebe00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cd8004870 0x7f3cd8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 -- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 msgr2=0x7f3cd8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cd8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 -- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cd8004870 msgr2=0x7f3cd8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cd8004870 0x7f3cd8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 -- 172.21.15.50:0/3029598244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80035d0 con 0x7f3cd8003a90 2024-09-13T15:12:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9a00700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cf406aaa0 0x7f3cd8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:56.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf9000700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd8003a90 0x7f3cd8003eb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400c350 tx=0x7f3cd80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9fcfffd7a386a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400ce50 con 0x7f3cd8003a90 2024-09-13T15:12:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce4005980 con 0x7f3cd8003a90 2024-09-13T15:12:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.450+0000 7f3cf3e00700 1 -- 172.21.15.50:0/3029598244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4005d30 con 0x7f3cd8003a90 2024-09-13T15:12:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cfa400700 1 -- 172.21.15.50:0/3029598244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd8003a90 msgr2=0x7f3cd8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cfa400700 1 --2- 172.21.15.50:0/3029598244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cd8003a90 0x7f3cd8003eb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400c350 tx=0x7f3cd80058a0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cf9a00700 1 -- 172.21.15.50:0/3029598244 reap_dead start 2024-09-13T15:12:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cfa400700 1 -- 172.21.15.50:0/3029598244 shutdown_connections 2024-09-13T15:12:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cfa400700 1 -- 172.21.15.50:0/3029598244 >> 172.21.15.50:0/3029598244 conn(0x7f3cf40b0c40 msgr2=0x7f3cf406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cfa400700 1 -- 172.21.15.50:0/3029598244 shutdown_connections 2024-09-13T15:12:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.454+0000 7f3cfa400700 1 -- 172.21.15.50:0/3029598244 wait complete. 2024-09-13T15:12:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 Processor -- start 2024-09-13T15:12:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 -- start start 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cd8003a90 0x7f3cf40c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf41e5a60 0x7f3cf4143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 0x7f3cf406c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf406c780 con 0x7f3cf406bdb0 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf4144780 con 0x7f3cf41e5a60 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cfa400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41e5f20 con 0x7f3cd8003a90 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 0x7f3cf406c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 0x7f3cf406c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43128/0 (socket says 172.21.15.50:43128) 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 -- 172.21.15.50:0/2285350740 learned_addr learned my addr 172.21.15.50:0/2285350740 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:56.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9000700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cd8003a90 0x7f3cf40c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cebe00700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf41e5a60 0x7f3cf4143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 -- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cd8003a90 msgr2=0x7f3cf40c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cd8003a90 0x7f3cf40c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 -- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf41e5a60 msgr2=0x7f3cf4143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf41e5a60 0x7f3cf4143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 -- 172.21.15.50:0/2285350740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf41e6200 con 0x7f3cf406bdb0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf9a00700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 0x7f3cf406c240 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4158cb0 tx=0x7f3cec0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec01b070 con 0x7f3cf406bdb0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.458+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec00f040 con 0x7f3cf406bdb0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.462+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00e050 con 0x7f3cf406bdb0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.462+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf41e64e0 con 0x7f3cf406bdb0 2024-09-13T15:12:56.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.462+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf41e6aa0 con 0x7f3cf406bdb0 2024-09-13T15:12:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.462+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf40cb400 con 0x7f3cf406bdb0 2024-09-13T15:12:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.462+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3cec003a40 con 0x7f3cf406bdb0 2024-09-13T15:12:56.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.466+0000 7f3cf1600700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3cd0066730 0x7f3cd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.466+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f3cec084390 con 0x7f3cf406bdb0 2024-09-13T15:12:56.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.466+0000 7f3cf9000700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3cd0066730 0x7f3cd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.466+0000 7f3cf9000700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3cd0066730 0x7f3cd0068bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4008fd0 tx=0x7f3ce400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:56.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.474+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3cec051750 con 0x7f3cf406bdb0 2024-09-13T15:12:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.662+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cf40b2d20 con 0x7f3cd0066730 2024-09-13T15:12:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.670+0000 7f3cf1600700 1 -- 172.21.15.50:0/2285350740 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48170 (secure 0 0 0) 0x7f3ce400cd50 con 0x7f3cd0066730 2024-09-13T15:12:56.675 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3cd0066730 msgr2=0x7f3cd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3cd0066730 0x7f3cd0068bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4008fd0 tx=0x7f3ce400a000 comp rx=0 tx=0).stop 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 msgr2=0x7f3cf406c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 0x7f3cf406c240 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4158cb0 tx=0x7f3cec0104a0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 shutdown_connections 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3cd0066730 0x7f3cd0068bf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf406bdb0 0x7f3cf406c240 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf41e5a60 0x7f3cf4143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 --2- 172.21.15.50:0/2285350740 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3cd8003a90 0x7f3cf40c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 >> 172.21.15.50:0/2285350740 conn(0x7f3cf40b0c40 msgr2=0x7f3cf40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 shutdown_connections 2024-09-13T15:12:56.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.674+0000 7f3cfa400700 1 -- 172.21.15.50:0/2285350740 wait complete. 2024-09-13T15:12:56.681 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:12:56.703 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-13T15:12:56.121634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260700,"kb_used_data":11772,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714020,"statfs":{"total":773094113280,"available":772827156480,"internally_reserved":0,"allocated":12054528,"data_stored":6151121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23657,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-162,"num_write_kb":-82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.597826"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T15:12:21.881934+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:12:21.881934+0000","last_peered":"2024-09-13T15:12:21.881934+0000","last_clean":"2024-09-13T15:12:21.881934+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:12:21.881934+0000","last_undegraded":"2024-09-13T15:12:21.881934+0000","last_fullsized":"2024-09-13T15:12:21.881934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1957888,"data_stored":1211746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.179},"min":{"1min":0.75900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5289999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1899999999999999,"15min":1.26},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4970000000000001,"5min":1.839,"15min":1.839},"last":1.036}]},{"osd":1,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.23,"15min":1.3360000000000001},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.9930000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.284},{"interface":"front","average":{"1min":1.131,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.84999999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.252}]},{"osd":2,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2370000000000001,"15min":1.3600000000000001},"min":{"1min":0.877,"5min":0.5,"15min":0.5},"max":{"1min":1.593,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2749999999999999,"15min":1.3460000000000001},"min":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4690000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2789999999999999,"15min":1.3979999999999999},"min":{"1min":0.86899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6799999999999999,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.341,"15min":1.492},"min":{"1min":1.0009999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.081,"15min":2.081},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1799999999999999,"15min":1.333},"min":{"1min":0.71899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5229999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.147},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3999999999999999},"min":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3700000000000001,"15min":1.5429999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5609999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3320000000000001,"15min":1.474},"min":{"1min":0.621,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8200000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3839999999999999,"15min":1.5609999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8939999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.359},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4199999999999999,"15min":1.601},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.633,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1388544,"data_stored":635877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.111,"15min":1.181},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4870000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1339999999999999,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5409999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.93100000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3799999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.244,"5min":1.252,"15min":1.3340000000000001},"min":{"1min":0.876,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4810000000000001,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.226,"15min":1.284},"min":{"1min":0.997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4990000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.323},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.302,"15min":1.3779999999999999},"min":{"1min":0.85199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5629999999999999,"5min":1.986,"15min":1.986},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.286,"15min":1.3140000000000001},"min":{"1min":0.84099999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.528,"5min":2.746,"15min":2.746},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.278,"5min":1.2869999999999999,"15min":1.373},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6120000000000001,"5min":2.371,"15min":2.371},"last":1.2330000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.242,"15min":1.3540000000000001},"min":{"1min":0.745,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.694,"5min":2.835,"15min":2.835},"last":1.357},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2250000000000001,"15min":1.3500000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.581,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.522}]},{"osd":5,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.27,"15min":1.302},"min":{"1min":0.749,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.635,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.204},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4279999999999999,"15min":1.5680000000000001},"min":{"1min":0.87,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.778,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.83999999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7170000000000001,"5min":2.444,"15min":2.444},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4330000000000001,"15min":1.5249999999999999},"min":{"1min":1.048,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.6970000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.125}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":614211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.121,"15min":1.2649999999999999},"min":{"1min":0.72799999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3300000000000001,"5min":1.869,"15min":1.869},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.3200000000000001},"min":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.458,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.26},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.341},{"interface":"front","average":{"1min":1.115,"5min":1.151,"15min":1.238},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3799999999999999,"5min":2.665,"15min":2.665},"last":1.3879999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1819999999999999,"15min":1.252},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5009999999999999,"5min":2.347,"15min":2.347},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.248,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4790000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1020000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2210000000000001,"15min":1.321},"min":{"1min":0.81000000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.544,"5min":2.524,"15min":2.524},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.3340000000000001,"15min":1.47},"min":{"1min":0.73499999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.538,"5min":2.036,"15min":2.036},"last":1.0229999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.236,"15min":1.361},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":2.012,"15min":2.012},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3100000000000001,"15min":1.456},"min":{"1min":0.78100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.694,"5min":3.117,"15min":3.117},"last":1.167}]},{"osd":6,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.276,"15min":1.4870000000000001},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6060000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.351,"15min":1.5409999999999999},"min":{"1min":0.81200000000000006,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5780000000000001,"5min":2.411,"15min":2.411},"last":1.4790000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.343,"15min":1.5169999999999999},"min":{"1min":0.91100000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.6319999999999999,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.4059999999999999,"15min":1.6240000000000001},"min":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5669999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.444}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1355776,"data_stored":620817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0900000000000001,"15min":1.1499999999999999},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4970000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.153,"15min":1.1930000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.778,"5min":1.78,"15min":1.78},"last":1.244}]},{"osd":1,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.208,"15min":1.25},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.325},{"interface":"front","average":{"1min":1.153,"5min":1.163,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5429999999999999,"5min":1.794,"15min":1.794},"last":1.0820000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.169,"15min":1.1859999999999999},"min":{"1min":0.83399999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5680000000000001,"5min":1.621,"15min":1.621},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.276,"15min":1.3280000000000001},"min":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7909999999999999,"5min":1.887,"15min":1.887},"last":1.5}]},{"osd":3,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.78600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7310000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.248,"15min":1.3240000000000001},"min":{"1min":0.83699999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6899999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2909999999999999,"15min":1.361},"min":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0800000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.403},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.325,"15min":1.383},"min":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8069999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4750000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.234,"15min":1.2929999999999999},"min":{"1min":0.91700000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.921,"5min":2.214,"15min":2.214},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3520000000000001,"15min":1.4279999999999999},"min":{"1min":0.85299999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7709999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.554}]},{"osd":7,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3420000000000001,"15min":1.4259999999999999},"min":{"1min":0.86799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8240000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.409,"15min":1.4830000000000001},"min":{"1min":1.0109999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.016,"5min":2.524,"15min":2.524},"last":1.4410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":613706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.046},"min":{"1min":0.69199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.8420000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.0980000000000001,"15min":1.093},"min":{"1min":0.88,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.9350000000000001,"5min":2.782,"15min":2.782},"last":0.95299999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96599999999999997,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.022},{"interface":"front","average":{"1min":1.115,"5min":1.107,"15min":1.1970000000000001},"min":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8149999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0640000000000001,"15min":1.1799999999999999},"min":{"1min":0.58799999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6479999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.274},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1950000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5349999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3029999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.329,"15min":1.3799999999999999},"min":{"1min":1.0289999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.4169999999999998,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.325,"15min":1.417},"min":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1949999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.228}]},{"osd":5,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4890000000000001},"min":{"1min":1.1519999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.286,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4610000000000001,"15min":1.6339999999999999},"min":{"1min":1.0609999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.4660000000000002,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3899999999999999,"15min":1.48},"min":{"1min":1.0880000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.768,"5min":2.839,"15min":2.839},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4319999999999999,"15min":1.544},"min":{"1min":1.135,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.804,"5min":3.786,"15min":3.786},"last":1.645}]},{"osd":7,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5569999999999999,"15min":1.74},"min":{"1min":1.167,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9139999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.73},{"interface":"front","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.645},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.95,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.764}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1355776,"data_stored":620817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.60299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.379,"5min":1.393,"15min":1.393},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0049999999999999,"15min":1.048},"min":{"1min":0.66000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6060000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.749}]},{"osd":1,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.597,"5min":1.599,"15min":1.599},"last":1.504},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1040000000000001,"15min":1.22},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.518,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.4710000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.008,"15min":1.093},"min":{"1min":0.66400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.681,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.6220000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1,"15min":1.0640000000000001},"min":{"1min":0.61099999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.538,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2829999999999999,"15min":1.3640000000000001},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":2.657,"15min":2.657},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3700000000000001,"15min":1.474},"min":{"1min":0.93700000000000006,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0059999999999998,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":1.1100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.256},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.343,"15min":1.381},"min":{"1min":0.999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6930000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3740000000000001,"15min":1.462},"min":{"1min":1.0620000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7749999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.3},{"interface":"front","average":{"1min":1.361,"5min":1.3919999999999999,"15min":1.454},"min":{"1min":1.0880000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.875,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4610000000000001,"15min":1.5369999999999999},"min":{"1min":1.03,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8740000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.365},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.48,"15min":1.542},"min":{"1min":1.0660000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.0369999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3959999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1347584,"data_stored":614261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.351,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.77400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.603,"5min":1.722,"15min":1.722},"last":1.425}]},{"osd":2,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.276,"5min":1.502,"15min":1.502},"last":1.012},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.052},"min":{"1min":0.68000000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5680000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1220000000000001,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.593,"5min":1.764,"15min":1.764},"last":1.157},{"interface":"front","average":{"1min":1.111,"5min":1.0369999999999999,"15min":1.125},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.8280000000000001,"5min":3.254,"15min":3.254},"last":1.0720000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1870000000000001},"min":{"1min":0.83799999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.494,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3180000000000001,"15min":1.3640000000000001},"min":{"1min":0.95399999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.786,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.333}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2989999999999999,"15min":1.411},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.8340000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2729999999999999,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5660000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.419,"15min":1.4970000000000001},"min":{"1min":1.085,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9319999999999999,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.5329999999999999},"min":{"1min":1.002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7090000000000001,"5min":4.843,"15min":4.843},"last":1.72}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.48,"15min":1.6619999999999999},"min":{"1min":1.0409999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.895,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.899},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3979999999999999,"15min":1.482},"min":{"1min":1.159,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8919999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.752}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1961984,"data_stored":1219686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83899999999999997,"15min":0.92200000000000004},"min":{"1min":0.57999999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3979999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93100000000000005,"15min":0.90800000000000003},"min":{"1min":0.65700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1319999999999999,"15min":1.2789999999999999},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.569,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.083},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":1.2549999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.708,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1100000000000001,"15min":1.1559999999999999},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.754,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":1.1479999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8100000000000001,"5min":2.157,"15min":2.157},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.258,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.704,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.1060000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.419}]},{"osd":5,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.3680000000000001},"min":{"1min":0.92000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6579999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.361,"15min":1.389},"min":{"1min":1.0469999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0960000000000001,"5min":2.367,"15min":2.367},"last":1.321}]},{"osd":6,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":1.2350000000000001,"5min":1.05,"15min":1.05},"max":{"1min":2.0299999999999998,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.526},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.452},"min":{"1min":1.0209999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5149999999999999},"min":{"1min":1.0880000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.909,"5min":3.302,"15min":3.302},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.4219999999999999,"15min":1.464},"min":{"1min":1.194,"5min":0.874,"15min":0.874},"max":{"1min":1.97,"5min":2.266,"15min":2.266},"last":1.5649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:12:56.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:12:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.870+0000 7faa59200700 1 Processor -- start 2024-09-13T15:12:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.870+0000 7faa59200700 1 -- start start 2024-09-13T15:12:56.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa59200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faa540cc6f0 0x7faa5415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa59200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540ccb40 con 0x7faa540cb020 2024-09-13T15:12:56.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa59200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540b2ad0 con 0x7faa5406aaa0 2024-09-13T15:12:56.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa59200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5415b960 con 0x7faa540cc6f0 2024-09-13T15:12:56.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa53400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa540cb020 0x7faa5415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36118/0 (socket says 172.21.15.50:36118) 2024-09-13T15:12:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa53400700 1 -- 172.21.15.50:0/555803938 learned_addr learned my addr 172.21.15.50:0/555803938 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa4aa00700 1 --2- 172.21.15.50:0/555803938 >> v2:172.21.15.181:3300/0 conn(0x7faa540cc6f0 0x7faa5415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa52a00700 1 -- 172.21.15.50:0/555803938 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580839300 0 0) 0x7faa540ccb40 con 0x7faa540cb020 2024-09-13T15:12:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa52a00700 1 -- 172.21.15.50:0/555803938 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa380035d0 con 0x7faa540cb020 2024-09-13T15:12:56.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa4aa00700 1 -- 172.21.15.50:0/555803938 >> v1:172.21.15.181:6789/0 conn(0x7faa5406aaa0 legacy=0x7faa540b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa4aa00700 1 -- 172.21.15.50:0/555803938 >> v1:172.21.15.50:6789/0 conn(0x7faa540cb020 legacy=0x7faa5415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa4aa00700 1 -- 172.21.15.50:0/555803938 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5415bc40 con 0x7faa540cc6f0 2024-09-13T15:12:56.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.874+0000 7faa4aa00700 1 --2- 172.21.15.50:0/555803938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa5415b0e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009850 tx=0x7faa3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d746e5ed84875e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:56.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa52a00700 1 -- 172.21.15.50:0/555803938 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011830 con 0x7faa540cc6f0 2024-09-13T15:12:56.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa52a00700 1 -- 172.21.15.50:0/555803938 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c011990 con 0x7faa540cc6f0 2024-09-13T15:12:56.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa52a00700 1 -- 172.21.15.50:0/555803938 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011d40 con 0x7faa540cc6f0 2024-09-13T15:12:56.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 -- 172.21.15.50:0/555803938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 msgr2=0x7faa5415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 --2- 172.21.15.50:0/555803938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa5415b0e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009850 tx=0x7faa3c009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 -- 172.21.15.50:0/555803938 shutdown_connections 2024-09-13T15:12:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 --2- 172.21.15.50:0/555803938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa5415b0e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 -- 172.21.15.50:0/555803938 >> 172.21.15.50:0/555803938 conn(0x7faa540b0c40 msgr2=0x7faa5406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:56.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 -- 172.21.15.50:0/555803938 shutdown_connections 2024-09-13T15:12:56.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.878+0000 7faa59200700 1 -- 172.21.15.50:0/555803938 wait complete. 2024-09-13T15:12:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 Processor -- start 2024-09-13T15:12:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 -- start start 2024-09-13T15:12:56.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa5406aaa0 0x7faa5414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 0x7faa541e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa540c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541e3cd0 con 0x7faa540cb020 2024-09-13T15:12:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5414cc20 con 0x7faa540cc6f0 2024-09-13T15:12:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa59200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5406fd40 con 0x7faa5406aaa0 2024-09-13T15:12:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa4aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 0x7faa541e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa4aa00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 0x7faa541e51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43142/0 (socket says 172.21.15.50:43142) 2024-09-13T15:12:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa4aa00700 1 -- 172.21.15.50:0/2969845988 learned_addr learned my addr 172.21.15.50:0/2969845988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa53400700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa5406aaa0 0x7faa5414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.882+0000 7faa53e00700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa540c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4aa00700 1 -- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa5406aaa0 msgr2=0x7faa5414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4aa00700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa5406aaa0 0x7faa5414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4aa00700 1 -- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 msgr2=0x7faa540c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4aa00700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa540c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4aa00700 1 -- 172.21.15.50:0/2969845988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0094b0 con 0x7faa540cb020 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa53e00700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa540c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4aa00700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 0x7faa541e51a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7faa3c000c00 tx=0x7faa3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c019ab0 con 0x7faa540cb020 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa541e5a10 con 0x7faa540cb020 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c01e070 con 0x7faa540cb020 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c019e50 con 0x7faa540cb020 2024-09-13T15:12:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa54070000 con 0x7faa540cb020 2024-09-13T15:12:56.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.886+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5415b0e0 con 0x7faa540cb020 2024-09-13T15:12:56.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.890+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa3c01a420 con 0x7faa540cb020 2024-09-13T15:12:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.890+0000 7faa4be00700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa30066730 0x7faa30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.890+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7faa3c085290 con 0x7faa540cb020 2024-09-13T15:12:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.890+0000 7faa53400700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa30066730 0x7faa30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.894+0000 7faa53400700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa30066730 0x7faa30068bf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faa44001560 tx=0x7faa44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:56.898+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faa3c0525d0 con 0x7faa540cb020 2024-09-13T15:12:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.094+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa5415b620 con 0x7faa30066730 2024-09-13T15:12:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.098+0000 7faa4be00700 1 -- 172.21.15.50:0/2969845988 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48170 (secure 0 0 0) 0x7faa44001ec0 con 0x7faa30066730 2024-09-13T15:12:57.106 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa30066730 msgr2=0x7faa30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa30066730 0x7faa30068bf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faa44001560 tx=0x7faa44009040 comp rx=0 tx=0).stop 2024-09-13T15:12:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 msgr2=0x7faa541e51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 0x7faa541e51a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7faa3c000c00 tx=0x7faa3c004770 comp rx=0 tx=0).stop 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 shutdown_connections 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7faa30066730 0x7faa30068bf0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa540cc6f0 0x7faa540c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540cb020 0x7faa541e51a0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 --2- 172.21.15.50:0/2969845988 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7faa5406aaa0 0x7faa5414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 >> 172.21.15.50:0/2969845988 conn(0x7faa540b0c40 msgr2=0x7faa5415d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 shutdown_connections 2024-09-13T15:12:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.102+0000 7faa59200700 1 -- 172.21.15.50:0/2969845988 wait complete. 2024-09-13T15:12:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:12:57.131 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-13T15:12:56.121634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260700,"kb_used_data":11772,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714020,"statfs":{"total":773094113280,"available":772827156480,"internally_reserved":0,"allocated":12054528,"data_stored":6151121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23657,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-162,"num_write_kb":-82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.597826"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T15:12:21.881934+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:12:21.881934+0000","last_peered":"2024-09-13T15:12:21.881934+0000","last_clean":"2024-09-13T15:12:21.881934+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:12:21.881934+0000","last_undegraded":"2024-09-13T15:12:21.881934+0000","last_fullsized":"2024-09-13T15:12:21.881934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1957888,"data_stored":1211746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.179},"min":{"1min":0.75900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5289999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1899999999999999,"15min":1.26},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4970000000000001,"5min":1.839,"15min":1.839},"last":1.036}]},{"osd":1,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.23,"15min":1.3360000000000001},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.9930000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.284},{"interface":"front","average":{"1min":1.131,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.84999999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.252}]},{"osd":2,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2370000000000001,"15min":1.3600000000000001},"min":{"1min":0.877,"5min":0.5,"15min":0.5},"max":{"1min":1.593,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2749999999999999,"15min":1.3460000000000001},"min":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4690000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2789999999999999,"15min":1.3979999999999999},"min":{"1min":0.86899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6799999999999999,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.341,"15min":1.492},"min":{"1min":1.0009999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.081,"15min":2.081},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1799999999999999,"15min":1.333},"min":{"1min":0.71899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5229999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.147},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3999999999999999},"min":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3700000000000001,"15min":1.5429999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5609999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3320000000000001,"15min":1.474},"min":{"1min":0.621,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8200000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3839999999999999,"15min":1.5609999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8939999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.359},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4199999999999999,"15min":1.601},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.633,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1388544,"data_stored":635877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.111,"15min":1.181},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4870000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1339999999999999,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5409999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.93100000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3799999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.244,"5min":1.252,"15min":1.3340000000000001},"min":{"1min":0.876,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4810000000000001,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.226,"15min":1.284},"min":{"1min":0.997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4990000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.323},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.302,"15min":1.3779999999999999},"min":{"1min":0.85199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5629999999999999,"5min":1.986,"15min":1.986},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.286,"15min":1.3140000000000001},"min":{"1min":0.84099999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.528,"5min":2.746,"15min":2.746},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.278,"5min":1.2869999999999999,"15min":1.373},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6120000000000001,"5min":2.371,"15min":2.371},"last":1.2330000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.242,"15min":1.3540000000000001},"min":{"1min":0.745,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.694,"5min":2.835,"15min":2.835},"last":1.357},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2250000000000001,"15min":1.3500000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.581,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.522}]},{"osd":5,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.27,"15min":1.302},"min":{"1min":0.749,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.635,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.204},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4279999999999999,"15min":1.5680000000000001},"min":{"1min":0.87,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.778,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.83999999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7170000000000001,"5min":2.444,"15min":2.444},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4330000000000001,"15min":1.5249999999999999},"min":{"1min":1.048,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.6970000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.125}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":614211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.121,"15min":1.2649999999999999},"min":{"1min":0.72799999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3300000000000001,"5min":1.869,"15min":1.869},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.3200000000000001},"min":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.458,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.26},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.341},{"interface":"front","average":{"1min":1.115,"5min":1.151,"15min":1.238},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3799999999999999,"5min":2.665,"15min":2.665},"last":1.3879999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1819999999999999,"15min":1.252},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5009999999999999,"5min":2.347,"15min":2.347},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.248,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4790000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1020000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2210000000000001,"15min":1.321},"min":{"1min":0.81000000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.544,"5min":2.524,"15min":2.524},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.3340000000000001,"15min":1.47},"min":{"1min":0.73499999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.538,"5min":2.036,"15min":2.036},"last":1.0229999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.236,"15min":1.361},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":2.012,"15min":2.012},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3100000000000001,"15min":1.456},"min":{"1min":0.78100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.694,"5min":3.117,"15min":3.117},"last":1.167}]},{"osd":6,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.276,"15min":1.4870000000000001},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6060000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.351,"15min":1.5409999999999999},"min":{"1min":0.81200000000000006,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5780000000000001,"5min":2.411,"15min":2.411},"last":1.4790000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.343,"15min":1.5169999999999999},"min":{"1min":0.91100000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.6319999999999999,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.4059999999999999,"15min":1.6240000000000001},"min":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5669999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.444}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1355776,"data_stored":620817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0900000000000001,"15min":1.1499999999999999},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4970000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.153,"15min":1.1930000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.778,"5min":1.78,"15min":1.78},"last":1.244}]},{"osd":1,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.208,"15min":1.25},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.325},{"interface":"front","average":{"1min":1.153,"5min":1.163,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5429999999999999,"5min":1.794,"15min":1.794},"last":1.0820000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.169,"15min":1.1859999999999999},"min":{"1min":0.83399999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5680000000000001,"5min":1.621,"15min":1.621},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.276,"15min":1.3280000000000001},"min":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7909999999999999,"5min":1.887,"15min":1.887},"last":1.5}]},{"osd":3,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.78600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7310000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.248,"15min":1.3240000000000001},"min":{"1min":0.83699999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6899999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2909999999999999,"15min":1.361},"min":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0800000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.403},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.325,"15min":1.383},"min":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8069999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4750000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.234,"15min":1.2929999999999999},"min":{"1min":0.91700000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.921,"5min":2.214,"15min":2.214},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3520000000000001,"15min":1.4279999999999999},"min":{"1min":0.85299999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7709999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.554}]},{"osd":7,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3420000000000001,"15min":1.4259999999999999},"min":{"1min":0.86799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8240000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.409,"15min":1.4830000000000001},"min":{"1min":1.0109999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.016,"5min":2.524,"15min":2.524},"last":1.4410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":613706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.046},"min":{"1min":0.69199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.8420000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.0980000000000001,"15min":1.093},"min":{"1min":0.88,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.9350000000000001,"5min":2.782,"15min":2.782},"last":0.95299999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96599999999999997,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.022},{"interface":"front","average":{"1min":1.115,"5min":1.107,"15min":1.1970000000000001},"min":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8149999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0640000000000001,"15min":1.1799999999999999},"min":{"1min":0.58799999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6479999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.274},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1950000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5349999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3029999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.329,"15min":1.3799999999999999},"min":{"1min":1.0289999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.4169999999999998,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.325,"15min":1.417},"min":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1949999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.228}]},{"osd":5,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4890000000000001},"min":{"1min":1.1519999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.286,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4610000000000001,"15min":1.6339999999999999},"min":{"1min":1.0609999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.4660000000000002,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3899999999999999,"15min":1.48},"min":{"1min":1.0880000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.768,"5min":2.839,"15min":2.839},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4319999999999999,"15min":1.544},"min":{"1min":1.135,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.804,"5min":3.786,"15min":3.786},"last":1.645}]},{"osd":7,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5569999999999999,"15min":1.74},"min":{"1min":1.167,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9139999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.73},{"interface":"front","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.645},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.95,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.764}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1355776,"data_stored":620817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.60299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.379,"5min":1.393,"15min":1.393},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0049999999999999,"15min":1.048},"min":{"1min":0.66000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6060000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.749}]},{"osd":1,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.597,"5min":1.599,"15min":1.599},"last":1.504},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1040000000000001,"15min":1.22},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.518,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.4710000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.008,"15min":1.093},"min":{"1min":0.66400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.681,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.6220000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1,"15min":1.0640000000000001},"min":{"1min":0.61099999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.538,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2829999999999999,"15min":1.3640000000000001},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":2.657,"15min":2.657},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3700000000000001,"15min":1.474},"min":{"1min":0.93700000000000006,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0059999999999998,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":1.1100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.256},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.343,"15min":1.381},"min":{"1min":0.999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6930000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3740000000000001,"15min":1.462},"min":{"1min":1.0620000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7749999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.3},{"interface":"front","average":{"1min":1.361,"5min":1.3919999999999999,"15min":1.454},"min":{"1min":1.0880000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.875,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4610000000000001,"15min":1.5369999999999999},"min":{"1min":1.03,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8740000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.365},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.48,"15min":1.542},"min":{"1min":1.0660000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.0369999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3959999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1347584,"data_stored":614261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.351,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.77400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.603,"5min":1.722,"15min":1.722},"last":1.425}]},{"osd":2,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.276,"5min":1.502,"15min":1.502},"last":1.012},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.052},"min":{"1min":0.68000000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5680000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1220000000000001,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.593,"5min":1.764,"15min":1.764},"last":1.157},{"interface":"front","average":{"1min":1.111,"5min":1.0369999999999999,"15min":1.125},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.8280000000000001,"5min":3.254,"15min":3.254},"last":1.0720000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1870000000000001},"min":{"1min":0.83799999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.494,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3180000000000001,"15min":1.3640000000000001},"min":{"1min":0.95399999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.786,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.333}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2989999999999999,"15min":1.411},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.8340000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2729999999999999,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5660000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.419,"15min":1.4970000000000001},"min":{"1min":1.085,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9319999999999999,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.5329999999999999},"min":{"1min":1.002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7090000000000001,"5min":4.843,"15min":4.843},"last":1.72}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.48,"15min":1.6619999999999999},"min":{"1min":1.0409999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.895,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.899},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3979999999999999,"15min":1.482},"min":{"1min":1.159,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8919999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.752}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1961984,"data_stored":1219686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83899999999999997,"15min":0.92200000000000004},"min":{"1min":0.57999999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3979999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93100000000000005,"15min":0.90800000000000003},"min":{"1min":0.65700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1319999999999999,"15min":1.2789999999999999},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.569,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.083},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":1.2549999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.708,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1100000000000001,"15min":1.1559999999999999},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.754,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":1.1479999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8100000000000001,"5min":2.157,"15min":2.157},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.258,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.704,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.1060000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.419}]},{"osd":5,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.3680000000000001},"min":{"1min":0.92000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6579999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.361,"15min":1.389},"min":{"1min":1.0469999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0960000000000001,"5min":2.367,"15min":2.367},"last":1.321}]},{"osd":6,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":1.2350000000000001,"5min":1.05,"15min":1.05},"max":{"1min":2.0299999999999998,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.526},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.452},"min":{"1min":1.0209999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5149999999999999},"min":{"1min":1.0880000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.909,"5min":3.302,"15min":3.302},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.4219999999999999,"15min":1.464},"min":{"1min":1.194,"5min":0.874,"15min":0.874},"max":{"1min":1.97,"5min":2.266,"15min":2.266},"last":1.5649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:12:57.133 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T15:12:57.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:12:57.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.310+0000 7f0fd3000700 1 Processor -- start 2024-09-13T15:12:57.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.310+0000 7f0fd3000700 1 -- start start 2024-09-13T15:12:57.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd3000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0fcc15cd90 0x7f0fcc0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd3000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd3000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc0d1390 con 0x7f0fcc15d170 2024-09-13T15:12:57.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd3000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0b2530 con 0x7f0fcc15cd90 2024-09-13T15:12:57.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd3000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0d05f0 con 0x7f0fcc0cdfe0 2024-09-13T15:12:57.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd1200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0fcc15d170 0x7f0fcc0cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36122/0 (socket says 172.21.15.50:36122) 2024-09-13T15:12:57.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd1200700 1 -- 172.21.15.50:0/2796388012 learned_addr learned my addr 172.21.15.50:0/2796388012 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:57.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd2600700 1 --2- 172.21.15.50:0/2796388012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd1c00700 1 --2- 172.21.15.50:0/2796388012 >> v2:172.21.15.181:3300/0 conn(0x7f0fcc15cd90 0x7f0fcc0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fcbe00700 1 -- 172.21.15.50:0/2796388012 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087875280 0 0) 0x7f0fcc0d1390 con 0x7f0fcc15d170 2024-09-13T15:12:57.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fcbe00700 1 -- 172.21.15.50:0/2796388012 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb40035d0 con 0x7f0fcc15d170 2024-09-13T15:12:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd2600700 1 -- 172.21.15.50:0/2796388012 >> v2:172.21.15.181:3300/0 conn(0x7f0fcc15cd90 msgr2=0x7f0fcc0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd2600700 1 --2- 172.21.15.50:0/2796388012 >> v2:172.21.15.181:3300/0 conn(0x7f0fcc15cd90 0x7f0fcc0b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd2600700 1 -- 172.21.15.50:0/2796388012 >> v1:172.21.15.50:6789/0 conn(0x7f0fcc15d170 legacy=0x7f0fcc0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.314+0000 7f0fd2600700 1 -- 172.21.15.50:0/2796388012 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0d1670 con 0x7f0fcc0cdfe0 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd2600700 1 --2- 172.21.15.50:0/2796388012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0ce450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009d90 tx=0x7f0fc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5407b8ae3dfa4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fcbe00700 1 -- 172.21.15.50:0/2796388012 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400e070 con 0x7f0fcc0cdfe0 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fcbe00700 1 -- 172.21.15.50:0/2796388012 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400bb20 con 0x7f0fcc0cdfe0 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fcbe00700 1 -- 172.21.15.50:0/2796388012 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4012430 con 0x7f0fcc0cdfe0 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 -- 172.21.15.50:0/2796388012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc0cdfe0 msgr2=0x7f0fcc0ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 --2- 172.21.15.50:0/2796388012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0ce450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009d90 tx=0x7f0fc400b330 comp rx=0 tx=0).stop 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 -- 172.21.15.50:0/2796388012 shutdown_connections 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 --2- 172.21.15.50:0/2796388012 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0ce450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 --2- 172.21.15.50:0/2796388012 >> v2:172.21.15.181:3300/0 conn(0x7f0fcc15cd90 0x7f0fcc0b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 -- 172.21.15.50:0/2796388012 >> 172.21.15.50:0/2796388012 conn(0x7f0fcc0d2c10 msgr2=0x7f0fcc0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 -- 172.21.15.50:0/2796388012 shutdown_connections 2024-09-13T15:12:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.318+0000 7f0fd3000700 1 -- 172.21.15.50:0/2796388012 wait complete. 2024-09-13T15:12:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 Processor -- start 2024-09-13T15:12:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 -- start start 2024-09-13T15:12:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 0x7f0fcc0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc15d170 0x7f0fcc0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc1593c0 con 0x7f0fcc15cd90 2024-09-13T15:12:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0b3c10 con 0x7f0fcc0cdfe0 2024-09-13T15:12:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd3000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0b3ef0 con 0x7f0fcc15d170 2024-09-13T15:12:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 0x7f0fcc0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 0x7f0fcc0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43146/0 (socket says 172.21.15.50:43146) 2024-09-13T15:12:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 -- 172.21.15.50:0/597811779 learned_addr learned my addr 172.21.15.50:0/597811779 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1c00700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd2600700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc15d170 0x7f0fcc0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 -- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc15d170 msgr2=0x7f0fcc0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc15d170 0x7f0fcc0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 -- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fcc0cdfe0 msgr2=0x7f0fcc0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 -- 172.21.15.50:0/597811779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4009a70 con 0x7f0fcc15cd90 2024-09-13T15:12:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd2600700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc15d170 0x7f0fcc0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.322+0000 7f0fd1200700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 0x7f0fcc0c6680 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c4d0 tx=0x7f0fb800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.326+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8005d90 con 0x7f0fcc15cd90 2024-09-13T15:12:57.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.326+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb80070d0 con 0x7f0fcc15cd90 2024-09-13T15:12:57.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.326+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc0b41d0 con 0x7f0fcc15cd90 2024-09-13T15:12:57.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.326+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8007480 con 0x7f0fcc15cd90 2024-09-13T15:12:57.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.326+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc0b4790 con 0x7f0fcc15cd90 2024-09-13T15:12:57.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.326+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc0b16b0 con 0x7f0fcc15cd90 2024-09-13T15:12:57.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.330+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0fb80075e0 con 0x7f0fcc15cd90 2024-09-13T15:12:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.330+0000 7f0fc9600700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fac066730 0x7f0fac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.330+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f0fb8083660 con 0x7f0fcc15cd90 2024-09-13T15:12:57.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.330+0000 7f0fd1c00700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fac066730 0x7f0fac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.334+0000 7f0fd1c00700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fac066730 0x7f0fac068bf0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009bf0 tx=0x7f0fc0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:57.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.338+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0fb8050990 con 0x7f0fcc15cd90 2024-09-13T15:12:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.526+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fcc0d1c30 con 0x7f0fac066730 2024-09-13T15:12:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.530+0000 7f0fc9600700 1 -- 172.21.15.50:0/597811779 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48170 (secure 0 0 0) 0x7f0fc00118c0 con 0x7f0fac066730 2024-09-13T15:12:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fac066730 msgr2=0x7f0fac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fac066730 0x7f0fac068bf0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009bf0 tx=0x7f0fc0009240 comp rx=0 tx=0).stop 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 msgr2=0x7f0fcc0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 0x7f0fcc0c6680 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c4d0 tx=0x7f0fb800c7e0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 shutdown_connections 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f0fac066730 0x7f0fac068bf0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0fcc15d170 0x7f0fcc0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fcc15cd90 0x7f0fcc0c6680 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 --2- 172.21.15.50:0/597811779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fcc0cdfe0 0x7f0fcc0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 >> 172.21.15.50:0/597811779 conn(0x7f0fcc0d2c10 msgr2=0x7f0fcc15fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 shutdown_connections 2024-09-13T15:12:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.538+0000 7f0fd3000700 1 -- 172.21.15.50:0/597811779 wait complete. 2024-09-13T15:12:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:12:57.571 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-13T15:12:56.121634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260700,"kb_used_data":11772,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714020,"statfs":{"total":773094113280,"available":772827156480,"internally_reserved":0,"allocated":12054528,"data_stored":6151121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23657,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-162,"num_write_kb":-82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.597826"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T15:12:21.881934+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:12:21.881934+0000","last_peered":"2024-09-13T15:12:21.881934+0000","last_clean":"2024-09-13T15:12:21.881934+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:12:21.881934+0000","last_undegraded":"2024-09-13T15:12:21.881934+0000","last_fullsized":"2024-09-13T15:12:21.881934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1957888,"data_stored":1211746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.179},"min":{"1min":0.75900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5289999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1899999999999999,"15min":1.26},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4970000000000001,"5min":1.839,"15min":1.839},"last":1.036}]},{"osd":1,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.23,"15min":1.3360000000000001},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.9930000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.284},{"interface":"front","average":{"1min":1.131,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.84999999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.252}]},{"osd":2,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2370000000000001,"15min":1.3600000000000001},"min":{"1min":0.877,"5min":0.5,"15min":0.5},"max":{"1min":1.593,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2749999999999999,"15min":1.3460000000000001},"min":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4690000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2789999999999999,"15min":1.3979999999999999},"min":{"1min":0.86899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6799999999999999,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.341,"15min":1.492},"min":{"1min":1.0009999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.081,"15min":2.081},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1799999999999999,"15min":1.333},"min":{"1min":0.71899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5229999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.147},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3999999999999999},"min":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3700000000000001,"15min":1.5429999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5609999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3320000000000001,"15min":1.474},"min":{"1min":0.621,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8200000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3839999999999999,"15min":1.5609999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8939999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.359},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4199999999999999,"15min":1.601},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.633,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1388544,"data_stored":635877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.111,"15min":1.181},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4870000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1339999999999999,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5409999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.93100000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3799999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.244,"5min":1.252,"15min":1.3340000000000001},"min":{"1min":0.876,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4810000000000001,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.226,"15min":1.284},"min":{"1min":0.997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4990000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.323},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.302,"15min":1.3779999999999999},"min":{"1min":0.85199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5629999999999999,"5min":1.986,"15min":1.986},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.286,"15min":1.3140000000000001},"min":{"1min":0.84099999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.528,"5min":2.746,"15min":2.746},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.278,"5min":1.2869999999999999,"15min":1.373},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6120000000000001,"5min":2.371,"15min":2.371},"last":1.2330000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.242,"15min":1.3540000000000001},"min":{"1min":0.745,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.694,"5min":2.835,"15min":2.835},"last":1.357},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2250000000000001,"15min":1.3500000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.581,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.522}]},{"osd":5,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.27,"15min":1.302},"min":{"1min":0.749,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.635,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.204},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4279999999999999,"15min":1.5680000000000001},"min":{"1min":0.87,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.778,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.83999999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7170000000000001,"5min":2.444,"15min":2.444},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4330000000000001,"15min":1.5249999999999999},"min":{"1min":1.048,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.6970000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.125}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":614211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.121,"15min":1.2649999999999999},"min":{"1min":0.72799999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3300000000000001,"5min":1.869,"15min":1.869},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.3200000000000001},"min":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.458,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.26},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.341},{"interface":"front","average":{"1min":1.115,"5min":1.151,"15min":1.238},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3799999999999999,"5min":2.665,"15min":2.665},"last":1.3879999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1819999999999999,"15min":1.252},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5009999999999999,"5min":2.347,"15min":2.347},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.248,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4790000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1020000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2210000000000001,"15min":1.321},"min":{"1min":0.81000000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.544,"5min":2.524,"15min":2.524},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.3340000000000001,"15min":1.47},"min":{"1min":0.73499999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.538,"5min":2.036,"15min":2.036},"last":1.0229999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.236,"15min":1.361},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":2.012,"15min":2.012},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3100000000000001,"15min":1.456},"min":{"1min":0.78100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.694,"5min":3.117,"15min":3.117},"last":1.167}]},{"osd":6,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.276,"15min":1.4870000000000001},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6060000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.351,"15min":1.5409999999999999},"min":{"1min":0.81200000000000006,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5780000000000001,"5min":2.411,"15min":2.411},"last":1.4790000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.343,"15min":1.5169999999999999},"min":{"1min":0.91100000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.6319999999999999,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.4059999999999999,"15min":1.6240000000000001},"min":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5669999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.444}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1355776,"data_stored":620817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0900000000000001,"15min":1.1499999999999999},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4970000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.153,"15min":1.1930000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.778,"5min":1.78,"15min":1.78},"last":1.244}]},{"osd":1,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.208,"15min":1.25},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.325},{"interface":"front","average":{"1min":1.153,"5min":1.163,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5429999999999999,"5min":1.794,"15min":1.794},"last":1.0820000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.169,"15min":1.1859999999999999},"min":{"1min":0.83399999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5680000000000001,"5min":1.621,"15min":1.621},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.276,"15min":1.3280000000000001},"min":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7909999999999999,"5min":1.887,"15min":1.887},"last":1.5}]},{"osd":3,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.78600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7310000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.248,"15min":1.3240000000000001},"min":{"1min":0.83699999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6899999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2909999999999999,"15min":1.361},"min":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0800000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.403},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.325,"15min":1.383},"min":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8069999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4750000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.234,"15min":1.2929999999999999},"min":{"1min":0.91700000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.921,"5min":2.214,"15min":2.214},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3520000000000001,"15min":1.4279999999999999},"min":{"1min":0.85299999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7709999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.554}]},{"osd":7,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3420000000000001,"15min":1.4259999999999999},"min":{"1min":0.86799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8240000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.409,"15min":1.4830000000000001},"min":{"1min":1.0109999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.016,"5min":2.524,"15min":2.524},"last":1.4410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":613706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.046},"min":{"1min":0.69199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.8420000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.0980000000000001,"15min":1.093},"min":{"1min":0.88,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.9350000000000001,"5min":2.782,"15min":2.782},"last":0.95299999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96599999999999997,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.022},{"interface":"front","average":{"1min":1.115,"5min":1.107,"15min":1.1970000000000001},"min":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8149999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0640000000000001,"15min":1.1799999999999999},"min":{"1min":0.58799999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6479999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.274},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1950000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5349999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3029999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.329,"15min":1.3799999999999999},"min":{"1min":1.0289999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.4169999999999998,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.325,"15min":1.417},"min":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1949999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.228}]},{"osd":5,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4890000000000001},"min":{"1min":1.1519999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.286,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4610000000000001,"15min":1.6339999999999999},"min":{"1min":1.0609999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.4660000000000002,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3899999999999999,"15min":1.48},"min":{"1min":1.0880000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.768,"5min":2.839,"15min":2.839},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4319999999999999,"15min":1.544},"min":{"1min":1.135,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.804,"5min":3.786,"15min":3.786},"last":1.645}]},{"osd":7,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5569999999999999,"15min":1.74},"min":{"1min":1.167,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9139999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.73},{"interface":"front","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.645},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.95,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.764}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1355776,"data_stored":620817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.60299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.379,"5min":1.393,"15min":1.393},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0049999999999999,"15min":1.048},"min":{"1min":0.66000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6060000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.749}]},{"osd":1,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.597,"5min":1.599,"15min":1.599},"last":1.504},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1040000000000001,"15min":1.22},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.518,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.4710000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.008,"15min":1.093},"min":{"1min":0.66400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.681,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.6220000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1,"15min":1.0640000000000001},"min":{"1min":0.61099999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.538,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2829999999999999,"15min":1.3640000000000001},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":2.657,"15min":2.657},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3700000000000001,"15min":1.474},"min":{"1min":0.93700000000000006,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0059999999999998,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":1.1100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.256},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.343,"15min":1.381},"min":{"1min":0.999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6930000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3740000000000001,"15min":1.462},"min":{"1min":1.0620000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7749999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.3},{"interface":"front","average":{"1min":1.361,"5min":1.3919999999999999,"15min":1.454},"min":{"1min":1.0880000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.875,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4610000000000001,"15min":1.5369999999999999},"min":{"1min":1.03,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8740000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.365},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.48,"15min":1.542},"min":{"1min":1.0660000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.0369999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3959999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1347584,"data_stored":614261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.351,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.77400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.603,"5min":1.722,"15min":1.722},"last":1.425}]},{"osd":2,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.276,"5min":1.502,"15min":1.502},"last":1.012},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.052},"min":{"1min":0.68000000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5680000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1220000000000001,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.593,"5min":1.764,"15min":1.764},"last":1.157},{"interface":"front","average":{"1min":1.111,"5min":1.0369999999999999,"15min":1.125},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.8280000000000001,"5min":3.254,"15min":3.254},"last":1.0720000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1870000000000001},"min":{"1min":0.83799999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.494,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3180000000000001,"15min":1.3640000000000001},"min":{"1min":0.95399999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.786,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.333}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2989999999999999,"15min":1.411},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.8340000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2729999999999999,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5660000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.419,"15min":1.4970000000000001},"min":{"1min":1.085,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9319999999999999,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.5329999999999999},"min":{"1min":1.002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7090000000000001,"5min":4.843,"15min":4.843},"last":1.72}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.48,"15min":1.6619999999999999},"min":{"1min":1.0409999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.895,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.899},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3979999999999999,"15min":1.482},"min":{"1min":1.159,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8919999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.752}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1961984,"data_stored":1219686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83899999999999997,"15min":0.92200000000000004},"min":{"1min":0.57999999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3979999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93100000000000005,"15min":0.90800000000000003},"min":{"1min":0.65700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.1699999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1319999999999999,"15min":1.2789999999999999},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.569,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.083},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":1.2549999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.708,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1100000000000001,"15min":1.1559999999999999},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.754,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":1.1479999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8100000000000001,"5min":2.157,"15min":2.157},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.258,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.704,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.1060000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.419}]},{"osd":5,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.3680000000000001},"min":{"1min":0.92000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6579999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.361,"15min":1.389},"min":{"1min":1.0469999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0960000000000001,"5min":2.367,"15min":2.367},"last":1.321}]},{"osd":6,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":1.2350000000000001,"5min":1.05,"15min":1.05},"max":{"1min":2.0299999999999998,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.526},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.452},"min":{"1min":1.0209999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5149999999999999},"min":{"1min":1.0880000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.909,"5min":3.302,"15min":3.302},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.4219999999999999,"15min":1.464},"min":{"1min":1.194,"5min":0.874,"15min":0.874},"max":{"1min":1.97,"5min":2.266,"15min":2.266},"last":1.5649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:12:57.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:12:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.742+0000 7f75bbe00700 1 Processor -- start 2024-09-13T15:12:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.742+0000 7f75bbe00700 1 -- start start 2024-09-13T15:12:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75bbe00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f75b41573b0 0x7f75b40cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75bbe00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75b40ce2f0 0x7f75b406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75bbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75bbe00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b406af60 con 0x7f75b40ce2f0 2024-09-13T15:12:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75bbe00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b40ad480 con 0x7f75b41573b0 2024-09-13T15:12:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75bbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4157790 con 0x7f75b406ab10 2024-09-13T15:12:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75b40ce2f0 0x7f75b406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75b40ce2f0 0x7f75b406a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43150/0 (socket says 172.21.15.50:43150) 2024-09-13T15:12:57.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 -- 172.21.15.50:0/906853458 learned_addr learned my addr 172.21.15.50:0/906853458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b9400700 1 --2- 172.21.15.50:0/906853458 >> v2:172.21.15.181:3300/0 conn(0x7f75b41573b0 0x7f75b40cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b9e00700 1 --2- 172.21.15.50:0/906853458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 -- 172.21.15.50:0/906853458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 msgr2=0x7f75b4160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 --2- 172.21.15.50:0/906853458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 -- 172.21.15.50:0/906853458 >> v2:172.21.15.181:3300/0 conn(0x7f75b41573b0 msgr2=0x7f75b40cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 --2- 172.21.15.50:0/906853458 >> v2:172.21.15.181:3300/0 conn(0x7f75b41573b0 0x7f75b40cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 -- 172.21.15.50:0/906853458 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b40ad6d0 con 0x7f75b40ce2f0 2024-09-13T15:12:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b8a00700 1 --2- 172.21.15.50:0/906853458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b40ce2f0 0x7f75b406a5d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f75b40cc4e0 tx=0x7f75a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b12a5d5de41d5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b3e00700 1 -- 172.21.15.50:0/906853458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011830 con 0x7f75b40ce2f0 2024-09-13T15:12:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b3e00700 1 -- 172.21.15.50:0/906853458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0011990 con 0x7f75b40ce2f0 2024-09-13T15:12:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.746+0000 7f75b3e00700 1 -- 172.21.15.50:0/906853458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011d20 con 0x7f75b40ce2f0 2024-09-13T15:12:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 -- 172.21.15.50:0/906853458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b40ce2f0 msgr2=0x7f75b406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 --2- 172.21.15.50:0/906853458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b40ce2f0 0x7f75b406a5d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f75b40cc4e0 tx=0x7f75a0009bf0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 -- 172.21.15.50:0/906853458 shutdown_connections 2024-09-13T15:12:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 --2- 172.21.15.50:0/906853458 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 --2- 172.21.15.50:0/906853458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b40ce2f0 0x7f75b406a5d0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 --2- 172.21.15.50:0/906853458 >> v2:172.21.15.181:3300/0 conn(0x7f75b41573b0 0x7f75b40cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 -- 172.21.15.50:0/906853458 >> 172.21.15.50:0/906853458 conn(0x7f75b40b08d0 msgr2=0x7f75b40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 -- 172.21.15.50:0/906853458 shutdown_connections 2024-09-13T15:12:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.750+0000 7f75bbe00700 1 -- 172.21.15.50:0/906853458 wait complete. 2024-09-13T15:12:57.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 Processor -- start 2024-09-13T15:12:57.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 -- start start 2024-09-13T15:12:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b40ce2f0 0x7f75b4156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 0x7f75b4146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4154d50 con 0x7f75b41573b0 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4155030 con 0x7f75b40ce2f0 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75bbe00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b4155310 con 0x7f75b406ab10 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 0x7f75b4146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 0x7f75b4146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43156/0 (socket says 172.21.15.50:43156) 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 -- 172.21.15.50:0/1679628785 learned_addr learned my addr 172.21.15.50:0/1679628785 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9400700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b8a00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b40ce2f0 0x7f75b4156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 -- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 msgr2=0x7f75b4154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 -- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b40ce2f0 msgr2=0x7f75b4156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.754+0000 7f75b9e00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b40ce2f0 0x7f75b4156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75b9e00700 1 -- 172.21.15.50:0/1679628785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009570 con 0x7f75b41573b0 2024-09-13T15:12:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75b9e00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 0x7f75b4146ea0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00eb60 tx=0x7f75ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac009740 con 0x7f75b41573b0 2024-09-13T15:12:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac009e00 con 0x7f75b41573b0 2024-09-13T15:12:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00ca70 con 0x7f75b41573b0 2024-09-13T15:12:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b41555f0 con 0x7f75b41573b0 2024-09-13T15:12:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b4154a60 con 0x7f75b41573b0 2024-09-13T15:12:57.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.758+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b41f2a50 con 0x7f75b41573b0 2024-09-13T15:12:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.762+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75ac00cbd0 con 0x7f75b41573b0 2024-09-13T15:12:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.762+0000 7f75b1600700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7594066730 0x7f7594068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.762+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f75ac084200 con 0x7f75b41573b0 2024-09-13T15:12:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.762+0000 7f75b9400700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7594066730 0x7f7594068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.766+0000 7f75b9400700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7594066730 0x7f7594068bf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f75a8011340 tx=0x7f75a800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:57.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.770+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75b41f2a50 con 0x7f75b41573b0 2024-09-13T15:12:57.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.958+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75b4155b10 con 0x7f75b41573b0 2024-09-13T15:12:57.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.958+0000 7f75b1600700 1 -- 172.21.15.50:0/1679628785 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+13704 (secure 0 0 0) 0x7f75b4155b10 con 0x7f75b41573b0 2024-09-13T15:12:57.965 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:12:57.966 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":110,"fsid":"73923987-4656-4194-a4fe-9d4ec875d2d3","created":"2024-09-13T15:07:13.454376+0000","modified":"2024-09-13T15:12:51.545626+0000","last_up_change":"2024-09-13T15:07:25.866798+0000","last_in_change":"2024-09-13T15:07:16.531919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:07:26.099979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e9df0e-591f-44b5-9dca-6aee13c5c6f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6801","nonce":2782884030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6803","nonce":2782884030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6807","nonce":2782884030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2782884030},{"type":"v1","addr":"172.21.15.50:6805","nonce":2782884030}]},"public_addr":"172.21.15.50:6801/2782884030","cluster_addr":"172.21.15.50:6803/2782884030","heartbeat_back_addr":"172.21.15.50:6807/2782884030","heartbeat_front_addr":"172.21.15.50:6805/2782884030","state":["exists","up"]},{"osd":1,"uuid":"0cb89c50-8f83-4dfd-a217-ff23506326c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6811","nonce":2789289607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6816","nonce":2789289607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6825","nonce":2789289607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2789289607},{"type":"v1","addr":"172.21.15.50:6820","nonce":2789289607}]},"public_addr":"172.21.15.50:6811/2789289607","cluster_addr":"172.21.15.50:6816/2789289607","heartbeat_back_addr":"172.21.15.50:6825/2789289607","heartbeat_front_addr":"172.21.15.50:6820/2789289607","state":["exists","up"]},{"osd":2,"uuid":"c07fbfc7-cafd-4308-94d8-adb1fb8d1435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6810","nonce":1292655960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6814","nonce":1292655960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6822","nonce":1292655960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":1292655960},{"type":"v1","addr":"172.21.15.50:6817","nonce":1292655960}]},"public_addr":"172.21.15.50:6810/1292655960","cluster_addr":"172.21.15.50:6814/1292655960","heartbeat_back_addr":"172.21.15.50:6822/1292655960","heartbeat_front_addr":"172.21.15.50:6817/1292655960","state":["exists","up"]},{"osd":3,"uuid":"bd5a1c36-553d-4756-9d99-91cdc9e89421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6824","nonce":2543403071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6827","nonce":2543403071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6831","nonce":2543403071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2543403071},{"type":"v1","addr":"172.21.15.50:6829","nonce":2543403071}]},"public_addr":"172.21.15.50:6824/2543403071","cluster_addr":"172.21.15.50:6827/2543403071","heartbeat_back_addr":"172.21.15.50:6831/2543403071","heartbeat_front_addr":"172.21.15.50:6829/2543403071","state":["exists","up"]},{"osd":4,"uuid":"c182ec57-da4b-4749-af30-c787603621c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6817","nonce":2078065177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6819","nonce":2078065177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6823","nonce":2078065177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2078065177},{"type":"v1","addr":"172.21.15.181:6821","nonce":2078065177}]},"public_addr":"172.21.15.181:6817/2078065177","cluster_addr":"172.21.15.181:6819/2078065177","heartbeat_back_addr":"172.21.15.181:6823/2078065177","heartbeat_front_addr":"172.21.15.181:6821/2078065177","state":["exists","up"]},{"osd":5,"uuid":"045f32b9-a818-40af-ba9c-3a4e4420564e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6825","nonce":1243766751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6827","nonce":1243766751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6831","nonce":1243766751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1243766751},{"type":"v1","addr":"172.21.15.181:6829","nonce":1243766751}]},"public_addr":"172.21.15.181:6825/1243766751","cluster_addr":"172.21.15.181:6827/1243766751","heartbeat_back_addr":"172.21.15.181:6831/1243766751","heartbeat_front_addr":"172.21.15.181:6829/1243766751","state":["exists","up"]},{"osd":6,"uuid":"924895c8-931b-4603-bf8a-034884888b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6801","nonce":89220898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6803","nonce":89220898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6807","nonce":89220898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":89220898},{"type":"v1","addr":"172.21.15.181:6805","nonce":89220898}]},"public_addr":"172.21.15.181:6801/89220898","cluster_addr":"172.21.15.181:6803/89220898","heartbeat_back_addr":"172.21.15.181:6807/89220898","heartbeat_front_addr":"172.21.15.181:6805/89220898","state":["exists","up"]},{"osd":7,"uuid":"99d95a00-ff75-47da-bf7e-8c742d02cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6809","nonce":2747791304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6811","nonce":2747791304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6815","nonce":2747791304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2747791304},{"type":"v1","addr":"172.21.15.181:6813","nonce":2747791304}]},"public_addr":"172.21.15.181:6809/2747791304","cluster_addr":"172.21.15.181:6811/2747791304","heartbeat_back_addr":"172.21.15.181:6815/2747791304","heartbeat_front_addr":"172.21.15.181:6813/2747791304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.499375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.257846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.308436+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.507265+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.284250+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.293657+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.312963+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:07:22.311944+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6834/3584876987":"2024-09-14T15:12:48.520351+0000","172.21.15.50:6832/3584876987":"2024-09-14T15:12:48.520351+0000","172.21.15.181:6834/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.50:6835/359103955":"2024-09-14T15:12:48.520384+0000","172.21.15.181:6835/2773604329":"2024-09-14T15:12:14.815012+0000","172.21.15.181:6837/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6833/359103955":"2024-09-14T15:12:48.520384+0000","172.21.15.181:6836/1242078789":"2024-09-14T15:12:14.783599+0000","172.21.15.50:6835/2577107387":"2024-09-14T15:12:14.657185+0000","172.21.15.50:6834/2577107387":"2024-09-14T15:12:14.657185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7594066730 msgr2=0x7f7594068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7594066730 0x7f7594068bf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f75a8011340 tx=0x7f75a800b040 comp rx=0 tx=0).stop 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 msgr2=0x7f75b4146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 0x7f75b4146ea0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00eb60 tx=0x7f75ac00ee70 comp rx=0 tx=0).stop 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 shutdown_connections 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f7594066730 0x7f7594068bf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41573b0 0x7f75b4146ea0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75b40ce2f0 0x7f75b4156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 --2- 172.21.15.50:0/1679628785 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f75b406ab10 0x7f75b4154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 >> 172.21.15.50:0/1679628785 conn(0x7f75b40b08d0 msgr2=0x7f75b4152380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 shutdown_connections 2024-09-13T15:12:57.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:57.962+0000 7f75bbe00700 1 -- 172.21.15.50:0/1679628785 wait complete. 2024-09-13T15:12:58.990 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T15:12:58.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:12:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.174+0000 7ff75b000700 1 Processor -- start 2024-09-13T15:12:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.174+0000 7ff75b000700 1 -- start start 2024-09-13T15:12:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff75b000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff75415cd50 0x7ff7540cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff75b000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7540d1620 con 0x7ff7540d3810 2024-09-13T15:12:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff75b000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7540d1900 con 0x7ff7540ce7d0 2024-09-13T15:12:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff75b000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7540cec20 con 0x7ff75415cd50 2024-09-13T15:12:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff759200700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7540d3810 0x7ff7540b63e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36136/0 (socket says 172.21.15.50:36136) 2024-09-13T15:12:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff759200700 1 -- 172.21.15.50:0/1946385377 learned_addr learned my addr 172.21.15.50:0/1946385377 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff759c00700 1 --2- 172.21.15.50:0/1946385377 >> v2:172.21.15.181:3300/0 conn(0x7ff75415cd50 0x7ff7540cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff753e00700 1 -- 172.21.15.50:0/1946385377 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795316309 0 0) 0x7ff7540d1620 con 0x7ff7540d3810 2024-09-13T15:12:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff759c00700 1 -- 172.21.15.50:0/1946385377 >> v1:172.21.15.181:6789/0 conn(0x7ff7540ce7d0 legacy=0x7ff7540b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff759c00700 1 -- 172.21.15.50:0/1946385377 >> v1:172.21.15.50:6789/0 conn(0x7ff7540d3810 legacy=0x7ff7540b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.178+0000 7ff759c00700 1 -- 172.21.15.50:0/1946385377 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540b5be0 con 0x7ff75415cd50 2024-09-13T15:12:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff759c00700 1 --2- 172.21.15.50:0/1946385377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75415cd50 0x7ff7540cf680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff748009850 tx=0x7ff748009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c84027c8b703574 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff753e00700 1 -- 172.21.15.50:0/1946385377 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748011830 con 0x7ff75415cd50 2024-09-13T15:12:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff753e00700 1 -- 172.21.15.50:0/1946385377 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff748011990 con 0x7ff75415cd50 2024-09-13T15:12:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff753e00700 1 -- 172.21.15.50:0/1946385377 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748011d20 con 0x7ff75415cd50 2024-09-13T15:12:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 -- 172.21.15.50:0/1946385377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75415cd50 msgr2=0x7ff7540cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 --2- 172.21.15.50:0/1946385377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75415cd50 0x7ff7540cf680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff748009850 tx=0x7ff748009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 -- 172.21.15.50:0/1946385377 shutdown_connections 2024-09-13T15:12:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 --2- 172.21.15.50:0/1946385377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75415cd50 0x7ff7540cf680 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 -- 172.21.15.50:0/1946385377 >> 172.21.15.50:0/1946385377 conn(0x7ff7540d2cf0 msgr2=0x7ff7540d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 -- 172.21.15.50:0/1946385377 shutdown_connections 2024-09-13T15:12:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.182+0000 7ff75b000700 1 -- 172.21.15.50:0/1946385377 wait complete. 2024-09-13T15:12:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 Processor -- start 2024-09-13T15:12:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 -- start start 2024-09-13T15:12:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7540ce7d0 0x7ff7541f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff7540d3810 0x7ff7540c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75415cd50 0x7ff7540c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540c8da0 con 0x7ff75415cd50 2024-09-13T15:12:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540c8190 con 0x7ff7540ce7d0 2024-09-13T15:12:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.186+0000 7ff75b000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540c8470 con 0x7ff7540d3810 2024-09-13T15:12:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75415cd50 0x7ff7540c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff759c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7540ce7d0 0x7ff7541f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75415cd50 0x7ff7540c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43160/0 (socket says 172.21.15.50:43160) 2024-09-13T15:12:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 -- 172.21.15.50:0/1223435150 learned_addr learned my addr 172.21.15.50:0/1223435150 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff759200700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff7540d3810 0x7ff7540c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 -- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff7540d3810 msgr2=0x7ff7540c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff7540d3810 0x7ff7540c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 -- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7540ce7d0 msgr2=0x7ff7541f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7540ce7d0 0x7ff7541f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 -- 172.21.15.50:0/1223435150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480094b0 con 0x7ff75415cd50 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75a600700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75415cd50 0x7ff7540c9dc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00cb50 tx=0x7ff74c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c003c20 con 0x7ff75415cd50 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c003d80 con 0x7ff75415cd50 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c00aac0 con 0x7ff75415cd50 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540c8750 con 0x7ff75415cd50 2024-09-13T15:12:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.190+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7540cc1b0 con 0x7ff75415cd50 2024-09-13T15:12:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.194+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff75404e700 con 0x7ff75415cd50 2024-09-13T15:12:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.194+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff74c00ac20 con 0x7ff75415cd50 2024-09-13T15:12:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.194+0000 7ff751600700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff734066730 0x7ff734068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.194+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff74c084170 con 0x7ff75415cd50 2024-09-13T15:12:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff751600700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7ff73406ccb0 0x7ff73406f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff759c00700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff734066730 0x7ff734068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 --> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff73406f7c0 con 0x7ff73406ccb0 2024-09-13T15:12:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff74c086750 con 0x7ff75415cd50 2024-09-13T15:12:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff759200700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7ff73406ccb0 0x7ff73406f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff759200700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7ff73406ccb0 0x7ff73406f0f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff759c00700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff734066730 0x7ff734068bf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff7480090b0 tx=0x7ff748008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.198+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== osd.0 v2:172.21.15.50:6800/2782884030 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff73406f7c0 con 0x7ff73406ccb0 2024-09-13T15:12:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 --> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff7540d1df0 con 0x7ff73406ccb0 2024-09-13T15:12:59.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff751600700 1 -- 172.21.15.50:0/1223435150 <== osd.0 v2:172.21.15.50:6800/2782884030 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff7540d1df0 con 0x7ff73406ccb0 2024-09-13T15:12:59.224 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:59.224 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:12:59.224 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7ff73406ccb0 msgr2=0x7ff73406f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:6800/2782884030,v1:172.21.15.50:6801/2782884030] conn(0x7ff73406ccb0 0x7ff73406f0f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff734066730 msgr2=0x7ff734068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff734066730 0x7ff734068bf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff7480090b0 tx=0x7ff748008030 comp rx=0 tx=0).stop 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75415cd50 msgr2=0x7ff7540c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 --2- 172.21.15.50:0/1223435150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff75415cd50 0x7ff7540c9dc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00cb50 tx=0x7ff74c00ce60 comp rx=0 tx=0).stop 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75a600700 1 -- 172.21.15.50:0/1223435150 reap_dead start 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 shutdown_connections 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 >> 172.21.15.50:0/1223435150 conn(0x7ff7540d2cf0 msgr2=0x7ff7540b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 shutdown_connections 2024-09-13T15:12:59.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.218+0000 7ff75b000700 1 -- 172.21.15.50:0/1223435150 wait complete. 2024-09-13T15:12:59.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T15:12:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.418+0000 7ff90b200700 1 Processor -- start 2024-09-13T15:12:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.418+0000 7ff90b200700 1 -- start start 2024-09-13T15:12:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90b200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff90c1610b0 0x7ff90c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c06aaa0 0x7ff90c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90b200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c0b3560 con 0x7ff90c0b2670 2024-09-13T15:12:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90b200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c070b30 con 0x7ff90c1610b0 2024-09-13T15:12:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c06b420 con 0x7ff90c06aaa0 2024-09-13T15:12:59.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff90c1610b0 0x7ff90c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90a800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff90c0b2670 0x7ff90c0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36140/0 (socket says 172.21.15.50:36140) 2024-09-13T15:12:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff90a800700 1 -- 172.21.15.50:0/3781957559 learned_addr learned my addr 172.21.15.50:0/3781957559 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909400700 1 --2- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c06aaa0 0x7ff90c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909e00700 1 -- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c06aaa0 msgr2=0x7ff90c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909e00700 1 --2- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c06aaa0 0x7ff90c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909e00700 1 -- 172.21.15.50:0/3781957559 >> v1:172.21.15.50:6789/0 conn(0x7ff90c0b2670 legacy=0x7ff90c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909e00700 1 -- 172.21.15.50:0/3781957559 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c0b3280 con 0x7ff90c1610b0 2024-09-13T15:12:59.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.422+0000 7ff909e00700 1 --2- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c1610b0 0x7ff90c0719c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009850 tx=0x7ff8fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32940e0861fe74a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff908a00700 1 -- 172.21.15.50:0/3781957559 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc011830 con 0x7ff90c1610b0 2024-09-13T15:12:59.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff908a00700 1 -- 172.21.15.50:0/3781957559 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc011990 con 0x7ff90c1610b0 2024-09-13T15:12:59.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff908a00700 1 -- 172.21.15.50:0/3781957559 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc011d40 con 0x7ff90c1610b0 2024-09-13T15:12:59.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 -- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c1610b0 msgr2=0x7ff90c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 --2- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c1610b0 0x7ff90c0719c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009850 tx=0x7ff8fc009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 -- 172.21.15.50:0/3781957559 shutdown_connections 2024-09-13T15:12:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 --2- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c06aaa0 0x7ff90c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 --2- 172.21.15.50:0/3781957559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c1610b0 0x7ff90c0719c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 -- 172.21.15.50:0/3781957559 >> 172.21.15.50:0/3781957559 conn(0x7ff90c0b0c40 msgr2=0x7ff90c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 -- 172.21.15.50:0/3781957559 shutdown_connections 2024-09-13T15:12:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.426+0000 7ff90b200700 1 -- 172.21.15.50:0/3781957559 wait complete. 2024-09-13T15:12:59.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 Processor -- start 2024-09-13T15:12:59.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 -- start start 2024-09-13T15:12:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 0x7ff90c1f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c0b2670 0x7ff90c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c1610b0 0x7ff90c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c1517b0 con 0x7ff90c06aaa0 2024-09-13T15:12:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0a8e60 con 0x7ff90c0b2670 2024-09-13T15:12:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90b200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0a9140 con 0x7ff90c1610b0 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 0x7ff90c1f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 0x7ff90c1f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43166/0 (socket says 172.21.15.50:43166) 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 -- 172.21.15.50:0/3354490911 learned_addr learned my addr 172.21.15.50:0/3354490911 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909400700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c0b2670 0x7ff90c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff90a800700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c1610b0 0x7ff90c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 -- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c1610b0 msgr2=0x7ff90c06cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c1610b0 0x7ff90c06cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 -- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c0b2670 msgr2=0x7ff90c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c0b2670 0x7ff90c0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.430+0000 7ff909e00700 1 -- 172.21.15.50:0/3354490911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc0094b0 con 0x7ff90c06aaa0 2024-09-13T15:12:59.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff909e00700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 0x7ff90c1f5fe0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0b1690 tx=0x7ff8fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc004570 con 0x7ff90c06aaa0 2024-09-13T15:12:59.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc01f070 con 0x7ff90c06aaa0 2024-09-13T15:12:59.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0038e0 con 0x7ff90c06aaa0 2024-09-13T15:12:59.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c0a9420 con 0x7ff90c06aaa0 2024-09-13T15:12:59.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c1f6520 con 0x7ff90c06aaa0 2024-09-13T15:12:59.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c1f66b0 con 0x7ff90c06aaa0 2024-09-13T15:12:59.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.434+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8fc021030 con 0x7ff90c06aaa0 2024-09-13T15:12:59.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.438+0000 7ff902000700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8ec066760 0x7ff8ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.438+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff8fc0855e0 con 0x7ff90c06aaa0 2024-09-13T15:12:59.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.438+0000 7ff909400700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8ec066760 0x7ff8ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.438+0000 7ff909400700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8ec066760 0x7ff8ec068c20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0cb2d0 tx=0x7ff8f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.442+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8fc0529a0 con 0x7ff90c06aaa0 2024-09-13T15:12:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.622+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff90c0714a0 con 0x7ff8ec066760 2024-09-13T15:12:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.622+0000 7ff902000700 1 -- 172.21.15.50:0/3354490911 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff8f8011720 con 0x7ff8ec066760 2024-09-13T15:12:59.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8ec066760 msgr2=0x7ff8ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8ec066760 0x7ff8ec068c20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0cb2d0 tx=0x7ff8f8008040 comp rx=0 tx=0).stop 2024-09-13T15:12:59.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 msgr2=0x7ff90c1f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 0x7ff90c1f5fe0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0b1690 tx=0x7ff8fc004770 comp rx=0 tx=0).stop 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 shutdown_connections 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff8ec066760 0x7ff8ec068c20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff90c1610b0 0x7ff90c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff90c0b2670 0x7ff90c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 --2- 172.21.15.50:0/3354490911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff90c06aaa0 0x7ff90c1f5fe0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 >> 172.21.15.50:0/3354490911 conn(0x7ff90c0b0c40 msgr2=0x7ff90c15f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 shutdown_connections 2024-09-13T15:12:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.630+0000 7ff90b200700 1 -- 172.21.15.50:0/3354490911 wait complete. 2024-09-13T15:12:59.637 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T15:12:59.658 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T15:12:59.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:12:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.826+0000 7f20dd000700 1 Processor -- start 2024-09-13T15:12:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.826+0000 7f20dd000700 1 -- start start 2024-09-13T15:12:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20dd000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d80ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20dd000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f20d80b4400 0x7f20d80b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20dd000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d815adb0 con 0x7f20d815a9d0 2024-09-13T15:12:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20dd000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80cd280 con 0x7f20d80b4400 2024-09-13T15:12:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20dd000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80b4db0 con 0x7f20d80cdc90 2024-09-13T15:12:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d7400700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f20d815a9d0 0x7f20d80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36142/0 (socket says 172.21.15.50:36142) 2024-09-13T15:12:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d7400700 1 -- 172.21.15.50:0/3517950036 learned_addr learned my addr 172.21.15.50:0/3517950036 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:12:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6a00700 1 --2- 172.21.15.50:0/3517950036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d80ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d7e00700 1 --2- 172.21.15.50:0/3517950036 >> v2:172.21.15.181:3300/0 conn(0x7f20d80b4400 0x7f20d80b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6000700 1 -- 172.21.15.50:0/3517950036 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891661289 0 0) 0x7f20d815adb0 con 0x7f20d815a9d0 2024-09-13T15:12:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6000700 1 -- 172.21.15.50:0/3517950036 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc0035d0 con 0x7f20d815a9d0 2024-09-13T15:12:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6a00700 1 -- 172.21.15.50:0/3517950036 >> v2:172.21.15.181:3300/0 conn(0x7f20d80b4400 msgr2=0x7f20d80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6a00700 1 --2- 172.21.15.50:0/3517950036 >> v2:172.21.15.181:3300/0 conn(0x7f20d80b4400 0x7f20d80b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6a00700 1 -- 172.21.15.50:0/3517950036 >> v1:172.21.15.50:6789/0 conn(0x7f20d815a9d0 legacy=0x7f20d80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.830+0000 7f20d6a00700 1 -- 172.21.15.50:0/3517950036 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80ce850 con 0x7f20d80cdc90 2024-09-13T15:12:59.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20d6a00700 1 --2- 172.21.15.50:0/3517950036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d80ce0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009850 tx=0x7f20c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7ba7f0f8b2b2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20d6000700 1 -- 172.21.15.50:0/3517950036 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4011830 con 0x7f20d80cdc90 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20d6000700 1 -- 172.21.15.50:0/3517950036 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4011990 con 0x7f20d80cdc90 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20d6000700 1 -- 172.21.15.50:0/3517950036 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4011d40 con 0x7f20d80cdc90 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 -- 172.21.15.50:0/3517950036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 msgr2=0x7f20d80ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 --2- 172.21.15.50:0/3517950036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d80ce0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009850 tx=0x7f20c4009b60 comp rx=0 tx=0).stop 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 -- 172.21.15.50:0/3517950036 shutdown_connections 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 --2- 172.21.15.50:0/3517950036 >> v2:172.21.15.181:3300/0 conn(0x7f20d80b4400 0x7f20d80b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 --2- 172.21.15.50:0/3517950036 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d80ce0f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 -- 172.21.15.50:0/3517950036 >> 172.21.15.50:0/3517950036 conn(0x7f20d8066270 msgr2=0x7f20d8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 -- 172.21.15.50:0/3517950036 shutdown_connections 2024-09-13T15:12:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 -- 172.21.15.50:0/3517950036 wait complete. 2024-09-13T15:12:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.834+0000 7f20dd000700 1 Processor -- start 2024-09-13T15:12:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 -- start start 2024-09-13T15:12:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d80b4400 0x7f20d81f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d815a9d0 0x7f20d815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81568e0 con 0x7f20d80b4400 2024-09-13T15:12:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81470f0 con 0x7f20d815a9d0 2024-09-13T15:12:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81464e0 con 0x7f20d80cdc90 2024-09-13T15:12:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d80b4400 0x7f20d81f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d80b4400 0x7f20d81f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43176/0 (socket says 172.21.15.50:43176) 2024-09-13T15:12:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d6a00700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 -- 172.21.15.50:0/179806474 learned_addr learned my addr 172.21.15.50:0/179806474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:12:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7e00700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d815a9d0 0x7f20d815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 -- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 msgr2=0x7f20d815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f20d80cdc90 0x7f20d815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 -- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d815a9d0 msgr2=0x7f20d815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d815a9d0 0x7f20d815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 -- 172.21.15.50:0/179806474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40094b0 con 0x7f20d80b4400 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20d7400700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d80b4400 0x7f20d81f6a90 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c4d0 tx=0x7f20c800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8005d90 con 0x7f20d80b4400 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c800ce80 con 0x7f20d80b4400 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80072d0 con 0x7f20d80b4400 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d81467c0 con 0x7f20d80b4400 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.838+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d8146d80 con 0x7f20d80b4400 2024-09-13T15:12:59.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.842+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20d80cd490 con 0x7f20d80b4400 2024-09-13T15:12:59.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.842+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20c8007430 con 0x7f20d80b4400 2024-09-13T15:12:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.842+0000 7f20cf400700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f20b8066730 0x7f20b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.842+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f20c8083b80 con 0x7f20d80b4400 2024-09-13T15:12:59.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20cf400700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7f20b806ccb0 0x7f20b806f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 --> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20b806f7c0 con 0x7f20b806ccb0 2024-09-13T15:12:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20c8083ef0 con 0x7f20d80b4400 2024-09-13T15:12:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20d6a00700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f20b8066730 0x7f20b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20d7e00700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7f20b806ccb0 0x7f20b806f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20d7e00700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7f20b806ccb0 0x7f20b806f0f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20d6a00700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f20b8066730 0x7f20b8068bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009850 tx=0x7f20c4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:59.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.846+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== osd.1 v2:172.21.15.50:6808/2789289607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f20b806f7c0 con 0x7f20b806ccb0 2024-09-13T15:12:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.862+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 --> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20d80cee10 con 0x7f20b806ccb0 2024-09-13T15:12:59.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20cf400700 1 -- 172.21.15.50:0/179806474 <== osd.1 v2:172.21.15.50:6808/2789289607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f20d000f040 con 0x7f20b806ccb0 2024-09-13T15:12:59.871 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:12:59.871 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:12:59.871 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7f20b806ccb0 msgr2=0x7f20b806f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:6808/2789289607,v1:172.21.15.50:6811/2789289607] conn(0x7f20b806ccb0 0x7f20b806f0f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f20b8066730 msgr2=0x7f20b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f20b8066730 0x7f20b8068bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009850 tx=0x7f20c4008030 comp rx=0 tx=0).stop 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d80b4400 msgr2=0x7f20d81f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 --2- 172.21.15.50:0/179806474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20d80b4400 0x7f20d81f6a90 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c4d0 tx=0x7f20c800c7e0 comp rx=0 tx=0).stop 2024-09-13T15:12:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20d7e00700 1 -- 172.21.15.50:0/179806474 reap_dead start 2024-09-13T15:12:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 shutdown_connections 2024-09-13T15:12:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 >> 172.21.15.50:0/179806474 conn(0x7f20d8066270 msgr2=0x7f20d806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 shutdown_connections 2024-09-13T15:12:59.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:12:59.866+0000 7f20dd000700 1 -- 172.21.15.50:0/179806474 wait complete. 2024-09-13T15:12:59.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T15:13:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff535c00700 1 Processor -- start 2024-09-13T15:13:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff535c00700 1 -- start start 2024-09-13T15:13:00.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff535c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff53006aaa0 0x7ff53006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff535c00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5300ccb40 con 0x7ff5300cb020 2024-09-13T15:13:00.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff535c00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53006b430 con 0x7ff5300cc6f0 2024-09-13T15:13:00.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff535c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5300b2ad0 con 0x7ff53006aaa0 2024-09-13T15:13:00.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff52fe00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff5300cb020 0x7ff53015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36156/0 (socket says 172.21.15.50:36156) 2024-09-13T15:13:00.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.066+0000 7ff52fe00700 1 -- 172.21.15.50:0/3440301345 learned_addr learned my addr 172.21.15.50:0/3440301345 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:13:00.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535200700 1 --2- 172.21.15.50:0/3440301345 >> v2:172.21.15.50:3300/0 conn(0x7ff53006aaa0 0x7ff53006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372831210 0 0) 0x7ff5300ccb40 con 0x7ff5300cb020 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5140035d0 con 0x7ff5300cb020 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232706434 0 0) 0x7ff51c001110 con 0x7ff5300cc6f0 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5300ccb40 con 0x7ff5300cc6f0 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535200700 1 -- 172.21.15.50:0/3440301345 >> v1:172.21.15.181:6789/0 conn(0x7ff5300cc6f0 legacy=0x7ff53015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535200700 1 -- 172.21.15.50:0/3440301345 >> v1:172.21.15.50:6789/0 conn(0x7ff5300cb020 legacy=0x7ff53015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535200700 1 -- 172.21.15.50:0/3440301345 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53015b960 con 0x7ff53006aaa0 2024-09-13T15:13:00.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535200700 1 --2- 172.21.15.50:0/3440301345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53006aaa0 0x7ff53006aef0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff528009d90 tx=0x7ff52800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bce434116243a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800e070 con 0x7ff53006aaa0 2024-09-13T15:13:00.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52800bb20 con 0x7ff53006aaa0 2024-09-13T15:13:00.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff52ea00700 1 -- 172.21.15.50:0/3440301345 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800be90 con 0x7ff53006aaa0 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 -- 172.21.15.50:0/3440301345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53006aaa0 msgr2=0x7ff53006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 --2- 172.21.15.50:0/3440301345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53006aaa0 0x7ff53006aef0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff528009d90 tx=0x7ff52800b330 comp rx=0 tx=0).stop 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 -- 172.21.15.50:0/3440301345 shutdown_connections 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 --2- 172.21.15.50:0/3440301345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53006aaa0 0x7ff53006aef0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 -- 172.21.15.50:0/3440301345 >> 172.21.15.50:0/3440301345 conn(0x7ff5300b0c40 msgr2=0x7ff53006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 -- 172.21.15.50:0/3440301345 shutdown_connections 2024-09-13T15:13:00.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.070+0000 7ff535c00700 1 -- 172.21.15.50:0/3440301345 wait complete. 2024-09-13T15:13:00.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.074+0000 7ff535c00700 1 Processor -- start 2024-09-13T15:13:00.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.074+0000 7ff535c00700 1 -- start start 2024-09-13T15:13:00.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff53006aaa0 0x7ff530156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 0x7ff5301545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff5300cc6f0 0x7ff53015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530154ae0 con 0x7ff5300cb020 2024-09-13T15:13:00.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301564a0 con 0x7ff53006aaa0 2024-09-13T15:13:00.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff530155890 con 0x7ff5300cc6f0 2024-09-13T15:13:00.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 0x7ff5301545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff5300cc6f0 0x7ff53015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52fe00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff53006aaa0 0x7ff530156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 0x7ff5301545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43188/0 (socket says 172.21.15.50:43188) 2024-09-13T15:13:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff5300cc6f0 0x7ff53015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:32948/0 (socket says 172.21.15.50:32948) 2024-09-13T15:13:00.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 -- 172.21.15.50:0/1675326898 learned_addr learned my addr 172.21.15.50:0/1675326898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 -- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff5300cc6f0 msgr2=0x7ff53015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff5300cc6f0 0x7ff53015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 -- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff53006aaa0 msgr2=0x7ff530156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff53006aaa0 0x7ff530156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 -- 172.21.15.50:0/1675326898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff528009a70 con 0x7ff5300cb020 2024-09-13T15:13:00.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff52f400700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 0x7ff5301545a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c4d0 tx=0x7ff51c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00cea0 con 0x7ff5300cb020 2024-09-13T15:13:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c0052f0 con 0x7ff5300cb020 2024-09-13T15:13:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff530155b70 con 0x7ff5300cb020 2024-09-13T15:13:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0036a0 con 0x7ff5300cb020 2024-09-13T15:13:00.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.078+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff530156130 con 0x7ff5300cb020 2024-09-13T15:13:00.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.082+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53006aef0 con 0x7ff5300cb020 2024-09-13T15:13:00.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.082+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff51c003800 con 0x7ff5300cb020 2024-09-13T15:13:00.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.086+0000 7ff527e00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff510066730 0x7ff510068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.086+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff51c083280 con 0x7ff5300cb020 2024-09-13T15:13:00.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.086+0000 7ff52fe00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff510066730 0x7ff510068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.086+0000 7ff52fe00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff510066730 0x7ff510068bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff520000f60 tx=0x7ff520007e20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.090+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff51c050640 con 0x7ff5300cb020 2024-09-13T15:13:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.286+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5300b2d20 con 0x7ff510066730 2024-09-13T15:13:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.286+0000 7ff527e00700 1 -- 172.21.15.50:0/1675326898 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff520006bd0 con 0x7ff510066730 2024-09-13T15:13:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff510066730 msgr2=0x7ff510068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff510066730 0x7ff510068bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff520000f60 tx=0x7ff520007e20 comp rx=0 tx=0).stop 2024-09-13T15:13:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 msgr2=0x7ff5301545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 0x7ff5301545a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c4d0 tx=0x7ff51c00c7e0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 shutdown_connections 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff510066730 0x7ff510068bf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff5300cc6f0 0x7ff53015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5300cb020 0x7ff5301545a0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 --2- 172.21.15.50:0/1675326898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff53006aaa0 0x7ff530156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 >> 172.21.15.50:0/1675326898 conn(0x7ff5300b0c40 msgr2=0x7ff53015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 shutdown_connections 2024-09-13T15:13:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.290+0000 7ff535c00700 1 -- 172.21.15.50:0/1675326898 wait complete. 2024-09-13T15:13:00.296 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T15:13:00.315 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T15:13:00.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:13:00.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff197200700 1 Processor -- start 2024-09-13T15:13:00.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff197200700 1 -- start start 2024-09-13T15:13:00.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff197200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff198161860 0x7ff19806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff197200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980cc6f0 con 0x7ff1980cdb90 2024-09-13T15:13:00.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff197200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980b2740 con 0x7ff1980b22b0 2024-09-13T15:13:00.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff197200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19815f060 con 0x7ff198161860 2024-09-13T15:13:00.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff196800700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff1980cdb90 0x7ff19816aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36168/0 (socket says 172.21.15.50:36168) 2024-09-13T15:13:00.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff196800700 1 -- 172.21.15.50:0/1028746181 learned_addr learned my addr 172.21.15.50:0/1028746181 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:13:00.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff195e00700 1 --2- 172.21.15.50:0/1028746181 >> v2:172.21.15.181:3300/0 conn(0x7ff198161860 0x7ff19806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340096285 0 0) 0x7ff1980cc6f0 con 0x7ff1980cdb90 2024-09-13T15:13:00.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.494+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff17c0035d0 con 0x7ff1980cdb90 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1172031845 0 0) 0x7ff17c0035d0 con 0x7ff1980cdb90 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 >> v2:172.21.15.181:3300/0 conn(0x7ff198161860 msgr2=0x7ff19806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 --2- 172.21.15.50:0/1028746181 >> v2:172.21.15.181:3300/0 conn(0x7ff198161860 0x7ff19806bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 >> v1:172.21.15.181:6789/0 conn(0x7ff1980b22b0 legacy=0x7ff198161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980b2a20 con 0x7ff1980cdb90 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 16932834 0 0) 0x7ff1900019f0 con 0x7ff1980cdb90 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 >> v1:172.21.15.50:6789/0 conn(0x7ff1980cdb90 legacy=0x7ff19816aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff17c003a90 0x7ff17c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17c004870 0x7ff17c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c005230 0x7ff17c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19815f060 con 0x7ff17c004870 2024-09-13T15:13:00.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c00c160 con 0x7ff17c003a90 2024-09-13T15:13:00.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c00c320 con 0x7ff17c005230 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17c004870 0x7ff17c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195e00700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff17c003a90 0x7ff17c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff196800700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c005230 0x7ff17c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 -- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c005230 msgr2=0x7ff17c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c005230 0x7ff17c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 -- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff17c003a90 msgr2=0x7ff17c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff17c003a90 0x7ff17c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff196800700 1 -- 172.21.15.50:0/1028746181 reap_dead start 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 -- 172.21.15.50:0/1028746181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0035d0 con 0x7ff17c004870 2024-09-13T15:13:00.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff195400700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17c004870 0x7ff17c004cf0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff1800017e0 tx=0x7ff17c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805131eba4063fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.498+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800052d0 con 0x7ff17c004870 2024-09-13T15:13:00.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180005450 con 0x7ff17c004870 2024-09-13T15:13:00.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff194a00700 1 -- 172.21.15.50:0/1028746181 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800038e0 con 0x7ff17c004870 2024-09-13T15:13:00.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 -- 172.21.15.50:0/1028746181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17c004870 msgr2=0x7ff17c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17c004870 0x7ff17c004cf0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff1800017e0 tx=0x7ff17c0058a0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 -- 172.21.15.50:0/1028746181 shutdown_connections 2024-09-13T15:13:00.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 --2- 172.21.15.50:0/1028746181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17c004870 0x7ff17c004cf0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 -- 172.21.15.50:0/1028746181 >> 172.21.15.50:0/1028746181 conn(0x7ff1980b05a0 msgr2=0x7ff1980b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:00.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 -- 172.21.15.50:0/1028746181 shutdown_connections 2024-09-13T15:13:00.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 -- 172.21.15.50:0/1028746181 wait complete. 2024-09-13T15:13:00.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 Processor -- start 2024-09-13T15:13:00.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.502+0000 7ff197200700 1 -- start start 2024-09-13T15:13:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c004870 0x7ff198153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff198152320 0x7ff198158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1981585a0 0x7ff19815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198158eb0 con 0x7ff1981585a0 2024-09-13T15:13:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198158bd0 con 0x7ff198152320 2024-09-13T15:13:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19815b7f0 con 0x7ff17c004870 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1981585a0 0x7ff19815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1981585a0 0x7ff19815c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43196/0 (socket says 172.21.15.50:43196) 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 -- 172.21.15.50:0/86338144 learned_addr learned my addr 172.21.15.50:0/86338144 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff195e00700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c004870 0x7ff198153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff195400700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff198152320 0x7ff198158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 -- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c004870 msgr2=0x7ff198153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff17c004870 0x7ff198153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 -- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff198152320 msgr2=0x7ff198158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff198152320 0x7ff198158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 -- 172.21.15.50:0/86338144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19815bad0 con 0x7ff1981585a0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff196800700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1981585a0 0x7ff19815c2d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff190000f80 tx=0x7ff190005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190008770 con 0x7ff1981585a0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1900088f0 con 0x7ff1981585a0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1900143f0 con 0x7ff1981585a0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19815bdb0 con 0x7ff1981585a0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.506+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19815c810 con 0x7ff1981585a0 2024-09-13T15:13:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.510+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1980cc300 con 0x7ff1981585a0 2024-09-13T15:13:00.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.510+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff190014550 con 0x7ff1981585a0 2024-09-13T15:13:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.510+0000 7ff18e000700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff174066760 0x7ff174068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.510+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff1900851b0 con 0x7ff1981585a0 2024-09-13T15:13:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff18e000700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7ff17406cce0 0x7ff17406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff17406f7f0 con 0x7ff17406cce0 2024-09-13T15:13:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff190085520 con 0x7ff1981585a0 2024-09-13T15:13:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff195e00700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff174066760 0x7ff174068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff195400700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7ff17406cce0 0x7ff17406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff195400700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7ff17406cce0 0x7ff17406f120 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff195e00700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff174066760 0x7ff174068c20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff198067950 tx=0x7ff188008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.514+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== osd.2 v2:172.21.15.50:6809/1292655960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff17406f7f0 con 0x7ff17406cce0 2024-09-13T15:13:00.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 --> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1980b2fe0 con 0x7ff17406cce0 2024-09-13T15:13:00.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff18e000700 1 -- 172.21.15.50:0/86338144 <== osd.2 v2:172.21.15.50:6809/1292655960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff180005250 con 0x7ff17406cce0 2024-09-13T15:13:00.544 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:13:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:13:00.544 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7ff17406cce0 msgr2=0x7ff17406f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:6809/1292655960,v1:172.21.15.50:6810/1292655960] conn(0x7ff17406cce0 0x7ff17406f120 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff174066760 msgr2=0x7ff174068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7ff174066760 0x7ff174068c20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff198067950 tx=0x7ff188008040 comp rx=0 tx=0).stop 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1981585a0 msgr2=0x7ff19815c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 --2- 172.21.15.50:0/86338144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1981585a0 0x7ff19815c2d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff190000f80 tx=0x7ff190005ee0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff196800700 1 -- 172.21.15.50:0/86338144 reap_dead start 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 shutdown_connections 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 >> 172.21.15.50:0/86338144 conn(0x7ff1980b05a0 msgr2=0x7ff19815f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 shutdown_connections 2024-09-13T15:13:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.538+0000 7ff197200700 1 -- 172.21.15.50:0/86338144 wait complete. 2024-09-13T15:13:00.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T15:13:00.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.738+0000 7fc92d200700 1 Processor -- start 2024-09-13T15:13:00.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.742+0000 7fc92d200700 1 -- start start 2024-09-13T15:13:00.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.742+0000 7fc92d200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9281599c0 0x7fc9280ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.742+0000 7fc92d200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92806c8e0 0x7fc92806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.742+0000 7fc92d200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92806d260 con 0x7fc92815d4a0 2024-09-13T15:13:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.742+0000 7fc92d200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280b3170 con 0x7fc9281599c0 2024-09-13T15:13:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.742+0000 7fc92d200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc928159da0 con 0x7fc92806c8e0 2024-09-13T15:13:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9281599c0 0x7fc9280ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9281599c0 0x7fc9280ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43202/0 (socket says 172.21.15.50:43202) 2024-09-13T15:13:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 -- 172.21.15.50:0/108004208 learned_addr learned my addr 172.21.15.50:0/108004208 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc926a00700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92806c8e0 0x7fc92806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 -- 172.21.15.50:0/108004208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92806c8e0 msgr2=0x7fc92806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92806c8e0 0x7fc92806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 -- 172.21.15.50:0/108004208 >> v1:172.21.15.181:6789/0 conn(0x7fc92815d4a0 legacy=0x7fc9280b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 -- 172.21.15.50:0/108004208 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92806bba0 con 0x7fc9281599c0 2024-09-13T15:13:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc926a00700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92806c8e0 0x7fc92806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:00.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc927400700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9281599c0 0x7fc9280ccc90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc91800bbb0 tx=0x7fc91800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25439380da040e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc926000700 1 -- 172.21.15.50:0/108004208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800dd90 con 0x7fc9281599c0 2024-09-13T15:13:00.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc926000700 1 -- 172.21.15.50:0/108004208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918010470 con 0x7fc9281599c0 2024-09-13T15:13:00.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc926000700 1 -- 172.21.15.50:0/108004208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918010820 con 0x7fc9281599c0 2024-09-13T15:13:00.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc92d200700 1 -- 172.21.15.50:0/108004208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9281599c0 msgr2=0x7fc9280ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc92d200700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9281599c0 0x7fc9280ccc90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc91800bbb0 tx=0x7fc91800bec0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.746+0000 7fc92d200700 1 -- 172.21.15.50:0/108004208 shutdown_connections 2024-09-13T15:13:00.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc92806c8e0 0x7fc92806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 --2- 172.21.15.50:0/108004208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9281599c0 0x7fc9280ccc90 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 -- 172.21.15.50:0/108004208 >> 172.21.15.50:0/108004208 conn(0x7fc92806e660 msgr2=0x7fc92806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:00.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 -- 172.21.15.50:0/108004208 shutdown_connections 2024-09-13T15:13:00.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 -- 172.21.15.50:0/108004208 wait complete. 2024-09-13T15:13:00.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 Processor -- start 2024-09-13T15:13:00.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.750+0000 7fc92d200700 1 -- start start 2024-09-13T15:13:00.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 0x7fc928157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9281599c0 0x7fc928149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92815d4a0 0x7fc92814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92814a2f0 con 0x7fc92806c8e0 2024-09-13T15:13:00.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92814c370 con 0x7fc92815d4a0 2024-09-13T15:13:00.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92814b760 con 0x7fc9281599c0 2024-09-13T15:13:00.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 0x7fc928157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 0x7fc928157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43206/0 (socket says 172.21.15.50:43206) 2024-09-13T15:13:00.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 -- 172.21.15.50:0/1778559202 learned_addr learned my addr 172.21.15.50:0/1778559202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:00.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc926a00700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9281599c0 0x7fc928149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927e00700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92815d4a0 0x7fc92814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 -- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9281599c0 msgr2=0x7fc928149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9281599c0 0x7fc928149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 -- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92815d4a0 msgr2=0x7fc92814af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92815d4a0 0x7fc92814af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 -- 172.21.15.50:0/1778559202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91800b810 con 0x7fc92806c8e0 2024-09-13T15:13:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc927400700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 0x7fc928157b60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc928067c50 tx=0x7fc918004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918003d10 con 0x7fc92806c8e0 2024-09-13T15:13:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918003e70 con 0x7fc92806c8e0 2024-09-13T15:13:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92814ba40 con 0x7fc92806c8e0 2024-09-13T15:13:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918010800 con 0x7fc92806c8e0 2024-09-13T15:13:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.754+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92814c000 con 0x7fc92806c8e0 2024-09-13T15:13:00.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.758+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9280b2ad0 con 0x7fc92806c8e0 2024-09-13T15:13:00.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.758+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc91802c440 con 0x7fc92806c8e0 2024-09-13T15:13:00.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.762+0000 7fc91f400700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc908066730 0x7fc908068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:00.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.762+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fc918085cc0 con 0x7fc92806c8e0 2024-09-13T15:13:00.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.762+0000 7fc926a00700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc908066730 0x7fc908068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:00.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.762+0000 7fc926a00700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc908066730 0x7fc908068bf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc9280b5370 tx=0x7fc914008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.766+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9280b2ad0 con 0x7fc92806c8e0 2024-09-13T15:13:00.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.946+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9280b2d90 con 0x7fc908066730 2024-09-13T15:13:00.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc91f400700 1 -- 172.21.15.50:0/1778559202 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc91400a670 con 0x7fc908066730 2024-09-13T15:13:00.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc908066730 msgr2=0x7fc908068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc908066730 0x7fc908068bf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc9280b5370 tx=0x7fc914008040 comp rx=0 tx=0).stop 2024-09-13T15:13:00.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 msgr2=0x7fc928157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:00.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 0x7fc928157b60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc928067c50 tx=0x7fc918004770 comp rx=0 tx=0).stop 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 shutdown_connections 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc908066730 0x7fc908068bf0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92815d4a0 0x7fc92814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9281599c0 0x7fc928149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 --2- 172.21.15.50:0/1778559202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc92806c8e0 0x7fc928157b60 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 >> 172.21.15.50:0/1778559202 conn(0x7fc92806e660 msgr2=0x7fc9280cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 shutdown_connections 2024-09-13T15:13:00.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:00.950+0000 7fc92d200700 1 -- 172.21.15.50:0/1778559202 wait complete. 2024-09-13T15:13:00.960 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T15:13:00.979 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T15:13:00.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:13:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.158+0000 7f5eee400700 1 Processor -- start 2024-09-13T15:13:01.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.158+0000 7f5eee400700 1 -- start start 2024-09-13T15:13:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.162+0000 7f5eee400700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5ee8066090 0x7f5ee80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.162+0000 7f5eee400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ee8066470 0x7f5ee80ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.162+0000 7f5eee400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80ac890 con 0x7f5ee80ae5f0 2024-09-13T15:13:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.162+0000 7f5eee400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80ad510 con 0x7f5ee8066470 2024-09-13T15:13:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.162+0000 7f5eee400700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80acb70 con 0x7f5ee8066090 2024-09-13T15:13:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ee8066470 0x7f5ee80ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eed000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5ee8066090 0x7f5ee80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ee8066470 0x7f5ee80ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43218/0 (socket says 172.21.15.50:43218) 2024-09-13T15:13:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 -- 172.21.15.50:0/1998634365 learned_addr learned my addr 172.21.15.50:0/1998634365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 -- 172.21.15.50:0/1998634365 >> v2:172.21.15.181:3300/0 conn(0x7f5ee8066090 msgr2=0x7f5ee80ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 --2- 172.21.15.50:0/1998634365 >> v2:172.21.15.181:3300/0 conn(0x7f5ee8066090 0x7f5ee80ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 -- 172.21.15.50:0/1998634365 >> v1:172.21.15.181:6789/0 conn(0x7f5ee80ae5f0 legacy=0x7f5ee806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 -- 172.21.15.50:0/1998634365 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80ace50 con 0x7f5ee8066470 2024-09-13T15:13:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eed000700 1 --2- 172.21.15.50:0/1998634365 >> v2:172.21.15.181:3300/0 conn(0x7f5ee8066090 0x7f5ee80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:13:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7e00700 1 --2- 172.21.15.50:0/1998634365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066470 0x7f5ee80ae0b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80b26f0 tx=0x7f5ed4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc8b615453401bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7400700 1 -- 172.21.15.50:0/1998634365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400b8a0 con 0x7f5ee8066470 2024-09-13T15:13:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7400700 1 -- 172.21.15.50:0/1998634365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400ba00 con 0x7f5ee8066470 2024-09-13T15:13:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5ee7400700 1 -- 172.21.15.50:0/1998634365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400bd90 con 0x7f5ee8066470 2024-09-13T15:13:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 -- 172.21.15.50:0/1998634365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066470 msgr2=0x7f5ee80ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 --2- 172.21.15.50:0/1998634365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066470 0x7f5ee80ae0b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80b26f0 tx=0x7f5ed4009bf0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 -- 172.21.15.50:0/1998634365 shutdown_connections 2024-09-13T15:13:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 --2- 172.21.15.50:0/1998634365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066470 0x7f5ee80ae0b0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 --2- 172.21.15.50:0/1998634365 >> v2:172.21.15.181:3300/0 conn(0x7f5ee8066090 0x7f5ee80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 -- 172.21.15.50:0/1998634365 >> 172.21.15.50:0/1998634365 conn(0x7f5ee8070cd0 msgr2=0x7f5ee80710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 -- 172.21.15.50:0/1998634365 shutdown_connections 2024-09-13T15:13:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.166+0000 7f5eee400700 1 -- 172.21.15.50:0/1998634365 wait complete. 2024-09-13T15:13:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 Processor -- start 2024-09-13T15:13:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 -- start start 2024-09-13T15:13:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066090 0x7f5ee813a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ee8066470 0x7f5ee80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ee80ae5f0 0x7f5ee80b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80cf1a0 con 0x7f5ee8066090 2024-09-13T15:13:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee813ad00 con 0x7f5ee80ae5f0 2024-09-13T15:13:01.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eee400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80ce590 con 0x7f5ee8066470 2024-09-13T15:13:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066090 0x7f5ee813a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066090 0x7f5ee813a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43224/0 (socket says 172.21.15.50:43224) 2024-09-13T15:13:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 -- 172.21.15.50:0/2252870712 learned_addr learned my addr 172.21.15.50:0/2252870712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5ee7e00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ee8066470 0x7f5ee80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eeda00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ee80ae5f0 0x7f5ee80b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 -- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ee8066470 msgr2=0x7f5ee80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5ee8066470 0x7f5ee80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 -- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ee80ae5f0 msgr2=0x7f5ee80b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ee80ae5f0 0x7f5ee80b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.170+0000 7f5eed000700 1 -- 172.21.15.50:0/2252870712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009570 con 0x7f5ee8066090 2024-09-13T15:13:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5eed000700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066090 0x7f5ee813a7c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e760 tx=0x7f5edc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00c070 con 0x7f5ee8066090 2024-09-13T15:13:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80ce870 con 0x7f5ee8066090 2024-09-13T15:13:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc004250 con 0x7f5ee8066090 2024-09-13T15:13:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0036c0 con 0x7f5ee8066090 2024-09-13T15:13:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80cee30 con 0x7f5ee8066090 2024-09-13T15:13:01.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.174+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ee8066890 con 0x7f5ee8066090 2024-09-13T15:13:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5edc003820 con 0x7f5ee8066090 2024-09-13T15:13:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee4c00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ec8066760 0x7f5ec8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f5edc084710 con 0x7f5ee8066090 2024-09-13T15:13:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee4c00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7f5ec806cce0 0x7f5ec806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 --> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ec806f7f0 con 0x7f5ec806cce0 2024-09-13T15:13:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5edc084b60 con 0x7f5ee8066090 2024-09-13T15:13:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee7e00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ec8066760 0x7f5ec8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5eeda00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7f5ec806cce0 0x7f5ec806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5ee7e00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ec8066760 0x7f5ec8068c20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4000c00 tx=0x7f5ed4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.178+0000 7f5eeda00700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7f5ec806cce0 0x7f5ec806f120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.182+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== osd.3 v2:172.21.15.50:6821/2543403071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5ec806f7f0 con 0x7f5ec806cce0 2024-09-13T15:13:01.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.198+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 --> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ee80cf2e0 con 0x7f5ec806cce0 2024-09-13T15:13:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.198+0000 7f5ee4c00700 1 -- 172.21.15.50:0/2252870712 <== osd.3 v2:172.21.15.50:6821/2543403071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5ee0001ec0 con 0x7f5ec806cce0 2024-09-13T15:13:01.205 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:13:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:13:01.205 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:13:01.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7f5ec806cce0 msgr2=0x7f5ec806f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:6821/2543403071,v1:172.21.15.50:6824/2543403071] conn(0x7f5ec806cce0 0x7f5ec806f120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ec8066760 msgr2=0x7f5ec8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f5ec8066760 0x7f5ec8068c20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4000c00 tx=0x7f5ed4008030 comp rx=0 tx=0).stop 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066090 msgr2=0x7f5ee813a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 --2- 172.21.15.50:0/2252870712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ee8066090 0x7f5ee813a7c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e760 tx=0x7f5edc00ea70 comp rx=0 tx=0).stop 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eeda00700 1 -- 172.21.15.50:0/2252870712 reap_dead start 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 shutdown_connections 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 >> 172.21.15.50:0/2252870712 conn(0x7f5ee8070cd0 msgr2=0x7f5ee815c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 shutdown_connections 2024-09-13T15:13:01.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.202+0000 7f5eee400700 1 -- 172.21.15.50:0/2252870712 wait complete. 2024-09-13T15:13:01.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T15:13:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.418+0000 7f2166000700 1 Processor -- start 2024-09-13T15:13:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.418+0000 7f2166000700 1 -- start start 2024-09-13T15:13:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2166000700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 0x7f21601621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2166000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 0x7f2160162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2166000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21600cd010 con 0x7f216006c950 2024-09-13T15:13:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2166000700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2160163530 con 0x7f2160161300 2024-09-13T15:13:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2166000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21600cd2b0 con 0x7f2160162bc0 2024-09-13T15:13:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2164c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 0x7f21601621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 0x7f2160162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2164c00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 0x7f21601621d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:45022/0 (socket says 172.21.15.50:45022) 2024-09-13T15:13:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2164c00700 1 -- 172.21.15.50:0/3661906004 learned_addr learned my addr 172.21.15.50:0/3661906004 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:01.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 0x7f2160162ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:33004/0 (socket says 172.21.15.50:33004) 2024-09-13T15:13:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 -- 172.21.15.50:0/3661906004 >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 msgr2=0x7f21601621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 --2- 172.21.15.50:0/3661906004 >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 0x7f21601621d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 -- 172.21.15.50:0/3661906004 >> v1:172.21.15.181:6789/0 conn(0x7f216006c950 legacy=0x7f21600ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 -- 172.21.15.50:0/3661906004 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600cd590 con 0x7f2160162bc0 2024-09-13T15:13:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2164c00700 1 --2- 172.21.15.50:0/3661906004 >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 0x7f21601621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:13:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f2165600700 1 --2- 172.21.15.50:0/3661906004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 0x7f2160162ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2158009d90 tx=0x7f215800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3299c66e50fe9ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f215f400700 1 -- 172.21.15.50:0/3661906004 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800e070 con 0x7f2160162bc0 2024-09-13T15:13:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f215f400700 1 -- 172.21.15.50:0/3661906004 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158003a40 con 0x7f2160162bc0 2024-09-13T15:13:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.422+0000 7f215f400700 1 -- 172.21.15.50:0/3661906004 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158003df0 con 0x7f2160162bc0 2024-09-13T15:13:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 -- 172.21.15.50:0/3661906004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 msgr2=0x7f2160162ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 --2- 172.21.15.50:0/3661906004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 0x7f2160162ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2158009d90 tx=0x7f215800b330 comp rx=0 tx=0).stop 2024-09-13T15:13:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 -- 172.21.15.50:0/3661906004 shutdown_connections 2024-09-13T15:13:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 --2- 172.21.15.50:0/3661906004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160162bc0 0x7f2160162ff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 --2- 172.21.15.50:0/3661906004 >> v2:172.21.15.181:3300/0 conn(0x7f2160161300 0x7f21601621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 -- 172.21.15.50:0/3661906004 >> 172.21.15.50:0/3661906004 conn(0x7f21600b0b50 msgr2=0x7f21600b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 -- 172.21.15.50:0/3661906004 shutdown_connections 2024-09-13T15:13:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 -- 172.21.15.50:0/3661906004 wait complete. 2024-09-13T15:13:01.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.426+0000 7f2166000700 1 Processor -- start 2024-09-13T15:13:01.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 -- start start 2024-09-13T15:13:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f216006c950 0x7f21600c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160161300 0x7f21601f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 0x7f2160071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600c73c0 con 0x7f2160162bc0 2024-09-13T15:13:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600c76a0 con 0x7f216006c950 2024-09-13T15:13:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2166000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21600c7980 con 0x7f2160161300 2024-09-13T15:13:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 0x7f2160071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 0x7f2160071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43226/0 (socket says 172.21.15.50:43226) 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 -- 172.21.15.50:0/3674579416 learned_addr learned my addr 172.21.15.50:0/3674579416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2164c00700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f216006c950 0x7f21600c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f215fe00700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160161300 0x7f21601f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 -- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160161300 msgr2=0x7f21601f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160161300 0x7f21601f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 -- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f216006c950 msgr2=0x7f21600c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f216006c950 0x7f21600c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 -- 172.21.15.50:0/3674579416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154009570 con 0x7f2160162bc0 2024-09-13T15:13:01.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.430+0000 7f2165600700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 0x7f2160071940 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f21600cd3f0 tx=0x7f2158004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.434+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158009410 con 0x7f2160162bc0 2024-09-13T15:13:01.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.434+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158004560 con 0x7f2160162bc0 2024-09-13T15:13:01.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.434+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158004910 con 0x7f2160162bc0 2024-09-13T15:13:01.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.434+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2158009a70 con 0x7f2160162bc0 2024-09-13T15:13:01.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.434+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21600c7f40 con 0x7f2160162bc0 2024-09-13T15:13:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.434+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21600c8150 con 0x7f2160162bc0 2024-09-13T15:13:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.438+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2158012430 con 0x7f2160162bc0 2024-09-13T15:13:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.438+0000 7f215cc00700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2140066730 0x7f2140068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.438+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f21580859a0 con 0x7f2160162bc0 2024-09-13T15:13:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.438+0000 7f2164c00700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2140066730 0x7f2140068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.438+0000 7f2164c00700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2140066730 0x7f2140068bf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2154006d50 tx=0x7f21540092e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.446+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21580567f0 con 0x7f2160162bc0 2024-09-13T15:13:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.630+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f21600ceb50 con 0x7f2140066730 2024-09-13T15:13:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.630+0000 7f215cc00700 1 -- 172.21.15.50:0/3674579416 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21600ceb50 con 0x7f2140066730 2024-09-13T15:13:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2140066730 msgr2=0x7f2140068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2140066730 0x7f2140068bf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2154006d50 tx=0x7f21540092e0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 msgr2=0x7f2160071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 0x7f2160071940 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f21600cd3f0 tx=0x7f2158004af0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 shutdown_connections 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2140066730 0x7f2140068bf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2160162bc0 0x7f2160071940 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2160161300 0x7f21601f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 --2- 172.21.15.50:0/3674579416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f216006c950 0x7f21600c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 >> 172.21.15.50:0/3674579416 conn(0x7f21600b0b50 msgr2=0x7f2160161e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 shutdown_connections 2024-09-13T15:13:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.638+0000 7f2166000700 1 -- 172.21.15.50:0/3674579416 wait complete. 2024-09-13T15:13:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T15:13:01.665 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T15:13:01.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:13:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.838+0000 7f94dd200700 1 Processor -- start 2024-09-13T15:13:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.838+0000 7f94dd200700 1 -- start start 2024-09-13T15:13:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94dd200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94d8160fc0 0x7f94d806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94dd200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94dd200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d806d000 con 0x7f94d80cf0b0 2024-09-13T15:13:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94dd200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80cf540 con 0x7f94d8160fc0 2024-09-13T15:13:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94dd200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d806c3f0 con 0x7f94d80b3990 2024-09-13T15:13:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94d8160fc0 0x7f94d806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94d8160fc0 0x7f94d806be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:45028/0 (socket says 172.21.15.50:45028) 2024-09-13T15:13:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 -- 172.21.15.50:0/3646474850 learned_addr learned my addr 172.21.15.50:0/3646474850 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d6800700 1 --1- 172.21.15.50:0/3646474850 >> v1:172.21.15.181:6789/0 conn(0x7f94d80cf0b0 0x7f94d806fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:47708/0 (socket says 172.21.15.50:47708) 2024-09-13T15:13:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 -- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 msgr2=0x7f94d80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 --2- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 -- 172.21.15.50:0/3646474850 >> v1:172.21.15.181:6789/0 conn(0x7f94d80cf0b0 legacy=0x7f94d806fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.842+0000 7f94d5e00700 1 -- 172.21.15.50:0/3646474850 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d806c6d0 con 0x7f94d8160fc0 2024-09-13T15:13:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94d5e00700 1 --2- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 0x7f94d806be10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009910 tx=0x7f94c8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ac6cdf698dd5bee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94d4a00700 1 -- 172.21.15.50:0/3646474850 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011830 con 0x7f94d8160fc0 2024-09-13T15:13:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94d4a00700 1 -- 172.21.15.50:0/3646474850 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8011990 con 0x7f94d8160fc0 2024-09-13T15:13:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94d4a00700 1 -- 172.21.15.50:0/3646474850 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011d40 con 0x7f94d8160fc0 2024-09-13T15:13:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 -- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 msgr2=0x7f94d806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 --2- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 0x7f94d806be10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009910 tx=0x7f94c8009c20 comp rx=0 tx=0).stop 2024-09-13T15:13:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 -- 172.21.15.50:0/3646474850 shutdown_connections 2024-09-13T15:13:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 --2- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 --2- 172.21.15.50:0/3646474850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 0x7f94d806be10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 -- 172.21.15.50:0/3646474850 >> 172.21.15.50:0/3646474850 conn(0x7f94d806a570 msgr2=0x7f94d806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 -- 172.21.15.50:0/3646474850 shutdown_connections 2024-09-13T15:13:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.846+0000 7f94dd200700 1 -- 172.21.15.50:0/3646474850 wait complete. 2024-09-13T15:13:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 Processor -- start 2024-09-13T15:13:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 -- start start 2024-09-13T15:13:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80cf0b0 0x7f94d80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 0x7f94d8153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80ce320 con 0x7f94d80cf0b0 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8153540 con 0x7f94d8160fc0 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94dd200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80ce5a0 con 0x7f94d80b3990 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80cf0b0 0x7f94d80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80cf0b0 0x7f94d80cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43230/0 (socket says 172.21.15.50:43230) 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 -- 172.21.15.50:0/2956448312 learned_addr learned my addr 172.21.15.50:0/2956448312 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5e00700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d6800700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 0x7f94d8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 -- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 msgr2=0x7f94d80cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94d80b3990 0x7f94d80cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 -- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 msgr2=0x7f94d8153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94d8160fc0 0x7f94d8153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.850+0000 7f94d5400700 1 -- 172.21.15.50:0/2956448312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8009570 con 0x7f94d80cf0b0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94d5400700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80cf0b0 0x7f94d80cdde0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009fd0 tx=0x7f94c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40095a0 con 0x7f94d80cf0b0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c4013680 con 0x7f94d80cf0b0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d81543a0 con 0x7f94d80cf0b0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4013a10 con 0x7f94d80cf0b0 2024-09-13T15:13:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d8154960 con 0x7f94d80cf0b0 2024-09-13T15:13:01.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94d81613a0 con 0x7f94d80cf0b0 2024-09-13T15:13:01.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.854+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94c4013b70 con 0x7f94d80cf0b0 2024-09-13T15:13:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94ce000700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f94b8066730 0x7f94b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f94c4083fd0 con 0x7f94d80cf0b0 2024-09-13T15:13:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94ce000700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f94b806ccb0 0x7f94b806f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 --> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94b806f7c0 con 0x7f94b806ccb0 2024-09-13T15:13:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94c40865b0 con 0x7f94d80cf0b0 2024-09-13T15:13:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94d5e00700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f94b8066730 0x7f94b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94d6800700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f94b806ccb0 0x7f94b806f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:01.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94d5e00700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f94b8066730 0x7f94b8068bf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.858+0000 7f94d6800700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f94b806ccb0 0x7f94b806f0f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.862+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== osd.4 v2:172.21.15.181:6816/2078065177 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f94b806f7c0 con 0x7f94b806ccb0 2024-09-13T15:13:01.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.882+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 --> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94d806cc90 con 0x7f94b806ccb0 2024-09-13T15:13:01.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.882+0000 7f94ce000700 1 -- 172.21.15.50:0/2956448312 <== osd.4 v2:172.21.15.181:6816/2078065177 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f94d00071e0 con 0x7f94b806ccb0 2024-09-13T15:13:01.889 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:13:01.889 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:13:01.889 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:13:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.882+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f94b806ccb0 msgr2=0x7f94b806f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.882+0000 7f94dd200700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6816/2078065177,v1:172.21.15.181:6817/2078065177] conn(0x7f94b806ccb0 0x7f94b806f0f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f94b8066730 msgr2=0x7f94b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f94b8066730 0x7f94b8068bf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c8008030 comp rx=0 tx=0).stop 2024-09-13T15:13:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80cf0b0 msgr2=0x7f94d80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 --2- 172.21.15.50:0/2956448312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94d80cf0b0 0x7f94d80cdde0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009fd0 tx=0x7f94c400eb20 comp rx=0 tx=0).stop 2024-09-13T15:13:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94d6800700 1 -- 172.21.15.50:0/2956448312 reap_dead start 2024-09-13T15:13:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 shutdown_connections 2024-09-13T15:13:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 >> 172.21.15.50:0/2956448312 conn(0x7f94d806a570 msgr2=0x7f94d80af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:01.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 shutdown_connections 2024-09-13T15:13:01.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:01.886+0000 7f94dd200700 1 -- 172.21.15.50:0/2956448312 wait complete. 2024-09-13T15:13:01.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T15:13:02.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.094+0000 7f41e8000700 1 Processor -- start 2024-09-13T15:13:02.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.094+0000 7f41e8000700 1 -- start start 2024-09-13T15:13:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.094+0000 7f41e8000700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e015b700 0x7f41e015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.094+0000 7f41e8000700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00cdd90 con 0x7f41e006a5d0 2024-09-13T15:13:02.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.094+0000 7f41e8000700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e006ce10 con 0x7f41e006c460 2024-09-13T15:13:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.094+0000 7f41e8000700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e015c020 con 0x7f41e015b700 2024-09-13T15:13:02.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e5600700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41e015b700 0x7f41e015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e6000700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41e006a5d0 0x7f41e00b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36176/0 (socket says 172.21.15.50:36176) 2024-09-13T15:13:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e6000700 1 -- 172.21.15.50:0/3458268085 learned_addr learned my addr 172.21.15.50:0/3458268085 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:13:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41dfe00700 1 -- 172.21.15.50:0/3458268085 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559240005 0 0) 0x7f41e00cdd90 con 0x7f41e006a5d0 2024-09-13T15:13:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e5600700 1 -- 172.21.15.50:0/3458268085 >> v1:172.21.15.181:6789/0 conn(0x7f41e006c460 legacy=0x7f41e006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e5600700 1 -- 172.21.15.50:0/3458268085 >> v1:172.21.15.50:6789/0 conn(0x7f41e006a5d0 legacy=0x7f41e00b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e5600700 1 -- 172.21.15.50:0/3458268085 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00cd4f0 con 0x7f41e015b700 2024-09-13T15:13:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e5600700 1 --2- 172.21.15.50:0/3458268085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e015b700 0x7f41e015bae0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009850 tx=0x7f41d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4730669ad88007c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41dfe00700 1 -- 172.21.15.50:0/3458268085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011830 con 0x7f41e015b700 2024-09-13T15:13:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41dfe00700 1 -- 172.21.15.50:0/3458268085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4011990 con 0x7f41e015b700 2024-09-13T15:13:02.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41dfe00700 1 -- 172.21.15.50:0/3458268085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011d20 con 0x7f41e015b700 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 -- 172.21.15.50:0/3458268085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e015b700 msgr2=0x7f41e015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 --2- 172.21.15.50:0/3458268085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e015b700 0x7f41e015bae0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009850 tx=0x7f41d4009b60 comp rx=0 tx=0).stop 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 -- 172.21.15.50:0/3458268085 shutdown_connections 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 --2- 172.21.15.50:0/3458268085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e015b700 0x7f41e015bae0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 -- 172.21.15.50:0/3458268085 >> 172.21.15.50:0/3458268085 conn(0x7f41e00b08d0 msgr2=0x7f41e00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 -- 172.21.15.50:0/3458268085 shutdown_connections 2024-09-13T15:13:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.098+0000 7f41e8000700 1 -- 172.21.15.50:0/3458268085 wait complete. 2024-09-13T15:13:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 Processor -- start 2024-09-13T15:13:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 -- start start 2024-09-13T15:13:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41e006a5d0 0x7f41e0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 0x7f41e01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41e015b700 0x7f41e0157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0157e60 con 0x7f41e006c460 2024-09-13T15:13:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0155b50 con 0x7f41e006a5d0 2024-09-13T15:13:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.102+0000 7f41e8000700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0155e30 con 0x7f41e015b700 2024-09-13T15:13:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 0x7f41e01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 0x7f41e01573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43260/0 (socket says 172.21.15.50:43260) 2024-09-13T15:13:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 -- 172.21.15.50:0/4047178283 learned_addr learned my addr 172.21.15.50:0/4047178283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e5600700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41e006a5d0 0x7f41e0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e6000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41e015b700 0x7f41e0157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 -- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41e015b700 msgr2=0x7f41e0157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41e015b700 0x7f41e0157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 -- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41e006a5d0 msgr2=0x7f41e0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41e006a5d0 0x7f41e0150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 -- 172.21.15.50:0/4047178283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40094b0 con 0x7f41e006c460 2024-09-13T15:13:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e6000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41e015b700 0x7f41e0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:13:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e5600700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41e006a5d0 0x7f41e0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:13:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e4c00700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 0x7f41e01573e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c500 tx=0x7f41cc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0052d0 con 0x7f41e006c460 2024-09-13T15:13:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc005430 con 0x7f41e006c460 2024-09-13T15:13:02.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0055a0 con 0x7f41e006c460 2024-09-13T15:13:02.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e01580b0 con 0x7f41e006c460 2024-09-13T15:13:02.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e0158670 con 0x7f41e006c460 2024-09-13T15:13:02.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.106+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e006ae30 con 0x7f41e006c460 2024-09-13T15:13:02.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.110+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41cc0038e0 con 0x7f41e006c460 2024-09-13T15:13:02.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.110+0000 7f41dd600700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41c0066730 0x7f41c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.110+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f41cc0835a0 con 0x7f41e006c460 2024-09-13T15:13:02.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.110+0000 7f41e5600700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41c0066730 0x7f41c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.114+0000 7f41e5600700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41c0066730 0x7f41c0068bf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f41d40090b0 tx=0x7f41d401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.118+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41cc0508e0 con 0x7f41e006c460 2024-09-13T15:13:02.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.298+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f41e00730c0 con 0x7f41c0066730 2024-09-13T15:13:02.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.302+0000 7f41dd600700 1 -- 172.21.15.50:0/4047178283 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f41e00730c0 con 0x7f41c0066730 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.302+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41c0066730 msgr2=0x7f41c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.302+0000 7f41e8000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41c0066730 0x7f41c0068bf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f41d40090b0 tx=0x7f41d401c040 comp rx=0 tx=0).stop 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.302+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 msgr2=0x7f41e01573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 0x7f41e01573e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c500 tx=0x7f41cc00c810 comp rx=0 tx=0).stop 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 shutdown_connections 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f41c0066730 0x7f41c0068bf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41e015b700 0x7f41e0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41e006c460 0x7f41e01573e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 --2- 172.21.15.50:0/4047178283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41e006a5d0 0x7f41e0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 >> 172.21.15.50:0/4047178283 conn(0x7f41e00b08d0 msgr2=0x7f41e00b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 shutdown_connections 2024-09-13T15:13:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.306+0000 7f41e8000700 1 -- 172.21.15.50:0/4047178283 wait complete. 2024-09-13T15:13:02.312 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T15:13:02.332 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T15:13:02.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:13:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 Processor -- start 2024-09-13T15:13:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 -- start start 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64a80b43a0 0x7f64a80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f64a80c5fd0 0x7f64a80b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a80cebd0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a80ce370 con 0x7f64a80b43a0 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ae200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a80cff30 con 0x7f64a80c5fd0 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ace00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64a80b3fc0 0x7f64a80cf2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36186/0 (socket says 172.21.15.50:36186) 2024-09-13T15:13:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64ace00700 1 -- 172.21.15.50:0/2235761126 learned_addr learned my addr 172.21.15.50:0/2235761126 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:13:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.518+0000 7f64a7e00700 1 --2- 172.21.15.50:0/2235761126 >> v2:172.21.15.50:3300/0 conn(0x7f64a80b43a0 0x7f64a80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ad800700 1 --2- 172.21.15.50:0/2235761126 >> v2:172.21.15.181:3300/0 conn(0x7f64a80c5fd0 0x7f64a80b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7400700 1 -- 172.21.15.50:0/2235761126 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844117893 0 0) 0x7f64a80cebd0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7400700 1 -- 172.21.15.50:0/2235761126 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64900035d0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7e00700 1 -- 172.21.15.50:0/2235761126 >> v2:172.21.15.181:3300/0 conn(0x7f64a80c5fd0 msgr2=0x7f64a80b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7e00700 1 --2- 172.21.15.50:0/2235761126 >> v2:172.21.15.181:3300/0 conn(0x7f64a80c5fd0 0x7f64a80b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7e00700 1 -- 172.21.15.50:0/2235761126 >> v1:172.21.15.50:6789/0 conn(0x7f64a80b3fc0 legacy=0x7f64a80cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7e00700 1 -- 172.21.15.50:0/2235761126 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80ce610 con 0x7f64a80b43a0 2024-09-13T15:13:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7e00700 1 --2- 172.21.15.50:0/2235761126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b43a0 0x7f64a80cf9f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f64a80cd590 tx=0x7f6494009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d4c0d5222e0cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7400700 1 -- 172.21.15.50:0/2235761126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494011830 con 0x7f64a80b43a0 2024-09-13T15:13:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7400700 1 -- 172.21.15.50:0/2235761126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494011990 con 0x7f64a80b43a0 2024-09-13T15:13:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64a7400700 1 -- 172.21.15.50:0/2235761126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494011d20 con 0x7f64a80b43a0 2024-09-13T15:13:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 -- 172.21.15.50:0/2235761126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b43a0 msgr2=0x7f64a80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 --2- 172.21.15.50:0/2235761126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b43a0 0x7f64a80cf9f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f64a80cd590 tx=0x7f6494009b30 comp rx=0 tx=0).stop 2024-09-13T15:13:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 -- 172.21.15.50:0/2235761126 shutdown_connections 2024-09-13T15:13:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 --2- 172.21.15.50:0/2235761126 >> v2:172.21.15.181:3300/0 conn(0x7f64a80c5fd0 0x7f64a80b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 --2- 172.21.15.50:0/2235761126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b43a0 0x7f64a80cf9f0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 -- 172.21.15.50:0/2235761126 >> 172.21.15.50:0/2235761126 conn(0x7f64a80d2cf0 msgr2=0x7f64a80d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 -- 172.21.15.50:0/2235761126 shutdown_connections 2024-09-13T15:13:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.522+0000 7f64ae200700 1 -- 172.21.15.50:0/2235761126 wait complete. 2024-09-13T15:13:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 Processor -- start 2024-09-13T15:13:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 -- start start 2024-09-13T15:13:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b3fc0 0x7f64a80cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a80b43a0 0x7f64a815e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a80c5fd0 0x7f64a8163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80cd0f0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a815e880 con 0x7f64a80b43a0 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.526+0000 7f64ae200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80cc570 con 0x7f64a80c5fd0 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b3fc0 0x7f64a80cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b3fc0 0x7f64a80cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43266/0 (socket says 172.21.15.50:43266) 2024-09-13T15:13:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 -- 172.21.15.50:0/3641153700 learned_addr learned my addr 172.21.15.50:0/3641153700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ad800700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a80c5fd0 0x7f64a8163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64a7e00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a80b43a0 0x7f64a815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 -- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a80c5fd0 msgr2=0x7f64a8163ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a80c5fd0 0x7f64a8163ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 -- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a80b43a0 msgr2=0x7f64a815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a80b43a0 0x7f64a815e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 -- 172.21.15.50:0/3641153700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940094b0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ace00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b3fc0 0x7f64a80cbf00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c700 tx=0x7f649c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c005d90 con 0x7f64a80b3fc0 2024-09-13T15:13:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c0070d0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c007480 con 0x7f64a80b3fc0 2024-09-13T15:13:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a80cc850 con 0x7f64a80b3fc0 2024-09-13T15:13:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a80cce10 con 0x7f64a80b3fc0 2024-09-13T15:13:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.530+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64a80d1a00 con 0x7f64a80b3fc0 2024-09-13T15:13:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f649c0075e0 con 0x7f64a80b3fc0 2024-09-13T15:13:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a4c00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6488066760 0x7f6488068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f649c083500 con 0x7f64a80b3fc0 2024-09-13T15:13:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a4c00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f648806cce0 0x7f648806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 --> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f648806f7f0 con 0x7f648806cce0 2024-09-13T15:13:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f649c085a80 con 0x7f64a80b3fc0 2024-09-13T15:13:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.534+0000 7f64a7e00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6488066760 0x7f6488068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.538+0000 7f64ad800700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f648806cce0 0x7f648806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.538+0000 7f64a7e00700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6488066760 0x7f6488068c20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6494000c00 tx=0x7f6494008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.538+0000 7f64ad800700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f648806cce0 0x7f648806f120 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.538+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== osd.5 v2:172.21.15.181:6824/1243766751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f648806f7f0 con 0x7f648806cce0 2024-09-13T15:13:02.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.558+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 --> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64a80d01d0 con 0x7f648806cce0 2024-09-13T15:13:02.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.558+0000 7f64a4c00700 1 -- 172.21.15.50:0/3641153700 <== osd.5 v2:172.21.15.181:6824/1243766751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f64a000f040 con 0x7f648806cce0 2024-09-13T15:13:02.565 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:13:02.565 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:13:02.565 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:13:02.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f648806cce0 msgr2=0x7f648806f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6824/1243766751,v1:172.21.15.181:6825/1243766751] conn(0x7f648806cce0 0x7f648806f120 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6488066760 msgr2=0x7f6488068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f6488066760 0x7f6488068c20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6494000c00 tx=0x7f6494008030 comp rx=0 tx=0).stop 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b3fc0 msgr2=0x7f64a80cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 --2- 172.21.15.50:0/3641153700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a80b3fc0 0x7f64a80cbf00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c700 tx=0x7f649c00ca10 comp rx=0 tx=0).stop 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ad800700 1 -- 172.21.15.50:0/3641153700 reap_dead start 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 shutdown_connections 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 >> 172.21.15.50:0/3641153700 conn(0x7f64a80d2cf0 msgr2=0x7f64a8160530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 shutdown_connections 2024-09-13T15:13:02.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.562+0000 7f64ae200700 1 -- 172.21.15.50:0/3641153700 wait complete. 2024-09-13T15:13:02.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T15:13:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5e00700 1 Processor -- start 2024-09-13T15:13:02.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5e00700 1 -- start start 2024-09-13T15:13:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f32c00b3980 0x7f32c015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c015e560 con 0x7f32c006aaa0 2024-09-13T15:13:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00b3e10 con 0x7f32c015d310 2024-09-13T15:13:02.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00adf90 con 0x7f32c00b3980 2024-09-13T15:13:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c4a00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32c006aaa0 0x7f32c006ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36194/0 (socket says 172.21.15.50:36194) 2024-09-13T15:13:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c4a00700 1 -- 172.21.15.50:0/2969567155 learned_addr learned my addr 172.21.15.50:0/2969567155 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:13:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.762+0000 7f32c5400700 1 --2- 172.21.15.50:0/2969567155 >> v2:172.21.15.181:3300/0 conn(0x7f32c00b3980 0x7f32c015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003547732 0 0) 0x7f32c015e560 con 0x7f32c006aaa0 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a80035d0 con 0x7f32c006aaa0 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144740860 0 0) 0x7f32c00b3e10 con 0x7f32c015d310 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c015e560 con 0x7f32c015d310 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5400700 1 -- 172.21.15.50:0/2969567155 >> v1:172.21.15.181:6789/0 conn(0x7f32c015d310 legacy=0x7f32c015e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5400700 1 -- 172.21.15.50:0/2969567155 >> v1:172.21.15.50:6789/0 conn(0x7f32c006aaa0 legacy=0x7f32c006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5400700 1 -- 172.21.15.50:0/2969567155 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c015d920 con 0x7f32c00b3980 2024-09-13T15:13:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5400700 1 --2- 172.21.15.50:0/2969567155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c015f100 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009d90 tx=0x7f32b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f96a4f8fff758199 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800e070 con 0x7f32c00b3980 2024-09-13T15:13:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800bb20 con 0x7f32c00b3980 2024-09-13T15:13:02.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32bf400700 1 -- 172.21.15.50:0/2969567155 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8012430 con 0x7f32c00b3980 2024-09-13T15:13:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 -- 172.21.15.50:0/2969567155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 msgr2=0x7f32c015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 --2- 172.21.15.50:0/2969567155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c015f100 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009d90 tx=0x7f32b800b330 comp rx=0 tx=0).stop 2024-09-13T15:13:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 -- 172.21.15.50:0/2969567155 shutdown_connections 2024-09-13T15:13:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 --2- 172.21.15.50:0/2969567155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c015f100 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 -- 172.21.15.50:0/2969567155 >> 172.21.15.50:0/2969567155 conn(0x7f32c00b0c40 msgr2=0x7f32c006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 -- 172.21.15.50:0/2969567155 shutdown_connections 2024-09-13T15:13:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.766+0000 7f32c5e00700 1 -- 172.21.15.50:0/2969567155 wait complete. 2024-09-13T15:13:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 Processor -- start 2024-09-13T15:13:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 -- start start 2024-09-13T15:13:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 0x7f32c013cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c0145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32c015d310 0x7f32c013edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01e55a0 con 0x7f32c006aaa0 2024-09-13T15:13:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0146780 con 0x7f32c00b3980 2024-09-13T15:13:02.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c5e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01e57b0 con 0x7f32c015d310 2024-09-13T15:13:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c4a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 0x7f32c013cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c4a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 0x7f32c013cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43268/0 (socket says 172.21.15.50:43268) 2024-09-13T15:13:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32c4a00700 1 -- 172.21.15.50:0/3434864325 learned_addr learned my addr 172.21.15.50:0/3434864325 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.770+0000 7f32bfe00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c0145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c5400700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32c015d310 0x7f32c013edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c4a00700 1 -- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32c015d310 msgr2=0x7f32c013edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c4a00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32c015d310 0x7f32c013edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c4a00700 1 -- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 msgr2=0x7f32c0145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c4a00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c0145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c4a00700 1 -- 172.21.15.50:0/3434864325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8009a70 con 0x7f32c006aaa0 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c5400700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32c015d310 0x7f32c013edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:13:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c4a00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 0x7f32c013cac0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f32b400c560 tx=0x7f32b400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4005d90 con 0x7f32c006aaa0 2024-09-13T15:13:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c01e5a90 con 0x7f32c006aaa0 2024-09-13T15:13:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40070d0 con 0x7f32c006aaa0 2024-09-13T15:13:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4007460 con 0x7f32c006aaa0 2024-09-13T15:13:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.774+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c013d000 con 0x7f32c006aaa0 2024-09-13T15:13:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.778+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c01e5fb0 con 0x7f32c006aaa0 2024-09-13T15:13:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.778+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32b40075c0 con 0x7f32c006aaa0 2024-09-13T15:13:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.778+0000 7f32bcc00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32a0066730 0x7f32a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.778+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f32b40836b0 con 0x7f32c006aaa0 2024-09-13T15:13:02.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.778+0000 7f32bfe00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32a0066730 0x7f32a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:02.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.782+0000 7f32bfe00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32a0066730 0x7f32a0068bf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f32c013fad0 tx=0x7f32ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:02.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.782+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32c01e5fb0 con 0x7f32c006aaa0 2024-09-13T15:13:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.962+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f32c013d1c0 con 0x7f32a0066730 2024-09-13T15:13:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.962+0000 7f32bcc00700 1 -- 172.21.15.50:0/3434864325 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32c013d1c0 con 0x7f32a0066730 2024-09-13T15:13:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32a0066730 msgr2=0x7f32a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32a0066730 0x7f32a0068bf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f32c013fad0 tx=0x7f32ac009040 comp rx=0 tx=0).stop 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 msgr2=0x7f32c013cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 0x7f32c013cac0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f32b400c560 tx=0x7f32b400c870 comp rx=0 tx=0).stop 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 shutdown_connections 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f32a0066730 0x7f32a0068bf0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f32c015d310 0x7f32c013edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c00b3980 0x7f32c0145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 --2- 172.21.15.50:0/3434864325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c006aaa0 0x7f32c013cac0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 >> 172.21.15.50:0/3434864325 conn(0x7f32c00b0c40 msgr2=0x7f32c006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 shutdown_connections 2024-09-13T15:13:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:02.966+0000 7f32c5e00700 1 -- 172.21.15.50:0/3434864325 wait complete. 2024-09-13T15:13:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T15:13:02.993 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T15:13:02.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:13:03.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 Processor -- start 2024-09-13T15:13:03.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 -- start start 2024-09-13T15:13:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c406be10 0x7fa0c40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c406d000 con 0x7fa0c4160fc0 2024-09-13T15:13:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40cf520 con 0x7fa0c406be10 2024-09-13T15:13:03.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.174+0000 7fa0cc200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c406c3f0 con 0x7fa0c40cf0b0 2024-09-13T15:13:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c406be10 0x7fa0c40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c406be10 0x7fa0c40ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55530/0 (socket says 172.21.15.50:55530) 2024-09-13T15:13:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 -- 172.21.15.50:0/3472488533 learned_addr learned my addr 172.21.15.50:0/3472488533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0ca200700 1 --2- 172.21.15.50:0/3472488533 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 -- 172.21.15.50:0/3472488533 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 msgr2=0x7fa0c41618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 --2- 172.21.15.50:0/3472488533 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 -- 172.21.15.50:0/3472488533 >> v1:172.21.15.181:6789/0 conn(0x7fa0c4160fc0 legacy=0x7fa0c40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 -- 172.21.15.50:0/3472488533 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c406c6d0 con 0x7fa0c406be10 2024-09-13T15:13:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c8e00700 1 --2- 172.21.15.50:0/3472488533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c40ceb70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009910 tx=0x7fa0b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0dbf6bc4ee080f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c3e00700 1 -- 172.21.15.50:0/3472488533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0011830 con 0x7fa0c406be10 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c3e00700 1 -- 172.21.15.50:0/3472488533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b0011990 con 0x7fa0c406be10 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0c3e00700 1 -- 172.21.15.50:0/3472488533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0011d40 con 0x7fa0c406be10 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 -- 172.21.15.50:0/3472488533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 msgr2=0x7fa0c40ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 --2- 172.21.15.50:0/3472488533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c40ceb70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009910 tx=0x7fa0b0009c20 comp rx=0 tx=0).stop 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 -- 172.21.15.50:0/3472488533 shutdown_connections 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 --2- 172.21.15.50:0/3472488533 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 --2- 172.21.15.50:0/3472488533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c40ceb70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 -- 172.21.15.50:0/3472488533 >> 172.21.15.50:0/3472488533 conn(0x7fa0c406a570 msgr2=0x7fa0c406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 -- 172.21.15.50:0/3472488533 shutdown_connections 2024-09-13T15:13:03.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.178+0000 7fa0cc200700 1 -- 172.21.15.50:0/3472488533 wait complete. 2024-09-13T15:13:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.182+0000 7fa0cc200700 1 Processor -- start 2024-09-13T15:13:03.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.182+0000 7fa0cc200700 1 -- start start 2024-09-13T15:13:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0cc200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0cc200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0cc200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c4160fc0 0x7fa0c41f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0cc200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41567f0 con 0x7fa0c406be10 2024-09-13T15:13:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0cc200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4153ac0 con 0x7fa0c4160fc0 2024-09-13T15:13:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0cc200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40b00a0 con 0x7fa0c40cf0b0 2024-09-13T15:13:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c41562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55540/0 (socket says 172.21.15.50:55540) 2024-09-13T15:13:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 -- 172.21.15.50:0/3449528197 learned_addr learned my addr 172.21.15.50:0/3449528197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c8e00700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0ca200700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c4160fc0 0x7fa0c41f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 -- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 msgr2=0x7fa0c41f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa0c40cf0b0 0x7fa0c41f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 -- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c4160fc0 msgr2=0x7fa0c41f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c4160fc0 0x7fa0c41f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 -- 172.21.15.50:0/3449528197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0009570 con 0x7fa0c406be10 2024-09-13T15:13:03.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c9800700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c41562b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800c500 tx=0x7fa0b800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.186+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80052d0 con 0x7fa0c406be10 2024-09-13T15:13:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.190+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40b0380 con 0x7fa0c406be10 2024-09-13T15:13:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.190+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8005430 con 0x7fa0c406be10 2024-09-13T15:13:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.190+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40b0940 con 0x7fa0c406be10 2024-09-13T15:13:03.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.190+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80055a0 con 0x7fa0c406be10 2024-09-13T15:13:03.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.190+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0c41613a0 con 0x7fa0c406be10 2024-09-13T15:13:03.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.194+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0b80038a0 con 0x7fa0c406be10 2024-09-13T15:13:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c1600700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa0a4066760 0x7fa0a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa0b8083b20 con 0x7fa0c406be10 2024-09-13T15:13:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c1600700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7fa0a406cce0 0x7fa0a406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 --> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0a406f7f0 con 0x7fa0a406cce0 2024-09-13T15:13:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c8e00700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa0a4066760 0x7fa0a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b8083e90 con 0x7fa0c406be10 2024-09-13T15:13:03.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0ca200700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7fa0a406cce0 0x7fa0a406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0c8e00700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa0a4066760 0x7fa0a4068c20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0000c00 tx=0x7fa0b0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.198+0000 7fa0ca200700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7fa0a406cce0 0x7fa0a406f120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.202+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== osd.6 v2:172.21.15.181:6800/89220898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa0a406f7f0 con 0x7fa0a406cce0 2024-09-13T15:13:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.222+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 --> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0c406cc90 con 0x7fa0a406cce0 2024-09-13T15:13:03.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.222+0000 7fa0c1600700 1 -- 172.21.15.50:0/3449528197 <== osd.6 v2:172.21.15.181:6800/89220898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa0bc00f040 con 0x7fa0a406cce0 2024-09-13T15:13:03.229 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:13:03.229 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:13:03.229 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:13:03.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7fa0a406cce0 msgr2=0x7fa0a406f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6800/89220898,v1:172.21.15.181:6801/89220898] conn(0x7fa0a406cce0 0x7fa0a406f120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa0a4066760 msgr2=0x7fa0a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa0a4066760 0x7fa0a4068c20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0000c00 tx=0x7fa0b0008030 comp rx=0 tx=0).stop 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 msgr2=0x7fa0c41562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 --2- 172.21.15.50:0/3449528197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406be10 0x7fa0c41562b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800c500 tx=0x7fa0b800c810 comp rx=0 tx=0).stop 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0ca200700 1 -- 172.21.15.50:0/3449528197 reap_dead start 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 shutdown_connections 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 >> 172.21.15.50:0/3449528197 conn(0x7fa0c406a570 msgr2=0x7fa0c4162850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 shutdown_connections 2024-09-13T15:13:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.226+0000 7fa0cc200700 1 -- 172.21.15.50:0/3449528197 wait complete. 2024-09-13T15:13:03.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T15:13:03.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.442+0000 7f2999e00700 1 Processor -- start 2024-09-13T15:13:03.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.442+0000 7f2999e00700 1 -- start start 2024-09-13T15:13:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2994161020 0x7f2994071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f299406ab00 0x7f299406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299406a390 con 0x7f29940ccd90 2024-09-13T15:13:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299406bc20 con 0x7f299406ab00 2024-09-13T15:13:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940cd340 con 0x7f2994161020 2024-09-13T15:13:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f298be00700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29940ccd90 0x7f29940b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42656/0 (socket says 172.21.15.50:42656) 2024-09-13T15:13:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f298be00700 1 -- 172.21.15.50:0/2810990176 learned_addr learned my addr 172.21.15.50:0/2810990176 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-13T15:13:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999400700 1 --2- 172.21.15.50:0/2810990176 >> v2:172.21.15.50:3300/0 conn(0x7f299406ab00 0x7f299406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2998a00700 1 --2- 172.21.15.50:0/2810990176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2994161020 0x7f2994071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2993e00700 1 -- 172.21.15.50:0/2810990176 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318908405 0 0) 0x7f299406a390 con 0x7f29940ccd90 2024-09-13T15:13:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999400700 1 -- 172.21.15.50:0/2810990176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2994161020 msgr2=0x7f2994071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999400700 1 --2- 172.21.15.50:0/2810990176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2994161020 0x7f2994071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999400700 1 -- 172.21.15.50:0/2810990176 >> v1:172.21.15.50:6789/0 conn(0x7f29940ccd90 legacy=0x7f29940b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999400700 1 -- 172.21.15.50:0/2810990176 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994071860 con 0x7f299406ab00 2024-09-13T15:13:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2999400700 1 --2- 172.21.15.50:0/2810990176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f299406ab00 0x7f299406af90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f298c009d90 tx=0x7f298c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2e2d8af2aa1758 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2993e00700 1 -- 172.21.15.50:0/2810990176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00e070 con 0x7f299406ab00 2024-09-13T15:13:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2993e00700 1 -- 172.21.15.50:0/2810990176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00bb20 con 0x7f299406ab00 2024-09-13T15:13:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.446+0000 7f2993e00700 1 -- 172.21.15.50:0/2810990176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c012430 con 0x7f299406ab00 2024-09-13T15:13:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 -- 172.21.15.50:0/2810990176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f299406ab00 msgr2=0x7f299406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 --2- 172.21.15.50:0/2810990176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f299406ab00 0x7f299406af90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f298c009d90 tx=0x7f298c00b330 comp rx=0 tx=0).stop 2024-09-13T15:13:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 -- 172.21.15.50:0/2810990176 shutdown_connections 2024-09-13T15:13:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 --2- 172.21.15.50:0/2810990176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f299406ab00 0x7f299406af90 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 --2- 172.21.15.50:0/2810990176 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2994161020 0x7f2994071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 -- 172.21.15.50:0/2810990176 >> 172.21.15.50:0/2810990176 conn(0x7f299406ca10 msgr2=0x7f299406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 -- 172.21.15.50:0/2810990176 shutdown_connections 2024-09-13T15:13:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 -- 172.21.15.50:0/2810990176 wait complete. 2024-09-13T15:13:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 Processor -- start 2024-09-13T15:13:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.450+0000 7f2999e00700 1 -- start start 2024-09-13T15:13:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299406ab00 0x7f299415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29940ccd90 0x7f29941f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 0x7f29941f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994157b10 con 0x7f2994161020 2024-09-13T15:13:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29941f74c0 con 0x7f299406ab00 2024-09-13T15:13:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29941f77a0 con 0x7f29940ccd90 2024-09-13T15:13:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 0x7f29941f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 0x7f29941f99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55552/0 (socket says 172.21.15.50:55552) 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 -- 172.21.15.50:0/2865421595 learned_addr learned my addr 172.21.15.50:0/2865421595 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f298be00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29940ccd90 0x7f29941f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2998a00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299406ab00 0x7f299415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 -- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29940ccd90 msgr2=0x7f29941f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29940ccd90 0x7f29941f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 -- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299406ab00 msgr2=0x7f299415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299406ab00 0x7f299415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 -- 172.21.15.50:0/2865421595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009a70 con 0x7f2994161020 2024-09-13T15:13:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.454+0000 7f2999400700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 0x7f29941f99f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f298c014040 tx=0x7f298c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c012430 con 0x7f2994161020 2024-09-13T15:13:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c020070 con 0x7f2994161020 2024-09-13T15:13:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29941f7a80 con 0x7f2994161020 2024-09-13T15:13:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c004280 con 0x7f2994161020 2024-09-13T15:13:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29941f9f30 con 0x7f2994161020 2024-09-13T15:13:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2994157ff0 con 0x7f2994161020 2024-09-13T15:13:03.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.458+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f298c0043e0 con 0x7f2994161020 2024-09-13T15:13:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.462+0000 7f2991600700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2970066730 0x7f2970068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.462+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f298c022070 con 0x7f2994161020 2024-09-13T15:13:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.462+0000 7f2998a00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2970066730 0x7f2970068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.462+0000 7f2998a00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2970066730 0x7f2970068bf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2994159320 tx=0x7f2984009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.470+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2994157ff0 con 0x7f2994161020 2024-09-13T15:13:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.658+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f299406a5e0 con 0x7f2970066730 2024-09-13T15:13:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.662+0000 7f2991600700 1 -- 172.21.15.50:0/2865421595 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2984011860 con 0x7f2970066730 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2970066730 msgr2=0x7f2970068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2970066730 0x7f2970068bf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2994159320 tx=0x7f2984009240 comp rx=0 tx=0).stop 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 msgr2=0x7f29941f99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 0x7f29941f99f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f298c014040 tx=0x7f298c004af0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 shutdown_connections 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f2970066730 0x7f2970068bf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2994161020 0x7f29941f99f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29940ccd90 0x7f29941f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 --2- 172.21.15.50:0/2865421595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299406ab00 0x7f299415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 >> 172.21.15.50:0/2865421595 conn(0x7f299406ca10 msgr2=0x7f2994070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 shutdown_connections 2024-09-13T15:13:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.666+0000 7f2999e00700 1 -- 172.21.15.50:0/2865421595 wait complete. 2024-09-13T15:13:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T15:13:03.695 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T15:13:03.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:13:03.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.866+0000 7fa5fe400700 1 Processor -- start 2024-09-13T15:13:03.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.866+0000 7fa5fe400700 1 -- start start 2024-09-13T15:13:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5fe400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5f81509e0 0x7fa5f80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5fe400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b2f60 0x7fa5f815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5fe400700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f8150dc0 con 0x7fa5f80b33d0 2024-09-13T15:13:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5fe400700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f80cf510 con 0x7fa5f81509e0 2024-09-13T15:13:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5fe400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8071070 con 0x7fa5f80b2f60 2024-09-13T15:13:03.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5f81509e0 0x7fa5f80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5f81509e0 0x7fa5f80ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55568/0 (socket says 172.21.15.50:55568) 2024-09-13T15:13:03.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 -- 172.21.15.50:0/3091886676 learned_addr learned my addr 172.21.15.50:0/3091886676 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:03.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5efe00700 1 --2- 172.21.15.50:0/3091886676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b2f60 0x7fa5f815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 -- 172.21.15.50:0/3091886676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b2f60 msgr2=0x7fa5f815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:03.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 --2- 172.21.15.50:0/3091886676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b2f60 0x7fa5f815d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 -- 172.21.15.50:0/3091886676 >> v1:172.21.15.181:6789/0 conn(0x7fa5f80b33d0 legacy=0x7fa5f8071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.870+0000 7fa5f7400700 1 -- 172.21.15.50:0/3091886676 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8071350 con 0x7fa5f81509e0 2024-09-13T15:13:03.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5f7400700 1 --2- 172.21.15.50:0/3091886676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f80ceb70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009910 tx=0x7fa5e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9ee279e7d2a8cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5f6a00700 1 -- 172.21.15.50:0/3091886676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8011830 con 0x7fa5f81509e0 2024-09-13T15:13:03.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5f6a00700 1 -- 172.21.15.50:0/3091886676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8011990 con 0x7fa5f81509e0 2024-09-13T15:13:03.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5f6a00700 1 -- 172.21.15.50:0/3091886676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8011d40 con 0x7fa5f81509e0 2024-09-13T15:13:03.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 -- 172.21.15.50:0/3091886676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 msgr2=0x7fa5f80ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 --2- 172.21.15.50:0/3091886676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f80ceb70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009910 tx=0x7fa5e8009c20 comp rx=0 tx=0).stop 2024-09-13T15:13:03.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 -- 172.21.15.50:0/3091886676 shutdown_connections 2024-09-13T15:13:03.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 --2- 172.21.15.50:0/3091886676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b2f60 0x7fa5f815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 --2- 172.21.15.50:0/3091886676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f80ceb70 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 -- 172.21.15.50:0/3091886676 >> 172.21.15.50:0/3091886676 conn(0x7fa5f806f5a0 msgr2=0x7fa5f806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:03.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 -- 172.21.15.50:0/3091886676 shutdown_connections 2024-09-13T15:13:03.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.874+0000 7fa5fe400700 1 -- 172.21.15.50:0/3091886676 wait complete. 2024-09-13T15:13:03.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 Processor -- start 2024-09-13T15:13:03.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 -- start start 2024-09-13T15:13:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f80b2f60 0x7fa5f81e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b33d0 0x7fa5f814f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f8140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8144450 con 0x7fa5f81509e0 2024-09-13T15:13:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81434f0 con 0x7fa5f80b2f60 2024-09-13T15:13:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5fe400700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81437d0 con 0x7fa5f80b33d0 2024-09-13T15:13:03.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f8140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f8140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55570/0 (socket says 172.21.15.50:55570) 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 -- 172.21.15.50:0/2023458840 learned_addr learned my addr 172.21.15.50:0/2023458840 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5efe00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b33d0 0x7fa5f814f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f80b2f60 0x7fa5f81e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 -- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b33d0 msgr2=0x7fa5f814f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa5f80b33d0 0x7fa5f814f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 -- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f80b2f60 msgr2=0x7fa5f81e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f80b2f60 0x7fa5f81e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.878+0000 7fa5f7e00700 1 -- 172.21.15.50:0/2023458840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009570 con 0x7fa5f81509e0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5f7e00700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f8140190 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cb50 tx=0x7fa5f000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003c20 con 0x7fa5f81509e0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0003d80 con 0x7fa5f81509e0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f8143ab0 con 0x7fa5f81509e0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000aac0 con 0x7fa5f81509e0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f814fb00 con 0x7fa5f81509e0 2024-09-13T15:13:03.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5f8071910 con 0x7fa5f81509e0 2024-09-13T15:13:03.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.882+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5f000ac20 con 0x7fa5f81509e0 2024-09-13T15:13:03.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5ef400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa5d4066730 0x7fa5d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa5f00840e0 con 0x7fa5f81509e0 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5ef400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fa5d406ccb0 0x7fa5d406f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 --> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d406f7c0 con 0x7fa5d406ccb0 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5f00866c0 con 0x7fa5f81509e0 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5f7400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa5d4066730 0x7fa5d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5efe00700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fa5d406ccb0 0x7fa5d406f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5f7400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa5d4066730 0x7fa5d4068bf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009c60 tx=0x7fa5e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.886+0000 7fa5efe00700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fa5d406ccb0 0x7fa5d406f0f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:03.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.890+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== osd.7 v2:172.21.15.181:6808/2747791304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d406f7c0 con 0x7fa5d406ccb0 2024-09-13T15:13:03.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.906+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 --> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5f8145840 con 0x7fa5d406ccb0 2024-09-13T15:13:03.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5ef400700 1 -- 172.21.15.50:0/2023458840 <== osd.7 v2:172.21.15.181:6808/2747791304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa5f8145840 con 0x7fa5d406ccb0 2024-09-13T15:13:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-13T15:13:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:13:03.915 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-13T15:13:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fa5d406ccb0 msgr2=0x7fa5d406f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6808/2747791304,v1:172.21.15.181:6809/2747791304] conn(0x7fa5d406ccb0 0x7fa5d406f0f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:03.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa5d4066730 msgr2=0x7fa5d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa5d4066730 0x7fa5d4068bf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009c60 tx=0x7fa5e8008030 comp rx=0 tx=0).stop 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 msgr2=0x7fa5f8140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 --2- 172.21.15.50:0/2023458840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5f81509e0 0x7fa5f8140190 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cb50 tx=0x7fa5f000ce60 comp rx=0 tx=0).stop 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5f7e00700 1 -- 172.21.15.50:0/2023458840 reap_dead start 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 shutdown_connections 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 >> 172.21.15.50:0/2023458840 conn(0x7fa5f806f5a0 msgr2=0x7fa5f806ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 shutdown_connections 2024-09-13T15:13:03.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:03.910+0000 7fa5fe400700 1 -- 172.21.15.50:0/2023458840 wait complete. 2024-09-13T15:13:03.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T15:13:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 Processor -- start 2024-09-13T15:13:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 -- start start 2024-09-13T15:13:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 0x7fc9a00d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc9a00d3880 0x7fc9a00d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a006b8b0 con 0x7fc9a00d14e0 2024-09-13T15:13:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00ce580 con 0x7fc9a00d3880 2024-09-13T15:13:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a5e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00ce820 con 0x7fc9a00b1f40 2024-09-13T15:13:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.130+0000 7fc9a4a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 0x7fc9a00d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 0x7fc9a00d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:51604/0 (socket says 172.21.15.50:51604) 2024-09-13T15:13:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5400700 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc9a00d14e0 0x7fc9a00cf490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.50:41110/0 (socket says 172.21.15.50:41110) 2024-09-13T15:13:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 -- 172.21.15.50:0/1904203824 learned_addr learned my addr 172.21.15.50:0/1904203824 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc99fe00700 1 --2- 172.21.15.50:0/1904203824 >> v2:172.21.15.181:3300/0 conn(0x7fc9a00d3880 0x7fc9a00d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc99f400700 1 -- 172.21.15.50:0/1904203824 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671275091 0 0) 0x7fc9a006b8b0 con 0x7fc9a00d14e0 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc99f400700 1 -- 172.21.15.50:0/1904203824 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9880035d0 con 0x7fc9a00d14e0 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 -- 172.21.15.50:0/1904203824 >> v2:172.21.15.181:3300/0 conn(0x7fc9a00d3880 msgr2=0x7fc9a00d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 --2- 172.21.15.50:0/1904203824 >> v2:172.21.15.181:3300/0 conn(0x7fc9a00d3880 0x7fc9a00d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 -- 172.21.15.50:0/1904203824 >> v1:172.21.15.181:6789/0 conn(0x7fc9a00d14e0 legacy=0x7fc9a00cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 -- 172.21.15.50:0/1904203824 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00ceb00 con 0x7fc9a00b1f40 2024-09-13T15:13:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a4a00700 1 --2- 172.21.15.50:0/1904203824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 0x7fc9a00d0a60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc994009910 tx=0x7fc994009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f70d89af576a1c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc99f400700 1 -- 172.21.15.50:0/1904203824 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011830 con 0x7fc9a00b1f40 2024-09-13T15:13:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc99f400700 1 -- 172.21.15.50:0/1904203824 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994011990 con 0x7fc9a00b1f40 2024-09-13T15:13:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc99f400700 1 -- 172.21.15.50:0/1904203824 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011d40 con 0x7fc9a00b1f40 2024-09-13T15:13:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 -- 172.21.15.50:0/1904203824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 msgr2=0x7fc9a00d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/1904203824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 0x7fc9a00d0a60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc994009910 tx=0x7fc994009c20 comp rx=0 tx=0).stop 2024-09-13T15:13:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 -- 172.21.15.50:0/1904203824 shutdown_connections 2024-09-13T15:13:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/1904203824 >> v2:172.21.15.181:3300/0 conn(0x7fc9a00d3880 0x7fc9a00d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/1904203824 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00b1f40 0x7fc9a00d0a60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 -- 172.21.15.50:0/1904203824 >> 172.21.15.50:0/1904203824 conn(0x7fc9a00d2c10 msgr2=0x7fc9a00d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.134+0000 7fc9a5e00700 1 -- 172.21.15.50:0/1904203824 shutdown_connections 2024-09-13T15:13:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.138+0000 7fc9a5e00700 1 -- 172.21.15.50:0/1904203824 wait complete. 2024-09-13T15:13:04.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.138+0000 7fc9a5e00700 1 Processor -- start 2024-09-13T15:13:04.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.138+0000 7fc9a5e00700 1 -- start start 2024-09-13T15:13:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a00b1f40 0x7fc9a01601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00d14e0 0x7fc9a00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 0x7fc9a0163630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00c6970 con 0x7fc9a00d3880 2024-09-13T15:13:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b2670 con 0x7fc9a00b1f40 2024-09-13T15:13:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b2950 con 0x7fc9a00d14e0 2024-09-13T15:13:04.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 0x7fc9a0163630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 0x7fc9a0163630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55572/0 (socket says 172.21.15.50:55572) 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 -- 172.21.15.50:0/3584788218 learned_addr learned my addr 172.21.15.50:0/3584788218 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a4a00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a00b1f40 0x7fc9a01601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc99fe00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00d14e0 0x7fc9a00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 -- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00d14e0 msgr2=0x7fc9a00b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00d14e0 0x7fc9a00b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 -- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a00b1f40 msgr2=0x7fc9a01601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a00b1f40 0x7fc9a01601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 -- 172.21.15.50:0/3584788218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009570 con 0x7fc9a00d3880 2024-09-13T15:13:04.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5400700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 0x7fc9a0163630 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc99800cc50 tx=0x7fc99800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800aad0 con 0x7fc9a00d3880 2024-09-13T15:13:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99800ac30 con 0x7fc9a00d3880 2024-09-13T15:13:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a00b2c30 con 0x7fc9a00d3880 2024-09-13T15:13:04.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.142+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998007070 con 0x7fc9a00d3880 2024-09-13T15:13:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.146+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a00b31f0 con 0x7fc9a00d3880 2024-09-13T15:13:04.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.146+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a00b33e0 con 0x7fc9a00d3880 2024-09-13T15:13:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.146+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9980071d0 con 0x7fc9a00d3880 2024-09-13T15:13:04.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.150+0000 7fc99cc00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc980066760 0x7fc980068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.150+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fc998083eb0 con 0x7fc9a00d3880 2024-09-13T15:13:04.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.150+0000 7fc9a4a00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc980066760 0x7fc980068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.150+0000 7fc9a4a00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc980066760 0x7fc980068c20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc994000c00 tx=0x7fc994008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:04.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.154+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc998051280 con 0x7fc9a00d3880 2024-09-13T15:13:04.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.338+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9a00b2ac0 con 0x7fc980066760 2024-09-13T15:13:04.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.338+0000 7fc99cc00700 1 -- 172.21.15.50:0/3584788218 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc9a00b2ac0 con 0x7fc980066760 2024-09-13T15:13:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc980066760 msgr2=0x7fc980068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc980066760 0x7fc980068c20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc994000c00 tx=0x7fc994008030 comp rx=0 tx=0).stop 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 msgr2=0x7fc9a0163630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 0x7fc9a0163630 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc99800cc50 tx=0x7fc99800cf60 comp rx=0 tx=0).stop 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 shutdown_connections 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fc980066760 0x7fc980068c20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9a00d3880 0x7fc9a0163630 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc9a00d14e0 0x7fc9a00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 --2- 172.21.15.50:0/3584788218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9a00b1f40 0x7fc9a01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 >> 172.21.15.50:0/3584788218 conn(0x7fc9a00d2c10 msgr2=0x7fc9a00af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 shutdown_connections 2024-09-13T15:13:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.342+0000 7fc9a5e00700 1 -- 172.21.15.50:0/3584788218 wait complete. 2024-09-13T15:13:04.350 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T15:13:04.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:13:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.538+0000 7f4982200700 1 Processor -- start 2024-09-13T15:13:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.538+0000 7f4982200700 1 -- start start 2024-09-13T15:13:04.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4982200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4982200700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f497c15ae20 0x7f497c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4982200700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c15b7f0 con 0x7f497c155100 2024-09-13T15:13:04.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4982200700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c071ff0 con 0x7f497c15ae20 2024-09-13T15:13:04.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4982200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c15ba50 con 0x7f497c0cf550 2024-09-13T15:13:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f497c15ae20 0x7f497c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f497c15ae20 0x7f497c15b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55576/0 (socket says 172.21.15.50:55576) 2024-09-13T15:13:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 -- 172.21.15.50:0/110569603 learned_addr learned my addr 172.21.15.50:0/110569603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f497be00700 1 --2- 172.21.15.50:0/110569603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 -- 172.21.15.50:0/110569603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 msgr2=0x7f497c070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 --2- 172.21.15.50:0/110569603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 -- 172.21.15.50:0/110569603 >> v1:172.21.15.50:6789/0 conn(0x7f497c155100 legacy=0x7f497c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 -- 172.21.15.50:0/110569603 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c15bd30 con 0x7f497c15ae20 2024-09-13T15:13:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f497b400700 1 -- 172.21.15.50:0/110569603 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804085778 0 0) 0x7f497c15b7f0 con 0x7f497c155100 2024-09-13T15:13:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f4981800700 1 --2- 172.21.15.50:0/110569603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c15ae20 0x7f497c15b2b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4974009e50 tx=0x7f497400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b478ce980050d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f497b400700 1 -- 172.21.15.50:0/110569603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400e070 con 0x7f497c15ae20 2024-09-13T15:13:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.542+0000 7f497b400700 1 -- 172.21.15.50:0/110569603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400b910 con 0x7f497c15ae20 2024-09-13T15:13:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f497b400700 1 -- 172.21.15.50:0/110569603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400bcc0 con 0x7f497c15ae20 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 -- 172.21.15.50:0/110569603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c15ae20 msgr2=0x7f497c15b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 --2- 172.21.15.50:0/110569603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c15ae20 0x7f497c15b2b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4974009e50 tx=0x7f497400b330 comp rx=0 tx=0).stop 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 -- 172.21.15.50:0/110569603 shutdown_connections 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 --2- 172.21.15.50:0/110569603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c15ae20 0x7f497c15b2b0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 --2- 172.21.15.50:0/110569603 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 -- 172.21.15.50:0/110569603 >> 172.21.15.50:0/110569603 conn(0x7f497c06a570 msgr2=0x7f497c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 -- 172.21.15.50:0/110569603 shutdown_connections 2024-09-13T15:13:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 -- 172.21.15.50:0/110569603 wait complete. 2024-09-13T15:13:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 Processor -- start 2024-09-13T15:13:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.546+0000 7f4982200700 1 -- start start 2024-09-13T15:13:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 0x7f497c0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f497c15ae20 0x7f497c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0af9d0 con 0x7f497c155100 2024-09-13T15:13:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0afcb0 con 0x7f497c15ae20 2024-09-13T15:13:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0aff90 con 0x7f497c0cf550 2024-09-13T15:13:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 0x7f497c0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 0x7f497c0cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55584/0 (socket says 172.21.15.50:55584) 2024-09-13T15:13:04.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 -- 172.21.15.50:0/13091529 learned_addr learned my addr 172.21.15.50:0/13091529 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4980e00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4981800700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f497c15ae20 0x7f497c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 -- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 msgr2=0x7f497c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 -- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f497c15ae20 msgr2=0x7f497c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f497c15ae20 0x7f497c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 -- 172.21.15.50:0/13091529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009b30 con 0x7f497c155100 2024-09-13T15:13:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f497be00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 0x7f497c0cc880 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f496800e9d0 tx=0x7f496800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968009720 con 0x7f497c155100 2024-09-13T15:13:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496800c850 con 0x7f497c155100 2024-09-13T15:13:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800cbc0 con 0x7f497c155100 2024-09-13T15:13:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0b0270 con 0x7f497c155100 2024-09-13T15:13:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.550+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c0c9450 con 0x7f497c155100 2024-09-13T15:13:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.554+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c070b70 con 0x7f497c155100 2024-09-13T15:13:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.554+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f496800cd20 con 0x7f497c155100 2024-09-13T15:13:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.558+0000 7f4978c00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f495c066760 0x7f495c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.558+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f49680844d0 con 0x7f497c155100 2024-09-13T15:13:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.558+0000 7f4980e00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f495c066760 0x7f495c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:04.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.558+0000 7f4980e00700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f495c066760 0x7f495c068c20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4970007fd0 tx=0x7f4970009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:04.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.566+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4968051890 con 0x7f497c155100 2024-09-13T15:13:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.758+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f497c0b1e00 con 0x7f495c066760 2024-09-13T15:13:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.762+0000 7f4978c00700 1 -- 172.21.15.50:0/13091529 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47974 (secure 0 0 0) 0x7f497c0b1e00 con 0x7f495c066760 2024-09-13T15:13:04.770 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:13:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f495c066760 msgr2=0x7f495c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f495c066760 0x7f495c068c20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4970007fd0 tx=0x7f4970009040 comp rx=0 tx=0).stop 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 msgr2=0x7f497c0cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 0x7f497c0cc880 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f496800e9d0 tx=0x7f496800ece0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 shutdown_connections 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f495c066760 0x7f495c068c20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f497c15ae20 0x7f497c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f497c155100 0x7f497c0cc880 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 --2- 172.21.15.50:0/13091529 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f497c0cf550 0x7f497c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 >> 172.21.15.50:0/13091529 conn(0x7f497c06a570 msgr2=0x7f497c158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.766+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 shutdown_connections 2024-09-13T15:13:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:04.770+0000 7f4982200700 1 -- 172.21.15.50:0/13091529 wait complete. 2024-09-13T15:13:04.776 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:13:04.797 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-13T15:13:04.123957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260820,"kb_used_data":11868,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713900,"statfs":{"total":773094113280,"available":772827033600,"internally_reserved":0,"allocated":12152832,"data_stored":6194183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003431"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-13T15:12:49.208712+0000","last_change":"2024-09-13T15:07:28.320730+0000","last_active":"2024-09-13T15:12:49.208712+0000","last_peered":"2024-09-13T15:12:49.208712+0000","last_clean":"2024-09-13T15:12:49.208712+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:12:49.208712+0000","last_undegraded":"2024-09-13T15:12:49.208712+0000","last_fullsized":"2024-09-13T15:12:49.208712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:07:26.871029+0000","last_clean_scrub_stamp":"2024-09-13T15:07:26.871029+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:15.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33036,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1966080,"data_stored":1217431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.179},"min":{"1min":0.75900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5289999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.133},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1899999999999999,"15min":1.26},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4970000000000001,"5min":1.839,"15min":1.839},"last":1.2729999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.23,"15min":1.3360000000000001},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.9930000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.05},{"interface":"front","average":{"1min":1.131,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.84999999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.5720000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2370000000000001,"15min":1.3600000000000001},"min":{"1min":0.877,"5min":0.5,"15min":0.5},"max":{"1min":1.593,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2749999999999999,"15min":1.3460000000000001},"min":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4690000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.599}]},{"osd":3,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2789999999999999,"15min":1.3979999999999999},"min":{"1min":0.86899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6799999999999999,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.327},{"interface":"front","average":{"1min":1.216,"5min":1.341,"15min":1.492},"min":{"1min":1.0009999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.081,"15min":2.081},"last":1.51}]},{"osd":4,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1799999999999999,"15min":1.333},"min":{"1min":0.71899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5229999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3999999999999999},"min":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.476}]},{"osd":5,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3700000000000001,"15min":1.5429999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5609999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.383},{"interface":"front","average":{"1min":1.282,"5min":1.3320000000000001,"15min":1.474},"min":{"1min":0.621,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8200000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3560000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3839999999999999,"15min":1.5609999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8939999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4199999999999999,"15min":1.601},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.633,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.421}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1368064,"data_stored":626044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.111,"15min":1.181},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4870000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.167,"5min":1.1339999999999999,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5409999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.411}]},{"osd":1,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3799999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.252,"15min":1.3340000000000001},"min":{"1min":0.876,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4810000000000001,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.369}]},{"osd":2,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.226,"15min":1.284},"min":{"1min":0.997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4990000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.302,"15min":1.3779999999999999},"min":{"1min":0.85199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5629999999999999,"5min":1.986,"15min":1.986},"last":1.534}]},{"osd":3,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.286,"15min":1.3140000000000001},"min":{"1min":0.84099999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.528,"5min":2.746,"15min":2.746},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.2869999999999999,"15min":1.373},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6120000000000001,"5min":2.371,"15min":2.371},"last":1.171}]},{"osd":4,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.242,"15min":1.3540000000000001},"min":{"1min":0.745,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.694,"5min":2.835,"15min":2.835},"last":1.577},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2250000000000001,"15min":1.3500000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.581,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.2909999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.27,"15min":1.302},"min":{"1min":0.749,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.635,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.464},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4279999999999999,"15min":1.5680000000000001},"min":{"1min":0.87,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.778,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.5129999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.83999999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7170000000000001,"5min":2.444,"15min":2.444},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4330000000000001,"15min":1.5249999999999999},"min":{"1min":1.048,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.6970000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.615}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.121,"15min":1.2649999999999999},"min":{"1min":0.72799999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3300000000000001,"5min":1.869,"15min":1.869},"last":0.875},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.3200000000000001},"min":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.458,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.26},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.167},{"interface":"front","average":{"1min":1.115,"5min":1.151,"15min":1.238},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3799999999999999,"5min":2.665,"15min":2.665},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1819999999999999,"15min":1.252},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5009999999999999,"5min":2.347,"15min":2.347},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.163,"5min":1.248,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4790000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.335}]},{"osd":3,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2210000000000001,"15min":1.321},"min":{"1min":0.81000000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.544,"5min":2.524,"15min":2.524},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.3340000000000001,"15min":1.47},"min":{"1min":0.73499999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.538,"5min":2.036,"15min":2.036},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.236,"15min":1.361},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":2.012,"15min":2.012},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3100000000000001,"15min":1.456},"min":{"1min":0.78100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.694,"5min":3.117,"15min":3.117},"last":1.522}]},{"osd":6,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.276,"15min":1.4870000000000001},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6060000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.149},{"interface":"front","average":{"1min":1.212,"5min":1.351,"15min":1.5409999999999999},"min":{"1min":0.81200000000000006,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5780000000000001,"5min":2.411,"15min":2.411},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.343,"15min":1.5169999999999999},"min":{"1min":0.91100000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.6319999999999999,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.4059999999999999,"15min":1.6240000000000001},"min":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5669999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.3600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32460,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0900000000000001,"15min":1.1499999999999999},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4970000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.751},{"interface":"front","average":{"1min":1.145,"5min":1.153,"15min":1.1930000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.778,"5min":1.78,"15min":1.78},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.208,"15min":1.25},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.3},{"interface":"front","average":{"1min":1.153,"5min":1.163,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5429999999999999,"5min":1.794,"15min":1.794},"last":0.871}]},{"osd":2,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.169,"15min":1.1859999999999999},"min":{"1min":0.83399999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5680000000000001,"5min":1.621,"15min":1.621},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.232,"5min":1.276,"15min":1.3280000000000001},"min":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7909999999999999,"5min":1.887,"15min":1.887},"last":1.028}]},{"osd":3,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.78600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7310000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.248,"15min":1.3240000000000001},"min":{"1min":0.83699999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6899999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.89800000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2909999999999999,"15min":1.361},"min":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0800000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.325,"15min":1.383},"min":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8069999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.236}]},{"osd":6,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.234,"15min":1.2929999999999999},"min":{"1min":0.91700000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.921,"5min":2.214,"15min":2.214},"last":1.266},{"interface":"front","average":{"1min":1.343,"5min":1.3520000000000001,"15min":1.4279999999999999},"min":{"1min":0.85299999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7709999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3420000000000001,"15min":1.4259999999999999},"min":{"1min":0.86799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8240000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.143},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.409,"15min":1.4830000000000001},"min":{"1min":1.0109999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.016,"5min":2.524,"15min":2.524},"last":1.341}]}]},{"osd":3,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1368064,"data_stored":626044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.046},"min":{"1min":0.69199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.8420000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.0980000000000001,"15min":1.093},"min":{"1min":0.88,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.9350000000000001,"5min":2.782,"15min":2.782},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96599999999999997,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.115,"5min":1.107,"15min":1.1970000000000001},"min":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8149999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0640000000000001,"15min":1.1799999999999999},"min":{"1min":0.58799999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6479999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.129},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1950000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5349999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.329,"15min":1.3799999999999999},"min":{"1min":1.0289999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.4169999999999998,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.284,"5min":1.325,"15min":1.417},"min":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1949999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.94699999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4890000000000001},"min":{"1min":1.1519999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.286,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.032},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4610000000000001,"15min":1.6339999999999999},"min":{"1min":1.0609999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.4660000000000002,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.278}]},{"osd":6,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3899999999999999,"15min":1.48},"min":{"1min":1.0880000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.768,"5min":2.839,"15min":2.839},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4319999999999999,"15min":1.544},"min":{"1min":1.135,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.804,"5min":3.786,"15min":3.786},"last":1.099}]},{"osd":7,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5569999999999999,"15min":1.74},"min":{"1min":1.167,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9139999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.216},{"interface":"front","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.645},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.95,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.194}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32460,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.60299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.379,"5min":1.393,"15min":1.393},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0049999999999999,"15min":1.048},"min":{"1min":0.66000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6060000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.597,"5min":1.599,"15min":1.599},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1040000000000001,"15min":1.22},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.518,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.0509999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.008,"15min":1.093},"min":{"1min":0.66400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.681,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1,"15min":1.0640000000000001},"min":{"1min":0.61099999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.538,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2829999999999999,"15min":1.3640000000000001},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":2.657,"15min":2.657},"last":1.087},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3700000000000001,"15min":1.474},"min":{"1min":0.93700000000000006,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0059999999999998,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":1.1100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.244},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.343,"15min":1.381},"min":{"1min":0.999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6930000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.038}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3740000000000001,"15min":1.462},"min":{"1min":1.0620000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7749999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3919999999999999,"15min":1.454},"min":{"1min":1.0880000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.875,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4610000000000001,"15min":1.5369999999999999},"min":{"1min":1.03,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8740000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.113},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.48,"15min":1.542},"min":{"1min":1.0660000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.0369999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.369}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32460,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.351,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.77400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.603,"5min":1.722,"15min":1.722},"last":1.5349999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.276,"5min":1.502,"15min":1.502},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.052},"min":{"1min":0.68000000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5680000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.022}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1220000000000001,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.593,"5min":1.764,"15min":1.764},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.0369999999999999,"15min":1.125},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.8280000000000001,"5min":3.254,"15min":3.254},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1870000000000001},"min":{"1min":0.83799999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.494,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.3180000000000001,"15min":1.3640000000000001},"min":{"1min":0.95399999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.786,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.585}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2989999999999999,"15min":1.411},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.8340000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2729999999999999,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5660000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.331}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.419,"15min":1.4970000000000001},"min":{"1min":1.085,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9319999999999999,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.401},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.5329999999999999},"min":{"1min":1.002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7090000000000001,"5min":4.843,"15min":4.843},"last":1.1539999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.48,"15min":1.6619999999999999},"min":{"1min":1.0409999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.895,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.635},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3979999999999999,"15min":1.482},"min":{"1min":1.159,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8919999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.49}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33036,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1961984,"data_stored":1216412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83899999999999997,"15min":0.92200000000000004},"min":{"1min":0.57999999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3979999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93100000000000005,"15min":0.90800000000000003},"min":{"1min":0.65700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1319999999999999,"15min":1.2789999999999999},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.569,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":1.2549999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.708,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.81399999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1100000000000001,"15min":1.1559999999999999},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.754,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.752},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":1.1479999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8100000000000001,"5min":2.157,"15min":2.157},"last":1.016}]},{"osd":4,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.258,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.704,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.1060000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.3680000000000001},"min":{"1min":0.92000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6579999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.361,"15min":1.389},"min":{"1min":1.0469999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0960000000000001,"5min":2.367,"15min":2.367},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":1.2350000000000001,"5min":1.05,"15min":1.05},"max":{"1min":2.0299999999999998,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.452},"min":{"1min":1.0209999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.044}]},{"osd":7,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5149999999999999},"min":{"1min":1.0880000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.909,"5min":3.302,"15min":3.302},"last":1.129},{"interface":"front","average":{"1min":1.472,"5min":1.4219999999999999,"15min":1.464},"min":{"1min":1.194,"5min":0.874,"15min":0.874},"max":{"1min":1.97,"5min":2.266,"15min":2.266},"last":1.069}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:13:04.803 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T15:07:26.871029+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=7, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=12, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:13:04.803 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:13:06.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:06.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:24.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:13:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 Processor -- start 2024-09-13T15:13:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 -- start start 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b9c0cb020 0x7f3b9c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c06b430 con 0x7f3b9c15c2a0 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0b2ad0 con 0x7f3b9c0cb020 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.977+0000 7f3ba3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c15b960 con 0x7f3b9c06aaa0 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b9c0cb020 0x7f3b9c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b9c0cb020 0x7f3b9c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.50:50158/0 (socket says 172.21.15.50:50158) 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 -- 172.21.15.50:0/790864114 learned_addr learned my addr 172.21.15.50:0/790864114 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba2800700 1 --2- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 -- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 msgr2=0x7f3b9c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 --2- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 -- 172.21.15.50:0/790864114 >> v1:172.21.15.181:6789/0 conn(0x7f3b9c15c2a0 legacy=0x7f3b9c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 -- 172.21.15.50:0/790864114 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c15bc40 con 0x7f3b9c0cb020 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba1e00700 1 --2- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c0cc6f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009910 tx=0x7f3b90009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31989e1b6f3fac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba0a00700 1 -- 172.21.15.50:0/790864114 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90011830 con 0x7f3b9c0cb020 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba0a00700 1 -- 172.21.15.50:0/790864114 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90011990 con 0x7f3b9c0cb020 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba0a00700 1 -- 172.21.15.50:0/790864114 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90011d40 con 0x7f3b9c0cb020 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 -- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c0cb020 msgr2=0x7f3b9c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 --2- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c0cc6f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009910 tx=0x7f3b90009c20 comp rx=0 tx=0).stop 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 -- 172.21.15.50:0/790864114 shutdown_connections 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 --2- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 --2- 172.21.15.50:0/790864114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c0cc6f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 -- 172.21.15.50:0/790864114 >> 172.21.15.50:0/790864114 conn(0x7f3b9c0b0c40 msgr2=0x7f3b9c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 -- 172.21.15.50:0/790864114 shutdown_connections 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.981+0000 7f3ba3200700 1 -- 172.21.15.50:0/790864114 wait complete. 2024-09-13T15:13:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 Processor -- start 2024-09-13T15:13:24.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 -- start start 2024-09-13T15:13:24.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c15c2a0 0x7f3b9c1f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c4770 con 0x7f3b9c0cb020 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c14f320 con 0x7f3b9c15c2a0 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.985+0000 7f3ba3200700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c3880 con 0x7f3b9c06aaa0 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52168/0 (socket says 172.21.15.50:52168) 2024-09-13T15:13:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 -- 172.21.15.50:0/2491615431 learned_addr learned my addr 172.21.15.50:0/2491615431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1e00700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba2800700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c15c2a0 0x7f3b9c1f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 -- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 msgr2=0x7f3b9c14ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c14ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 -- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c15c2a0 msgr2=0x7f3b9c1f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c15c2a0 0x7f3b9c1f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 -- 172.21.15.50:0/2491615431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009570 con 0x7f3b9c0cb020 2024-09-13T15:13:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba2800700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c15c2a0 0x7f3b9c1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:13:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba1400700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c154e00 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c530 tx=0x7f3b8c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0052d0 con 0x7f3b9c0cb020 2024-09-13T15:13:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c005430 con 0x7f3b9c0cb020 2024-09-13T15:13:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0055a0 con 0x7f3b9c0cb020 2024-09-13T15:13:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c0c3b60 con 0x7f3b9c0cb020 2024-09-13T15:13:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c0c4120 con 0x7f3b9c0cb020 2024-09-13T15:13:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.989+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c0c48e0 con 0x7f3b9c0cb020 2024-09-13T15:13:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.993+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b8c0038e0 con 0x7f3b9c0cb020 2024-09-13T15:13:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.993+0000 7f3b96000700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b80066760 0x7f3b80068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.997+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f3b8c083390 con 0x7f3b9c0cb020 2024-09-13T15:13:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.997+0000 7f3ba1e00700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b80066760 0x7f3b80068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:24.997+0000 7f3ba1e00700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b80066760 0x7f3b80068c20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b90000c00 tx=0x7f3b90008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.001+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b8c0506c0 con 0x7f3b9c0cb020 2024-09-13T15:13:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.185+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 --> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b9c0cb400 con 0x7f3b80066760 2024-09-13T15:13:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.189+0000 7f3b96000700 1 -- 172.21.15.50:0/2491615431 <== mgr.4099 v2:172.21.15.181:6832/3430379714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48088 (secure 0 0 0) 0x7f3b90011b80 con 0x7f3b80066760 2024-09-13T15:13:25.193 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b80066760 msgr2=0x7f3b80068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b80066760 0x7f3b80068c20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b90000c00 tx=0x7f3b90008030 comp rx=0 tx=0).stop 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 msgr2=0x7f3b9c154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c154e00 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c530 tx=0x7f3b8c00c840 comp rx=0 tx=0).stop 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 shutdown_connections 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f3b80066760 0x7f3b80068c20 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b9c15c2a0 0x7f3b9c1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b9c0cb020 0x7f3b9c154e00 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 --2- 172.21.15.50:0/2491615431 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b9c06aaa0 0x7f3b9c14ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 >> 172.21.15.50:0/2491615431 conn(0x7f3b9c0b0c40 msgr2=0x7f3b9c15dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 shutdown_connections 2024-09-13T15:13:25.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.193+0000 7f3ba3200700 1 -- 172.21.15.50:0/2491615431 wait complete. 2024-09-13T15:13:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-13T15:13:25.220 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-13T15:13:24.129623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260808,"kb_used_data":11868,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713912,"statfs":{"total":773094113280,"available":772827045888,"internally_reserved":0,"allocated":12152832,"data_stored":6194183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003374"},"pg_stats":[{"pgid":"1.0","version":"110'119","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-13T15:13:04.613289+0000","last_change":"2024-09-13T15:13:04.613482+0000","last_active":"2024-09-13T15:13:04.613289+0000","last_peered":"2024-09-13T15:13:04.613289+0000","last_clean":"2024-09-13T15:13:04.613289+0000","last_became_active":"2024-09-13T15:07:28.319394+0000","last_became_peered":"2024-09-13T15:07:28.319394+0000","last_unstale":"2024-09-13T15:13:04.613289+0000","last_undegraded":"2024-09-13T15:13:04.613289+0000","last_fullsized":"2024-09-13T15:13:04.613289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'119","last_scrub_stamp":"2024-09-13T15:13:04.613244+0000","last_deep_scrub":"110'119","last_deep_scrub_stamp":"2024-09-13T15:13:04.613244+0000","last_clean_scrub_stamp":"2024-09-13T15:13:04.613244+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:17.813066+0000","scrub_duration":0.0084981269999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1966080,"data_stored":1217431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1479999999999999,"15min":1.179},"min":{"1min":0.75900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5289999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.069},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1899999999999999,"15min":1.26},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4970000000000001,"5min":1.839,"15min":1.839},"last":1.1639999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.23,"15min":1.3360000000000001},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.9930000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1559999999999999,"15min":1.2390000000000001},"min":{"1min":0.84999999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.272}]},{"osd":2,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2370000000000001,"15min":1.3600000000000001},"min":{"1min":0.877,"5min":0.5,"15min":0.5},"max":{"1min":1.593,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2749999999999999,"15min":1.3460000000000001},"min":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4690000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.1359999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2789999999999999,"15min":1.3979999999999999},"min":{"1min":0.86899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6799999999999999,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.216,"5min":1.341,"15min":1.492},"min":{"1min":1.0009999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.081,"15min":2.081},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.1799999999999999,"15min":1.333},"min":{"1min":0.71899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5229999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.256,"15min":1.3999999999999999},"min":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.633,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3700000000000001,"15min":1.5429999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5609999999999999,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":1.095},{"interface":"front","average":{"1min":1.282,"5min":1.3320000000000001,"15min":1.474},"min":{"1min":0.621,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8200000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.367}]},{"osd":6,"last update":"Fri Sep 13 15:12:43 2024","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3839999999999999,"15min":1.5609999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8939999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.325},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.4199999999999999,"15min":1.601},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.633,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.294}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1368064,"data_stored":626044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.111,"15min":1.181},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4870000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1339999999999999,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5409999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3799999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.244,"5min":1.252,"15min":1.3340000000000001},"min":{"1min":0.876,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4810000000000001,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.042}]},{"osd":2,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.226,"15min":1.284},"min":{"1min":0.997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4990000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.302,"15min":1.3779999999999999},"min":{"1min":0.85199999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5629999999999999,"5min":1.986,"15min":1.986},"last":1.1799999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.286,"15min":1.3140000000000001},"min":{"1min":0.84099999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.528,"5min":2.746,"15min":2.746},"last":1.252},{"interface":"front","average":{"1min":1.278,"5min":1.2869999999999999,"15min":1.373},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6120000000000001,"5min":2.371,"15min":2.371},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.242,"15min":1.3540000000000001},"min":{"1min":0.745,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.694,"5min":2.835,"15min":2.835},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2250000000000001,"15min":1.3500000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.581,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.27,"15min":1.302},"min":{"1min":0.749,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.635,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4279999999999999,"15min":1.5680000000000001},"min":{"1min":0.87,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.778,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.149}]},{"osd":7,"last update":"Fri Sep 13 15:12:41 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.349,"15min":1.423},"min":{"1min":0.83999999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7170000000000001,"5min":2.444,"15min":2.444},"last":1.101},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4330000000000001,"15min":1.5249999999999999},"min":{"1min":1.048,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.6970000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.86299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.121,"15min":1.2649999999999999},"min":{"1min":0.72799999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3300000000000001,"5min":1.869,"15min":1.869},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.3200000000000001},"min":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.458,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.3}]},{"osd":1,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.175,"15min":1.26},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.478},{"interface":"front","average":{"1min":1.115,"5min":1.151,"15min":1.238},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3799999999999999,"5min":2.665,"15min":2.665},"last":1.256}]},{"osd":2,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1819999999999999,"15min":1.252},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5009999999999999,"5min":2.347,"15min":2.347},"last":1.075},{"interface":"front","average":{"1min":1.163,"5min":1.248,"15min":1.3500000000000001},"min":{"1min":0.82199999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.4790000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.3759999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2210000000000001,"15min":1.321},"min":{"1min":0.81000000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.544,"5min":2.524,"15min":2.524},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.3340000000000001,"15min":1.47},"min":{"1min":0.73499999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.538,"5min":2.036,"15min":2.036},"last":1.5309999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.236,"15min":1.361},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4279999999999999,"5min":2.012,"15min":2.012},"last":1.571},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.3100000000000001,"15min":1.456},"min":{"1min":0.78100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.694,"5min":3.117,"15min":3.117},"last":1.554}]},{"osd":6,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.276,"15min":1.4870000000000001},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6060000000000001,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.607},{"interface":"front","average":{"1min":1.212,"5min":1.351,"15min":1.5409999999999999},"min":{"1min":0.81200000000000006,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5780000000000001,"5min":2.411,"15min":2.411},"last":1.6659999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:12:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.343,"15min":1.5169999999999999},"min":{"1min":0.91100000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.6319999999999999,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.4059999999999999,"15min":1.6240000000000001},"min":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5669999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.704}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32460,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0900000000000001,"15min":1.1499999999999999},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4970000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.119},{"interface":"front","average":{"1min":1.145,"5min":1.153,"15min":1.1930000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.778,"5min":1.78,"15min":1.78},"last":0.95699999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.208,"15min":1.25},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.385},{"interface":"front","average":{"1min":1.153,"5min":1.163,"15min":1.2190000000000001},"min":{"1min":0.748,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5429999999999999,"5min":1.794,"15min":1.794},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.169,"15min":1.1859999999999999},"min":{"1min":0.83399999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5680000000000001,"5min":1.621,"15min":1.621},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.276,"15min":1.3280000000000001},"min":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7909999999999999,"5min":1.887,"15min":1.887},"last":1.0680000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.78600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7310000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.028},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.248,"15min":1.3240000000000001},"min":{"1min":0.83699999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.6899999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.4570000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2909999999999999,"15min":1.361},"min":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0800000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.492},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.325,"15min":1.383},"min":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8069999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4430000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.234,"15min":1.2929999999999999},"min":{"1min":0.91700000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.921,"5min":2.214,"15min":2.214},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.3520000000000001,"15min":1.4279999999999999},"min":{"1min":0.85299999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7709999999999999,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.2110000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3420000000000001,"15min":1.4259999999999999},"min":{"1min":0.86799999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8240000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.335},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.409,"15min":1.4830000000000001},"min":{"1min":1.0109999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.016,"5min":2.524,"15min":2.524},"last":1.641}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32456,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1368064,"data_stored":626044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.046},"min":{"1min":0.69199999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.8420000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.0980000000000001,"15min":1.093},"min":{"1min":0.88,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.9350000000000001,"5min":2.782,"15min":2.782},"last":1.0620000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96599999999999997,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.115,"5min":1.107,"15min":1.1970000000000001},"min":{"1min":0.68300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8149999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.2609999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0640000000000001,"15min":1.1799999999999999},"min":{"1min":0.58799999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6479999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1950000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.5349999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.329,"15min":1.3799999999999999},"min":{"1min":1.0289999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.4169999999999998,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.234},{"interface":"front","average":{"1min":1.284,"5min":1.325,"15min":1.417},"min":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1949999999999998,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.4350000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4890000000000001},"min":{"1min":1.1519999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.286,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.5},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4610000000000001,"15min":1.6339999999999999},"min":{"1min":1.0609999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.4660000000000002,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.575}]},{"osd":6,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3899999999999999,"15min":1.48},"min":{"1min":1.0880000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.768,"5min":2.839,"15min":2.839},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4319999999999999,"15min":1.544},"min":{"1min":1.135,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.804,"5min":3.786,"15min":3.786},"last":1.337}]},{"osd":7,"last update":"Fri Sep 13 15:12:38 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5569999999999999,"15min":1.74},"min":{"1min":1.167,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9139999999999999,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":1.524},{"interface":"front","average":{"1min":1.526,"5min":1.5209999999999999,"15min":1.645},"min":{"1min":1.1140000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":1.95,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.296}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32460,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.60299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.379,"5min":1.393,"15min":1.393},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0049999999999999,"15min":1.048},"min":{"1min":0.66000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.6060000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.93899999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.597,"5min":1.599,"15min":1.599},"last":1.325},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1040000000000001,"15min":1.22},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.518,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.4650000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.008,"15min":1.093},"min":{"1min":0.66400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.681,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1,"15min":1.0640000000000001},"min":{"1min":0.61099999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.538,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5129999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2829999999999999,"15min":1.3640000000000001},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.778,"5min":2.657,"15min":2.657},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3700000000000001,"15min":1.474},"min":{"1min":0.93700000000000006,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0059999999999998,"5min":5.3940000000000001,"15min":5.3940000000000001},"last":1.8}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.304,"15min":1.3149999999999999},"min":{"1min":1.1100000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.343,"15min":1.381},"min":{"1min":0.999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6930000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.405}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3740000000000001,"15min":1.462},"min":{"1min":1.0620000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7749999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3919999999999999,"15min":1.454},"min":{"1min":1.0880000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.875,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.5529999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.4610000000000001,"15min":1.5369999999999999},"min":{"1min":1.03,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8740000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.48,"15min":1.542},"min":{"1min":1.0660000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.0369999999999999,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.629}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32460,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1372160,"data_stored":627063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.875},"min":{"1min":0.68899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.351,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.77400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.603,"5min":1.722,"15min":1.722},"last":1.0800000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.276,"5min":1.502,"15min":1.502},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.052},"min":{"1min":0.68000000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5680000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1220000000000001,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.593,"5min":1.764,"15min":1.764},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.0369999999999999,"15min":1.125},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.8280000000000001,"5min":3.254,"15min":3.254},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1579999999999999,"15min":1.1870000000000001},"min":{"1min":0.83799999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.494,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.3180000000000001,"15min":1.3640000000000001},"min":{"1min":0.95399999999999996,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.786,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.401}]},{"osd":5,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2989999999999999,"15min":1.411},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.8340000000000001,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1.149},{"interface":"front","average":{"1min":1.28,"5min":1.2729999999999999,"15min":1.349},"min":{"1min":0.93999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5660000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.246}]},{"osd":6,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.419,"15min":1.4970000000000001},"min":{"1min":1.085,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.9319999999999999,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.5329999999999999},"min":{"1min":1.002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7090000000000001,"5min":4.843,"15min":4.843},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:12:37 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.48,"15min":1.6619999999999999},"min":{"1min":1.0409999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.895,"5min":4.9489999999999998,"15min":4.9489999999999998},"last":1.302},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3979999999999999,"15min":1.482},"min":{"1min":1.159,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8919999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.3360000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1961984,"data_stored":1216412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83899999999999997,"15min":0.92200000000000004},"min":{"1min":0.57999999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3979999999999999,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93100000000000005,"15min":0.90800000000000003},"min":{"1min":0.65700000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1319999999999999,"15min":1.2789999999999999},"min":{"1min":0.75600000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.569,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.99299999999999999,"15min":1.2549999999999999},"min":{"1min":0.628,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.708,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1100000000000001,"15min":1.1559999999999999},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.754,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":1.1479999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8100000000000001,"5min":2.157,"15min":2.157},"last":1.4670000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.258,"15min":1.3009999999999999},"min":{"1min":0.97999999999999998,"5min":0.875,"15min":0.875},"max":{"1min":1.704,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.1060000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.2729999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.292,"15min":1.3680000000000001},"min":{"1min":0.92000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6579999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.073},{"interface":"front","average":{"1min":1.427,"5min":1.361,"15min":1.389},"min":{"1min":1.0469999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0960000000000001,"5min":2.367,"15min":2.367},"last":1.5640000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.4690000000000001,"15min":1.4870000000000001},"min":{"1min":1.2350000000000001,"5min":1.05,"15min":1.05},"max":{"1min":2.0299999999999998,"5min":2.9700000000000002,"15min":2.9700000000000002},"last":1.619},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.349,"15min":1.452},"min":{"1min":1.0209999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.929,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.504}]},{"osd":7,"last update":"Fri Sep 13 15:12:34 2024","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5149999999999999},"min":{"1min":1.0880000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.909,"5min":3.302,"15min":3.302},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.4219999999999999,"15min":1.464},"min":{"1min":1.194,"5min":0.874,"15min":0.874},"max":{"1min":1.97,"5min":2.266,"15min":2.266},"last":1.427}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:13:25.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T15:13:25.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.393+0000 7f19c5a00700 1 Processor -- start 2024-09-13T15:13:25.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.393+0000 7f19c5a00700 1 -- start start 2024-09-13T15:13:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19c5a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19c5a00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19c00cfee0 0x7f19c00ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19c5a00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00cdb00 con 0x7f19c00d38e0 2024-09-13T15:13:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19c5a00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c00cdde0 con 0x7f19c00cfee0 2024-09-13T15:13:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19c5a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00ce0c0 con 0x7f19c01604a0 2024-09-13T15:13:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.50:40400/0 (socket says 172.21.15.50:40400) 2024-09-13T15:13:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 -- 172.21.15.50:0/4191551462 learned_addr learned my addr 172.21.15.50:0/4191551462 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 -- 172.21.15.50:0/4191551462 >> v2:172.21.15.181:3300/0 conn(0x7f19c00cfee0 msgr2=0x7f19c00ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 --2- 172.21.15.50:0/4191551462 >> v2:172.21.15.181:3300/0 conn(0x7f19c00cfee0 0x7f19c00ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 -- 172.21.15.50:0/4191551462 >> v1:172.21.15.50:6789/0 conn(0x7f19c00d38e0 legacy=0x7f19c00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 -- 172.21.15.50:0/4191551462 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00ce3a0 con 0x7f19c01604a0 2024-09-13T15:13:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.397+0000 7f19bea00700 1 --2- 172.21.15.50:0/4191551462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00d16e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009910 tx=0x7f19b0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6946ca922820f86f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19bd600700 1 -- 172.21.15.50:0/4191551462 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0004230 con 0x7f19c01604a0 2024-09-13T15:13:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19bd600700 1 -- 172.21.15.50:0/4191551462 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0004390 con 0x7f19c01604a0 2024-09-13T15:13:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19bd600700 1 -- 172.21.15.50:0/4191551462 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0009e60 con 0x7f19c01604a0 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 -- 172.21.15.50:0/4191551462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 msgr2=0x7f19c00d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 --2- 172.21.15.50:0/4191551462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00d16e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009910 tx=0x7f19b0009c20 comp rx=0 tx=0).stop 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 -- 172.21.15.50:0/4191551462 shutdown_connections 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 --2- 172.21.15.50:0/4191551462 >> v2:172.21.15.181:3300/0 conn(0x7f19c00cfee0 0x7f19c00ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 --2- 172.21.15.50:0/4191551462 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00d16e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 -- 172.21.15.50:0/4191551462 >> 172.21.15.50:0/4191551462 conn(0x7f19c00d2dc0 msgr2=0x7f19c00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 -- 172.21.15.50:0/4191551462 shutdown_connections 2024-09-13T15:13:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.401+0000 7f19c5a00700 1 -- 172.21.15.50:0/4191551462 wait complete. 2024-09-13T15:13:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 Processor -- start 2024-09-13T15:13:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 -- start start 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 0x7f19c014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c00d38e0 0x7f19c00c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00cc630 con 0x7f19c00cfee0 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c9b10 con 0x7f19c00d38e0 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19c5a00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00ca500 con 0x7f19c01604a0 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19bea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 0x7f19c014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19bea00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 0x7f19c014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52184/0 (socket says 172.21.15.50:52184) 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19bea00700 1 -- 172.21.15.50:0/3194322108 learned_addr learned my addr 172.21.15.50:0/3194322108 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19be000700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c00d38e0 0x7f19c00c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.405+0000 7f19bf400700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19bea00700 1 -- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 msgr2=0x7f19c00c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19bea00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19bea00700 1 -- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c00d38e0 msgr2=0x7f19c00c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19bea00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c00d38e0 0x7f19c00c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19bea00700 1 -- 172.21.15.50:0/3194322108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009570 con 0x7f19c00cfee0 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19bea00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 0x7f19c014f3b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009c60 tx=0x7f19b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000bbd0 con 0x7f19c00cfee0 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b001f070 con 0x7f19c00cfee0 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00036c0 con 0x7f19c00cfee0 2024-09-13T15:13:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c00c6f50 con 0x7f19c00cfee0 2024-09-13T15:13:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c00c7510 con 0x7f19c00cfee0 2024-09-13T15:13:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.409+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00ce8c0 con 0x7f19c00cfee0 2024-09-13T15:13:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.413+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19b0021030 con 0x7f19c00cfee0 2024-09-13T15:13:25.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.413+0000 7f19b6a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f19a0066730 0x7f19a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.413+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f19b0085700 con 0x7f19c00cfee0 2024-09-13T15:13:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.413+0000 7f19be000700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f19a0066730 0x7f19a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.417+0000 7f19be000700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f19a0066730 0x7f19a0068bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f19c006d000 tx=0x7f19ac007ee0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.421+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19b0052ac0 con 0x7f19c00cfee0 2024-09-13T15:13:25.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.605+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f19c00ce8c0 con 0x7f19c00cfee0 2024-09-13T15:13:25.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.609+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f19b0052ac0 con 0x7f19c00cfee0 2024-09-13T15:13:25.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.613+0000 7f19b6a00700 1 -- 172.21.15.50:0/3194322108 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7f19b00560e0 con 0x7f19c00cfee0 2024-09-13T15:13:25.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f19a0066730 msgr2=0x7f19a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f19a0066730 0x7f19a0068bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f19c006d000 tx=0x7f19ac007ee0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 msgr2=0x7f19c014f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 0x7f19c014f3b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009c60 tx=0x7f19b0004770 comp rx=0 tx=0).stop 2024-09-13T15:13:25.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 shutdown_connections 2024-09-13T15:13:25.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7f19a0066730 0x7f19a0068bf0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19c01604a0 0x7f19c00c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c00d38e0 0x7f19c00c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 --2- 172.21.15.50:0/3194322108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c00cfee0 0x7f19c014f3b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 >> 172.21.15.50:0/3194322108 conn(0x7f19c00d2dc0 msgr2=0x7f19c00b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:25.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 shutdown_connections 2024-09-13T15:13:25.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.617+0000 7f19c5a00700 1 -- 172.21.15.50:0/3194322108 wait complete. 2024-09-13T15:13:25.639 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:13:25.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.805+0000 7fa127e00700 1 Processor -- start 2024-09-13T15:13:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.805+0000 7fa127e00700 1 -- start start 2024-09-13T15:13:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa127e00700 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa12006a5d0 0x7fa120071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa127e00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1200b19f0 0x7fa12006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa127e00700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200ce140 con 0x7fa1200cd610 2024-09-13T15:13:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa127e00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200b1e60 con 0x7fa1200b19f0 2024-09-13T15:13:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa127e00700 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12006aef0 con 0x7fa12006a5d0 2024-09-13T15:13:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1200b19f0 0x7fa12006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1200b19f0 0x7fa12006a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52200/0 (socket says 172.21.15.50:52200) 2024-09-13T15:13:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 -- 172.21.15.50:0/831606604 learned_addr learned my addr 172.21.15.50:0/831606604 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa125400700 1 --2- 172.21.15.50:0/831606604 >> v2:172.21.15.181:3300/0 conn(0x7fa12006a5d0 0x7fa120071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 -- 172.21.15.50:0/831606604 >> v2:172.21.15.181:3300/0 conn(0x7fa12006a5d0 msgr2=0x7fa120071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 --2- 172.21.15.50:0/831606604 >> v2:172.21.15.181:3300/0 conn(0x7fa12006a5d0 0x7fa120071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 -- 172.21.15.50:0/831606604 >> v1:172.21.15.50:6789/0 conn(0x7fa1200cd610 legacy=0x7fa12006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 -- 172.21.15.50:0/831606604 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200cde60 con 0x7fa1200b19f0 2024-09-13T15:13:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.809+0000 7fa124a00700 1 --2- 172.21.15.50:0/831606604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1200b19f0 0x7fa12006a9b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa1200cc4e0 tx=0x7fa10c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13614d2264994901 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa11fe00700 1 -- 172.21.15.50:0/831606604 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c004230 con 0x7fa1200b19f0 2024-09-13T15:13:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa11fe00700 1 -- 172.21.15.50:0/831606604 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa10c004390 con 0x7fa1200b19f0 2024-09-13T15:13:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa11fe00700 1 -- 172.21.15.50:0/831606604 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0036c0 con 0x7fa1200b19f0 2024-09-13T15:13:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 -- 172.21.15.50:0/831606604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1200b19f0 msgr2=0x7fa12006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 --2- 172.21.15.50:0/831606604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1200b19f0 0x7fa12006a9b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa1200cc4e0 tx=0x7fa10c009bf0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 -- 172.21.15.50:0/831606604 shutdown_connections 2024-09-13T15:13:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 --2- 172.21.15.50:0/831606604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1200b19f0 0x7fa12006a9b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 --2- 172.21.15.50:0/831606604 >> v2:172.21.15.181:3300/0 conn(0x7fa12006a5d0 0x7fa120071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 -- 172.21.15.50:0/831606604 >> 172.21.15.50:0/831606604 conn(0x7fa1200b08d0 msgr2=0x7fa1200b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 -- 172.21.15.50:0/831606604 shutdown_connections 2024-09-13T15:13:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.813+0000 7fa127e00700 1 -- 172.21.15.50:0/831606604 wait complete. 2024-09-13T15:13:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 Processor -- start 2024-09-13T15:13:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 -- start start 2024-09-13T15:13:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 0x7fa120146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1200b19f0 0x7fa1200af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200cd610 0x7fa12015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1201419a0 con 0x7fa12006a5d0 2024-09-13T15:13:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12013f8d0 con 0x7fa1200cd610 2024-09-13T15:13:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa127e00700 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12013fbb0 con 0x7fa1200b19f0 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 0x7fa120146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 0x7fa120146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52216/0 (socket says 172.21.15.50:52216) 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 -- 172.21.15.50:0/120615526 learned_addr learned my addr 172.21.15.50:0/120615526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa124a00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1200b19f0 0x7fa1200af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200cd610 0x7fa12015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 -- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1200b19f0 msgr2=0x7fa1200af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1200b19f0 0x7fa1200af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 -- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200cd610 msgr2=0x7fa12015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.817+0000 7fa125400700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200cd610 0x7fa12015ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa125400700 1 -- 172.21.15.50:0/120615526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c009570 con 0x7fa12006a5d0 2024-09-13T15:13:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa125400700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 0x7fa120146010 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa11400d800 tx=0x7fa11400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1140125f0 con 0x7fa12006a5d0 2024-09-13T15:13:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa114012750 con 0x7fa12006a5d0 2024-09-13T15:13:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114012ae0 con 0x7fa12006a5d0 2024-09-13T15:13:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1201415c0 con 0x7fa12006a5d0 2024-09-13T15:13:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12013fe90 con 0x7fa12006a5d0 2024-09-13T15:13:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.821+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa120141c10 con 0x7fa12006a5d0 2024-09-13T15:13:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.825+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa114012c40 con 0x7fa12006a5d0 2024-09-13T15:13:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.825+0000 7fa11d600700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa100066730 0x7fa100068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.825+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa114084320 con 0x7fa12006a5d0 2024-09-13T15:13:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.825+0000 7fa124a00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa100066730 0x7fa100068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.825+0000 7fa124a00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa100066730 0x7fa100068bf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa1200cc4e0 tx=0x7fa10c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:25.833+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1140515c0 con 0x7fa12006a5d0 2024-09-13T15:13:26.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.049+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa120141420 con 0x7fa12006a5d0 2024-09-13T15:13:26.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.049+0000 7fa11d600700 1 -- 172.21.15.50:0/120615526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fa120141420 con 0x7fa12006a5d0 2024-09-13T15:13:26.053 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-13T15:13:26.053 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/1074967159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":1074967159},{"type":"v1","addr":"172.21.15.181:6837","nonce":1074967159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7531,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/720057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":720057},{"type":"v1","addr":"172.21.15.181:6835","nonce":720057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2115290179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2115290179},{"type":"v1","addr":"172.21.15.50:6834","nonce":2115290179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2140389552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2140389552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2140389552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[]} 2024-09-13T15:13:26.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa100066730 msgr2=0x7fa100068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa100066730 0x7fa100068bf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa1200cc4e0 tx=0x7fa10c008030 comp rx=0 tx=0).stop 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 msgr2=0x7fa120146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 0x7fa120146010 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa11400d800 tx=0x7fa11400db10 comp rx=0 tx=0).stop 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 shutdown_connections 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:6832/3430379714,v1:172.21.15.181:6833/3430379714] conn(0x7fa100066730 0x7fa100068bf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200cd610 0x7fa12015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1200b19f0 0x7fa1200af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 --2- 172.21.15.50:0/120615526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12006a5d0 0x7fa120146010 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.053+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 >> 172.21.15.50:0/120615526 conn(0x7fa1200b08d0 msgr2=0x7fa1200cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.057+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 shutdown_connections 2024-09-13T15:13:26.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-13T15:13:26.057+0000 7fa127e00700 1 -- 172.21.15.50:0/120615526 wait complete. 2024-09-13T15:13:26.060 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-13T15:13:26.083 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T15:13:26.084 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T15:13:26.084 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:13:26.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:26.108 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:13:26.108 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:13:26.108 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:26.171 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:13:26.171 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:13:26.171 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:26.190 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:13:26.191 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:13:26.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:26.260 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:13:26.260 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T15:13:26.260 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T15:13:26.261 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:26.351 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T15:13:26.351 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T15:13:26.352 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:29.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-13T15:13:32.454 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T15:13:32.455 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T15:13:32.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:32.547 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T15:13:32.548 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T15:13:32.548 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:35.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T15:13:35.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-13T15:13:36.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:36.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:38.650 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T15:13:38.650 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T15:13:38.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:38.744 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T15:13:38.745 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T15:13:38.745 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:40.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T15:13:40.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T15:13:44.847 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T15:13:44.848 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T15:13:44.848 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:44.932 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T15:13:44.932 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T15:13:44.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:46.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T15:13:46.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T15:13:51.035 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T15:13:51.035 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T15:13:51.036 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T15:13:51.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:51.102 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T15:13:51.103 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T15:13:51.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:51.174 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T15:13:51.175 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T15:13:51.175 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T15:13:51.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:51.218 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T15:13:51.218 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T15:13:51.218 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:51.256 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T15:13:51.257 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T15:13:51.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:51.328 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T15:13:51.329 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T15:13:51.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'client session with non-allowable root' | head -n 1 2024-09-13T15:13:51.388 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:13:51.389 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T15:13:51.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T15:13:51.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:13:51.868 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T15:13:52.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:13:52.079 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T15:13:52.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:13:52.290 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T15:13:52.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:13:52.538 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T15:13:52.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:13:52.859 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T15:13:53.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:13:53.045 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T15:13:53.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:13:53.267 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T15:13:53.468 INFO:tasks.ceph:Archiving mon data... 2024-09-13T15:13:53.469 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/data/mon.a.tgz 2024-09-13T15:13:53.469 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-13T15:13:53.486 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.4e6mvO2RYd 2024-09-13T15:13:53.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4e6mvO2RYd 2024-09-13T15:13:53.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.4e6mvO2RYd 2024-09-13T15:13:53.783 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.4e6mvO2RYd is 524KB 2024-09-13T15:13:53.864 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.4e6mvO2RYd 2024-09-13T15:13:53.882 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/data/mon.b.tgz 2024-09-13T15:13:53.883 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T15:13:53.901 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.lM0ShRapU3 2024-09-13T15:13:53.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lM0ShRapU3 2024-09-13T15:13:54.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.lM0ShRapU3 2024-09-13T15:13:54.231 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.lM0ShRapU3 is 668KB 2024-09-13T15:13:54.311 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.lM0ShRapU3 2024-09-13T15:13:54.329 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/data/mon.c.tgz 2024-09-13T15:13:54.329 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T15:13:54.390 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.l8xBV8Sa4L 2024-09-13T15:13:54.391 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.l8xBV8Sa4L 2024-09-13T15:13:54.624 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.l8xBV8Sa4L 2024-09-13T15:13:54.717 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.l8xBV8Sa4L is 668KB 2024-09-13T15:13:54.799 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.l8xBV8Sa4L 2024-09-13T15:13:54.818 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T15:13:54.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T15:13:54.824 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T15:13:54.892 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T15:13:54.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T15:13:54.906 DEBUG:teuthology.orchestra.run.smithi181:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T15:13:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T15:13:54.985 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T15:13:54.999 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T15:13:55.001 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/remote/smithi050/crash 2024-09-13T15:13:55.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T15:13:55.036 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/remote/smithi181/crash 2024-09-13T15:13:55.037 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T15:13:55.073 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T15:13:55.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:55.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:55.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:55.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T15:13:55.246 INFO:tasks.ceph:Compressing logs... 2024-09-13T15:13:55.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:13:55.262 DEBUG:teuthology.orchestra.run.smithi181:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:14:00.771 INFO:tasks.ceph:Archiving logs... 2024-09-13T15:14:00.771 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/remote/smithi050/log 2024-09-13T15:14:00.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T15:14:01.872 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/remote/smithi181/log 2024-09-13T15:14:01.873 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T15:14:02.489 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T15:14:02.499 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T15:14:02.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T15:14:02.506 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T15:14:02.616 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T15:14:02.625 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T15:14:02.625 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:14:02.631 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:14:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:14:02.672 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-13T15:14:02.672 INFO:teuthology.orchestra.run.smithi050.stdout:+hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.083 -0.594 0.447 2024-09-13T15:14:02.672 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 1 64 377 0.111 0.656 0.492 2024-09-13T15:14:02.672 INFO:teuthology.orchestra.run.smithi050.stdout:*hv03.front.sepi 74.6.168.72 3 u 11 64 377 0.101 -0.985 0.318 2024-09-13T15:14:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-09-13T15:14:02.674 INFO:teuthology.orchestra.run.smithi181.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:14:02.674 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================== 2024-09-13T15:14:02.674 INFO:teuthology.orchestra.run.smithi181.stdout:*hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.107 1.039 0.326 2024-09-13T15:14:02.674 INFO:teuthology.orchestra.run.smithi181.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.116 2.136 0.137 2024-09-13T15:14:02.675 INFO:teuthology.orchestra.run.smithi181.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.110 0.503 0.238 2024-09-13T15:14:02.675 INFO:teuthology.orchestra.run.smithi181.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-09-13T15:14:02.676 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T15:14:02.685 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T15:14:02.686 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T15:14:02.748 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T15:14:02.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T15:14:02.780 INFO:teuthology.task.internal:Duration was 1106.518077 seconds 2024-09-13T15:14:02.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T15:14:02.791 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T15:14:02.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T15:14:02.797 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T15:14:02.948 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T15:14:02.948 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-13T15:14:02.948 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T15:14:02.983 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T15:14:02.983 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T15:14:03.016 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T15:14:03.017 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:14:03.034 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:14:03.126 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T15:14:03.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T15:14:03.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T15:14:03.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T15:14:03.272 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T15:14:03.273 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T15:14:03.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T15:14:03.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T15:14:03.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:14:03.360 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:14:03.391 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-13T15:14:03.419 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-13T15:14:03.456 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:14:03.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:14:03.484 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:14:03.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:14:03.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T15:14:03.528 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T15:14:03.529 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/remote/smithi050 2024-09-13T15:14:03.529 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T15:14:03.574 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903707/remote/smithi181 2024-09-13T15:14:03.575 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T15:14:03.617 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T15:14:03.617 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T15:14:03.623 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T15:14:03.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T15:14:03.687 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T15:14:03.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T15:14:03.697 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T15:14:03.697 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T15:14:03.702 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T15:14:03.717 INFO:teuthology.orchestra.run.smithi050.stdout: 1181012 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 15:14 /home/ubuntu/cephtest 2024-09-13T15:14:03.737 INFO:teuthology.orchestra.run.smithi181.stdout: 1181012 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 15:14 /home/ubuntu/cephtest 2024-09-13T15:14:03.743 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T15:14:03.754 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T15:14:03.781 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} duration: 1106.518077135086 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T15:14:03.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:14:03.890 INFO:teuthology.run:pass